Saturday, May 24, 2014

When Data Are Not Data

My favorite story of the last week ran in Valerie Strauss's "The Answer Sheet" on the Washington Post site and dealt with Arne Duncan's reaction to the increasingly loud chorus of VAM debunkers.

The research showing VAM as ineffective is piling up. Research by Polikoff and Porter eviscerated, finding no real predictive power and suggesting that what VAM measures is not what we mean when we say "good teaching." That study was particularly telling because it had large piles of Gates dollars piled up behind it.

Perhaps my favorite VAM study was performed by Marianne P. Bitler who showed that VAM predicts a teacher's effect on student test score growth about as well as it predicts the teacher's effect on the student's height.

People who play with this type of statistical analysis have been warning that VAM was not solid for five years now, but now in addition to the professional opinions of people who do this sort of thing for a living, we have actual studies by actual scientists with actual-- what is that stuff called? Oh yeah-- DATA!

Don't we love data now? Isn't the whole foundation of the VAM system the idea that it's cold, hard data, with like numbers and stuff, so we know it has to be right. So wouldn't the US DOE want to make use of all this handy data that's rolling in about VAM? Here's the response that Strauss reports from the DOE:

Including measures of how well students are learning as part of multiple indicators of educator effectiveness is part of a set of long-needed changes that will improve classroom learning for kids. Growth measures are a significant improvement over the system that existed before, which failed to produce useful distinctions in teacher performance. Growth measures — including value-added measures — focus attention on student learning and show progress. While these measures are better than what existed before, educators will continue to improve them, and sharp, critical attention from the research community can help.

Strauss is a real journalist, so she simply reports this quote with little comment. I am not a real journalist, so I can go ahead and say this-- what a load of bullshit.

It is a distilled version of the Reformster narrative. We know (because, you know, we just know) that there are a whole ton of terrible teachers out there. The old evaluation system doesn't show the existence of these gazillion horrible educators, so the old system must not work. We will look for a new system that does work, and we will have proof that it works when it confirms our belief that a huge number of American school teachers suck. VAM may not work any better than tea leaves or reading the bumps on a frog, but it tells us that many teachers suck, and that's good enough for us and certainly an improvement of the old system.

The spokesperson also indicated that the US DOE keeps track of the research.

So bottom line-- Duncan's office knows that VAM is crap. They just don't particularly care. Because data are only data when they say what you want them to say.

AP A-OK?

The US DOE, among its many promotional and marketing activities, has been pushing hard for AP classes. This week they aimed loud praise noises at the state of Colorado for increasing AP participation in the state. The laudatory article declares success because more students take and pass the AP courses.

But before parents and students get too excited about the spreading and blooming of AP courses, they should remember a few simple facts:

AP Is A Business, Not A Public Service

AP tests are a product of the College Board, the same people who bring you the SAT, and although the name seems to suggest a group of college scholars who gather together on some altruistic mission to guard the gateways of higher education for the Greater Good, the fact is that the College Board is just a business intent on making a buck and keeping its market share (it is also currently run by David Coleman, one of the co-authors of the Common Core).

Every time a teacher goes to a seminar to learn about designing an AP course, the AP folks make money. Every time a school buys AP materials, the AP folks make money. And every time a student takes the AP test, the AP folks make money-- a bunch of money. 

It was a great day for these folks when they hopped on the Education Reform Gravy Train and became the Official Education Course Product of Race to the Top. In Pennsylvania, for instance, a school's rating factors in how many AP courses are offered. This is extraordinary, like Ford getting the government to rate school district excellence based on how many Ford school buses they used.

You May Get Absolutely Nothing For Your $$

AP stands for Advanced Placement. The whole point of AP is supposed to be that you take the exam, get a good score, and your college gives you either course credit or a higher placement. In other words, you get to either replace English for Dopes with a higher level course, or you get credit for the course without ever having to take it. The second option is appealing to students; it's not quite so appealing to colleges, because it amounts to giving away free credits. And here's the important point to remember--

What you get, or not, is completely at the discretion of your college or university.

Many schools prefer that you learn things their way. (“We want a Dartmouth education to take place at Dartmout.”) They may not grant AP credit within your major (which is likely to be your strongest AP showing), and they definitely may not be in the mood to give away credits for free. The College Board folks pooh-pooh these sorts of trends, just as they pooh-pooh the plummeting market share of the SAT test and the growing tendency of colleges not to require it, but if you think dropping $90 on the AP test is going to pay off in college, you may be better off buying your kid a nice outfit to wear to the interview.


This chart can talk about the students who "qualified for college credit" but it's baloney. Nobody is qualified for college credit until the college offers it. (The chart also provides a quick guide to how huge a financial windfall Race to the Top has provided for the College Board).

Is There No Value?

One of the odd positives in the AP marketing scam is leverage for teachers. Where administration might in the past simple axed any requests for resources by classroom teachers, the AP marketing boondoggle gives teachers a new magic power. "Well, if you want to offer AP Basketweaving," says the teacher, "You are going to have to give us double-lab periods and buy these super-duper books."

AP also has the virtue of being a loose framework. When we "added" our first AP English course, we only had to perform some minor tweakage on the honors program we already had in place. But now, you know, it was AP!!!!!!! (use your super-hero voice) and so it was totally awesome. I used to call AP the alligator on a polo shirt, and little has happened to change my mind. It's savvy marketing, but it comes without handcuffs or a program in a box. I guess it says something about the current state of education that it qualifies as one of the less malignant tumors growing on the heart of schools these days.

[Update: Annnnd I had to take back some of those nice words about the loose framework almost immediately.]

What! Already?

The end of May is always hard. Tests, prom, yearbook distribution, my birthday, and suddenly it's finals and summer vacation. Already? Seriously?

I know there are teachers who count down to the first day of summer vacation like it's Christmas morning. I am not one of those teachers. For me it's more like the countdown of a ticking bomb.

There has never been enough time in the year. When I started teaching, it was my own fault-- I just couldn't find the most efficient rhythm for getting through everything I wanted to teach my students. With every year, I got better, cutting away the chunks of unit that didn't really serve my students well, learning when to lean hard and when to lay back before I burned them out, discovering how to dovetail units and piggyback goals. And I became so much faster at grading, assessing, general paper turnaround.

But at the same time, more has been piled on. Testing and pre-testing and test-prepping began to eat larger and larger chunks of the school year, and no matter how hard I juggled, I had to drop some balls so that I could manage the chainsaws that our Education Leaders were throwing at me. This is part of the gig, one of those parts they don't tell you about in teacher school.

They don't tell you you'll never have enough time to do everything you know you need to do. They don't tell you just how finite are the 180 (or so) days that you have with your students. They don't tell you how summer vacation can be rejuvenating, but also disorienting.

Every June, every teacher loses his job. Most of us know we'll have a new job in the fall, but it will be a slightly different job, working with a different group of people doing work that's similar, but not exactly the same because the conditions and students will be new. My wife is going to wrap up her first full year of first grade, and I know when the day comes that she has to say goodbye to these students she's given her heart to, she's going to cry a bunch. But the job we've just spent nine months on-- it's over.

I'll fill the time. My wife and I will spend time and travel together. I'll play in our community band and do some directing for community theater; these are things I enjoy, but also things that allow me to put something back into a community that pays me. I'll read, and I'll try to figure out some new tricks for making next year's job better than this year's.

I am not complaining. Not a bit. American education's tradition of giving students the summer to help with the family farm is weirdly anachronistic, but the result is a huge blessing and benefit for me and I am grateful for it.

But still-- can't I have one more week? Even a few more days? There are so many things I wanted to do with these guys, and I crammed as much into my 178 days as I could, but -- I need more. And when this job that I've poured myself into stops, it's like setting my foot down expecting a step and finding instead nothing. Yes, I'm a bit frayed right now, but I'm also strengthened by knowing when I get up in the morning I'm heading off to do important work, work that matters, work that allows me to be my own best self. When summer comes, it's hard not to miss that a little.

We live where we are, when we are. We grab whatever is here, now, and we embrace it and live it and try to go all Thoreau on it. My heart goes out to those teachers who are teaching far harder trenches than mine; God bless them with the respite they need.

But for me, this is one of the hardest times of the year. So much to do. So little time.

Friday, May 23, 2014

Pearls, Triggers, Exonians & Checker

The trigger warnings issue has now reached a massive level of pearl clutching all around.

What's the Issue?

We know that trigger warnings are a thing because the New York Times wrote about them last Sunday. The basic idea seems to be that certain works of literature, classroom subjects, even statues, should come with warning labels attached because they might trigger a traumatic memory or reaction of some sort. Trapped in a classroom and suddenly confronted with a graphic reminder of a traumatic personal experience, a student could suddenly be overwhelmed by panic, fear, discomfort.

On the one hand, there's a certain amount of common sense at play here. When I have a student who is suffering through the difficulty of a recent or imminent death of a loved one, I pay special attention to how any of the 482 death-related literary works that we study might strike that student's particularly raw nerve. I do anything from soften the discussion of the work to prepare the student ahead of time for what's coming. And I am always conscious of the fact that there may be other similarly raw nerves in my classroom that I just don't know about.  I don't really do this as a pedagogical choice, but as a human one.

Are Those Crazy Kids Out of Line?

On the other hand, some of the campus pearl clutchers seem a bit overzealous about stamping a warning label on any potentially upsetting content, and there seems to be a rather fuzzy zone between triggering a real personal trauma and just being kind of uncomfortable. I find it hard to imagine, as one advocate suggests, that The Merchant of Venice might trigger a serious episode of panic and distress because of its anti-Semitism (the presence of which is open to some debate anyway).

Fahrenheit 451 (a far more believable and hence scarier dystopic novel than 1984) posits a world of censorship that is not the result of top-down totalitarian mind-control, but instead censorship from the bottom up, caused by people demanding that anything disturbing or upsetting or uncomfortable be whisked away from public view. I think that's a fair comparison here.

But before I get my own pearls twisted up in my knickers, I remind myself that trigger warnings are a thing that some college students are asking for, and college students ask for a lot of things. We periodically hear about these movements sweeping campuses, and then it turns out, not so much. College faculties are not so excited about this idea, and colleges have an oft-effective means of dealing with troublemakers-- give them a diploma and send them away. So I'm not ready to get excited about this yet, and we can probably all calm down and---

No, Wait. Too Late.

The phrase "trigger warning" itself needs a trigger warning, because the term comes from the world of feminism, and you know how feminism gets some people's pearls all clutchified.

Like Chester E. Finn, Jr., currently head honcho at The Fordham Institute. Checker wrote a piece for Politico which has a url-based title of "Will America's College Kids Ever Grow Up" but which is headlined "America's College Kids Are of Mollycoddled Babies." And boy, if "mollycoddled" doesn't evoke some serious pearl-clutching, I don't know what does.

Finn is a smart man, an accomplished and prolific writer, and a conservative guy who often says things I quite agree with. But although he's a mere thirteen years older than I am, in this piece he sounds for all the world like my grandmother.

Poor dears. These are the same kids who would riot in the streets if their colleges asserted any form of in loco parentis when it comes to such old-fashioned concerns as inebriation and fornication. God forbid they should be treated as responsible, independent adults! After all, they’re old enough to vote, to drive, even (though it’s unlikely) to join the army.

Yes, we all remember those awful pro-fornication campus riots of.... when exactly was that, again? Well, it doesn't matter. Kids These Days, with the rap music and playing with their twitters and the backwards hats and not getting jobs and not joining the army. Pull up your pants and get off my lawn!!
Those Darn Miserable Stinky Fershlugginer Kids!

While I usually stick with mockery and avoid ad homineming it up, since Finn just ad hominemed all current college students, I'm going to make an observation or two. First, born in 1944, Finn would have come of age just in time to serve in Vietnam, yet curiously, I find no mention of that service in any of his bios. His bios do mention his education at Phillips Exeter Academy and Harvard. I did not attend Harvard, but I'm pretty sure that mollycoddling is tolerated there to a considerable degree; in fact, many students arrive pre-mollycoddled. But then, I think Finn knows this.

He goes on to contrast traditional four-year college students with good, solid, dependable job-holding, family-supporting, career-minded folks that you can find at community colleges, trade schools and the University of Phoenix (so, clutching some cyber-pearls). These traditional students have "been accustomed to getting their own way with just about everything, hovered over and indulged by their parents, praised (and grade-inflated) by their teachers and carefully cushioned from every form of risk, adversity and hardship."

Did I say pearl clutching? Finn has grabbed his pearls and is swinging them around, flailing angrily at these damn kids. They go to barely fifteen hours of classes a week. They gorge themselves on copious food options. They dare to protest speakers they disagree with. They use elaborate exercise and recreation facilities. They are awash in political correctness, self-absorption and "spoiled bratism." They are prissy. They are "schizy and spoiled." They will make terrible leaders in the future.

What are we to make of this child of privilege so filled with rage at the children of privilege? When he says that they've been "carefully cushioned from every form of risk, adversity and hardship," what exactly is he gauging that against? Because I am pretty sure that Chester E. Finn, Jr. has not spent a lot of time developing grit out on the mean streets. I don't know-- maybe Harvard was a tough go for Checker. But clearly, young people complaining about things are a huge trigger for him. I mean, seriously-- I've read his stuff before and I have never seen him so angry and ranty. You would think that Kids These Days are the softest, whiniest, most terriblest students ever in the history of ever. Spiro Agnew on his worst day did not dismiss a chunk of young America so completely, and Spiro didn't even go to Harvard.

Surprise Personal Insight

True story. My father is also a graduate of Phillips Exeter Academy, but he attended as a townie. His wealthy classmates went on to Harvard, but he went on to the University of New Hampshire. My father was the son of a general contractor; Chester Finn, Sr. was a prominent Dayton attorney. My father was the only member of his family to ever attend such a prestigious school; Chester Finn, Jr. is a third generation Exonian. So I guess if anyone had cause to be bitter and cranky about the children of prep school privilege, it would be my father, but he's not. Never has been.

More true story. My folks sent me to Phillips Exeter for a six week summer session. It was one of the great experiences of my life. The library was a gorgeous dream, the theater building the envy of most colleges.

The summer session brought together people from all over; most of us were nicknamed by our home city or state. I learned much. I learned that rich kids don't always have it easy, and poor kids don't always have it hard. I learned that rich is a relative thing.* I learned that when you have people from many backgrounds, it's good to think before you open your mouth because you might trigger someone's anger or hurt without even meaning to.

At the end of the day, the whole trigger notice brouhaha appears to be a bunch of folks just clutching pearls at each other. Am I being too simplistic when I suggest that just being kind and considerate and thoughtful, that just listening to people without scolding them for whatever imagined slights you think they have committed or are about to commit, that just treating each other decently would allow all of us to just put down our pearls and take a break? Because that looks like a path forward to me, even if I never went to Harvard or the University of Phoenix.



*This is my best Phillips Exeter summer school story, and while this piece is already way too long, I never get a chance to tell this one. So here it is a s a footnote; you can skip it all you want.

It was the summer of 1973. We would hang out in the dorm lounge and tell stories about home. We regularly made fun of one foreign kid who kept telling us about his country where every single citizen was rich, and every citizen got a share of the oil money, free health care, free college, free everything. We teased him and accused him of making it all up. He just laughed and said we could believe him or not; he would own us all one day. We had never even heard of his country before; we thought he made the name up, too. The country was Kuwait.

Tyranny of the Test

When Michelle Obama spoke up in support of the arts this week, I was not moved. In fact, I was bummed. Because her "defense" of the arts was simply one more sign that we live under the Tyranny of the Test.

The bottom line here is very clear: Arts education isn't something we add on after we've achieved other priorities, like raising test scores and getting kids into college. It's actually critical for achieving those priorities in the first place.

So there you have it. The arts are not in and of themselves important. They're important because they help us with what really matters, and that's raising test scores. So....what? Art and music have no value out in the world outside of school? They are just a tool, a trick to get students "in the seats" so that we can do the real work? If we didn't have the test scores to raise, cutting the arts from education would totally make sense?

Apparently that would make sense in Boston, where the public school system has announced that the History and Social Studies Departments are being eliminated. The school district has been quick to clarify that these departments and areas of study aren't being done away with--  they are "attempting to embed History and Social Studies education" into the "bigger picture."

What that appears to mean is that the departments will be folded into the English Language Arts department, the better to develop laser-like focus on the Test.

Or to put it another way, Boston Schools are taking a step to align the very organization of their instruction to the organization of the Test. Boston is boldly institutionalizing its devotion to Test Prep (you know-- the test prep that is totally not happening any more since we've moved on to Common Core).

This is the tyranny of high stakes testing. This is using a testing instrument to warp and distort the very idea of what it means to be a well-educated person. A well-educated person, it turns out, is one who gets good math and ELA scores on the Test-- nothing else matters. The longer we let this foolishness continue, the more we are going to suffer as a society from our small, cramped narrow vision of what it means to be human. Surely we can aspire to greater things for ourselves and for our children than simply to make good numbers on a bad standardized test.

UPDATE:
Boston schools have either clarified (or backtracked, depending on your level of paranoia) that no combining, deleting or otherwise screwing with the departments will be happening. You can read all about it here. They apologize for communicating poorly and assure us all that The Worst is not happening. So, good news.

Why Students Drop Out

This pooped up on twitter a few days ago




And, because I'm always interested in what Arne has to say, I followed the link. And I think Arne maybe didn't actually read it.

The link goes to a report from Gradnation, a project of the America's Promise Alliance that addresses the problem of students not finishing school. Here's what they found out.

Explaining why young people leave high school is at once quite simple and overwhelmingly complex. Young people’s words often illustrate the interplay among factors like absent parents, the impact of violence close to home, negative peer influences, and a sense of responsibility for others.

Researchers found s cluster of twenty-five factors that influenced decisions about school, including adults, family upheaval, safety, peer influence and becoming a parent. Toxic environments at home were a huge factor, and school was not always found to be a safe alternative.


The researchers also found that a desire for some sort of human connection also drove much of the behavior. Students who left school often cited a failure to find a connection with a caring adult in the school.

Contrary to what grittologists might suggest, researchers found that the young people leaving high school often displayed considerable courage, resilience, persistence and personal agency. They had the toughness; what they lacked was some help and guidance in directing it.

The researchers concluded :

1) Students who leave school are stronger than current conventional wisdom says.

2) Students who leave school often do so because they face huge life challenges that "push school attendance far down their priority list."

3) They find it easier to not attend than to attend, or to start back in again.

4) They emphasize how important connections to parents, peers and other adults matter.

5) Everyone in a young person's life can help.

And the researchers offer these concrete recommendations:

1) Listen

2) Provide at-risk students with extra support

3) Community "navigators" are needed to help students stay in school.

4) Follow the evidence of what works

5) Place young people in central leadership roles to design and implement solutions

I don't know who these folks are (though the website has a nice picture of Colin Powell on it) but the results of this study make sense to me, so it passes that sniff test. I suspect may not be super-rigorous and feels urban-skewed.  But here's the thing. This was a recommendation from Arne's own tweet (or Arne's own intern's own tweet-- I still have my doubts). Please notice, Arne, the things it does not say:

It does not suggest that students drop out because school is not rigorous enough.

It does not suggest that teachers are the most important factor in whether or not the student stays.

It does not suggest that a super-duper high stakes testing program would make things better.

And it especially does not say-- in fact says the opposite-- that what these kids need is a swift kick in the pants and a push to develop more grit and persistence.

So I am grateful to Arne for tweeting this link. Now I wish he would read it himself.

Thursday, May 22, 2014

Did President Obama Ruin CCSS?

It's Obama's fault.

The state-led initiative was chugging right along, moving forward without any interference from the feds, when somehow, they decided to leap in. Or as Kentucky Education Commissioner Terry Holliday recently put it, things were fine "until the President and secretary of education took credit for the Common Core."This is part of the current conservative CCSS support narrative (you can find put forth by, among others, the boys over at the Fordham). The story goes something like this:

Once upon a time, some noble governors and dedicated corporate guys got together and created the Common Core, and people pretty much thought it was swell. Then the Obama administration tried to get involved with cheerleading and with Racing to the Top and NCLB waivers. This was a Bad Thing because it woke up the Tea Party folks, who began shrieking about federal over-reach. People who wouldn't have cared one way or another suddenly were against it because Obama was for it and whatever he's doing, it must be evil. If the feds had just stayed home and tended to their knitting, we would not be having all this CCSS fracasization.

Isn't it pretty to think so. Here's why there is no alternate timeline based on those halcyon days before the feds got involved, before CCSS was gone with the DC wind.

There Was Never A "Before the Feds Got Involved."

Even if we pretend that the feds weren't involved from day one, even if we pretend that the feds haven't been angling for this for several administrations, even if we pretend that the Obama administration wasn't sponsoring slumber parties and buying the refreshments for CCSS-writing parties, the feds must still take responsibility for the prime motivator for the whole mess.

States were not open to CCSS because of some burning desire to revamp their education systems. They were all sitting on the ticking time bomb that was (actually, is) No Child Left Behind, otherwise known as ESEA, otherwise known as federal law. The feds were always involved. Always.

Corporations Are Not Lazy

For Pearson et al, CCSS represent a marketing opportunity sent from heaven. CCSS opened up the US education market faster and more completely than a velociraptor fileting a sleepy cow. To open a national market, they needed national standards, not the state-by-state patchwork of the past. They were always going to use every tool at their disposal to make this happen across the entire country, and that toolbox includes the federal government.  

Pearson et al were no more going to sit and wait while each state made up its mind about the CCSS than General Dynamics would ever say, "Just send that tank model over to the Pentagon, step back, and just let them make up their minds on their own." Money was at stake. There was no way that Pearson et al was not going to "encourage" its "friends" on the federal level to push CCSS hard.

It's Not Like The CCSS Sell Themselves

Who can seriously argue that all the states were going to say, "Yeah, we should totally implement this untested set of standards, sight unseen. Especially since they come with a huge price tag. Yes, let's do it." Particularly states that had perfectly good standards already. "Now that we've paid off this beautiful Lexus, let's junk it and get a Yugo for twice the cost," said no car owner ever,

No, a wave of bribery (Race to the Top) was needed to get the ball rolling. Or do you seriously want to suggest that states would have raced toward the Core for free. And when states wouldn't fall in line for the bribe, we moved on to the extortion-- "I'd hate to see anything happen to your state just because of some crazy No Child Left Behind law; you should really consider getting our special protection waiver plan."

Selling CCSS required a federal-sized stick and a DC calibre stick. States do not generally volunteer for massive unfunded mandates. Only a federal-sized sales job would do, even if it had to be carefully calibrated to avoid looking illegal.

Because, Politics

Education is the cute fluffy bunny of politics, the one that plays in happy fields far away from third rails. Any politician who has an excuse to pick up the bunny for a photo op will do so because, up until recently, there was no down side. Being in favor of good schools and teaching children was a guaranteed win. It's a measure of how big a botch the CCSS complex is that it has actually turned education into a thorny issue.
 
So say what you like. It's impossible for the administration to have avoided involvement in CCSS. And if by some miracle it had kept its hands off, CCSS would now be an interesting experimental set of standards being tried out in four or five states, maybe. It's true that Obama didn't do CCSS any favors, but it would have died on the vine without him.