Is PISA Data Useless?

Yes, if you're a regular reader, then you know I think it's rather useless anyway.

But in April this story dropped. Folks had begun a mild-tomedium freakout because the East Asian PISA math superpowers (South Korea, Taiwan, Hong Kong, Singapore, etc), the people whose program everyone else was trying to imitate, had seen their scores start to drop. 

But now Andreas Schleicher, the official in charge of Pisa, has said that this fall may not be due to a drop in the performance of these Asian powerhouses. He said he was looking into whether the decline could be explained by the fact that Pisa used computers for the main tests for the first time in 2015.

In other words, data that is clearly presented as “comparable” in the study may not be comparable at all.

Which means the whole longitudinal game of charting PISA scores over time could be ruined, all those nifty charts now meaningless.

There's another implication here as well. The Testocrats have been quietly assuming that taking a Big Standardized Test on a computer is exactly like taking it on paper. But what if that's not true? What if taking a math test involves not only math skills, but test-taking skills. And what if computer test-taking skills are not the same set of skills as pencil-and-paper test-taking skills?

What if the Big Standardized Tests aren't really measuring what they purport to measure at all, and the whole test-centered education model is built on a sham?

A Better PARCC/SBA Test Prep Program

You may recall the old SAT vocabulary lists. Dozens of test prep lists that promised to get you ready for the SAT because their creators had pored through and broken down dozens upon dozens of old SAT tests, and here they were-- the 50 or 100 or 500 words that most commonly appeared on the test.

Of course you remember these lists, because they totally worked. While the SAT allegedly tested reasoning, mostly what all those analogies and other nifty word puzzles tested was your vocabulary, and having a list of the most likely vocabulary on the test ahead of time was a great way to make your studying more direct and efficient. Cheating...? Well, that's quite a philosophical conundrum, isn't it-- if someone creates an artificial obstacle between you and a goal, and the obstacle is not only artificial, but rather unfair and designed mostly to serve their needs at your expense, is "cheating" even really a possibility? If the game is rigged and somebody else is forcing you to play it, do you have an ethical obligation to follow their rules to the letter?

But I digress.

The point is, Amplify is offering just that sort of test prep for the PARCC and SBA.

Amplify, you will recall, was going to be Rupert Murdoch's big shot at hoovering up some of those sweet sweet public education tax dollars. Instead, it limped its way to being bought by Joel Klein and other big whoopdie doo education privateers who had been brought in to run the place. Their most spectacular disaster was the Los Angeles ipad fiasco, but mostly they've been a company of high-rolling education amateurs.

So they've been doing their homework, including poring through and breaking down old PARRC and SBA reading tests.

These new-generation tests have always pretended to be two impossible things. 1) A test that is impervious to test prep, so don't even try, just go about regular educating stuff and we will accurately measure that. 2) A test of reading skills that are somehow divorced from any sort of content knowledge.

The second is a deeply impossible thing-- divorcing reading from content is like divorcing kissing from touching. It can't really be done, and so every reading test is inescapably a test of prior knowledge.

With that in mind, wouldn't it be helpful to know what prior knowledge would be helpful? Sure it would-- and the folks at Amplify know. They even have a nifty graphic:

There's your top ten content areas--  US History, Folk Tales, Human Biology, Historical Fiction, Contemporary Realistic Fiction, Classic Children's Fiction, Immigration, Astronomy and Space, Engineering, Animals & Ecology. But not sports. This is what your K-5 students should be reading about to get ready for the test.

Oh, and Amplify wants you to know one other thing:

We also found that students who had studied our K-5 Core Knowledge Language Arts^® (CKLA^™) curriculum would have prior knowledge relevant to more than 75% of passages reviewed on summative tests like PARCC and SBAC.

I'm sort of impressed by their honesty. No "CKLA provides for excellent development of language skills that will better prepare your students for college and career by meeting high standards etc etc blah blah blah." Instead, just a plain and simple "Buy our program. It's excellent test prep, because it teaches the content they're likely to be tested on."

It's not quite selling an early peek at the test, so I suppose it's not exactly cheating. It's just not exactly education, either.

Pennsylvania Recap (Call Your Legislator)

I don't usually do this, but it seems like a good moment to pause and gather up some of the more recent news from Pennsylvania, because it's becoming difficult to keep track of all the lousy ideas in Harrisburg right now. If you are in Pennsylvania, here's some food for thought for the next time you contact your elected representative (and that time should come early and often).

School Funding Emerges From Time Warp

Funding formula continues to be an issue. Last summer, we were starting to sort things out, but it remains to be seen if Governor Wolf and the GOP legislature can do a deal.

Testing Stutter Steps

The Keystones are currently paused, but that pause is just about done. Legislators need to be encouraged to push pause for, oh, forever in regards to using the lousy tests as graduation requirements. This should be an easy sell-- remember, the Keystones are norm-referenced ("graded on the curve" for civilians) which means that making them a graduation requirement absolutely guarantees that a bunch of Pennsylvanian students with passing report cards will be denied diplomas if Keystones are a grad requirement. Which legislators would like to have their names on that accomplishment?

Cutting Funding

We keep having stories like this, in which enterprising folks try to get schools taxes rolled back. Pay attention.

Erie May Close All High Schools

This piece is from a year ago, and things haven't gotten any better. Does your legislator really want to see public education ended? If not, what is he going to do about it?

Charter Costs

Before you call your legislator to tell him to keep charters from bleeding districts dry, check and see just how bad it is in your district (and look at how heavily lobbied Harrisburg is).

Future Ready Schools

Pennsylvania's plan for getting in line with ESSA. Take a look. See if you have some thoughts about how this mess could be improved.

Let's Arm Teachers

Some guys in Harrisburg think that what's really missing from schools is guns. This is a dumb idea. Tell your legislator so.

Bad Charter Reform Bill

I wrote about the first version of this bad bill last year, and it is back and still bad. It doesn't fix cyber charter funding and doesn't stop charters from being an unregulated drain on public tax dollars. Tell them to do better.

Remember That You Are Dealing with Really Bad Legislators Like This Guy

Brad Roae is about as anti-public school teacher as you can get. I wrote this piece about him last fall-- before he was re-elected, again. If you have to call him, be prepared for a less-than-warm reception.

Who the Hell Is Scott Wagner

Finally, start reading up on this guy, who wants to be the Scott Walker of PA. He has declared candidacy for Governor, and he would like to see teachers unions shut down, poor people left to starve, and public education replaced with businesses. Wagner is rich and ready and has already been doing the groundwork to help his run at the governor's office. On first glance, you are going to be inclined to dismiss him as a ridiculous cartoon. Don't. Get ready for a fight this fall, and if you're a Republican, educate yourself before the primary in a few weeks.

Did FCC Just Damage School Internet

In the wonky alphabet soup depths of policy, this thing happened in April-- the FCC decided to uncap BDS pricing, because free market competition.

Wires competing for space on free market pole

Business Data Services refers to the kind of bulk internet access sold by providers like Verizon and ATT to business and other institutional buyers. Like small businesses or hospitals or libraries or schools.

And while there is no limit on what providers can charge you for home internet, the BDS sector has always been highly regulated, based on the argument that schools and libraries and mom-and-pop businesses should not be priced out of the market.

The end of the cap allows service providers to charge whatever they think the market can bear (or even employ the time-honored practice of jacking up prices in order to drive away customers you don't want to serve). The cap removal is conditional-- it can only happen in counties where there is competition. Competition in this case is defined as "any other isp provider within a half mile of fifty percent of the buildings being served." Estimates are that about a third of the coountry will consequently stay under the old cap.

Some Democrats are not happy about this move by the FCC:

Many politicians have talked in recent months "about protecting our nation's small businesses -- the backbone of the American economy," said Commissioner Mignon Clyburn, a Democrat. "Yet it is these very businesses -- the mom-and-pop hardware store, the family-owned wireless provider, and the small rural hospital, that just drew the short straw."

Instead of looking out for "millions of little guys," the Republican majority at the FCC has sided with the interests of huge telecom providers, she added. Clyburn predicted "immediate price hikes," especially in rural areas.

"Just where does the buck stop? At the wallets of every American consumer," she said.

Can you guess who thinks this is a good idea?

"Price regulation—that is, the government setting the rates, terms, and conditions for special access services—is seductive," FCC Chairman Ajit Pai, a former Verizon lawyer, said. "Who can possibly resist the promise of forcing prices lower right now? But in reality, price regulation threatens competition and investment."

My emphasis. Yup. Just in case you missed that one in the flurry-ish wave of appointments, Trump put a former Verizon counsel in charge of the FCC. But before you get too mad(der) at Trump, note that one reason you may have missed this appointment is because Pai left Verizon in 2003, went to work at the Department of Justice for a few years, and then started working at the FCC in 2007. In 2011, Obama nominated him for the Republican commissioner spot on the FCC and the Senate approved him unanimously. So while Pai keeps getting "Trump-appointed" appended to his name, all Trump did this time was just continue a bipartisan institutional process that has been going on for a while. Now we have Pai, spearheading the attack on net neutrality and this BPS thing.

Will this ultimately make internet access more expensive for your school? Probably. Then again, the intense free market competition may drive your costs relentlessly down (if you are among the 24% of BDS customers in a two-server market). Because, see, price competition really kicks in when providers are free to charge more. Because... wait-- are we saying that because they weren't free to charge more before, they couldn't compete by charging less? I could swear that's not how the free market is actually supposed to work.

ICYMI: Wrapping Up April Edition (4/30)

Where did that month go? Here are some reads from last week. As always, I ask you to please amplify what speaks to you. "I wish I could write like that person," is what I often hear, and I feel you, but anybody and everybody can tweet, facebook, email and otherwise amplify those voices-- and if you don't push a writer's work out into the world, it doesn't matter if she wrote it. 

Deescalating School Reform Wars

John Thompson has been tireless in trying to build bridges in the school reform debates, and he continues that work with a thoughtful review of Rick Hess's new book.

Eight Questions About School Vouchers

That Betsy DeVos won't be able to answer (or would rather not)

The Untold History of Charter Schools

The "if you're only going to read one post on this list" post for the week. Like me, you probably have absorbed the Albert-Shanker-started-charters story. Rachel Cohen has done some actual research, and we're all a little smarter because of it.

When Anxiety Rules

A recently-minted NY teacher talks about what it's like to go through the EdTPA process (spoiler alert: not good).

Common Enemy

Jennifer Berkshire returns from her trip to Ohio with some serious insights about school reform in Trumplandia.

Quirk in PA Charter Law

Why are students with certain special needs the geese that lay the golden eggs in Pennsylvania's charter law? Here's a good explanation.

School Choice Profits on the Taxpayer's Dime

Carol Burris lays out the facts for Arizona on how their charter industry really works.

Desperately Searching for the Merit Pay Fairy

Jersey Jazzman continues his search for the fabled fairy of magical merit pay (spoiler alert: he fails again).

4th Best High School in New York Doesn't Exist

Yeah, about that US News great schools list...

"I Found a Jewel for You"

Nobody observes the world of littles like Teacher Tom.

Lift Your Head

In my capacity as Head Stage Manager Guy at my school, I have spent my day on duty for a concert sponsored by a local church. It makes for a long day, but the crowd is always pleasant and the featured band this year is one my kids used to listen to growing up (Audio Adrenaline, for you people both of faith and also of a certain age, though like most decades-old bands, they are now essentially a ghost band made of all-replaced parts).

At any rate, during set-up this afternoon, I ran into a former student I haven't seen in years. I'm going to call him Bob.

I had Bob as a freshman and as a junior. Bob had some real strengths as a reader and a writer, but a low level of achievement. Some days he was a real pleasure to have around-- outgoing and genial. Other days he arrived at school with a great deal anger stuffed inside. He could be that kid who tries to teach you a lesson by figuratively punching himself in the face over and over. And he would periodically disappear for many days at a time. Big on drama, low on responsibility. Occasionally really cruel and thoughtless, but with occasional flashes of real kindness and decency. Still, most days he flopped into his seat like a lanky pile of loosely associated parts, smiling at things like the sheer hilarity of me asking him to try at whatever we were doing.

As a freshman, Bob was an "at-risk" student with no real support system at home (what at my school we sometimes call "better off raised by wolves") and group of friends who shared an interest in better living through pharmaceuticals. As a junior, he was circling the drain, hard to reach and with no effs left to give. Before the end of the year, he dropped out.

That was a few years ago. Today, he approached me and stuck out his hand to say hi. I asked him how he was doing, what he was up to. In the intervening years, he has earned a GED and gone to tech school to become certified as a welder. Now he is considering leaving the area for work or joining the armed services. He says if he does that he'll use the time to leave the area and get a good start elsewhere he comes. "I've seen too many guys come back here and screw it all up," he says.

I've heard versions of this story a thousand thousand times; so has any teacher who's been at the work for more than five years. It is the umpty gazillionth piece of proof that just because a student doesn't march right through twelve years of school and get the good grades and ace the swell tests and show the correct behaviors-- it doesn't mean that young human is doomed.

You know all the stories. Kid takes six years to finish high school and one day a light bulb goes on and she says, "I'm going to make my life different than this." Or the other stories. Honor student blows up his marriage ten years later by getting caught in a motel room trading sex for drugs with a minor. And THEN gets his act together and gets into a healthy marriage with beautiful children. My director of special ed tells the story of a student with special needs who could barely pass, well, anything, but declared her intention to become a nurse and all her special ed teachers tried to gently steer her away from it and now, today, she is a By God Nurse. My director of special ed tells that story and says, "Now I never say 'never'."

These are the stories I think of when some government bureaucrat announces that we should be able to look at a child and declare definitively whether that child is on the correct direct path to College and Career Readyville. Are you nuts? Have you met some actual humans? For anyone to look at a young human and declare, "I know what path you are on " is just nuts. For many, if not most, we reach our destination in our own way, in our own time. Insisting that everyone should reach the same place on the same path in the same way is just... well, dumb.

If you had asked me years ago if I would bet on Bob, I would have balked. He had tools, but not many, and he seemed determined to trash them. And yet there he was, standing before me like a grown-ass man with his act pretty much together, confident and determined.

To imagine that we can see to the very core of another person is startling hubris. To declare that someone is certainly doomed, that their problems are inescapable solid-state fundamentals of who they are, or that we can prescribe for them what they need or have or lack-- that's just a failure to understand what it means to be human.

I've seen the same line on several t-shirts tonight. It seems like an appropriate to this string of thoughts, even with the folksy non-standard English:

Lift your head. It ain't over yet.

To give a student a test, or to sum up their status in school, to tell them, in effect, just put your head down, because it's over for you-- I can't think of a greater crime to commit against the young humans in our charge. Ignore the test. Skip the test. Forget the pronouncements about college and career readiness.

Lift your head.

Choice and Guarantees

You are visiting friends, and at suppertime, they give you two options. "We can go to Restaurant A," they say, "and there will be only one choice on the menu, but I can guarantee you that it will be awesome. Or we can go to Restaurant B where there will be plenty of choices, but it's entirely possible they will all be pretty lousy."

Which restaurant would you select?

Some reformy choice advocates insist that Restaurant B is the better option. These choicers insist that what parents want is choice. I think not. I think what parents (and students and neighbors and taxpayers) want is secure knowledge that public tax money s being well-spent, and that when a student walks into a classroom, that student is being met by a well-trained, capable professional educator who is going to meet that child where the child is, and do their best to lift that child up.

Rick Smith, in a recent conversation with Jeff Bryant, makes the point by talking about health care. If I'm sick or, say, my wife is about to give birth, I don't want a bunch of choices of various hospitals and doctors. I want to know that the hospital I go to will be great. And then Bryant used a word that jumped out at me.

When it comes to schools, people want a guarantee.

Not choice. Not a bunch of bad options. They want a guarantee.

Guarantee is a strong word. We often talk about the promise of public education, and that's a nice word, but a promise leaves an awful lot of wiggle room.

But guarantee. That's strong stuff. No matter who you are. No matter where you live. No matter what your child brings to the table. We guarantee we'll provide whatever is needed to do the job.

A guarantee isn't just a promise that I'll do the job right. It is a promise that if I fail, I will make it right.

There is absolutely no question that there are places, districts, schools that have failed to honor their guarantee. I don't want to minimize that for a second. Some school "failures" have been manufactured by rigging the game and cooking the books (looking at you, test-centered "accountability'). Some school failures have been manufactured by deliberately starving public schools. Some school failures have been deliberate choices to deny Those Children their guaranteed education. And some schools have managed to fail all on their own, through some unfortunate combination of bad leadership or terrible management.

Those failures have provided an opening, a business opportunity, for champions of choice. "Instead of a renewed guarantee for the school you already have," is the pitch, "how about a choice of other schools." And many folks have bit on that offer because 1) their old school really has failed to live up to the guarantee and 2) they hear the word "school" (or in some cases, "public school") and they assume that the choice school comes with its own guarantee. But many charter-choice schools come with no guarantee at all. No promise that the school will do its best to provide a great education to every single child, and definitely no promise that if the school fails, the family has an avenue to demand that the school make it right.

So instead of making a promise good, fulfilling the guarantee of a public school, choicers just offer other unguaranteed, buyer beware, good luck with that options. If the school fails a student, well, there's the door. Except, of course, voting with your feet does not make things right.

To me it is one of the central mysteries of the choice argument-- if a school is bad, why would you start to open other schools instead of fixing it?

I know one answer, which is "we tried and it just didn't work" followed, usually, by blaming that failure on unions or teachers or deficit models of how Those People's Families behave. No. If what you tried didn't work, the most likely explanation is that what you tried was a bad idea, implemented by someone who didn't know what the hell they were talking about (see also, test-centered accountability).

The other answer, which generally arrives in more coded language, is "fixing schools would cost money, not make money, and why would we spend money on Those People"?

What do we need in education?

We need to issue a clear, unequivocal guarantee to every parent, every child, every taxpayer, every citizen, that they will have a locally-run school in their community fully funded, well resourced, staffed with quality trained professionals, and well-maintained, and that every child who walks into that school will be met by caring professionals who will meet the child where she is and help guide her toward her best possible future. And if the guarantee is not being met, there will be a means to make things right.

Yes, it would be expensive. And yes, it would be most expensive in communities where there are the fewest local resources which, yes, means that you'd have to spend a bunch of tax dollars on Those People's Children. Yes, a guarantee would require a commitment. A big commitment. A real commitment. And while that may seem hopelessly huge, we have certainly found the will-- and the money-- for everything from walking on the moon to grin ding away for decades of Middle Eastern military adventures.

Choice isn't about replacing the guarantee or honoring the guarantee. Choice is about masking the unhappy truth that our leaders don't have the will to make the guarantee and stand by it. Choice is about masking the unhappy truth that too many of us don't really think Those People's Children deserve any such guarantee (just like poor people don't really deserve health care). Choice is not how we find our way to a Great American Education Guarantee; it is what we do instead.