Friday, December 18, 2020
Children are not our future
Thursday, December 17, 2020
More Teacher Effectiveness Mirages
The Fordham Institution has a new report entitled "Teacher Effectiveness and Improvement in Charter and Traditional Public Schools." Despite what it claims to study, the report is a neear-perfect demonstration of Campbell's Law in action.
The study starts with a question that, as used car salesmen put it, assumes the sale:
Study after study has found that urban charter schools, and non-profit charter networks in particular, tend to be more successful at boosting student achievement than traditional public schools in similar settings. But why?
We're not going to get bogged down in the details of this study, including this assertion that charter school superiority is a proven thing, because none of them matter when it comes to understanding why this study is fatally flawed.
The fleshed-out version of the question under study is this-- we know that more experienced teachers are generally better at their craft then newbies (an assertion that Fordham didn't make back in the days when they were part of the Let's Get Rid Of Teacher Job Protections crowd), but we also know that charters mostly have newbie teachers, so how is it that charters gets these superior results with fresh-out-the-wrapper staff?
The report was written by Matthew P. Steinberg (George Mason University) and Haisheng Yeng (U of Penn grad student). They worked from a pile of data from the PA department of education from between 2007 and 2017.
We could dig deeply into this report, but there's no reason to. All we really have to see is this sentence:
Like other studies, this one uses estimates of teachers’ value-added—that is, their contribution to students’ English language arts (ELA) and math achievement growth— as a proxy for their effectiveness.
So once again, "teacher effectiveness" is being used as a synonym for "scores on a single standardized test of math and reading soaked in the widely-debunked VAM formula." This is bunk. They try to prop it up with this--
Although such estimates cannot capture other valuable aspects of teaching practice and behaviors, research shows that (in addition to learning more math and English language arts) students assigned to teachers with higher value-added scores are more likely to go to college and earn higher salaries later in life.
That assertion about later salaries is cited from Chetty, Friedman, & Rockoff, 2014, a work that is problematic at best and bunk at worst. Meanwhile, even folks in the ed reform community have caught on to the fact that raising a child's Big Standardized Test score doesn't lead to that child having a better life.
But using test scores as a proxy for "student achievement" or "teacher effectiveness" is a critical tactic for ed reformsters, because writing a whole paper about how one set of teachers is better at raising test scores isn't very sexy or exciting. "What I really want from a teacher is for her to get my kid to do better on that one standardized test they take every spring, and nothing else matters as much," said no parent ever. Likewise, while there are a million interpretations of "good teacher," very few of them are "teacher whose students get good scores on that one big test."
Using test scores as a measure of teaching quality and student achievement isn't just a bad, inaccurate measurement--it triggers Goodhart's Law, or its somewhat better known sibling, Campbell's Law. The idea here is that the more you use a quantitative social measure for social decision-making, the more it will tend to disrupt and corrupt the processes it's supposed to be monitoring. If you like a pithier version, take Strathern's restatement of Goodhart--
When a measure becomes a target, it ceases to be a good measure.
Which brings us back to this piece of research. Steinberg and Yang find that CMO-run charters seem to have better-trained teachers, and they posit that hiring practices, training practices, or the charter chain tendency to force all teachers to follow the prescribed procedures--not just curricular, but pedagogical--might be the answer.
But if we stop using bad proxies and just say plainly what we're talking about, there's little mystery here. The premise of the study is that newbie charter teachers get better test scores than public school teachers. That points to just one thing--more focused test prep. This is easy to enforce with newbie teachers in a restrictive teaching environment because they don't have enough of a well-established professional identity to push back. Meanwhile, teachers in public schools are trying to balance the demand for raising test scores against the demand to actually teach.
In short, the explanation laid out by this report is that charter schools (at least the ones studied here) train teachers to do test prep instead of training them to actually teach.
Mike Petrilli suggested on Twitter this morning that I'm being cynical here with my reading of the report, but I think it's far more cynical to keep arguing in 2020 that using a single set of test scores and a long-since-discredited number crunching formula as a measure of true teacher quality. It is possible, as Petrilli says, that some charters are doing a great job of teaching junior teachers to "teach well," but as long as the premise is that "teach well" means "have students who get high scores on the BS Test," we'll never, ever know.
"Well, then, how do we figure out which teachers are doing a good job," has been the complaint for the past couple of decades, and I agree that this is a tough nut to crack, but that does not mean that we settle on a bad answer. It is hard to cure certain types of cancer, but that does not mean that we should settle for "drink bleach and sacrifice a frog under a full moon" as a cure. We do not, like the proverbial drunk, search for our car keys under a streetlight a hundred feet from where we dropped the keys because the light is better there.
It has been true since we ushered in test-centric schooling under NCLB--the discussion about teacher quality is worth having, but we cannot have it if we insist on using as "data" something that does not measure teacher quality.
There are other problems with this particular study. Most notably, since it is based on tests scores, it makes sense to look at the students who are taking those tests and the long-known techniques of cherry picking and push-out used by many charter schools to insure that they have a good crop of quality test-takers. Or we could talk about longer school days, or simply organizing the vast amount of school time around the BS Test. Any of these would explain the charter alleged test edge. This study doesn't address any of that.
But it doesn't matter. Any study that accepts the premise that BS Test-based VAM scores are a measure of teacher quality is wasting time.
Tuesday, December 15, 2020
How Does Education Fix Poverty? Spoiler alert...
The idea that we can educate poverty away has been a popular one with policymakers and politicians for years now. Here's just one example, from Janet Yellen, former Fed Chair and, possibly, future Treasury Secretary, back in 2017:
Yellen spoke to a conference on community development today, where she says that providing children with the opportunity to learn important skills earlier is essential to ending this generational cycle of poverty.“This research underscores the value of starting young to develop basic work habits and skills,” she said. “These habits and skills help prepare people for work, help them enter the labor market sooner, meet with more success over time and be in a position to develop the more specialized skills and obtain the academic credentials that are strongly correlated with higher and steadier earnings.”
Sunday, December 13, 2020
Schools, Supposedly, Have Caused the Fall of US Religion
The Christian Church has been suffering a steady and rapid decline for a few decades now, a trend noted by many social scientists, and a source of struggle within many churches that are looking for ways to fill newly-emptied pews. You can look at many data sets on the subject. The folks at Pew Research find that there's a stark generational factor; in the Silent Generation and Baby Boomer cohort, those who call themselves Christian are a vast majority (84% and 76% respectively), but only half of Millennials describe themselves as Christian.
It's a complicated phenomenon, and carries a little existential weight in a country that many folks like to think of as a Christian nation.
So what's the answer?
Religion News Service offers ten reasons, including prosperity that distracts people from faith, lack of compelling religious leaders, the end of Sunday as a "protected" church day, and the "wired" world. Many writers point out that US numbers are still higher than European ones. Focus on the Family says it's all okay, because evangelicals are gaining. Ross Douthat at the New York Times kind of agreed, suggesting that it's "lukewarm Christianity" that is declining. Christian Smith, a sociology and religion professor at Notre Dame, pointed at three historical events driving the precipitous post-90s plunge: the end of the Cold War, 9/11, and the political team-up of the GOP and the religious right. Researcher Jean M. Twenge found a sharp drop in religiosity among teens; we might come back to her findings in a moment.
Or maybe we won't bother, because Cameron Hilditch over at the National Review has solved the mystery-- it's those darned public schools.
We have discussed Hilditch's work before; he's the one who is pissed off that people think of teachers as selfless and calling some schools "public" is just a rhetorical dirty trick. He's a William F. Buckley Fellow in Political Journalism at National Review Institute, a Belfast native, and an Oxford guy.
His argument here is built partly on the work of Lyman Stone at the American Enterprise Institute, who cranked out a report about this back in April of 2020, Promise and Peril. I'm guessing a lot of folks missed it because in April of 2020, we were pre-occupied with a few other issues. It's loaded with lots of attempts to find a way to measure how religious folks are.
The title "Why American Children Stopped Believing in God" doesn't telegraph much, but the sub-head does--"The time has come for religious parents to take their children back from the state." Hilditch is here both to solve the mystery and to torch some straw persons, and he's neither subtle nor witty about which side he's backing:
Religious conservatives would probably cite the loosening of the country’s morals that began in the ’60s and ’70s. Secular progressives might mutter something about the onward march of “Science” and “Reason” over time.It’s a simple theory, befitting the minds of those who have historically espoused it.
It’s quite simple, really. Children learn more at school than reading, writing, and arithmetic. They imbibe a whole set of implied assumptions about what’s important in life. By excluding religious instruction from public schools, the government-run education system tacitly teaches students that religious commitments are not a first-order priority in life. Faith in God becomes a sort of optional weekend hobby akin to playing tennis or video games. Christ and Moses are treated by teachers and administrators like weapons or drugs — confiscated upon discovery.
ICYMI: Still Shopping Edition (12/13)
Trying desperately to shop at small local stores, and it's a real challenge right now. And what has to be ordered comes with the special When Will It Actually Arrive suspense. Happy holidays, one and all. In the meantime, some reading....
San Joaquin Valley in the DPE Crosshairs
Thomas Ultican peels back the layers on yet another assault on public education, this one out in California. Interesting to see how several groups' interests converge on one goal--dismantling public education.
The next education secretary must know about much more than education
I know I've been heavy on the need to get public education expertise in the department of education under Biden, but at Hechinger, Andre Perry makes a good case for other skill sets that the next secretary will need.
Reuters takes a look at teacher layoffs in Schenectady, NY, and asks if this is not an ominous sign for what's ahead for public schools.
The 10 most significant education studies of 2020
This piece at Edutopia leaves lots of room for debate--are the reading wars over, and is handwriting a key part of learning, and did Fordham really release a study that contradicts some of the ideas behind its beloved Common Core? But it's an interesting conversation piece of a list.
McKinsey and Company use falling behind talk to ramp up school toughness
Nancy Bailey takes a look at what McKinsey, the 800-pound gorilla of consulting, has to say about the children "falling behind," and what policies they're using the big fear to push.
Visa Ban on Foreign Workers Has Left School With Teacher Shortages
Hey, remember how some school systems were using foreign teachers to fill the spots they couldn't convince US citizens to take? And remember how Trump has been slowly choking off the stream of even legal immigration? Turns out those two things ran into each other. From the Intercept.
Norms, ethics and civility. Plus education.
Nancy Flanagan has an exceptional gift for connecting her own personal experience to larger ideas, and that's on display here. Do we need calls for civility right now--or is something else needed to move past these Trump years?
Saturday, December 12, 2020
Schools Are Still Not Like Ubers
Betsy DeVos (who will soon not be a humble servant in the education secretary's office, but will instead be a very rich lady who wants to dismantle public education) likes to compare her vision of education to the same kind of disruption offered by outfits like Uber, a comparison that many folks like to make. I've written before about what a lousy comparison that is, focusing on problems like a business mentality and the problems of automation.
But here's a quick piece by techno-critic Cory Doctorow to remind us that Uber is, at the end, a terrible thing for anybody to want to emulate. Instead, he says, Uber was "a company that was never, ever going to be profitable, which existed solely to launder billions for the Saudi royals."
Doctorow connects Uber to a Saudi plan to diversify and capture monopolies in other sectors as a cushion against future downturns in the oil market. Their plan for Uber was, well...
The S1 – the document that explains how the company plans to be profitable – set two conditions for Uber's profitability.First, all the public transit in the world had to shut down and be replaced by Uber.
Next, all the drivers had to be replaced by AIs.
Thursday, December 10, 2020
Mrs. Gates Still Doesn't Get It, Still.
Last week the New York Times decided to offer one more glowing portrait of Melinda Gates, unintentionally underlining the work of rich folk critic Anand Giridharadas and explaining, again, that she doesn't get the problem of Gates riches in education.
She opens with an Emerson quote from her valedictory high school graduation speech about success being the knowledge that one person has breathed easier because you have lived. That quote, writes David Gelles, "is still ringing in her ears."
“That’s been my definition of success since high school,” she said. “So if I have an extra dollar, or a thousand dollars, or a million dollars, or in my case, which is absurd, a billion dollars to plow back into making the world better for other people, that’s what I’m going to do.”






