So, if you need a little something to jumpkick you into the season, here's a playlist challenge for you.
Saturday, December 5, 2020
The Jingle Bells Effect And The Canon
Friday, December 4, 2020
Does Your School Suffer From Advanced Testivitis
In some quarters we seem to have cycled back around to the old argument that the Big Standardized Test provides an assortment of necessary data with no actual downside, so let's trot those puppies out here for this already-maimed year. I've spent a bunch of time talking about why the tests provide no actual benefit (here, here and here, for example), but let me take a moment to look at the other half of the problem.
Depending on your state and local leadership, your school may be suffering from the advanced stages of Testivitis, an untreated and damaging condition that is damaging to schools and the students in them. Here are the symptoms to watch for:
Upside Down School
Underlying most of the symptoms listed here is one major shift-- a school in the grip of testivitis is upside down. It is not run to serve the needs of students; it is run to get the students to serve the school's need for certain scores. And it will beat on those students like test-taking pinatas in an attempt to get the "right" scores to fall out. This apparently includes considering actions like requiring students to break pandemic distancing in order to come to school and take the test.
Test Prep
It has long been a contention of BS Test manufacturers that their products cannot be "prepped" for, but what they mean is that you can't pre-load a list of facts to get students ready. Nowadays, test prep means getting students to be comfortable with the language, style and special tricks of the tests.
That means lots of multiple choice question techniques, as well as learning about the ways that test writers will try to "trick" students with certain types of wrong answers. For instance, ELA tests in PA always included a question or two that involved a familiar word used in an unfamiliar context and a question asking the students to use context clues to determine what the word means. Not hard to manage if you're aware that questions like that turn up on the test and are meant to trick you.
Mini Reading Instruction
A particular large and pernicious form of test prep. At some point in the last decade or two, your English classes started using drilling exercises that involved a single page of text followed by a short set of multiple choice questions. In the most advanced cases, these have squeezed out any number of full works, even complete short stories. In place of longer works, your students may read excerpted passages ("Here's a page from Romeo and Juliet"). But a large part of the class had dropped longer reflection on longer works in favor of mini-readings with dine and dash question sets.
Practice Tests
In schools with advanced cases of testivitis, students take several tests a year, often starting out in the very first week of school (which sets a real tone about the purpose of the school year). NWEA MAP test is a popular, but there are many out there. The purpose is always to get ahead of the BS Test results, generate some data, focus some interventions. By the time you're done, you'll have sacrificed a couple of weeks of instruction time to taking these things. You will also sacrifice classroom teacher credibility, because that's who's asked to sell these no-stakes tests to students. I used to promise my students at the beginning of the year that I would never purposefully, knowingly waste their time. Practice tests required me to add an asterisk to that promise.
Data Meetings
One by-product of all the testing is a bunch of data that teachers are required to sit and pore over, like searching tea leaves for clues about the future health of swine in Saigon. Often the data is so broad or incomplete that there is really nothing to be done except to shuffle the numbers around into different forms of graphs and charts. Sometimes the dance is all about finding a way NOT to say, "This is the part of the test that you aren't teaching to directly enough."
But sometimes data meetings result in very bad news for students.
Targeted Interventions
In a heavily infected school, students will be sorted into three groups after practice test results are used to predict their probably BS Test results--students we don't have to worry about, students who are hopeless cases, and students who are close enough to the dividing line that we might be able to drag them up to acceptable scores. The first two groups may be left along, but that third group will be targeted for "extra help."
Maybe they'll lose a study hall or recess. Maybe they'll be pulled from electives like music or art in order to get extra test prep. At my old district, a middle school principle one year pulled all targeted students from history and science classes and stuck them with double periods of math and English. This is a full-on upside down school approach, with the long term needs of the students absolutely discarded so that the school's "need" for scores can be served right now. And in severe cases, those students who show little prospect of ever getting high enough test scores will be subjected to this targeting as well.
Ignoring the Data We Already Have
In advanced stages of testivitis, only test-generated data counts. In her classroom, what the teacher gleans from her own assessments doesn't count. She may be literally required to ignore the evidence of her own eyes and operate as if the test-generated numbers are the only real truth. Florida (a state whose schools are well into the advanced stages) demonstrated this by refusing to promote third graders into fourth grade because the only data available was their grades and classwork, which showed them to be excellent readers. But there wasn't any test data for them, so, declared the school, they must be retained. A lawyer for the state department actually argued that teacher-created grades "are meaningless."
When your school has reached the point where only the Beloved Test Data should be believed, your testivitis is seriously life-threatening.
Preoccupation with Test Security
Teachers from testivitis-infested schools will recognize that up there where I described a type of BS Test question, I was actually breaching security. In advanced testivitis we find that, even more sacred than the school's need for scores is the test manufacturer's need to protect the sanctity of their proprietary materials. The argument is that it protects the accuracy of the test, but mostly it's about sparing the test manufacturers two problems. Teachers and students are sworn to secrecy; teachers are not even allowed to set eyes on test questions.
First, it spares them the embarrassment/responsibility for explaining their bad questions. For example, the infamous talking pineapple question of 2012, or that time a poet found she couldn't correctly answer test questions about poems that she wrote. Second, it saves them the expense of having to manufacture a bunch of new material instead of recycling the old stuff. The test manufacturers are pretty dogged about this; Pearson is known for monitoring and pursuing students who breach security on social media. I could show you another example, but a piece that I once wrote describing some test questions in broad, vague terms became the only post on this blog every taken down by Google, done at the test manufacturer's request.
This has only gotten worse, with a whole surveillance industry springing up to monitor test-taking by distance learning students. Note that all of this security and surveillance activity is far, far removed from the issue of assessing students' skills and knowledge. It's all about protecting the Holy Test.
Reorganization
It wouldn't have occurred to me that this would even happen, but I saw it with my own eyes.
There's a problem with the BS Test and 8th graders. Maybe it's test fatigue, or maybe it's just 8th graders being 8th graders (if you've taught them and spent years enjoying their glorious beautiful rebellious anarchic nature, you know what I mean)--but 8th graders tend to have lousy BS Test results. Which means if your district has a traditional middle school with grades 7 and 8, that school is an ugly blot on your test score picture.
Solution? Re-organize your district so that your 8th graders are put under the same roof as a grade that gets better scores. Some administrator will come up with a publicly acceptable way to sell it, but the main idea, the idea that will cinch it for the board and other administrators, is that it will make the district look better on paper. It is truly the tail wagging the dog.
Testivitis was jump-started by No Child Left Behind and given a shot of disease-loving steroids under Race to the Top, and while ESEA is supposedly built to try to fight the infection, this disease has had decades to get fully rooted in schools around the country. Plenty of charter schools have been set up with testivitis built into their Day One DNA.
The Covid pandemic has provided a perfect opportunity to treat this disease--or for the disease to fatally affect a school already reeling from pandemess. The Cult of Testing claims that administering these tests is now more necessary than ever; I will continue to argue that the reverse is true--that time is precious commodity right now, and that making distance learning work requires a fanatical focus on the needs of the students, and that allowing testivitis to run rampant runs counter to both of those needs. The BS Test has become like a cancer stealing resources in a body that is already starved for them. It's time to take the cure and cut this disease out of the body of education.
Thursday, December 3, 2020
Election Polling and the Big Standardized Test
From the Washington Post to the Wall Street Journal to the Atlantic and beyond, writers weeks after the election castigating the pollsters for yet another less-than-stellar year. But education writer Larry Ferlazzo moved on to another question—”Could Polling Errors in the 2020 Election Teach Us Something About The Use Of ‘Data’ In Education.”
After all, those big “measure everyone” standardized math and reading tests that states are mandated to give every year are similar to opinion polls—they are trying to measure and quantify what is going on in peoples’ heads. And to work, there are several things the data-gatherers have to get right.
Ask the right questions.
For an election poll, this seems simple enough. “Which candidate are you going to vote for?” But trying to fold in other information like political leanings, positions on other issues, the strength of the voter’s opinions—that gets harder.
For math and reading tests, this part is trickier. Imagine, for instance, you want to know if a student can find the main idea of any piece of writing. Could you measure that by asking just a couple of multiple choice questions? How many questions do you think it takes to figure out whether or not someone is a good reader?
The respondent has to care enough to make a good faith response.
Whether it’s someone who doesn’t want talk about their political choices out loud, or someone who is so tired of answering those damned phone calls that they just start saying anything, a poll cannot collect useful and authentic data if respondents don’t care enough to cooperate.
Ditto for a standardized test. Take the NAEP 12th grade results recently released to hand-wringing by Education Secretary Betsy DeVos and others. High school teachers don’t get very excited about these results because the test is given to high school seniors in the spring. Have you ever met a high school senior in the spring? They are firmly focused on the future; a no-stakes standardized test is unlikely to be a major concern. Students currently in K-12 have been subjected to standardized testing every year of their educational careers. While bureaucrats, researchers, and edu-commentators may consider these tests critical and important, for many students they are just a pointless, boring chore. Students are not sitting there thinking, “I must be sure to do my very best on this so that researchers can better inform policy discussions with an accurate picture of my skills and knowledge.”
There must be a good data crunching machine.
Now, this may not actually matter, because the best model or equation in the world cannot get good results out of bad data. But if the model is bad, the results are bad.
In education, we have seen attempts to take test data and crunch it to do things like find “effective” teachers by computing the “value” they have “added” to students. This super-secret special formula has been disavowed by all manner of professionals and even struck down by a federal court, but versions of it are still in use.
One distinction of election polls is that eventually we actually have the election, and the polls are tested against cold, hard reality. Unfortunately, fans of the Big Standardized Test are able to argue on ad infinitum that the data are real and accurate and useful. We know that raising test scores does not improve student futures, but testocrats are still asserting that we had better get to testing during pandemic school or all manner of disorder will ensue.
Ferlazzo refers to one other problem of being driven by data that the polls highlight, citing an article by Adrian Chiles—”In a data-obsessed world, the power of observation must not be forgotten.” Chiles tells a story:
In 2017, after a nasty bump between a US warship and an oil tanker, Aron Soerensen, head of maritime technology and regulation at the Baltic and International Maritime Council, said: “Maybe today there’s a bit of a fixation on instruments instead of looking out the window.” There’s a lot of this about, literally and metaphorically.
For teachers, teaching driven by test-generated data is rarely more effective than looking out the window.
Wednesday, December 2, 2020
Back On The No-Longer-Trailing Pandemic Education Edge: Digging A Ditch
I've been offering updates from my own small town/rural corner of the universe for just one more data point about how various school districts are dealing with pandemic education. We don't all need to write about New York City schools.
My region had a decent shot. In a county of 50,000 people, we had a total of 70 cases at the beginning of September. All schools opened for face-to-face instruction, with various precautions and protocols in place.
Things have gone south pretty rapidly. We just passed 1,000 cases.
School districts had moved from face to face to hybrid elementary and distance high school. That lasted a few weeks, but there have been repeated multiple out breaks in schools. One district is still toggling between hybrid and distance--basically every time there's a confirmed case in the school, they go back to distance for a couple of weeks. Everyone else was in distance mode.
Last night several local boards (there are four districts in the county) met to decide what to do with the rest of December. The discussions were spirited but nuanced. Because we are so rural, there are some major issues with getting a wifi signal to some folks; there are a few hot spots set up, but (and this seems to escape some folks) a hot spot is basically a relay station, and you can't relay a signal you can't get. So folks who want to use the hot spots have to drive to them. Not everyone has vehicle access, and winter's moving in.
The local boards really struggling. Nobody thinks virtual school is best. Nobody. But now, really for the first time, people now people who have suffered or died from covid. Reliably Trumpy Facebook pages now get pushback against "this is all just a scam, you dumb sheeple" posts.
"Look, I didn't have any names to put to this two weeks ago. Now I do," said one local principal to his board. "There's no easy answers. I'm riding the fence, too. Are we digging a ditch educationally? Yes, but we could be digging a ditch to put somebody in."
People are concerned about the uncertainty. Teachers are worried about safety (well, most are) and working to deal with the workload challenges of the various models. Teachers are sharing hacks, tips, pieces of software, materials, teaming up for online instruction. They have the advantage of having started the year face to face and building an initial relationship with students, but it's still tough. Tomorrow night, at her students' request, my wife is hosting a zoom hot chocolate party with her second graders, during which they will sip hot chocolate and show off decorations/pets/whatever at their homes.
People are concerned about the virus, about the viability of local small businesses, about staying caught up with the state's patchwork quilt of inconsistent rules. And what is anyone going to do about Christmas? This is likely to be a long month.
Tuesday, December 1, 2020
Is This How Post-pandemic Ed Tech Will Be Different
Andreesen Horowitz is a silicon valley venture capitalist investment firm looking to strike it rich in the ed tech world. That is more than enough reason to distrust them (here's just one article laying out how vc firms--particularly tech ones--are wrecking our world). But they want to play in the ed tech sandbox, which is another reason. But they have some thoughts about how ed tech will look after the pandemic, and it is always important to keep an eye on where the vultures are circling.
"Edtech's Answer to Remote Learning Burnout" comes from Anne Lee Skates and Connie Chan. Chan is a specialist in Chinese consumer tech investment, while Skates graduated from Princeton, started a failed company, went to work for McKinsey, and ended up with Andreesen Horowitz (she also came to the Us from Taiwan to become a violinist and performed a solo at the 49th Grammy Awards, so that's cool). No education background in either case.
As always with investment articles, this is less about prediction and more about selling. Consider this paragraph from the introduction:
Public schools’ budget limitations have created a surge in alternative avenues of education, for those who can access them: private schools, homeschooling, and supplemental education. Edtech companies targeting this market combine software and online distribution to help make teachers’ jobs easier and learning more engaging.Monday, November 30, 2020
The 2020 Edubook Christmas List
Time to go hunting for books for the people on your Christmas list, and I have some recommendations for you if there are people on your list who care about public education (and really, everybody should).
Before we start shopping, let me also direct your attention to Bookshop.org, an online vendor set up to benefit local independent booksellers instead of, say, giving Jeff Mezos his next gazillion dollars. You can also use it to locate a local bookstore and then shop even more directly.
Now, here's my handful or recommendations for this year.
This book does not actually ship for another week, but based on the fact that it's edited by Jesse Hagopian and Denisha Jones, my copy is already on order.
Andre Perry brings a really unique collection of hats to this work, from Brookings scholar to education journalist, and this work is an impressive distillation of it all. At some points, it's a powerful personal reflection on his own experience, and at others, a scholarly look at how Blacks in the US have had value systematically stripped from them in ways that have lasting financial and social consequences. This book is huge help in understanding the how of racism in not just abstract or social ways, but in concrete, practical financial ways.
Schoolhouse Burning & The Wolf at the Schoolhouse Door
Schoolhouse Burning by Derek Black and A Wolf at the Schoolhouse Door by Jennifer Berkshire and Jack Schneider are two entirely separate books, but they make a perfect pairing. It enhances both to read them back to back.
Black is a legal scholar whose book traces the importance of education in this country as reflected in the laws and constitutions of the states. This book is a perfect response to those who claim that public education is not in the US Constitution and is not foundational to democracy and anyway we are a republic. A good, clear explanation of how we arrived at the present moment, and why an assault on public education is an assault on democracy.
Schneider, an education scholar, and Berkshire, an education journalist, together host the popular Have You Heard podcast. They have crafted a critical explanation of how the once-right-fringe idea of privatizing public education has become an accepted mainstream policy idea, and lay out the tools being used to further that cause.
I've just reviewed both of these over at Forbes.com-- you can read those reviews here and here.
And if you want to make it a trilogy, here's the perfect follow up. Way back at the dawn of this year, Diane Ravitch published her latest book. Slaying Goliath focuses on the fight against education disruptors and the many signature battles of the last few decades. Highlighting the many aspects of the grassroots fight to preserve public ed and the forces arrayed against it in Ravitch's trademark scholarly firebrand style, this shows how the fight to preserve the bedrock of democracy can be won and argues passionately that it must. Ravitch's blog has long stood as the town square, the hub of the universe of public education supporters, and it gives her an unmatched view of the movement in all its forms.
John Warner's book is admittedly of greatest use to those who actually teach writing in the classroom, but that's a subject near and dear to my heart, and this book says so many of the things I believe need to be said about teaching writing, and why it has become an endangered art, and how we could better approach it.
A Practical Guide to Digital Research
If you're buying a gift for someone who has been studying up on the basics of the education debates and who wants to be able to get in their and dig out information on their own, particularly to research local ed issues, this book is the berries. Schneider shares all the tricks of the researcher's trade for making connections between groups, following the money, and getting at the truth that is so often being concealed.
And if we cheat a little and dip into last year:
Anand Giridharadas's book is now just over a year old, but if you haven't read it yet, you should. Everybody should. Beyond the red versus blue politics of our era, this book looks at how the elites trained in places like McKinsey have come to make such a mess out of this country. Really--everybody you know should read this book. And now that you've waited, you can get it in paperback.
Robert Pondiscio's book about Success Academy shows that this charter juggernaut is both better and worse than you imagined. If you want a solid, serious look at how the grand dame of charterdom really does her thing, this book gives you a hard look, even with Pondiscio's preference for choice.
From earlier in 2019, Andrea Gabor's book is still one of the best looks at the best and worst of education reform; the early pioneers, the big successes, and the big failures. Here's how to improve a public school system without breaking it down for parts and selling off the scrap.
I'm reaching all the way back to 2017, but as arguments about standardized testing heat up again, this book still offers the definitive explanation of what is wrong with our test-centric approach, what is wrong with tests themselves, and why the testocrats' preferred path to drag us all down is the wrong one. Required reading for anyone who expects to be in an argument about the Big Standardized Test.
I could go on all day, and there is so much to choose form out there that I have no doubt missed some worthy choices, but you've now got enough of a list to get some shopping done, whether it's cyber-shopping today or in the weeks ahead.
Donors Choose Monday: Expanding the Library
This week's project is exactly the sort of thing that shouldn't be on donors choose.
Mrs. Gibson is an elementary teacher in South Carolina, and she's looking to expand her classroom library.
My students are living in a low income area where literacy is our focus in order to meet the needs they may not be receiving at home.My focus is to bring in books that we help them connect with other cultures within the world and the school setting to help them become culturally competent and aware.