Monday, December 7, 2020
Donors Choose Monday: Mice
Sunday, December 6, 2020
ICYMI: So It's Really December Edition (12/6)
Still trying to take care of all the places the cold gets into our house, because apparently the season is serious about things. Still counting down to the magical day when I can go many days at a time without asking, "Well, what has the President done today?" But there are still some good things to read from this week, so here's your list.
How DeVos May Have Started a Counter-Revolution in Education
Jack Schneider and Jennifer Berkshire in the New York Times explaining how Betsy DeVos has broken up an unspoken treaty between conservative and liberal ed reform folks, and how that may open the door to some actual steps forward.
Are We Compassionate Enough In School?
A hell of a question, posed by guest writer Matthew Fleming over at Ed Week. Pretty cool little piece about some of the things that create fatigue and burnout.
Behaviorism, Surveillance, and (School) Work
Audrey Watters was a speaker at the #AgainstSurveillance teach-in, and here's what she said. As always, informative and infuriating, including enterprise software, Skinner's box for babies, and test proctoring.
Anti-Affirmative Action Group Hopes Conservative Supreme Court Will Finally Give Them A Win
Now that the Supreme Court has been tilted a bit further rightward, all manner of folks are getting ready to take a run at SCOTUS to get their favorite reactionary cause pumped up. So here come Students for Fair Admission, ready to stump for favored admission status for white guys. From the Root.
Rundown Schools Force More Students To Go Remote
Hechinger Reports with a good look at how some schools were hit extra hard by the pandemic because they'd already gone years without decent maintenance. Let critical resources decay, and they can't sustain an extra hit--go figure.
VCs Are Pouring Money Into the Wrong Education Startups
Venture capitalists, or vulture capitalists--take your pick, but they're making sure this mess doesn't go to waste. WIRED takes a look at where the money is going.
A Soccer Club and $1.2 Million for a charter school
We mentioned this here at the Institute back when the grant was first issued, but now Carol Burris at the Washington Post has even more details, and the rest of the story (which is that these amateurs didn't even get their school approved). Just our tax dollars--well, not so much "at work" as "being wasted."
Worse than Betsy DeVos: The disturbing story of 2020 school board elections
Jeff Bryant has looked downticket to discover that in many school board elections, pubic education was not the winner. From Alternet.
Online exam monitoring can invade privacy and erode trust at universities
A Canada-centric look at the rapidly spreading ugly mess that is tecno-proctoring. Short form: it's bad.
Texas high school senior suspended for painted nails
I'm always leery of these sorts of stories, because there is often another side of the tale that the school isn't free to tell. But I can't think of another side that would make this any less stupid. Sometimes public schools put dopes in charge, and they make dopey policies.
Saturday, December 5, 2020
The Jingle Bells Effect And The Canon
So, if you need a little something to jumpkick you into the season, here's a playlist challenge for you.
Friday, December 4, 2020
Does Your School Suffer From Advanced Testivitis
In some quarters we seem to have cycled back around to the old argument that the Big Standardized Test provides an assortment of necessary data with no actual downside, so let's trot those puppies out here for this already-maimed year. I've spent a bunch of time talking about why the tests provide no actual benefit (here, here and here, for example), but let me take a moment to look at the other half of the problem.
Depending on your state and local leadership, your school may be suffering from the advanced stages of Testivitis, an untreated and damaging condition that is damaging to schools and the students in them. Here are the symptoms to watch for:
Upside Down School
Underlying most of the symptoms listed here is one major shift-- a school in the grip of testivitis is upside down. It is not run to serve the needs of students; it is run to get the students to serve the school's need for certain scores. And it will beat on those students like test-taking pinatas in an attempt to get the "right" scores to fall out. This apparently includes considering actions like requiring students to break pandemic distancing in order to come to school and take the test.
Test Prep
It has long been a contention of BS Test manufacturers that their products cannot be "prepped" for, but what they mean is that you can't pre-load a list of facts to get students ready. Nowadays, test prep means getting students to be comfortable with the language, style and special tricks of the tests.
That means lots of multiple choice question techniques, as well as learning about the ways that test writers will try to "trick" students with certain types of wrong answers. For instance, ELA tests in PA always included a question or two that involved a familiar word used in an unfamiliar context and a question asking the students to use context clues to determine what the word means. Not hard to manage if you're aware that questions like that turn up on the test and are meant to trick you.
Mini Reading Instruction
A particular large and pernicious form of test prep. At some point in the last decade or two, your English classes started using drilling exercises that involved a single page of text followed by a short set of multiple choice questions. In the most advanced cases, these have squeezed out any number of full works, even complete short stories. In place of longer works, your students may read excerpted passages ("Here's a page from Romeo and Juliet"). But a large part of the class had dropped longer reflection on longer works in favor of mini-readings with dine and dash question sets.
Practice Tests
In schools with advanced cases of testivitis, students take several tests a year, often starting out in the very first week of school (which sets a real tone about the purpose of the school year). NWEA MAP test is a popular, but there are many out there. The purpose is always to get ahead of the BS Test results, generate some data, focus some interventions. By the time you're done, you'll have sacrificed a couple of weeks of instruction time to taking these things. You will also sacrifice classroom teacher credibility, because that's who's asked to sell these no-stakes tests to students. I used to promise my students at the beginning of the year that I would never purposefully, knowingly waste their time. Practice tests required me to add an asterisk to that promise.
Data Meetings
One by-product of all the testing is a bunch of data that teachers are required to sit and pore over, like searching tea leaves for clues about the future health of swine in Saigon. Often the data is so broad or incomplete that there is really nothing to be done except to shuffle the numbers around into different forms of graphs and charts. Sometimes the dance is all about finding a way NOT to say, "This is the part of the test that you aren't teaching to directly enough."
But sometimes data meetings result in very bad news for students.
Targeted Interventions
In a heavily infected school, students will be sorted into three groups after practice test results are used to predict their probably BS Test results--students we don't have to worry about, students who are hopeless cases, and students who are close enough to the dividing line that we might be able to drag them up to acceptable scores. The first two groups may be left along, but that third group will be targeted for "extra help."
Maybe they'll lose a study hall or recess. Maybe they'll be pulled from electives like music or art in order to get extra test prep. At my old district, a middle school principle one year pulled all targeted students from history and science classes and stuck them with double periods of math and English. This is a full-on upside down school approach, with the long term needs of the students absolutely discarded so that the school's "need" for scores can be served right now. And in severe cases, those students who show little prospect of ever getting high enough test scores will be subjected to this targeting as well.
Ignoring the Data We Already Have
In advanced stages of testivitis, only test-generated data counts. In her classroom, what the teacher gleans from her own assessments doesn't count. She may be literally required to ignore the evidence of her own eyes and operate as if the test-generated numbers are the only real truth. Florida (a state whose schools are well into the advanced stages) demonstrated this by refusing to promote third graders into fourth grade because the only data available was their grades and classwork, which showed them to be excellent readers. But there wasn't any test data for them, so, declared the school, they must be retained. A lawyer for the state department actually argued that teacher-created grades "are meaningless."
When your school has reached the point where only the Beloved Test Data should be believed, your testivitis is seriously life-threatening.
Preoccupation with Test Security
Teachers from testivitis-infested schools will recognize that up there where I described a type of BS Test question, I was actually breaching security. In advanced testivitis we find that, even more sacred than the school's need for scores is the test manufacturer's need to protect the sanctity of their proprietary materials. The argument is that it protects the accuracy of the test, but mostly it's about sparing the test manufacturers two problems. Teachers and students are sworn to secrecy; teachers are not even allowed to set eyes on test questions.
First, it spares them the embarrassment/responsibility for explaining their bad questions. For example, the infamous talking pineapple question of 2012, or that time a poet found she couldn't correctly answer test questions about poems that she wrote. Second, it saves them the expense of having to manufacture a bunch of new material instead of recycling the old stuff. The test manufacturers are pretty dogged about this; Pearson is known for monitoring and pursuing students who breach security on social media. I could show you another example, but a piece that I once wrote describing some test questions in broad, vague terms became the only post on this blog every taken down by Google, done at the test manufacturer's request.
This has only gotten worse, with a whole surveillance industry springing up to monitor test-taking by distance learning students. Note that all of this security and surveillance activity is far, far removed from the issue of assessing students' skills and knowledge. It's all about protecting the Holy Test.
Reorganization
It wouldn't have occurred to me that this would even happen, but I saw it with my own eyes.
There's a problem with the BS Test and 8th graders. Maybe it's test fatigue, or maybe it's just 8th graders being 8th graders (if you've taught them and spent years enjoying their glorious beautiful rebellious anarchic nature, you know what I mean)--but 8th graders tend to have lousy BS Test results. Which means if your district has a traditional middle school with grades 7 and 8, that school is an ugly blot on your test score picture.
Solution? Re-organize your district so that your 8th graders are put under the same roof as a grade that gets better scores. Some administrator will come up with a publicly acceptable way to sell it, but the main idea, the idea that will cinch it for the board and other administrators, is that it will make the district look better on paper. It is truly the tail wagging the dog.
Testivitis was jump-started by No Child Left Behind and given a shot of disease-loving steroids under Race to the Top, and while ESEA is supposedly built to try to fight the infection, this disease has had decades to get fully rooted in schools around the country. Plenty of charter schools have been set up with testivitis built into their Day One DNA.
The Covid pandemic has provided a perfect opportunity to treat this disease--or for the disease to fatally affect a school already reeling from pandemess. The Cult of Testing claims that administering these tests is now more necessary than ever; I will continue to argue that the reverse is true--that time is precious commodity right now, and that making distance learning work requires a fanatical focus on the needs of the students, and that allowing testivitis to run rampant runs counter to both of those needs. The BS Test has become like a cancer stealing resources in a body that is already starved for them. It's time to take the cure and cut this disease out of the body of education.
Thursday, December 3, 2020
Election Polling and the Big Standardized Test
From the Washington Post to the Wall Street Journal to the Atlantic and beyond, writers weeks after the election castigating the pollsters for yet another less-than-stellar year. But education writer Larry Ferlazzo moved on to another question—”Could Polling Errors in the 2020 Election Teach Us Something About The Use Of ‘Data’ In Education.”
After all, those big “measure everyone” standardized math and reading tests that states are mandated to give every year are similar to opinion polls—they are trying to measure and quantify what is going on in peoples’ heads. And to work, there are several things the data-gatherers have to get right.
Ask the right questions.
For an election poll, this seems simple enough. “Which candidate are you going to vote for?” But trying to fold in other information like political leanings, positions on other issues, the strength of the voter’s opinions—that gets harder.
For math and reading tests, this part is trickier. Imagine, for instance, you want to know if a student can find the main idea of any piece of writing. Could you measure that by asking just a couple of multiple choice questions? How many questions do you think it takes to figure out whether or not someone is a good reader?
The respondent has to care enough to make a good faith response.
Whether it’s someone who doesn’t want talk about their political choices out loud, or someone who is so tired of answering those damned phone calls that they just start saying anything, a poll cannot collect useful and authentic data if respondents don’t care enough to cooperate.
Ditto for a standardized test. Take the NAEP 12th grade results recently released to hand-wringing by Education Secretary Betsy DeVos and others. High school teachers don’t get very excited about these results because the test is given to high school seniors in the spring. Have you ever met a high school senior in the spring? They are firmly focused on the future; a no-stakes standardized test is unlikely to be a major concern. Students currently in K-12 have been subjected to standardized testing every year of their educational careers. While bureaucrats, researchers, and edu-commentators may consider these tests critical and important, for many students they are just a pointless, boring chore. Students are not sitting there thinking, “I must be sure to do my very best on this so that researchers can better inform policy discussions with an accurate picture of my skills and knowledge.”
There must be a good data crunching machine.
Now, this may not actually matter, because the best model or equation in the world cannot get good results out of bad data. But if the model is bad, the results are bad.
In education, we have seen attempts to take test data and crunch it to do things like find “effective” teachers by computing the “value” they have “added” to students. This super-secret special formula has been disavowed by all manner of professionals and even struck down by a federal court, but versions of it are still in use.
One distinction of election polls is that eventually we actually have the election, and the polls are tested against cold, hard reality. Unfortunately, fans of the Big Standardized Test are able to argue on ad infinitum that the data are real and accurate and useful. We know that raising test scores does not improve student futures, but testocrats are still asserting that we had better get to testing during pandemic school or all manner of disorder will ensue.
Ferlazzo refers to one other problem of being driven by data that the polls highlight, citing an article by Adrian Chiles—”In a data-obsessed world, the power of observation must not be forgotten.” Chiles tells a story:
In 2017, after a nasty bump between a US warship and an oil tanker, Aron Soerensen, head of maritime technology and regulation at the Baltic and International Maritime Council, said: “Maybe today there’s a bit of a fixation on instruments instead of looking out the window.” There’s a lot of this about, literally and metaphorically.
For teachers, teaching driven by test-generated data is rarely more effective than looking out the window.
Wednesday, December 2, 2020
Back On The No-Longer-Trailing Pandemic Education Edge: Digging A Ditch
I've been offering updates from my own small town/rural corner of the universe for just one more data point about how various school districts are dealing with pandemic education. We don't all need to write about New York City schools.
My region had a decent shot. In a county of 50,000 people, we had a total of 70 cases at the beginning of September. All schools opened for face-to-face instruction, with various precautions and protocols in place.
Things have gone south pretty rapidly. We just passed 1,000 cases.
School districts had moved from face to face to hybrid elementary and distance high school. That lasted a few weeks, but there have been repeated multiple out breaks in schools. One district is still toggling between hybrid and distance--basically every time there's a confirmed case in the school, they go back to distance for a couple of weeks. Everyone else was in distance mode.
Last night several local boards (there are four districts in the county) met to decide what to do with the rest of December. The discussions were spirited but nuanced. Because we are so rural, there are some major issues with getting a wifi signal to some folks; there are a few hot spots set up, but (and this seems to escape some folks) a hot spot is basically a relay station, and you can't relay a signal you can't get. So folks who want to use the hot spots have to drive to them. Not everyone has vehicle access, and winter's moving in.
The local boards really struggling. Nobody thinks virtual school is best. Nobody. But now, really for the first time, people now people who have suffered or died from covid. Reliably Trumpy Facebook pages now get pushback against "this is all just a scam, you dumb sheeple" posts.
"Look, I didn't have any names to put to this two weeks ago. Now I do," said one local principal to his board. "There's no easy answers. I'm riding the fence, too. Are we digging a ditch educationally? Yes, but we could be digging a ditch to put somebody in."
People are concerned about the uncertainty. Teachers are worried about safety (well, most are) and working to deal with the workload challenges of the various models. Teachers are sharing hacks, tips, pieces of software, materials, teaming up for online instruction. They have the advantage of having started the year face to face and building an initial relationship with students, but it's still tough. Tomorrow night, at her students' request, my wife is hosting a zoom hot chocolate party with her second graders, during which they will sip hot chocolate and show off decorations/pets/whatever at their homes.
People are concerned about the virus, about the viability of local small businesses, about staying caught up with the state's patchwork quilt of inconsistent rules. And what is anyone going to do about Christmas? This is likely to be a long month.
Tuesday, December 1, 2020
Is This How Post-pandemic Ed Tech Will Be Different
Andreesen Horowitz is a silicon valley venture capitalist investment firm looking to strike it rich in the ed tech world. That is more than enough reason to distrust them (here's just one article laying out how vc firms--particularly tech ones--are wrecking our world). But they want to play in the ed tech sandbox, which is another reason. But they have some thoughts about how ed tech will look after the pandemic, and it is always important to keep an eye on where the vultures are circling.
"Edtech's Answer to Remote Learning Burnout" comes from Anne Lee Skates and Connie Chan. Chan is a specialist in Chinese consumer tech investment, while Skates graduated from Princeton, started a failed company, went to work for McKinsey, and ended up with Andreesen Horowitz (she also came to the Us from Taiwan to become a violinist and performed a solo at the 49th Grammy Awards, so that's cool). No education background in either case.
As always with investment articles, this is less about prediction and more about selling. Consider this paragraph from the introduction:
Public schools’ budget limitations have created a surge in alternative avenues of education, for those who can access them: private schools, homeschooling, and supplemental education. Edtech companies targeting this market combine software and online distribution to help make teachers’ jobs easier and learning more engaging.