Over at Education Week: Teacher, Liana Heitin has rewritten a press release from the Joyce Foundation (if you don't know that name, more shortly) for general consumption. The lede is there in the title: Teachers May Need to Deepen Assessment Practices for Common Core.
The article spins off the work of Olivia Lozano and Gabriela Cardenas, two teachers at the UCLA Lab School in Los Angeles. This teaching team has spent ten years exploring the wonders of formative assessment. One of the handy specifics they have landed on include talking to the students one-on-one or in small groups, asking open-ended questions, and recording all the stuff they find out (copious notes) in a binder. Also, they like to call themselves "teacher researchers."
"More than just a buzzword among savvy educators, formative assessment is
the ongoing process of collecting data on what students know or don't
know, and changing instruction accordingly." First, hats off to the copywriter at Joyce, who has apparently stepped up from his previous job as a copywriter for JC Penneys. Second, who is the audience for this article? People who slept through all four years of teacher school? People whose teacher training only lasted five weeks? I read this sort of thing and think these people must believe that actual professional teachers are as ignorant of the teaching profession as these reformy types are. Sigh. Moving on...
Formative assessment used to be just quizzes and things, but now that Common Core has arrived to demand stronger thinky skills, we must formatively assess in stronger thinky ways.
The common standards are asking students to do that and more. They are
aimed at "building childrens' capacity to think, and analyze, and
communicate, and reason," said Margaret Heritage, the assistant director
for professional development at the National Center for Research on Evaluation, Standards, and Student Testing at UCLA.
"Aimed at"? Yes, and when I was in college, I "aimed at" dating the hot girl in the flute section but I ended up getting pizza by myself. "Aiming at," is a wonderful phrase. I suggest that students taking math assessments indicate that they "aimed at" the correct answer and see if that gets them credit.
At any rate, what we seem to be advocating in the article is taking more time to assess more deeply. "A lot more talking, more focus, more discourse, more depth." Lots and lots of listening, high-quality listening, deep listening, creepy eaves-dropping on the kids listening. Because, again, no teacher has ever thought about listening to students.
In math, instead of "I do, you do, we do" lessons, teachers will need to have discussions about the answers, maybe spending twenty minutes to debate and discuss a single problem.
So, in short, all you need is a ten hour school day and a co-teacher in your classroom. Oh, and the kind of student population that a university lab school gets. Just take this proposal to your school board and suggest it for your entire elementary program; just double the length of the day and the size of the staff. How expensive could it be?
But Joyce--I mean, Heitin-- isn't done drifting through an alternate reality yet. The capper on the article is connecting all of this to the PARCC and SBA. But you will be relieved to know that both consortia will be making formative test materials available to your school! Yes!! Which is a relief because none of the stuff the whole rest of the article talks about will do a thing about preparing your students for the high stakes testing.
This kind of press release is about just one thing-- a credible cover story. It's the least the Joyce Foundation, a group that has its roots in Chicago schools corparateering and hangs out at the same reformy clubs as Gates and Broad, can do for us.
What are we actually going to do? We're going to get the practice tests ("formative assessments") and we're going to use them to teach to the test so that we can try to avoid the punishments threatened for students, teachers, schools, administrators and taxpayers if the students don't do well.
But we can't say we're teaching to the test. So we're offered this option-- pretend that we're doing all this cool stuff advocated by Joyce (if we aren't able to achieve the doubled school model, we can at least say we're "aiming at" it). Use this sparkly rhetoric to sell it to the public. Then send teachers back to their rooms to close the door and use their practice tests to drill students in preparation for the Big Test.
Friday, March 14, 2014
Thursday, March 13, 2014
The Conservative Defense of CCSS
Over at the Daily Caller, Robby Soave and Rachel Solzfoos wrote a story in which Michael Brickman of the Fordham Institute labors mightily to construct a conservative defense of the Common Core.
It's a heroic struggle to be sure, as the very first sentence acknowledges, "Conservatives remain deeply skeptical of the Common Core education standards." The Daily Caller's robolinker is not helping; I'm looking at links to a story about how a poor school district wasted money "on lavish Common Core spa trip" and an ad for accredited homeschooling. In this exclusive interview, Brickman tries to combat that conservative blowback and runs directly into one of the central problems of conservatism.
Brickman leads with the "mess of fifty standards" defense of the Core. Many of those standards were just so lacking and students were graduating without necessary proficiencies. The standards "outline types of thinking and skills that students should master by certain grade levels" plus calling for "vigorous high-stakes testing to ensure that kids are actually learning the skills."Lots wrong there, but let's move on.
The article acknowledges the political problems for conservatives and the Core. Although developed by the National Governors Association (a pleasant not-exactly-a-lie, not-exactly-the-truth) and supported by moderate GOP governors like Bush, Jindal and Christie, the CCSS also received support from the Obama administration. That sends up the "protect local control from federal overreach" warning flags for conservatives.
Brickman says the feds should not have coerced the states into accepting the Core, but they are totes worth adopting. This is the modern conservative problem-- there are things you ought to do, but the government should not make you do them. This often comes out as "It's only federal overreach if the feds are making you do something wrong."
Brickman threads the needle and lands on “There are absolutely legitimate, uh, examples of federal overreach from the Obama administration, but I don’t think Common Core is one of them because… It was something that was led by the governors and the state education chiefs.” And nicely played, Daily Caller, in leaving the "uh" in his quote. It's okay-- I don't believe his bullshit story, either. And anyway, Brickman adds, the feds doing way worse overreach stuff over there. Don't be distracted by the Common Core (when I rather wish you'd be distracted FROM the Common Core instead).
No, conservatives should be clamoring for their local authorities to embrace and preserve the Core. So again-- don't let the feds tell you what to do, but make sure that your local authorities do what the feds want you to do. It's very hard to be a conservative these days.
Next Brickman reminds us that the CCSS are under attack from Tea Partiers and teacher unions. Also, the Monster in your Closet wants to attack it. Booga-booga! A paragraph later he also acknowledges that other members of the Right-ish Thinky Tank Club have also come out against the Core (here's one from just this morning) but Fordham iswell paid by Bill Gates sure the others are wrong.
Only in the last paragraph does Daily Caller let Brickman get something right, which is that eradicating CCSS doesn't really solve your wacky bad homework problem or your government mind-control through grammar homework problem.
So the argument fails as a defense and fails as conservatism. In fairness, I haven't seen anybody concoct a good liberal defense for CCSS, either. I'd wager that's because CCSS isn't so much politically charged as it's just bad. Corporate power grabs are pan-political, and Democrats and Republicans of all stripes have been happy to jump on the gravy train. Fordham is a conservative voice that has received a truckload of money from the Gates Foundation. It's funny how sometimes green is a much stronger color than red or blue.
It's a heroic struggle to be sure, as the very first sentence acknowledges, "Conservatives remain deeply skeptical of the Common Core education standards." The Daily Caller's robolinker is not helping; I'm looking at links to a story about how a poor school district wasted money "on lavish Common Core spa trip" and an ad for accredited homeschooling. In this exclusive interview, Brickman tries to combat that conservative blowback and runs directly into one of the central problems of conservatism.
Brickman leads with the "mess of fifty standards" defense of the Core. Many of those standards were just so lacking and students were graduating without necessary proficiencies. The standards "outline types of thinking and skills that students should master by certain grade levels" plus calling for "vigorous high-stakes testing to ensure that kids are actually learning the skills."Lots wrong there, but let's move on.
The article acknowledges the political problems for conservatives and the Core. Although developed by the National Governors Association (a pleasant not-exactly-a-lie, not-exactly-the-truth) and supported by moderate GOP governors like Bush, Jindal and Christie, the CCSS also received support from the Obama administration. That sends up the "protect local control from federal overreach" warning flags for conservatives.
Brickman says the feds should not have coerced the states into accepting the Core, but they are totes worth adopting. This is the modern conservative problem-- there are things you ought to do, but the government should not make you do them. This often comes out as "It's only federal overreach if the feds are making you do something wrong."
Brickman threads the needle and lands on “There are absolutely legitimate, uh, examples of federal overreach from the Obama administration, but I don’t think Common Core is one of them because… It was something that was led by the governors and the state education chiefs.” And nicely played, Daily Caller, in leaving the "uh" in his quote. It's okay-- I don't believe his bullshit story, either. And anyway, Brickman adds, the feds doing way worse overreach stuff over there. Don't be distracted by the Common Core (when I rather wish you'd be distracted FROM the Common Core instead).
No, conservatives should be clamoring for their local authorities to embrace and preserve the Core. So again-- don't let the feds tell you what to do, but make sure that your local authorities do what the feds want you to do. It's very hard to be a conservative these days.
Next Brickman reminds us that the CCSS are under attack from Tea Partiers and teacher unions. Also, the Monster in your Closet wants to attack it. Booga-booga! A paragraph later he also acknowledges that other members of the Right-ish Thinky Tank Club have also come out against the Core (here's one from just this morning) but Fordham is
Only in the last paragraph does Daily Caller let Brickman get something right, which is that eradicating CCSS doesn't really solve your wacky bad homework problem or your government mind-control through grammar homework problem.
So the argument fails as a defense and fails as conservatism. In fairness, I haven't seen anybody concoct a good liberal defense for CCSS, either. I'd wager that's because CCSS isn't so much politically charged as it's just bad. Corporate power grabs are pan-political, and Democrats and Republicans of all stripes have been happy to jump on the gravy train. Fordham is a conservative voice that has received a truckload of money from the Gates Foundation. It's funny how sometimes green is a much stronger color than red or blue.
Wednesday, March 12, 2014
Because It's On the Test
Peter DeWitt wrote a response spun from Marc Tucker's most excellent posting about testing culture and its effects on American education. Tucker's piece scathingly but accurately marks the harmful effects of test-driven education without actually attacking CCSS at all. In his response, DeWitt writes, "It makes me question whether the Common Core is guilty by association, or just plain guilty."
It's one of the most thoughtful versions I've read of the question, "Can CCSS be decoupled from testing? And once decoupled, could CCSS actually turn out to be a force for good?"
Even as recently as a year ago, we might have only guessed what the answer to that question might be. Today, we have a pretty good idea.
With the more widescale implementation of CCSS, we see the same scene repeated in classroom after classroom. A teacher (maybe elementary math, maybe high school reading, maybe some other affected teacher) contemplates a lesson from their CCSS-aligned Pearson-produced materials. "This lesson is terrible. Terribly paced and inappropriate for my students, and the explanation will not make any sense to them," the teacher says, or thinks. "But I have to do this material anyway because it's on the test."
"Because it's on the test" has increasingly become the leading pedagogical rationale since the advent of NCLB. The story of NCLB and RTTT has been the story of crafting an answer to the follow-up question-- "So what if it's on the test?" That answer is, of course, "If you fail the test, we will punish the students, the teachers, the administration, the school, and the taxpayers." And so educational value, pedagogical soundness, time-tested effectiveness, student need-- all of those old ways of planning instruction take a back seat to "because it's on the test."
So "Because it's on the test" is answer enough.
We teach writing badly because that style of writing is on the test. We teach mathematical concepts too early because they are on the early test. We teach a warped version of a single literary analysis technique because that's what's on the test.
Teachers commit any number of acts of educational malpractice in a week because they're on the test. It is literally the ONLY reason that we are doing some of the things we do in the classroom.
The decoupling question is really asking this: What would teachers do if "because it's on the test" were no longer a reason to teach anything?
We already have a hint.
We already do it because of the test. The CCSS has some lovely language about cooperative learning. Nobody's teaching that because it's not on the test. There some nice lip service to questions with multiple correct responses. Also sitting gathering dust, because that's not on the test.
Take away the test, and teachers would rewrite the standards on the ground. Teachers would use their experience and training and professional judgment to adjust the standards to suit the students in their classroom. They would add (without regard for 15%) the standards that are missing. They would adjust the pace and depth of their instruction to match the needs of the students in their classrooms. They would replace "because it is on the test" with "because it best serves the needs of my students."
The coupling of testing and CCSS is, in its own way, the ultimate proof of CCSS's suckiness. Because if the CCSS were good, really good, you know what would happen if we decoupled?
Nothing. Teachers would say, "Thank you for these most excellent standards! I will take them back to my classroom and use them happily! They're so great; I'm not going to change a thing."
But CCSS are a straightjacket, and "because it's on the test" is the padlock that keeps it tight. Like a terrible performer, CCSS can only command a captive audience, and the chains on the door are "because it's on the test."
DeWitt wonders if CCSS is guilty by association, and it's true. Sometimes a nice guy looks like a criminal because he's hanging out with the wrong crowd, and test-driven accountability, as Tucker rightly argues, is one of the ugliest crowds around. But sometimes a guy is hanging out with a bunch of bad guys because he is, himself, a bad guy. With CCSS and test-driven accountability, I don't think it's so much a matter of "guilt by association" as "birds of a feather."
It's one of the most thoughtful versions I've read of the question, "Can CCSS be decoupled from testing? And once decoupled, could CCSS actually turn out to be a force for good?"
Even as recently as a year ago, we might have only guessed what the answer to that question might be. Today, we have a pretty good idea.
With the more widescale implementation of CCSS, we see the same scene repeated in classroom after classroom. A teacher (maybe elementary math, maybe high school reading, maybe some other affected teacher) contemplates a lesson from their CCSS-aligned Pearson-produced materials. "This lesson is terrible. Terribly paced and inappropriate for my students, and the explanation will not make any sense to them," the teacher says, or thinks. "But I have to do this material anyway because it's on the test."
"Because it's on the test" has increasingly become the leading pedagogical rationale since the advent of NCLB. The story of NCLB and RTTT has been the story of crafting an answer to the follow-up question-- "So what if it's on the test?" That answer is, of course, "If you fail the test, we will punish the students, the teachers, the administration, the school, and the taxpayers." And so educational value, pedagogical soundness, time-tested effectiveness, student need-- all of those old ways of planning instruction take a back seat to "because it's on the test."
So "Because it's on the test" is answer enough.
We teach writing badly because that style of writing is on the test. We teach mathematical concepts too early because they are on the early test. We teach a warped version of a single literary analysis technique because that's what's on the test.
Teachers commit any number of acts of educational malpractice in a week because they're on the test. It is literally the ONLY reason that we are doing some of the things we do in the classroom.
The decoupling question is really asking this: What would teachers do if "because it's on the test" were no longer a reason to teach anything?
We already have a hint.
We already do it because of the test. The CCSS has some lovely language about cooperative learning. Nobody's teaching that because it's not on the test. There some nice lip service to questions with multiple correct responses. Also sitting gathering dust, because that's not on the test.
Take away the test, and teachers would rewrite the standards on the ground. Teachers would use their experience and training and professional judgment to adjust the standards to suit the students in their classroom. They would add (without regard for 15%) the standards that are missing. They would adjust the pace and depth of their instruction to match the needs of the students in their classrooms. They would replace "because it is on the test" with "because it best serves the needs of my students."
The coupling of testing and CCSS is, in its own way, the ultimate proof of CCSS's suckiness. Because if the CCSS were good, really good, you know what would happen if we decoupled?
Nothing. Teachers would say, "Thank you for these most excellent standards! I will take them back to my classroom and use them happily! They're so great; I'm not going to change a thing."
But CCSS are a straightjacket, and "because it's on the test" is the padlock that keeps it tight. Like a terrible performer, CCSS can only command a captive audience, and the chains on the door are "because it's on the test."
DeWitt wonders if CCSS is guilty by association, and it's true. Sometimes a nice guy looks like a criminal because he's hanging out with the wrong crowd, and test-driven accountability, as Tucker rightly argues, is one of the ugliest crowds around. But sometimes a guy is hanging out with a bunch of bad guys because he is, himself, a bad guy. With CCSS and test-driven accountability, I don't think it's so much a matter of "guilt by association" as "birds of a feather."
Tuesday, March 11, 2014
Essay-Grading Software & Peripatetic Penguins
Education Week has just run an article by Caralee J. Adams announcing (again) the rise of essay-grading software. There are so many things wrong with this that I literally do not know where to begin, so I will use the device of subheadings to create the illusion of order and organization even though I promise none. But before I begin, I just want to mention the image of a plethora of peripatetic penguins using flamethrowers to attack an army of iron-clad gerbils. It's a striking image using big words that I may want later. Also, look at what nice long sentences I worked into this paragraph.
Look! Here's My First Subheading!
Speaking for the software will be Mr. Jeff Pence, who apparently teaches middle school English to 140 students. God bless you, Mr. Pence. He says that grading a set of essays may take him two weeks, and while that seems only a hair slow to me, I would certainly agree that nobody is taking 140 7th grade essays home to read overnight.
But Mr. Pence is fortunate to have the use of Pearson WriteToLearn, a product with the catchy slogan "Grade less. Teach more. Improve scores." Which is certainly a finely tuned set of catchy non-sequitors. Pearson's ad copy further says, "WriteToLearn—our web-based literacy tool—aligns with the Common Core State Standards by placing strong emphasis on the comprehension and analysis of information texts while building reading and writing skills across genres." So you know this is good stuff.
Pearson White Papers Are Cool!
Pearson actually released a white paper "Pearson's Automated Scoring of Writing, Speaking, and Mathematics" back in May of 2011 (authors were Lynn Streeter, Jared Bernstein, Peter Foltz, and Donald DeLand-- all PhD's except DeLand).
The paper wears its CCSS love on its sleeve, leading with an assertion that the CCSS "advocate that students be taught 21st century skills, using authentic tasks and assessments." Because what is more authentic than writing for an automated audience? The paper deals with everything from writing samples of constructed response answers (I skipped the math parts) and in all cases finds the computer better, faster, and cheaper than the humans.
Also, Webinar!
The Pearson website also includes a link to a webinar about formative assessment which heavily emphasizes the role of timely, specific feedback, followed by targeted instruction, in improving student writing. Then we move on to why automated assessment is good for all these things (in this portion we get to hear about the work of Peter Foltz and Jeff Pence, who is apparently Pearson's go-to guy for pitching this stuff). This leads to a demo week in Pence's class to show how this works, and much of this looks usable. Look-- the 6+1 traits are assessed. Specific feedback. Helps.
And we know it works because the students who have used the Pearson software get better scores on the Pearson assessment of writing!! Magical!! Awesome!! We have successfully taught the lab rats how to push down the lever and serve themselves pellets.
Wait! What? Not Miraculous??
"Critics," Adams notes drily, "contend the software doesn't do much more than count words and therefor can't replace human readers." They contend a great deal more, and you can read about their contending at the website humanreaders.org, and God bless the internet that is a real thing.
"Let's face the realities of automated essay scoring," says the site. "Computers cannot 'read'." They have plenty of research findings and literature to back them up, but they also have a snappy list of one-word reasons that automated assessors are inadequate. Computerized essay grading is:
trivial
reductive
inaccurate
undiagnostic
unfair
secretive
Unlike Pearson, the folks at this website do not have snappy ad copy and slick production values to back them up. They are forced to resort to research and facts and stuff, but their conclusion is pretty clear. Computer grading is indefensible.
There's History
Adams gets into the history. I'm going to summarize.
Computer grading has been around for about forty years, and yet somehow it never quite catches on.
Why do you suppose that is?
That Was A Rhetorical Question
Computer grading of essays is the very enshrinement of Bad Writing Instruction. Like most standardized writing assessment in which humans score the essays based on rubrics so basic and mindless that a computer really could do the same job, this form of assessment teaches students to do an activity that looks like writing, but is not.
Just as reading without comprehension or purpose becomes simply word calling, writing without purpose becomes simply making word marks on a piece of paper or a screen.
Authentic writing is about the writer communicating something that he has to say with an audience. It's about sharing something she wants to say with people she wants to say it to. Authentic writing is not writing created for the purpose of being assessed.
If I've told my students once, I've told them a hundred times--good writing starts with the right question. The right question is not "What can I write to satisfy this assignment?" The right question is "What do I want to say about this?"
Computer-assessed writing has no more place in the world of humans than computer-assessed kissing or computer-assessed singing or computer-assessed joke delivery. These are all performance tasks, and they all have one other thing in common-- if you need a computer to help you assess them, you have no business assessing them at all.
And There's The Sucking Thing
Adams wraps up from some quotes from Les Perelman, former director of the MIT Writing Across the Curriculum program. He wrote an awesome must-read take-down of standardized writing for Slate, in which, among other things, he characterized standardized test writing as a test of "the ability to bullshit on demand." He was also an outspoken critic of the SAT essay portion when it first appeared, noting that length, big wordiness, and a disregard for factual accuracy were the only requirements. And if you have any illusions about the world of human test essay scoring, reread this classic peek inside the industry.
His point about computer-assessed writing is simple. "My main concern is that it doesn't work." Perelman is the guy who coached two students to submit an absolutely execrable essay to the SAT. The essay included gem sentences such as:
American president Franklin Delenor Roosevelt advocated for civil unity despite the communist threat of success by quoting, "the only thing we need to fear is itself," which disdained competition as an alternative to cooperation for success.
That essay scored a five. So when Pearson et al tell you they've come up with a computer program that assesses essays just as well as a human, what they mean is "just as well as a human who is using a crappy set of standardized test essay assessment tools." In that regard, I believe they are probably correct.
To Conclude
Computer-assessed grading remains a faster, cheaper way to enshrine the same hallmarks of bad writing that standardized tests were already promoting. Just, you know, faster and cheaper, ergo better. The good news is that the system is easy to game. Recycle the prompt. Write lots and lots of words. Make some of them big. And use a variety of sentence lengths and patterns, although you should err on the side of really long sentences because those will convince the program that you have expressed a really complicated thought and not just I pledge allegiance to the flag of the United States of Estonia; therefor, a bicycle, because a vest has no plethora of sleeves. And now I will conclude by bring up the peripatetic penguins with flamethrowers again, to tie everything up. Am I a great writer, or what?
Look! Here's My First Subheading!
Speaking for the software will be Mr. Jeff Pence, who apparently teaches middle school English to 140 students. God bless you, Mr. Pence. He says that grading a set of essays may take him two weeks, and while that seems only a hair slow to me, I would certainly agree that nobody is taking 140 7th grade essays home to read overnight.
But Mr. Pence is fortunate to have the use of Pearson WriteToLearn, a product with the catchy slogan "Grade less. Teach more. Improve scores." Which is certainly a finely tuned set of catchy non-sequitors. Pearson's ad copy further says, "WriteToLearn—our web-based literacy tool—aligns with the Common Core State Standards by placing strong emphasis on the comprehension and analysis of information texts while building reading and writing skills across genres." So you know this is good stuff.
Pearson White Papers Are Cool!
Pearson actually released a white paper "Pearson's Automated Scoring of Writing, Speaking, and Mathematics" back in May of 2011 (authors were Lynn Streeter, Jared Bernstein, Peter Foltz, and Donald DeLand-- all PhD's except DeLand).
The paper wears its CCSS love on its sleeve, leading with an assertion that the CCSS "advocate that students be taught 21st century skills, using authentic tasks and assessments." Because what is more authentic than writing for an automated audience? The paper deals with everything from writing samples of constructed response answers (I skipped the math parts) and in all cases finds the computer better, faster, and cheaper than the humans.
Also, Webinar!
The Pearson website also includes a link to a webinar about formative assessment which heavily emphasizes the role of timely, specific feedback, followed by targeted instruction, in improving student writing. Then we move on to why automated assessment is good for all these things (in this portion we get to hear about the work of Peter Foltz and Jeff Pence, who is apparently Pearson's go-to guy for pitching this stuff). This leads to a demo week in Pence's class to show how this works, and much of this looks usable. Look-- the 6+1 traits are assessed. Specific feedback. Helps.
And we know it works because the students who have used the Pearson software get better scores on the Pearson assessment of writing!! Magical!! Awesome!! We have successfully taught the lab rats how to push down the lever and serve themselves pellets.
Wait! What? Not Miraculous??
"Critics," Adams notes drily, "contend the software doesn't do much more than count words and therefor can't replace human readers." They contend a great deal more, and you can read about their contending at the website humanreaders.org, and God bless the internet that is a real thing.
"Let's face the realities of automated essay scoring," says the site. "Computers cannot 'read'." They have plenty of research findings and literature to back them up, but they also have a snappy list of one-word reasons that automated assessors are inadequate. Computerized essay grading is:
trivial
reductive
inaccurate
undiagnostic
unfair
secretive
Unlike Pearson, the folks at this website do not have snappy ad copy and slick production values to back them up. They are forced to resort to research and facts and stuff, but their conclusion is pretty clear. Computer grading is indefensible.
There's History
Adams gets into the history. I'm going to summarize.
Computer grading has been around for about forty years, and yet somehow it never quite catches on.
Why do you suppose that is?
That Was A Rhetorical Question
Computer grading of essays is the very enshrinement of Bad Writing Instruction. Like most standardized writing assessment in which humans score the essays based on rubrics so basic and mindless that a computer really could do the same job, this form of assessment teaches students to do an activity that looks like writing, but is not.
Just as reading without comprehension or purpose becomes simply word calling, writing without purpose becomes simply making word marks on a piece of paper or a screen.
Authentic writing is about the writer communicating something that he has to say with an audience. It's about sharing something she wants to say with people she wants to say it to. Authentic writing is not writing created for the purpose of being assessed.
If I've told my students once, I've told them a hundred times--good writing starts with the right question. The right question is not "What can I write to satisfy this assignment?" The right question is "What do I want to say about this?"
Computer-assessed writing has no more place in the world of humans than computer-assessed kissing or computer-assessed singing or computer-assessed joke delivery. These are all performance tasks, and they all have one other thing in common-- if you need a computer to help you assess them, you have no business assessing them at all.
And There's The Sucking Thing
Adams wraps up from some quotes from Les Perelman, former director of the MIT Writing Across the Curriculum program. He wrote an awesome must-read take-down of standardized writing for Slate, in which, among other things, he characterized standardized test writing as a test of "the ability to bullshit on demand." He was also an outspoken critic of the SAT essay portion when it first appeared, noting that length, big wordiness, and a disregard for factual accuracy were the only requirements. And if you have any illusions about the world of human test essay scoring, reread this classic peek inside the industry.
His point about computer-assessed writing is simple. "My main concern is that it doesn't work." Perelman is the guy who coached two students to submit an absolutely execrable essay to the SAT. The essay included gem sentences such as:
American president Franklin Delenor Roosevelt advocated for civil unity despite the communist threat of success by quoting, "the only thing we need to fear is itself," which disdained competition as an alternative to cooperation for success.
That essay scored a five. So when Pearson et al tell you they've come up with a computer program that assesses essays just as well as a human, what they mean is "just as well as a human who is using a crappy set of standardized test essay assessment tools." In that regard, I believe they are probably correct.
To Conclude
Computer-assessed grading remains a faster, cheaper way to enshrine the same hallmarks of bad writing that standardized tests were already promoting. Just, you know, faster and cheaper, ergo better. The good news is that the system is easy to game. Recycle the prompt. Write lots and lots of words. Make some of them big. And use a variety of sentence lengths and patterns, although you should err on the side of really long sentences because those will convince the program that you have expressed a really complicated thought and not just I pledge allegiance to the flag of the United States of Estonia; therefor, a bicycle, because a vest has no plethora of sleeves. And now I will conclude by bring up the peripatetic penguins with flamethrowers again, to tie everything up. Am I a great writer, or what?
When Is Your Last Teaching Day of School?
Years ago, the Tax Foundation hit upon a great tool for illustrating how large our individual tax load is-- Tax Freedom Day. Starting from January 1, how many days would Americans (or residents of your state, if you break it down that way) have to work just to pay off taxes.
In a small piece of PR serendipity, Tax Freedom Day falls in April in most states. By some mid-April day, all Americans have earned enough money to pay off the income tax debt.
It makes me wonder, as we enter testing season, when our Last Teaching Day of School would be.
If all standardized testing came at the very end of the year, what would be our last day of school?
How would the pubic react if we handed out final report cards in April (or in some heavily-besieged elementary schools, March) and told parents, "Okay, the teaching year is over. But your child needs to come to school for the next 4/6/8/10 weeks just to take all their tests."
How quickly would the remaining public support for our massive testing status quo evaporate if the tests were no longer hidden and camouflaged among the teaching days of the real school year, but had to stand on their own? I'm guessing pretty quickly. Wherever you are, maybe it would help crystallize things for folks if you could tell them what the Last Teaching Day of the year would be.
In a small piece of PR serendipity, Tax Freedom Day falls in April in most states. By some mid-April day, all Americans have earned enough money to pay off the income tax debt.
It makes me wonder, as we enter testing season, when our Last Teaching Day of School would be.
If all standardized testing came at the very end of the year, what would be our last day of school?
How would the pubic react if we handed out final report cards in April (or in some heavily-besieged elementary schools, March) and told parents, "Okay, the teaching year is over. But your child needs to come to school for the next 4/6/8/10 weeks just to take all their tests."
How quickly would the remaining public support for our massive testing status quo evaporate if the tests were no longer hidden and camouflaged among the teaching days of the real school year, but had to stand on their own? I'm guessing pretty quickly. Wherever you are, maybe it would help crystallize things for folks if you could tell them what the Last Teaching Day of the year would be.
Bad Threats
It's a lesson from Teacher Basics 101. Don't make a threat if you can't live with the consequences.
Do not tell your students that if they don't hand in the homework, you'll fail them for the year. Don't tell your students that everybody runs a four-minute mile or everybody's off the team. And never, ever tell an unruly class that if you hear "one more peep," everybody gets a detention.
The Masters of Reforming Our Nation's Schools have no teaching experience to their collective names, and so they've been breaking the Bad Threat rule with abandon, and children are paying the price.
There are two parts to a bad threat.
Part I is the expectation.
We've heard plenty about the "soft bigotry of low expectations." And Michael Gerson wasn't entirely wrong-- we have a history of all too often writing off students because of poverty or race or chaotic home life or not-so-brightness. Too often we really have held our most challenged students to no expectation at all.
But for the soft bigotry of low expectations, we have substituted the hard tyranny of ridiculous expectations. We have, for instance, substituted the expectation that every third grader will read at grade level no matter what. In some states (I'm looking at you, NY) we raised the standard for proficiency arbitrarily. And we have just generally pushed the idea that all students should be at grade level (as determined by anything from data averages to a politician's whim) all the time.
That seems like a swell expectation. It's not. It's stupid. Let's just apply that reasoning some more. Let's compute the average height for an eight-year-old and declare that all third graders must be that height. Let's require all children to be walking by their tenth month and potty trained by month thirteen. Let's require all seventeen-year-old males to be able to grow facial hair and all fifteen-year-old females to fill a B cup. And let's tell all young men and women that they must be engaged by age twenty-two.
Let's take every single human developmental milestone and set a point by which every human being must have achieved it. Because that is totally how human beings develop and learn and grow-- on exactly the same path, at exactly the same speed, at exactly the same time.
Then we get to Part II of a Bad Threat-- the "or else."
A bad "or else" creates a punishment that neither the Person In Charge or the person being punished can easily live with. If I give everybody in my class a detention because one kid said "peep" (and everyone laughed, because it is kind of funny, but now I look like a fool, so detentions for all of you rotten kids!!), my students have an hour of their lives wasted, and I have to sit in the principal's office and explain what they hell I was thinking.
But the "or else" under the current standards testing regime is far worse. We've said to students, "You are going to reach this level of development, or we'll flunk you, even if it's a ton of you." As noted by Carol Burris and Alan A. Aja, "ton" is an understatement. We've sold many communities on the idea that being subjected to the hard tyranny of ridiculous expectations is a good thing, and now the cost is becoming clear.
The achievement gap is widening. Students are falling below basic in staggering numbers (50% of third grade black students below basic on ELA tests, 84% ELL students below basic on ELA tests, and the list goes on).
The "promise of the common core" turns out to be nothing more than threatening students "You're going to pass this high stakes test or we're going to label you a failure, punish your teachers, and keep you from graduating." That's not the soft bigotry of low expectations, but the rather harsh bigotry of "Those damn lazy kids just aren't motivated enough. Threaten them." They don't need help, support, resources, economic relief, or anything else-- just threats.
The cost of this bad threat is more than the students should have to bear and certainly of no benefit to us as a society. And the test results recall one more lesson from Basic Teacher 101. If you have given a test to your class and a huge percentage of the students have failed it, it's a bad test.
Do not tell your students that if they don't hand in the homework, you'll fail them for the year. Don't tell your students that everybody runs a four-minute mile or everybody's off the team. And never, ever tell an unruly class that if you hear "one more peep," everybody gets a detention.
The Masters of Reforming Our Nation's Schools have no teaching experience to their collective names, and so they've been breaking the Bad Threat rule with abandon, and children are paying the price.
There are two parts to a bad threat.
Part I is the expectation.
We've heard plenty about the "soft bigotry of low expectations." And Michael Gerson wasn't entirely wrong-- we have a history of all too often writing off students because of poverty or race or chaotic home life or not-so-brightness. Too often we really have held our most challenged students to no expectation at all.
But for the soft bigotry of low expectations, we have substituted the hard tyranny of ridiculous expectations. We have, for instance, substituted the expectation that every third grader will read at grade level no matter what. In some states (I'm looking at you, NY) we raised the standard for proficiency arbitrarily. And we have just generally pushed the idea that all students should be at grade level (as determined by anything from data averages to a politician's whim) all the time.
That seems like a swell expectation. It's not. It's stupid. Let's just apply that reasoning some more. Let's compute the average height for an eight-year-old and declare that all third graders must be that height. Let's require all children to be walking by their tenth month and potty trained by month thirteen. Let's require all seventeen-year-old males to be able to grow facial hair and all fifteen-year-old females to fill a B cup. And let's tell all young men and women that they must be engaged by age twenty-two.
Let's take every single human developmental milestone and set a point by which every human being must have achieved it. Because that is totally how human beings develop and learn and grow-- on exactly the same path, at exactly the same speed, at exactly the same time.
Then we get to Part II of a Bad Threat-- the "or else."
A bad "or else" creates a punishment that neither the Person In Charge or the person being punished can easily live with. If I give everybody in my class a detention because one kid said "peep" (and everyone laughed, because it is kind of funny, but now I look like a fool, so detentions for all of you rotten kids!!), my students have an hour of their lives wasted, and I have to sit in the principal's office and explain what they hell I was thinking.
But the "or else" under the current standards testing regime is far worse. We've said to students, "You are going to reach this level of development, or we'll flunk you, even if it's a ton of you." As noted by Carol Burris and Alan A. Aja, "ton" is an understatement. We've sold many communities on the idea that being subjected to the hard tyranny of ridiculous expectations is a good thing, and now the cost is becoming clear.
The achievement gap is widening. Students are falling below basic in staggering numbers (50% of third grade black students below basic on ELA tests, 84% ELL students below basic on ELA tests, and the list goes on).
The "promise of the common core" turns out to be nothing more than threatening students "You're going to pass this high stakes test or we're going to label you a failure, punish your teachers, and keep you from graduating." That's not the soft bigotry of low expectations, but the rather harsh bigotry of "Those damn lazy kids just aren't motivated enough. Threaten them." They don't need help, support, resources, economic relief, or anything else-- just threats.
The cost of this bad threat is more than the students should have to bear and certainly of no benefit to us as a society. And the test results recall one more lesson from Basic Teacher 101. If you have given a test to your class and a huge percentage of the students have failed it, it's a bad test.
Monday, March 10, 2014
Reclaiming Public Education 101
Today, I'm opening a branch blog office.
I've come to believe there's an unmet need in the edublogoverse (the unmet need is not the one for new made-up words). Most of us who frequent these spots have spent months or years sorting through the giant convoluted multi-threaded novel series that is reformy stuff, and what we write, while perfectly sensible to each other, may leave many other folks scratching their heads and feeling that they've stumbled into a private party where everyone speaks some odd form of Greek.
In here I could write, "Cami and King can just VAM-cram their reformy stuff into a slow boat to Estonia and let Arne steer the whole way while Rhee sings lullabies through her duct-taped lips," and most of you would actually understand what the heck I was talking about. The average human on the planet would not.
I am in a place where much of the new reformy stuff hasn't attracted many peoples' attention yet, but is poking at the edges of consciousness where it is perceived as This Year's Slightly Dumber Than Usual Mandates from the State. I would like to help them understand.
I occasionally write pieces aimed at that audience, but those quickly disappear into the pile of witty takedowns of bureaucratic nonsense written by people they don't know about things they haven't heard of (it's possible that I write too much and too fast).
Several months ago I created a tumblr of ed links just so I wouldn't lose stuff as I found it (it's right here) but I just got my tumblr 1000-post merit badge and the site looks like the online version of my grandfather's attic.
So I'm going to try this. It's called Reclaiming Public Education 101, and I believe in it enough to actually fork over the nominal wordpress domain fee so that it's easy to remember/find.
If you are reading my blog, RPE101 is probably not for you. It's for your friend who says things like, "So why does the Common Core make you spit and growl, exactly?" Or your other friend who says, "That can't be how that Value Added thing is really supposed to work." Or your coworker who says, "I tried to read that link you sent me, but it made my brain hurt hard."
It's set up to be quick and simple. Just an excerpt, an abstract, and a link for each post. A kind of gateway drug for edublog consumption. I will gladly take suggestions and ecstatically take referrals (I've already included Anthony Cody's classic 10 CCSS mistakes and Erin Osborne's invaluable new Gates $$ chart). I'll even take requests. I'll keep adding things as I find them or write them (and I'll post the ones I write here first, because I come from a long line of mild OCD sufferers).
I respect and admire so many people in this fight. The people who do the hard core scholarship, the people who get out in the streets and fight and holler, the people who work the halls of power. For a variety of reasons, those are not things I can really do. But I can write and tag and collect. I can pound a keyboard like a sumbitch. So this is my next contribution. Let me know if it's useful and how it can be more useful, and I'll see if we can make a helpful tool out of it.
I've come to believe there's an unmet need in the edublogoverse (the unmet need is not the one for new made-up words). Most of us who frequent these spots have spent months or years sorting through the giant convoluted multi-threaded novel series that is reformy stuff, and what we write, while perfectly sensible to each other, may leave many other folks scratching their heads and feeling that they've stumbled into a private party where everyone speaks some odd form of Greek.
In here I could write, "Cami and King can just VAM-cram their reformy stuff into a slow boat to Estonia and let Arne steer the whole way while Rhee sings lullabies through her duct-taped lips," and most of you would actually understand what the heck I was talking about. The average human on the planet would not.
I am in a place where much of the new reformy stuff hasn't attracted many peoples' attention yet, but is poking at the edges of consciousness where it is perceived as This Year's Slightly Dumber Than Usual Mandates from the State. I would like to help them understand.
I occasionally write pieces aimed at that audience, but those quickly disappear into the pile of witty takedowns of bureaucratic nonsense written by people they don't know about things they haven't heard of (it's possible that I write too much and too fast).
Several months ago I created a tumblr of ed links just so I wouldn't lose stuff as I found it (it's right here) but I just got my tumblr 1000-post merit badge and the site looks like the online version of my grandfather's attic.
So I'm going to try this. It's called Reclaiming Public Education 101, and I believe in it enough to actually fork over the nominal wordpress domain fee so that it's easy to remember/find.
If you are reading my blog, RPE101 is probably not for you. It's for your friend who says things like, "So why does the Common Core make you spit and growl, exactly?" Or your other friend who says, "That can't be how that Value Added thing is really supposed to work." Or your coworker who says, "I tried to read that link you sent me, but it made my brain hurt hard."
It's set up to be quick and simple. Just an excerpt, an abstract, and a link for each post. A kind of gateway drug for edublog consumption. I will gladly take suggestions and ecstatically take referrals (I've already included Anthony Cody's classic 10 CCSS mistakes and Erin Osborne's invaluable new Gates $$ chart). I'll even take requests. I'll keep adding things as I find them or write them (and I'll post the ones I write here first, because I come from a long line of mild OCD sufferers).
I respect and admire so many people in this fight. The people who do the hard core scholarship, the people who get out in the streets and fight and holler, the people who work the halls of power. For a variety of reasons, those are not things I can really do. But I can write and tag and collect. I can pound a keyboard like a sumbitch. So this is my next contribution. Let me know if it's useful and how it can be more useful, and I'll see if we can make a helpful tool out of it.
Subscribe to:
Posts (Atom)