In the classroom, objectives are important. I remember my own painful experience as a student teacher (replicated by several of my own student teachers), imagining that we would simply read a book and the magical educationny things would just sort of happen, somehow. I had to learn to answer the question "Why are we studying thing?" I had to know what I wanted students to get out of the unit, and once I understood that, then teaching and instructional strategies and assessments all just kind of fell into place.
So do not imagine for a moment that I don't see the value of objectives. No teacher can function well in a classroom if she can't answer the question, "What is the point of any of this?"
But the modern reform era has given us objectives that hamper teaching rather than enhance it.
The standards movement has given us objectives that are strikingly narrow and literal, as well as completely blind to the content of the material that we teach.
ELA objectives (standards) are strictly skills based, so we approach a work like Hamlet focused strictly on items like this:
Determine the meaning of words and phrases as they are used in the text, including figurative and connotative meanings; analyze the impact of specific word choices on meaning and tone, including words with multiple meanings or language that is particularly fresh, engaging, or beautiful.
Nowhere in the standards will you find any reference to grappling with the major topics and themes of Hamlet, like mortality and coming to grips with death and the search for meaning in existence. Nope. Find some words and figure out what they mean.
And the Big Standardized Tests double down on this objective myopia. There will be no questions about the content of Hamlet-- not even simple recall of plot and character, let alone the kind of deeply considered ideas that could only be examined in lengthy writing produced over a thoughtful period of time. No, the BST will say, "Remember how you figured out what some strange words meant in that one thing you read? Here are some strange words-- do that figure-them-out trick again."
In fact, many of us have been ordered to put up posters in our room reminding our students about their singular objectives. And many of us are now required to do the same with each and every lesson-- to focus our students on the one-and-only objective of the day's teaching. "This is our goal, our only goal, and our all-consuming goal."
This is education as a ride on a train, with only one destination, one purpose, one target. This is standardization at its very worst. This is a prospector who sets up his equipment to drill for oil on his property and declares himself a failure because all he found was silver, gold, and diamonds.
This is bad teaching. This is the kindergarten teacher who flunks Pat for coloring outside the lines. This is the English teacher who teaches that there is one-- and only one-- correct interpretation for every work of literature. In fact, this is not just bad teaching, but bad living-- the people who think there is only one correct way to be in the world, only one True system of belief, only one correct way to react to a given situation. This is rigid fundamentalism at its worst.
Should we have objectives? Absolutely. Should we be open to the possibilities of many objectives? Should we be open to the possibility of opportunities arising in the classroom? Also absolutely. We certainly shouldn't suggest to our students that there is only one goal and then tell them what it is in such a way as to suggest that all other possible discoveries should be ignored. We should never throw away diamonds because we were searching only for oil.
Monday, November 20, 2017
Sunday, November 19, 2017
NPE: Charter Effects Are Alarming
We can talk all day about the intentions of charter operators, about the possible ramifications of various charter policy decisions. Heck, on occasion I can talk about the conditions under which I would welcome charter schools (because I don't automatically default to the position that they're a Bad Thing).
There is a pattern in the ed reform movement. Reformsters hold up a bright shiny polished reform idea, people hop up to say, "Wow, that looks great! Let's have some of that!" And then something else entirely is delivered. So when we talk about any reform policy, we need to talk about what is actually happening on the ground. And what is happening on the ground is fairly alarming.
The Network for Public Education has now done that for charter schools. Full disclosures-- first, I'm a member of NPE and second, NPE is not predisposed to be kind to charter schools. Nevertheless, I recommend you read their new report Charters and Consequences and judge for yourself. NPE has taken a look at what is actually happening in the charter world, and it's not good.
The report is a collection of eleven separate pieces of investigation, created over the span of a year. These are not policy arguments or debates about how public ed should be handled. These are heavily researched, fully sourced accounts of what is actually happening in America. You may disagree with NPE's position, but this is not a position paper. It's a fact-based picture of what is actually going on.
The first four pieces deal with California, where there are more charter schools and charter school students than in any other state. The very first piece sets the stage for California charter shenanigans:
You can find a charter in a mall, near a Burger King, where students as young as 12 meet their “teacher on demand.” Or, you can make a cyber visit to the “blended learning” Epic Charter School, whose students are required to meet a teacher (at a convenient, to be determined location) only once every 20 days. There is an added bonus upon joining Epic—students receive $1500 for a personal “learning fund,” along with a laptop computer. The enrollment site even advertised that students could boost that fund by referring others to the charter chain.
A superintendent can expand his tiny rural district of 300 students to 4000 by running "independent study" charters in storefronts in cities miles away, netting millions in revenue for his district, while draining the sometimes unsuspecting host district of students and funds. If he is clever, he might arrange a “bounty” for each one opened, while having a side business selling services to the charters. Charters can even provide lucrative investment opportunities for tennis stars and their friends. And then there is the opportunity "to cash in" on international students at a jaw dropping $31,300 per student.
The report is thick with such details. And why is California such a charter playground? Because there is plenty of big money that has come there to play, with the California Charter School Association pouring $2.3 million into just one school board election. Those pockets are deep.
The report also looks at independent learning centers, the kind of storefront charters that operate independent of any specific classroom setting. many of these turn out to be linked pieces of a chain of resource centers, and their track record is abysmal, with far fewer than half the students actually graduating.
The report threads its way through an example of how for-profits can hide behind a web of non-profits, essentially laundering money before turning it into a nice pile of cash to benefit owners of the operation.
And the report talks to some of the folks in California who have tried to fight back against charter fraud and abuse, from whole school boards to individuals like Mike Matsuda. None of them are arguing to eliminate charters entirely, but all would like to see charters operate fairly and within the rules. And that concludes the four-part trip through California.
In, "Charter High Schools and the Best of High Schools List," NPE looks at some of the high-ranking charters and how they get there. For instance, the BASIS charter in Phoenix earns a super-high "challenge" ranking by combining a high attrition rate with giving the AP test to many underclasspersons.
In "Charter Chains: Risk, High Costs and Consequences" the report looks at the growing dominance of charter chains and the risks that come from putting so many schools under the control of state-spanning corporations. There's a risk for fraud and abuse, as well as directing a ton of money to the top in groups like KIPP, which boasts $6 million in administrative costs. And of course there's the Gulen chain, allegedly a fundraising arm of an out-of-power Turkish government in exile.
"Draining the Coffers: The Fiscal Impact of Charters on Public Schools" looks at how charters suck the financial blood from public schools, and what better place to look than my own Pennsylvania, where cyber-charters in particular are driving schools into financial trouble. But across the state, we see public schools that are forced to slash and gut programs, even close schools, to survive the charter drain. I'll note as always that this doesn't have to be the case-- if legislators had the guts to tell the truth and not pretend that you can run three schools for the same cost as running one. But as long as that lie is the premise of charter policy, education will be a zero sum game in which every charter student represents damage to the public system.
In "Public Funding with Private School Advantages," the report looks at how charters often try to have it both ways-- public when they want access to public tax dollars, but private when it comes to following laws governing education. BASIS again provides an example of a charter that isn't really open to everyone (eg- each family must makes a $1500 donation).
"Ignoring the Community Voice" looks at how Philadelphia lost community voice in management of its schools. It's a pattern repeated across the country-- you can have a charter school if you are willing to give up any voice in how your child's school operates.
"Are Charters Public Schools?" Do they reflect the demographic make-up of their neighborhood? Are they committed to serving all students? Are they responsible to community voices? Here's some data to answer the question (spoiler alert-- no).
Finally, the report asks "Have NAACP concerns been addressed?" In other words, are charters still functioning as engines of segregation? Are they transparent and accountable? Are they damaging the rest of the community in which they exist? Are they still disproportionately punishing and pushing out some students?
The report package ends with a statement from NPE about charter schools, with a call for a specific list of legislative policies and reforms favored by the group. Bottom line: until charters follow the public school rules, they're still private schools that take public funds.
The report is under fifty pages and quite readable. Nothing I do here can really capture the sheer weight of detail and examples provided. it will make a great resource for when one of those charter questions comes up yet again, and it's a good primer for people wondering what the fuss is about. It's a worthwhile read.
There is a pattern in the ed reform movement. Reformsters hold up a bright shiny polished reform idea, people hop up to say, "Wow, that looks great! Let's have some of that!" And then something else entirely is delivered. So when we talk about any reform policy, we need to talk about what is actually happening on the ground. And what is happening on the ground is fairly alarming.
The Network for Public Education has now done that for charter schools. Full disclosures-- first, I'm a member of NPE and second, NPE is not predisposed to be kind to charter schools. Nevertheless, I recommend you read their new report Charters and Consequences and judge for yourself. NPE has taken a look at what is actually happening in the charter world, and it's not good.
The report is a collection of eleven separate pieces of investigation, created over the span of a year. These are not policy arguments or debates about how public ed should be handled. These are heavily researched, fully sourced accounts of what is actually happening in America. You may disagree with NPE's position, but this is not a position paper. It's a fact-based picture of what is actually going on.
The first four pieces deal with California, where there are more charter schools and charter school students than in any other state. The very first piece sets the stage for California charter shenanigans:
You can find a charter in a mall, near a Burger King, where students as young as 12 meet their “teacher on demand.” Or, you can make a cyber visit to the “blended learning” Epic Charter School, whose students are required to meet a teacher (at a convenient, to be determined location) only once every 20 days. There is an added bonus upon joining Epic—students receive $1500 for a personal “learning fund,” along with a laptop computer. The enrollment site even advertised that students could boost that fund by referring others to the charter chain.
A superintendent can expand his tiny rural district of 300 students to 4000 by running "independent study" charters in storefronts in cities miles away, netting millions in revenue for his district, while draining the sometimes unsuspecting host district of students and funds. If he is clever, he might arrange a “bounty” for each one opened, while having a side business selling services to the charters. Charters can even provide lucrative investment opportunities for tennis stars and their friends. And then there is the opportunity "to cash in" on international students at a jaw dropping $31,300 per student.
The report is thick with such details. And why is California such a charter playground? Because there is plenty of big money that has come there to play, with the California Charter School Association pouring $2.3 million into just one school board election. Those pockets are deep.
The report also looks at independent learning centers, the kind of storefront charters that operate independent of any specific classroom setting. many of these turn out to be linked pieces of a chain of resource centers, and their track record is abysmal, with far fewer than half the students actually graduating.
The report threads its way through an example of how for-profits can hide behind a web of non-profits, essentially laundering money before turning it into a nice pile of cash to benefit owners of the operation.
And the report talks to some of the folks in California who have tried to fight back against charter fraud and abuse, from whole school boards to individuals like Mike Matsuda. None of them are arguing to eliminate charters entirely, but all would like to see charters operate fairly and within the rules. And that concludes the four-part trip through California.
In, "Charter High Schools and the Best of High Schools List," NPE looks at some of the high-ranking charters and how they get there. For instance, the BASIS charter in Phoenix earns a super-high "challenge" ranking by combining a high attrition rate with giving the AP test to many underclasspersons.
In "Charter Chains: Risk, High Costs and Consequences" the report looks at the growing dominance of charter chains and the risks that come from putting so many schools under the control of state-spanning corporations. There's a risk for fraud and abuse, as well as directing a ton of money to the top in groups like KIPP, which boasts $6 million in administrative costs. And of course there's the Gulen chain, allegedly a fundraising arm of an out-of-power Turkish government in exile.
"Draining the Coffers: The Fiscal Impact of Charters on Public Schools" looks at how charters suck the financial blood from public schools, and what better place to look than my own Pennsylvania, where cyber-charters in particular are driving schools into financial trouble. But across the state, we see public schools that are forced to slash and gut programs, even close schools, to survive the charter drain. I'll note as always that this doesn't have to be the case-- if legislators had the guts to tell the truth and not pretend that you can run three schools for the same cost as running one. But as long as that lie is the premise of charter policy, education will be a zero sum game in which every charter student represents damage to the public system.
In "Public Funding with Private School Advantages," the report looks at how charters often try to have it both ways-- public when they want access to public tax dollars, but private when it comes to following laws governing education. BASIS again provides an example of a charter that isn't really open to everyone (eg- each family must makes a $1500 donation).
"Ignoring the Community Voice" looks at how Philadelphia lost community voice in management of its schools. It's a pattern repeated across the country-- you can have a charter school if you are willing to give up any voice in how your child's school operates.
"Are Charters Public Schools?" Do they reflect the demographic make-up of their neighborhood? Are they committed to serving all students? Are they responsible to community voices? Here's some data to answer the question (spoiler alert-- no).
Finally, the report asks "Have NAACP concerns been addressed?" In other words, are charters still functioning as engines of segregation? Are they transparent and accountable? Are they damaging the rest of the community in which they exist? Are they still disproportionately punishing and pushing out some students?
The report package ends with a statement from NPE about charter schools, with a call for a specific list of legislative policies and reforms favored by the group. Bottom line: until charters follow the public school rules, they're still private schools that take public funds.
The report is under fifty pages and quite readable. Nothing I do here can really capture the sheer weight of detail and examples provided. it will make a great resource for when one of those charter questions comes up yet again, and it's a good primer for people wondering what the fuss is about. It's a worthwhile read.
ICYMI: Last Quiet Weekend Edition (11/19)
Some important reads this week. As always, I encourage you to share and tweet and email anything you read that you think deserves a wider audience, because you, dear reader, are how those pieces get a wider audience.
Florida Teacher Shortage
Many, many folks have read the piece I wrote in response to this Sun-Sentinel article about the teacher shortage [sic] in Florida, but I encourage you to go read the original reporting, which is really top notch.
After a Political Rout in Massachusetts, New York Astro-Turf Group Mulling Strategy
When a bunch of millionaires poured money into launching new charter rules in Massachusetts, tey had no idea they'd get spanked this badly. What now? A look at one of the big dark money groups driving the charter school movement.
The Every Student Succeeds Act's Hollow Educational Ambition
Rick Hess (AEI) is a reformster, but he's not afraid to point out when ed reform makes some stupid moves. Here's his take on how NCLB dropped the ball, and ESSA is dropping the same ball again.
Closing the Gap for Native American Youth
A new study, the first ever done, looks at what can be done to close the gap for native American children. This will take you to the study; if that seems daunting, I will try to get to it at some point.
How Ed Reform Ate the Democratic Party
Jennifer Berkshire looks at the sad history of how the Democratic Party decided to stop being the party of public education and instead transformed itself into GOP-lite.
How Stranger Things Shows Support for Public Schools
One small feature of the hit Netflix series is how it places the local school in the middle of the community.
Schooling Is Never Neutral
The JLV with a brief but important reminder
The DC School Reform Fiasco: A Complete History
John Merrow and Mary Levy have created a comprehensive look at the DC "reform" shenanigans of She Who Will Not Be Named and others. An important counterpoint to all the folks who keep insisting that DC is an example of school reform working.
But It Was The Very Best Butter
Almost forgot this one-- a quick explanation of how a good test can still be a bad test
Florida Teacher Shortage
Many, many folks have read the piece I wrote in response to this Sun-Sentinel article about the teacher shortage [sic] in Florida, but I encourage you to go read the original reporting, which is really top notch.
After a Political Rout in Massachusetts, New York Astro-Turf Group Mulling Strategy
When a bunch of millionaires poured money into launching new charter rules in Massachusetts, tey had no idea they'd get spanked this badly. What now? A look at one of the big dark money groups driving the charter school movement.
The Every Student Succeeds Act's Hollow Educational Ambition
Rick Hess (AEI) is a reformster, but he's not afraid to point out when ed reform makes some stupid moves. Here's his take on how NCLB dropped the ball, and ESSA is dropping the same ball again.
Closing the Gap for Native American Youth
A new study, the first ever done, looks at what can be done to close the gap for native American children. This will take you to the study; if that seems daunting, I will try to get to it at some point.
How Ed Reform Ate the Democratic Party
Jennifer Berkshire looks at the sad history of how the Democratic Party decided to stop being the party of public education and instead transformed itself into GOP-lite.
How Stranger Things Shows Support for Public Schools
One small feature of the hit Netflix series is how it places the local school in the middle of the community.
Schooling Is Never Neutral
The JLV with a brief but important reminder
The DC School Reform Fiasco: A Complete History
John Merrow and Mary Levy have created a comprehensive look at the DC "reform" shenanigans of She Who Will Not Be Named and others. An important counterpoint to all the folks who keep insisting that DC is an example of school reform working.
But It Was The Very Best Butter
Almost forgot this one-- a quick explanation of how a good test can still be a bad test
Saturday, November 18, 2017
DeVos: Vouchers Don't Have To Serve Everyone
You may recall the case of Endrew F. vs. Douglas County School District, in which the parents of an autistic child and the Douglas County schools of Colorado got into an argument about "de minimis" aka "how little education can a district get away with providing." Did Endrew's IEP require the district to pay for his tuition to a swanky school that provided fancy stuff like "education"? Somehow this made it all the way to the Supremes, who unanimously ruled sort of down the middle-- school district compliance with IDEA has to be more than a half-baked half effort, but education experts get to be the experts on education, not Mom and Dad.
The whole business now has a sequel, starring Secretary of Education Betsy DeVos.
Remember that time DeVos was being interviewed for her job and she didn't really seem to understand what IDEA actually was? Specifically, didn't seem clear on whether schools receiving federal funds would be required to follow the federal IDEA law?
Oh-- and remember that time when she called Historically Black Colleges and Universities "pioneers of school choice"? Which was kind of like calling the underground railroad pioneers of Uber?
Well, both of those moments had a sequel this week as reported by Ann Schimke for Chalkbeat. There are two take-aways here. One is not so big, and one kind of is.
First, the F family was none too happy about being used as props for one more DeVos love letter to school choice.
“Every family should have that ability to choose the learning environment that’s right for their child,” she said. “They shouldn’t have to sue their way to the Supreme Court to get it.”
Remember that DeVos quote. The Fs, Joe and Jennifer, were not pleased.
“To hold us out there as a poster child on how a private school is working for our child and how this is how school choice is supposed to work, really bugs me,” Joe said.
“It was a little disappointing,” Jennifer said. “She picked the parts that she liked and used them for what she wanted.”
Now to the bigger takeaway. Turns out that the Fs had actually met DeVos, privately, at her request.
They were flattered by her interest, but felt she didn’t understand why private school vouchers would never work for them — or many other families who have children with disabilities.
Specifically, how a small voucher amount does not get you into a pricey specialized private school like the one Endrew attends. But according to the Fs, they raised an even larger issue, and DeVos gave them a straight, if not welcome, answer.
Do students with disabilities lose their rights to a fair and appropriate education — a guarantee under the 1975 Individuals with Disabilities Education Act — if they use vouchers to attend private schools?
Yes, DeVos said.
“She answered point blank,” Joe said.
So in the DeVosian voucher world, choice schools do get to pick and choose which students they will serve-- or not serve. The USED would not require recipients of federal dollars (which given a Education Savings Account approach to vouchers would be cleansed of their federal taint) to obey federal law.
The huge irony here? DeVos doesn't think parents should have to sue somebody to have their child's needs met, but in a voucher world, parents like the Fs would not be able to sue anybody. School choice would mean that the school could choose to show Endrew the door. School choice would mean that parents would have to give up their rights in return for their voucher. It's a reminder that school choice and the privatization of education is largely about stripping citizens of the right to a free and appropriate public education. Voucher and choice systems aren't just a different delivery system-- they represent a fundamental change in our educational mission as a country. And that's a lot less than de minimis.
The whole business now has a sequel, starring Secretary of Education Betsy DeVos.
Remember that time DeVos was being interviewed for her job and she didn't really seem to understand what IDEA actually was? Specifically, didn't seem clear on whether schools receiving federal funds would be required to follow the federal IDEA law?
Oh-- and remember that time when she called Historically Black Colleges and Universities "pioneers of school choice"? Which was kind of like calling the underground railroad pioneers of Uber?
Well, both of those moments had a sequel this week as reported by Ann Schimke for Chalkbeat. There are two take-aways here. One is not so big, and one kind of is.
First, the F family was none too happy about being used as props for one more DeVos love letter to school choice.
“Every family should have that ability to choose the learning environment that’s right for their child,” she said. “They shouldn’t have to sue their way to the Supreme Court to get it.”
Remember that DeVos quote. The Fs, Joe and Jennifer, were not pleased.
“To hold us out there as a poster child on how a private school is working for our child and how this is how school choice is supposed to work, really bugs me,” Joe said.
“It was a little disappointing,” Jennifer said. “She picked the parts that she liked and used them for what she wanted.”
Now to the bigger takeaway. Turns out that the Fs had actually met DeVos, privately, at her request.
They were flattered by her interest, but felt she didn’t understand why private school vouchers would never work for them — or many other families who have children with disabilities.
Specifically, how a small voucher amount does not get you into a pricey specialized private school like the one Endrew attends. But according to the Fs, they raised an even larger issue, and DeVos gave them a straight, if not welcome, answer.
Do students with disabilities lose their rights to a fair and appropriate education — a guarantee under the 1975 Individuals with Disabilities Education Act — if they use vouchers to attend private schools?
Yes, DeVos said.
“She answered point blank,” Joe said.
So in the DeVosian voucher world, choice schools do get to pick and choose which students they will serve-- or not serve. The USED would not require recipients of federal dollars (which given a Education Savings Account approach to vouchers would be cleansed of their federal taint) to obey federal law.
The huge irony here? DeVos doesn't think parents should have to sue somebody to have their child's needs met, but in a voucher world, parents like the Fs would not be able to sue anybody. School choice would mean that the school could choose to show Endrew the door. School choice would mean that parents would have to give up their rights in return for their voucher. It's a reminder that school choice and the privatization of education is largely about stripping citizens of the right to a free and appropriate public education. Voucher and choice systems aren't just a different delivery system-- they represent a fundamental change in our educational mission as a country. And that's a lot less than de minimis.
PA: Graduation Test In Trouble (Again)
Pennsylvania's education bureaucrats had high hopes for the Keystone exams.
Back in 2010, the idea was that there would be at least ten of them-- one for each major course-- and students would take them at the end of the year as a final qualifying test for course credit (and therefor graduation). Donna Cooper (now of Public Citizens for Children and Youth) was part of the Rendell administration pushing for the tests, and like all good reformsters of the era, all she wanted was perfect standardization so that every student in every state was learning exactly the same thing. "It would seem to me that a parent in Norristown and a parent in Johnstown, their kids should know the same things to graduate.”
And like good reformy bureaucrats, neither the Rendell administration that cooked this up, nor the Corbett administration that cemented it into law, envisioned the state providing any resources at all to help students over this new hurdle. The Keystone exam system was the biggest unfunded mandate the state had ever seen.
The fiddling began immediately. Maybe the Keystones would count for a third of the full year grade. And somehow we'd have to roll the tests out over several years, only they turned out to be hard to just whip up quickly. And they were expensive, too.
Soon enough, the state decided that math, biology and English literature (aka "reading") would be the Keystone exams offered. And students and schools would get a couple of years to get up to speed before the test became a graduation requirement for the Class of 2017.
But there was a problem. It quickly became clear that if the Keystones were required for graduation, a whole bunch of students weren't going to graduate. In more than 100 districts (and charters) well over half the students would not get a diploma.
Nobody in Harrisburg wanted to attach his name to that, so Keystones-as-grad-requirements were pushed back to 2019, and to insure that the results looked better by then, the state government did-- well, they did nothing. Hopes and dreams, thoughts and prayers, maybe. But still no resources to help in those afflicted districts. And sure enough-- as 2019 approaches (those students are taking the tests this year in many districts) things still look bad.
So buried within Harrisburg's most recent attempt to enact a budget, there's another postponement for the Keystones.
Fans of local control are pleased-- let local districts set their own graduation requirements. But members of the Cult of Testing and Standardization are unhappy. Like Cooper, they argue that the previous Big Standardized Test, the PSSA, proved that local standards were inadequate.
“58,000 students were graduated and given diplomas who could not pass the state’s 11th grade PSSA,” said Cooper. “That’s a real indication of the failure of local control to understand the market signals of what is needed for a kid to succeed in today’s economy.”
Cooper and others like her might have a point-- if there were a speck of evidence that the PSSA was a valid measure of what is needed for a kid to succeed in today's economy, or college, or anything. There was no such evidence for the PSSA, nor is there any such evidence for the Keystone. And the PSSA, which is still given in lower grades, is a norm-referenced test with cut scores reset every year -- so somebody has to fail.
The Keystone exams are theoretically standards-referenced, which should mean that everyone can pass. But it should also mean that we can get test results literally five minutes after the student finishes the test, but we're still waiting months. Why is that? Maybe because of something called scaling, which seems like a fancy way to explain different weights for different questions on different forms of the test. Or maybe it has to do with rangefinding, which seems an awful lot like norm-referencing-- collect answers and see what their distribution looks like.
Trying to uncover the problems of the Keystone exams can be a daunting task. The technical reports from every year are available (here's 2015), with hundreds of pages each, including illuminating passages like this one
Reading these technical reports might suggest to a layperson, even a highly educated one, that testocrats have disappeared so far up their own butts that they are now viewing the world through the tiny little lenses of their own belly buttons.
But the answer to the Keystone problem may be much simpler than psychometric gobbledeegook or legislative refusal to fund what they demand.
It could be that the Keystones are just bad tests.
Mind you, I'm not supposed to know that. The PA DOE Code of Ethics says that I should never set eyes on the test itself, and if I accidentally see anything, I should make myself forget it. We are supposed to remain ignorant of the test except in the most general terms, and the students have to swear not to talk about them either. We are all not only supposed to hit the target, but we're supposed to do it blindfolded. That waythe test manufacturers won't have to spend money rebuilding the test every year the integrity of the test will be maintained.
But, scofflaw that I am, I look anyway. And I'm telling you that if someone offered me the test to use for free in my class so that I could have more time with my children and less time test writing, I would turn it down. It's junk. Questions with no objectively supportable single correct answer. Questions that are simple vocabulary tests. Questions that require the students to use psychic powers on the authors of the passages. These tests do not measure anything except the students' ability to navigate a bunch of trick questions and guess what the test manufacturers are thinking.
You know who else knows that? My students. Like most districts, we have made the tests mandatory for graduation because we want the students to try because our school rating depends largely on those test results. But the students know that they'll do a performance task (the Binder of Doom) if they fail, and many of them are not only tired of taking stupid tests year after year, but they have long since concluded that they might as well roll dice, because success or failure feel pretty much random to them.
Pennsylvania is having the same damn argument as much of the rest of the education world, with accountability mavens arguing that we must test to have accountability, but skipping over the entire question of whether the test being used is actually measuring anything worth measuring. It's like listening to someone insist, "We have to know whether or not you have cancer, so you must wave your hand over this horny toad under a full moon." It's the same old reformy disconnect-- establishing that something is a real problem is not the same as establishing that you are proposing a real solution (and for those of us who don't agree that local control and variation is a real problem, you are even further off base).
Without a decent, fair, valid test, and without resources to back up this unfunded mandate, and without a reason for students to care, the Keystones will always be a disaster. We can only hope that the state legislature stops kicking this can down the road and finally just throws it in the dumpster of history, where it belongs.
Back in 2010, the idea was that there would be at least ten of them-- one for each major course-- and students would take them at the end of the year as a final qualifying test for course credit (and therefor graduation). Donna Cooper (now of Public Citizens for Children and Youth) was part of the Rendell administration pushing for the tests, and like all good reformsters of the era, all she wanted was perfect standardization so that every student in every state was learning exactly the same thing. "It would seem to me that a parent in Norristown and a parent in Johnstown, their kids should know the same things to graduate.”
And like good reformy bureaucrats, neither the Rendell administration that cooked this up, nor the Corbett administration that cemented it into law, envisioned the state providing any resources at all to help students over this new hurdle. The Keystone exam system was the biggest unfunded mandate the state had ever seen.
The fiddling began immediately. Maybe the Keystones would count for a third of the full year grade. And somehow we'd have to roll the tests out over several years, only they turned out to be hard to just whip up quickly. And they were expensive, too.
Soon enough, the state decided that math, biology and English literature (aka "reading") would be the Keystone exams offered. And students and schools would get a couple of years to get up to speed before the test became a graduation requirement for the Class of 2017.
But there was a problem. It quickly became clear that if the Keystones were required for graduation, a whole bunch of students weren't going to graduate. In more than 100 districts (and charters) well over half the students would not get a diploma.
Nobody in Harrisburg wanted to attach his name to that, so Keystones-as-grad-requirements were pushed back to 2019, and to insure that the results looked better by then, the state government did-- well, they did nothing. Hopes and dreams, thoughts and prayers, maybe. But still no resources to help in those afflicted districts. And sure enough-- as 2019 approaches (those students are taking the tests this year in many districts) things still look bad.
So buried within Harrisburg's most recent attempt to enact a budget, there's another postponement for the Keystones.
Fans of local control are pleased-- let local districts set their own graduation requirements. But members of the Cult of Testing and Standardization are unhappy. Like Cooper, they argue that the previous Big Standardized Test, the PSSA, proved that local standards were inadequate.
“58,000 students were graduated and given diplomas who could not pass the state’s 11th grade PSSA,” said Cooper. “That’s a real indication of the failure of local control to understand the market signals of what is needed for a kid to succeed in today’s economy.”
Cooper and others like her might have a point-- if there were a speck of evidence that the PSSA was a valid measure of what is needed for a kid to succeed in today's economy, or college, or anything. There was no such evidence for the PSSA, nor is there any such evidence for the Keystone. And the PSSA, which is still given in lower grades, is a norm-referenced test with cut scores reset every year -- so somebody has to fail.
The Keystone exams are theoretically standards-referenced, which should mean that everyone can pass. But it should also mean that we can get test results literally five minutes after the student finishes the test, but we're still waiting months. Why is that? Maybe because of something called scaling, which seems like a fancy way to explain different weights for different questions on different forms of the test. Or maybe it has to do with rangefinding, which seems an awful lot like norm-referencing-- collect answers and see what their distribution looks like.
Trying to uncover the problems of the Keystone exams can be a daunting task. The technical reports from every year are available (here's 2015), with hundreds of pages each, including illuminating passages like this one
Reading these technical reports might suggest to a layperson, even a highly educated one, that testocrats have disappeared so far up their own butts that they are now viewing the world through the tiny little lenses of their own belly buttons.
But the answer to the Keystone problem may be much simpler than psychometric gobbledeegook or legislative refusal to fund what they demand.
It could be that the Keystones are just bad tests.
Mind you, I'm not supposed to know that. The PA DOE Code of Ethics says that I should never set eyes on the test itself, and if I accidentally see anything, I should make myself forget it. We are supposed to remain ignorant of the test except in the most general terms, and the students have to swear not to talk about them either. We are all not only supposed to hit the target, but we're supposed to do it blindfolded. That way
But, scofflaw that I am, I look anyway. And I'm telling you that if someone offered me the test to use for free in my class so that I could have more time with my children and less time test writing, I would turn it down. It's junk. Questions with no objectively supportable single correct answer. Questions that are simple vocabulary tests. Questions that require the students to use psychic powers on the authors of the passages. These tests do not measure anything except the students' ability to navigate a bunch of trick questions and guess what the test manufacturers are thinking.
You know who else knows that? My students. Like most districts, we have made the tests mandatory for graduation because we want the students to try because our school rating depends largely on those test results. But the students know that they'll do a performance task (the Binder of Doom) if they fail, and many of them are not only tired of taking stupid tests year after year, but they have long since concluded that they might as well roll dice, because success or failure feel pretty much random to them.
Pennsylvania is having the same damn argument as much of the rest of the education world, with accountability mavens arguing that we must test to have accountability, but skipping over the entire question of whether the test being used is actually measuring anything worth measuring. It's like listening to someone insist, "We have to know whether or not you have cancer, so you must wave your hand over this horny toad under a full moon." It's the same old reformy disconnect-- establishing that something is a real problem is not the same as establishing that you are proposing a real solution (and for those of us who don't agree that local control and variation is a real problem, you are even further off base).
Without a decent, fair, valid test, and without resources to back up this unfunded mandate, and without a reason for students to care, the Keystones will always be a disaster. We can only hope that the state legislature stops kicking this can down the road and finally just throws it in the dumpster of history, where it belongs.
Friday, November 17, 2017
Data and Numbers and Audiences
During the last week, Pat has shown a 6.3 rate of response in class, with a score of 75 on the Hendrix Orientation Scale. Informal assessment yield a 82 (well within the "moderate" range) for response accuracy. In a forty-minute period Pat showed a 45 for Attentiveness Measure, but Pat's interactions with peers score a 21 on Hemmings Interaction Index. However, that places Pat's Optimal Utilization Index Score well under the minimum desired level of 55.
That's one report I could fill out for Imaginary Student Pat. Or I could say:
Pat has some trouble paying attention, but Pat can still answer questions if I call on Pat. Pat's not really distracting any of the other students, but it's pretty clear that Pat isn't trying and is still managing to do just enough to get by. Pat's a good kid; just kind of bored.
In fact, the first one is composed entirely of fake data measures, but you weren't sure, were you. It sounds more official than the second one. Because it's data, with numbers.
The thing is-- the second explanation is also packed with data. In fact, it's the same data, but expressed in human terms rather than in numbers and technobabble. Reform-resistant teachers are often accused of being anti-data, but the problem with much of the data we're offered by education technicians is that it is flat and meager compared to what we are used to gathering on a daily basis. To reduce and aspect of a student's behavior, performance or existence to a single digit on some manufactured scale means I must actually flatten or simplify the data I have, throwing out plenty that is valuable.
It's like coming up with a digital rating for a kiss. It can be done, but what I end up with will be far less descriptive, rich or thorough than a poem or a song or a description.
Data Overlords don't like verbal packages of data because they are "messy," but the only way to make them less messy is to throw a bunch of "extra" data out. The resulting digit score actually contains less data than the messy version-- and the mess that we've thrown out can be hugely important. We complain a lot about what the Data Overlords decide to focus on, but what they choose to ignore is at least as large a part of the problem.
But Big Data requires digital data so that it can be crunched and spread-sheeted and used for big picture centralized measuring and planning (someday we will have to talk about Seeing Like a State, a somewhat wonky but also brilliant book about this phenomenon). And in the process, Big Data has also usurped the anser to the question, "What data are important, and which can be safely ignored."
In fact, the shift to digital data is about a shift in audience-- schools are no longer expected to be accountable to local taxpayers and parents, but to some larger government or corporate entity. If I give Pat's parents that digital data report, their first question will be some version of "What does that mean in plain English." And then I'll give them the second explanation, which will have far more data in a far more useful context.
Do not buy the idea that teachers do not gather data. We have never done anything except gather data. What we haven't done is gather bad flattened data selected according to the instructions of functionaries who are far away from the intersection of the rubber and the road. And just because it's a digit, that doesn't mean it's good data-- in fact, it may be exactly the opposite.
That's one report I could fill out for Imaginary Student Pat. Or I could say:
Pat has some trouble paying attention, but Pat can still answer questions if I call on Pat. Pat's not really distracting any of the other students, but it's pretty clear that Pat isn't trying and is still managing to do just enough to get by. Pat's a good kid; just kind of bored.
In fact, the first one is composed entirely of fake data measures, but you weren't sure, were you. It sounds more official than the second one. Because it's data, with numbers.
The thing is-- the second explanation is also packed with data. In fact, it's the same data, but expressed in human terms rather than in numbers and technobabble. Reform-resistant teachers are often accused of being anti-data, but the problem with much of the data we're offered by education technicians is that it is flat and meager compared to what we are used to gathering on a daily basis. To reduce and aspect of a student's behavior, performance or existence to a single digit on some manufactured scale means I must actually flatten or simplify the data I have, throwing out plenty that is valuable.
It's like coming up with a digital rating for a kiss. It can be done, but what I end up with will be far less descriptive, rich or thorough than a poem or a song or a description.
Data Overlords don't like verbal packages of data because they are "messy," but the only way to make them less messy is to throw a bunch of "extra" data out. The resulting digit score actually contains less data than the messy version-- and the mess that we've thrown out can be hugely important. We complain a lot about what the Data Overlords decide to focus on, but what they choose to ignore is at least as large a part of the problem.
But Big Data requires digital data so that it can be crunched and spread-sheeted and used for big picture centralized measuring and planning (someday we will have to talk about Seeing Like a State, a somewhat wonky but also brilliant book about this phenomenon). And in the process, Big Data has also usurped the anser to the question, "What data are important, and which can be safely ignored."
In fact, the shift to digital data is about a shift in audience-- schools are no longer expected to be accountable to local taxpayers and parents, but to some larger government or corporate entity. If I give Pat's parents that digital data report, their first question will be some version of "What does that mean in plain English." And then I'll give them the second explanation, which will have far more data in a far more useful context.
Do not buy the idea that teachers do not gather data. We have never done anything except gather data. What we haven't done is gather bad flattened data selected according to the instructions of functionaries who are far away from the intersection of the rubber and the road. And just because it's a digit, that doesn't mean it's good data-- in fact, it may be exactly the opposite.
Thursday, November 16, 2017
FL: What?! A teacher shortage??!!
Shocking news in today's Sun-Sentinel:
Almost three months into the school year, thousands of public school students in South Florida still don't have a permanent teacher —a problem expected to get worse as more educators flee the classroom and the number of those seeking teaching degrees plummets.
Okay, not shocking. Utterly predictable, given Florida's unending efforts to create the worst atmosphere for public education in the country. Here are some of the things they've done, in no particular order:
* They have tried to make it possible for parents to stamp out the teaching of science.
* They have given charters the unchecked ability to steal local tax dollars.
* They have made an absolute disastrous amateur-hour hash out of their Big Standardized Test.
* They have made successful students repeat third grade for failing to love the BST
* They have declared-- in court-- that teacher-prepared report cards are meaningless
* They have demonstrated how badly teacher merit pay can fail
* They made a dying child take the Big Standardized Test
* They turned recess into a political football.
* They based a strategic plan based on bad retail management.
* They abolished tenure, and fired teachers for advocating for students.
* They've allowed racist underfunding of schools to flourish.
* They have provided ample proof that an A-F school rating system doesn't work.
* They host experiments in computerized avatar classrooms.
* They have charter legislation hustled through the capital by lawmakers who profit from it.
* They allow more charter misbehavior than you can shake a stick at.
* They have created a charter money grab law so onerous and obnoxious they have actually moved public schools to sue the state government.
All of this over and above the continued drip, drip, drip of starving public schools of resources and finding new ways to treat public school teachers with disrespect. And the pay stinks.
There is no reason to be surprised that Florida teachers are "fleeing." And the article notes just how much fleeing is going on. Broward County lost 1,000 teachers last year-- and that's not counting retirees.
The Sun-Sentinel article is brutal, noting that the drain of teachers leads to economic problems for communities, as well as becoming a self-perpetuating problem-- as the teacher pool is drained in schools, schools become less effective, which means they turn out fewer and fewer grads well-prepared for or interested in teaching. The article piles on the anecdotal evidence. A teacher who left, tired of constant testing and lack of autonomy. A teacher who left because you can't afford to be a single mom on a Florida teacher salary. A teacher who handles over thirty kids in an honors class because the state class size law only applies to "core" classes.
And of course, Florida is "solving" the problem by opening up alternative paths, because the way to get better teachers and fill teaching jobs is by making it possible to slap any warm body into a classroom. My favorite bar-lowering idea-- Florida Atlantic University will give Palm Beach Schools a list of students who flunked out of medical and science programs so that those students can be recruited to teach. And meanwhile the remaining dedicated, qualified teachers of Florida wonder how much longer they can hold on.
Of course, somehow, these champions of free market, these lovers of the invisible hand, cannot figure out that if people won't sell you a good or service under the terms you set, free market competition demands that you offer better terms and conditions. It's as simple as that. If you can't buy a Porsche for $1.98, that doesn't mean there's an automobile shortage. Even convenience stores understand that if you can't get enough quality people to work for you, you have to offer better terms of employment. Florida's leaders simply insist on pretending not to understand this, even as they try to starve pubic education so that the unregulated world of Florida charter schools will look more appealing. This is like setting fire to an apartment building so that the tenants will "choose" to move into a shifty trailer park operation, while in the meantime you "try" to hire firefighters by offering $1.00 an hour wages and a punch-in-the-face benefits.
This-- all of this-- I have to remind you, is what USED Secretary Betsy DeVos thinks is the shining light that our nation should be following. This disastrous train wreck, this state that has worked hard to destroy its public education system-- this is what DeVos thinks the nation should be emulating. Run the public system into the ground, drive the teachers away, and sell the pieces to privatizers.
Almost three months into the school year, thousands of public school students in South Florida still don't have a permanent teacher —a problem expected to get worse as more educators flee the classroom and the number of those seeking teaching degrees plummets.
Okay, not shocking. Utterly predictable, given Florida's unending efforts to create the worst atmosphere for public education in the country. Here are some of the things they've done, in no particular order:
* They have tried to make it possible for parents to stamp out the teaching of science.
* They have given charters the unchecked ability to steal local tax dollars.
* They have made an absolute disastrous amateur-hour hash out of their Big Standardized Test.
* They have made successful students repeat third grade for failing to love the BST
* They have declared-- in court-- that teacher-prepared report cards are meaningless
* They have demonstrated how badly teacher merit pay can fail
* They made a dying child take the Big Standardized Test
* They turned recess into a political football.
* They based a strategic plan based on bad retail management.
* They abolished tenure, and fired teachers for advocating for students.
* They've allowed racist underfunding of schools to flourish.
* They have provided ample proof that an A-F school rating system doesn't work.
* They host experiments in computerized avatar classrooms.
* They have charter legislation hustled through the capital by lawmakers who profit from it.
* They allow more charter misbehavior than you can shake a stick at.
* They have created a charter money grab law so onerous and obnoxious they have actually moved public schools to sue the state government.
All of this over and above the continued drip, drip, drip of starving public schools of resources and finding new ways to treat public school teachers with disrespect. And the pay stinks.
There is no reason to be surprised that Florida teachers are "fleeing." And the article notes just how much fleeing is going on. Broward County lost 1,000 teachers last year-- and that's not counting retirees.
The Sun-Sentinel article is brutal, noting that the drain of teachers leads to economic problems for communities, as well as becoming a self-perpetuating problem-- as the teacher pool is drained in schools, schools become less effective, which means they turn out fewer and fewer grads well-prepared for or interested in teaching. The article piles on the anecdotal evidence. A teacher who left, tired of constant testing and lack of autonomy. A teacher who left because you can't afford to be a single mom on a Florida teacher salary. A teacher who handles over thirty kids in an honors class because the state class size law only applies to "core" classes.
And of course, Florida is "solving" the problem by opening up alternative paths, because the way to get better teachers and fill teaching jobs is by making it possible to slap any warm body into a classroom. My favorite bar-lowering idea-- Florida Atlantic University will give Palm Beach Schools a list of students who flunked out of medical and science programs so that those students can be recruited to teach. And meanwhile the remaining dedicated, qualified teachers of Florida wonder how much longer they can hold on.
Of course, somehow, these champions of free market, these lovers of the invisible hand, cannot figure out that if people won't sell you a good or service under the terms you set, free market competition demands that you offer better terms and conditions. It's as simple as that. If you can't buy a Porsche for $1.98, that doesn't mean there's an automobile shortage. Even convenience stores understand that if you can't get enough quality people to work for you, you have to offer better terms of employment. Florida's leaders simply insist on pretending not to understand this, even as they try to starve pubic education so that the unregulated world of Florida charter schools will look more appealing. This is like setting fire to an apartment building so that the tenants will "choose" to move into a shifty trailer park operation, while in the meantime you "try" to hire firefighters by offering $1.00 an hour wages and a punch-in-the-face benefits.
This-- all of this-- I have to remind you, is what USED Secretary Betsy DeVos thinks is the shining light that our nation should be following. This disastrous train wreck, this state that has worked hard to destroy its public education system-- this is what DeVos thinks the nation should be emulating. Run the public system into the ground, drive the teachers away, and sell the pieces to privatizers.
Subscribe to:
Posts (Atom)