Mike Petrilli, head honcho of the ever-reformy Thomas B. Fordham Institute, has taken a look at the future of Personalized Learning, and he has some concerns. He's read the PR, and he knows about the appeal of super-flexible differentiation, the varied student-customized pathways to excellence. However:
Hooray for all that. But after seeing a version of personalized learning
in action recently, I’m worried that it may be reinforcing some of the
worst aspects of standards-based, data-driven instruction. Namely: It
might be encouraging a reductionist type of education that breaks
learning into little bits and scraps and bytes of disparate skills,
disconnected from an inspiring, coherent whole.
What he's noting here is the ways in which Personalized Learning has become the cojoined twin of Competency Based Education. Saying that PL/CBE "might be" encouraging reductionist, list-based, disjointed education is like saying that Betsy DeVos "might be" leaning toward school choice as a policy approach to education.
We have had versions of this conversation before. Back in the day when folks bothered to talk about Common Core, defenders frequently countered the real-life problems of CCSS with explanations of how it was "supposed" to be. Even people who wrote it would argue that people were misusing their beautiful creation and that's not how it was supposed to look at all. It wasn't supposed to be top-down or prescriptive or rigid or a straightjacket on both curriculum and instruction. And yet, in the real world, it was absolutely all those things.
Over the past years, I have had multiple conversations with CBE fans who direct me to things like the CBE work in Chugach, Alaska, as a sign that CBE doesn't have to be an Outcome-Based Education retread with lists to check off and "outcomes" reduced to simple, easily measured mini-tasks. Yet, that is exactly what's being sold-- often with the additional phrase "in any environment" because part of the pitch is that competencies can be acquired at any time, which means they competencies will be taught and assessed by computer software, which means that the competencies must be assessed with an instrument that computer software can do, which means no writing and no critical thinking. This fits nicely with choice on steroids, the a la carte choice system where students just select particular competencies from an online supermarket.
Likewise, Personalized Learning is sold as just an extension of the IEPs that students with special needs already get. Just super-differentiation, which doesn't sound scary at all, and yet it always turns into a discussion of how AI software will chart an individualized path for each student.
Folks all the way up to our Secretary of Education see the CBE/PL system as tied to technology. iNACOL sees both as a wide-open market opportunity for techsters. Petrilli already knows this.
Picture an elementary school. Yes, there’s a long list of skills that
kids need to master and for which an individualized approach would work
fine: decoding; spelling; writing letters and numbers; counting to one
hundred; keyboarding; and so forth. Measuring children’s progress in
learning these skills is the sort of thing that assessments like iReady’s can readily do, and then point teachers and parents toward learning modules that will help them take the next step.
And he's aware of the limits:
Yet there’s so much else that we also want young children to experience
and that’s hard—maybe impossible—to break down into little bits.
Well, yes-- it is impossible. But that is exactly what the very marketplace that the Fordham has championed for years is pushing toward. But he is either ignoring or in denial about the implications of what he has been pushing. Here he is imagining how a standards-based classroom should work:
Teachers would stop projecting the day’s standards-to-be-tackled on the
board; they would stop asking students to determine whether they have
mastered a particular standard, and how to know when they’ve mastered
it—practices I saw at the school I visited. They would stop planning
lessons by “back-mapping” from the standards. They would simply adopt a
great curriculum that is aligned to the standards, then forget about the
standards and teach the curriculum instead.
But that's not what happened. And Petrilli chooses to address the elephant in the classroom, which is test-centered accountability, a feature of reform that has absolutely guaranteed that schools would teach to the standards-based-ish tests. This oversight matters. Here's Petrilli on what he think has gone wrong:
That’s hard to do, though, in a personalized classroom, if the model is
premised on the idea that we can break knowledge and skills into
discreet standards and progressions, and if teacher-led discussions are
discouraged. Perhaps that works for math. But for English? History?
Science? Art and music? Character, values, and self-control?
No, no,no, no and no. And as for character traits, I refer Petrilli to the death of OBE, which was in no small part to strong reactions against the proposal that government would train students to be the Right Sort of People.
But the problematic premises of PL/CBE are not just that we can break complex knowledge and skills into tiny pieces, but that we can use computer software to measure those pieces, and that we must measure those people, and that the ongoing measure of those pieces should drive the system, determining what module a student should work on next. PL/CBE takes the worst feature of reform so far-- test-centered accountability-- and drives it even deeper into the bones of the system. It takes the already-failing Big Standardized Test system we've been using to measure everything from student achievement to teacher effectiveness even as it has narrowed and gutted the education system-- it gets rid of that once-a-year travesty and replaces it with standardized testing, all day, every day.
Petrilli worries that the ideas will be taken to a bad extreme. The solution is the same one as ever-- take the reins out of the hands of corporations, investors, and all the other amateurs who have gathered to make a buck. Consider-- just consider-- involving trained professional educators in some of these decisions.
Petrilli visited a PL school and was not encouraged by what he saw. Little teaching, standards obsession, and "everything looked like distilled and fragmented test prep." Well, yes. That was not an aberration or mistake. It was not a bug-- it was a feature. Every piece of PL/CBE is aimed toward that product, and he can't be surprised or shocked, because he helped make that, and some of us, for years, have been telling him and others like him that this is what they are building.
Wednesday, May 17, 2017
Rutgers Prof Beats NJ Charter Attack
I'm happy to provide a good news follow up to an old story.
Two years ago, Rutgers University professor Julia Sass Rubin found herself under attack by the New Jersey Charter School Association. She had published research that contradicted the rosy charter picture in NJ, showing that, much to nobody's surprise, that charters enroll fewer very poor students, fewer non-English speaking students, and fewer students with special needs. So the NJCSA decided to play hardball. They filed an ethics complaint against Sass Rubin. As I wrote back at the time:
Yes, confronted by clear scientific data that conflicted with their position, the New Jersey Charter Schools Association did the only thing that reasonable, ethical, intelligent human beings can do in that situation-- they went after the bearer of bad tidings with a switchblade and brass knuckles. Not since Tonya Harding tried to have Nancy Kerrigan kneecapped have we seen such a reasoned and rational approach to conflicting views.
The NJCSA attacked Rubin by accusing her of correctly identifying herself as a Rutger professor, even when participating as a member of Save Our Schools New Jersey. Again, from my opriginal blog about the charges:
****
The complaint seriously seeks the remedy of having Rubin stop identifying herself as a Rutgers professor when she says these things that make the NJ Charter operators look like lying liars who lie. From philly.com coverage:
I can understand their confusion to a point. It is, of course, standard operating procedure in the reformster world to NOT identify who you actually work for, get money from, or otherwise are affiliated with. It's SOP to put out a slick "report" without actually explaining why anyone should believe you know what you're talking about, but Rubin and Weber go ahead and list their actual credentials. Apparently NJCSA's argument is that it's unethical to let people know why your work is credible.
****
The charter association went so far as to hire Michael Turner to handle the PR-- Turner is an expert in smear tactics to help his clients. The goal throughout was simple-- to make Rubin and her colleague Mark Weber (Jersey Jazzman) shut up and stop using facts and research to undercut charter marketing. As I noted back then, the research is basically just crunching numbers, so NJCSA could have attacked the data or the methodology or even the conclusions, but instead they attacked the researcher. It's almost as if they knew they didn't have a leg to stand on when it came to the facts.
But news came yesterday that this assault on Rubin has come to naught. The State Ethics Commission bounced the complaint back to Rutgers, and Rutgers has found "no evidence to support allegations against Julia Sass Rubin."
Well, hooray for that. Nobody should have to work with allegations hanging over their heads that are boundless and intended to shut the person up. Disagree with someone? Then dispute what they've said, and don't go trying to ruin their career or just make their professional life miserable. I hope the NJCSA wasted all sorts of money of this attempt at bullying.
So this time, the good guys win and the charter forces will have to find some other way to obscure the facts.
Two years ago, Rutgers University professor Julia Sass Rubin found herself under attack by the New Jersey Charter School Association. She had published research that contradicted the rosy charter picture in NJ, showing that, much to nobody's surprise, that charters enroll fewer very poor students, fewer non-English speaking students, and fewer students with special needs. So the NJCSA decided to play hardball. They filed an ethics complaint against Sass Rubin. As I wrote back at the time:
Yes, confronted by clear scientific data that conflicted with their position, the New Jersey Charter Schools Association did the only thing that reasonable, ethical, intelligent human beings can do in that situation-- they went after the bearer of bad tidings with a switchblade and brass knuckles. Not since Tonya Harding tried to have Nancy Kerrigan kneecapped have we seen such a reasoned and rational approach to conflicting views.
The NJCSA attacked Rubin by accusing her of correctly identifying herself as a Rutger professor, even when participating as a member of Save Our Schools New Jersey. Again, from my opriginal blog about the charges:
****
The complaint seriously seeks the remedy of having Rubin stop identifying herself as a Rutgers professor when she says these things that make the NJ Charter operators look like lying liars who lie. From philly.com coverage:
"The paper's conclusion and
recommendations are identical to - and clearly intended to provide the
appearance of legitimate academic support for - the lobbying positions
that Dr. Rubin and SOSNJ have zealously promoted for years," the Charter
Schools Association wrote in its complaint.
So, as a citizen, she's not allowed to believe what she believes as an
academic? When her research as an academic leads her to certain
conclusions, she must never talk about them outside of school? Or when
she's speaking as a citizen, she is not allowed to note that she has
professional training and skills that qualify her to make certain
conclusions?
I can understand their confusion to a point. It is, of course, standard operating procedure in the reformster world to NOT identify who you actually work for, get money from, or otherwise are affiliated with. It's SOP to put out a slick "report" without actually explaining why anyone should believe you know what you're talking about, but Rubin and Weber go ahead and list their actual credentials. Apparently NJCSA's argument is that it's unethical to let people know why your work is credible.
****
The charter association went so far as to hire Michael Turner to handle the PR-- Turner is an expert in smear tactics to help his clients. The goal throughout was simple-- to make Rubin and her colleague Mark Weber (Jersey Jazzman) shut up and stop using facts and research to undercut charter marketing. As I noted back then, the research is basically just crunching numbers, so NJCSA could have attacked the data or the methodology or even the conclusions, but instead they attacked the researcher. It's almost as if they knew they didn't have a leg to stand on when it came to the facts.
But news came yesterday that this assault on Rubin has come to naught. The State Ethics Commission bounced the complaint back to Rutgers, and Rutgers has found "no evidence to support allegations against Julia Sass Rubin."
Well, hooray for that. Nobody should have to work with allegations hanging over their heads that are boundless and intended to shut the person up. Disagree with someone? Then dispute what they've said, and don't go trying to ruin their career or just make their professional life miserable. I hope the NJCSA wasted all sorts of money of this attempt at bullying.
So this time, the good guys win and the charter forces will have to find some other way to obscure the facts.
Tuesday, May 16, 2017
The Takeover Lie
One of the techniques in the reformster arsenal has been the school takeover, in which some august body declares a public school a failure, and that school is marked for Takeover. That failure can be certified by specious Big Standardized Test results (yay, PARCC and SBA) or by the more cynical method of refusing to fuly fund a district and then certifying them, as financially distressed. This particular "solution" was built into Race To The Trough Top and RTTT Lite (more waivers, less paperwork), but it has been embraced in a variety of forms, such as the Achievement School District of Tennessee and other attempts to create via bureaucracy what had previously been accomplished by natural disaster (aka Hurricane Katrina).
You can see it happening yet again in Gary, Indiana, where the schools have been taken over by the state. That state takeover, which strips the elected school board of power and replaces them with a state-appointed manager, was enacted a month ago and explained to the public more fully just a week ago. Gary was a two-fer, a district slammed for both low test scores and for failing to get enough money to keep itself solvent. Within roughly five minutes, a charter company was putting in its bid to run the formerly-public school system.
The proposed management group is the Phalen Leadership Academies, a group with strong ties to Indianapolis's big charter boosters with giant apsirations loaded into its name-- the Mind Trust. The group was founded by a former Indianapolis mayor and his head of charter schoolery, and it has done a fine job of finding ways to funnel public tax dollars into private pockets. So there are plenty of specific and historical reasons to oppose Phalen's glomming up one more set of de-public schools.
But the whole takeover process is itself a scam of tremendous proportions, a house of cards resting on a foundation of falsehoods.
Remember, the basic idea here is, "You public school people couldn't make this school work, so we're going to bring in someone who can." Let's consider that premise for a moment.
What's your secret?
The takeover premise requires someone who knows the secret of making a school "work." Someone who knows more about how to educate children than the trained professionals who previously ran the school. Let's mull on that for a second-- if this person (or person's company) knows the secret of Making Schools Work, what exactly have they been doing? Why have we not already hear about them? Why are they not already rich from running seminars and presenting training and having entire states adopt their special techniques for success? Why aren't principals and teachers falling all over themselves to bring these people in to run professional development so that we can all be awesomely successful? Why haven't we all heard and read about their great success?
Have they had these Secrets for Success all along, but they've been sitting on them, saying, "Well, we're not sharing this with anybody unless they pay us a bunch of money." And if so, are those the kind of people we want running schools?
Or could it be that these takeover artists don't know a damn thing more about educating students and running a school than the rest of us?
What's the cost?
In addition to pulling off the trick of deploying super-secret education techniques unknown to anyone who actually works in public education, takeover artists must also pull off some financial magic.
The takeover artists must run the school with the same money as the "failed" managers-- and they must somehow squeeze that piggy bank so that there is money left over to pay the takeover company.
In other words, they must keep doing what the school was always doing for the same amount of money, and have more money left at the end. Which means, of course, that they can only pull this off if they don't keep doing what the school was always doing. That means cutting programs or closing facilities or paying bottom dollar for personnel (and therefor having their pick of hiring from among all the people who couldn't get real jobs).
The fantasy is that schools-- even, somehow, schools that are in financial distress-- are loaded with such waste that a savvy business person can find efficiencies and eliminate waste., which is sort of true if one believes that paying teachers or offering certain programs are wasteful. Or, of course, one might believe that certain students, by virtue of their special needs, cost too much money to keep a trim budget, and so those students must be pushed elsewhere.
The central lie
The heart of the takeover idea is that there are people out there who know special secrets-- how to educate students, how to run schools, how to do it all for less money-- that somehow nobody in public education knows. But we've had these companies in business for years now, and there's no reason to believe that the heart of the takeover idea is anything but a profitable falsehood.
You can see it happening yet again in Gary, Indiana, where the schools have been taken over by the state. That state takeover, which strips the elected school board of power and replaces them with a state-appointed manager, was enacted a month ago and explained to the public more fully just a week ago. Gary was a two-fer, a district slammed for both low test scores and for failing to get enough money to keep itself solvent. Within roughly five minutes, a charter company was putting in its bid to run the formerly-public school system.
The proposed management group is the Phalen Leadership Academies, a group with strong ties to Indianapolis's big charter boosters with giant apsirations loaded into its name-- the Mind Trust. The group was founded by a former Indianapolis mayor and his head of charter schoolery, and it has done a fine job of finding ways to funnel public tax dollars into private pockets. So there are plenty of specific and historical reasons to oppose Phalen's glomming up one more set of de-public schools.
But the whole takeover process is itself a scam of tremendous proportions, a house of cards resting on a foundation of falsehoods.
Remember, the basic idea here is, "You public school people couldn't make this school work, so we're going to bring in someone who can." Let's consider that premise for a moment.
What's your secret?
The takeover premise requires someone who knows the secret of making a school "work." Someone who knows more about how to educate children than the trained professionals who previously ran the school. Let's mull on that for a second-- if this person (or person's company) knows the secret of Making Schools Work, what exactly have they been doing? Why have we not already hear about them? Why are they not already rich from running seminars and presenting training and having entire states adopt their special techniques for success? Why aren't principals and teachers falling all over themselves to bring these people in to run professional development so that we can all be awesomely successful? Why haven't we all heard and read about their great success?
Have they had these Secrets for Success all along, but they've been sitting on them, saying, "Well, we're not sharing this with anybody unless they pay us a bunch of money." And if so, are those the kind of people we want running schools?
Or could it be that these takeover artists don't know a damn thing more about educating students and running a school than the rest of us?
What's the cost?
In addition to pulling off the trick of deploying super-secret education techniques unknown to anyone who actually works in public education, takeover artists must also pull off some financial magic.
The takeover artists must run the school with the same money as the "failed" managers-- and they must somehow squeeze that piggy bank so that there is money left over to pay the takeover company.
In other words, they must keep doing what the school was always doing for the same amount of money, and have more money left at the end. Which means, of course, that they can only pull this off if they don't keep doing what the school was always doing. That means cutting programs or closing facilities or paying bottom dollar for personnel (and therefor having their pick of hiring from among all the people who couldn't get real jobs).
The fantasy is that schools-- even, somehow, schools that are in financial distress-- are loaded with such waste that a savvy business person can find efficiencies and eliminate waste., which is sort of true if one believes that paying teachers or offering certain programs are wasteful. Or, of course, one might believe that certain students, by virtue of their special needs, cost too much money to keep a trim budget, and so those students must be pushed elsewhere.
The central lie
The heart of the takeover idea is that there are people out there who know special secrets-- how to educate students, how to run schools, how to do it all for less money-- that somehow nobody in public education knows. But we've had these companies in business for years now, and there's no reason to believe that the heart of the takeover idea is anything but a profitable falsehood.
Sunday, May 14, 2017
Artificial Stupidity
Facebook absolutely insist on showing me "top stories." Every time I open the Facebook page, I have to manually switch back to "most recent," because even though the Facebook Artificial Smartitude Software thinks it knows what I most want to see, it can't figure out that I want to see the "most recent" feed. Mostly because the Facebook software is consistently wrong about what I will consider Top News.
Meanwhile, my Outlook mail software has decided that I should now have the option of Focused, an email listing that lists my emails according to... well, that's not clear, but it seems to think it is "helping" me. It is not. The Artificial Smartitude Software seems to work roughly as well as rolling dice to decide the ranking of each e-mail. This is not helpful.
I pay attention to these sorts of features because we can't afford to ignore new advances in artificial intelligence, because a whole lot of people think that AI is the future of education, that computerized artificial intelligence will do a super-duper job directing the education of tiny humans, eclipsing the lame performance of old-school meat-based biological intelligence.
Take, for instance, this recent profile in Smithsonian, which is basically a puff piece to promote a meat-based biological intelligence unit named Joseph Qualls. Now-Dr Qualls (because getting meat-based biological intelligence degrees is apparently not a waste of time just yet) started his AI business back when he was a lonely BS just out of college, and he has grown the business into.... well, I'm not sure, but apparently he used AI to help train soldiers in Afghanistan among other things.
To his credit, Qualls in his interview correctly notes one of the hugest issues of AI in education or anywhere else-- What if the AI's wrong? Yes, that's a big question. It's a "Other than that, how did you like the play, Mrs. Lincoln" question. It's such a big question that Quall notes that much AI research is not driven by academics, but by lawyers who want to know how the decisions are made so they can avoid lawsuits. So, hey, it's super-encouraging to know that lawyers are so involved in developing AI. Yikes.
Still, Qualls sees this rather huge question as just a bump in the road, particularly for education.
With education, what’s going to happen, you’re still going to have monitoring. You’re going to have teachers who will be monitoring data. They’ll become more data scientists who understand the AI and can evaluate the data about how students are learning.
You’re going to need someone who’s an expert watching the data and watching the student. There will need to be a human in the loop for some time, maybe for at least 20 years. But I could be completely wrong. Technology moves so fast these days.
So neither the sage on the stage or the guide on the side, but more of a stalker in the closet, watching the data run across the screen while also keeping an eye on the students, and checking everyone's work in the process. But only for the next couple of decades or so; after that, we'll be able to get the meat widgets completely out of education. College freshmen take note-- it's not too late to change your major to something other than education.
Where Qualls' confidence comes form is unsure, since a few paragraphs earlier, he said this:
One of the great engineering challenges now is reverse engineering the human brain. You get in and then you see just how complex the brain is. As engineers, when we look at the mechanics of it, we start to realize that there is no AI system that even comes close to the human brain and what it can do.
We’re looking at the human brain and asking why humans make the decisions they do to see if that can help us understand why AI makes a decision based on a probability matrix. And we’re still no closer.
I took my first computer programming course in 1978; our professor was exceedingly clear on one point-- computers are stupid. They are fast, and they are tireless, and if you tell them to do something stupid or wrong, they will do it swiftly and relentlessly, but they will not correct for your stupid mistake. They do not think; they only do what they're told, as long as you can translate what you want into a series of things they can do.
Much of what is pitched as AI is really the same old kind of stupid, but AI does not simply mean "anything done by a computer program." When a personalized learning advocate pitches an AI-driven program, they're just pitching a huge (or not so huge) library of exercises curated by a piece of software with a complex (or not so complex) set of rules for sequencing those exercises. There is nothing intelligent about it-- it is just as stupid as stupid can be but, but implemented by a stupid machine that is swift and relentless. But that software-driven machine is the opposite of intelligence. It is the bureaucratic clerk who insists that you can't have the material signed out because you left one line on the 188R-23/Q form unfilled.
There are huge issues in directing the education of a tiny human; that is why, historically, we have been careful about who gets to do it. And the issues are not just those of intelligence, but of morals and ethics as well.
We can see these issues being played out on other AI fronts. One of the huge hurdles of self-driven cars are moral questions-- sooner or later a self-driven car is going to have to decide who lives and who dies. And as an AP story noted just last week, self-driven car software also struggles with how to interact with meat-based biological intelligence units. The car software wants a set of rules to follow all the time, every time, but meat units have their own sets of exceptions and rules for special occasions etc etc etc. But to understand and measure and deal and employ all those "rules," one has to have actual intelligence, not simply a slavish, tireless devotion to whatever rules someone programmed into you. And that remains a huge challenge for Artificial So-called-intelligence. Here are two quotes from the AP story:
"There's an endless list of these cases where we as humans know the context, we know when to bend the rules and when to break the rules," says Raj Rajkumar, a computer engineering professor at Carnegie Mellon University who leads the school's autonomous car research.
"Driverless cars are very rule-based, and they don't understand social graces," says Missy Cummings, director of Duke University's Humans and Autonomy Lab.
In other words, computers are stupid.
It makes sense that Personalized Learning mavens would champion the Artificial Stupidity approach to education, because what they call education is really training, and training of the simplest kind, in which a complicated task is broken down into a series of simper tasks and then executed in order without any attention to what sort of whole they add up to. Software-directed education is simply that exact same principle applied to the "task" of teaching. And like the self-driven car fans who talk about how we need to change the roads and the markings and the other cars on the highways so that the self-driven car can work, software-driven education ends up being a "This will work well if you change the task to what we can do instead of what you want to do." You may think you can't build a house with this stapler-- but what if you built the house out of paper! Huh?! Don't tell me you're so stuck in a rut with the status quo that you can't see how awesome it would be!
So, they don't really understand learning. they don't really understand teaching, and they don't really understand what computers can and cannot do-- outside of that, AI-directed Personalized Learning Fans are totally on to something.
And still, nobody is answering the question-- what if the AI is wrong?
What if, as Qualls posits, an AI decides that this budding artist is really supposed to be a math whiz? What if the AI completely mistakes what this tiny human is interested in or motivated by? What if the AI doesn't understand enough about the tiny human's emotional state and psychological well-being to avoid assigning tasks that are damaging? What if the AI encounters a child who is a smarter and more divergent thinker than the meat widget who wrote the software in the first place? What id we decide that we want education to involve deeper understanding and more complicated tasks, but we're stuck with AI that is unable to assess or respond intelligently to any sort of written expression (because, despite corporate assurances to the contrary, the industry has not produced essay-assessment software that is worth a dime, because assessing writing is hard, and computers are stupid)?
And what if it turns out (and how else could it turn out) that the AI is unable to establish the kind of personal relationship with a student that is central to education, particularly the education of tiny humans?
And what, as is no doubt the case with my Top Stories on Facebook, the AI is also tasked with following someone else's agenda, like an advertiser's or even political leader's?
All around us there are examples, demonstrations from the internet to the interstate of how hugely AI is not up to the task. True-believing technocrats keep insisting that any day now we will have the software that can accomplish all these magical things, and yet here I sit, still rebooting some piece of equipment in my house on an almost-daily basis because my computer and my router and my isp and various other devices are all too stupid to talk to each other consistently. My students don't know programming or intricacies of certain software that they use, but they all know that Step #1 with a computer problem is to reboot your device because that is the one computer activity that they all practice on a very regular basis.
Maybe someday actual AI will be a Thing, and then we can have a whole other conversation about what the virtues of replacing meat-based biological intelligence with machine-based intelligence may or may not be. But we are almost there in the sense that the moon landings put us one step closer to visiting Alpha Centauri. In the meantime, beware of vendors bearing AI, because what they are selling is a stupid, swift, relentless worker who is really not up to the task.
Meanwhile, my Outlook mail software has decided that I should now have the option of Focused, an email listing that lists my emails according to... well, that's not clear, but it seems to think it is "helping" me. It is not. The Artificial Smartitude Software seems to work roughly as well as rolling dice to decide the ranking of each e-mail. This is not helpful.
I pay attention to these sorts of features because we can't afford to ignore new advances in artificial intelligence, because a whole lot of people think that AI is the future of education, that computerized artificial intelligence will do a super-duper job directing the education of tiny humans, eclipsing the lame performance of old-school meat-based biological intelligence.
Take, for instance, this recent profile in Smithsonian, which is basically a puff piece to promote a meat-based biological intelligence unit named Joseph Qualls. Now-Dr Qualls (because getting meat-based biological intelligence degrees is apparently not a waste of time just yet) started his AI business back when he was a lonely BS just out of college, and he has grown the business into.... well, I'm not sure, but apparently he used AI to help train soldiers in Afghanistan among other things.
To his credit, Qualls in his interview correctly notes one of the hugest issues of AI in education or anywhere else-- What if the AI's wrong? Yes, that's a big question. It's a "Other than that, how did you like the play, Mrs. Lincoln" question. It's such a big question that Quall notes that much AI research is not driven by academics, but by lawyers who want to know how the decisions are made so they can avoid lawsuits. So, hey, it's super-encouraging to know that lawyers are so involved in developing AI. Yikes.
Still, Qualls sees this rather huge question as just a bump in the road, particularly for education.
With education, what’s going to happen, you’re still going to have monitoring. You’re going to have teachers who will be monitoring data. They’ll become more data scientists who understand the AI and can evaluate the data about how students are learning.
You’re going to need someone who’s an expert watching the data and watching the student. There will need to be a human in the loop for some time, maybe for at least 20 years. But I could be completely wrong. Technology moves so fast these days.
So neither the sage on the stage or the guide on the side, but more of a stalker in the closet, watching the data run across the screen while also keeping an eye on the students, and checking everyone's work in the process. But only for the next couple of decades or so; after that, we'll be able to get the meat widgets completely out of education. College freshmen take note-- it's not too late to change your major to something other than education.
Where Qualls' confidence comes form is unsure, since a few paragraphs earlier, he said this:
One of the great engineering challenges now is reverse engineering the human brain. You get in and then you see just how complex the brain is. As engineers, when we look at the mechanics of it, we start to realize that there is no AI system that even comes close to the human brain and what it can do.
We’re looking at the human brain and asking why humans make the decisions they do to see if that can help us understand why AI makes a decision based on a probability matrix. And we’re still no closer.
I took my first computer programming course in 1978; our professor was exceedingly clear on one point-- computers are stupid. They are fast, and they are tireless, and if you tell them to do something stupid or wrong, they will do it swiftly and relentlessly, but they will not correct for your stupid mistake. They do not think; they only do what they're told, as long as you can translate what you want into a series of things they can do.
Much of what is pitched as AI is really the same old kind of stupid, but AI does not simply mean "anything done by a computer program." When a personalized learning advocate pitches an AI-driven program, they're just pitching a huge (or not so huge) library of exercises curated by a piece of software with a complex (or not so complex) set of rules for sequencing those exercises. There is nothing intelligent about it-- it is just as stupid as stupid can be but, but implemented by a stupid machine that is swift and relentless. But that software-driven machine is the opposite of intelligence. It is the bureaucratic clerk who insists that you can't have the material signed out because you left one line on the 188R-23/Q form unfilled.
There are huge issues in directing the education of a tiny human; that is why, historically, we have been careful about who gets to do it. And the issues are not just those of intelligence, but of morals and ethics as well.
We can see these issues being played out on other AI fronts. One of the huge hurdles of self-driven cars are moral questions-- sooner or later a self-driven car is going to have to decide who lives and who dies. And as an AP story noted just last week, self-driven car software also struggles with how to interact with meat-based biological intelligence units. The car software wants a set of rules to follow all the time, every time, but meat units have their own sets of exceptions and rules for special occasions etc etc etc. But to understand and measure and deal and employ all those "rules," one has to have actual intelligence, not simply a slavish, tireless devotion to whatever rules someone programmed into you. And that remains a huge challenge for Artificial So-called-intelligence. Here are two quotes from the AP story:
"There's an endless list of these cases where we as humans know the context, we know when to bend the rules and when to break the rules," says Raj Rajkumar, a computer engineering professor at Carnegie Mellon University who leads the school's autonomous car research.
"Driverless cars are very rule-based, and they don't understand social graces," says Missy Cummings, director of Duke University's Humans and Autonomy Lab.
In other words, computers are stupid.
It makes sense that Personalized Learning mavens would champion the Artificial Stupidity approach to education, because what they call education is really training, and training of the simplest kind, in which a complicated task is broken down into a series of simper tasks and then executed in order without any attention to what sort of whole they add up to. Software-directed education is simply that exact same principle applied to the "task" of teaching. And like the self-driven car fans who talk about how we need to change the roads and the markings and the other cars on the highways so that the self-driven car can work, software-driven education ends up being a "This will work well if you change the task to what we can do instead of what you want to do." You may think you can't build a house with this stapler-- but what if you built the house out of paper! Huh?! Don't tell me you're so stuck in a rut with the status quo that you can't see how awesome it would be!
So, they don't really understand learning. they don't really understand teaching, and they don't really understand what computers can and cannot do-- outside of that, AI-directed Personalized Learning Fans are totally on to something.
And still, nobody is answering the question-- what if the AI is wrong?
What if, as Qualls posits, an AI decides that this budding artist is really supposed to be a math whiz? What if the AI completely mistakes what this tiny human is interested in or motivated by? What if the AI doesn't understand enough about the tiny human's emotional state and psychological well-being to avoid assigning tasks that are damaging? What if the AI encounters a child who is a smarter and more divergent thinker than the meat widget who wrote the software in the first place? What id we decide that we want education to involve deeper understanding and more complicated tasks, but we're stuck with AI that is unable to assess or respond intelligently to any sort of written expression (because, despite corporate assurances to the contrary, the industry has not produced essay-assessment software that is worth a dime, because assessing writing is hard, and computers are stupid)?
And what if it turns out (and how else could it turn out) that the AI is unable to establish the kind of personal relationship with a student that is central to education, particularly the education of tiny humans?
And what, as is no doubt the case with my Top Stories on Facebook, the AI is also tasked with following someone else's agenda, like an advertiser's or even political leader's?
All around us there are examples, demonstrations from the internet to the interstate of how hugely AI is not up to the task. True-believing technocrats keep insisting that any day now we will have the software that can accomplish all these magical things, and yet here I sit, still rebooting some piece of equipment in my house on an almost-daily basis because my computer and my router and my isp and various other devices are all too stupid to talk to each other consistently. My students don't know programming or intricacies of certain software that they use, but they all know that Step #1 with a computer problem is to reboot your device because that is the one computer activity that they all practice on a very regular basis.
Maybe someday actual AI will be a Thing, and then we can have a whole other conversation about what the virtues of replacing meat-based biological intelligence with machine-based intelligence may or may not be. But we are almost there in the sense that the moon landings put us one step closer to visiting Alpha Centauri. In the meantime, beware of vendors bearing AI, because what they are selling is a stupid, swift, relentless worker who is really not up to the task.
ICYMI: Mother's Day Edition (5/14)
Time for another batch of reading. I know I sound like a broken record, but when you read something you like, share it, pass it along, help add to its reach.
How Google Took Over the Classroom
The New York Times takes a close look at how Google took over the classroom-- and what price we all may be paying.
Don't Put Efficiency in School Ahead of Other Goals
Andy Smarick in US News once again applying some thought to consideration of reformy policy ideas.
Attrition in Denver Charter Schools
Jersey Jazzman comes through once again with the data, researched and laid out in clear form. This time it's the Denver charter schools, recently held up as an example of charter "success." Let's see what the secret of their success is, shall we?
The War on Education as Public Good
Wendy Lecker with another great set of insights on the assault on Public Education
We Are Teaching Kids How To Write All Wrong and No Mr Miyagis Rote Lesson Won't Help a Bit
A great response to that piece from the previous week that made all of us who teach writing snap our pencils in half.
Remembering Benjamin Barber
I have a Barber quote sticky-noted to my monitor. Jan Ressenger with a look at why he's important to remember.
Explaining the Persistence of Inadequacy
Jack Schneider and Ethan Hutt take a look at the history of achievement testing, and why we keep doing it even though it doesn't work particularly well.
Eleven Ways Chicago Is the Beating Heart of the Disastrous Charter School Agenda
A good look at how Chicago is, well, the beating heart of the disastrous charter school agenda
99% of Students Handcuffed in School by NYPD Were Black or Hispanic
The headline tells you the bulk of the story, but there are more details in the reporting.
Dear Bethune-Cookman 2017 Grads, Thank You For Telling Betsy Devos “Nah”
There were many responses to Betsy DeVos's ill-considered commencement gig, but this was by far my favorite.
Rich, Clueless Reformsters Whine About Bloggers
All right, not the actual title of Sarah Lahm's piece, but it captures the gist. This is a well-documented look at what sorts of folks are determined to help themselves to money and power in Minnesota, and the masks they wear to do it.
Relay Graduate School, Librarians, and the Effort To Make Our Public Schools "Future Ready"
From Seattle, another look at how charterizing from within can work.
What School Policy Do Conservatives Really Want
Adam Laats runs the awesomely-named I Love You But You're Going To Hell, where he interprets conservatives for those who don't speak the language. But he's also a historian in his day job-- here he is at the History News Network considering if conservatives are really getting what they want under Trump.
How Google Took Over the Classroom
The New York Times takes a close look at how Google took over the classroom-- and what price we all may be paying.
Don't Put Efficiency in School Ahead of Other Goals
Andy Smarick in US News once again applying some thought to consideration of reformy policy ideas.
Attrition in Denver Charter Schools
Jersey Jazzman comes through once again with the data, researched and laid out in clear form. This time it's the Denver charter schools, recently held up as an example of charter "success." Let's see what the secret of their success is, shall we?
The War on Education as Public Good
Wendy Lecker with another great set of insights on the assault on Public Education
We Are Teaching Kids How To Write All Wrong and No Mr Miyagis Rote Lesson Won't Help a Bit
A great response to that piece from the previous week that made all of us who teach writing snap our pencils in half.
Remembering Benjamin Barber
I have a Barber quote sticky-noted to my monitor. Jan Ressenger with a look at why he's important to remember.
Explaining the Persistence of Inadequacy
Jack Schneider and Ethan Hutt take a look at the history of achievement testing, and why we keep doing it even though it doesn't work particularly well.
Eleven Ways Chicago Is the Beating Heart of the Disastrous Charter School Agenda
A good look at how Chicago is, well, the beating heart of the disastrous charter school agenda
99% of Students Handcuffed in School by NYPD Were Black or Hispanic
The headline tells you the bulk of the story, but there are more details in the reporting.
Dear Bethune-Cookman 2017 Grads, Thank You For Telling Betsy Devos “Nah”
There were many responses to Betsy DeVos's ill-considered commencement gig, but this was by far my favorite.
Rich, Clueless Reformsters Whine About Bloggers
All right, not the actual title of Sarah Lahm's piece, but it captures the gist. This is a well-documented look at what sorts of folks are determined to help themselves to money and power in Minnesota, and the masks they wear to do it.
Relay Graduate School, Librarians, and the Effort To Make Our Public Schools "Future Ready"
From Seattle, another look at how charterizing from within can work.
What School Policy Do Conservatives Really Want
Adam Laats runs the awesomely-named I Love You But You're Going To Hell, where he interprets conservatives for those who don't speak the language. But he's also a historian in his day job-- here he is at the History News Network considering if conservatives are really getting what they want under Trump.
Saturday, May 13, 2017
Progressive: The Trouble with Ranking Schools
For a while now I've been a "Progressive Fellow in Education" (which is different from being, say, a charming fellow in the low brass section) and I write regularly for them as part of a group of twelve education writers. If you aren't reading the Fellows regularly, you should be.
Anyway, I'm going to try to entice you over there by offering the lead to my latest piece, because I think it's important that we all keep our heads on straight every time some new List of Schools comes out. So here we go--
The selection method is a curious one, based on a series of hurdles. First, the school must show that it performed “better than expected” on the Big Standardized Test for its state (e.g. PARCC or SBA). “Better than expected” is based on a statistical model developed to look at genetic trends in cattle. I kid you not. It compares actual test results with an ideal alternative universe. If the real universe student does better than what the model predicts, the model assumes that’s because the teacher and school did something right.The technique has been criticized by statisticians and educators alike, but it remains the first hurdle that a U.S. News Super School must jump. (There is one loophole—all schools that score in the top 10 percent for their state automatically qualify, whether they beat expectations or not.)
You can read the rest of the article here...
Anyway, I'm going to try to entice you over there by offering the lead to my latest piece, because I think it's important that we all keep our heads on straight every time some new List of Schools comes out. So here we go--
Every time U.S. News and World Report issues its Best High School Rankings Index, I think of basketball. Here’s why. If you look at the CBS Sports list of top-ranking high school basketball teams
in Pennsylvania, of the top twelve ranking programs only one is a
public school. The rest include charter schools, Catholic schools, one
private academy, and a Quaker boarding school.
I see two possible explanations for the lack of public schools:
either those private schools know some important secrets about coaching
basketball, or they benefit from being able to recruit and select the
best players for their teams. I’m betting it’s the latter.So when U.S. News announces that charters are marching up the rankings list, it’s pretty important to take a peek at just how those schools are assessed.
The selection method is a curious one, based on a series of hurdles. First, the school must show that it performed “better than expected” on the Big Standardized Test for its state (e.g. PARCC or SBA). “Better than expected” is based on a statistical model developed to look at genetic trends in cattle. I kid you not. It compares actual test results with an ideal alternative universe. If the real universe student does better than what the model predicts, the model assumes that’s because the teacher and school did something right.The technique has been criticized by statisticians and educators alike, but it remains the first hurdle that a U.S. News Super School must jump. (There is one loophole—all schools that score in the top 10 percent for their state automatically qualify, whether they beat expectations or not.)
You can read the rest of the article here...
(Not) A New Conversation
Phyllis Lockett took to Huffington Post last week to call for a New Conversation, which-- okay, can we stop calling for new conversations? Because they're hardly ever new and often they are barely conversations, and we have had many of these calls and maybe we should just finish one of our old conversations instead of dropping them to start new ones like an easily-distracted party guest.
Lockett is listed as a CEO without indicating "of what," a piece of fairly critical information in this context. Lockett used to be CEO of New Schools for Chicago, which used to be Renaissance, a private turnaround charter school investment launch group. As NSFC chief, Lockett was pretty vocal about the awfulness of failing public schools. After NSFC, Lockett has moved on to be CEO of LEAP Innovations. LEAP's mission is to "discover, pilot and scale personalized learning technologies and innovation practices in the classroom." They claim to be a "national hub" for an "ecosystem" of "education innovators, digital entrepreneurs, and thought leaders."
So given that, can we guess what Lockett's "new conversation" is going to look like?
She opens by noting that reform is kind of stale, what with the standards movement and charters being old, and so we need something fresh, because, I guess, we're not so much interested in effectiveness as we are in freshness?
What we really need is a new conversation that begins with what our children want and need and empowers them to pursue their interests. There’s a name for it—personalized learning–and it’s based on the common sense idea that our schools should meet every child where they are and help them get where they want to go.
So, another pitch for personalized learning. Who would have expected that, from a woman who currently earns her living promoting personalized learning. But I support public education and that's where I make my (considerably more modest) living. Maybe she 's just in the field because she really believes it, and she's not just pushing a product. Maybe her argument really is new and not just the same old PL boilerplate. Or maybe by reading her new boilerplate, we can get a sense of what the new sales pitch is going to be. Let's see. Let's move down through her pitch and see if it's made out of valid points.
First, she notes that no two children enter a classroom at the same point, and that teachers have to teach to the middle in their classroom. Half-true-- students do enter at different points, but teachers with a good handle on instructional design can still meet students where those students are.
Next, this:
The personalization of learning allows students to demonstrate competency as soon as they’re ready – and once they do so, let them go on to achieve higher.
Bzzzt. Wrong. The notion that education is simply demonstrating a series of competencies is fundamental to Personalized Learning (I will use capital to distinguish between personalized learning the education idea and Personalized Learning the product for sale), and it is one of PL's fundamental flaws. Demonstrating a series of competencies is not education-- it's training. And it's not even good training, because it breaks down tasks into simple bits and then assumes that a quick assessment task (which may or may not actually reflect the competence it claims to measure) means that competency is now mastered. I earned my "multiply by six" badge last year, so clearly I never need to do any more work on multiplying by six ever again.
Gone are the days when it was enough for students to download information from a textbook into their brains.
Well, those days have been mostly gone for decades, if I understand what she means by "downloading" from a textbook into a brain. Of, course, maybe she just means "reading," in which case, yeah, we still do that. We think there's some utility to it. And all of this begs the question of what, exactly, is different about asking students to download information from a computer screen.
There's a Montessori quote. PL folks like Montessori even though their entire philosophy is anti-Montessori. The quote Pickett uses here is the one about "follow the child, they will show you what they need to do..." but PL's philosophy is "use computer software to tell the child what to do next." It is not child-centered; it is software centered. Do you want to argue that the software is child centered? How can that be-- the software was written by humans, and those humans have never even met the children who are now subject to the software's plans and limitations. There can be no child-centered system that does not take the time to meet the child.
But Pickett will continue on this idea of "let the child lead" which is manifestly not what a PL program does. It lets the software lead.
Of course, students can’t do it alone. They need teachers and mentors to co-design their learning experience so that it covers a range of topics and subject matter. Done well, personalized learning empowers great teachers to make dynamic adjustments based on each student’s skills, curiosity, and goals.
Nope. If the classroom is truly teacher-directed and child-centered, then your PL software is really just a computer bank of resources, which is fine, but don't hand me a hammer and tell me you have now taken a bold new step in architectural design. Pickett is of course being generous here-- many PL advocates believe the teacher's role is basic monitoring, and not anything resembling teaching at all.
Pickett nods to Individualized Education Programs (IEPs) which are a great example of how we can provide everything from a personalized learning experience for students all the way to a series of go-through-motions paperwork for teachers and parents.
Pickett winds up with a one-two punch of "Hey, the world is changing and we must adapt and change, too" leading right into "Shiny pretty future but sometimes the education system doesn't like tobuy my product try new things and I hope this will be different."
Bottom line: Pickett is not offering a conversation. There's no "Let's hear from teachers what they think would be a good idea to pursue or not." And there is nothing new. This is just plain old "We have a new product that we would like you to believe will help educate students, so would you give us some money for it, please."
This is what to watch for when a Personalized Learning advocate comes your way-- not a new conversation about education, but an old sales pitch.
Lockett is listed as a CEO without indicating "of what," a piece of fairly critical information in this context. Lockett used to be CEO of New Schools for Chicago, which used to be Renaissance, a private turnaround charter school investment launch group. As NSFC chief, Lockett was pretty vocal about the awfulness of failing public schools. After NSFC, Lockett has moved on to be CEO of LEAP Innovations. LEAP's mission is to "discover, pilot and scale personalized learning technologies and innovation practices in the classroom." They claim to be a "national hub" for an "ecosystem" of "education innovators, digital entrepreneurs, and thought leaders."
So given that, can we guess what Lockett's "new conversation" is going to look like?
She opens by noting that reform is kind of stale, what with the standards movement and charters being old, and so we need something fresh, because, I guess, we're not so much interested in effectiveness as we are in freshness?
What we really need is a new conversation that begins with what our children want and need and empowers them to pursue their interests. There’s a name for it—personalized learning–and it’s based on the common sense idea that our schools should meet every child where they are and help them get where they want to go.
So, another pitch for personalized learning. Who would have expected that, from a woman who currently earns her living promoting personalized learning. But I support public education and that's where I make my (considerably more modest) living. Maybe she 's just in the field because she really believes it, and she's not just pushing a product. Maybe her argument really is new and not just the same old PL boilerplate. Or maybe by reading her new boilerplate, we can get a sense of what the new sales pitch is going to be. Let's see. Let's move down through her pitch and see if it's made out of valid points.
First, she notes that no two children enter a classroom at the same point, and that teachers have to teach to the middle in their classroom. Half-true-- students do enter at different points, but teachers with a good handle on instructional design can still meet students where those students are.
Next, this:
The personalization of learning allows students to demonstrate competency as soon as they’re ready – and once they do so, let them go on to achieve higher.
Bzzzt. Wrong. The notion that education is simply demonstrating a series of competencies is fundamental to Personalized Learning (I will use capital to distinguish between personalized learning the education idea and Personalized Learning the product for sale), and it is one of PL's fundamental flaws. Demonstrating a series of competencies is not education-- it's training. And it's not even good training, because it breaks down tasks into simple bits and then assumes that a quick assessment task (which may or may not actually reflect the competence it claims to measure) means that competency is now mastered. I earned my "multiply by six" badge last year, so clearly I never need to do any more work on multiplying by six ever again.
Gone are the days when it was enough for students to download information from a textbook into their brains.
Well, those days have been mostly gone for decades, if I understand what she means by "downloading" from a textbook into a brain. Of, course, maybe she just means "reading," in which case, yeah, we still do that. We think there's some utility to it. And all of this begs the question of what, exactly, is different about asking students to download information from a computer screen.
There's a Montessori quote. PL folks like Montessori even though their entire philosophy is anti-Montessori. The quote Pickett uses here is the one about "follow the child, they will show you what they need to do..." but PL's philosophy is "use computer software to tell the child what to do next." It is not child-centered; it is software centered. Do you want to argue that the software is child centered? How can that be-- the software was written by humans, and those humans have never even met the children who are now subject to the software's plans and limitations. There can be no child-centered system that does not take the time to meet the child.
But Pickett will continue on this idea of "let the child lead" which is manifestly not what a PL program does. It lets the software lead.
Of course, students can’t do it alone. They need teachers and mentors to co-design their learning experience so that it covers a range of topics and subject matter. Done well, personalized learning empowers great teachers to make dynamic adjustments based on each student’s skills, curiosity, and goals.
Nope. If the classroom is truly teacher-directed and child-centered, then your PL software is really just a computer bank of resources, which is fine, but don't hand me a hammer and tell me you have now taken a bold new step in architectural design. Pickett is of course being generous here-- many PL advocates believe the teacher's role is basic monitoring, and not anything resembling teaching at all.
Pickett nods to Individualized Education Programs (IEPs) which are a great example of how we can provide everything from a personalized learning experience for students all the way to a series of go-through-motions paperwork for teachers and parents.
Pickett winds up with a one-two punch of "Hey, the world is changing and we must adapt and change, too" leading right into "Shiny pretty future but sometimes the education system doesn't like to
Bottom line: Pickett is not offering a conversation. There's no "Let's hear from teachers what they think would be a good idea to pursue or not." And there is nothing new. This is just plain old "We have a new product that we would like you to believe will help educate students, so would you give us some money for it, please."
This is what to watch for when a Personalized Learning advocate comes your way-- not a new conversation about education, but an old sales pitch.
Subscribe to:
Posts (Atom)