Saturday, August 24, 2024
Call Them By Their Name
Thursday, August 22, 2024
Mystery Choice Coalition Opposes Harris-Walz
Carroll's LinkedIn says that he presided over Invest in Education Coalition and Foundation from March 2012 to March 2019, calling it "A think tank and advocacy organization focused on school choice in NY and nationally." He also says he founded #EdTaxCredit50 Coalition in January of 2017, which focused on pushing a 50-state tax credit and "the expansion of 529 college savings accounts in December 2017 to allow withdrawals for private K-12 tuition, the biggest federal school-choice initiative ever adopted."
Prior to his time at IIE, Carroll spent 2002-2012 as president of the Foundation for Education Reform and Accountability, a New York State choice advocacy group, and before that, founder and chairman of the Brighter Choice Foundation, a charter network in and around Albany. Though he doesn't mention it, a listing for Carroll at the Center for Education Reform also says that post-FERA, he headed up the Foundation for Opportunity in Education, which fits.
Carroll's 2012 arrival at Invest in Education aligns with the group's certification by the IRS. The Foundation was granted tax exempt status in 2012, and the Coalition in 2013. Both list an Albany post office box as their address, both list Anthony De Nicola (the current chair) as the principal officer.
Back then, IIEF had a president-- Luke Messer. Messer was the CEO of School Choice Indiana. He was also elected a state legislator (2003-2006) then moved on to a US Rep from 2013-2019 (in the district Mike Pence vacated to become Governor), where he was founder and co-chair of the Congressional School Choice Caucus. He made plenty of choicer friends in the days after Trump's election and DeVos's appointment.
By May of 2022, he was a partner at the law firm of Bose McKinney & Evans. At Invest in Education, he worked "every day to enact a $10 billion federal tax credit that would help give millions of children access to a high-quality school." By June of 2023, IIEF's address was the same as that of Bose McKinney & Evans, and the site was sporting logos for both a foundation and a coalition. One thing Messer doesn't list in his bio is his years as a registered lobbyist (2006-2012), right after he tried to privatize some Indiana highways. And he's been out there as the face of Invest in Education stumping for choice on all the usual fun places.
Anthony J. de Nicola is the chair. He's also chairman of private equity firm Welsh, Carson, Anderson & Stowe, a New York private equity firm that specializes in tech and healthcare. He and his wife are big on philanthropic giving, including supporting the Catholic church.
Thomas E. McInerny is the secretary of the board. He's CEO at Bluff Point Associates, a private equity firm. He used to be a general partner at Welsh, Carson, Anderson & Stowe.
Robert H. Neihaus is treasurer. He's founder of GCP Capital Partners, a private equity firm.
Wednesday, August 21, 2024
Chicago Schools' Terrible Awful No Good Very Bad AI Guide
pursuit of educational excellence and innovation, organizational operations, instructional core, drive community engagement, strategic adoption, enrich learning environments, success in a continually evolving technological world, steadfastly upholding, leveraging GenAI responsibly, enhance educational outcomes
Lordy.
We then jump into the AI portions of the guidebook, and things are looking bad right off the top.
Artificial Intelligence (AI) leverages computing power to mimic human cognitive functions such as problem-solving and decision-making.
Not really, no. Nor do we get a better explanation for generative AI in particular:
GenAI generates new content—including text, audio, code, images, or videos—based on vast amounts of “training” data, typically derived from the internet.
That's not really a useful answer, is it. Like saying "a piano is an instrument that produces notes"-- it's not wrong, but it completely omits the "how," and omitting the "how" from any discussion on GenAI is a terrible mistake, because if there's anything that is a) super important and b) widely misunderstood, it is how GenAI actually works. This is a link to three excellent explanations, but the very short answer regarding text is that GenAI strings together a series of probably next words. It does not "understand" anything in any human sense of the word. It is not magical, and it is not smart, and anyone who is going to mess with it must understand those things. Spoiler alert: at no point will this guide clarify any of that. Just "Magic box makes smarty content stuff! Wheee!"
Next is some guidance for staff in GenAI use. Start with what ought to already be a basic IT rule for staff--don't feed the AI any private information.
Much of the guidance falls into one of two categories: 1) Can be done, but will be more time consuming than just generating materials your own damn self and 2) Cannot be done.
For instance, CPS wants teachers to verify the tool's output. "These systems and their output require vigorous scrutiny and correction." Because the output might include "hallucinations" (aka wrong things the software just made up), the output "requires careful review." But if I'm going to have the computer kick out my lesson materials, and then I am going to spend a whole lot of time doing research and review of those materials, where am I saving time, and I wouldn't I be just as far ahead to put it together in the first place?
Also, CPS wants teachers to "avoid using any GenAI outputs that might contain copyrighted material without clear ownership." You can do this, the guide says, by "examining the work for a copyright notice, considering the type of content and source (i.e. content issued by the US government is generally public), or referring to websites that store public domain works or the Copyright Database." This is bananas. You have no idea what the GenAI has trained on. GenAI companies have gone to great lengths (and increasing numbers of lawsuits) to avoid letting you know what the AI has trained on. The chance that any content generated by any AI is the result of training on or inclusion of copyrighted materials is somewhere around 99.999%, and the chances that you can confidently check an AI's output for copyrighted material is 00.0001%.
CPS warns us that "all models reflect the biases in their training data," but they only warn about this insofar as it might perpetuate stereotypes, discrimination, or DEI problems. All worth considering, but it's also worth mentioning that there are a zillion other biases in the world ("Lincoln was not a great President" "Certain types of data are more valid than others") and those can also work their way in. CPS suggests
Conduct thorough reviews to ensure outputs are not only accurate, but also free of unintended biases and align with our educational goals. Verify and assess the source information that GenAI outputs are relying upon.
Again, the first takes a whole lot of time, and the second cannot be done.
Always document the use of AI tools. I'm not sure what this accomplishes, exactly. Are teachers going to hand out worksheets marked "Generated by ChatGPT"? CPS says to make sure that "all GenAI engagements are traceable and accountable," which raises sort of an interesting question-- can GenAI results be traceable when they are not replicable? But throughout the guide, CPS is clear that they want "detailed records of when and how GenAI tools are used." If I were cynical, I might think this was a bit of a CYA paper trail for the district. But hey--maybe you can just have GenAI generate that detailed record for you.
How about academic integrity. CPS says that "students should submit work that is fundamentally their own," whatever that means. But also, "students should clearly identify any AI-generated content they have used in their assignments." This should work as well as telling students they are obligated to show where they have cut and pasted paragraphs from Wikipedia into their paper.
Don't use AI to "create inappropriate or harmful content." But CPS does have a whole page of "positive GenAI use for students."
Use GenAI as a brainstorming partner. Synthesize a variety of opinions and propose compromise solutions (I think this one is meant to handle your group work). Use GenAI image creators to bring ideas to life. Overcome writer's block by suggesting a variety of ideas and writing prompts. Ask GenAI to propose unconventional solutions to problems. Use GenAI as an interactive tutor. Generate immediate feedback on first drafts of written assignments (but not, I guess, if that makes it not fundamentally your own). Oh, and use generative search engines like Perplexity as a research assistant (that would be the AI that is in trouble for scraping data without permission, which would seem to conflict with some of the ethical concerns CPS has).
CPS also has guidance for educators and staff. There are some restrictions suggested; for instance, Gemini and Copilot, two GenAI programs that pretty much every student has access to, should not be used by students under 18.
As with any new student-facing technology, the introduction of GenAI tools invites educators to consider how GenAI can further the underlying goals of their activities and assignments instead of impeding them.
This is wrong in the way that much ed tech introduction is wrong. Teachers should not be asking how the technology can help-- they should be asking IF the technology can help and whether or not it should be allowed to help.
But, Lord help us, CPS even has some specific suggestions of how certain assignments would go without and with GenAI.
Not all of these are terrible. The elementary science assignment in which students let the AI try to depict an animal and then figure out what the AI got wrong? Not bad at all. Some of them are pointless. The elementary social studies assignment in which students role play as leaders and answer questions--why does the teacher need an AI to generate questions? And how much magical thinking is behind the notion that having AI design interventions for individual students is better than having the teacher do it?
Some are short-circuiting education itself. Like the science assignments that suggest that, instead of having students run experiments, just have the AI run "virtual" experiments and tell the students how they went. Not how to have students learn science (but it is how to justify cutting labs and lab supplies out of budgets).
And some are just bananas. Have the AI role play a character in a book, or retell the story from that character's point of view? I have seen nothing to indicate that an AI is any way capable of faithfully doing that work (at best, it will steal from human-completed versions of that assignment).
There is a link to a list of 851 CPS-approved GenAI products, and if someone at the office has extensively vetted each and every one of those, they deserve a huge raise.
This is just a mess. The guidebook repeatedly insists that students and teachers use AI ethically, but there is little evidence that the folks behind this have wrestled with many of the deep and difficult ethical questions behind generative AI. How much is too much? How do we reckon AI programs' unauthorized and undisclosed use of people's work for "training"? And while CPS wants teachers to monitor how and how much students use AI, they have no more thoughts than anyone else about how teachers are supposed to do that.
Teachers do need some help dealing with the AI revolution. This is not that. Look online for some thoughtful and useful guides (like this one). The best thing I can say about it is that it smells like the sort of thing that arrives in teacher mailboxes from the front office which they then ignore. This should be one of the prettiest, slickest items in many circular files.
Monday, August 19, 2024
How Khan Academy (And Others) Fudged Their Research
Do they work? In August 2022, three researchers at Khan Academy, a popular math practice website, published the results of a massive, 99-district study of students. It showed an effect size of 0.26 standard deviations (SD)—equivalent to several months of additional schooling—for students who used the program as recommended.
A 2016 Harvard study of DreamBox, a competing mathematics platform, though without the benefit of Sal Khan’s satin voiceover, found an effect size of 0.20 SD for students who used the program as recommended. A 2019 study of i-Ready, a similar program, reported an effect size in math of 0.22 SD—again for students who used the program as recommended. And in 2023 IXL, yet another online mathematics program, reported an effect size of 0.14 SD for students who used the program as designed.
Did you notice a key phrase?
"For students who used the program as recommended."
So how many students is that. Well, Holt checked the footnotes on the Khan Academy study and found the answer--
4.7%
Not a typo. The study threw out over 95% of the results. Holt says that the other programs report similar numbers.
I suppose the takeaway could be that folks should be trying harder to follow the program as recommended. Of course, it could also be that students who rea motivated to follow the program as recommended are the most ready-to-learn ones.
But if you hand me a tool that has been made so difficult or unappealing to use that 95% of the "users" say, "No, thanks," I'm going to blame your tool design.
It's a problem eerily similar to that of ed tech itself, where the pitch to teachers is so often, "If you just change what you do and how you try to do it, this tool will be awesome." When the main problem with your piece of education technology is that it's not designed in such a way that your end users find it actually useful, that is on you.
In the meantime, schools might want to be a little more careful about how they select these programs. Ed tech companies are interested in marketing, in selling units, and if they have to massage the data to do it--well, the free market. As I've said many times before, the free market does not foster superior quality; the free market fosters superior marketing. And nothing markets in the ed sector like Scientific Evidence Supported by Hard Data.
Always check the data. Always.
Houston and the End of an Era
A group calling itself Community Voices for Public Education organized protests, petitions, and testimonials from parents and teachers decrying what they saw as the “tired old script from 2012,” and asserting that NES was leaving children “overwhelmed, crying, and complaining.”
This year, “they’re not relating to us at all,” said one student. “This is not fun,” said another. “I feel like I’m in prison.” A former Houston ISD principal said Miles is instilling a “culture of fear.” The district’s largest teachers union mounted a picket to protest the reforms. At a September board meeting, members of the audience set alarms on their phones to go off every four minutes to mock the NES requirement that teachers stop every four minutes to do a multiple response strategy, which conjured up images of timers ringing on a fast-food deep fryer to goad a Pavlovian response from low-skill McTeachers. Nor did it help that the takeover was marked by what one former Houston ISD board member described as a series of unforced errors. Early on, district-made curriculum units were riddled with errors, and poor communications led to national news stories erroneously claiming that Miles was turning school libraries into detention centers for misbehaving students.
For Pondiscio, Miles's problems are a sign of how the context for full-scale reform has changed. "Ed reform embodied youthful energy and do-gooder earnestness" he says, having elsewhere noted more than once that Miles is--well, he's not young (he's my age). Back in the day, reformsters like Rhee were on magazine covers, and Waiting for Superman was a hot ticket, even shown at the Democratic Convention.
As for Miles himself and his reaction to the criticism of his work-- "I'm old and I don't care."
It's not quite that simple, and Pondiscio crams a lot of nuance into a small space. But he notes that the clock is ticking for Miles, for a variety of reasons, including the super-voucher love of Governor Abbott, Miles's main patron. In one sentence, Pondiscio captures the current drift of reformsterism:
Among many red state Republicans, who often view traditional public schools as irredeemable cauldrons of “woke” indoctrination, ESAs have become the preferred remedy for public education.
For reformsters, particularly the reformsters of the past twenty years, the article may sting with its elegy for a style of reform whose time has passed, and a lack of optimism for Miles's prospect for success in Houston. For defenders of public education, there will be irritation with what Pondiscio has left out: details like how Miles did in Dallas, and details in the presented history that invite debate, particularly in the pictures from reformy days gone by. Regular readers of this space will have repeated urges to say, "Hey, yeah, but, wait--", including a longer litany of Miles's missteps.
If parents, politicians, philanthropists, and the news media have grown impatient with urban public-school reform, not even waiting for measurable outcomes before pronouncing the entire enterprise a failure—too disruptive, too disrespectful of teachers, too stressful for children—who is the constituency left for big-city reform? Who is left to champion change for the vast majority of children who, even in an emerging era of increasing choice, are likely to remain in urban public schools and struggle to read or do math at a reasonable standard, limiting their future opportunities and life prospects?
There are unexamined questions here--how is it that big city reform lost all of its supposed constituencies? And is it possible to champion change for those students without championing the Superstar CEO Takeover model for improving big city schools?
Maybe being a) powerful and b) sure that you're right is not the recipe for successful leadership, and maybe that is doubly true when that particular management model has never produced any significant, lasting success. Maybe this idea has lost support because it's a bad idea. And maybe putting a hard-charging high-powered person in control of a school district is not the only way to lift up those students who are falling behind. Maybe this was a tree that was never going to bear fruit, and reform fans should have been cultivating something else entirely.
It's a piece that deserves some attention and discussion, well-crafted, with something for everyone to object to. It's an interesting picture of what's going on in Houston combined with an encapsuled history of one slice of reformster history. You may find plenty to jeer, but I recommend reading it anyway.
Sunday, August 18, 2024
OK: State Rescinds Approval For Christian Charter School--For Now
One small addition to the story of St. Isidore, the Catholic cyber charter that was angling to be the nation's first religious charter school.
St. Isidore was approved a little over a year ago, despite the opinion of Republican attorney general Gentner Drummond that it was a Very Bad Idea and also Probably Illegal. There was nothing particularly sneaky about it--the Catholic Diocese of Tulsa was very clear that they intended it to be a full-on Catholic charter school, just as explicitly religious as any parochial school.
The supporters of the school (including, of course Governor Stitt and education dudebro-in-chief Ryan Walters) were banking on the Carson v. Makin decision paved the way for this new move. Meanwhile, GOP opponents like Drummond feared that it would open the door for all manner of religious charter schools (The Satanic Temple was ready to roll), and charter world opponents like Nina Rees of the National Alliance of Public Charter Schools objected because it would challenge the notion that charter schools are public schools, a definition that charteristas have historically preferred to bring up only when it suited them.
But the most immediate result of the state's board overseeing the approval of St. Isidore was, of course, a lawsuit.
Which the Catholic school lost.
The court was pretty clear. The state's charter act says that charter schools are public schools. The state constitution says that the state must support public schools and may not spend taxpayer money on religious institutions.
Therefor the Establishment Clause and the Oklahoma Constitution apply, and the Free Exercise does not (because, says the court, St. Isidore is not a private entity). Wrote the court:The State’s establishment of a religious charter school violates Oklahoma statutes Oklahoma Constitution, and the Establishment Clause. St. Isidore cannot justify existence by invoking Free Exercise rights as religious entity. St. Isidore came into existence through its charter with the State and will function as a component of the state’s public school system. The case turns on the State’s contracted-for religious teachings and activities through a new public charter school, not the State’s exclusion of a religious entity.In other words, charters can’t invoke the rights of a private organization to Free Exercise, because they are not private organizations, but part of the state. Rescind the contract, ordered the court.
ICYMI: Teacher Start Up Edition (8/18)
Schools have made slow progress on record absenteeism, with millions of kids still skipping class
Jeff Bryant looks at Tim Walz in the context of the Democratic Party's less-than-stellar record with public education in the recent past.
Fintech bullies stole your kid's lunch money
Yes this matters