Sunday, February 7, 2016

NCTQ: Terrible Teacher Prep and Headline Research

The National Council on Teacher Quality is one of the great mysteries of the education biz. They have no particular credentials and are truly the laziest "researchers" on the planet, but I think I may have cracked the code. Let me show you their latest piece of "research," and then we can talk about how they really work.

Their new report-- "Learning about Learning: What Every New Teacher Needs To Know" (which is a curious title-- do other teachers NOT need to know these things?)-- is yet another NCTQ indictment of current teacher education programs. The broad stroke of their finding is that teacher education programs are not teaching the proven strategies that work in education.

That's the broad stroke. As always with NCTQ, the devil is in the details. After all, that sounds like a huge research undertaking. First, you would have to identify teaching strategies that are clearly and widely supported by all manner of research. Then you would have to carefully examine a whooooooole lot of teacher education programs-- college visits, professor and student interviews, sit in classes, extensive study of syllabi-- it would be a huge undertaking.

Or you could just flip through a bunch of educational methods textbooks.

What Every Teacher Needs To Know

First, NCTQ had to select those methods that "every new teacher needs to know." Here's the methodology for that piece of research-based heavy lifting:

In Organizing Instruction and Study to Improve Student Learning: A Practice Guide, the Institute of Education Sciences (IES), the research arm of the U.S. Department of Education, identified proven practices that promote learning for all students, regardless of grade or subject, and that are especially potent with struggling students. Six practices stand out for the research behind them. There is little debate among scholars about the effectiveness of these six strategies.

Here are a few things to know about Organizing Instruction and Study To Improve Student Learning.

It was published in September of 2007. It was produced under a USED- IES contract with Optimal Solutions Group, LLC, a policy data-analysis business. It opens with a disclaimer that includes this:

The opinions and positions expressed in this practice guide are the authors’ and do not necessarily represent the opinions and positions of the Institute of Education Sciences or the U.S. Department of Education. 

The IES paper does, in fact, appear to be a group of researchers checking to see how much research basis there is for seven ideas that they think will help teaching subjects "that demand a great deal of content learning, including social studies, science, and mathematics." So, not actually "all subjects and grades" as NCTQ says. And they are based around a memory-based model of education.

More importantly, the IES paper rates the seven approaches according to strength of the research to support them. Four of the seven are rated "moderate," two are rated "low," and the seventh is rated "strong".

What Are The Must-Know Techniques?

That depends on whether you look at the original IES paper or the NCTQ "research." NCTQ drops one IES technique-- teaching students how to use time. And they convert "use quizzing to promote learning" into "assessing to boost retention." Either way, the IES paper rates the scientific basis for this technique low, with little research beyond reading instruction experiments with college students. So that whole "there is little debate" and "research-based" bullshit is, in fact, bullshit.

That is the only low-rated technique that made the list. The strong technique is "ask deep probing questions."

The other four are all moderately-rated, meaning that there is some research basis for them (back in 2007), but it's not overwhelming. Those four are "pairing graphics with words," "linking abstract concepts with concrete representations," "alternating solved problems with problems to solve," and "spread out practice over time."

These are not bad techniques, useless techniques, unwelcome techniques-- but is NCTQ suggesting that of all the educational techniques in the world, these six are the essential ones? Well, they call them "the fundamental knowledge they need to make learning 'stick.'"

NCTQ refers to these six techniques as "the field’s bedrock research as identified by IES," which is a lie. 

And they reach this scary conclusion: "If teacher candidates aren’t being taught the research-proven and workable practices that help students learn new content, they will flounder when they try to make learning last." So how do they know that teacher candidates aren't being taught these techniques. 

How Are Ed Schools Failing?

They looked in a bunch of textbooks. They looked at 48 college programs (at 28 different colleges). They selected books "assigned in educational psychology, general methods and secondary subject-specific methods courses." And because NCTQ really is the laziest research group on the planet, there's this:

We note that textbooks unique to subject-specific elementary methods courses were not reviewed in depth. What examination we did of these textbooks indicated that had we reviewed them, none would have received credit for covering the strategies.

We glanced at some books and they looked like they were fer suresies losers, so we just skipped those.

Ultimately they settled on 48 books. You can see the breakdown here. A team of four scanned through the books for signs of references to the techniques with blah blah blah I'm not sure they didn't just use [Control + F] here, but they have a complex-sounding technique for deciding if the technique was fully and accurately presented in the textbook. You can look through their methodology if you like, but the bottom line is that references to the techniques had to be absolutely on the nose.

They also claim to have done some study of programs, going back to their file folder of course syllabi, because that totally tells you exactly what goes on in classes. As with books, the requirement was to learn the technique as a general truth. It looks as if, for instance, learning all about teaching maths with manipulatives does not count as "linking abstract ideas to concrete representations" because that's only for a math class, and dopey teachers might not understand that linking abstract and concrete could be used in other classes.

Seriously?

There are so many other questions to ask, such as, "Do teachers actually use their methods and general ed psych books?" Is the main pathway for teaching prospective teachers through traditional lecture and textbooks? That would be an interesting question to study, but NCTQ does not go there. Heck, asking any teacher in any classroom, "Can you put your hands on your college methods textbook right now?" would be entertaining. But as always, NCTQ has more important things to do than try to find out any useful truths.

Who are these people?

NCTQ has appointed themselves the arbiters of teacher quality because reasons. Would you like to guess how many career teachers are actually involved in running NCTQ? Did you answer zero? Good for you. Would you like to guess how many former TFA temps are running the group? Did you guess many? Good for you again.

What is their research specialty?

NCTQ is the group that once declared that college teacher programs are too easy, and their research was (and I swear I am not making this up) to look through college commencement programs.

NCTQ is the group that cranked out a big report on teacher evaluation whose main point was, "It must not be right yet, because not enough teachers are failing."

NCTQ creates the college rankings list published every year by US News leading to critiques of NCTQ's crappy methodology here and here and here, to link to just a few. NCTQ's method here again focuses on syllabi and course listings, which, as one college critic noted, "is like a restaurant reviewer deciding on the quality of a restaurant based on its menu alone, without ever tasting the food." That college should count its blessings; NCTQ has been known to "rate" colleges without any direct contact at all.

NCTQ's history has been well-chronicled by both Mercedes Schneider and Diane Ravitch. It's worth remembering that She Who Must Not Be Named, the failed DC chancellor and quite possibly the least serious person to ever screw around with education policy, was also a part of NCTQ.

NCTQ depends on the reluctance of people to read past the lede. For this piece, for instance, anybody who bothered to go read the old IES paper that supposedly establishes these as "bedrock" techniques would see that the IES does no such thing. Anyone who read into the NCTQ "research" on teacher program difficulty would see it was based on reading commencement programs. The college president I spoke to was so very frustrated because anybody who walked onto her campus could see that the program NCTQ gave a low ranking was a program that did not actually exist.

But NCTQ specializes in headline research-- generate an eye-catching pro-reform headline and hope that if you follow it with a bunch of words, folks will just say, "Well, there's a lot of words there, so they must have a real research basis for what they're saying."

There are reform advocates who are, I believe, sincere and intellectually honest. But for NCTQ to, for instance, transcribe the 2007 IES report of the quizzing technique as a "bedrock" of learning when IES clearly ranks it as having little real research to back it up-- that requires either unbelievable stupidity, incredible laziness, or just flat-out lying. NCTQ might very well be the least serious outfit in the education biz, and yet they still draw press attention.

But if you run across references to this report (which is part of a broader assault on teacher education programs), rest assured that it's rubbish, and don't hesitate to encourage people to ignore it. Never has a group so justly deserved to be completely ignored.

ICYMI: Your Sunday Halftime Reading

Just kidding. At my house, the game will not even be on, and I'm pretty sure life will go on. But here are a few pieces to read today.

The Real Issue with Teacher Pay

The North Carolina 2015 Teacher of the Year has a few things to say about respect for the profession (and if you've been paying attention to North Carolina, you know why)

Alice's Adventures in Public Education

Turns out Lewis Carroll was writing about the future, and here we are. 

The Classroom Door Is Always Open

A visit to one of the few old-style schools of choice still operating out there. This is what it should be about.

Reforminess IS the Status Quo 

Jersey Jazzman continues his frustrated attempts to ground the education discussion in reality.

Why Aren't Public Schools Too Big To Fail? 

Steven Singer wonders why our response to failing schools is to abandon them, rather than attempt a rescue.

Cook for 17 minutes at 350 degrees

Frozen pizza instructions prompt a reflection on teaching skills in the English classroom.

George Orwell's Ed Conference 

Morna McDermott looks at the incredible, astonishing education conference coming up, courtesy our good friends at Pearson

Saturday, February 6, 2016

PA: Partial Testing Pause

This week Pennsylvania Governor Tom Wolf signed the bill that will delay using the Keystone Exams (our version of the Big Standardized Test for high school students) as a graduation requirement. Though we've been giving the test for a few years, it will now not become a grad requirement until 2019 (postponed from 2017). That's certainly not bad news, but there's no reason to put the party hats on just yet.

First, as (unfortunately) always, it's worth noting that this happens against the backdrop of our leaders' absolute inability to fulfill their most basic function- as I type this, Pennsylvania is on its 221st day without a budget. We are right on track to have the governor preparing next year's budget while this year's budget is still not fully adopted. It is entirely possible that Harrisburg is populated entirely by dopes.

Second, the idea is to have officials go back to the drawing board and come up with better ideas for BS Testing. This is akin to feeling great pain because you're hitting yourself in the head with a hammer and saying, "Hmm. Well, maybe if I turn the hammer sideways it won't hurt so much." It's akin to eating a terrible, vomit-inducing meal of liver and pineapple and rotted fish parts covered with chocolate sauce and saying, "Well, maybe if we put the chocolate sauce on first rather than last." This is about re-aranging deck chairs rather than examining the premise.

Third, while high school seniors will not be required by the state to pass the Keystones to graduate, the state still plans to use the Keystones to evaluate schools and teachers. So our professional fates are still tied to a BS Test that students have no reason to take seriously or care about. Great.

Fourth-- well, many DO have a reason to care about the test, because in anticipation of the state's BS Test grad requirement, many school districts have already made passing the Keystone a local graduation requirement. We do that in PA-- the state sets a grad requirement minimum, and local districts can require over and above that. So for many local students, the postponing of the Keystone grad requirement will make zero difference-- they still have to pass the test or an alternative assessment (known in my district as the Binder of Doom) in order to graduate.

So this is good news in the sense that it would be worse if the state had gone ahead with its original plan to require Keystones as exit tests right now. But it's bad news in the sense that we aren't really trying to fix anything or figure out what we really ought to be doing. And it's bad news because the decisions are still in the hands of the most expensive, most incompetent state government in the country.

Friday, February 5, 2016

Support Real Education Journalism

I am here to ask for your support. Not for me-- my brand of faux journalism costs little to produce. Instead, I want you to help out with Jennifer Berkshire's (Edushyster) latest project.

Berkshire is working to fill one of the gaping holes in education journalism. Well, two holes, actually. The first is the need to hear voices that have gone too long unheard. The other is to literally make those voices heard by podcast.

Podcasting journalism done right is neither cheap nor easy. You need equipment, both for gathering material and for putting it in a nice production package. And you need to travel, to go where the people are who need to be heard and who, in many cases, have gone unheard for too long. For example, the first episode of the Have You Heard series, which gives voice to the African-American opt out parents of Philadelphia.

Watch their pitch here.




I don't make this kind of pitch often, but this is a project I believe in. I believe that there is a need for this kind of journalism in this kind of format, and I believe that Berkshire is just the woman to do it. She has an incredibly deft touch with an interview, and she remains fair and open without giving up her own convictions about public education. In a fair and just world, she would be making the kind of money that the big boys in the Gates-funded thinky tanks pull down. The advantage of the reformsters remains a huge mountain of cash and people who work full time, ready to be dispatched to any corner of the world that calls for them. In this world, Berkshire and French need some help from all of us.

So if you have thought periodically that you would like to do something, something to help the cause of public education in this country, here's a chance to do something that you can accomplish without moving form where you're sitting to read my words. Click on over to the Beacon site and give her a hand.

HYH: Urban Opt Out Is a Thing

Have You Heard is a new podcast series from Jennifer Berkshire (Edushyster), one of the handful of edubloggers who does the work of a real journalist.

For her first episode, she and blog partner Aaron French have traveled to Philadelphia to talk to some Opt Out activists who are not suburban white soccer moms, but urban African-American parents. It's a group that has been largely invisible in mainstream coverage of the opt-out movement, in particular because the narrative of the Testocrats has been that the Big Standardized Test is an important civil rights tool, opposed only (as famously suggested by Arne Duncan) a bunch of white suburban moms who are mad that the BS Test reveals their children to be less brilliant than they supposed.

But Philadelphia activists like Robin Roberts, Will Thomas, Shakeda Gaines and Tonya Bah reveal another picture.

Their growth as opt-out activists has been gradual, in part because Philly school authorities denied that opt out exists in PA, that parents have no such rights. The first time Gaines took her opt-out letter to the school and was denied. Says Thomas, "They'll look you right in your face and make you believe that what you're feeling isn't real."Yet Pennsylvania clearly has an opt out law on the books, allowing any parent to opt out of just about any educational activity based on religious objections-- and there is no requirement for them to explain the nature of that religious objection.

These parents see the stakes as large, and throughout the interview it becomes clear that they see the issue of testing as part of a larger assault on their schools. Schools that are already on starvation budgets still keep the testing no matter what the budget cuts. Resources are lost. Thomas asks if children doesn't do well, is there a program that says "Let's assist them." Is there money set aside to "empower" that school? No, he says. They close it. Your child is bussed out.

Bah says that students, teachers and parents have a right to be part of the decisions about the school. And that's a recurring theme for these activists-- the view that the BS Testing juggernaut is part of a mechanism for dismantling local schools and silencing local voices. "We will have a community of people that merely follow directions. I'm not interested in that type of community." Opt out is a way to demand that schools are centers of learning, not of testing.

There's much more to hear, though the podcast clocks in at just over 19 minutes. Give it a listen right in the space below, and then if you like it, make a contribution to the work that Berkshire and French have set out to do.You can catch my full-on pitch right here. 

This is a great podcast to share; it's clear and understandable and fair and even people who haven't been closely following the issues will still see clearly what is going on. Take a listen, then share it with a friend.



USED: King's Big Fail

It took Danny Harris's collapse to draw many people's attention. We should have been paying attention sooner.

Harris is the Chief Information Officer for the Department of Education. Prior to taking on that job in 2008, he was with the department's CFO office. He is a government lifer. And he was in front of the House Committee on Oversight and Government Reform because the US Department of Education is a big fat cyber-mess.

By late last year, in the wake of the huge security breach at Office of Personnel Management computers, Congress was checking the locks on the doors all around the federal government. And the Department of Education was spectacularly lousy. The Inspector General reported that her office found they could hack their way into USED systems with no particularly great effort. The department's data includes at least 139 million different social security numbers (so, almost half the US population), along with oversight of a trillion dollars.

Congress worked Harris like a chew toy back in November, at which time he did himself no favors by giving his department a 7 out of 10 when everyone else was giving the department F's and D's. So his recent collapse-inducing appearance in front of the House committee is the latest in a series.

The House Oversight Committee is headed by Jason Chaffetz. Chaffetz is an interesting story in his own right. The Utah Representative arrived at Brigham Young as a Jewish Democrat and left as a Mormon Republican. He earned early attention as one of the legislators who slept on a cot in his office rather than renting pricey DC digs. He's the guy who barely let the head of Planned Parenthood get a word in edgewise and ginned up the misleading cancer care vs. abortions chart. He's taken on the Secret Service, and he's also the guy who threatened to have US Marshalls hunt down Flint emergency manager Darnell Earley and drag him before Congress. And he's the guy leading the attempted interrogation of that odious pharma-troll Martin Shkreli this week. All in all, it seems safe to say that Chaffetz isn't afraid of a little tussle, though he is noted by many as a Representative who can play well bipartisanly, particularly within his committee.

All of this bode poorly for the Department of Ed in general and Danny Harris in particular when Chaffetz decided that Harris was the problem, both in terms of managerial skills and professional ethics. This last hearing was an odd mish-mosh of continued grilling about cyber-security, the ethical problems of Harris running a side business, and rigged awarding of department contracts to Harris's friend. Outside vendors are an issue for USED-- of the 184 data systems they manage, 120 are actually run by contracted vendors.

Acting Pretend Secretary of Education John King had to put in an appearance and while it has been chronicled in many press accounts, nothing captures just how painful it is to watch King fumble and stonewall. One clip that is making the rounds starts with Harris's attempt to explain that although he was the program manager, he didn't lead the project-- so he was in charge, but not in charge, when his friend landed a contract.

Then he moves on to King. Chaffetz has laid out the contract irregularities, and by this point in proceedings, Harris has admitted that he failed to properly report the income from his side business to either the department or the IRS. Chaffetz will now try to get King to say that Harris's behavior was unethical and illegal (the full video is posted below, if you think you can stand it-- this starts at about the 3:15 mark).

Chaffetz: So Mr. King, how is that not a violation of regulation, policy or the law? He admitted that he had outside income above the two hundred dollar threshold and he did not report it either to the IRS nor on the ethics form. How is that not a violation of law, regulation or policy?

King: As you know the general council's role is to review-- our chief career ethics officer, her job is to review the findings from the inspector general and to determine whether or not there has been a violation of law or regulation or policy. General counsel advised--

Chaffetz: But you're asked to review that. You're the one that's supposed to look at that. You're not just supposed to read and say "Hey, that's what they say" and you still to this day believe that Mister Harris has done nothing wrong?

King: A-As I indicated previously, general counsel may--

Chaffetz: No, I want to know what you believe. All this evidence we've thrown out there, you still believe that there is nothing he's done wrong?

King: My responsibility is to rely on the guidance--

Chaffetz: No, your responsibility is to make a judgment--

King: to review the evidence--

Chaffetz: You're hired for your judgment. You're the acting secretary--

King: And based on the recommendation of the general counsel, based on the review that was conducted Deputy Secretary Miller when these incidents first occurred, Deputy Secretary Shelton, after further review of the inspector general's report, after review of the addendum which indicated that the Department of Justice declined further action, based on all those recommendations and the recommendations of our staff, yes, I believe that the department's actions in this case have been appro--

Chaffetz: I asked you if you believed that he had done anything wrong. To this day, do you believe he's done anything wrong?

King: I believe there were significant lapses of judgment. Counsel--

Chaffetz: To your mind is that doing something wrong?

King: Those significant lapses of judgment-- I counseled him on those and they ended by 2013.

Chaffetz: Is it a violation of policy or regulation or law to have outside income and not disclose.

King: The specific determination of whether--

Chaffetz: No no no no no--

King: evidence--

Chaffetz: Mr. King. With all due respect. You're a smart guy. You're in this position for a reason. I'm asking you, is it appropriate, because everybody at the Department of Education is watching you and what you're doing and there's a reason why you're scoring near the bottom of the heap, bottom ten percent of everybody in government. Every single key metric we look at is going down and it's your leadership that's on the line. I'm asking you is it appropriate, is it a violation of law or regulation or policy to have outside income purposely not disclose it?

King: Based on the recommendation of (our) general counsel I do not believe that there was a violation of law, regulation or policy--

Chaffetz: He admitted that he didn't do it-- he admitted that he didn't do it. You don't think that's--

That's eight times that Chaffetz tries to get an answer pried out of King. On the last attempt, King gets around to trying to defend his department about the charges of sucking at cyber security. Chaffetz will try once more at least to get King to say something like, "Yes, what he did was wrong." But he will try in vain. King will steadfastly assert that the general counsel said this was fine and somebody wrote out this cool talking point that he will hold onto like life itself.

Now, I think it's worth looking at this because I don't just see a guy who is stonewalling to protect one of his career bureaucrats. King here is a guy who clearly thinks that exercising judgment is not part of his job.

That's worth noting. We've seen all along that reformsters envision a world where classroom teachers exercise no personal or professional judgment, but simply follow procedures and structures handed down from faceless authorities. But watching King here, I'm realizing that it's not just a vision of how a classroom should work, but how the whole world should work. As long as your oversight policies don't set off alarms, as long as the program says you're okay, there is no responsibility or even need to look at something and say, based on your own human experience and judgment, "This is wrong."

As long as the bureaucracy is functioning in its bureaucratic way, no actual human thought or judgment, neither moral, ethical, professional or personal-- none of it is either needed or desired. That would seem to be Chaffetz's point-- in a department where nobody wants to talk about right and wrong, it is predictable that all sorts of things would come off the rails.

It's clear that King didn't singlehandedly create this mess (Arne Duncan supposedly only met with Harris about security issues once a month). It's equally clear that King is not the man to clean it up. And it is clearest of all that the Department is a drifting ship loaded with valuable cargo that it has no idea of how to protect.






Thursday, February 4, 2016

Robert Marzano Takes on Edublogger

Emily Talmage has been working hard for Maine schools. She is a tireless citizen journalist who has dug and dug and dug some more to uncover some of the ugly roots that Competency Based Education has put down across the country, with those roots running deep in her own state (the decision by somebody, somewhere, to roll out the new CBE in Maine, a quiet little state with a big loud governor, must be an interesting story of its own).

At any rate, if you are not a regular reader of Saving Maine Schools just because you don't live in Maine, don't let that stop you. It should be on your don't-miss list.

Apparently, as we've learned over the last week, one reader is not a fan. Here's the story.

Last Saturday, Talmage took aim at Robert Marzano. Marzano has been at the reformster business for over two decades, hopping on the educonsultant train back in the early nineties when Outcome Based Education first reared its unattractive visage, and he's been at it ever since, with a stew of semi-researched recommendations for school reform, teacher observation, and instructiony ideas.

As an early acolyte of OBE, Marzano must be enjoying seeing his ship come in again. He was apparently not so happy when Talmage stood on the dock and told everyone else a few things about Marzano.

Reaction to her post was immediate and loud-- in twenty years, Marzano has given many, many working educators reason to make a "yuck" face when they hear his name. But that batch of responses brought in news from Detroit that the beleagured and supposedly money-starved district just spent $6 million dollars on Marzano's consulting company. Talmage wrote about that, too.  

Six million freakin' dollars in a spectacularly crumbling school district. Do you know what a district could do with six million dollars?

It was about that time that Talmage noticed two things-- the appearance of an Ohio investigation firms ip in her visitor's list, and much more noticeable, an e-mail threat from Marzano himself. 

I assume you know that while you may state your opinions quite freely, false statements about people that are damaging to their reputation are considered slander. In the blog post I read you have a number of such statements about me. 

Marzano took exception to two assertions in Talmage's posts-- first, that he had never taught in a classroom, and second, the whole six million dollar contract thing.

On point one, Talmage learned that she was in error, though it appears she had to do a great deal of digging on her own to confirm that he had indeed taught, though, well-- she found a document where he listed himself as an "English teacher" in "New York City Schools" in 1967-68,-- he graduated from college in 1968, so I'm not sure how that works. After that he spent two years as English Department Chair in a Seattle private school.

On point two, Talmage asked for and received copies of the contract from the reporter whose FOIA request broke the story. The $6 million company is Learning Sciences International which holds the copyright to some of Marzano's delightful teacher stuff, but which is not technically his company-- they give him money, but he doesn't have to work there.

You can read all of this in greater detail on Talmage's blog. I'm not usually one to do what is essentially a repost of other people's stuff, but this is a story that deserves to spread. Plus I'm just impressed by any blogger who can pull an actual threat from a rich and famous reformster.

I asked her how it felt.

A little scary, but exciting too... If he weren't at least a little concerned, I don't think he would have taken the time to respond ... These big shots need to realize that we are on to them.

I also felt a little sorry for him... I honestly think his companies are getting so many contracts right now that he probably didn't realize Detroit was spending so much on his professional development program ... I wonder if it was a little embarrassing for him to have a teacher point it out?

That sounds about right. It's good to know that they are paying attention, they are hearing us, and they can't just sail on thinking that nobody notices or cares what they're up to. Hats off to Talmage for making Marzano take notice.