This week you may have caught this report that ran in the Columbus Dispatch and the Washington Post and the Detroit Free Press, to name a few. Turns out there's a study that shows that online charter school students learn far less than their bricks-and-mortar counterparts.
Check out this mind-boggling statistic:
Nationally, online charter students received on average 180 fewer days of learning in math and 72 fewer days in reading during a typical 180-day school year. In Ohio, with the largest e-school enrollment, students lost 144 days of math and 79 days of reading.
180 days fewer than 180 would seem to equal, well, zero. So on average, the study suggests that studying math in cyber-school is no more productive than 180 days of watching Dr. Phil. And 180 days is an average-- which means that some cyberschools actually move students backwards during the year, I guess. ("Students, in today's lesson, we'll be forcing you to forget everything you know about the quadratic equation.")
These are stunning results, even worse than some of the mean things that I have had to say about cyber charters (and I've said some mean things about the bloodsucking cyberschool vampires that have been allowed to lay waste to much of Pennsylvania's educational landscape).
Who would go after cyber charters with such verve?
Well, let's check the pull quotes. From the Washington Post:
Nina Rees, president and CEO of the National Alliance for Public Charter Schools, said her group was “disheartened to learn of the large-scale underperformance of full-time virtual charter public schools. While we know that this model works for some students, the CREDO report shows that too many students aren’t succeeding in a full-time online environment.”
From the Detroit Free Press:
Greg Richmond, president and CEO of the National Association of Charter School Authorizers, said in a statement that the results are "deeply troubling."
"There is a place for virtual schooling in our nation, but there is no place for results like these," he said.
And from the Dispatch
“In Ohio and across the United States, students attending virtual charter schools simply are not learning enough,” said Chad L. Aldis, vice president for Ohio policy and advocacy for the Thomas B. Fordham Institute, which sponsors 11 traditional charter schools.
“Proponents of school choice are increasingly hard-pressed to defend virtual charters when their academic gains fall so far below the traditional schools against which they are compared.”
Yes, three top charter-loving outfits, all lined up to stick it to the cybers based on the results of this study conducted by-- wait for it-- CREDO.
Yup. If you didn't read these reports carefully enough, you might have missed that the Center for Research on Education Outcomes at Stanford. This drubbing of cyber charters comes from the choice-favoring, charter-leaning folks at CREDO, and then has been enthusiastically endorsed by a brace of charter advocates.
What's going on? A new epiphany about chartering? A willingness to confront hard truths? Opposite day?
I don't know. But I can guess. Let's see.... besides advocating for choice and charters, what else does Fordham do in Ohio? That's right--they run bricks and mortar charters.
One aspect of the zero-sum charter-choice landscape has always been predictable. At some point, the charter operators will have to fight each other for those sweet slices of that finite school funding pie. The lofty picture of "competition" has always been neat and bloodless, noble charter operators simply pursuing excellence in hopes that if they built a better math trap, the students would beat a path to their school.
But of course that's not always how competition works. Some times you get out the long knives and start trying to carve up competitors. Because until we fix the stupid, stupid funding system we've got now, more for me must always mean less for you.
So, yes-- charter operators will call for reforms (like say, a New York law that only schools with "success" in the name can be authorized, or an Ohio law that allows payments only for schools that have car manufacturers' names and pork products in their organization title). It was only a matter of time before they started promoting research that proved that some charters are Bad. So they shake their heads, cluck their tongues, and express sadness that Those Terrible Charters are taking attention away from Our Awesome Charters (accepting applications for next year's class soon).
Do I think cyber charters are often dreadful? Sure. But call me a little cynical if I see a bit of self-serving cynicism in the charter community's announcement that they are shocked-- shocked!!-- at some of the awful shenanigans going on. But only Over There.
Friday, October 30, 2015
Thursday, October 29, 2015
The Only Good Standardized Test
As testing has risen once again to the surface of the ed policy soup, I have found myself in versions of the same conversation, because people who like the idea of standardized testing really like the idea of standardized testing, and because I said the number of necessary standardized tests is zero.
data from tests are the life blood of education and he took exception with my exception. Someone in the comments called me a "union shill." And a reporter asked me what the alternative to standardized testing would be.
It's a fair question. Is there such a thing as a useful standardized test?
But First a Few Words about Opposition
To have this conversation, we have to get one thing out of the way first. If you believe (and I think some reformsters sincerely believe it) that the only reason that teachers oppose the current high stakes test-and-punish status quo is because their self-serving union tells them to, you are blinding yourself to some real issues. First, there is a real gulf between national union leadership and rank and file teachers precisely because union opposition to reformster policies has been tepid at best. For the most part, NEA and AFT leadership is not whipping up opposition to ed reform policies-- they are trying to tamp it down.
The teacher opposition to testing comes first and foremost from teachers who are watching testing become a toxic and destructive element in our classrooms. Testing doesn't just drive the bus, but it drives it straight toward a cliff. It gets in our way, interfering with our ability to deliver real education. It's detrimental to our students. It is educational malpractice. And on top of all that, it is used in many places to deliver a professional verdict on our schools and ourselves with an accuracy no greater than a roll of the dice.
The other opposition to testing comes from the other people who see how it plays out on the ground-- the parents. The Opt Out movement was not created by teachers, is not led by teachers and, in some places, is actually potentially damaging to teachers under the current bizarro test-driven accountability system.
So if you imagine that test opposition is some sort of political ploy engineered top-down by the unions, you are kidding yourself.
None of That Answers the Question, so Let's Get Back To It
If I am such a dedicated opponent of standardized testing, what do I propose as an acceptable substitute.
Before we go any further, we'd better clarify our rather fuzzy terms.
"Standardized" Test?
Come to think of it, we'd better clarify "test" as well. For many folks, it's only a "test" if the student is answering questions. A five page paper assignment, for instance, is usually not called a test. In fact, the more open-ended the assessment, the less likely folks are to call it a "test." In schools, a test (students must prove they know something) is different from tests anywhere else (e.g. if we test the water, it is not up to the water to prove anything, but it is up to the tester to find a way to measure the nature of the water). Requiring students to prove themselves is the very first step in developing a bad assessment.
"Standardized" when applied to a test can mean any or all (well, most) of the following: mass-produced, mass-administered, simultaneously mass-administered, objective, created by a third party, scored by a third party, reported to a third party, formative, summative, norm-referenced or criterion referenced.
This broad palate of definitions means that conversations about standardized testing often run at cross-purposes. When Binis talks about the new performance assessment task piloting in NH, she thinks she's making a case for standardization, and I'm think that performance based assessment is pretty much the opposite of standardized testing. There's a lot of this happening in the testing debates-- people arguing unproductively because they have very different things in mind.
Acceptable Substitute for What Purpose
The confusion is further exacerbated by a myriad of stated and unstated purposes for standardized testing. This confusion about purpose has emerged as a huge issue in the ed debates because far too many of the amateurs designing testing policy don't understand this at all. At. All.
It's not just that reformsters argue that you can make the pig gain weight by measuring it. It's that they also assert that the scales used for weighing the pig can also be used to measure the voltage of your house's electrical system and the rate of water flow in the Upper Mississippi.
If we want to find an acceptable test, we have to first declare what the test is going to be used for.
Ranking schools, students and teachers
This is where purpose becomes important, because I can't think of a good test for achieving these goals because I don't think these goals are worth achieving. As a teacher, I don't need to know how my student compares to students in Idaho. I don't need to know that as a parent, either.
Comparing teachers to other teachers, schools to other schools, students to other students-- it's a fool's game. First of all, I can only make the comparison based on a narrowly defined criteria. Otherwise I'm reduced to deciding if my insensitive smart flabby artist student ranks lower or higher than my sensitive tall winning cross country racer student. The comparison only has meaning if it is based on narrow criteria (which student answered the most math problems correctly on Tuesday)-- but what good is a narrowly defined comparison.
If I find that my smart, funny wife is not as smart and funny as some other woman, should I be unhappy in my marriage? If this delicious steak is not as delicious as the steak I had last night, should I spit it out? If all the teachers in my school are great, should it be closed down because some other school has greater ones?
The signature feature of a ranking system is that it locates losers. But what decent teacher would stand in front of a class of thirty on the first day of school and say, "Five of you will turn out to be losers." Testy science wonks like Binis would scold me for saying "loser" and argue for something less loaded and more clinical, but I'm working with students and all the sugar coating in the world will not hide the medicine in this model.
Ranking and rating means that even if everyone is excellent, the least excellent must be marked Below Basic or Underperforming or Just Not Good Enough. A system based on ranking and rating is a system that assumes that in every endeavor, there are people who just aren't good enough. I reject that view of the world, and so I reject any testing system designed to re-inforce that view. If everybody in my classroom does a great job, everybody in my classroom gets an A.
Providing feedback for parents
Here we have a standardization problem because not all parents want the same feedback. Is she getting an A? Is she passing? Is she developing a better grasp of abstract language particularly as used in classic literature? Is she okay? Does she seem happy? These are all types of feedback I've been asked for by some parents. What one measuring tool would satisfy all those questions?
Standardized testing is repeatedly sold with the myth of the clueless parents, the parents who have no idea how their students are doing. But the solution to this problem is transparency, the levels of which can be controlled by the parents.
For example, the electronic gradebook. Our parents can look up their students any time and see exactly what I see when I pull up the gradebook. Some of my parents look every day. Some look never. Some look and then call or email me to ask, "So what exactly was this one assignment."
When we control the available information, we do parents a disservice. Only revealing the grade at report card time is a disservice. But anyone who has taught at a school with big detailed portfolio gradeless systems can tell the story of the parent who looked at all that data and said, "Look, can you just tell me what grade she's getting?"
Parents deserve just as much feedback as they want. Standardized testing has nothing to do with providing that.
Feedback for teachers
Any decent teacher generates this kind of data daily. Any lousy teacher will have no use for standardized test data even if it arrives on gold-clothed ponies.
You are dodging the question
Okay, yeah. I've laid out my usual assortment of objections to standardized testing, but I still haven't said what would be an acceptable substitute. If you're still here, I'll try to address that now.
What qualities would an acceptable-to-me standardized test have?
If I ever were to find a standardized test that I could live with (or even date regularly), this is what it would look like.
Criterion-based (and so, objective)
If I'm going to measure my students against a standard, not against each other. I can use the test to answer the question, "Do my students know how to find verbs" or "Can my students identify dependent clauses?" If every student in my class can't potentially get a top score, I'm not interested. And if it's not objectively scoreable, it's no help. That means that no standardized test is going to be used for any higher order critical thinking type skills.
(This is part of the whole point of Depth of Knowledge testing love--it creates the illusion that higher order stuff can be scored objectively. But no, it can't).
It is possible to come up with standardized questions. I once had a textbook with great literature questions-- but I still had to evaluate the answers myself.
In fact, I can only see using a standardized test for checking the lowest levels of simple operations-- simple recall, basic application.
As Close to Authentic as Possible
I want a task that actually assesses what it claims to assess. Multiple choice questions don't assess writing skills. Click-and-drag questions don't assess critical thinking.
Transparent
This ought to go without saying, but if I don't get to see the questions, the answers, and the exact results from my students, then, no, thank you. I can do better myself.
Adaptable
I rarely re-use my own test-like assessments; instead, I make new ones each year to fit the class and the instruction. Particularly when I'm working summative assessments, I'll create something that focuses on the issues that we're struggling with. For instance, if we're solid on spotting infinitive phrases but have trouble picking out gerunds used as direct objects, I can design a test that will help both me and my students. I can adjust assessment to build confidence or prompt a come-to-Jesus moment.
Expertise and Convenience
There are lots of things I don't know. Materials prepared by people who are experts in particular areas are a necessary aid, and those sometimes include assessments. I'm happy to have an expert in a particular field in my classroom.
And at some points, I can use the convenience of having something pre-built to save me some time.
So, the acceptable alternative...?
Man, this ended up far longer than I meant it to, but I wanted to seriously examine my thoughts about this. Do I really think that there are no necessary standardized tests?
Well, Binis is correct when she argues that we all use standardization because we don't completely individualize everything from assessment through evaluation-- but that's a hugely broad definition of "standardized."(She disagrees with my reading of her "ever do this..." list.)
By that standard (har) everything used with two or more students is a standardized test-- and maybe it's useful to think of standardization as a sliding scale. The more we broaden the reach of the assessment, the more students we try to make it each, and the more we try to make the grading of the test be quick and uniform, the less useful the assessment becomes. A test that you can give to every student in America and which can be scored in just a week will by necessity be inauthentic and measure little. So for best classroom assessment, we stay as close to the individualized specifics end as we possibly can. The more that an assessment is developed in response to specific instruction by a specific teacher of specific students, the more useful that assessment will be in performing the most useful function of any test-- telling students and teachers where their strengths and weaknesses lie.
Yes, that information is not what the policymakers would really like to have. But the information they would like to have is completely useless to me in the classroom (and so far, they've found no reliable method for either collecting or using such information anyway). I'm not convinced that information can be collected by standardized tests anyway, but Good lord in Heaven am I still typing???
The number of necessary standardized tests, the number of tests I really need in my classroom? I still say zero. Mind you, I'm not saying that all standardized tests are an evil plague, and stripped of baseless high-stakes consequences, their plaguiness is greatly reduced. There are standardized tools that are tolerable, and a few that might rise to the level of useful. But necessary? Needed?
Still zero.
data from tests are the life blood of education and he took exception with my exception. Someone in the comments called me a "union shill." And a reporter asked me what the alternative to standardized testing would be.
It's a fair question. Is there such a thing as a useful standardized test?
But First a Few Words about Opposition
To have this conversation, we have to get one thing out of the way first. If you believe (and I think some reformsters sincerely believe it) that the only reason that teachers oppose the current high stakes test-and-punish status quo is because their self-serving union tells them to, you are blinding yourself to some real issues. First, there is a real gulf between national union leadership and rank and file teachers precisely because union opposition to reformster policies has been tepid at best. For the most part, NEA and AFT leadership is not whipping up opposition to ed reform policies-- they are trying to tamp it down.
The teacher opposition to testing comes first and foremost from teachers who are watching testing become a toxic and destructive element in our classrooms. Testing doesn't just drive the bus, but it drives it straight toward a cliff. It gets in our way, interfering with our ability to deliver real education. It's detrimental to our students. It is educational malpractice. And on top of all that, it is used in many places to deliver a professional verdict on our schools and ourselves with an accuracy no greater than a roll of the dice.
The other opposition to testing comes from the other people who see how it plays out on the ground-- the parents. The Opt Out movement was not created by teachers, is not led by teachers and, in some places, is actually potentially damaging to teachers under the current bizarro test-driven accountability system.
So if you imagine that test opposition is some sort of political ploy engineered top-down by the unions, you are kidding yourself.
None of That Answers the Question, so Let's Get Back To It
If I am such a dedicated opponent of standardized testing, what do I propose as an acceptable substitute.
Before we go any further, we'd better clarify our rather fuzzy terms.
"Standardized" Test?
Come to think of it, we'd better clarify "test" as well. For many folks, it's only a "test" if the student is answering questions. A five page paper assignment, for instance, is usually not called a test. In fact, the more open-ended the assessment, the less likely folks are to call it a "test." In schools, a test (students must prove they know something) is different from tests anywhere else (e.g. if we test the water, it is not up to the water to prove anything, but it is up to the tester to find a way to measure the nature of the water). Requiring students to prove themselves is the very first step in developing a bad assessment.
"Standardized" when applied to a test can mean any or all (well, most) of the following: mass-produced, mass-administered, simultaneously mass-administered, objective, created by a third party, scored by a third party, reported to a third party, formative, summative, norm-referenced or criterion referenced.
This broad palate of definitions means that conversations about standardized testing often run at cross-purposes. When Binis talks about the new performance assessment task piloting in NH, she thinks she's making a case for standardization, and I'm think that performance based assessment is pretty much the opposite of standardized testing. There's a lot of this happening in the testing debates-- people arguing unproductively because they have very different things in mind.
Acceptable Substitute for What Purpose
The confusion is further exacerbated by a myriad of stated and unstated purposes for standardized testing. This confusion about purpose has emerged as a huge issue in the ed debates because far too many of the amateurs designing testing policy don't understand this at all. At. All.
It's not just that reformsters argue that you can make the pig gain weight by measuring it. It's that they also assert that the scales used for weighing the pig can also be used to measure the voltage of your house's electrical system and the rate of water flow in the Upper Mississippi.
If we want to find an acceptable test, we have to first declare what the test is going to be used for.
Ranking schools, students and teachers
This is where purpose becomes important, because I can't think of a good test for achieving these goals because I don't think these goals are worth achieving. As a teacher, I don't need to know how my student compares to students in Idaho. I don't need to know that as a parent, either.
Comparing teachers to other teachers, schools to other schools, students to other students-- it's a fool's game. First of all, I can only make the comparison based on a narrowly defined criteria. Otherwise I'm reduced to deciding if my insensitive smart flabby artist student ranks lower or higher than my sensitive tall winning cross country racer student. The comparison only has meaning if it is based on narrow criteria (which student answered the most math problems correctly on Tuesday)-- but what good is a narrowly defined comparison.
If I find that my smart, funny wife is not as smart and funny as some other woman, should I be unhappy in my marriage? If this delicious steak is not as delicious as the steak I had last night, should I spit it out? If all the teachers in my school are great, should it be closed down because some other school has greater ones?
The signature feature of a ranking system is that it locates losers. But what decent teacher would stand in front of a class of thirty on the first day of school and say, "Five of you will turn out to be losers." Testy science wonks like Binis would scold me for saying "loser" and argue for something less loaded and more clinical, but I'm working with students and all the sugar coating in the world will not hide the medicine in this model.
Ranking and rating means that even if everyone is excellent, the least excellent must be marked Below Basic or Underperforming or Just Not Good Enough. A system based on ranking and rating is a system that assumes that in every endeavor, there are people who just aren't good enough. I reject that view of the world, and so I reject any testing system designed to re-inforce that view. If everybody in my classroom does a great job, everybody in my classroom gets an A.
Providing feedback for parents
Here we have a standardization problem because not all parents want the same feedback. Is she getting an A? Is she passing? Is she developing a better grasp of abstract language particularly as used in classic literature? Is she okay? Does she seem happy? These are all types of feedback I've been asked for by some parents. What one measuring tool would satisfy all those questions?
Standardized testing is repeatedly sold with the myth of the clueless parents, the parents who have no idea how their students are doing. But the solution to this problem is transparency, the levels of which can be controlled by the parents.
For example, the electronic gradebook. Our parents can look up their students any time and see exactly what I see when I pull up the gradebook. Some of my parents look every day. Some look never. Some look and then call or email me to ask, "So what exactly was this one assignment."
When we control the available information, we do parents a disservice. Only revealing the grade at report card time is a disservice. But anyone who has taught at a school with big detailed portfolio gradeless systems can tell the story of the parent who looked at all that data and said, "Look, can you just tell me what grade she's getting?"
Parents deserve just as much feedback as they want. Standardized testing has nothing to do with providing that.
Feedback for teachers
Any decent teacher generates this kind of data daily. Any lousy teacher will have no use for standardized test data even if it arrives on gold-clothed ponies.
You are dodging the question
Okay, yeah. I've laid out my usual assortment of objections to standardized testing, but I still haven't said what would be an acceptable substitute. If you're still here, I'll try to address that now.
What qualities would an acceptable-to-me standardized test have?
If I ever were to find a standardized test that I could live with (or even date regularly), this is what it would look like.
Criterion-based (and so, objective)
If I'm going to measure my students against a standard, not against each other. I can use the test to answer the question, "Do my students know how to find verbs" or "Can my students identify dependent clauses?" If every student in my class can't potentially get a top score, I'm not interested. And if it's not objectively scoreable, it's no help. That means that no standardized test is going to be used for any higher order critical thinking type skills.
(This is part of the whole point of Depth of Knowledge testing love--it creates the illusion that higher order stuff can be scored objectively. But no, it can't).
It is possible to come up with standardized questions. I once had a textbook with great literature questions-- but I still had to evaluate the answers myself.
In fact, I can only see using a standardized test for checking the lowest levels of simple operations-- simple recall, basic application.
As Close to Authentic as Possible
I want a task that actually assesses what it claims to assess. Multiple choice questions don't assess writing skills. Click-and-drag questions don't assess critical thinking.
Transparent
This ought to go without saying, but if I don't get to see the questions, the answers, and the exact results from my students, then, no, thank you. I can do better myself.
Adaptable
I rarely re-use my own test-like assessments; instead, I make new ones each year to fit the class and the instruction. Particularly when I'm working summative assessments, I'll create something that focuses on the issues that we're struggling with. For instance, if we're solid on spotting infinitive phrases but have trouble picking out gerunds used as direct objects, I can design a test that will help both me and my students. I can adjust assessment to build confidence or prompt a come-to-Jesus moment.
Expertise and Convenience
There are lots of things I don't know. Materials prepared by people who are experts in particular areas are a necessary aid, and those sometimes include assessments. I'm happy to have an expert in a particular field in my classroom.
And at some points, I can use the convenience of having something pre-built to save me some time.
So, the acceptable alternative...?
Man, this ended up far longer than I meant it to, but I wanted to seriously examine my thoughts about this. Do I really think that there are no necessary standardized tests?
Well, Binis is correct when she argues that we all use standardization because we don't completely individualize everything from assessment through evaluation-- but that's a hugely broad definition of "standardized."(She disagrees with my reading of her "ever do this..." list.)
By that standard (har) everything used with two or more students is a standardized test-- and maybe it's useful to think of standardization as a sliding scale. The more we broaden the reach of the assessment, the more students we try to make it each, and the more we try to make the grading of the test be quick and uniform, the less useful the assessment becomes. A test that you can give to every student in America and which can be scored in just a week will by necessity be inauthentic and measure little. So for best classroom assessment, we stay as close to the individualized specifics end as we possibly can. The more that an assessment is developed in response to specific instruction by a specific teacher of specific students, the more useful that assessment will be in performing the most useful function of any test-- telling students and teachers where their strengths and weaknesses lie.
Yes, that information is not what the policymakers would really like to have. But the information they would like to have is completely useless to me in the classroom (and so far, they've found no reliable method for either collecting or using such information anyway). I'm not convinced that information can be collected by standardized tests anyway, but Good lord in Heaven am I still typing???
The number of necessary standardized tests, the number of tests I really need in my classroom? I still say zero. Mind you, I'm not saying that all standardized tests are an evil plague, and stripped of baseless high-stakes consequences, their plaguiness is greatly reduced. There are standardized tools that are tolerable, and a few that might rise to the level of useful. But necessary? Needed?
Still zero.
StudentsFirst Weak Core Endorsement
Andy Cuomo's Common Core Task Force is supposed to be busily working today to come up with a new name for the Common Core to carefully examine and consider educational modifications to the Core because it's politically expedient to do so because it's politically expedient to do so.
StudentsFirst NY was only too happy to get involved with a forum sponsored by High Achievement New York, a coalition that asks the question, "If you rub a whole bunch of astroturf together, can you light a fire under New York politicians?" Today they're reporting the testimony of four parents, and it's a sign of how weak the pro-Core argument has become. I'm not going to list the parent names, though SFNY does. I just want to concentrate on the actual argument being pushed here.
Parent #1
Parent #1 has a third grade student who will be taking his first CCSS-aligned test in February. And he has a story to tell.
StudentsFirst NY was only too happy to get involved with a forum sponsored by High Achievement New York, a coalition that asks the question, "If you rub a whole bunch of astroturf together, can you light a fire under New York politicians?" Today they're reporting the testimony of four parents, and it's a sign of how weak the pro-Core argument has become. I'm not going to list the parent names, though SFNY does. I just want to concentrate on the actual argument being pushed here.
Parent #1
Parent #1 has a third grade student who will be taking his first CCSS-aligned test in February. And he has a story to tell.
In the past, I had no way of really knowing if he was making the grade. Last year, he fell behind academically and the only way I found out was after I asked his teacher at a parent teacher conference. I don’t understand why they didn’t let me know he needed extra help.
Let me be clear-- this is a real problem, and Parent #1 has every reason to be upset. However, the Core and and Core-aligned tests are not a solution.
The Common Core will make sure my son is on track. I’ll have a way to make sure he’s making the grade – and his teachers will be able to show me clearly what he needs to work on.
What way to make sure he's on track? The CCSS-aligned test? The one he's taking in February??? Because otherwise I'm not clear on how the Core makes the teacher more transparent and communicative about the student's progress (or lack thereof).
Parent #2
This parent's child is in sixth grade.
I was lucky enough to grow up in a school environment where my parents and teachers could track my progress. I want my child to have that same opportunity.
Excellent! Did you grow up with Common Core in your school? No? Then let's talk about how to install that excellent system and environment that you grew up with, because there's no reason to think that it had anything to do with CCSS.
I am sick and tired of hearing that every child doesn't deserve high standards.
And yet I don't think I've ever heard anybody say it ever, at all, even once.
Parent #3
Two daughters who have both taken Core-aligned tests, and boy were they hard, but now the girls are proud of having "made it through." This parent asserts that the daughters "are getting a better education now because of the Common Core." No indication of how, exactly. The Core is a critical tool for teachers, somehow, and it is "critical for parent to hold the system accountable." Again, not clear how that works, exactly, or more importantly, why one needs Common Core to do it..
Parent #4
Fourth grade son. And this parent loves the Core a lot.
I believe that all parents should be able to track their children’s progress – and that’s exactly what the Common Core does
Because of one aligned test a year? That may seem bizarre, but next up is this false equivalency built of straw.
There are some parents who don’t want their kids to take the annual tests. I just don’t understand why they don’t want to know if their kids are learning what they need to learn. Burying your head in the sand may make you feel better, but it’s not going to help your child learn the skills he needs to be successful.
Not such a mystery. I'm going to bet those parents figure that the Big Standardized Test does not actually tell them whether their kids are learning. They might even suspect that there's no reason to believe that the Common Core is an actual list of what students need to learn.
And that's it
Let me point out, for the record, that when Core advocates complain that folks conflate the Core Standards and the Big Standardized Tests, this is the sort of piece they should be looking at-- all four parents draw no distinction at all between the standards and the tests and treat them as part of the same swell Corey creature. Which is as it was always designed-- I'm just saying that Core fans need to stop asking, "Where did people get such an idea? The standards and the tests are totally different things!"
Beyond that, this weak sauce is a reduction of the classic reformster stew of real problems and fake solutions. Every one of these parents is concerned about something worth being concerned about, and every one of them puts in a plug for a solution that is not a solution.
If you are really concerned about getting lots of useful feedback about your child's progress, call your child's teacher. If your child's teacher is not forthcoming, that's a problem, and you should raise a ruckus. But no matter what, a once-a-year BS Tests that tests only for narrow areas of math and English will not address your concern about useful feedback. Agitate for a transparent system-- heck, the technology is already in existence and in use to make a teacher's electronic gradebook available for student and parent view. My students and their parents can see exactly where they stand every single day, and if more detailed explanation is needed, I am only a phone call or email away. Compared to the dark ages when I went to school, we live in an age of unparalleled transparency and availability of school information.
The advocacy here is representative of the current state of the Core itself-- weak, vague, and confused. The problems listed are real, legitimate concerns, but there isn't one of them that isn't better addressed by something other than the Common Core. If this is what StudentsFirst has mustered to fight off their own reformy buddies in Albany, then the Common Core brand is in big trouble in New York.
Parent #4
Fourth grade son. And this parent loves the Core a lot.
I believe that all parents should be able to track their children’s progress – and that’s exactly what the Common Core does
Because of one aligned test a year? That may seem bizarre, but next up is this false equivalency built of straw.
There are some parents who don’t want their kids to take the annual tests. I just don’t understand why they don’t want to know if their kids are learning what they need to learn. Burying your head in the sand may make you feel better, but it’s not going to help your child learn the skills he needs to be successful.
Not such a mystery. I'm going to bet those parents figure that the Big Standardized Test does not actually tell them whether their kids are learning. They might even suspect that there's no reason to believe that the Common Core is an actual list of what students need to learn.
And that's it
Let me point out, for the record, that when Core advocates complain that folks conflate the Core Standards and the Big Standardized Tests, this is the sort of piece they should be looking at-- all four parents draw no distinction at all between the standards and the tests and treat them as part of the same swell Corey creature. Which is as it was always designed-- I'm just saying that Core fans need to stop asking, "Where did people get such an idea? The standards and the tests are totally different things!"
Beyond that, this weak sauce is a reduction of the classic reformster stew of real problems and fake solutions. Every one of these parents is concerned about something worth being concerned about, and every one of them puts in a plug for a solution that is not a solution.
If you are really concerned about getting lots of useful feedback about your child's progress, call your child's teacher. If your child's teacher is not forthcoming, that's a problem, and you should raise a ruckus. But no matter what, a once-a-year BS Tests that tests only for narrow areas of math and English will not address your concern about useful feedback. Agitate for a transparent system-- heck, the technology is already in existence and in use to make a teacher's electronic gradebook available for student and parent view. My students and their parents can see exactly where they stand every single day, and if more detailed explanation is needed, I am only a phone call or email away. Compared to the dark ages when I went to school, we live in an age of unparalleled transparency and availability of school information.
The advocacy here is representative of the current state of the Core itself-- weak, vague, and confused. The problems listed are real, legitimate concerns, but there isn't one of them that isn't better addressed by something other than the Common Core. If this is what StudentsFirst has mustered to fight off their own reformy buddies in Albany, then the Common Core brand is in big trouble in New York.
Wednesday, October 28, 2015
NAEP: Further Evidence of Reformy Failure
Mike Petrilli of the Fordham Institute has gone so far as to call the new NAEP scores "heartbreak." The scores on the Nation's Report Card are crappy, ranging from "barely stagnant" to "plunging."
Petrilli and other reformsters have started the business of finding an explanation for this tragic result (more about that in a moment), but while we are thinking about what did make this happen, let's not lose sight of what didn't happen.
Test-driven accountability tied to national standards did not make NAEP scores rise.
Fifteen years of reformsterism has not moved the needle. Well, actually, that's not entirely true-- the NAEP trend has been ever upward since before the Reformster Era, so we could argue that ed reform actually stopped the needle from moving. So, worse than nothing.
But let's not quibble for the moment. The bottom line is still clear: reformsterism is failing. The reform programs, which are in fact our current status quo, are failing. And we all know what reformsters have been telling us, over and over and over again, about the status quo-- when it's not working, it must be changed.
Now, honestly, I'm not all that concerned about the Nation's Report Card. There are many reasons to suspect that the NAEP is not a reliable benchmark of student learning. But it was part of the rules that reformsters wanted to play by, so it's worth noting that by their own rules, reformsters have failed.
The most entertaining part of the failure is the discovery by reformsters that poverty matters!! Who knew? Oh, wait-- everybody except the reformsters, who could not stop themselves from repeatedly criticizing people who wanted to use poverty as an "excuse."
Kevin Welner at the National Education Policy Center has a great piece collecting many of the prominent reformster "NAEPscuses". "Look," they declare. "There are powerful forces outside of schools that have an effect on how students fare on Big Standardized Tests." I try not to use a lot of salty language here at the blog, but is there any better response than, "No, shit, Sherlock."
How much further will reformsters insist on driving us down this same failed road? How deep into the Big Muddy do we need to get before the Big Fool decides to turn around? How many versions of "maybe the critics had a point" do we have to hear before reformsters finally switch to, "we'd like to talk to teachers and professional educators before we finish developing this policy."
It is 2015, and none of the promised benefits of reformster policies have appeared. Colleges are not announcing, "Man, we are swamped with college and career ready freshmen." Charters are not learning brand new educational techniques that can be adopted by public schools. High stakes testing is not bringing social justice to every corner of the nation. Rich, standardy goodness is not ushering in an end to inequity.
And the NAEP scores are not going up.
It will be natural at this point for many classroom teachers to want to engage in a round of "I told you so." But that's really not the important thing. Instead, we need to ask some big questions. How many more education reform failures must we endure, wasting time and money and grinding teachers and schools down? How many more years will we keep pursuing these failed policies? How much longer will we drift helplessly in the wasted waters of a stagnant status quo?
High stakes standardized testing, national standards, and test-based accountability are wasting time, money, effort, and people, while providing not a glimmer of success in return. Let's be done, already.
Petrilli and other reformsters have started the business of finding an explanation for this tragic result (more about that in a moment), but while we are thinking about what did make this happen, let's not lose sight of what didn't happen.
Test-driven accountability tied to national standards did not make NAEP scores rise.
Fifteen years of reformsterism has not moved the needle. Well, actually, that's not entirely true-- the NAEP trend has been ever upward since before the Reformster Era, so we could argue that ed reform actually stopped the needle from moving. So, worse than nothing.
But let's not quibble for the moment. The bottom line is still clear: reformsterism is failing. The reform programs, which are in fact our current status quo, are failing. And we all know what reformsters have been telling us, over and over and over again, about the status quo-- when it's not working, it must be changed.
Now, honestly, I'm not all that concerned about the Nation's Report Card. There are many reasons to suspect that the NAEP is not a reliable benchmark of student learning. But it was part of the rules that reformsters wanted to play by, so it's worth noting that by their own rules, reformsters have failed.
The most entertaining part of the failure is the discovery by reformsters that poverty matters!! Who knew? Oh, wait-- everybody except the reformsters, who could not stop themselves from repeatedly criticizing people who wanted to use poverty as an "excuse."
Kevin Welner at the National Education Policy Center has a great piece collecting many of the prominent reformster "NAEPscuses". "Look," they declare. "There are powerful forces outside of schools that have an effect on how students fare on Big Standardized Tests." I try not to use a lot of salty language here at the blog, but is there any better response than, "No, shit, Sherlock."
How much further will reformsters insist on driving us down this same failed road? How deep into the Big Muddy do we need to get before the Big Fool decides to turn around? How many versions of "maybe the critics had a point" do we have to hear before reformsters finally switch to, "we'd like to talk to teachers and professional educators before we finish developing this policy."
It is 2015, and none of the promised benefits of reformster policies have appeared. Colleges are not announcing, "Man, we are swamped with college and career ready freshmen." Charters are not learning brand new educational techniques that can be adopted by public schools. High stakes testing is not bringing social justice to every corner of the nation. Rich, standardy goodness is not ushering in an end to inequity.
And the NAEP scores are not going up.
It will be natural at this point for many classroom teachers to want to engage in a round of "I told you so." But that's really not the important thing. Instead, we need to ask some big questions. How many more education reform failures must we endure, wasting time and money and grinding teachers and schools down? How many more years will we keep pursuing these failed policies? How much longer will we drift helplessly in the wasted waters of a stagnant status quo?
High stakes standardized testing, national standards, and test-based accountability are wasting time, money, effort, and people, while providing not a glimmer of success in return. Let's be done, already.
Tuesday, October 27, 2015
Cartman Rules
What is absolutely guaranteed to pop the wheels right off the school bus when it comes to order and atmosphere and culture and just plain treating children with the decency to which they are entitled because they are A) living human beings and B) here?
Cartman rules. (NSFW ahead)
Yeah, that's the whole point of a Cartman Rule. You will respect my authoritah. You will acknowledge that I am The Man. You will do whatever the hell I say because I AM the boss of you.
Is there anything more ridiculous, more silly, more counterproductive, more flat out disrespectful than getting in a grudge match with a child or young adult with absolutely no intent except to force them, through word or deed, to acknowledge that they respect your authority?
I wish it weren't true, but we've all seen it too many times within the walls of a school. The kid laughs with the wrong kind of smile. The kid responds to a direction with a shrug instead of quick compliance. The kid gives all the appearance of not giving a rat's rear about what he's just been told.
And the Enforcer of the Cartman Rule completely loses the thread. What were we trying to do? Were we trying to cover the instruction for today's lesson? Were we trying to get the class focused on a goal, or engaged with some practice? Never mind-- we're going to drop it all so that we can back this kid into a corner and browbeat him into submission.
Hell, we've now got entire schools devoted to Cartman Rules, where the first rule of the school is not about learning or growing but about recognizing the absolute authority of the school over every student action, and no excuses for failing to comply.
Cartman Rules have nothing to do with education, though the justification is always that we have to have order and control in order to teach Those Children. Cartman Rules are recognizable because they are tiny and picky and unrelated to any sort of instructional goals. You must sit just so. You must address me with the correct tone. You must not look at me with the wrong expression. Many Cartman Rules are never written down because in print it would be obvious just how wrong-headed they are.
Cartman Rules clash with race and class. Students who belong to my tribe already know how to play the game and show respect. But Those Students-- you know the ones-- are always too loud, too brash, not respectful enough in the way my tribe understands it. When a student from my tribe says something to a neighbor and laughs, I know nothing's wrong because he's Good People. But when one of Those Students does it-- well, you know how Those Students are and it is undoubtedly one more example of failing to respect my authoritah. Sometimes a Cartman Ruler is so sure that Those Students are out there that he will go looking for them, prodding and provoking until he can push some child to react, "proving" that he was right all along.
Cartman Rules believe in the slippery slope. We must not give an inch. I once heard an administrator explain that if we were going to let students violate parts of the dress code, we might as well just let them start murdering each other. Because dress code violations and murder are totally the same thing.
But that's not the worst part. The worst part is that those who live by Cartman Rules will make judgments that stick. Cartman Rule folks tend to sort the world into good and bad. That student who failed to respect my authoritah? His behavior just proves he's a Bad Kid, and once I know he's a Bad Kid, I can start seeing disrespect and defiance in every single thing he does.
Folks who live by Cartman Rules will always come off the rails sooner or later, and then they'll start flailing about and damaging everyone in sight. Sometimes they'll make such a mess they'll lose their position; sometimes they're so protected that they can get away with awful stuff. Another fictional teacher who lives by Cartman Rules-- Dolores Umbrage.
So (a Cartman Rules teacher will say) do you want chaos and disorder? Are you one of those touchy feely teachers who just lets the students run riot in your classroom?
The answer is no. The antidote to Cartman Rules ("Everyone must respect my authoritah") is another, simpler classroom and school rule. Everyone must treat everyone else with respect-- and "everyone" means everyone. If you like a simpler wording, try "everyone must treat everyone else as if they are a live human person."
Build an atmosphere of respect and decency and human consideration, and the order will follow. Try to build a system where rules and authority are the highest values, and nothing will thrive, not order, not education, and certainly not the students. Are there students out there who present a huge, huge challenge to a functioning classroom? Sure. But they are still human beings, and are entitled to be treated as such.
Every time you see one more news story about a student who was assaulted by a school official (though we never call the assault by its name) or about a child who was slapped in handcuffs or some other horrifying treatment of a student, you are seeing Cartman Rules in action. You are seeing an adult who put his or her own power and authority ahead of student needs or concerns. It's not okay. It's never okay. And the excuses are always lame because they always boil down to the same damn thing-- Cartman bleating "she wouldn't respect my authoritah."
Cartman rules. (NSFW ahead)
Yeah, that's the whole point of a Cartman Rule. You will respect my authoritah. You will acknowledge that I am The Man. You will do whatever the hell I say because I AM the boss of you.
Is there anything more ridiculous, more silly, more counterproductive, more flat out disrespectful than getting in a grudge match with a child or young adult with absolutely no intent except to force them, through word or deed, to acknowledge that they respect your authority?
I wish it weren't true, but we've all seen it too many times within the walls of a school. The kid laughs with the wrong kind of smile. The kid responds to a direction with a shrug instead of quick compliance. The kid gives all the appearance of not giving a rat's rear about what he's just been told.
And the Enforcer of the Cartman Rule completely loses the thread. What were we trying to do? Were we trying to cover the instruction for today's lesson? Were we trying to get the class focused on a goal, or engaged with some practice? Never mind-- we're going to drop it all so that we can back this kid into a corner and browbeat him into submission.
Hell, we've now got entire schools devoted to Cartman Rules, where the first rule of the school is not about learning or growing but about recognizing the absolute authority of the school over every student action, and no excuses for failing to comply.
Cartman Rules have nothing to do with education, though the justification is always that we have to have order and control in order to teach Those Children. Cartman Rules are recognizable because they are tiny and picky and unrelated to any sort of instructional goals. You must sit just so. You must address me with the correct tone. You must not look at me with the wrong expression. Many Cartman Rules are never written down because in print it would be obvious just how wrong-headed they are.
Cartman Rules clash with race and class. Students who belong to my tribe already know how to play the game and show respect. But Those Students-- you know the ones-- are always too loud, too brash, not respectful enough in the way my tribe understands it. When a student from my tribe says something to a neighbor and laughs, I know nothing's wrong because he's Good People. But when one of Those Students does it-- well, you know how Those Students are and it is undoubtedly one more example of failing to respect my authoritah. Sometimes a Cartman Ruler is so sure that Those Students are out there that he will go looking for them, prodding and provoking until he can push some child to react, "proving" that he was right all along.
Cartman Rules believe in the slippery slope. We must not give an inch. I once heard an administrator explain that if we were going to let students violate parts of the dress code, we might as well just let them start murdering each other. Because dress code violations and murder are totally the same thing.
But that's not the worst part. The worst part is that those who live by Cartman Rules will make judgments that stick. Cartman Rule folks tend to sort the world into good and bad. That student who failed to respect my authoritah? His behavior just proves he's a Bad Kid, and once I know he's a Bad Kid, I can start seeing disrespect and defiance in every single thing he does.
Folks who live by Cartman Rules will always come off the rails sooner or later, and then they'll start flailing about and damaging everyone in sight. Sometimes they'll make such a mess they'll lose their position; sometimes they're so protected that they can get away with awful stuff. Another fictional teacher who lives by Cartman Rules-- Dolores Umbrage.
So (a Cartman Rules teacher will say) do you want chaos and disorder? Are you one of those touchy feely teachers who just lets the students run riot in your classroom?
The answer is no. The antidote to Cartman Rules ("Everyone must respect my authoritah") is another, simpler classroom and school rule. Everyone must treat everyone else with respect-- and "everyone" means everyone. If you like a simpler wording, try "everyone must treat everyone else as if they are a live human person."
Build an atmosphere of respect and decency and human consideration, and the order will follow. Try to build a system where rules and authority are the highest values, and nothing will thrive, not order, not education, and certainly not the students. Are there students out there who present a huge, huge challenge to a functioning classroom? Sure. But they are still human beings, and are entitled to be treated as such.
Every time you see one more news story about a student who was assaulted by a school official (though we never call the assault by its name) or about a child who was slapped in handcuffs or some other horrifying treatment of a student, you are seeing Cartman Rules in action. You are seeing an adult who put his or her own power and authority ahead of student needs or concerns. It's not okay. It's never okay. And the excuses are always lame because they always boil down to the same damn thing-- Cartman bleating "she wouldn't respect my authoritah."
Monday, October 26, 2015
The Correct Number of Standardized Tests
The national conversation will now swing around to figuring out exactly how many standardized test should be given in schools. What, we will all wonder, is the correct number of standardized tests necessary for every student to experience in a year, or in an entire school career.
Here's the correct answer.
None.
Zip. Zero. Nada.
Students need standardized tests like a fish needs a bicycle. Standardized tests are as essential to education as a mugging is essential to better financial health.
Is there a benefit to the child to be compared and ranked against the rest of the children in the country, to be part of the Great Sorting of children into winners and losers? No. Having such rankings and ratings may advance the agenda of other folks when it comes to writing policy and distributing money, but those benefits are for those folks-- not the children. The mugger may benefit from mugging me, but it does not follow that I enjoy a benefit.
Are there standardized tests from which a classroom teacher can glean useful information? Sure-- but those tests are best chosen to fit the needs and concerns of one particular teacher and one particular collection of students. A diagnostic test might help me with Chris, but there's no reason to believe it would help me better understand Chris if it were given to every other student at the same time.
Do the poor children of some non-white non-wealthy neighborhood need to take the Big Standardized Test just like the rich white kids so that we have equity? Maybe-- but you know how else we could even that out? We could have all the public school kids do what the very wealthy private school students do-- take no BS Test at all. That would also provide equity.
Can I squeeze some useful information out of some standardized tests? Sure. I can grow and learn important lessons from being mugged, but that doesn't mean that getting mugged is still great and worthwhile. Do not tell me what I can learn from student standardized test results-- tell me what I can learn from those results that I cannot learn in faster, better, clearer, easier, cheaper ways on my own. Getting mugged might teach me not to take a lot of money with me when I leave the house, but are you sure I couldn't learn that lesson without getting punched in the face?
Do we need tests so that teachers, parents and students know "how the student is doing"? Only if the teacher, parents and students are clueless. Parents and teachers who are paying attention and doing their jobs know how the children are doing (and those who don't care still won't care when you wave a test score at them). And the students should be learning one of the most important lessons and skills of an educated person-- how to evaluate and assess yourself, so that you can be a self-directed, self-actuated human being, answerable to your own judgment, goals and assessment. You cannot learn that from a standardized test.
If you want me to inflict a Big Standardized Test on every single one of my students, you need to be able to answer one question:
What will I be able to do to further my students' education that I could not possibly accomplish any other way? If your BS Tests were denied access to my classroom, what benefits would my students be cheated of? If the universal one-size-fits-all BS Tests were banned today, what would my students be missing from their education tomorrow?
Nothing. The number of necessary standardized tests is zero.
Here's the correct answer.
None.
Zip. Zero. Nada.
Students need standardized tests like a fish needs a bicycle. Standardized tests are as essential to education as a mugging is essential to better financial health.
Is there a benefit to the child to be compared and ranked against the rest of the children in the country, to be part of the Great Sorting of children into winners and losers? No. Having such rankings and ratings may advance the agenda of other folks when it comes to writing policy and distributing money, but those benefits are for those folks-- not the children. The mugger may benefit from mugging me, but it does not follow that I enjoy a benefit.
Are there standardized tests from which a classroom teacher can glean useful information? Sure-- but those tests are best chosen to fit the needs and concerns of one particular teacher and one particular collection of students. A diagnostic test might help me with Chris, but there's no reason to believe it would help me better understand Chris if it were given to every other student at the same time.
Do the poor children of some non-white non-wealthy neighborhood need to take the Big Standardized Test just like the rich white kids so that we have equity? Maybe-- but you know how else we could even that out? We could have all the public school kids do what the very wealthy private school students do-- take no BS Test at all. That would also provide equity.
Can I squeeze some useful information out of some standardized tests? Sure. I can grow and learn important lessons from being mugged, but that doesn't mean that getting mugged is still great and worthwhile. Do not tell me what I can learn from student standardized test results-- tell me what I can learn from those results that I cannot learn in faster, better, clearer, easier, cheaper ways on my own. Getting mugged might teach me not to take a lot of money with me when I leave the house, but are you sure I couldn't learn that lesson without getting punched in the face?
Do we need tests so that teachers, parents and students know "how the student is doing"? Only if the teacher, parents and students are clueless. Parents and teachers who are paying attention and doing their jobs know how the children are doing (and those who don't care still won't care when you wave a test score at them). And the students should be learning one of the most important lessons and skills of an educated person-- how to evaluate and assess yourself, so that you can be a self-directed, self-actuated human being, answerable to your own judgment, goals and assessment. You cannot learn that from a standardized test.
If you want me to inflict a Big Standardized Test on every single one of my students, you need to be able to answer one question:
What will I be able to do to further my students' education that I could not possibly accomplish any other way? If your BS Tests were denied access to my classroom, what benefits would my students be cheated of? If the universal one-size-fits-all BS Tests were banned today, what would my students be missing from their education tomorrow?
Nothing. The number of necessary standardized tests is zero.
Sunday, October 25, 2015
ICYMI: Edu-reading for the week
Hey, remember back before everyone was busy writing responses to the latest administration PR blitz? Let's travel back to that land of a Few Days Ago, shall we, and look at some of what deserved reading this week.
Is Success Academy Fighting Inequality
A good look at SA's policy's and involvement in NY lobbying
As a Weapon in the Hands of the Restless Poor
This is a long form piece that originally ran in Harper's back in 1997. It's Earl Shorris writing about his launch of the Clemente Class project, and if you don't know about any of that, this is a good introduction. But it's also an answer to a fundamental question-- is there a point to teaching classical humanities to the poor (or anyone)?
Dear USD, Testing Disaster Is Yours
Don't miss Paul Thomas's take on the current kerfluffle, including a great reading list to put the whole testing biz into historical perspective.
Newark: The Day the Dream Died
Bob Braun takes a look, from right on the front lines, at how things are headed south in Newark. A bummer, but a necessary read.
Should Reading Be Taught in Kindergarten?
Reading expert Russ Walsh takes a look at this question and handles it with intelligence and balance, as always.
This Is What Has To Be Done
Jose Luis Vilson, as always an articulate advocate for both the positive and the challenging. A good positive note to end this week's list on.
Is Success Academy Fighting Inequality
A good look at SA's policy's and involvement in NY lobbying
As a Weapon in the Hands of the Restless Poor
This is a long form piece that originally ran in Harper's back in 1997. It's Earl Shorris writing about his launch of the Clemente Class project, and if you don't know about any of that, this is a good introduction. But it's also an answer to a fundamental question-- is there a point to teaching classical humanities to the poor (or anyone)?
Dear USD, Testing Disaster Is Yours
Don't miss Paul Thomas's take on the current kerfluffle, including a great reading list to put the whole testing biz into historical perspective.
Newark: The Day the Dream Died
Bob Braun takes a look, from right on the front lines, at how things are headed south in Newark. A bummer, but a necessary read.
Should Reading Be Taught in Kindergarten?
Reading expert Russ Walsh takes a look at this question and handles it with intelligence and balance, as always.
This Is What Has To Be Done
Jose Luis Vilson, as always an articulate advocate for both the positive and the challenging. A good positive note to end this week's list on.
Subscribe to:
Posts (Atom)