Where Does AI Fit In The Writing Process

Pitches and articles keep crossing my desk that argue for including AI somewhere in the student writing process. My immediate gut-level reaction is similar to my reaction upon finding glass shards in my cheeseburger, but, you know, maybe my reaction is a just too visceral and I need to step back and think this through.

So let's do that. Let's consider the different steps in a student essay, both for teachers and students, and consider what AI could contribute.

The Prompt

The teacher will have to start the ball rolling with the actual assignment. This could be broad ("Write about a major theme in Hamlet") or very specific ("How does religious imagery enhance the development of ideas related to the role of women in early 20th century New Orleans in Kate Chopin's The Awakening?"). 

If you're teaching certain content, I am hoping that you know the material well enough to concoct questions about it that are A) worth answering and B) connected to your teaching goals for the unit. I have a hard time imagining a competent teacher who says, "Yeah, I've been teaching about the Industrial Revolution for six weeks, but damned if I know what anyone could write about it." 

I suppose you could try to use ChatGPT to bust some cobwebs loose or propose prompts that are beyond what you would ordinarily set. But evaluating responses to a prompt that you haven't thought through yourself? Also, will use of AI at this stage save a teacher any real amount of time?

Choosing the Response

Once the student has the prompt, they need to do their thinking and pre-writing to develop an idea about which to write. 

Lord knows that plenty of students get stuck right here, so maybe an AI-generated list of possible topics could break the logjam. But the very best way to get ready to write about an idea starts when you start developing the idea. 

The basic building block of an essay is an idea, and the right question to ask is "What do I have to say about this prompt?" Asking ChatGPT means you're starting with the question, "What could I write an essay about?" Which is a fine question if your goal is to create an artifact, a piece of writing performance. 

I'm not ruling out the possibility that a student see a topic on a list and have a light bulb go off-- "OOoo! That sounds interesting to me!" But mostly I think asking LLMs to pick your topic is the first step down the wrong road, particularly when you consider the possibility that the AI will spit out an idea that is simply incorrect.

Research and Thinking

So the student has picked a topic and is now trying to gather materials and formulate ideas. Can AI help now?

Some folks think that AI is a great way to summarize sources and research. Maybe combine that with having AI serve as a search engine. "ChatGPT, find me sources about symbiosis in water-dwelling creatures." The problem is that AI is bad at all those things. Its summarizing abilities are absolutely unreliable and it is not a good search engine, both because it tends to make shit up and because its training data is probably not up to date.

But here's the thing about the thinking part of preparing to write. If you are writing for real, and not just filling in some version of a five paragraph template, you have to think about the idea and their component parts and how they relate, because that is where the form and organization of your essay comes from. 

Form follows function. If you start with five blank paragraphs and then proceed to ask "What can I put in this paragraph, you get a mediocre-at-best artifact that can be used for generating a grade. But if you want to communicate ideas to other actual humans, you have to figure out what you want to say first, and that will lead you straight to How To Say It. 

So letting AI do the thinking part is a terrible idea. Not just because it produces a pointless artifact, but because the whole thinking and organizing part is a critical element of the assignment. It exercises exactly the mental muscles that a writing assignment is supposed to build. In the very best assignments, this stage is where the synthesis of learning occurs, where the student really grasps understanding and locks it in place. 

So many writing problems are really thinking problems-- you're not sure how to say it because you're not sure what to say. And every problem encountered is an opportunity. Every point of friction is the place where learning occurs.

Organization

See above. If you have really done the thinking part, you can organize the elements of the paper faster and better than the AI anyway. 

Drafting

You've got a head full of ideas, sorted and organized and placed in a structure that makes sense. Now you just have to put them into words and sentences and paragraphs. Well, maybe not "just." This composing stage is the other major point of the whole assignment-- how do we take the thoughts into our heads and turn them into sequences of words that communicate across the gulf between separate human beings? That's a hell of a different challenge than "how does one string together words to fill up a page in a way that will collect grade tokens?" 

And if you've done all the thinking part, what does tagging in AI do for you anyway? You know better than the AI what exactly you have in mind, and by the time you've explained all that in your ChatGPT prompt box, you might as well have just written the essay yourself.

I have seen the argument--from actual teachers-- that having students use AI to create a rough draft is a swell idea. Then the student can just "edit" the AI product-- just fix the mistakes, organize things more in line with what you were thinking, maybe add a little voice here and there. 

But if you haven't done the thinking part, how can you edit? If you don't know what the essay is intended to say--or if, in fact, it came from a device that cannot form intent-- how can you judge how well it is working?

Proof and edit

The AI can't tell you how well you communicated what you intended to communicate because, of course, it has no grasp of your intent. That said, this is a step that I can imagine some useful of computerized analysis, though whether it all rises to the level of AI is debatable.

I used to have my students do some analysis of their own writing to illuminate and become more conscious of their own writing patterns. Some classics like counting the forms of "be" in the essay (shows if you have a love for passive or weak verbs). Count the number of words per sentence. Do a grammatical analysis of the first four words of every sentence. All data points that can help a writer see and then try to break certain unconscious habits. Students can do this by hand; computers could do it faster, and that would be okay.

The AI could be played with for some other uses. Ask the AI to summarize your draft, to see if you seem to have said what you meant to say. I suppose students could ask AI for editing suggestions, but only if we all clearly understand that many of those suggestions are going to be crappy. I've seen suggestions like having students take the human copy and the edited-by-AI copy and perform a critical comparison, and that's not a terrible assignment, though I would hope that the outcome would be realization that human editing is better. 

I'm also willing to let my AI guard down here because decades of classroom experience taught me that students would, generally speaking, rather listen to their grandparents declaim loudly about the deficiencies of Kids These Days than do meaningful proofreading of their own writing. So if playing editing games with AI can break down that barrier at all, I can live with it. But so many pitfalls; for instance, the students who comply by writing the most half-assed rough draft ever and just letting ChatGPT finish the job. 

Final Draft

Another point at which, if you've done all the work so far, AI won't save you any time or effort. On the other hand, if this is the main "human in the loop" moment in your process, you probably lack the tools to make any meaningful final draft decisions.

Assessing the Essay

As we have noted here at the institute many, many times over the years, computer scoring of essays is the self-driving car of the academic world. It is always just around the corner, and it never, ever arrives. Nor are there any signs that is about to. 

No responsible school system (or state testing system) should use computers to assess human writing. Computers, including AI programs, can't do it well for a variety of reasons, but let's leave it at "They do not read in any meaningful sense of the word." They can judge is the string of words is a probable one. They can check for some grammar and usage errors (but they will get much of that wrong). They can determine if the student has wandered too far from the sort of boring mid sludge that AI dumps every second onto the internet. And they can raise the philosophical question, "Why should students make a good faith attempt to write something that no human is going to make a good faith attempt to read?"

Yes, a ton of marketing copy is being written (probably by AI) about how this will streamline teacher work and make it quicker and more efficient and even more fair (based on the imaginary notion that computers are impartial and objective). The folks peddling these lies are salivating at the dreams of speed and efficiency and especially all the teachers that can be fired and replaced with servers that don't demand raises and don't join unions and don't get all uppity with their bosses. 

But all the wishing in the world will not bring us effective computer assessment of student writing. It will just bring us closer to the magical moment when AI teachers generate an AI assignment which student AI then generate to be fed into AI assessment programs. The AI curriculum is thereby completed in roughly eight and a half minutes, and no actual humans even have to get out of bed. What that gets us other than wealthy, self-satisfied tech overlords, is not clear. 

Bottom Line

All of the above is doubly true if you are in classroom where writing is used as an assessment of content knowledge. 

This is all going to seem like quibbling to people who having an artifact to exchange for grade tokens is the whole point of writing. But if we want to foster writing as a real meaningful means of expression and communication, AI doesn't have much to offer the process. Call me an old fart, but I still haven't seen much of a use case for AI in the classroom when it comes to any sort of writing. 

What AI mostly promises is the classroom equivalent of having someone come to the weight room and do the exercises for you. Yeah, it's certainly easier than doing it yourself, but you can't be surprised that you aren't any stronger when your substitute is done.