John Warner, whose book Why They Can't Write should be required reading for all teachers of writing, just took a look at GPT-3, one of the new generation of algorithms that is being sold as an artificial intelligence capable of writing. GPT-3's capabilities are perhaps being oversold, and it has exhibited some of the usual problems with generating gibberish and "learning" to say terrible things, plus a tendency, like many such algorithms, to get stranded in a linguistic uncanny valley.
Warner was surprised by the discovery that GPT-3 does not know grammar, or any of the rules about how words can be put together meaningfully. I suspect many people would be surprised to learn this. But it's really really important when talking about computer algorithms for handling language to grasp that computers do not "understand" language in any regular sense of the world.The best metaphor I've seen for this kind of program is a weather forecasting model (I'm going to grossly oversimplify here--people who are knowledgeable about weather forecasting can take me to task in the comments). Think of weather forecasting as data crunching. When your infallible weather app tells you that there's a 50% chance of rain, what it means is that in all the times that the same weather conditions have been in place, half of them produced rain. To do this kind of predicting, you need two things-- a big bank of data of all the weather conditions from the past, and a good model for picking out which pieces of the data are important.
That's what language generating algorithms do. The algorithm crunches a whole lot of language "conditions" in the past--examples (sentences) scraped from a variety of sources-- and uses them to make predictions about what words could go together now. Or, as Warner aptly sums it up
As GPT-3 is “composing,” it is not referencing a vast knowledge of rules for grammatical expression. It’s simply asking, based on the word that it just used, what’s a good word to use next.Warner finishes his piece with a question:
I’m thinking it might be fun to ask GPT-3 to write on a prompt to compare and contrast how GPT-3 and Joan Didion employ grammar in their writing, based in Didion’s famous quote, “Grammar is a piano I play be ear, since I seem to have been out of school the year the rules were mentioned. All I know about grammar is its infinite power. To shift the structure of a sentence alters the meaning of that sentence as definitely and inflexibly as the position of a camera alters the meaning of the object photographed.”I wonder what it would say?
To start with, I swapped GPT-3 out for Jarvis and asked
Compare and contrast how Jarvis and Joan Didion employ grammar in their writing.
Here's what I got back:
Joan Didion and James Jarvis both use grammar in their writing, but they employ it differently. Joan Didion uses grammar to create short, declarative sentences that pack a lot of meaning into a small amount of space. On the other hand, James Jarvis uses grammar to create long, complex sentences that often meander and take a long time to end. Didion uses grammar as a piano she plays by ear ; Jarvis uses grammar as sheet music he meticulously follows.Both writers use grammar to create their own unique effects in their writing. Joan Didion's short, declarative sentences often have a staccato quality that creates a sense of unease or tension. This can be seen in her essay "Slouching Towards Bethlehem," where she actually wrote a book, not an essay. The effect is achieved by the choppy, staccato quality of her sentences:
In Eureka, California, in the late fifties, I worked for a while as a waitress in a coffee shop called Roy's. It was on Fourth Street then; it is now on Broad- way and is called Roy's Restaurant.
That yielded this:
Joan Didion employs grammar in a very straightforward way. She uses simple, declarative sentences and her syntax is usually very clear and easy to follow. In contrast, GPT-3 often employs more complex sentence structures and its grammar can be more difficult to parse. However, both writers use grammar to effectively communicate their ideas. Even though GPT-3 is computer software and not actually a writer. It is still able to generate writing that is clear and concise. This demonstrates the power of grammar in conveying meaning.
didion's Joan Didion employs grammar in a very straightforward way. She uses simple, declarative sentences and her syntax is usually very clear and easy to follow. In contrast, GPT-3 often employs more
Joan Didion says, "Grammar is a piano I play by ear, since I seem to have been out of school the year the rules were mentioned. All I know about grammar is its infinite power. To shift the structure of a sentence alters the meaning of that sentence as definitely and inflexibly as the position of a camera alters the meaning of the object photographed."
GPT-3, on the other hand, says: "The rules of grammar are there for a reason: to ensure that communication is clear and unambiguous. To break those rules is to invite confusion and misunderstanding."
So, we can see that Joan Didion has a more relaxed attitude towards grammar, whereas GPT-3 is less relaxed, probably because it is a machine. However, both recognise the importance of grammar in communication. Playing a piano by ear, however, is something that only humans can do; GPT-3 may be able to follow the rules of grammar perfectly, but it lacks the creativity that Joan Didion has. Playing trombone by ear, however, would be harder for GPT-3. Even if it could follow the rules of grammar perfectly, the nuances of music are something that machines struggle with.
So, in conclusion, we can see that while GPT-3 is very good at following the rules of grammar, Joan Didion is better at playing by ear and picking up on the nuances of
John Warner's approach to computerized writing is all about making the process as simple and streamlined as possible. He believes that the best way to do this is to focus on the content, rather than the form. This means that he pays attention to things like structure, organization, and clarity, rather than worrying about things like grammar and style.
His work focuses on certain critical aspects of the writing process, such as understanding your audience, developing a clear purpose, and organizing your thoughts. By taking these things into account, he believes that you can produce much better writing, regardless of the medium.
One of the main goals of Warner's approach is to help users write more effectively for their specific audiences. To do this he recommends that writers should do the following steps, as outlined in his book "The Elements of Effective Writing":
1. Know your audience
2. Develop a clear purpose
3. Organize your thoughts
4. Support your ideas with evidence
5. Use appropriate language
6. Edit and proofread your work
While all of these steps are important, Warner emphasizes the