It is the dream that will not die. For some reason, there are still people who think the world would be a better place if student essays could be evaluated by software, because reasons. The problem has remained the same--for decades companies have searched for a software algorithm that can do the job, but other than deciding to call the algorithms "AI," progress has been slim to none.
The Feedback Prize is a coding competition being run through Kaggle, in which competitors are asked to root through a database of just under 26K student argumentative essays that have been previously scored by "experts" as part of state standardized assessments between 2010 and 2020 (which raises a whole other set of issues, but let's skip that for now). The goal is to have your algorithm come close to the human scoring results. Why? Well, they open their case with a sentence that deserves its own award for understatement.There are currently numerous automated writing feedback tools, but they all have limitations.