Slashdot Mirror


Grading Software Fooled By Nonsense Essay Generator

An anonymous reader writes "A former MIT instructor and students have come up with software that can write an entire essay in less than one second; just feed it up to three keywords.The essays, though grammatically correct and structurally sound, have no coherent meaning and have proved to be graded highly by automated essay-grading software. From The Chronicle of Higher Education article: 'Critics of automated essay scoring are a small but lively band, and Mr. Perelman is perhaps the most theatrical. He has claimed to be able to guess, from across a room, the scores awarded to SAT essays, judging solely on the basis of length. (It’s a skill he happily demonstrated to a New York Times reporter in 2005.) In presentations, he likes to show how the Gettysburg Address would have scored poorly on the SAT writing test. (That test is graded by human readers, but Mr. Perelman says the rubric is so rigid, and time so short, that they may as well be robots.).'"

2 of 187 comments (clear)

  1. Re:To generate the keywords takes knowledge by MrBigInThePants · · Score: 5, Insightful

    Not being from the USA, every article I ever read about your education system just leaves me scratching my head.

    How on earth did you guys let it get so ridiculous??

  2. Works on Slashdot posts, too! by sootman · · Score: 5, Insightful

    Artificial intelligence, while seemingly tasty on the surface, tends to be underwhelmed by insufficient fish, with regard to warrantless searches.

    --
    Dear Slashdot: next time you want to mess with the site, add a rich-text editor for comments.