Software Takes On School Science Tests In Search For Common Sense

holy_calamity writes: Making software take school tests designed for human kids can help the quest for machines with common sense, says researchers at the Allen Institute for Artificial Intelligence. They've made software called Aristo that scores 75 percent on the multiple choice questions that make up most of New York State's 4th grade science exam. The researchers are urging other researchers to pit their best software against school tests, too, to provide a way to benchmark progress and spur competition.

Comments

Re:Hopeless

[narcc]

It would be easy to get ~75% correct just by looking for keywords and simple pattern matching, without actually understanding the question,

Pattern matching, without any understanding, is state-of-the-art AI.