Slashdot Mirror


EFF Launches New AI Progress Measurement Project (eff.org)

Reader Peter Eckersley writes: There's a lot of real progress happening in the field of machine learning and artificial intelligence, and also a lot of hype. These technologies already have serious policy implications, and may have more in the future. But what's the ratio of hype to real progress? At EFF, we decided to find out.

Today we are launching a pilot project to measure the progress of AI research. It breaks the field into a taxonomy of subproblems like game playing, reading comprehension, computer vision, and asking neural networks to write computer programs, and tracks progress on metrics across these fields. We're hoping to get feedback and contributions from the machine learning community, with the aim of using this data to improve the conversations around the social implications, transparency, safety, and security of AI.

1 of 48 comments (clear)

  1. I can summarize by 110010001000 · · Score: 2, Interesting

    You can just mark 0% for progress now. Playing Go or Chess or any game is NOT AI. Neither is Siri or facial or voice recognition or autonomous driving. They are just programs. Computers are good at Go and Chess because they have strict rules to follow. Computers love rules. Computers are less good at autonomous driving because the rules aren't as clearly defined.