Robots Are Coming For Our Ms. Pac-Man High Scores (fastcompany.com)
A Microsoft-made AI system has achieved a perfect score of 999,990 points on the Atari 2600 version of the classic 'Ms. Pac-Man.' From a report: Researchers at the Microsoft-owned deep learning company Maluuba have used an AI system to break the all-time Ms. Pac-Man record. In a blog post, Microsoft wrote that, "using a divide-and-conquer method that could have broad implications for teaching AI agents to do complex tasks that augment human capabilities," Maluuba's AI was able to record a perfect Ms. Pac-Man score of 999,990 on the Atari 2600 version of the game, breaking the all-time record of 933,580.
This particular Atari game was one of the few games that resisted to Deep Q Learning (a form of Reinforcement Learning invented by DeepMind). Many researchers have tried over the last couple of years to solve it. This time, Microsoft found an ingenious solution to the problem, that combines experience from multiple agents and learns to form sub-goals. Their solution could mean that in the future it might be easier to apply reinforcement learning to other settings, such as robotics. The interesting part about reinforcement learning is that it learns dynamic behavior, as opposed to static classification. It learns to act intelligently. This kind of AI is invaluable.