An AI Is Finally Trouncing The World's Best Poker Players (cmu.edu)

Halfway through the "Brains vs. AI" poker competition, an AI named Libratus is trouncing its human opponents, who are four of the world's top professional players. One of the pros, Jimmy Chou, said he and his colleagues initially underestimated Libratus, but have come to regard it as one tough player. "The bot gets better and better every day," Chou said. "It's like a tougher version of us"... Chou said he and the other pros have shared notes and tips each day, looking for weaknesses they can each exploit. "The first couple of days, we had high hopes," Chou said. "But every time we find a weakness, it learns from us and the weakness disappears the next day."
By Saturday, the AI had amassed a lead of $693,531 after 56,732 hands in the 120,000-hand match (which is being livestreamed by the Rivers Casino on Twitch). "I'm feeling good," said Tuomas Sandholm, the computer science professor at Carnegie Mellon who co-created the AI. "The algorithms are performing great. They're better at solving strategy ahead of time, better at driving strategy during play and better at improving strategy on the fly."

Comments

Important milestone

[Mostly a lurker]

Unlike with games like Chess (best moves can be precisely calculated) and Backgammon (simple probabilities), Poker requires adapting to human behavior, indeed varying your play depending on what you learn about your opponent. The techniques are going to be applicable to a wide range of situations. For instance, I will go so far as to claim that we will shortly be wise to use an AI to advise us on investment decisions. (In the past, the computer has been used for speed, and reacting to subtle market signals, but not so much for long term investment planning.)

The next challenge is going to be independent learning. I believe human experts still supervise the learning process of all the best AIs. Once the need for the human adviser goes away, AIs are literally going to be everywhere. Your phone AI will recognize and react to your current mental state, as well as help you overcome everyday problems. The AI in your fridge could become a huge help in keeping you compliant with your diet plans.

Re:Important milestone

[lgw]

Not as humans play it. You don't play the early game, or any area where pieces are sparse, by exhaustive analysis, but that's where the mechanical search space would be largest. (Much like humans don't play the endgame in chess that way.) "Complexity" of the naive search space, before even the most basic pruning, isn't an interesting measure.

Playing as humans play, the early game in chess is more complex than go, the midgame is similar, the endgame is much more complex in go. Go is harder to write a bot for, because chess is more complex in ways that are hard for humans, while go is more complex in ways that are hard to program. Does that make it a "more complex game"? Maybe - it's all down to definitions.