AI Decisively Defeats Four Pro Poker Players In 'Brains Vs AI' Tournament (ieee.org)
Halfway through the "Brains vs. AI" poker competition, it was pretty clear the artificial intelligence named Libratus would end up victorious against its human opponents, who are four of the world's top professional players. Lo and behold, Libratus lived up to its "balanced and forceful" Latin name by becoming the first AI to beat professional poker players at heads-up, no-limit Texas Hold'em, reports IEEE Spectrum. From the report: The tournament was held at the Rivers Casino in Pittsburgh from 11-30 January. Developed by Carnegie Mellon University, the AI won the "Brains Vs. Artificial Intelligence" tournament against four poker pros by $1,766,250 in chips over 120,000 hands (games). Researchers can now say that the victory margin was large enough to count as a statistically significant win, meaning that they could be at least 99.7 percent sure that the AI victory was not due to chance. Previous attempts to develop poker-playing AI that can exploit the mistakes of opponents -- whether AI or human -- have generally not been overly successful, says Tuomas Sandholm, a computer scientist at Carnegie Mellon University. Libratus instead focuses on improving its own play, which he describes as safer and more reliable compared to the riskier approach of trying to exploit opponent mistakes. Even more importantly, the victory demonstrates how AI has likely surpassed the best humans at doing strategic reasoning in "imperfect information" games such as poker. The no-limit Texas Hold'em version of poker is a good example of an imperfect information game because players must deal with the uncertainty of two hidden cards and unrestricted bet sizes. An AI that performs well at no-limit Texas Hold'em could also potentially tackle real-world problems with similar levels of uncertainty. In other words, the Libratus algorithms can take the "rules" of any imperfect-information game or scenario and then come up with its own strategy. The Libratus victory comes two years after a first "Brains Vs. Artificial Intelligence" competition held at the Rivers Casino in Pittsburgh in April-May 2015.
oh no it can't. yes it can. no it can't.
I don't play poker enough to know, but I wonder if many human players at the top level also try to win through discerning tells and weaknesses of opponents... if an AI can win so consistently is is using a technique that a human could also learn to get a step ahead of todays other human players?
"There is more worth loving than we have strength to love." - Brian Jay Stanley
Must be the first time ever I've heard of a Texas Holdem game where luck was not a factor.
Did you ever wake up in the morning, with a Zombie Woof behind your eyes? -- FZ
Perhaps it belches cigar smoke at chosen times.
It sounds like its just better at calculating the odds than humans are, which is not much of a feat, really. I mean... it would almost be surprising if it couldn't.
I'm not trying to diminish the significance of the research... but what is the real innovation here?
Because online poker companies around the would would love to get their hands on the software and plug it into their system, so that you'd never know if you were playing a computer or a real person. If you were playing the computer, you'd always lose.
Of course they could program their computers to simply know what you have in your hand and bet accordingly, but still..
1. Poker companies make their money from the "rake", which is a (capped) percentage of the pot. They get their money regardless of who wins.
2. Poker companies want you to keep playing, because that way you'll continue contributing to the pot (and therefore, to the rake). Players that lose too much, leave. That's why some poker companies offer tutorials and "schools" to retain players by helping them improve.
3. Poker companies that operate in highly regulated markets have their code audited, their installations inspected and each and every hand submitted in real-time to the regulatory authority for possible future scrutiny. Player trust is very important, being caught cheating will cause the players to switch to the competitors.
There will be a nuclear war in one year. I guarantee. I would get out of the US if you can.
If there is a nuclear war it won't matter where on the planet you are. An exchange of just a few 20-kiloton weapons will fuck up the entire Earth in short order.
Just cruising through this digital world at 33 1/3 rpm...
Because online poker companies around the would would love to get their hands on the software and plug it into their system, so that you'd never know if you were playing a computer or a real person. If you were playing the computer, you'd always lose.
No, with the probabilities involved in poker no player (AI or otherwise) can always win. Rather you'd loose over the long term, but that's already the case for most players.
Moreover, there is no financial incentive for on-line poker companies to have you always lose, or lose in any given hand. Like all effective gambling products (even those, unlike poker, where the house is your counter-party) what they want you to do is to win often enough to keep you coming back for more.
Of course they could program their computers to simply know what you have in your hand and bet accordingly, but still.
Exactly, and thus largely eliminating the chance to which the AI is still subject. But again they wouldn't because they have no financial incentive to do so. They make their money from the rake remember.
If on-line poker companies were to rig the system it would instead be to produce situations which encourage heavy post-flop action. The accusation that they do so is often made by players who have experienced (what they intuit as) more than their fair share of bad beats. But again the probabilities of Holdem will see to frequent bad beats even without undue interference. Now let me tell you about the time I had this perfect read on the villain, I was K full of Qs and he was Q full of As and then the river came a ...
Better to be despised for too anxious apprehensions, than ruined by too confident a security. --Edmund Burke
I'm looking forward to the AI that absolutely destroys the stock market which in turn will end the stock market.
Anons need not reply. Questions end with a question mark.
I don't play poker enough to know, but I wonder if many human players at the top level also try to win through discerning tells and weaknesses of opponents... if an AI can win so consistently is is using a technique that a human could also learn to get a step ahead of todays other human players?
These are all online pros (4 of the top 10 in the world). So their game is essentially entirely based on discerning patterns of betting behaviors and action frequencies.
Humans are still bad at statistics and machines can lie without any outward signs.
What is the point of this news?
Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
Will there ever be someone who is intelligent as well as a philanthropist to have AI make our lives simpler and give us more free time, and time to catch our breath?? Or will the noose of regulation and control get ever tighter?
It must win by judging the tells of its opponents though a camera, not calculate the possible outcomes which have a greater chance of success. This would make it AI.
Laws are rules for the court, but merely a bottom bar to hit for life. Think beyond laws in your actions always.
The AI would probably have an advantage as its less likely to have discerning tells of its own because all of the easily discoverable ones would have been caught much earlier on, whereas human players who've only played against other human players might not have spotted and obvious and exploitable pattern in their play yet and even though the AI "knows" what it is, it can't easily tell them what they're doing wrong.
An AI that performs well at no-limit Texas Hold'em could also potentially tackle real-world problems with similar levels of uncertainty.
We should plug it into all military hardware and put it in charge of all ICBM and SLBM launch decisions. Oh, and its hardware should have lots and lots of blinking lights...
and reel-to-reel tape drives.
There will be a nuclear war in one year. I guarantee.
I might take you up on that one ... what odds are you are offering?
Better to be despised for too anxious apprehensions, than ruined by too confident a security. --Edmund Burke
Who's Al? He sounds pretty brainy to me.
by Cyphase ( 907627 )
You're actually not right. It can be AI without being sentient, and in this case, it is just that. It's a general purpose learning algorithm. Not a strategic poker playing algorithm. It doesn't need to be sentient to be intelligent. You're confusing General AI with Narrow AI. This is a Narrow AI, to be sure, but if you string enough Narrow AI's up together, they can eventually give the same appearance of a General AI. This is just one milestone along the way. In particular, it dethrones the idea that poker is the last bastion of human dominance in cognition. Obviously we'll have to find a new bastion, like the fact that we are, so far, the only General Intelligence thus far observed or produced.
Speak for yourself.
BS
https://www.quora.com/How-many...
That was before this.
Slashdot, fix the reply notifications... You won't get away with it...
Everybody keeps saying that, somehow, a computer being able to play poker is the next step up from Go. I think this 'easy' victory shows that it's not that, but that poker is really just quite a stupid game. Which _people_ try to play by 'reading faces', but that you _should_ play - as any gamble - by statistics.
Religion is what happens when nature strikes and groupthink goes wrong.
it dethrones the idea that poker is the last bastion of human dominance in cognition
I think that idea was dethroned when Bill "The Bluff" Higgins got a train to Boston in 1872 with his pockets full of winnings, and strode into Harvard saying "Gentleman, the finest minds in the world have recently met in the back room of McKluskey's Hotel, and held a competition of arithmetic, stoney faces and drinking, to determine a winner. And I am that winner. Your work, professors, is needed no more. A dominant mind has been chosen."
Seriously, what makes poker attractive as a benchmark of AI is that it is essentially simple (like chess, go and most other card or board games), but contains a very small element of modest complexity (bluffing).
Compare that to a game like Pictionary. Pictionary is vastly, vastly more complex than poker. When two computers with cameras and screens can beat a pair of humans at pictionary, I'll be impressed.
-----
You can have intelligence without sentience. It's a question of degree. Do you do nuance, at all?
I do not want your cheap brainburning drugs. They are useless for work. And I am a working man today.
He has credibility, you don't.
I do not want your cheap brainburning drugs. They are useless for work. And I am a working man today.
The obvious problem is that humans are bad at randomization and computers are reasonably good at that. If the computer then does something at random, the humans will not be able to copy it.
They don't have to cheat. It's very important that a poker site offers a wide variety of games and bet sizes, and have a large number of active tables. Being able to plug in bots, with skill levels tuned to the game, would be very lucrative even if the bots are set to play only well enough to break even.
They will not reply, this is just a meme the liberals are using. However they have now increased it so I guess one of their web sites told them to, it use to be a month.
An essential element of any poker game is reading your opponent and making them misread you or not read you at all.
Using a computer to play reduces the game to its ultimate component of chance.
How do you bluff a computer that's not reading your face?
This is pretty much the same as setting up a robotic arm to throw three point basketball shots without having to worry about a human trying to take away the ball of block the shot.
When Fascism comes to America, it will call itself Anti-Fascism, and tell you to give up your guns.
This is interesting, but I have to wonder how much the fact that the best human players have optimized their strategy to beat humans is a factor. I'd like to see whether the AI would maintain its advantage when the human players have become more familiar with its play style.
When someone says, "Any fool can see
When two computers with cameras and screens can beat a pair of humans at pictionary, I'll be impressed.
Given that, recently, computers do way better than humans at facial recognition, pictionary sounds that a big deal compared to poker.
Slashdot, fix the reply notifications... You won't get away with it...
The game being played was online poker, so nobody was reading anybody's face making it an equal contest. Check the source article.
Weaselmancer
rediculous.
Running an undeclared bot that takes players' money is worse than cheating, it is criminal fraud (or possibly worse, I am not a law expert). The premise of poker is that you do not play against the house, you play against other players and pay the house for providing the venue. Given that the Libratus' play style measurably differs from a human's, it will be easily detected by analysis.
You might have as well suggested that the poker company fudge the amount of money in players' accounts and hope nobody notices.
#3 is not funny, it is a pain in the ass due to the number of hoops one needs to jump through and having the software flexible enough to support all the different requirements the regulators come up with.
I don't have publicly-accessible links to give you, but if you are interested to learn more about the subject, I suggest researching the French regulations from ARJEL and the Italian ones from AAMS.
If AI and sentience were one and the same, we wouldn't call it AI, we'd call it AS. Besides, sentience is a philosophical concept. The definition of which is the ability to have "subjective perceptual experiences". And going by that definition, one can argue that such a learning algorithm is indeed sentient. AI research does not particularly use the word "sentience" because it is such an abstract concept that it doesn't really add to the field of study. "Intelligence" just means that a thing learns, and potentially modifies it's behavior based on previous experiences; and that's unarguably exactly what this does.
For future reference, people asking "why does this matter?" or "why should anyone give a damn?" on slashdot is trollbait. You'll find at least one comment asking this in nearly every post.
BS
My mistake- I meant to write "20-megaton", not "20-kiloton". (Although a few 20-kiloton wouldn't exactly improve things either.)
So, to correct my original statement, "If there is a nuclear war it won't matter where on the planet you are. An exchange of just a few 20-megaton weapons will fuck up the entire Earth in short order."
Just cruising through this digital world at 33 1/3 rpm...
Am I the only one who sees "LIBERATE US" in the name Libratus?
Be scared.
If during a hand, the AI had accused another player of cheating, knocked over the 'table', and pulled out a BFG 9000 to 'right the wrong'!
Yeah I see Russians having a leg up in case of a nuclear winter.
and I don't know if the above statement even qualifies as sarcasm, post-sarcasm anyone?
Oh I'm all in for an "Adventure Time" type of future, do you mean we all get this as a bonus for Americans voting for him? GO DRUMPTF!
I know you are not the original AC, but damn if the winning is getting lame, get over it kids.
do you mean we all get this as a bonus for Americans voting for him? GO DRUMPTF!
Yes, it would not surprise me if this president manages to precipitate a nuclear exchange. I would suggest investing in companies that make ammunition and MREs as they're sure to do a booming business in the foreseeable future.
Just cruising through this digital world at 33 1/3 rpm...
You're ignoring the "play well enough to break even" part. And why would they have to do it in secret? Card rooms have always employed paid shills to fill empty seats to keep games going or to start a new one. It's not secret. I worked as one for a time, and the players knew it. I also won money, but the bots don't have to, and the card room would have preferred that I didn't win. (most shills don't win. They hope to break even and live off the salary.)
The problem with this approach is that it changes the role of the house in the game. In poker, as opposed to casino games, you can argue that the house is an impartial party, that has no stake in the outcome of the game. Should it change, it will open a big Pandora's box of complications that would keep many lawyers gainfully employed for a long time.
Not if they say that's what they're doing. They can even publish the bots' results showing that they are not making money, but merely filling tables.
The only company in the business that I am closely familiar with is Pokerstars, and they don't have a problem filling tables.
http://www.pokerscout.com/Site...
What does that have to do with it? You seem to be bent on being contrarian no matter how far we get from the original point.
The original claim was that "online poker companies around the would would love to get their hands on the software and plug it into their system" and I do not think that we strayed that far from it.
My point is that (at least for the dominant player in the business) the drawbacks and risks outweigh any potential benefits to the point that it will not even be considered.
If failing to bring convincing arguments to the opposite makes me "contrarian", so be it.
You started screaming fraud, now you're simply saying there's no need. One of the biggest problems of starting an online poker room is the lack of players. No matter how good everything else is, if it's hard to find the game a player wants he won't play there. That inevitably leads to a small handful of giants. This type of bot would allow competition to flourish. Ultimately, that's good for the player. The very person you said would be harmed.
I don't remember screaming anything, I tried to keep this conversation polite.
My fraud remark was about running undisclosed bots, which was what the original poster I replied to insinuated.
As for newcomer companies, I can see how having AI for players to play with will alleviate the problem of empty tables, but I also see how it would cause other problems. In no particular order:
Even assuming that everything is straight, level and upfront, it still creates the perception of a conflict of interests. After all, poker is played for money and now the house is perceived to have a stake in the game.
This will likely be disallowed by regulatory bodies, as it blurs the line between player vs player games and casino-style games. Regulators are a pain to deal with.
As I said, poker is played for money (I will address the play money case later), and arguably one of top (if not the top) players' goal is to win money. If the bots play too well, nobody would want to play them; if they play too badly, people will always try to play only against them.
In the case of play-money games, the reasons outlined above may not hold, but I fail to see the incentive of using such AIs in this case. Even the educational value is low since such AIs play very differently from humans (as per the article).
Now, there may be something I am missing in the picture, and you are more than welcome to point out any errors in my reasoning, but I suspect that without any hard data this will remain an academic argument.