Slashdot Mirror


Humans Dominating Poker Super Computer

New submitter IoTdude writes: The Claudico super computer uses an algorithm to account for gargantuan amounts of complexity by representing the number of possible Heads-Up No-limit Texas Hold'em decisions. Claudico also updates its strategy as it goes along, but its basic approach to the game involves getting into every hand by calling bets. And it's not working out so far. Halfway through the competition, the four human pros had a cumulative lead of 626,892 chips. Though much could change in the week remaining, a lead of around 600,000 chips is considered statistically significant.

25 of 93 comments (clear)

  1. Is it too hard to list chip counts? by ranton · · Score: 4, Insightful

    How are we supposed to have any idea what a cumulative lead of 626,892 chips means without knowing how many total chips there are? If there are 650,000 chips then the game is almost over, but if there are 1,000,000,000 chips then there hasn't been any movement at all.

    This is some pretty poor journalism.

    --
    -- All that is necessary for the triumph of evil is that good men do nothing. -- Edmund Burke
    1. Re:Is it too hard to list chip counts? by Anonymous Coward · · Score: 2, Informative

      80000 hands * 20000 stack each hand = 1600000000 chips if humans win all hands.

  2. They thought this would work? by PAjamian · · Score: 2, Insightful

    So let me get this straight. At the start of the game the computer calls all bets and then it lets the other players train it and change their strategy to take advantage of that training? And they thought this would beat a seasoned professional poker player?

    This is basically a beginning poker player (fresh blood) but who is more consistent. A pro will absolutely clobber it.

    --
    Windows is a bonfire, Linux is the sun. Linux only looks smaller if you lack perspective.
    1. Re:They thought this would work? by Idarubicin · · Score: 4, Insightful

      This is basically a beginning poker player (fresh blood) but who is more consistent. A pro will absolutely clobber it.

      In other words, either the researchers involved are complete idiots, or a Slashdot poster jumped to a useless conclusion based on a strawman argument spun from the summary. Hm.

      --
      ~Idarubicin
    2. Re:They thought this would work? by belthize · · Score: 4, Insightful

      That's good entry level tight strategy but will get you cleaned out playing no limit against a seasoned pro. You really have to learn how to win with any two random cards against any flop. You don't make a run at the hand every time but you must occasionally. If you know your opponent only plays face cards and likes to slow play strong hands preflop I'd rather call a minimum bet preflop with 2 3 than with KQ. I can get out cheap or absolutely clobber him with a good flop and I avoid the risk that he has some Ax, KK, QQ, JJ or some other face cards that can put my KQ in an uncomfortable spot.

      Lastly, if in doubt never call. Either raise or fold. Calling should be a very deliberate play. Most folks call because they have no clue if they're winning or losing a hand. Hint, you're losing.

    3. Re:They thought this would work? by twistedcubic · · Score: 2

      The two lowest card you can not use in a straight, 2 and 7, are probably worse than a 2 and 3. I'm too lazy to do the math, but you can check for me :) I see a lot of straights when watching poker on tv.

  3. Don't know about the technology... by Idarubicin · · Score: 3, Insightful

    I don't know about the technology or the algorithm(s), but the linked article is certainly nonsense.

    “You could use the same basic framework to do robust decision making like trying to come up with insulin and glucose monitoring plans [for diabetes patients],” says Neil Burch, a computer scientist at the University of Alberta who helped design a poker-playing AI earlier this year. “You get regular snapshots of glucose levels, and you have to decide how much insulin you should take, and how often.”

    Look, I get it. Nobody wants to admit that they're spending their grant money this way because it's fun to get a computer to play Hold 'em. But that's got to be the dumbest justification I've ever read. Human metabolism is complex, but the pancreas doesn't bluff.

    --
    ~Idarubicin
    1. Re:Don't know about the technology... by khallow · · Score: 2

      But that's got to be the dumbest justification I've ever read. Human metabolism is complex, but the pancreas doesn't bluff.

      It means they're solving a harder problem.

    2. Re:Don't know about the technology... by Anonymous Coward · · Score: 2, Interesting

      but poker is about much more than just the odds.. it's about emotions, reading players expressions and tells, intimidation, and taking advantage of all that. playing 'perfectly' based on percentages only gives you a chance at staying in the game, it's mastering the 'human factor' that gets you all the chips.

      i don't see the point to training a computer solely based on odds and what happens 'on the table', and i don't see how you could possibly program a machine (with today's technology, anyway) to exhibit the same traits as people do when playing (down to facial expressions, body language, and tells and such) so that players and machines had the same 'tools' available.

      cmdr data sucked at all that and he was a slightly more advanced computer than the guys at cmu are using. only when he got flung back in time to the 1890s did he truly excel at poker, and that was against human players who did not have centuries of analysis programmed into them and saw the odd looking and talking android as a possible easy mark and totally underestimated him.

  4. Not surprising by GammaKitsune · · Score: 3, Interesting

    Lt. Commander Data struggled with the intricacies of poker as well.

    --
    Gamertag: WyleType
    1. Re:Not surprising by pushing-robot · · Score: 2

      Glad I wasn't the only one to immediately think of this.

      --
      How can I believe you when you tell me what I don't want to hear?
  5. Poker is a lot more complex... by arbiter1 · · Score: 2

    Playing poker is a lot more about reading your opponent. figuring out if they are buffing or if they really have something. No computer can do that. Not at least at this point in time.

    1. Re:Poker is a lot more complex... by NicBenjamin · · Score: 2

      Ever heard of card counting? Computers are impossible to beat at card counting.

      So any game where card counting is part of a useful strategy the computer has a huge advantage. That's why they were able to solve two-player limited Texas Hold 'em, card counting well gives you a slight advantage so the computer can win 52-53% of the time even tho it can't read it's human opponent very well.

      The version they're playing now has some problems, but apparently the problems are caused as much by the programmer's poor choices (ie: call on every bet seems to be the definition of suboptimal strategy) as the use of a computer. Presumably future versions will have better strategies, and will be able to adapt their play-style to suit their opponents.

      Note that even if the optimizing play-styles to suit the opponent thing turns out to be a total bust, it should increase the winning percentage because the humans will have to spend some time figuring out what the optimizations for this particular tournament actually were, whereas these guys are winning partly because they can figure out the algorithm.

    2. Re:Poker is a lot more complex... by AuMatar · · Score: 2

      No, it isn't. Or at least, it isn't by looking for tells. You win money by analyzing their betting pattern on this hand, comparing it to what makes sense, and putting them on a range of possible hands. One of those possible hands is always a bluff. Then you see what you beat of those hands, what beats you, and what your drawing odds are to improve and make a choice off that information. That is definitely something a computer can do. But the question is never "is he bluffing" its "is my hand strong enough and with sufficient odds of winning to be worth paying at the pot and implied odds this gives me".

      Those are things a computer definitely can do.

      --
      I still have more fans than freaks. WTF is wrong with you people?
    3. Re:Poker is a lot more complex... by AuMatar · · Score: 4, Informative

      There's no card counting in Texas Holdem. The deck is reshuffled after each hand dealt. Only 7 cards are shown to a given player, and all of them can be read at any time. There's no advantage to card counting, because you don't need to count. They may have some other card game they beat, but it isn't holdem.

      --
      I still have more fans than freaks. WTF is wrong with you people?
    4. Re:Poker is a lot more complex... by greg1104 · · Score: 2

      Card counting is a betting strategy that's mainly about when to play or not. Computing odds is not card counting, even though that sometimes involves counting the number of cards that satisfy some condition.

  6. The limit means a lot by dlenmn · · Score: 3, Interesting

    I almost did a double-take with this story; a few months ago I read about computers having solved heads-up _limit_ Texas hold’em: http://arstechnica.com/science...

    Well, it looks like the computer can win when there is a limit, but humans can still win when there is no limit.

    I guess that's not too surprising: the limit really cuts down the number of choices, making a brute-force calculations more practical, and brute-force calculations are what computers do best. Without the restrictions of a limit, the AI needs to be a lot more clever. I wonder how long it'll be until computers win at this.

  7. Humans will always be better at some things by jandrese · · Score: 3, Funny

    There's no way the computer is going to win at Strip Poker.

    --

    I read the internet for the articles.
    1. Re:Humans will always be better at some things by captnjohnny1618 · · Score: 2

      Well, they could win, but it'd be disappointing for everyone.

  8. Re:Yeeee ha! by mc6809e · · Score: 5, Informative

    And the computer here is a patsy called a calling station.

    From the article: "but its basic approach to the game involves getting into every hand by calling bets".

  9. That's not what arbiter1 meant. by tlambert · · Score: 3, Insightful

    And what facial expressions would the computer betray?

    That's not what arbiter1 meant.

    "Reading your opponent" doesn't rely on facial expressions or tells when you are playing online poker.

  10. Claudico is actually beating one of the pros! by Dr.+Spork · · Score: 5, Interesting

    First of all, this is the link that the story should have included. It includes updates of the scoreboard, etc. On it you will see that even though the brains are collectively beating Claudico, the computer is actually over $100,000 ahead against Jason Les, a feat that almost no human could match. Yes, Claudico is down against the other three, but these are the top players in the world, and most human pros would get clobbered much worse by these guys. Are we really so hard to impress? This is the first time that something like this has been tried, and already, the computer is performing on a level that most poker pros would love to reach.

  11. Human specialty by tmosley · · Score: 2

    Humans were designed over a long, intense period of selection to be able to perform deep, self-referential thinking, ie to be able to know that the other guy knows that they are bluffing/lying/have some particular knowledge, and make plans accordingly. It is probably the single task that humans are best at. I'm not saying that having a machine beat humans at poker will mean the Singularity has arrived, but when they go one step farther and start beating us at politics (which requires the same skillset as poker but with more complexity, plus the ability to integrate other types of knowledge), then it's all over.

    I must say that I am looking forward to it. Humans are much better at beating others in the race to gain power than they are at actually ruling and making decisions for other people.

  12. yeah, meaning toss 75% at a table of four by raymorris · · Score: 2

    Yeah that's a restatement of my first-order analysis. At a table of four, you'll have the best hole cards 25% of the time, so you should fold if your cards aren't in the top 25% of possible pairs. There are patterns you can learn to know approximately how many hands beat yours.

    Further analysis brings out the fact that sometimes you can call cheap, get a good flop, then have someone bet large into your strong hand. So if you're playing against a table who bets small preflop and large postflop, you might call more often. On the other hand, if there are several potential raisers behind you, calling the one bet might not let you see the flop without calling more, so you should fold more often rather than getting stuck between multiple raises. It just depends on who you're playing against and your position relative to the button.

  13. Comment removed by account_deleted · · Score: 2

    Comment removed based on user account deletion