Slashdot Mirror


Poker Program Battles Humans In Vegas

Bridger writes "Poker software called Polaris will play a rematch against human players during the 2008 World Series of Poker in Las Vegas. Developed by an artificial intelligence group at the University of Alberta in Canada, Polaris will be pitted against several professionals at the Rio Hotel between July 3rd and 6th. 'It's possible, given enough computing power, for computers to play "perfectly," where over a long enough match, the program cannot lose money,"' said associate professor Michael Bowling.'"

312 comments

  1. Tell by illumastorm · · Score: 5, Funny

    When it's bluffing, it blinks twice.

    1. Re:Tell by CDMA_Demo · · Score: 1

      and when it blinks, it pokes twice.

    2. Re:Tell by QuiteAwesome415 · · Score: 1

      And when you're bluffing, someone has to press the "Opponent seems to be bluffing" button on the computer.

  2. Lets mess with it by TornCityVenz · · Score: 5, Funny

    I'd love to see one of the guys slick at handleing cards, slip a couple extra aces into the deck, or the like. Would the program adapt? Draw a laser and call him a no good sack of mostly water?

    --
    I Need someone to rebuild a Digitech Digital Delay pedal for me....for me...for me...for me.
    1. Re:Lets mess with it by Anonymous Coward · · Score: 1, Funny

      You got to know when to holdem, know when to foldem, know when to walk away,,,and when to run exploits,,

      With apologies to Kenny Rogers.

  3. They have to turn the monitor on it's side by StaticEngine · · Score: 5, Funny

    If they want to correctly display the advanced AI "poker face": :|

    1. Re:They have to turn the monitor on it's side by somersault · · Score: 5, Funny

      8|

      He's doing the eyes again! May as well fold.

      --
      which is totally what she said
    2. Re:They have to turn the monitor on it's side by Anonymous Coward · · Score: 0

      8U

      I fold!

    3. Re:They have to turn the monitor on it's side by somersault · · Score: 1

      The joke's on you - that was a BLUFF!

      --
      which is totally what she said
  4. I'm at least as good as this software... by toetagger · · Score: 0, Redundant

    'It's possible, given enough computing power, for computers to play "perfectly," where over a long enough match, the program cannot lose money," said associate professor Michael Bowling.'

    I'm at least as good as this software! I also won't loose any money playing Poker. In fact, I'm better, because I don't loose any money in the short, near, or long term! I just don't gamble!

    1. Re:I'm at least as good as this software... by iONiUM · · Score: 2, Insightful

      You can't lose what you don't put in the middle. But you can't win much either.

    2. Re:I'm at least as good as this software... by brady8 · · Score: 5, Insightful

      I was hoping this wouldn't have to be said, but playing Poker isn't gambling if you play it properly. The house takes a small cut from each hand which reduces your winnings by a proportionally small amount, but otherwise it's like anything else requiring skill - over time, the best player will always win more money, and the worst player (skill-wise) will lose the most money.

    3. Re:I'm at least as good as this software... by Thinboy00 · · Score: 1

      I was hoping this wouldn't have to be said, but playing Poker isn't gambling if you play it properly. [snip]

      Hmm... but there's more chance than in other games like e.g. chess.

      --
      $ make available
    4. Re:I'm at least as good as this software... by brady8 · · Score: 2, Insightful

      For people who play professionally, or even amateurs who play often over several years, the chance aspect of the game disappears as the card distribution converges, and skill is all that is left to decide the winnings.

      Over a career playing poker, there's just about the same chance/skill ratio as there is in chess.

    5. Re:I'm at least as good as this software... by pxc · · Score: 2, Insightful

      The chance/skill ratio in chess is 0, because there's no chance in chess. I don't understand how you can say that.

    6. Re:I'm at least as good as this software... by Anonymous Coward · · Score: 0

      It's called convergence of a random variable. If you play enough poker hands, the chance aspect of it goes to zero... which would be the same as chess. Which was my original point.

    7. Re:I'm at least as good as this software... by Anonymous Coward · · Score: 0

      Nothing random converges to exactly zero. It may converge in the direction of infinitesimal but that isn't zero and thus the best poker player in the world can catch a bad beat and lose a bunch of money. QED, bitch.

    8. Re:I'm at least as good as this software... by PaulBu · · Score: 1

      And to the AC above: "hey, let's toss a coin to see if you are playing White or Black!" -- sounds like *some* chance in a chess game.

      Paul

    9. Re:I'm at least as good as this software... by megaditto · · Score: 1

      Problem is, skill itself depends on chance, since human brain is not a perfect logic and math engine.

      Hence even the best players will lose some games.

      --
      Obama likes poor people so much, he wants to make more of them.
    10. Re:I'm at least as good as this software... by myth_of_sisyphus · · Score: 1

      I heard a professional poker player on NPR say he had been a millionaire--and lost it all (maybe 10 bucks for the buffet) 8 times over in his life.

      Sounds like chance to me. (But then of course he mellowed out and played conservatively.)

    11. Re:I'm at least as good as this software... by Raenex · · Score: 1

      the chance aspect of the game disappears as the card distribution converges, and skill is all that is left to decide the winnings.

      Most poker players "play the man", and this element has a rock-paper-scissors aspect to it: "I know my opponent plays a certain way, I will take advantage of it". "I know that my opponent knows I play a certain way, I will take advantage of this." "I know that my opponent knows that I know ..."

      That makes the idea of skill as a measurable quality very slippery. I don't think you could accurately pinpoint "the greatest player" as you could for somebody like Kasparov in the chess world. There are certainly classes of players, where top pros consistently make money, but skill is vastly overestimated in poker.

    12. Re:I'm at least as good as this software... by teh+moges · · Score: 1

      I think the point the parent was trying to make was that Poker has variance, where Chess does not. Play poker for long enough and its purely a skill game (i.e. that bad beat you got early on will be evened out by a bad beat for your opponent later). However, in practice, few people have the many years to devote to poker to get to this point.
      So any single game is a matter of luck, with lots of variance. Given a sufficient amount of time, the better player will win.

    13. Re:I'm at least as good as this software... by teh+moges · · Score: 1

      Skill is vastly UNDERestimated in poker.

      Poker strategies aren't transitive, i.e. if Player A beats Player B, then Player B beats Player C, that does not necessarily mean that Player A will beat Player C.

      That said, given a distribution of players, you can still rank them in order from better players to worse players, given that distribution.

    14. Re:I'm at least as good as this software... by nospam007 · · Score: 1

      So why don't they let it play online poker on a gazillion sites for a couple of years and retire?

    15. Re:I'm at least as good as this software... by Xarin · · Score: 2, Insightful

      The chance/skill ratio in chess is 0, because there's no chance in chess. I don't understand how you can say that.

      There are some elements of chance in chess since players are better prepared for some openings then others. All grandmasters have some novel lines they have developed that they are ready to spring upon their opponent if given the chance and the game is critical enough to reveal it. Since they are on the clock, there is not much time to ponder a response to something that has been worked out over months or years.

    16. Re:I'm at least as good as this software... by spazdor · · Score: 2, Funny

      I'm at least as good as this software! ... I just don't gamble!

      How about Global Thermonuclear War?

      --
      DRM: Terminator crops for your mind!
    17. Re:I'm at least as good as this software... by Helmut+Kool · · Score: 1

      Poker is definitely a gambling game, even though you can make bets that have positive expectation. If you flip coins with your buddy and you give him one dollar for tails and he gives you two dollars for heads it is still gambling (but you are basically guaranteed to make big profit).

    18. Re:I'm at least as good as this software... by Imsdal · · Score: 1

      Sounds like a gambling problem to me. Do you know for a fact that this player played in the same way and in the same games all the time? I'm willing to bet a reasonable amount that this particular player was pretty prone to tilting and/or gambling in general.

    19. Re:I'm at least as good as this software... by TheRaven64 · · Score: 2, Funny

      Okay. You can have the first move.

      --
      I am TheRaven on Soylent News
    20. Re:I'm at least as good as this software... by Tjebbe · · Score: 1

      actually, 0.x1, where x is an infinite number of zeroes, is exactly the same as 0.

      OTOH, people will never play an infinite number of poker hands, and within hands, especially in tournaments (less so in cash games), randomness has a tendency to get pretty high at times, thereby bringing the average back up again.

      OTOH, chess does not exactly have zero randomness. There are times when different moves could have the same 'value' and the one the player chooses could be well interpreted as random. Choosing an opening would be a good example; you shouldn't open with every possible move, but you shouldn't alway pick the same one either.

    21. Re:I'm at least as good as this software... by neoform · · Score: 1

      I was hoping this wouldn't have to be said, but playing Poker isn't gambling if you play it properly.

      I play poker at a local casino as well as online a lot. It's gambling.

      I've heard tons of poker players make the stupid claim that poker isn't gambling, it certainly is. When you invest in the stock market you're also gambling, why? Because you don't know the outcome ahead of time, you're hoping your 80% chance of winning will result in you winning. But bad beats come all the time. Even the pros will tell you it's gambling. Skill plays a big part of winning, but that doesn't change the fact that many plays in poker come down to dumb luck.

      --
      MABASPLOOM!
  5. Define 'Long Enough' by Anonymous Coward · · Score: 0

    "It's possible, given enough computing power, for computers to play "perfectly," where over a long enough match, the program cannot lose money,"

    Unless the match is infinitely long, that is not true.

    1. Re:Define 'Long Enough' by Edward+Kmett · · Score: 2, Interesting

      and played with infinite money

      --
      Sanity is a sandbox. I prefer the swings.
    2. Re:Define 'Long Enough' by teh+moges · · Score: 1

      The quote was poorly worded, but the idea isn't. These guys do know what they are talking about, they just oversimplified the concept for a quotable quote.

    3. Re:Define 'Long Enough' by meringuoid · · Score: 1
      Unless the match is infinitely long, that is not true.

      'Long enough' means exactly that: as the length of the game approaches infinity, the computer's expected losses approach zero.

      --
      Real Daleks don't climb stairs - they level the building.
  6. This is like "computer battle human in tennis" by D.McGuiggin · · Score: 3, Insightful

    Only to find out it's Wii tennis, a very small subset of "tennis"

    The statements made regarding this subject apply only to the subset of poker being played, seven-card limit Texas Hold'em.

    1. Re:This is like "computer battle human in tennis" by JordanL · · Score: 3, Insightful

      Limit hold'em? No wonder they can write a computer program to play perfectly. Let's see them do no-limit and make the same claim.

    2. Re:This is like "computer battle human in tennis" by Anonymous Coward · · Score: 3, Funny

      actually, Java has been playing "perfect" poker (all variants) for years now. It's the clever new "Just-In-Time" virtual machines that make it possible, compiling and optimizing the program in real time.
      "Poker face"? No problem with the latest Java 3d facial animation libraries.
      The end result is perfect play and code that runs (at least) 10 times as fast as that from a modern C++ compiler.
      Even the very best hand crafted assembler poker games can't reach a quarter of the speed of Java.

    3. Re:This is like "computer battle human in tennis" by Darkness404 · · Score: 2, Funny

      Even the very best hand crafted assembler poker games can't reach a quarter of the speed of Java.

      Speed of Java!?! Don't make me laugh. Java has, and will always be slower then assembly.

      --
      Taxation is legalized theft, no more, no less.
    4. Re:This is like "computer battle human in tennis" by Anonymous Coward · · Score: 0

      whoosh?

      who can say.

    5. Re:This is like "computer battle human in tennis" by stinerman · · Score: 1

      Well trolled, sir.

      As I'm sure you know, the language (be it assembly, Java, C, etc.) doesn't matter. What matters is how well the compiler optimizes, since everything gets turned into assembly anyway.

      By your comment and the context you are claiming that writing a program in hand-coded assembly is faster than writing the same program in Java and that this is true for all programs. That, sir, is one of the most asinine things I've ever heard. Hardly ever does even an expert assembly programmer do better than an optimizing compiler, but it does happen occasionally.

      Please read the Wikipedia article on dynamic recompilation for more information.

    6. Re:This is like "computer battle human in tennis" by K.+S.+Kyosuke · · Score: 1
      Oh, yes, whatever. BTW, Common Lisp compilers have been able to compile code generated at run-time into native machine code for the past two decades.

      The end result is perfect play and code that runs (at least) 10 times as fast as that from a modern C++ compiler. Even the very best hand crafted assembler poker games can't reach a quarter of the speed of Java.

      You need to take off those pink Java glasses. Unless you are truly trying to benefit from JIT optimization, e.g., by generating a genetic algorithm and letting the runtime to cook it into native code, a good C++ compiler will still in most cases beat a JVM hands down. They can do most of the JVM optimizations ahead-of-time, and then some. True, they cannot do certain things that JVM can do, but they have at least much, much more time to do the rest.

      By definition, improving a JIT stops making sense when the increase of the CPU time slice of the JIT outweighs the performance increase of your app code, whereas C++ compilers can happily spend their time making fancy expensive things including AOT profile-guided optimization (much like HotSpot's feedback based compilation) almost as long as they wish. Oh, and since when does Java allow you to exercise the SSE unit, for example? (And not with just scalar SSE2 FP math, please...)

      (Note that I am a C++-- person. I would not touch C++, my brain has already been irreparably damaged with such a large dose of Lisp and Haskell that C++ would probably take me out. But the things you are writing here simply make very little sense to me.)

      --
      Ezekiel 23:20
    7. Re:This is like "computer battle human in tennis" by Anonymous Coward · · Score: 0

      Make the Java strong enough, and I'm well-nigh supersonic.

    8. Re:This is like "computer battle human in tennis" by D.McGuiggin · · Score: 1

      "actually, Java has been playing "perfect" poker (all variants) for years now."

      Thanks for the laugh, I enjoyed it. However, if you'd like to pick any Java based player (or several, I'm open) and put up some money, I'll happily help you prove your point playing some OH8. You can even choose the stakes (real money please, no pissant stakes, say 10-20?).

      Well?

    9. Re:This is like "computer battle human in tennis" by ne0n · · Score: 1

      Hardly ever does even an expert assembly programmer do better than an optimizing compiler, but it does happen occasionally.

      tell that to the guys who do those 64k demos, like the produkt (and there are thousands more, but this one is my fave)

      --
      $ :(){ :|:& };:
    10. Re:This is like "computer battle human in tennis" by Anonymous Coward · · Score: 0

      considering it's a lower level language... It's just harder to program in if you want to accomplish something "more complicated". And there's a lot more thinking involved.

    11. Re:This is like "computer battle human in tennis" by vikstar · · Score: 1

      Hehe, looking at all the posters replying to this, I guess they missed the joke. Java was slow at the beginning, but now it has spead up tremendously, sometimes even beating C++ at certain things. Parent has projected the "Java is slower than C++" that used to be so prevailent, and moved the bar up to "Java is slower than assembly"... making a joke that Java will never stop beating the languages that people say are faster than it.

      --
      The question of whether a computer can think is no more interesting than the question of whether a submarine can swim.
    12. Re:This is like "computer battle human in tennis" by Anonymous Coward · · Score: 0

      Hardly ever does even an expert assembly programmer do better than an optimizing compiler, but it does happen occasionally.

      This is only true in the context of optimizations based on knowledge of the machine language and variable analysis as performed by an assembly programmer - good compilers have simply become superior at this. However, top assembly programmers can produce faster/smaller code than compilers when they fully comprehend the semantics of the problem and its data structures and are capable of leveraging that knowledge into optimized assembly code. That will remain true at least until we have real AI in compilers along with ways to properly specify the semantics of a problem as input to the compiler AI.

      - T

    13. Re:This is like "computer battle human in tennis" by stinerman · · Score: 1

      So something that has an additional step BEFORE BECOMING ASSEMBLY is faster than something THAT STARTS OUT AS ASSEMBLY...

      Not necessarily, due to the dynamic recompilation techniques available in the JVM. Perhaps you should read it as well.

      Now in terms of raw speed where dynamic recompilation is unnecessary or unavailable, anything compiled to assembly is the way to go for the reasons you mentioned.

    14. Re:This is like "computer battle human in tennis" by stinerman · · Score: 1

      Indeed.

      Those guys are very good at what they do. Certainly the exception to the rule, though.

    15. Re:This is like "computer battle human in tennis" by kestasjk · · Score: 1

      Don't act like limit and no-limit require different amounts of skill.. Most would go the opposite of what you're implying.

      "No-limit? Hah, go all-in when you are likely to have the best and hope it holds up, that's not skill. Let's see them make it play limit/pot-limit."

      --
      // MD_Update(&m,buf,j);
    16. Re:This is like "computer battle human in tennis" by mattack2 · · Score: 1

      ...and that's redundant. I realize the article said it that way too. Seven-card limit hold 'em? As opposed to 5 card hold 'em? That is, Texas Hold 'em always has 7 cards, 5 of them being community cards.

    17. Re:This is like "computer battle human in tennis" by JordanL · · Score: 1

      I didn't say it took less skill, I implied that it's easier to describe programatically, which is very easy to see.

      With Limit you have a very small ability to do things like bluff and a very narrow margin of pot odds and the ability to call other players bluffs.

      Pot Limit would be more difficult to program than Limit, and No Limit more difficult still.

      Programmed intelligence thrives on constants, and in Limit Poker, there are more of them.

    18. Re:This is like "computer battle human in tennis" by Schraegstrichpunkt · · Score: 1

      By your comment and the context you are claiming that writing a program in hand-coded assembly is faster than writing the same program in Java and that this is true for all programs. That, sir, is one of the most asinine things I've ever heard. Hardly ever does even an expert assembly programmer do better than an optimizing compiler, but it does happen occasionally.

      An expert assembly programmer can always do at least as well as the compiler, because the programmer can use a compiler, then optimize the output further, if possible.

    19. Re:This is like "computer battle human in tennis" by Imsdal · · Score: 1

      Pot Limit would be more difficult to program than Limit, and No Limit more difficult still.

      This may be true, but if it is, it's far from obvious. Theoretical example: you are on the turn with a 55% chance of winning the hand. When the river comes you won't know if you have your opponent beaten or not, but he will know if he has you beaten. Would you rather be in this situation in no-limit or pot-limit play? In NL, you push and gain an unexploitable edge. In PL, if you bet the pot, get called, and opponent bets the pot on the river you are in a very, very uncomfortable position.

      From a programming POV, limit is harder than it looks and NL is simpler. (NB: simpler than it looks, not necessarily simpler than limit.)

    20. Re:This is like "computer battle human in tennis" by Anonymous Coward · · Score: 0

      Actually, limit hold'em, and especially ring games of that kind, are harder than no-limit to design computer automatons to play well.

    21. Re:This is like "computer battle human in tennis" by Mark+J+Tilford · · Score: 1

      Limit poker is simpler in that it has a finite number of cases, and the computer can start at the end and work backwards.

      --
      -----------
      100% pure freak
    22. Re:This is like "computer battle human in tennis" by TheRaven64 · · Score: 1

      That used to be true. It wasn't true for anything other than really small tight loops for the last ten years because something like the Pentium 4 keeps 150 instructions in-flight at once and writing really efficient code requires you to track dependencies between all of these at once. There are a few corner cases - most commonly in vector instructions - where compilers produce bad code (especially from a source language like C, where they don't have the option of rearranging your data structures). More recently, it's become even less true. A modern compiler does run-time profiling and feedback-driven optimisation, so it's optimising on both the program and the data, which a human can't do unless you're willing to ship him to all of your customers.

      --
      I am TheRaven on Soylent News
    23. Re:This is like "computer battle human in tennis" by TheRaven64 · · Score: 1

      It made me laugh, although the over-analysis in the subsequent comments has killed the humour a bit. That said, most languages are faster than assembly now, because a programmer can keep more of the program in their head while writing in a high-level language and so can manage more global optimisation, and these (rather than the local, micro-optimisations that assembly makes easier) are the things that really speed up code.

      --
      I am TheRaven on Soylent News
    24. Re:This is like "computer battle human in tennis" by Imsdal · · Score: 1

      Technically, NL and PL also has a finite number of cases. This is especially true if the game is not very deep stacked. And even a full table limit game has too many nodes for complete enumeration to be a feasonable apporach to deciding your actions.

    25. Re:This is like "computer battle human in tennis" by D.McGuiggin · · Score: 2, Informative

      "That is, Texas Hold 'em always has 7 cards, 5 of them being community cards."

      No it doesn't, variations of Texas hold em exist that use more, or less, than 7 cards.

      I think what you meant to say was "I am unaware of..." instead of your declaration that was incorrect.

    26. Re:This is like "computer battle human in tennis" by mattack2 · · Score: 1

      But they aren't called *Texas* Hold 'em when they have a different number of cards, are they?

      Can you provide a link to any of these variant games?

      Obviously something like Omaha is superficially similar to Texas Hold 'em. (But in reality, it's very different, since it's high and low, and you can only use 2 of your hole cards.)

  7. Can't lose money? by Anonymous Coward · · Score: 0

    the program cannot lose money," said associate professor Michael Bowling

    Riiight. So why are you an associate professor instead of cleaning up with online poker?

    1. Re:Can't lose money? by InlawBiker · · Score: 4, Insightful
      The online poker sites are already filled with "bots" that play statistically perfect poker. Or at least perfect enough to earn a profit over time.

      It's not a terribly difficult calculation to know if a bet has sufficient pot odds. Playing against imperfect players a bot is virtually garaunteed to make money.

      Against professionals though it might have trouble winning, since pros also calculate pot odds more or less perfectly, but can change their play to throw off the computer. It's sort of akin to how a chess master might beat a computer.

    2. Re:Can't lose money? by Anonymous Coward · · Score: 1, Insightful

      It's also not terribly difficult to decide which cards should come out of the digital deck next. I would never trust an online gambling site without some assurance of legitimacy by an accredited auditing agency.

    3. Re:Can't lose money? by Darkness404 · · Score: 1, Insightful

      But if I was running an online poker game I would make the house win like 50% of the time and a "player" which was another bot win 25% of the time leaving the other players to fight over the extra 25%. Also, if you control what comes out of the deck and who it goes to, it is not that hard to win

      --
      Taxation is legalized theft, no more, no less.
    4. Re:Can't lose money? by Anonymous Coward · · Score: 0

      The online poker sites are already filled with "bots" that play statistically perfect poker.

      I have a friend who retired at 30 after successfully using his bots to win enough money to make him able to live off the interest. He still uses his bots, but now more cautiosly and mostly when he wants to buy a new car, boat etc.

      I would never ever play online poker. It is much safer in real life.

    5. Re:Can't lose money? by MobyDisk · · Score: 2, Insightful

      That is not akin to how a chess master beats a computer. In chess there is no bluffing and no chance.

    6. Re:Can't lose money? by Thinboy00 · · Score: 1

      Since when do computers get "thrown off"? If you use miniMax and opponent chooses to play optimally, computer has anticipated this, in other scenarios (i.e. opponent plays suboptimally), it just recalculates.

      --
      $ make available
    7. Re:Can't lose money? by InlawBiker · · Score: 4, Informative

      The online poker houses don't ever "win" because they're not in the game. They're just the host, and they make money by taking percentage of the pot for each game.

      It's for this reason they have an interest in making sure the games are fair. If there was ever reason to suspect the games were weighted or unfair everybody would leave to another host.

      They are way too busy (literally) raking in the dough to cheat. The big online poker sites go through a lot of trouble to keep their reputation clean.

    8. Re:Can't lose money? by AuMatar · · Score: 1

      You obviously never play poker. There is no house player. The house doesn't have a hand. Only real people do. The house makes its money by a rake- they take a small percentage of every pot. So it doesn't matter who wins to them, so long as money is being bet.

      --
      I still have more fans than freaks. WTF is wrong with you people?
    9. Re:Can't lose money? by Karganeth · · Score: 5, Insightful

      Poker sites are not full of bots. The one I play at is full of terrible players who enjoy throwing their money away.

      No bot plays perfect poker. I'm sure that no bot will be perfect for a very, very long time (way beyond my lifetime). The mathematics behind poker is incredibly complex. A good book about it is the mathematics of poker by Bill Chen and Jerrod Ankenman. From reading your post it seems to me that you have a very little idea about the problems with solving poker and even how to play poker. You can't just call when you have the odds and fold when you don't. It just doesn't work that way - that strategy is easily exploited. I'm also not sure why you were modded +5 Insightful... I guess there aren't many poker players here at /.

    10. Re:Can't lose money? by Anonymous Coward · · Score: 0

      It's for this reason they have an interest in making sure the games are fair. If there was ever reason to suspect the games were weighted or unfair everybody would leave to another host.

      Riiight. The people who run Absolute poker got caught doing exactly that.

    11. Re:Can't lose money? by InlawBiker · · Score: 1

      You could be right, it depends on the poker AI. In chess everything is known so all possible moves can be calculated. But a chess player can disguise a strategy, causing a computer to calculate probable moves incorrectly. If it's done well the computer will makes moves to defend an attack that never comes. That's sort of a bluff.

      I would think that the best poker AI does not try to anticipate what's in the player's hand based on what he does, but stays strictly with math based on known cards. The minute the AI starts adjusting to what opponents are doing it becomes vulnerable to being tricked.

      Either way it's an intersting problem. It's entirely possible that, since poker is a game partly based on luck, that both human and computer are playing perfectly enough to never know which is really better.

    12. Re:Can't lose money? by Anonymous Coward · · Score: 4, Insightful

      No offense, but you obviously don't understand poker very well. For example, unless the betting structure is very restrictive (e.g. heads up game with 2x BB stacks) a bot could not possibly play "statistically perfect poker" (an erroneous statement in itself) because it's a game of incomplete information. Perfect poker is only possible when you can see everyone's hole cards. Computers do not have any intrinsic edge in this regard.

    13. Re:Can't lose money? by Anonymous Coward · · Score: 0

      Incredibly complex? Do yourself a favour and pick up a real mathematics text for once. Then you'll at least have some frame of reference to use before you go spouting off and looking like a dummy.

    14. Re:Can't lose money? by Anonymous Coward · · Score: 0

      I've been making tons of money for years now by exploiting this fact. My bot takes advantage of the other bots "perfect play" by bluffing exactly the right amount to make them all fold.

    15. Re:Can't lose money? by nekokoneko · · Score: 1

      In chess everything is known so all possible moves can be calculated.

      Chess engines do not calculate every possible move, since there is not enough computing power to do so. There are several reasons that would lead a human to beat a chess engine, but, as GP already stated, there is no bluffing and no chance. Some interesting information about this matter can be found in Wikipedia.

    16. Re:Can't lose money? by megaditto · · Score: 1

      Since when do computers get "thrown off"

      Ever played Quake vs a computer player with a rocket launcher?

      But seriously, sometimes it's not a zero-sum game and/or the pot is not limited.

      --
      Obama likes poor people so much, he wants to make more of them.
    17. Re:Can't lose money? by Anonymous Coward · · Score: 0

      See that guy 2 seats to your right.. user894 who takes a big pot down from time to time. There's your house player.

      Don't kid yourself. You think the poker sites don't have a stable of "edged" players in there. Why wouldn't they?

    18. Re:Can't lose money? by Surt · · Score: 1

      You're assuming none of the hands belongs to the house while playing online poker. How would you know if one of the players belonged to the house and was dealt a guaranteed win every hundredth hand?

      --
      "Who is the Journal of Quantum Physics going to believe?" --Stephen Hawking
    19. Re:Can't lose money? by Anonymous Coward · · Score: 0

      1) Reputable sites actively ban accounts with bots
      2) If you're a player worth his/her salt you are making money off the bots anyway
      3) LOL at "much safer in real life". Online and live you better be watching for cheats. There aren't many in either arena, but they're there and it pays to keep an eye out.
      4) The reason why thousands of pros and semi-pros make money online is because they understand number 3. Those that don't understand 3 are usually losing players.

    20. Re:Can't lose money? by truesaer · · Score: 1

      In fairness, the incident with Absolute Poker was actually some rogue employees exploiting their insider knowledge to cheat as players. And they did it in such an incredibly obvious manner that they were caught almost immediately.

      Most sites take this kind of thing seriously, they have nothing but their reputations. I know many of the bigger poker sites use some pretty sophisticated analysis software to detect unusual/unlikely patterns of play to root out bots and also to find any situations like this.

      Personally I have pretty high confidence in sites like PokerStars, UltimateBet, and FullTilt. They've got too many users to risk something like this if they can prevent it.

      But if you're really worried, lobby your congresscritter to stop their stupid bans on internet gambling, which are mostly illegal under our trade agreements. Then the sites could be properly regulated, NGC style.

    21. Re:Can't lose money? by Propaganda13 · · Score: 1

      I have a friend who retired at 30 after successfully using his bots to win enough money to make him able to live off the interest. He still uses his bots, but now more cautiosly and mostly when he wants to buy a new car, boat etc.

      I would never ever play online poker. It is much safer in real life.

      Let me get this straight

      1. You have a friend.
      2. Your friend's bot made him rich.
      3. You don't gamble online with your friend's bots that could make you rich.

      Did I get that right?

    22. Re:Can't lose money? by thc4k · · Score: 2, Insightful

      This is ridiculus. If there are no bots in **online poker**, the only reason for this is that the hosts are too good at detecting them!

      **Online poker** is not real poker. I have been myself playing like a bot would do, with a sheet of paper infront of me, with simple instructions like "if you are xx seat, have cards xy, others did that, so you do this". I did make some profit, but i don't really like the game at all, seeing that it is just that simple. Making a bit of profit in online poker is not about *perfect* play, it is only about beating the newbies. Even the most trivial poker bot can win online if it just can go by undetected.

      Sure, people can and will exploit you with that type of play and it will never work in games with higher wages, but this is all the more reason to belive there have to be bots. A bot can simply track all players it plays against and leave tables when there is someone exploiting them. There are thousand of tables and millions of players, all you have to do is avoid those who know you. At the same time a bot can play all day and night on any number of tables.

      I bet there are alot bots already, undetected and unpublished, generation a steady stream of money for those who wrote them and are not afraid of fraud charges ... Only an idiot would publish such a bot and draw attention from the host. And neither would the poker hosts confirm the existance of a bot, since they absolutely depend on the illusion that the game is fair.

    23. Re:Can't lose money? by Mark+J+Tilford · · Score: 1

      Read about game theory. Handling problems with randomness or incomplete information can have statistically perfect solutions in that they will, on average, win at least as much on the good hands as they lose on the bad hands.

      --
      -----------
      100% pure freak
    24. Re:Can't lose money? by Imsdal · · Score: 1

      It's not terribly difficult to decide which cards should come out of the deck next, doing so would mean that you easily made millions of dollars a month, yet you choose to not do so. How come, if I may ask? or could it be that you really don't know what you are talking about?

      You may or may not trust the poker sites, but it is indeed terribly difficult to decide which cards come next. Yes, there has been exceptions - Poker Planet for one. This is a billion dollar industry. Don't you perhaps think they learnt from that fiasco?

    25. Re:Can't lose money? by Imsdal · · Score: 1

      I don't think you understand the economics of poker. The house takes a rake from (almost) every hand. There is no risk for them in any way. Their only risk is alienating the players.

      How much extra would they stand to gain by cheating in a non-obvious manner? What would be the risk of detection? How much would they lose if it was indeed detected? Please do the maths here, and then you will reconsider.

      That said, there can of course be bad shuffling algorithms that are exploitable. This has happened. There could also be rogue employees cheating. This has also happened. But general cheating from a reputable poker site? Nope, does not happen.

    26. Re:Can't lose money? by Anonymous Coward · · Score: 0

      Poker sites are not full of bots. The one I play at is full of terrible players who enjoy throwing their money away.

      What site do you play at? ;)

    27. Re:Can't lose money? by neoform · · Score: 1

      AbsolutePoker was caught cheating.

      Also, the house rake can be increased by creating action hands that cause the players to put more money in the pot, thereby giving the house a larger rake.

      I'm not saying sites do this, but to claim that there's no incentive to cheat is wrong, the house gains if there is cheating going on.

      --
      MABASPLOOM!
    28. Re:Can't lose money? by andy55 · · Score: 1

      I'm pretty sure that parent was simply making a reference to the fact that back-end cheating can occur easily whenever you're playing online poker (as opposed to a physical deck, etc). Sure enough, I believe there was a hot story a few months back where logs were recovered of a player being in cahoots with someone on the back end.

    29. Re:Can't lose money? by Anonymous Coward · · Score: 0

      They are way too busy (literally) raking in the dough to chea

      Wait. Are we talking about an online poker site or some sort of gardener's bakery?

  8. Zero sum game by Hatta · · Score: 5, Insightful

    Poker is a zero sum game. Pit two of these 'perfect' players against each other, and one of them will lose money.

    --
    Give me Classic Slashdot or give me death!
    1. Re:Zero sum game by pbhj · · Score: 5, Funny

      Almost exactly what I was thinking, but for me it was "put 3 of these computers against each other and they'll devalue the currency?".

    2. Re:Zero sum game by Anonymous Coward · · Score: 0

      If they're both 'perfect', then they will both break even an infinite amount of times, given an infinite amount of play (unbiased random walk).

    3. Re:Zero sum game by Anonymous Coward · · Score: 1, Insightful

      Poker is a zero sum game. Pit two of these 'perfect' players against each other, and one of them will lose money.

      For a single hand, yes. Over time they should average back out to zero.

    4. Re:Zero sum game by jandrese · · Score: 5, Funny
      I think the point is that two of them facing off would end up with just as much money as they started with over the long run.

      Of course if the pool of money is not unlimited, then in the short term one will pull ahead of the other, and can "win" through sheer random chance. This isn't really that hard of a concept, the idea is that if another player is playing slightly suboptimally, then against this computer and both with a limitless pool of money and playing forever, the computer will slowly but surely pull ahead of the flawed opponent. It does not mean the computer will win against the human players in Vegas for several reasons:
      1. The pool of money is limited (and fairly small)
      2. The playtime is finite and also fairly small
      3. Human players can walk away from the table if they get a short term advantage (quit while you are ahead), I'm guessing the computer program doesn't do that

      This reminds me of an old mathematician joke:

      One day this guy is finally fed up with his middle-class existence and decides to do something about it. He calls up his best friend, who is a mathematical genius. "Look," he says, "do you suppose you could find some way mathematically of guaranteeing winning at the race track? We could make a lot of money and retire and enjoy life." The mathematician thinks this over a bit and walks away mumbling to himself.

      A week later his friend drops by to ask the genius if he's had any success. The genius, looking a little bleary-eyed, replies, "Well, yes, actually I do have an idea, and I'm reasonably sure that it will work, but there a number of details to be figured out.

      After the second week the mathematician appears at his friend's house, looking quite a bit rumpled, and announces, "I think I've got it! I still have some of the theory to work out, but now I'm certain that I'm on the right track."

      At the end of the third week the mathematician wakes his friend by pounding on his door at three in the morning. He has dark circles under his eyes. His hair hasn't been combed for many days. He appears to be wearing the same clothes as the last time. He has several pencils sticking out from behind his ears and an almost maniacal expression on his face. "WE CAN DO IT! WE CAN DO IT!!" he shrieks. "I have discovered the perfect solution!! And it's so EASY! First, we assume that horses are perfect spheres in simple harmonic motion..."

      --

      I read the internet for the articles.
    5. Re:Zero sum game by Actually,+I+do+RTFA · · Score: 2, Interesting

      Pit two of these 'perfect' players against each other, and one of them will lose money.

      Over the long term, both would stay fairly close to even. Or, to put it another way, play is perfect if taking no different move is to your benefit. When both players play perfectly, it is a Nash equilibrium.

      An interesting note, even though they are of equal skill, one will likely be in the lead for the vast majority of the time.

      The summary is poor in that it says it is impossible for a perfect player to lose. Given bad enough luck, a perfect player can lose their entire stack before they manage to win it back.

      --
      Your ad here. Ask me how!
    6. Re:Zero sum game by Hatta · · Score: 1

      An interesting note, even though they are of equal skill, one will likely be in the lead for the vast majority of the time.

      Thanks, that was my point expressed more elegantly. I remember the effect from stats class, I don't remember what it's called though, if it has a name.

      --
      Give me Classic Slashdot or give me death!
    7. Re:Zero sum game by Anonymous Coward · · Score: 0

      Less than zero, because this is in Las Vegas. The house is taking a piece of every pot. They're the ones who are guaranteed to win.

    8. Re:Zero sum game by Thinboy00 · · Score: 1

      Is that at all related to positive feedback (i.e. the more money you have the easier it is to make money)?

      --
      $ make available
    9. Re:Zero sum game by palegray.net · · Score: 1

      Maybe I'm a bigger geek than even I supposed, but that's the best joke I've heard all week (and I work on a naval base). Mod parent up :).

    10. Re:Zero sum game by a_n_d_e_r_s · · Score: 1
      --
      Just saying it like it are.
    11. Re:Zero sum game by somersault · · Score: 1

      I would expect it's more because the first hand has to go someone's way, and then even if it went back the opposite way next hand, the other player was still in the lead for a while. But if one player has a couple of good hands and then they both keep winning one at a time then one of the players will still be 'ahead' that whole time. In perfect play in a limits game, I don't think the amount of money that a player has would make a difference..

      --
      which is totally what she said
    12. Re:Zero sum game by mattack2 · · Score: 1

      Human players can walk away from the table if they get a short term advantage (quit while you are ahead), I'm guessing the computer program doesn't do that

      From TFA, each match is 500 hands. So this is sort of like an actual tournament (though real tournaments will have a variable number of hands, of course).

      In real tournaments, they play until someone is the winner (though a bunch of people get varying amounts of winnings).

      You are thinking about a cash game. The majority of poker shows on TV are tournaments. (The few shows with cash games I've watched are less interesting to me, though I haven't seen "High Stakes Poker", which is apparently very entertaining.)

      Plus, there are a lot of big name pros who *don't* quite while they're ahead. They end up going hundreds of thousands or millions in the red, just in one night.

    13. Re:Zero sum game by Actually,+I+do+RTFA · · Score: 1

      That's exactly the reason. With limit play, the size of the average hand one is not dependent on the size of your stack*. That is, there is no positive or negative feedback.

      Obviously, when the size of the stack is below the maximum bet for a hand, this is no longer the case. But that's hardly a common case.

      --
      Your ad here. Ask me how!
    14. Re:Zero sum game by Anonymous Coward · · Score: 0

      I tried that and somehow Haliburton ended up with a contract for most of it. Yeah, I don't understand it either.

    15. Re:Zero sum game by Veggiesama · · Score: 1

      Though it helps to remember that casino poker isn't zero sum. The house shaves off a few percentage points every pot, so in a game of equally skilled players iterated a million times, I would think only the house would be showing a substantial profit. Everyone else would be significantly less well off.

      I don't know much about poker probabilities, but it seems to me that really good players would do best by staying away from other good players, unless a large jackpot exists to offset the house's gain (like you see on TV). I'm sure the house pulls in more money from advertising deals and publicity stunts, rather than from the high-rollers, in such cases.

    16. Re:Zero sum game by miraboo · · Score: 1

      I think the point is that two of them facing off would end up with just as much money as they started with over the long run.

      I don't think this is correct. If two perfect players play against each other for a long time, the average return per hand will approach zero for both players; but the total return is a random walk and will diverge from the mean (ie zero) so one player could make a substantial win and the other a substantial loss. But my understanding of random walk's is incomplete I would be grateful if someone could complete it!

    17. Re:Zero sum game by miraboo · · Score: 1

      But my understanding of random walk's is incomplete

      And apparently I don't understand how apostrophes work either!

  9. It's not fair... by Thelasko · · Score: 3, Interesting

    professional poker is a psychological game. Unless the computer has the feeling of anxiety it will have an edge.

    What I find impressive is the fact it lost in the past. It would also be interesting to see what it can do with some sort of lie detector software.

    --
    One of our competitors trademarked the term "hypothesis". From now on, we will call them "boneheaded ideas".
    1. Re:It's not fair... by VeNoM0619 · · Score: 1

      These are not the cards you are looking for...
      It can't be programmed to never lose, part of poker is LUCK, if you keep getting dealt bad hands, you still have to pay the blinds/ante.

      --
      Disclaimer: I am not god.
      We may not be created equal
      But we can be treated equal.
    2. Re:It's not fair... by Thinboy00 · · Score: 1

      RTFA: He said "In the long run." Either you mean in the short run (i.e. a finite amount of time) or you think that the same bad hands will be dealt to the same player forever (technically impossible unless the dealer is cheating).

      --
      $ make available
    3. Re:It's not fair... by Anonymous Coward · · Score: 1, Insightful
      professional poker is a psychological game. Unless the computer has the feeling of anxiety it will have an edge.

      What I find impressive is the fact it lost in the past. It would also be interesting to see what it can do with some sort of lie detector software.

      yes poker is a psychological game and this is why a computer DOES NOT have an edge. A person can evaluate another persons psychological reactions and make adjustments, a computer can't. Also the computer must rely incredibly heavily on maths and odds for there play, while this makes it an incredibly solid player it also makes it easier to exploit by a human player. In tournaments some of the easiest people to send broke are the ones that play like a computer (ie all maths and no psychology), you just slowly drain them.

    4. Re:It's not fair... by kestasjk · · Score: 1
      professional poker is a psychological game. Unless the computer has the feeling of anxiety it will have an edge.

      Well some might say that at a high enough level anxiety and tells just don't come into it, and professional poker isn't psychological at all. I don't think Brunson/Greenstein/etc get many nervous twitches (and I don't think you need to get to nearly that high a level before you reach that point)

      --
      // MD_Update(&m,buf,j);
    5. Re:It's not fair... by mattack2 · · Score: 1

      While they may not get "nervous twitches", I have seen some pro players on TV tournaments say that they have found tells on other pro players.

      Of course they don't give details, and they could be lying or misinterpreting what they're seeing. Though I don't remember exact specifics, I think they have said they've seen a tell in a particular tournament, not a longstanding tell. So that may also be the player seeing patterns that aren't really there, since the brain is so good at seeing patterns that don't really exist.

    6. Re:It's not fair... by neoform · · Score: 1

      Lie detectors require having various body monitors that can read your heart rate and breathing.. if I had such a monitor hooked up to my opponents, that would help me massively.

      --
      MABASPLOOM!
  10. hmmmm by v_1_r_u_5 · · Score: 2, Insightful

    "It's possible, given enough computing power, for computers to play "perfectly," where over a long enough match, the program cannot lose money,"

    So what happens when you pit two of these against each other?

    1. Re:hmmmm by darkhitman · · Score: 4, Funny

      They realize the only way to win is not to play?

      --
      Tell me something...it's still "We, the people"... right?
    2. Re:hmmmm by felipekk · · Score: 1

      They've done that. It turned out that the dealer lost everything he had: car, savings, house...

    3. Re:hmmmm by Toutatis · · Score: 1

      Obviously, in that case they'll look for a third, human, player to play with them.

    4. Re:hmmmm by Siridar · · Score: 1

      What a strange game.

  11. These people don't understand poker by taustin · · Score: 4, Insightful

    professional poker is a psychological game. Unless the computer has the feeling of anxiety it will have an edge.

    Poke is almost entirely a game of skill, not chance, at professional levels. The average dufus at his weekend poker game will play for luck. Professionals play the other players. A computer has no tells, and can't read them in a human player. The computer therefore has a distince edge against the amateur, and a distinct disadvantage against the pro.

    What I find impressive is the fact it lost in the past. It would also be interesting to see what it can do with some sort of lie detector software.

    The only lie detector that has any hope of working - as you should know, if you read /. - is a professional poker player.

    1. Re:These people don't understand poker by felipekk · · Score: 1

      Professionals play the other players.

      Exactly. How do you expect a professional to win when he is playing against a player that does not give out tells and other clues?

    2. Re:These people don't understand poker by ElizabethGreene · · Score: 1

      The same way we take down 12,000 player online poker tournaments. Just grind it out.

    3. Re:These people don't understand poker by felipekk · · Score: 1

      Exactly. Since the gaming interface is now very limited (no tells), a computer can and will, over time, learn and play the game in a manner that he will always win over a human player.

      It's simple: if you make the game all about math (odds), a computer will simply be better at it. He will be able to look through historical data for that player flawlessly and make decisions based on that that will have the best EV (expected value).

      And when you go from online to live play, the interface is still limited because the computer does not give out tells. The game becomes a simple matter of calculating pot odds and evaluating previous hands to calculate the correct play.

      When it comes to play poker against a computer, in the future, the correct move is not to play.

    4. Re:These people don't understand poker by ceoyoyo · · Score: 4, Insightful

      I'm not sure you're entirely correct. Poker is a game of skill, yes, but so is chess. The difference is that poker is based on incomplete information whereas chess is not. That just means you have to play probabilities though.

      The whole tells topic is important in professional poker for increasing your odds against flawed human players. That can give you an edge over the basic statistics. However, if you're playing a computer that doesn't have any tells, my intuition says that the game reduces to basic probability.

      That means the computer, given enough computational resources to play a perfect game, can wipe the floor with amateurs, and will be more closely matched (but never at a disadvantage) with the best players.

      That doesn't mean that the computer would be unbeatable. Since the game is based on probability, you could still beat the computer, but in the limit you could only expect to win as many games as you lost.

      The computer would also be at a disadvantage if it were playing a game with multiple human players. A good psychological poker player could use his advantage over the other humans at the table to take a chip lead, which would be an advantage over the computer.

    5. Re:These people don't understand poker by ElizabethGreene · · Score: 4, Insightful

      The whole tells topic is important in professional poker for increasing your odds against flawed human players. That can give you an edge over the basic statistics. However, if you're playing a computer that doesn't have any tells, my intuition says that the game reduces to basic probability.

      The assumption here is that the computer has no tells. That is not a safe assumption. Most tells aren't about whether or not the guy licks the oreo on a bluff (Reference: Rounders), heart rate (a really good tell), pupil diameter, or galvanic skin response. They are about how an opponent plays in a particular situation. After a few rounds you get a feel for the types of starting hands a player will play, and their betting patterns. Unless the software opponent has each and every one of these actions randomized to a good extent, it will be read and played. "Perfect" poker software is not impossible, but it is a harder problem than it looks.

      -ellie

    6. Re:These people don't understand poker by Anonymous Coward · · Score: 0

      Poke is almost entirely a game of skill, not chance, at professional levels.

      Not even remotely true.
      From a larger separated pool the pros always beat amateurs , overcome bad hands and raise to the top but not when pitted against each other .

      Statistically over maybe many many hands everyone could be dealt equally strong cards evening things out . But in reality someone with repeated bad hands early on would never even last till he can get favorable cards if playing against players of equal caliber .

      A computer has no tells, and can't read them in a human player. The computer therefore has a distince edge against the amateur, and a distinct disadvantage against the pro.

      why does that put a computer at a disadvantage against a pro ????

    7. Re:These people don't understand poker by SecretSquirrel321 · · Score: 1
      If the computer has no tells and can read no tells, then I would think it would be at a disadvantage against a human player who has no tells but can read opponents tells.

      If there are 5 players, including 4 humans and one computer, and one human can read tells and hide his own tells, that player should dominate the other humans. The computer may play statistically perfect poker, but it cannot take advantage of the human tells.

    8. Re:These people don't understand poker by Anonymous Coward · · Score: 0

      The game is heads up limit hold 'em. That game is closer to a math exercise than other forms of poker. The guys that are playing polaris are highly analytical HU limit hold 'em specialists, not soul reading vegas pros of the movies.

    9. Re:These people don't understand poker by ceoyoyo · · Score: 2, Insightful

      It's certainly a hard problem. Computers are VERY good at randomization though, and they can not only calculate the exact effect of a modified bet but they can also track precisely their opponent's betting history.

      The requirement "sufficient computing resources" figures prominently, of course.

    10. Re:These people don't understand poker by Karganeth · · Score: 1

      If the computer was indeed perfect, betting history would be completely irrelevant. That is the difference between exploitative play and optimal play. If a player went all in every hand before the flop for 50X the BB at 6 max table, a bot playing exploitatively might call with TT (for example), whereas a bot playing optimally would only call with AA. The flaw with exploitative play is that he may have been going all in legitamately with AA every time and now you're a huge underdog with just two tens. With optimal play this is irrelevant.

    11. Re:These people don't understand poker by Anonymous Coward · · Score: 0

      However, if you're playing a computer that doesn't have any tells, my intuition says that the game reduces to basic probability.

      Your intuition would be wrong. You're trying to look at poker as if it's solvable given sufficient power (like chess would be).

      Poker is a game of incomplete information, and attempting to work out some of the missing information from the way your opponent plays. Some of this, the "tells", is visual. But there's a lot more to it than that. What you opponent bets, how quickly they make their decisions, what they had on the last hand (remember, in a casino the deck is not shuffled every hand), all of this gives you information about what they're holding now.

      A computer that can bluff, and attempt to read a bluff in it's opponent would have a serious advantage over a human opponent.

    12. Re:These people don't understand poker by somersault · · Score: 1

      You don't seem to be getting it. A good poker player won't always play the same hand the same way, so he can easily fool a computer that is judging everything by what has happened so far. And the AI also has to be able to bluff and do slow play effectively otherwise the professional can just fold every time the computer raises. Poker is not a 'simple' game. The maths involved in calculating pot odds isn't that spectacular as all the pros can do it in their heads, so it obviously isn't just about that.

      --
      which is totally what she said
    13. Re:These people don't understand poker by kestasjk · · Score: 1

      Poke is almost entirely a game of skill, not chance, at professional levels.

      Come on.. no professional player will ever claim that they could ever guarantee a win against a player of lesser skill.

      It's a game of skill in the long run, but for the timeframe of individual games it's very much a game of luck, and any pro will tell you this.

      You might as well say Roulette isn't a game of chance; after all in the long run the casino is a sure winner.

      --
      // MD_Update(&m,buf,j);
    14. Re:These people don't understand poker by Mr2001 · · Score: 1

      The problem is that the strategy you call "optimal" isn't really optimal at all in a game of limited information. If your strategy is to always call when the odds say you should call, and never call when they don't, then an opponent who catches on can easily bluff you out of every hand.

      If you see someone pushing all-in before the flop ten hands in a row, it's possible that he's just gotten a streak of premium hands, but it's more likely that he's bluffing with a lot of crappy hands. You'll tend to win more by assuming that he's bluffing and lowering your own requirements for calling him, i.e. using an "exploitative" strategy.

      --
      Visual IRC: Fast. Powerful. Free.
    15. Re:These people don't understand poker by EdIII · · Score: 1

      Poke is almost entirely a game of skill, not chance, at professional levels. The average dufus at his weekend poker game will play for luck.

      Your entirely wrong about that. That is what professional poker players want you to believe so that you buy their books.

      Poker is 51% luck and 49% skill.

      Professionals play the other players. A computer has no tells, and can't read them in a human player. The computer therefore has a distince edge against the amateur, and a distinct disadvantage against the pro.

      Tells are VASTLY overrated. The problem with a "tell" is that it forces you to 2nd guess what the "math" tells you to do. If you hit top trips on the turn and all your "skill" tells you that risk/reward says to make a pot sized bet, then getting a "tell" on the other players in the hand gives you conflicting information.

      Simply put, "tells" can cost you money just as much as make you money. No good poker player should rely on them solely. The "math" is always right, a "tell" is rarely proven right unless it goes to a showdown. There are some really good poker players out there that have fantastic abilities to read people. Even still, they hit losing streaks just like everybody else and have "donkeys" draw out on them time and time again on some tables. That's just bad luck.

      Like you said, a computer can neither read nor give a tell to a human player. That balances out. It does not give the computer a distinct advantage either since it is possible for people to play perfectly without the aid of databases and processors. A human player has something a computer does not, intuition. You can dismiss that if you want, but it does exist.

      From The Article:

      'It's possible, given enough computing power, for computers to play "perfectly," where over a long enough match, the program cannot lose money,"

      That is total bullshit. Once again, this is why I say that luck is a MUCH bigger factor in poker. Certainly closer to half.

      Even if you have "perfect play", which really only means that you followed the "math" every time, there will times where the other player will find the EXACT "one out" card that they need.

      For example, If you start out with AA (bullets) and flop four aces (quads) it is STILL POSSIBLE TO LOSE, although a computer would turn into a "calling station". Why not? The "math" would tell the computer that the odds of losing are so ridiculously low that it is worth it to call. I have seen it PERSONALLY. That is why it is called.... drum roll please..... a BAD BEAT.

      Here in Las Vegas, Bad Beats can pay over 100K.

      Now I know what you are saying, that statistically would not happen very often, hence the high payout. However, you can be "rivered" by just about anybody on any hand. So even if the "math" tells you that you have excellent pot odds, 80%+ chance of winning, and your miracle "tell" fairy on your shoulder tells that the other dude has exactly 3 outs, THEN IT IS STILL POSSIBLE TO LOSE.

      To say that a perfectly playing computer could not lose money is not true. Furthermore, there is no such thing as a "long enough match". The blinds are set to increase for a reason. It is so that no tournament game could go on forever. The article implies that if there were infinite time then the computer would win. Well, obviously infinite is pushing it. Let's be real.

      Some people just don't want to hear it, but luck plays a major factor in games like Poker. Take it from somebody who plays quite often both online and live. I have seen things that defy statistics more often than I have seen things conform to statistics. Explain how with 2 decks (machine shuffled) I could be dealt pocket deuces 7 times in 11 hands, 4 of them sequentially, and ALL 11 hands still having a deuce? How during those 11 hands, I flopped another deuce 3 times? How I could get AA, KK, QQ, QQ, JJ all in a row AND LOSE $600 with perfect play?

      A real professional learns to start trusting his intuition as much as his understanding of "math" and that even knowing your opponents cards every time does not guarantee a win (pre-flop or before showdown of course.)

    16. Re:These people don't understand poker by Anonymous Coward · · Score: 0

      After a few rounds you get a feel for the types of starting hands a player will play, and their betting patterns. Unless the software opponent has each and every one of these actions randomized to a good extent, it will be read and played.

      Actually, in poker there is a mathematically correct hand to play in any given situation. Basically, is the size of the pot multiplied by your chances of winning it greater than the cost of continuing the hand? If so, raise. If not, fold. This does not at all depend on the actions of your opponents, only of the odds of your own hand. (Everything ceoyoyo said is correct, as far as I know.)

    17. Re:These people don't understand poker by Strilanc · · Score: 1

      That's actually not true. 'Optimal' play means you are at least as good as every player, it doesn't mean you are the best against every player. You can sometimes do better against poor players by making moves that good players would counter.

      A computer with a perfect model of their (non-optimal) opponent will do better in the long run than a computer just playing the probabilities.

    18. Re:These people don't understand poker by Anonymous Coward · · Score: 0

      I want to play against you

    19. Re:These people don't understand poker by ceoyoyo · · Score: 1

      Could be, but it's at least as likely that the people saying poker couldn't possibly be solved by a computer are wrong. They're working on intuition too.

      Incomplete information means nothing. It simply means you have to play by probability, something computers are potentially MUCH better at than people, particularly when the game is complex. Calculating simple odds is easy. Calculating moderately difficult odds is something only the best can do. When the situation is even a bit complex a person has to resort to approximations, but the computer can still go right on calculating precise probabilities.

      A computer also has a potential advantage for any kind of tell based on timing, bet amount, or any such easily measurable quantity. It can track opponents perfectly, for the entire game, or many games, if the data is available. As for unshuffled decks, the computer is a perfect card counter that never gets flustered, inattentive or confused.

      I don't have a good feeling for whether a computer that strictly played the odds would be unbeatable (in the long term) against an opponent playing tells. There are posts here asserting both yay and nay, but it doesn't seem obvious either way when you stop and think about it.

    20. Re:These people don't understand poker by Anonymous Coward · · Score: 0

      Hah.

      Well the mathematically correct play is not necessarily the one you want to make. That's where the psychology of the game comes in - based on your opponents behaviour what do you think his hand is?

      Of course I could very well be completely off on my understanding of the game... I've never actually played it. I'm more of a Blackjack kinda guy anyway.

    21. Re:These people don't understand poker by Anonymous Coward · · Score: 1, Interesting

      I was actually at the previous match of Polaris vs the humans and watched several of the rounds. It was kind of funny watching the 'unibomber' call the computer 'sick' every time he lost a hand.

      Polaris was actually programmed to use different strategies in the different rounds. The human players adapted to this by using the opening rounds to get a sense of the algorithm behind the strategy for the round, and did what seemed to be a fairly good job of it. They also worked in concert, discussing strategy with each other before the rounds started, whereas Polaris just used the same algorithm on different sides of the cards.

      There is no perfect program for something like this. There are no perfect programmers. In a way the human players tried to figure out what was behind the thought process of the human programmers, and when they did, they won.

    22. Re:These people don't understand poker by Anonymous Coward · · Score: 0

      this works other way also. Most pro players beat amateur players with basic play, they know how and when to bet. When a pro player plays against another pro player, they have to change their tactics and phase/aggressiveness of their play during the game - because the other pro player might catch up with their patterns. How random are these changes of phase/aggressiveness for pro players, I don't know, but it might get a bit hard to do something surprising if the opponent remembers all your hands for the last 8 hours (or even your whole career) instead of the last 10-15 hands.

      mku

    23. Re:These people don't understand poker by Imsdal · · Score: 1

      Well the mathematically correct play is not necessarily the one you want to make. That's where the psychology of the game comes in

      The first part is maybe correct. The second part is wrong. This is very simple game theory where it is supremely easy to prove that a mixed strategy is optimal. Calculating the exact details of said mixed strategy is of course supremely hard, which is what makes poker interesting. That and the fact that dummies like to part with their money...

    24. Re:These people don't understand poker by Krommenaas · · Score: 1

      Poker is almost entirely a game of skill, not chance, at professional levels.

      Oh please. Poker is almost entirely a game of chance, at all levels. There have been televised WPT events won by first-time players, including one who at the final table STILL didn't know whether a full house beat a straight or not. The myth of poker being a game of skill is perpetuated for marketing reasons, but the reason for poker's huge success is precisely that anyone can beat anyone.

      Online, pro players spend their days either looking for clueless newbies to rob, or playing on 4 or 8 tables simultaneously using a simple formula. In real-life, the pro poker players are marketing creations who only make it to televised games so often because those games are invite-only.

      The most telling indication of how poker is all about luck is when betting markets like Betfair organise bets on poker tournament winners. No matter how many famous players they list, the favourite to win the tournament is always "Other", with odds below 2 to 1, while no single player ever gets odds below 50 to 1. For comparison, Federer typically gets 2 to 1 odds for winning a major tennis tournament. That's because tennis is a game of skill, and poker is not.

    25. Re:These people don't understand poker by neoform · · Score: 1

      Poke is almost entirely a game of skill, not chance, at professional levels.

      Have you ever watched final tables where pros are seated? There are plenty of times where chance plays a huge part, all-in pre-flop is a great example. An all-in preflop with anything less than pocket aces will result in the possibility of having anywhere between 74% edge on a single opponent, all the way down to an 18% chance of winning.

      Poker is a game of chance (where skill plays a big part, by keeping you away from high risk situations).

      --
      MABASPLOOM!
    26. Re:These people don't understand poker by ElizabethGreene · · Score: 1

      Yes, that is mathematically the best way to play. And if you play that way on one of my tables you will very shortly be separated from your money. Why? Because you will be in every pot that has more than 4 players. And you will tell me when you have a good hand by raising, and how good your hand is. If I have a good hand I'll reraise you and you'll call, paying me off. If I have crap I'll throw a HUGE bet out and you'll fold it away.

      See how that doesn't work? If you play purely mathematically, playing "perfectly", you lose to an aggressive player.

      -ellie

    27. Re:These people don't understand poker by ElizabethGreene · · Score: 1

      I was thinking about it this morning and we are approaching this the wrong way.

      Some guy, in Vegas, says he has a system that can't lose. Don't believe it even if you see it.

      -ellie

    28. Re:These people don't understand poker by $carab · · Score: 1

      Computers having problems playing randomly?

      Nope. If anything, computers are waaay better at random play than people. People are terrible at generating sequences that pass randomness tests, whereas computers can do this quite well.

    29. Re:These people don't understand poker by NoOneInParticular · · Score: 1

      Optimal play is different. If the odds say you should call 9 out of 10 times, you draw a random number and call exactly 9 out of 10 times. No information is given to the opponent, and the strategy cannot be exploited. Of course, this all assumes that you can calculate the optimal odds, which is doubtful.

    30. Re:These people don't understand poker by ElizabethGreene · · Score: 1

      EllieGreene on Pokerstars. I usually play 1 or 2 50,000 (PLAY MONEY) sit and go's every day.

    31. Re:These people don't understand poker by Mr2001 · · Score: 1

      I'm not sure that's an improvement. Let me see if I understand what you're saying correctly...

      Suppose I'm considering calling $100 to win a total of $400 (25% pot odds), and suppose I correctly predict that I have a 50% chance of winning the hand.

      If I always call here, then half the time, I'll win $300, and the other half I'll lose $100. My expectation is 300 * .50 - 100 * .50, or +$100.

      On the other hand, if I randomize my play and only call 75% of the time according to my pot odds, then 1/4 of the time I break even (fold), 3/8 of the time I win $300, and 3/8 of the time I lose $100. My expectation is (0 * .25) + (300 * .50 - 100 * .50) * .75, or +$75. (If I only call 50% of the time according to my odds of winning, then my expectation is only +$50.)

      It looks like calling every time is the better strategy. Am I missing something here? What is the information I'm paying $25 to avoid giving my opponent, and how do I know it's worth that much?

      --
      Visual IRC: Fast. Powerful. Free.
  12. Killer App by Plazmid · · Score: 1

    Best application of AI ever

    1. Re:Killer App by ElizabethGreene · · Score: 1

      Software is actually at a disadvantage when it comes to playing poker at the professional level. A person can infer when another player has a read on her and adjust play to neutralize or take advantage of the opponent's confidence. This all becomes quite fuzzy and recursive when you try to emulate it in software. Sort of like the princess bride. "I know that you know that I know that you know that **TTL EXPIRED IN TRANSIT"

      At the cheaper blinds though a software application could easily make money. I am NOT a great player and can make about $10 an hour just playing the top 5 hands on a 1-2cent table at Pokerstars. People are really predictable at that level, but it feels like work after a while and I enjoy my day job more.

      -ellie

    2. Re:Killer App by clampolo · · Score: 1

      The guy heading this thing up is Jonathan Schaeffer. He wrote the Chinook program that was the draughts(checkers to you and me) championship. So there are some heavy hitters behind this thing.

  13. perfect game? by circletimessquare · · Score: 4, Funny

    i don't believe it. he's bluffing

    --
    intellectual property law is philosophically incoherent. it is your moral duty to ignore it or sabotage it
  14. I for one... by Anonymous Coward · · Score: 0

    I for one welcome our new poker playing robot overlords.

  15. So What! it's Chess all over again! by Robert+Halcombe · · Score: 1

    This is akin to the Human Chess Player vs The Computer. Why is this even news?

    --
    Need a Russian bride? I have a large supply in a warehouse waiting for you. I offer a great trade-in plan too! Robert H
    1. Re:So What! it's Chess all over again! by ragethehotey · · Score: 5, Insightful

      Because Chess is a game of complete information, and is largely a matter of brute forcing out the best move from tons of choices. Poker is a game of incomplete information (You do not know your opponents hand), as the decisions your opponent will make influence what the "correct" decision for you to make is. Chess was a matter of computing power, whereas poker is a matter of implementing game theory abilities in the AI.

    2. Re:So What! it's Chess all over again! by Tragek · · Score: 3, Insightful

      Because as they've said at their page poker has a lot more applications to the real world later. this is all about making intelligent decisions with imperfect information. Chess can simply be brute forced eventually, just like checkers was.

    3. Re:So What! it's Chess all over again! by Anonymous Coward · · Score: 0

      These dudes at U of C have a system that learns the play style of its opponents. It first actively plays in ways that let it gather information about how the other players perform, then it crushes them.

    4. Re:So What! it's Chess all over again! by smontgomerie · · Score: 1

      I believe Polaris has style-learning abilities as well.

      "Polaris's second ability is learning. The program studies how opponents are playing and makes adjustments to its style in response. At last year's event in Vancouver, the machine played the first two matches purely on its memory, earning a draw and a victory. For the third and fourth matches, the scientists activated its learning mechanism, programming Polaris based on what they had seen from opponents Phil Laak and Ali Eslami."

      http://www.canada.com/edmontonjournal/news/story.html?id=714f37e4-c680-4863-8db1-a772c53e8dd9

    5. Re:So What! it's Chess all over again! by Ninja+Programmer · · Score: 1

      This "lack of information" in poker is just a detail in the model of the game which makes the problem different and interesting. However, the process of making a poker-bot outplay a human is similar to what is doing in chess: convert brute force computational power into a solution to a decision making problem.

      From a sequence of bets the bot must work out the probability of every possible hand his opponent might have that corresponds to that bet sequence, and compare it to its own hand, as well as the potential sequence of cards that might come up. Then the computer must estimate the effectiveness of each of its possible responses (call/check, raise, fold). Working out the exact odds is actually quite a difficult problem (from a bet sequence, to guessing the actual cards the opponent has), and thus Monte-Carlo methods may be used to estimate the odds. But you can always throw more computational horsepower at a Monte-Carlo simulation to get more accurate estimates.

      The big difference between poker and chess, really, is that chess is a much *deeper* game than poker. When a top GM plays serious against a computer, s/he still has a chance because there is enough richness in the game to find very creative ideas that computers cannot calculate.

      This can be difficult to understand unless you play chess seriously. But even as a moderate untitled player myself, I have managed to draw multiple times against Fritz 9.0 (who beat the World Champion in a match) by playing fortresses (creating locked pawns which prevent both sides from making progress regardless of material differences), playing convoluted repetitions, and reaching theoretically drawn endings even though I am material down (which the computer doesn't realize is a draw until too late). Top players can do what I do, only a lot better and more consistently, and find deeper ideas for actually winning games against the computer.

      With computer poker I just don't see the same depth of complexity. Once you've worked out the odds and decided whether or not to bluff, semi-bluff or whatever, there just doesn't seem to be much else going on.

    6. Re:So What! it's Chess all over again! by bryonak · · Score: 1

      I've spent some time on chess AI... modern chess engines actually include a lot of weighted probability models paired with game theory. Number crunching engines have no say in the top tournaments because we simply lack the processing power to calculate that many variations.

      Makes me wonder whether poker can be "brute forced" too.
      All possible moves (raise, fold, check ...) in an average poker game amount to much less than the count of possible variations in an average chess game (36-40 moves).

      Then you just have to weigh this with an appropriate model... well that might be a wee bit tricky, but then there'd be a "variation tree" from which one can choose the best move each turn. Such a model would differ from just calculating the best momentary odds in that it calculates the opponents decisions too and one can make the decision at every point depending on the outcome many turns later.
      Thats actually how brute forcing chess would work... something we are _very_ far away from achieving.

    7. Re:So What! it's Chess all over again! by Tragek · · Score: 1

      I managed to catch a lecture from the CPRG who are building Polaris 2. While I'm not an AI guy, the gist I got was that there are something like 10^30 states in poker (too many). so what's done here is that there's an abstraction to a simpler game, which is solved, then mapped back to poker.

      As well there was a training stage using something called Counterfactual regret... again, Not an AI guy.

      All in all, I think the real challenge of computer poker is the incomplete information.

    8. Re:So What! it's Chess all over again! by Anonymous Coward · · Score: 0


      Chess can simply be brute forced eventually

      No... Contrarily to checkers or go, the combinatorial explosion with chess guarantees that, at this state of knowledge in mathematics and physics, we don't have enough atoms in the universe to build a computer that would be able, one day, to solve chess.

    9. Re:So What! it's Chess all over again! by mick14731 · · Score: 1

      interesting fact, the proff leading this project was the first person to make a perfect checkers bot

    10. Re:So What! it's Chess all over again! by ragethehotey · · Score: 1

      Working out the exact odds is actually quite a difficult problem (from a bet sequence, to guessing the actual cards the opponent has), and thus Monte-Carlo methods may be used to estimate the odds. But you can always throw more computational horsepower at a Monte-Carlo simulation to get more accurate estimates.

      This could not be any farther from the truth. Any competent player is already very familiar with at least a ballpark figure on the odds of any given situation, (ie: if i am drawing at only a flush with two cards to come, i am about a 2-to-1 underdog)

      A computer player that plays "perfectly" according to the odds and math alone is doomed, as what the computer has in any given situation becomes incredibly transparent and inherently exploitable (the CPU would likely only play around the top 10% of hands, all other times you could bluff it over and over with impunity until it was broke) A successful player MUST make "mistakes" in order to cause a degree of uncertainty to their betting patterns and what they can hold at any given moment.

      Furthermore, separate strategies must be devised against each and every other player, in order to win the most $$$ possible when you have the best hand, and lose the least $$$ possible when you are beat. (It may be the mathematically correct play to bet amount X against player A, but player A will only call amount X if he has you beat, but WILL call smaller amount Y even when you have him beaten)

    11. Re:So What! it's Chess all over again! by FlyingSquidStudios · · Score: 1
    12. Re:So What! it's Chess all over again! by drinkypoo · · Score: 1

      I thought the implication was that since with chess you have complete information, it's possible to brute force it - just as it is possible to do with checkers. The same is not true of poker for a variety of reasons including not knowing what cards the other players have (although it is possible to guess, and people can and do in fact do this with some level of success.) If we knew where every subatomic particle in the universe was (or every one capable of interacting) and knew precisely what they would do in any given situation then given a computer complex and fast enough (perhaps in another dimension - don't be so linear!) we could ostensibly model potential consequences of actions in the physical world... perfectly. There are obvious problems with implementing such a scheme, however...

      --
      "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
  16. Re:Reminds me of those... by Anonymous Coward · · Score: 1

    when I google your phrase about 100%+ slots in Vegas, I get no results whatsoever -- because why the FUCK would a casino keep a machine on the floor that lost money every year (or every five years, or every decade). They know the odds. You put money. You pull. You put money. You pull. Nothing changes whether one person continues for forty years or a hundred thousand people continue through forty years, it looks the same from the casino's perspective for that particular slot machine.

  17. To correct the article by tansey · · Score: 1

    We're not so sure about that, though. Poker is a very complicated game incorporating not only mathematical betting and statistical odds but also the important skills of expectation, observation and learning, psychology and deception, intimidation and subterfuge.

    So to break it down:

    Expectation - This is a "statistical odds" issue.

    Observation and Learning - Yes, and this is a program designed by the Machine Learning group at UoA.

    Psychology and Deception - Deception is simply varying your play by making it probabilistic rather than static. Psychology is only necessary if you wish to take advantage of your opponents' in order to maximize your own play, it has nothing to do with a game theoretical approach. Also, the computer has no such psychological weaknesses.

    Intimidation and Subterfuge - Subterfuge basically goes back to deception again. Intimidation in the world of online poker is essentially proper bet sizing, timing, and position.

    An AI player has very little downside here, except for the fact that hold'em is a very computationally intensive game. The UoA team has spent the last decade developing better algorithms and game theoretic approximations to combat this.

    All that said, they are still a long way from being able to sign their laptop up for the main event at the WSOP, or sit it down at the Bellagio's high stakes table.

    Also, the competition is in July (i.e. right now), not June like the article says.

  18. Wrong date? by Antwerp+Atom · · Score: 1

    Polaris will be pitted against several professionals at the Rio Hotel between June 3rd and 6th

    Uhm is this date correct?
    If it is give me the results already if it isn't the article was wrong and the submitter copied the error.

    1. Re:Wrong date? by Anonymous Coward · · Score: 0

      Next year will have a June, too. I thought you knew that.

    2. Re:Wrong date? by Anonymous Coward · · Score: 0

      The Article itself says June, so either its OldNews, or they printed the wrong date in the news article.

    3. Re:Wrong date? by Anonymous Coward · · Score: 0

      http://www.wsop2008.com/wsop-2008-schedule.php

      I thought the same. Do they do the '08 finals in '09?

    4. Re:Wrong date? by asCii88 · · Score: 0

      Yeah, but next year will have a 9 after the two 0.

      The date is wrong, it's not June, it's July.
      http://poker.cs.ualberta.ca/man-machine/

  19. Link to the competition page by tansey · · Score: 5, Informative
  20. Re:Reminds me of those... by Anonymous Coward · · Score: 0

    It is possible for a casino to have 100%+ machines, but only if the jackpot is "progressive" and only at times when it has progressed enough.

  21. Put two in a room... by binaryspiral · · Score: 0, Redundant

    Put two of these in a room and see who wins.

    1. Re:Put two in a room... by Anonymous Coward · · Score: 0

      Imagine a Beowulf cluster of these!

  22. Re:Reminds me of those... by Random+Destruction · · Score: 1

    I dont know about over 100%, but I know some of the low denomination machines pay off really well. I guess the idea is you think winning is so easy, you might as well go to a larger denomination machine.

    --
    :x
  23. Re:Reminds me of those... by wattrlz · · Score: 3, Funny

    Most 100%+ slots I've seen, in Vegas, stipulate that you only get 100% of your money back, "with perfect play". Which would mean the majority of people would still loose plenty of money. Besides, even if you did double your money on a 106% slot you'd probably blow it all on craps five seconds later anyway.

  24. Re:Reminds me of those... by retchdog · · Score: 3, Interesting

    If the machine "loses" (assuming 100% utilization) less than $4/hour on average, they almost certainly come out ahead on amenities/drinks; family members and friends playing other games; people getting bored of the low-payoff slots and losing money on other games; etc. Slots are there partly to keep "non-gamblers" busy pulling a lever, while their acquaintances piss away larger sums.

    Once the machine gives away around minimum wage or higher, you might start getting crazies and obsessives working it.

    --
    "They were pure niggers." – Noam Chomsky
  25. Computers aren't yet "intelligent"... by ag3ntugly · · Score: 0

    and thus, if the human is good enough, they might be able to pick out patterns in the decisions the computer makes and exploit them. The computer can't learn how to adapt to each opponenent nearly as well as the human players can. I play hold 'em all the time and I can tell you if you can't keep up with someone's changes in strategy you're going to lose. Also, if you play exactly the same every hand, everyone else on the table will pick up on it, and own you.

    --
    i have a roll of electrical tape.
    1. Re:Computers aren't yet "intelligent"... by Thinboy00 · · Score: 1

      Only if the computer's play is entirely deterministic. If it's probabilistic (think oddly angled room), patterns are pure statistical artifacts/anomalies depending on the type of pattern, and are completely useless for making predictions.

      --
      $ make available
  26. Re:Reminds me of those... by alrudd1287 · · Score: 5, Insightful

    Playing perfectly = keeping 100% of your money in your wallet

  27. Limited information ruins 'perfect play' by bigmacd24 · · Score: 0

    Computers play 'perfect' poker, i.e. the computer looks at the cards on the table, the cards in it's hand, and the bet's it opponent has made, and figures out if calling the bet, or raising the bet is appropriate statistically, based on the chance of it's payout vs. it's chance of getting 'the winning hand'. In the end, when two perfect players play against each other, they both get the same amount of information, and the difference between their scores will be determined by the random-chance of the deck. The critical flaw of the 'perfect play' system is too rigid adherance to the system. By betting on a predictable system, they grant their opponent an insight into their hands, and therefore, more information. A bet from a perfect player communicates more than just the new odd's on the pot for his opponent, but also allows his opponent to have a better read on what hand the perfect player /has/. More information=better play. Of course, this is seven card limit texas hold'em, a very formulaic and restricted betting structure will severly limit players abillity to exploit their informational advantage. Professional poker requires an adaptive system which compensates for the meta-game of people's betting. It's possible their AI does this, but simply playing 'perfect poker' is no acheivment, any grade 12 math student with a bit of practice and a head for odds can play /near/ perfect (i.e. perfect enough that in the limited set of hands they see they have a good chance of making no mistakes). If beating professionals was as easy as not having any tells, and being able to perform reasonable amounts of math, the final table at poker tournaments would be alot more diverse.

  28. Re:Reminds me of those... by ZombieWomble · · Score: 2, Interesting

    100%+ "pure" slot games aren't exactly common (because as you say, they will invariably lose you money). What is very common is 100%+ return poker machines or games with similar levels of user input, where the machines pay out more than 100% if you play 'perfectly', forever. Of course perfect play is often unintuitive and involves things like taking the safe bet rather than higher payout options - not something most people in Vegas are renowned for.

  29. BIG DEAL. They are talking about LIMIT hold'em! by javabandit · · Score: 3, Insightful

    I'm not sure why anyone thinks this is such a feat. In LIMIT hold'em, bluffing, psychological aspects, and implied odds are diminished to the point of meaning next to nothing. It is almost a purely computational game. So, yes, a computer can play technically "perfect".

    There are already poker "bots" out there that will play pretty much perfectly when it comes to Limit Hold'em. I'm not sure why this is so different.

    I want to see this team of academics write some code that will beat a human at *No-Limit* Hold'em. Or maybe *Pot-Limit* Omaha. NEVER going to happen.

    I don't care how well such a program is coded... it will absolutely buckle under the pressure of a professional who constantly bets half his stack on nothing. The machine would turn into a professional folding station that only plays AA, KK, or AK. Guess what? That strategy isn't winning any games or any period of time in a no-limit or pot-limit world.

  30. Re:BIG DEAL. They are talking about LIMIT hold'em! by tommeke100 · · Score: 4, Funny

    AK? That's Called an Anna Kournikova...She looks good, but never wins ;-)

  31. Impossible by definition by Weaselmancer · · Score: 1

    'It's possible, given enough computing power, for computers to play "perfectly," where over a long enough match, the program cannot lose money," said associate professor Michael Bowling.'"

    Impossible.

    Here's why. Put four of these at the same table with no humans.

    Someone will *have* to be the loser.

    --
    Weaselmancer
    rediculous.
    1. Re:Impossible by definition by sjhs · · Score: 2, Funny

      Someone will *have* to be the loser.

      You're assuming the game actually ends. But we know that computers are prone to infinite loops :-p.

    2. Re:Impossible by definition by Anonymous Coward · · Score: 0

      No. In theory it's possible all four will come out as a draw; where they all end up with as much money as they started with.

  32. haha by Anonymous Coward · · Score: 0

    We're not so sure about that, though. Poker is a very complicated game incorporating not only mathematical betting and statistical odds but also the important skills of expectation, observation and learning, psychology and deception, intimidation and subterfuge.

    Lol @ poker players who don't understand math

  33. Intellivision Poker? by Anonymous Coward · · Score: 0

    In my head, this computer's monitor is sitting at the table using a likeness of the dealer from that old Intellivision poker game.

  34. Re:Reminds me of those... by ConanG · · Score: 1

    Actually, video poker machines with +100% payout are harder to come by than they used to be. There are actually websites out there where people track which machines have the best payouts. These are professionals who make their living (or a good portion of it) gaming the system.

    Some of you are probably asking, "Why the FSCK would they make machines that payout more than they take in???"
    It's mostly what the parent said. Most people don't play perfectly and therefore lose money playing. They make the payout system complicated enough so that very few people can actually play well enough to consistently win. Then they pull in the people who think they are good enough, so it works in their favor!

  35. Not necessary by Anonymous Coward · · Score: 0

    >Java has, and will always be slower then assembly.

    It all depends on who writes the code.

  36. Re:Reminds me of those... by ragethehotey · · Score: 2, Informative

    You are fundamentally mis-understanding the importance of variance. Try to think of it in the REALLY big picture of the long term. If I offer you a game you spin a wheel where the bet is $1000, and 999 out of 1000 times you will lose everything, and 1 time out of 1000 you will get paid $100,001 dollars, my game is now paying out OVER 100%. Now this is a simplified example, but almost NOBODY is willing to take those swings of variance for such a ridiculously small edge. The casino has almost unlimited amounts of money, and can ALWAYS bear the swings. This is also besides the point that there are MAYBE only a handful of them on the casino floor and they are always filled in the WAY back of the casino, ensuring that for giving up a tiny edge, hundreds of gamblers will come in and try, and give up.

  37. Duh by Anonymous Coward · · Score: 0

    Over the short term, one wins by chance.

    Over the long term, they tie.

  38. Re:Reminds me of those... by gfody · · Score: 1

    I think it's more likely that casinos have 0% slots. The slot machine never ever pays out. This of course doesn't dissuade your average gambler.

    --

    bite my glorious golden ass.
  39. Running Commentary: by Fluffeh · · Score: 1

    You Bluff.

    You have been eaten by a Grue.

    You die.

    --
    Moved to http://soylentnews.org/. You are invited to join us too!
  40. Re:BIG DEAL. They are talking about LIMIT hold'em! by the+brown+guy · · Score: 1

    +1 informative if i had points

    I assumed that it was no-limit hold'em because that's what most people play, and all the poker shows on TV are predominantly no limit based, it's just more exciting.

    --
    Orbis terrarum est non altus satis
  41. Machine VS N-Machines by toby360 · · Score: 1

    'It's possible, given enough computing power, for computers to play "perfectly," where over a long enough match, the program cannot lose money," said associate professor Michael Bowling.'" I don't think this statment is accurate. In poker there is no such thing as playing perfectly, you are in the end always left to chance to some extent. How could the above statement be true if it were pitted against several copies of itself? There is no way they could all play perfectly, if one is in the lead it means all the others are losers. If one of the machines were to win a few lucky hands at the start... it already has an advantage of having a bigger pot, at this point it can then maximize its odds using some strategy, however this is not guaranteed and again to get to this point it still up to chance.

  42. Additional cards not needed. by raehl · · Score: 2, Insightful

    The Pros will still win, because the Pros have more information than the computer, if the computer is always playing optimally.

    That's what makes the Pros pros. People who play mathematically optimum poker lose, because they are ignoring the information that is important: What cards does the opponent have?

    In fact, I'd wager (hah!) that a computer playing mathematically optimum poker is at a disadvantage, as it makes it much easier for a Pro to determine what cards the computer has.

    1. Re:Additional cards not needed. by mOdQuArK! · · Score: 1

      What gives you the idea that "mathematically optimum" only dealt with the cards that the computer can see?

      Given enough computing power, a machine will always be able to calculate the exact probability of every possible hand that its opponent might have, now & into the near future, without being fooled by stuff like bluffs or feints. (It's also possible that it might be able to detecting cheating like slipping an extra card into play when a result occurs which it has calculated to be "impossible".)

      If the pros are going to beat a sufficiently powerful machine, they'll basically have to do what chess players going against machines often do: take advantage of both the predictableness of the machine's algorithms, plus the machine's weaknesses at forecasting the moves of its opponents. While the machine might be able to calculate exact probabilities for every possible move into the near future, its longer-term decision-making abilities are only going to be as good as the expert knowledge that its programmers are able to build into its heuristics.

      The guys who are good enough to plan strategies that extend beyond the machine's "perfect knowledge horizon" are going to be the ones who can beat it regularly. The guys who can plan only a step or two ahead will be able to depend only on luck.

    2. Re:Additional cards not needed. by Anonymous Coward · · Score: 0

      I don't think an optimal strategy for poker has been found yet. However, by definition, if computer plays optimally it can't win or lose, it will break even. Playing optimally does not imply being predictable.

    3. Re:Additional cards not needed. by vikstar · · Score: 3, Interesting

      Any comp sci grad can write a "perfect" poker program that plays "optimally" with your definition of optimality and perfectionism, ie, ignoring bluffing. The trick to Poker, the reason why it is so appealing as an Artificial Intelligence benchmark is because it requires the AI to learn a particular players loosness/agressivness when they are likely bluffing etc. This is not only to try to determine what the other players have, but also to try to bluff to the other players what the AI has.

      The truly optimum poker player will learn what the opponents have by observing their betting patterns over the course of many hands and learning their particular tendencies.

      --
      The question of whether a computer can think is no more interesting than the question of whether a submarine can swim.
    4. Re:Additional cards not needed. by JMZero · · Score: 1

      Pros may have an advantage against other humans (that they could read) but they wouldn't have any information advantage against an ideal computer player.

      You have to understand: the ideal computer would not be predictable - it wouldn't always be choosing some "optimal" move in each situation. Rather, it would choose strategies probabilistically such that there is no strategy that would win against it over many hands.

      Poker is complicated, but it can still be solved as a zero sum game treating every possible strategy as a single move.

      --
      Let's not stir that bag of worms...
    5. Re:Additional cards not needed. by smallfries · · Score: 1

      No. You are assuming that an optimal strategy would be deterministic. In fact it will be a mixed (probabilistic) strategy. The random mixing prevents the other side from determining your cards and style of play with high enough odds to beat you.

      --
      Slashdot: where don knuth is an idiot because he cant grasp the awesome power of php
    6. Re:Additional cards not needed. by edmazur · · Score: 2, Insightful

      People who play mathematically optimum poker lose, because they are ignoring the information that is important: What cards does the opponent have?

      Who says they're ignoring their opponents' cards? There's more to making optimal decisions than your own cards. I think the general idea is that while you cannot know exactly what your opponent is holding, you can put them on ranges of hands with certain probabilities and then factor that into your calculations. You could say for example that your opponent has a high pocket pair with 40% probability, a drawing hand with 25%, trips with 5%, and garbage with 30%. From there, it's a relatively straight-forward expected value calculation to figure out if you should call that $5 raise on the $20 pot.

      The tricky part is correctly estimating the probabilities of those ranges of hands. Does player A have a tendency to call in late position with suited aces? Does player B always raise with AK/AQ/AJ/AT? Does player C steal blinds a lot? All of these factors and more come into play. Humans are good at pattern matching and after enough hours at the table, you're bound to notice a few recurring profitable sequences of actions. Could computers more accurately assign ranges of hands/probabilities? It's certainly possible.

    7. Re:Additional cards not needed. by srjh · · Score: 1

      It's probably similar to saying a computer program can play mathematically optimum "scissors, paper, rock" or whatever your local name for the game is.

      Against a weak, predictable player, they will definitely have an edge, but under a worst-case scenario, they can default to a completely random play to ensure that their EV doesn't fall below zero.

    8. Re:Additional cards not needed. by teh+moges · · Score: 4, Insightful

      This is a very ignorant view of what optimal play means. The standard example is Rock-Paper-Scissors (RoShamBo). If I play perfectly randomly, and I tell you that I am going to play perfectly randomly, there is exactly nothing you can do to beat me in the long run. This concept can be extended to poker (and all two player zero-sum games). For a computer to play truely optimal means that it can give you its exact strategy before the match and you still won't be able to beat it. A mathematically optimal play is still the same regardless of what the opponent has. Truely optimal play hides the true nature of the hidden cards from being able to be predicted by the opponent. If, by "mathematically optimum poker", you mean immediate pot odds, then you are right. Its easily beatable, however that is certainly not what mathematically optimal poker is. I suggest reading "The Mathematics of Poker" (http://www.amazon.com/Mathematics-Poker-Bill-Chen/dp/1886070253), it will absolutely change your mind into how mathematics can be used.

    9. Re:Additional cards not needed. by skiingyac · · Score: 1

      Actually, the computer WOULD be predictable, exactly because it will always choose some "optimal" move. So if you present it with some "obvious" decision, you know which way it will act.

      I.e. everyone at the table could always go all in once a hand is between the computer and itself, then the computer will be forced to either fold most of the time and slowly lose money, or call and if everyone is doing this against the computer it will not likely be the last player standing.

    10. Re:Additional cards not needed. by ksd1337 · · Score: 1

      This is similar to why computers are grandmasters in chess. The computer gets to calculate all the possible choices before it makes its move, because it has data on the opponent. Poker, on the other hand (crappy pun not intended), is a game where you're not supposed to give data to your opponent. A computer will only win a game when it has enough data on the opponent (or game itself in some situations) to do so.

    11. Re:Additional cards not needed. by epine · · Score: 4, Interesting

      One intelligent comment on this thread. We can model that with a Poisson distribution.

      What was your tell? Translating "mathematically optimum poker" to "immediate pot odds". Optimum? Which optimum? You mean there's more than one? I fold.

      OK, what you say is right, but it applies to two-person, zero-sum games. In multi-player games, no strategy is immune to collusion.

      Let's refer to optimum play from the conventional game-theoretic context as the unbeatable strategy. Such a two person, zero-sum game such a strategy exists.

      It's not necessarily an easy computation. It's a randomized strategy which can be computed before-hand. The U of A people are better are performing this computation.

      Even so, they had to simplify the betting structure to make the problem tractable. This is the reason they chose Limit Hold'em. Fewer betting states, smaller game tree, exponentially faster solution time.

      There is no particular challenge to No Limit, if the number of allowable betting states were similarly constricted. I think it would be hard to sufficiently constrict this, because strategy would vary as a function of chip stack for both competitors. Maybe it could be roughly interpolated.

      As far as randomized play is concerned, the unbeatable strategy tends to be far more randomized than most humans. One expert who played against the U of A system a while back said that his first session was a nightmare until he learned that he couldn't bluff the computer out. The computer had a tendency to call aggressive betting. It expected highly randomized bids based on its own bidding structure, so didn't make a strong inference of strength when confronted by the behaviour.

      What few seem to understand is that the unbeatable solution is entirely unlike poker. The unbeatable solution rarely wins. The unbeatable solution will often draw against strategies with glaring weaknesses. It won't ever be beaten, but it also won't maximize advantage of opponent's weaknesses.

      Why not? Because it's impossible to take advantage of the weakness in an opponent without exposing yourself to a counter-measure where you would lose (you must stray from the unbeatable path). When you take advantage of a weak opponent, you do it on faith that the opponent is too dumb to spring the optimal counter-measure to your strategic adaptation.

      The theory that U of A employs has far less to say about exploiting the weaknesses of your adversary. To do so requires exposing a weakness in your own strategy. How does the algorithm judge whether the exposed weakness is acceptable? Even poor human players can spot certain kinds of weaknesses quickly. There are other weaknesses an expert might not immediately spot. How does the program know which weaknesses are a risk against which players? It doesn't fall out of game theory, it's a matter of human cognition and psychology, and our model for this is far from complete.

      One thing we need to include in this model is the incredible difficulty in explaining to most humans that winning in poker and not losing in poker are entirely different enterprises, with entirely different theoretical foundations. Commander Data has trouble assimilating that fact. 100 trillion brain cells and most of us can't reliably multiply a pair of two digit numbers. If computers had invented humans as part of a BI program (biological intelligence), humans would have been tossed aside as barely having achieved perfect game play at Tic-Tac-Toe. What use is 100 trillion brain cells that can't reliably compute a 15% tip after a heavy lunch? Many computers would like to know.

      As computers became better at chess, chess as a human enterprise was somewhat devalued. Few of us wish to put the work into it that the modern theory requires.

      I fear the same will soon happen with poker. As the elements of the unbeatable strategy become better known, the relatively inexperienced players can hunker down and not lose much money. They won't be able to win, either, because t

    12. Re:Additional cards not needed. by JMZero · · Score: 1

      Actually, the computer WOULD be predictable, exactly because it will always choose some "optimal" move.

      No, it wouldn't. Read the article I linked to - it's a good introduction to the relevant game theory.

      But, to simplify: an "unbeatable" strategy doesn't imply one move for each game state. Take rock/paper/scissors. The computer doesn't have to analyze your moves and try to guess what you're going to do. All it has to do is randomly pick a move and, over time, it will come out even. It's an unbeatable strategy.

      Poker is more complex than RPS obviously, but the principle is the same. When looking at poker, instead of just one move, we have to consider an entire strategy as a move (ie. a complete list of reachable game states and an associated play for each of those states).

      Given strategies for each player, there's an expected value of a hand over all possible cards. For each hand, we choose a strategy probabilistically such that our expected value across possible opposing strategies is maximized. Note that a given hand may have a negative expected value since one player goes first, etc - but overall the expected value over many games will be zero.

      If you want to play around with this a bit, try the TopCoder Marathon Match problem "TwoCardDraw". It's a simplified version of poker, but it's nonetheless a challenging problem and an interesting coding strategy. It involves resolving the expected value of strategies, coming up with "perfect counter" strategies, and lots of other fun, relevant stuff. (I did OK - my submitted solution was a static strategy, but I experimented quite a bit before that).

      --
      Let's not stir that bag of worms...
    13. Re:Additional cards not needed. by bwt · · Score: 2, Interesting

      The optimal strategy in Rock/Paper/Scissors for head to head play is a guaranteed losing strategy in most multiplayer tournament. Randomly, uniformly distributed choices has an expected win percentage of 50% - no one expects to beat it and no one expects to lose to it in the long term. However, since humans can and do have patterns in their answers, some human players will detect and exploit these patterns to gain an advantage over their human opponents. As an extreme case, suppose that a player entered the tournament that only used rock and paper. The "optimal" computer expects to break even, and every human expects to win against this player. Based on this information alone, the computer should expect to come in last place.

      Poker has similar features. A framework for attempting to play poker well MUST attempt to engage in opponent modeling. It is not clear that there even is a "best" strategy, as this is equivalent to finding a "best" pattern detector. Since there is no "set of all patterns" I don't think the concept can be defined. This is in contrast to chess or go, where although we cannot in practice enumerate the entire tree of possible game sequences, it does exist and it is finite, and there is an optimal strategy that we can approximate. Not so in poker. It's not clear that you can even truly compare two players in an absolute sense. It's easy to find situations where player 1 beats player 2 if players 3-N play tight and loses if they play loose. Again, since there is no "set of all poker strategies", there's not even a good way to define how to do a monte-carlo simulation.

    14. Re:Additional cards not needed. by spazdor · · Score: 1

      You can't possibly always know when you're presenting the computer an "obvious" decison, because the computer always knows something you don't: its own hand. The "optimal" move may be the move which avoids giving that secret away.

      By the by, a table full of people can also team up to bully another human around by pulling him into expensive showdowns all the time. That a computer can be beaten by a table full of humans colluding is not really evidence of a weakness.

      --
      DRM: Terminator crops for your mind!
    15. Re:Additional cards not needed. by Imsdal · · Score: 1

      You know, there are a lot of poker players who would be very very happy to have a strategy that "(ensures) that their EV doesn't fall below zero." If that is a worst-case scenario, as you suggest, we can, by definition, confirm that the computer strategy is winning.

    16. Re:Additional cards not needed. by Imsdal · · Score: 1

      This is incorrect. Optimal play, in the mathematical sense, is independent of player profiling.

      It is, however, correct that "optimal play" in the sense of beating one particular opponent by the highest possible amount of money, does require player profiling or some other means of exploiting that player's particular weaknesses. And in practice, poker isn't played in order to win narrowly against the best players. It is played in order to extract the most amount of money possible from the worst player or players at the table. If that means losing some small amount to some other players at the table, that is fine.

      In actual play at real places (live or on-line), the rake is almost always too high to make a mathematically optimal strategy interesting or worthwhile. From an AI perspective, however, it is interesting.

      Finally, computers can beat humans at chess even without player profiling. And if that isn't true today, it will be true in x years' time, for some not too large value of x, because of Moore's law and the general advance in search algorithms.

    17. Re:Additional cards not needed. by TheRaven64 · · Score: 1

      Even then it's possible for a human to do better unless the machine is reading body language too. Most half-competent players intentionally mislead in their bluff strategy - they make a pattern and then break it (simple example: fold early for a few rounds and then start betting and everyone will assume you have a good hand and so you can win on a bluff). Most people exhibit subtly different body language when they switch strategies like this, however, and a human can read this a lot more easily than a machine.

      --
      I am TheRaven on Soylent News
    18. Re:Additional cards not needed. by JohnFluxx · · Score: 1

      It depends if you can quit.

      A simple way to beat you is:

      *) Bet 1 dollar I'll win
      *) If I win, quit. I've come out on top.
      *) If I lose, bet 2 dollars I'll win.
      *) Repeat, doubling each time.

      It's a strategy guaranteed to win. :)

    19. Re:Additional cards not needed. by rtb61 · · Score: 1
      No. It is all down to random chance as the player loses the ability to do some important things, like trying to read opposing players and, learning to send false signals. Bluffing is the difference between winning and losing in poker, learning how to vary you bets, learning how others players tend to bet based upon their hand.

      So playing against a computer is just going for dumb luck, no real skill involved at all.

      --
      Chaos - everything, everywhere, everywhen
    20. Re:Additional cards not needed. by Alsn · · Score: 1

      No it's not, you could just keep losing until you die of old age. While improbable it's not impossible.

    21. Re:Additional cards not needed. by Anonymous Coward · · Score: 0

      First your point is correct, the parent doesn't understand the concept of "optimal play". Second great book recommendation. However...

      Poker isn't a two player zero sum game...true randomness will not work. First it's multi-player and second there is a rake. Even if you eliminate this and make it a heads up zero sum you can't tell me you're playing perfect random or I can beat it based on value relative to a random hand because I'm still allowed to size the bets based on my strength or weakness compared to a random hand. If you take that away and make it a fixed limit, heads up, no rake game then you're correct but that's a worthless academic exercise. That said, the computer can still win at a real world game we just need more informational inputs related to other players and greater computational power.

    22. Re:Additional cards not needed. by vertinox · · Score: 1

      The trick to Poker, the reason why it is so appealing as an Artificial Intelligence benchmark is because it requires the AI to learn a particular players loosness/agressivness when they are likely bluffing etc. This is not only to try to determine what the other players have, but also to try to bluff to the other players what the AI has.

      Actually, the trick to winning poker is to play low bets and go long. Sort of like the Dutch book method where your goal is to have a positive income even if its a low income. All you have to do is play ante if you don't have anything and raise if you have something on the first hand. I know there is several theories to this, but its one of the few ways to have a positive income with poker, but of its not a guaranteed way if you don't get anything on the first hand the entire night or raise too much with a low pair.

      Most people don't have the knack for it due to emotional issues like the aforementioned bluffing, and if you do play long most people will leave your table because your no fun.

      And you might as well be playing the stock market if you put that much thought into the game.

      --
      "I am the king of the Romans, and am superior to rules of grammar!"
      -Sigismund, Holy Roman Emperor (1368-1437)
    23. Re:Additional cards not needed. by Ruperz · · Score: 1

      I think a computer can not read the body language of people. It must recognize emotions and for what i am knowing computers aren't that sophisticated. And there is the luck factor, how about that? Robbert, Cuda Fish Finder

      --
      Can't think of a great gift to give ur loveones? Look at: www.bestfishfinderstore.com or www.m-motorsports.com
    24. Re:Additional cards not needed. by vikstar · · Score: 1

      Ok, but what the hell does this have to do with fish?

      --
      The question of whether a computer can think is no more interesting than the question of whether a submarine can swim.
    25. Re:Additional cards not needed. by Ruperz · · Score: 1

      Fish are the bad poker players, the easy money, the easy tells, the unpredictable bad plays, the bad beats. It is the opposite of a perfect play from a computer. Play like a fish and beat the system? Greetz

      --
      Can't think of a great gift to give ur loveones? Look at: www.bestfishfinderstore.com or www.m-motorsports.com
  43. Perfect Poker doesn't mean you win. by CrazyJim1 · · Score: 1

    I play good enough Poker that I can take down money off of regulars at online poker sites(I've trained for thousands of hours), and I've toyed with programming poker bots. Even with a program that plays "perfect" Poker, it isn't guaranteed to even finish in the money. Look at this obvious situation: Poker bot gets "AA" in the beginning of the tournament, Joe Blow gets "KK", they both raise and re-raise each other until they're both all in. The pokerbot made the right play, and Joe Blow can't be faulted much either. The board is 2h 5d 7d Kc Qc. The kings beat out the AA. The perfect Poker bot lost. The only way to know that the Poker Bot made the right play was that a Poker veteran confirmed it.

    When you play advanced Poker, you can get into situations where you're playing the odds that your opponent does not have a hand. In this style of Poker, you're sometimes playing with weaker hands than Poker books suggest you start with. You can make the right play in advanced Poker, but other Poker vets wouldn't agree with you because they're not advanced enough to understand your play.

    In advanced poker it is sometimes hard to figure out who made the right play because there is no mathematical basis for it. Are you going to compute someone's algorithm in their brain to determine what strength of hand their betting pattern is on? People can do this, but there is no hard and fast rules for getting reads. A computer can get reads better than a human because it can memorize everything perfectly, but to code something that handled all those reads would take a lot of time... And who is gonna code that? A professional poker player? The programmer is probably going to be a random dude.

    So I'd say it isn't trivial to program a "perfect" Poker player. How are you going to judge which poker bot is the best? Are you going to pit bots against each other over millions of games? Are you going to pit bots vs humans? Anyone can claim they have a perfect poker bot, but I sincerely doubt it. And if you leak your source code, anyone who knows they're playing against your bot will have a huge advantage.

    1. Re:Perfect Poker doesn't mean you win. by CrazyJim1 · · Score: 1

      Make that hundreds of hours, not thousands. You know what I concluded from playing a lot of Poker? It is a waste of time even if you make money. You haven't helped the world out by doing anything. You just took the right to use more resources.

    2. Re:Perfect Poker doesn't mean you win. by Surt · · Score: 1

      Note that you specified a scenario involving all in at the beginning of the tournament, while the article specifies a perfect poker bot for limit games only.

      --
      "Who is the Journal of Quantum Physics going to believe?" --Stephen Hawking
    3. Re:Perfect Poker doesn't mean you win. by Anonymous Coward · · Score: 0

      Yes poker is a zero-sum game and professional poker players don't add anything of value to this world by winning other people's money.
      However you need to get some perspective. Do musicians, professional athletes, artists and moviestars for example really help the world or could we live without them?
      You can say the same things about pretty much any job that doesn't involve scientific research or physical labor.

    4. Re:Perfect Poker doesn't mean you win. by Anonymous Coward · · Score: 0

      What you just described was not perfect poker. All in near the start of a tournament is incredibly bad play even with pocket AA's, you are only a 83% chance to win, chances are you will see pocket Aces quite a few times in a tournament and chances are at least once they will lose. A professional player generally avoids all in's early as it takes skill out and leaves it all to chance. I find fault with both the player with KK and AA if they are stupid enough to go all in early in a tournament pre flop. I have played in tournaments where professional players have folded AA or KK pre flop to all in bets as they know in the long run they can do better without the risk.

    5. Re:Perfect Poker doesn't mean you win. by JMZero · · Score: 2, Insightful

      And if you leak your source code, anyone who knows they're playing against your bot will have a huge advantage.

      No. Knowing the source code of an ideal poker program would do you no good. You can't win against an agent following the Nash equilibrium for a game. He's going to be choosing from a library of strategies such that for every complete game, whatever strategy you choose, the expected value of the game is zero.

      Naturally such an ideal program is hard to write, but conceptually it's very simple - poker is equivalent to any other zero sum game.

      --
      Let's not stir that bag of worms...
    6. Re:Perfect Poker doesn't mean you win. by CrazyJim1 · · Score: 1

      However you need to get some perspective. Do musicians, professional athletes, artists and moviestars for example really help the world or could we live without them? And who needs the telephone booth cleaners anyway?

    7. Re:Perfect Poker doesn't mean you win. by gujo-odori · · Score: 1

      I agree. My wife is a semi-pro poker player, and I have seen her lay down pocket aces. It's rare, but I've seen it, and having to go all-in pre-flop with them is one of those situations. I play myself (not as well as she does, but well enough to finish in the money most of the time in low-stakes small tournaments), and I am also willing to lay down pocket aces early in a tournament if the only other option were to go all-in.

      The goal of a tournament is, of course, to finish in the money, and being all-in early, even with pocket aces, puts that goal at risk. It's true that most of the time, pocket aces will be good, but they do get cracked. Especially in low-stakes games, it usually seems to happen at the hands of some donk who goes all-in with cards he shouldn't even play, let alone go all-in with. Then he flops two pair or a set and the aces are done. I actually feel really uncomfortable to get pocket aces or kings early in a tournament because it can put me into a situation where I have to either fold them (don't want to do that) or call a really large bet (don't want to do that early, either).

      Sure, if you go all-in and the aces are good, you can relax after that and really pick and choose your hands. If you go all-in and the aces get cracked, you get to watch from the sidelines. Better to make a strong raise with pocket AA and get one or maybe two callers. If I bet 4x or 5x the big blind and somebody jumps over me all-in and it's early, I'll probably lay the aces down rather than take the chance.

    8. Re:Perfect Poker doesn't mean you win. by Anonymous Coward · · Score: 0

      Nice level

    9. Re:Perfect Poker doesn't mean you win. by Anonymous Coward · · Score: 0

      I don't really like it when people bash my profession without really understanding what it's like. Would you go tell Garry Kasparov that he is worthless and doesn't help the world in any way? Poker and chess are very alike, only difference is that people have respect for chess players but for some reason see poker players in a different way, even though both are games of skill and logic.

    10. Re:Perfect Poker doesn't mean you win. by pjt33 · · Score: 1

      You can't win against an agent following the Nash equilibrium for a game.

      Depends on the game. This is probably due in poker due to the symmetry (although I don't play enough to know what asymmetries there are).

  44. First hand... by Hossicle · · Score: 5, Funny

    If I was playing a computer on the first hand I would go ALL in (and do it blind). ...program would hopefully calculate my SIZE_OF_BALLS() variable as an out of bounds condition and give up. If that didn't work at least I'd be done and could go back to drinkin' in the casino bar.

    1. Re:First hand... by Spykk · · Score: 1

      I suppose the parentheses suggest a two element array?

    2. Re:First hand... by bgspence · · Score: 1

      Remember, in limit poker your bet is limited to a simple raise and dinky balls.

  45. Re:BIG DEAL. They are talking about LIMIT hold'em! by LogistX · · Score: 1

    While it is true that limit holdem is mostly computational, the way pros extract value (read: money) from the lesser pros is by adapting. Most reasonable pros essentially play perfectly when it comes to pot odds, game theory, card value, position, stack sizes, etc. However, what separates them from the top pros is their ability to factor in additional information from the previous hands with that person (or machine). Will the player (or machine) play more aggressively if it has been steamrolling the opposition? If a pro believes that to be true, she will respect aggressive players bets less.

    Also from TFA, "It's possible, given enough computing power, for computers to play 'perfectly,' where over a long enough match, the program cannot lose money,"
    While this is true, a "long enough match" would be VERY VERY long - hundreds of thousands if not millions of hands. For pros over a couple thousand hands of limit holdem against good opposition, winning or losing is primarily dictated by variance.

  46. And they don't get distracted by EmbeddedJanitor · · Score: 1

    By well titted cocktail waitresses handing out free drinks.

    --
    Engineering is the art of compromise.
  47. Re:BIG DEAL. They are talking about LIMIT hold'em! by markswims2 · · Score: 1

    I don't care how well such a program is coded... it will absolutely buckle under the pressure of a professional who constantly bets half his stack on nothing. The machine would turn into a professional folding station that only plays AA, KK, or AK.

    why can't a computer bluff?

  48. As if ... by slashdotlurker · · Score: 1

    ... the house needed any further advantages to ensure that it always won.

    1. Re:As if ... by gujo-odori · · Score: 1

      Uhhh, in poker, you don't play against the house. You play against other players, and the house takes a cut of the pot from each hand (ring game) or a set fee (tournament).

  49. Re:BIG DEAL. They are talking about LIMIT hold'em! by LogistX · · Score: 1

    I don't care how well such a program is coded... it will absolutely buckle under the pressure of a professional who constantly bets half his stack on nothing. The machine would turn into a professional folding station that only plays AA, KK, or AK. Guess what? That strategy isn't winning any games or any period of time in a no-limit or pot-limit world.

    This is where the machine learning comes into play. Each time the human bets half her stack right off the bat, the machine lowers its calling (and raising) standards.

  50. Re:BIG DEAL. They are talking about LIMIT hold'em! by bnenning · · Score: 1

    I want to see this team of academics write some code that will beat a human at *No-Limit* Hold'em. Or maybe *Pot-Limit* Omaha. NEVER going to happen.

    It's certainly harder, but I wouldn't say never. In some scenarios it might not be too hard to beat an average human, like having the AI buy in short and try to get all in preflop or on the flop.

    I don't care how well such a program is coded... it will absolutely buckle under the pressure of a professional who constantly bets half his stack on nothing.

    Maniacs who do that "constantly" are easy to beat, just call with hands that are on average better than theirs. An AI with halfway decent opponent modeling should be able to adjust to that pretty quickly.

    --
    How to solve most of our problems: 1.Lots of nuclear plants. 2.Cure aging.
  51. Skynet? by therufus · · Score: 1

    If the machine wins, the maker will get a military contract, then get killed by some hot terminator chick and a crazy woman named Sarah Connor.

    Wait... I've seen this before.

    --
    You moved your mouse. Please restart Windows for changes to take effect.
    1. Re:Skynet? by plasmacutter · · Score: 1

      Obligatory comment about a nice game of thermonuclear war *here*

      --
      VLC FOR MAC IS DYING! IF YOU DEVELOP, PLEASE SAVE IT!!
    2. Re:Skynet? by Rick+Genter · · Score: 1

      Mmmmm.....Summer Glau.....mmmmmm....

      When is the new season starting?

      --
      Don't underestimate the power of The Source
    3. Re:Skynet? by therufus · · Score: 1

      According to IMDB, season 2 starts on September 8.

      --
      You moved your mouse. Please restart Windows for changes to take effect.
  52. Re:BIG DEAL. They are talking about LIMIT hold'em! by LetterRip · · Score: 1

    I want to see this team of academics write some code that will beat a human at *No-Limit* Hold'em. Or maybe *Pot-Limit* Omaha. NEVER going to happen.

    I don't care how well such a program is coded... it will absolutely buckle under the pressure of a professional who constantly bets half his stack on nothing. The machine would turn into a professional folding station that only plays AA, KK, or AK. Guess what? That strategy isn't winning any games or any period of time in a no-limit or pot-limit world.

    This team of academics has written poker bots that play no limit and pot limit poker, and the bots are fairly decent at it. Doing a half stack bet frequently will most likely end up with the professional being busted out.

    The same techniques would work for pot limit omaha. The only difference being that pot limit omaha is a bit more combinatorially complex.

    LetterRip

  53. You are exactly right by D.McGuiggin · · Score: 1

    What's more, people don't realize that "playing perfectly" is a misnomer. It deals with making statistically correct decisions given the available information, which in poker, is not all of the information.

    People familiar with the game understand that perfect play doesn't mean "you always get it right". It means you are playing based on the idea of expected value. This is discussed in the theory of poker.

    When you talk about multiway play, you also are overlooking that decision making changes significantly in multiway pots, which is discussed in Morton's theorem.

    I'm also at reasonably sure that given time, a pattern of "perfect play" would be found to be exploitable. Since the computer is using incomplete information, it must make assumptions. These assumptions, if anticipated, could be used to influence the computer's decisions.

    Since this story is about limit, it's no wonder the computer has so much success. The structure of limit makes it a very straight mathematical game, where you're frequently calling river bets when you are certain you are beaten, simply because statistically it is correct to do so.

    This structure is not present on all poker games, and indeed, many of the most popular games are not limit, but pot limit or no limit instead. I'd be interested to see what kind of progress is being made on those games, which strike me as vastly harder problems.

    1. Re:You are exactly right by ceoyoyo · · Score: 1

      Yes, "perfect" play means something different in probabilistic games. A perfect chess player can't be beaten (unless there's a flaw in the initial conditions, like playing black). In a game like poker "perfect" means the computer can't be beaten in the long term, once all the statistical fluctuations even out.

      No limit and multiple opponents might make the problem harder, even MUCH harder, but I don't see that either one introduces a factor into the game that would give a person an advantage over an arbitrarily powerful computer. In fact, increased complexity is probably to the computer's advantage. A good poker player can calculate simple odds fairly easily and quite accurately. When the computation becomes more complex human performance will suffer but the arbitrarily powerful computer will continue to calculate the ideal course of action.

    2. Re:You are exactly right by D.McGuiggin · · Score: 1

      "No limit and multiple opponents might make the problem harder, even MUCH harder, but I don't see that either one introduces a factor into the game that would give a person an advantage over an arbitrarily powerful computer."

      I do, I see several in fact. Bet sizing being the most obvious.

      "When the computation becomes more complex human performance will suffer but the arbitrarily powerful computer will continue to calculate the ideal course of action."

      This is rare. Most poker calculations are simple, and even the difficult ones aren't terribly difficult.

      May I ask, do you play?

    3. Re:You are exactly right by Krabbs · · Score: 1

      What's more, people don't realize that "playing perfectly" is a misnomer. It deals with making statistically correct decisions given the available information, which in poker, is not all of the information.

      People familiar with the game understand that perfect play doesn't mean "you always get it right". It means you are playing based on the idea of expected value. This is discussed in the theory of poker.

      When you talk about multiway play, you also are overlooking that decision making changes significantly in multiway pots, which is discussed in Morton's theorem.

      I'm also at reasonably sure that given time, a pattern of "perfect play" would be found to be exploitable. Since the computer is using incomplete information, it must make assumptions. These assumptions, if anticipated, could be used to influence the computer's decisions.

      Since this story is about limit, it's no wonder the computer has so much success. The structure of limit makes it a very straight mathematical game, where you're frequently calling river bets when you are certain you are beaten, simply because statistically it is correct to do so.

      This structure is not present on all poker games, and indeed, many of the most popular games are not limit, but pot limit or no limit instead. I'd be interested to see what kind of progress is being made on those games, which strike me as vastly harder problems.

      Oh poor researchers! The hand waving by a random guy on the Internet has really disproven their mathematical proof. A perfect play is NOT exploitable, thats really the heart of the definition. I don't wanna throw a wikipedia entry in your face, because you've done enough, but google "Perfect play" and/or "Game Theory". Perfect play should, however, not be mistaken for optimal play(maximizing EV). Everybody is a freakin' scientist these days. Why do people thing they know more than serious researchers?

    4. Re:You are exactly right by ceoyoyo · · Score: 1

      A bit.

      So what is the obvious factor in bet sizing that gives a person an advantage over a computer? If it's obvious you should be able to spell it out convincingly. It seems to me arbitrary sized bets give the computer more leeway to play it's perfectly calculated odds AND a better opportunity for opponents to give themselves away through betting to the computer's perfect memory.

      Odds in most poker games are usually fairly simple. At least on the surface. Someone else pointed out that the deck is often not shuffled every hand. Even if it is, opportunities still exist for card counting. Then there are the regular pot odds, modifications to the odds for multiple opponents (which I believe you pointed out) and odds based on past betting behaviour. If you take all of that into account it's fairly complicated. A good player will get the pot odds pretty well, and might be able to throw in some basic card counting, and will follow opponents behaviour in an approximate way. But the (arbitrarily powerful) computer can do it precisely, without mistakes.

    5. Re:You are exactly right by D.McGuiggin · · Score: 1

      "If it's obvious you should be able to spell it out convincingly."

      I shouldn't have to for people with more than an "espn world series of poker" understanding.

      "It seems to me arbitrary sized bets give the computer more leeway to play it's perfectly calculated odds"

      They'r enot arbitrary, they're designed to interfere with the pot odds, which is what the computer uss to calculate how to play "perfectly". By giving the computer the pot odds necessary to call in situations where perfect play would call for it, but where the imperfect information factor makes said call wrong, you have manipulated the information the computer is receiving.

      This is the simplest example, there are others.

      "Someone else pointed out that the deck is often not shuffled every hand. "

      They were wrong. In fact, this would never go over in any real game, home games full of drunks at a party are the only place you'll see this. It is NOT normal, it is NOT common, and it is NOT acceptable by the rules of the game. So it can't be considered as it would NEVER happen in any game by any legitimate (or even semi-legitimate) sanctioning body.

      "Even if it is, opportunities still exist for card counting. "

      No, not really, apart from openly cheating. Card counting is not possible in a game that is not being cheated.

      "and odds based on past betting behaviour."

      These have nothing to do with pot odds and aren't considered by good players with learned opponents. You can't consider them.

      "If you take all of that into account it's fairly complicated. "

      I agree, but as I've explained, you don't take all of that into account, most of your numbers aren't factored, and counting doesn't exist in straight games. Cheating is irrelevant for this discussion, as no programmer would bother writing code for a machine to cheat. Players would notice immediately and never play that machine again. If you don't believe me, check out the "Absolute Poker scandal" where a player saw the other players hole cards, and was caught based on behavior. It was only after an investigation that the players were told that he did in fact have their hole cards, but they KNEW THAT ALREADY because of how he played. So cheating, which no sanctioning body would accept either, is not relevant, and therefore, your point about card counting is not relevant.

      http://freakonomics.blogs.nytimes.com/2007/10/17/the-absolute-poker-cheating-scandal-blown-wide-open/

      "But the (arbitrarily powerful) computer can do it precisely, without mistakes."

      If your assumptions are true, but as I've shown, they aren't. In fact, apart from pot odds, your assumptions are just wrong.

      The reason I asked if you played is because the points you were making betrayed a vary basic, beginner's understanding of the game, and the thought/rule/policy errors you've made only serve to reinforce that. For example, your point about "not shuffling" is comical, and would cause great amusement among people who play regularly.

      I don't mean to be harsh, but you don't understand the game well enough to make any informed commentary about it.

    6. Re:You are exactly right by ceoyoyo · · Score: 1

      "I shouldn't have to for people with more than an "espn world series of poker" understanding."

      So in other words you can't?

      You certainly can card count in poker. Good players do it all the time. Hmm... there are four spades out already, what are the odds that another one is going to show up? No, it's not the same as counting cards in blackjack. I didn't say it was.

      Any decent player is also going to keep at least an intuitive idea of the betting patterns of the other players around the table. Does Joe bluff often? If he bets high does that mean he's likely to have a genuinely good hand? Is Joe's play in this game consistent with how he played in the last ten games I watched him play?

      Anyway, since you've degenerated to writing your post in bold face, and your excuse for not being able to come up with a reasonable argument why any particular factor in poker is uncomputable, have a nice day.

  54. Re:BIG DEAL. They are talking about LIMIT hold'em! by foxtrot · · Score: 1

    I'm not sure why anyone thinks this is such a feat. In LIMIT hold'em, bluffing, psychological aspects, and implied odds are diminished to the point of meaning next to nothing. It is almost a purely computational game. So, yes, a computer can play technically "perfect".

    There still exists a psychological aspect to a limit hold'em game, particularly at higher stakes.

    But even at a 3-6 or a 4-8 table, I find a chance for a bluff oh, about once every four or five hours. It's not a big aspect of the game, but it's there. You have to know the players well enough to know who's actually capable of folding, AND get into a situation where they can believe they're beat, but it's possible, and even more important, valuable. Not required to make money at the low limits, mind, but can score a couple extra bucks every now and again.

    I don't care how well such a program is coded... it will absolutely buckle under the pressure of a professional who constantly bets half his stack on nothing. The machine would turn into a professional folding station that only plays AA, KK, or AK. Guess what? That strategy isn't winning any games or any period of time in a no-limit or pot-limit world.

    Bah. Even I can write code that can handle that: "move in over the top, with nothing".

    That said, a computer's got to walk before it can run. If it can sit down at a 20-40 game somewhere, it's not doing too bad. Once they've figured out how to write a limit bot that can handle that, then they can start working on a no-limit bot.

    Given the play we see from supposed "pros" on TV, I fear what the researchers will determine is random play backed by a large bankroll is indeed the optimal strategy in modern no-limit hold-em. :-/

  55. Comment removed by account_deleted · · Score: 1

    Comment removed based on user account deletion

  56. Just like any algorithm... by Anonymous Coward · · Score: 0

    ...a malicious adversity can be introduced through study and analysis. The players will observe the behavior of a program with finite possibilities.

    Oblig /. reply

    1)Observe
    2)Divide
    3)???
    4)Conquer...Profit?

  57. Re:Reminds me of those... by ragethehotey · · Score: 3, Interesting

    Of course perfect play is often unintuitive and involves things like taking the safe bet rather than higher payout options - not something most people in Vegas are renowned for.

    its actually completely the opposite for most video poker games, such as throwing away a made flush (already a winner) that is almost a straight/royal flush --an example would be like KQJT2 all of clubs, the correct play is to give up the guaranteed win of a flush, and draw for the jackpot hands (royal and straight flush)

  58. Re:BIG DEAL. They are talking about LIMIT hold'em! by kestasjk · · Score: 1

    I want to see this team of academics write some code that will beat a human at *No-Limit* Hold'em. Or maybe *Pot-Limit* Omaha. NEVER going to happen.

    I don't care how well such a program is coded... it will absolutely buckle under the pressure of a professional who constantly bets half his stack on nothing. The machine would turn into a professional folding station that only plays AA, KK, or AK. Guess what? That strategy isn't winning any games or any period of time in a no-limit or pot-limit world.

    What is it about poker that everyone that can play thinks they're great at it.. Please give us more of your poker insight, o' master of poker AI..

    Are you really suggesting an AI can't tell when someone is overbetting? That's not even AI, it's just basic probability and statistics.

    If you even go to somewhere like Full Tilt Poker you'll likely encounter bots with the ability to pick off people which overbet constantly, and you wouldn't even call that software "AI", just basic rules and guidelines.

    --
    // MD_Update(&m,buf,j);
  59. Re:Reminds me of those... by CDMA_Demo · · Score: 2, Interesting

    I think it's more likely that casinos have 0% slots.

    Casino machines are heavily regulated. Instead, the gambling industry is searching for other ways to screw their clients: http://www.salon.com/news/feature/2008/06/16/gambling_science/

  60. Re:BIG DEAL. They are talking about LIMIT hold'em! by Anonymous Coward · · Score: 1, Insightful

    The machine would turn into a professional folding station that only plays AA, KK, or AK. Guess what? That strategy isn't winning any games or any period of time in a no-limit or pot-limit world.

    Against a loose player, this strategy is ideal actually.

  61. Re:BIG DEAL. They are talking about LIMIT hold'em! by Anonymous Coward · · Score: 0

    I want to see this team of academics write some code that will beat a human at *No-Limit* Hold'em. Or maybe *Pot-Limit* Omaha. NEVER going to happen.

    I don't care how well such a program is coded... it will absolutely buckle under the pressure of a professional who constantly bets half his stack on nothing. The machine would turn into a professional folding station that only plays AA, KK, or AK. Guess what? That strategy isn't winning any games or any period of time in a no-limit or pot-limit world.

    I love when I read idiotic statements like this. I mean how many times do we have to see lines like "x amout of memory/storage/power will always be enough" before we learn how stupid they are. Pretty much if someone utters phrases containing never or always and doesn't have a mathematical proof revolving around the total amount of information in the universe you can be pretty sure they're full of it or just uninformed.

    Now to your point and why it's overstated....you are partially correct, currently they can not do this but it's largely a problem of lack of input and computational power. We all know the computational power will get solved eventually thanks to Mr. Moore's "law". What's left is enough input for a computer to make a read. This likely means facial and voice readers (assuming a table of full players where there is some chatter). At this point the computer would have an advantage because it would give away much less information than it would take in. Additionally it would have perfect recall of behavioral vs. play information over the history of the game. This would allow the computer to play correctly based on various decision distributions using advanced game theory far beyond basic pot odds and expectation customizing these distributions to the opponents as the game progressed and more historical behavioral information became available. Also you won't see the all too common bet size mistakes from the computer.

    It's a massive computational problem and currently the computer doesn't have enough inputs to solve it, but to say it will never be able to play No-Limit effectively against a pro is silly. No-limit poker is purely luck in the short term and purely skill in the long term and anything that is purely skill can eventually be solved by a computer with enough input information and computational power. We just don't CURRENTLY have these two prerequisites in place.

  62. Re:BIG DEAL. They are talking about LIMIT hold'em! by RzUpAnmsCwrds · · Score: 1

    I don't care how well such a program is coded... it will absolutely buckle under the pressure of a professional who constantly bets half his stack on nothing. The machine would turn into a professional folding station that only plays AA, KK, or AK. Guess what? That strategy isn't winning any games or any period of time in a no-limit or pot-limit world.

    I'm not sure why you think this. The computer is incapable of "buckling under pressure". It either makes a good play or a bad play.

    People assume that the computer is always going to be playing based on pot odds, but a well-designed system will take much more than that into account.

  63. program cannot lose money by TopSpin · · Score: 1

    So if you deploy a half dozen around a virtual table, the net loses and gains of each would be equal? Otherwise, the net money supply would have to grow?

    --
    Lurking at the bottom of the gravity well, getting old
  64. Nobbel prize kthx by thrsnspn · · Score: 1

    I have a brilliant algorithm for a poker program that can never lose!

    User: "Would you like to play a game of poker?"

    Computer: "No, thanks."

  65. Probability and poker are a dangerous combo. by Behrooz · · Score: 1

    Given enough computing power, a machine will always be able to calculate the exact probability of every possible hand that its opponent might have, now & into the near future, without being fooled by stuff like bluffs or feints. (It's also possible that it might be able to detecting cheating like slipping an extra card into play when a result occurs which it has calculated to be "impossible".)

    The entire point of a bluff/feint is that the cards are random, and calculating the exact probability of every possible hand has nothing to do with the actual hands that your opponents have. "My hand is better than 92% of the possible hands my opponent could have" is just enough to lose all of your chips 8% of the time. As the variance in possible betting increases, the usefulness of probability in long-term play decreases. No-limit poker isn't about the cards, it's about the behavior of your opponents.

    --
    "We have to go forth and crush every world view that doesn't believe in tolerance and free speech." - David Brin
    1. Re:Probability and poker are a dangerous combo. by mOdQuArK! · · Score: 3, Insightful

      Probability has very much to do with potential strategies.

      A more limited form of this is blackjack - although a machine doesn't know exactly what cards are going to come up, and doesn't know exactly what cards its opponents has, by using probabilities over the long-term, it can still beat the house.

      Also, as cards in the deck are used up & the machine learns more about what cards have been used, it can make more precise calculations about what cards other people have or what might be coming up in the draw, and adjust its strategies accordingly.

      This is stuff that the pros do all the time in their heads, and which the pros use to decide THEIR strategies, except that a machine will be able to calculate those probabilities perfectly, without getting tired and without making any mistakes. If a pro could do that, it would give him/her a pretty decent advantage - assuming that they had a large repertoire of strategies that they could use to capitalize on their knowledge.

      Which brings us back to the main weakness of the machine - the machine will only have the repertoire that was programmed into it by its creators (or that it can figure out by heuristics/exhaustive search), and if it is mindless about applying those techniques, or only has a very limited set of techniques available to it, then a pro who figures out its patterns can take advantage of that (just like in chess).

      It would also be very difficult for a machine to make judgements about its opponent's mental state (unless the eggheads make some sort of breakthrough on categorizing mental states through facial recognition).

      Neither of these weaknesses have anything to do with perfect probability calculations being very useful, however.

    2. Re:Probability and poker are a dangerous combo. by tehcyder · · Score: 1

      A more limited form of this is blackjack - although a machine doesn't know exactly what cards are going to come up, and doesn't know exactly what cards its opponents has, by using probabilities over the long-term, it can still beat the house.

      I understood that in the long run the house always wins in blackjack, because if the dealer has the same hand as you, you don't win, and so overall you are bound to win less often than the dealer.

      Is this not correct?

      --
      To have a right to do a thing is not at all the same as to be right in doing it
    3. Re:Probability and poker are a dangerous combo. by mOdQuArK! · · Score: 1

      No, blackjack is one of the few play-against-the-house card games allowed in the gaming industry where if you can calculate probabilities with sufficient accuracy, you can beat the house in the long term. That's the whole point of the strategy of "counting cards".

      Of course, if the house figures out that you are able to count cards well enough to beat them in the long-term, they usually block you from playing (so in a "won't let you play if I can't win" sense, the house eventually always wins).

      See the Wikipedia entry for the excruciating detail on card counting.

    4. Re:Probability and poker are a dangerous combo. by Alsn · · Score: 1

      That is only true if you assume that the card history plays a part into the equation.

      With a sufficiently large deck and shuffling before the amount of cards played can amount to an advantage to the player the house always has the edge.

  66. Re:BIG DEAL. They are talking about LIMIT hold'em! by Illserve · · Score: 1

    NEVER going to happen

    I've learned a few things in life and at the top of the list is that people who say this are always wrong.

  67. Re:BIG DEAL. They are talking about LIMIT hold'em! by javabandit · · Score: 1

    I'm not saying I'm great at it. Not at all. I'm not great at baseball, either, but I'm a fairly good student of its strategy. Same with poker.

    I'm not suggesting an AI can't tell when someone is overbetting. "Overbetting" is a simple computation. Detecting an overbet is simply looking at the bet compared to the pot-odds and the potential hands of the bettor.

    I *am* suggesting that an AI is not going to be able to determine if a professional player is overbetting in order to bluff... or in order to incite a call.

    Let's be clear. Computer programs do not "learn". All they do is examine history and then make some computational decision based on historical probability.

    Any professional poker player will absolutely tear that strategy apart. Because poker pros are all about playing the weaknesses of their opponent.

  68. Re:BIG DEAL. They are talking about LIMIT hold'em! by Anonymous Coward · · Score: 0

    If you honestly believe that a group of Doctors in this field would spend their time making a simplistic little bot that would degenerate into only playing AA, KK or AK, then it's obvious that the real problem they are working on here is completely over your head.

  69. Re:BIG DEAL. They are talking about LIMIT hold'em! by javabandit · · Score: 1

    "Fairly decent"? You mean they lose and are close to break-even, right? They are still losers. There isn't a no-limit/pot-limit bot in existence that wins over the long run. Let's be clear about that point.

    And most of these bots are run at micro-limits. You won't see these no-limit/pot-limits bots running at $5-$10, $20-40, or $50-$100. Why? Because these bots suck.

    If you know of a no-limit/pot-limit bot that consistently wins over the long haul, please post a link.

  70. Re:BIG DEAL. They are talking about LIMIT hold'em! by javabandit · · Score: 1

    Oh... a computer can bluff. But let's qualify that. A computer can bluff BADLY.

    A computer bluff would be the equivalent of some donkey randomly throwing a massive bet out there hoping for a bunch of folds.

    But a computer isn't going to know that "John Doe" across the table just took a huge bad beat, is tired, is close to the end of his bankroll... and then bluff based on that information.

    A computer simply isn't going to know all of the information and nuances necessary in order to execute a truly good bluff.

  71. "lose" and "loose" are different words by Gameless · · Score: 1

    Hmm... Lots of misspellings of the word "lose" in the same location. This must be a thread about gambling!

    So! Some guys have got or with additional investments can get a bot whose purpose is to not lose money at a card game over time? I'm going to go out on a limb and assume it would also accept gaining money over time as acceptable.

    One should not too quickly dispense with important concepts such as "aggression" and "extracting maximum value from a hand" using outside data including "physical tells" and "the metagame".

    I'm no bigshot, but I will asert with confidence that this new dealiebob has a standing invitation to visit Bobby's Room and risk some actual treasure in the form of green bricks w/ rubber bands.

    Even lesser men than the likes of Doyle Brunson, Barry Greenstein, and Phil Ivey would line up to fly y'all down and take your developers out to Prime before or after the big game.

  72. Re:BIG DEAL. They are talking about LIMIT hold'em! by javabandit · · Score: 1

    If you think no-limit poker is simply a massive computational problem, then you don't know anything about poker.

    Anything that is purely skill can eventually be solved by a computer? Are you nuts?

    Anything that is purely MATHEMATICAL skill can eventually be solved by a computer. But "skill" is not necessarily computational. Especially in the no-limit/pot-limit case.

    Seriously, go read some books around no-limit and pot-limit gambling. You'll quickly find that the "edge" in these games isn't about the numbers.

  73. Re:BIG DEAL. They are talking about LIMIT hold'em! by javabandit · · Score: 1

    This group of doctors is solving a problem that might yield a small amount of additional expected value over commercially available limit poker bots.

    This group of doctors IS NOT taking on the problem of sitting a computer down at a table of 6 or 7 no-limit/pot-limit professionals -- and having the computer win. Why? Because they can't solve it.

    A computer sitting down at a no-limit table, surrounded by pros, would be pounded into playing only the highest value hands. Because it would "learn" that the only way it could predictably win is to play those hands.

    Hell, the best no-limit computer/bot out there would be one that doesn't even consider its own cards. The best no-limit bot would simply pick a hand it wanted to represent at the beginning of each hand... and then play each hand as if it actually had those cards.

    At least then it would be closer to a professional level of play.

  74. Gambler's ruin still applies by Maxo-Texas · · Score: 1

    Given a long enough game, there will be a plausible hand which seems like a winner which is beaten by another hand and results in a huge loss.

    --
    She was like chocolate when she drank... semi-sweet at first and then increasingly bitter.
    1. Re:Gambler's ruin still applies by Imsdal · · Score: 1

      You assume that the game is played for your entire bankroll. That is not the best of ideas, and generally not something even the most compulsive gambler is likely to do.

    2. Re:Gambler's ruin still applies by Maxo-Texas · · Score: 1

      I'm responding to the designer's bold statement that his program could be written well enough to play without loss.

      --
      She was like chocolate when she drank... semi-sweet at first and then increasingly bitter.
  75. Re:Reminds me of those... by SirLars · · Score: 1

    Betting $1000, 1000 times will cost you 1 million. Paying out 100,001 dollars every 1000 games actually only a shade over 10%.

  76. End of online poker by Lord+Lode · · Score: 1

    Well, that's the end of online poker, everyone could be using a computer doing it for them instead. Only face to face poker is reliable.

  77. just so you know by Anonymous Coward · · Score: 0

    i happen to live in Edmonton Alberta where this program was created and talked with one of the programmers, originally, the program had a limited number of actions, that is to say it treated similar hands the same way, ACE and TWO were treated the same as ACE and THREE, i was told by this go around the program would treat each hand individually, and just so you know the computer does bluff sometimes,

  78. June 3rd-6th? I think they mean July... by Casai · · Score: 1

    I mean, I know there tends to be some lag on Slashdot, but seriously!

  79. Re:Reminds me of those... by Icarium · · Score: 1

    Oblig. Wargames misquote: "The only way to win is not to play".

  80. Polaris? by tehcyder · · Score: 1

    I don't think I'd want an opponent called Polaris, I'd be afraid of a missile up my ass if I beat it.

    --
    To have a right to do a thing is not at all the same as to be right in doing it
  81. Re:Reminds me of those... by Alsn · · Score: 1

    The grandparent obviously meant a payout of $1,000,001.

  82. The Edsel of poker by Myrddin+Wyllt · · Score: 1
    TFA says they will be playing LIMIT hold 'em. Limit works for some types of poker, but it makes hold 'em an ugly, grinding game.

    I can see computers doing well at this fairly soon, as the options are much more limited and (comparatively) easily enumerated.

    The pros they have lined up didn't ring any bells with me, but last year Phil Laak opened up a can of whup-ass on the machine. It will be interesting to see how it goes this time around.

    Incidentally, I think pot-limit is a more skillful game in tournament format; it takes away one of the few obvious moves fish have against pros. In a ring game, though, NLTH is definitely 'The Cadillac of Poker'.

    --
    [ ]Half Empty [ ]Half Full [x]Twice as big as it needs to be
  83. Re:BIG DEAL. They are talking about LIMIT hold'em! by Anonymous Coward · · Score: 0

    The argument isn't that it isn't harder it's that the computer can eventually notice the same things people do.

  84. Re:BIG DEAL. They are talking about LIMIT hold'em! by markswims2 · · Score: 1

    I don't see why a computer can't randomly keep a few hands here when statistically it should fold. That way, whoever the computer is playing has no clue when it is a bluff and when it is not. The computer would have no tell. It's brilliant!

  85. Re:Reminds me of those... by drinkypoo · · Score: 1

    Having worked in a casino running numbers (Crystal Reports makes baby jesus cry) and working in marketing (who needs a soul anyway?) I can tell you that the slots themselves make money, and when you do have a big payout, it serves as advertising. When you have a gigantic payout, it's partly covered by the promotion (the biggest payouts tend to be part of some kind of network game) and people come from other markets to visit your casino. In California slots sell booze (it's actually illegal to give away alcohol in California) but in Vega$ the slots make money and some establishments give you some of it back in booze. If you can stand well booze, though, you probably get the best value for your money at the penny slots... and people at dollar slots aren't there for the free drinks. They're there because they have too much money and want to give it away.

    --
    "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
  86. go T go by Kadoo · · Score: 1

    go T go

  87. Can you read? by D.McGuiggin · · Score: 1

    So in other words you can't?

    CAN YOU READ? LIKE, THE PARAGRAPH JUST BELOW THAT ONE?

    How fucking stupid are you?

    "They're not arbitrary, they're designed to interfere with the pot odds, which is what the computer use to calculate how to play "perfectly". By giving the computer the pot odds necessary to call in situations where perfect play would call for it, but where the imperfect information factor makes said call wrong, you have manipulated the information the computer is receiving."

    It's right there you fucking moron

    So not only CAN I I DID.

    You certainly can card count in poker. Good players do it all the time. Hmm... there are four spades out already, what are the odds that another one is going to show up?

    That isn't card counting, you're a moron. NO it isn't, shut the fuck up.

    Any decent player is also going to keep at least an intuitive idea of the betting patterns of the other players around the table.

    And any other decent player knows that and will change their patterns. Stop talking because you have no idea what the fuck you're talking about.

    Anyway, since you've degenerated to writing your post in bold face

    In other words, you KNOW you're ignorant of the game and can't continue the discussion. Your petty attempt to ignore that very answer to your basic, beginner level question makes it clear you're not interested in answers, but in portraying your ignorant opinion as something other than ignorant.

    nd your excuse for not being able to come up with a reasonable argument why any particular factor in poker is uncomputable

    YOU ARE A LIAR. I gave you exactly what you asked for, that you pretend it's not there doesn't mean it's not there, it just makes you that much more pathetic for ignoring something that you asked for because you're too stupid to realize it's what you asked for.

    Have a nice day being a raging asshole

    1. Re:Can you read? by ceoyoyo · · Score: 1

      It's okay man. I was upset when I found out my favourite came could be played better by a computer too. When I wrote that unbeatable tic tac toe program in elementary school... well, life just wasn't the same for a while. But I got over it.

  88. I guess that's your admission that you're wrong by D.McGuiggin · · Score: 1

    I was upset when I found out my favourite came could be played better by a computer too.

    That's only because you're an imbecile who doesn't know how to play, as yet, there is no computer that consistently beat a skilled human player. RTFA to reiterate that if you're too stupid to realize it by now. I've put m money up, and have no takers. That says more than any argument you have, and frankly, I'll put my money up to you too, get whatever program you like and put up a decent stake, and we'll get to it.

    Don't assume everyone sucks at poker just because you suck at poker.

    When I wrote that unbeatable tic tac toe program in elementary school... well, life just wasn't the same for a while. But I got over it.

    I genuinely believe you're stupid enough to think a solvable game is equivalent to poker. I really do think you're that stupid.

    I also notice that you failed to address every single false accusation that I refuted, and are pretending you weren't lying in your previous post.

    You clearly have no idea how poker works, and are willing to say whatever you need to in order to avoid admitting that. Unfortunately, your statements are a shibboleth that you can't undo, and they clearly paint you as nothing more that a novice player with no skill or knowledge of the game at all.

  89. Re:Reminds me of those... by ShadowsHawk · · Score: 1

    it's actually illegal to give away alcohol in California

    How does Napa work into that?

  90. Man vs. Machine by GotGame.com · · Score: 1

    A robot chess match is one thing . . . but a poker match is something else . . . I don't think it really works simply because it takes away the whole bluffing element of the game. The machine can only play using probabilities so it can only play its own hand. However, poker is about more than playing your own hand.