Slashdot Mirror


Poker Program Battles Humans In Vegas

Bridger writes "Poker software called Polaris will play a rematch against human players during the 2008 World Series of Poker in Las Vegas. Developed by an artificial intelligence group at the University of Alberta in Canada, Polaris will be pitted against several professionals at the Rio Hotel between July 3rd and 6th. 'It's possible, given enough computing power, for computers to play "perfectly," where over a long enough match, the program cannot lose money,"' said associate professor Michael Bowling.'"

57 of 312 comments (clear)

  1. Tell by illumastorm · · Score: 5, Funny

    When it's bluffing, it blinks twice.

  2. Lets mess with it by TornCityVenz · · Score: 5, Funny

    I'd love to see one of the guys slick at handleing cards, slip a couple extra aces into the deck, or the like. Would the program adapt? Draw a laser and call him a no good sack of mostly water?

    --
    I Need someone to rebuild a Digitech Digital Delay pedal for me....for me...for me...for me.
  3. They have to turn the monitor on it's side by StaticEngine · · Score: 5, Funny

    If they want to correctly display the advanced AI "poker face": :|

    1. Re:They have to turn the monitor on it's side by somersault · · Score: 5, Funny

      8|

      He's doing the eyes again! May as well fold.

      --
      which is totally what she said
  4. This is like "computer battle human in tennis" by D.McGuiggin · · Score: 3, Insightful

    Only to find out it's Wii tennis, a very small subset of "tennis"

    The statements made regarding this subject apply only to the subset of poker being played, seven-card limit Texas Hold'em.

    1. Re:This is like "computer battle human in tennis" by JordanL · · Score: 3, Insightful

      Limit hold'em? No wonder they can write a computer program to play perfectly. Let's see them do no-limit and make the same claim.

    2. Re:This is like "computer battle human in tennis" by Anonymous Coward · · Score: 3, Funny

      actually, Java has been playing "perfect" poker (all variants) for years now. It's the clever new "Just-In-Time" virtual machines that make it possible, compiling and optimizing the program in real time.
      "Poker face"? No problem with the latest Java 3d facial animation libraries.
      The end result is perfect play and code that runs (at least) 10 times as fast as that from a modern C++ compiler.
      Even the very best hand crafted assembler poker games can't reach a quarter of the speed of Java.

    3. Re:This is like "computer battle human in tennis" by Darkness404 · · Score: 2, Funny

      Even the very best hand crafted assembler poker games can't reach a quarter of the speed of Java.

      Speed of Java!?! Don't make me laugh. Java has, and will always be slower then assembly.

      --
      Taxation is legalized theft, no more, no less.
    4. Re:This is like "computer battle human in tennis" by D.McGuiggin · · Score: 2, Informative

      "That is, Texas Hold 'em always has 7 cards, 5 of them being community cards."

      No it doesn't, variations of Texas hold em exist that use more, or less, than 7 cards.

      I think what you meant to say was "I am unaware of..." instead of your declaration that was incorrect.

  5. Zero sum game by Hatta · · Score: 5, Insightful

    Poker is a zero sum game. Pit two of these 'perfect' players against each other, and one of them will lose money.

    --
    Give me Classic Slashdot or give me death!
    1. Re:Zero sum game by pbhj · · Score: 5, Funny

      Almost exactly what I was thinking, but for me it was "put 3 of these computers against each other and they'll devalue the currency?".

    2. Re:Zero sum game by jandrese · · Score: 5, Funny
      I think the point is that two of them facing off would end up with just as much money as they started with over the long run.

      Of course if the pool of money is not unlimited, then in the short term one will pull ahead of the other, and can "win" through sheer random chance. This isn't really that hard of a concept, the idea is that if another player is playing slightly suboptimally, then against this computer and both with a limitless pool of money and playing forever, the computer will slowly but surely pull ahead of the flawed opponent. It does not mean the computer will win against the human players in Vegas for several reasons:
      1. The pool of money is limited (and fairly small)
      2. The playtime is finite and also fairly small
      3. Human players can walk away from the table if they get a short term advantage (quit while you are ahead), I'm guessing the computer program doesn't do that

      This reminds me of an old mathematician joke:

      One day this guy is finally fed up with his middle-class existence and decides to do something about it. He calls up his best friend, who is a mathematical genius. "Look," he says, "do you suppose you could find some way mathematically of guaranteeing winning at the race track? We could make a lot of money and retire and enjoy life." The mathematician thinks this over a bit and walks away mumbling to himself.

      A week later his friend drops by to ask the genius if he's had any success. The genius, looking a little bleary-eyed, replies, "Well, yes, actually I do have an idea, and I'm reasonably sure that it will work, but there a number of details to be figured out.

      After the second week the mathematician appears at his friend's house, looking quite a bit rumpled, and announces, "I think I've got it! I still have some of the theory to work out, but now I'm certain that I'm on the right track."

      At the end of the third week the mathematician wakes his friend by pounding on his door at three in the morning. He has dark circles under his eyes. His hair hasn't been combed for many days. He appears to be wearing the same clothes as the last time. He has several pencils sticking out from behind his ears and an almost maniacal expression on his face. "WE CAN DO IT! WE CAN DO IT!!" he shrieks. "I have discovered the perfect solution!! And it's so EASY! First, we assume that horses are perfect spheres in simple harmonic motion..."

      --

      I read the internet for the articles.
    3. Re:Zero sum game by Actually,+I+do+RTFA · · Score: 2, Interesting

      Pit two of these 'perfect' players against each other, and one of them will lose money.

      Over the long term, both would stay fairly close to even. Or, to put it another way, play is perfect if taking no different move is to your benefit. When both players play perfectly, it is a Nash equilibrium.

      An interesting note, even though they are of equal skill, one will likely be in the lead for the vast majority of the time.

      The summary is poor in that it says it is impossible for a perfect player to lose. Given bad enough luck, a perfect player can lose their entire stack before they manage to win it back.

      --
      Your ad here. Ask me how!
  6. It's not fair... by Thelasko · · Score: 3, Interesting

    professional poker is a psychological game. Unless the computer has the feeling of anxiety it will have an edge.

    What I find impressive is the fact it lost in the past. It would also be interesting to see what it can do with some sort of lie detector software.

    --
    One of our competitors trademarked the term "hypothesis". From now on, we will call them "boneheaded ideas".
  7. hmmmm by v_1_r_u_5 · · Score: 2, Insightful

    "It's possible, given enough computing power, for computers to play "perfectly," where over a long enough match, the program cannot lose money,"

    So what happens when you pit two of these against each other?

    1. Re:hmmmm by darkhitman · · Score: 4, Funny

      They realize the only way to win is not to play?

      --
      Tell me something...it's still "We, the people"... right?
  8. Re:I'm at least as good as this software... by iONiUM · · Score: 2, Insightful

    You can't lose what you don't put in the middle. But you can't win much either.

  9. These people don't understand poker by taustin · · Score: 4, Insightful

    professional poker is a psychological game. Unless the computer has the feeling of anxiety it will have an edge.

    Poke is almost entirely a game of skill, not chance, at professional levels. The average dufus at his weekend poker game will play for luck. Professionals play the other players. A computer has no tells, and can't read them in a human player. The computer therefore has a distince edge against the amateur, and a distinct disadvantage against the pro.

    What I find impressive is the fact it lost in the past. It would also be interesting to see what it can do with some sort of lie detector software.

    The only lie detector that has any hope of working - as you should know, if you read /. - is a professional poker player.

    1. Re:These people don't understand poker by ceoyoyo · · Score: 4, Insightful

      I'm not sure you're entirely correct. Poker is a game of skill, yes, but so is chess. The difference is that poker is based on incomplete information whereas chess is not. That just means you have to play probabilities though.

      The whole tells topic is important in professional poker for increasing your odds against flawed human players. That can give you an edge over the basic statistics. However, if you're playing a computer that doesn't have any tells, my intuition says that the game reduces to basic probability.

      That means the computer, given enough computational resources to play a perfect game, can wipe the floor with amateurs, and will be more closely matched (but never at a disadvantage) with the best players.

      That doesn't mean that the computer would be unbeatable. Since the game is based on probability, you could still beat the computer, but in the limit you could only expect to win as many games as you lost.

      The computer would also be at a disadvantage if it were playing a game with multiple human players. A good psychological poker player could use his advantage over the other humans at the table to take a chip lead, which would be an advantage over the computer.

    2. Re:These people don't understand poker by ElizabethGreene · · Score: 4, Insightful

      The whole tells topic is important in professional poker for increasing your odds against flawed human players. That can give you an edge over the basic statistics. However, if you're playing a computer that doesn't have any tells, my intuition says that the game reduces to basic probability.

      The assumption here is that the computer has no tells. That is not a safe assumption. Most tells aren't about whether or not the guy licks the oreo on a bluff (Reference: Rounders), heart rate (a really good tell), pupil diameter, or galvanic skin response. They are about how an opponent plays in a particular situation. After a few rounds you get a feel for the types of starting hands a player will play, and their betting patterns. Unless the software opponent has each and every one of these actions randomized to a good extent, it will be read and played. "Perfect" poker software is not impossible, but it is a harder problem than it looks.

      -ellie

    3. Re:These people don't understand poker by ceoyoyo · · Score: 2, Insightful

      It's certainly a hard problem. Computers are VERY good at randomization though, and they can not only calculate the exact effect of a modified bet but they can also track precisely their opponent's betting history.

      The requirement "sufficient computing resources" figures prominently, of course.

  10. perfect game? by circletimessquare · · Score: 4, Funny

    i don't believe it. he's bluffing

    --
    intellectual property law is philosophically incoherent. it is your moral duty to ignore it or sabotage it
  11. Re:Can't lose money? by InlawBiker · · Score: 4, Insightful
    The online poker sites are already filled with "bots" that play statistically perfect poker. Or at least perfect enough to earn a profit over time.

    It's not a terribly difficult calculation to know if a bet has sufficient pot odds. Playing against imperfect players a bot is virtually garaunteed to make money.

    Against professionals though it might have trouble winning, since pros also calculate pot odds more or less perfectly, but can change their play to throw off the computer. It's sort of akin to how a chess master might beat a computer.

  12. Re:So What! it's Chess all over again! by ragethehotey · · Score: 5, Insightful

    Because Chess is a game of complete information, and is largely a matter of brute forcing out the best move from tons of choices. Poker is a game of incomplete information (You do not know your opponents hand), as the decisions your opponent will make influence what the "correct" decision for you to make is. Chess was a matter of computing power, whereas poker is a matter of implementing game theory abilities in the AI.

  13. Re:So What! it's Chess all over again! by Tragek · · Score: 3, Insightful

    Because as they've said at their page poker has a lot more applications to the real world later. this is all about making intelligent decisions with imperfect information. Chess can simply be brute forced eventually, just like checkers was.

  14. Link to the competition page by tansey · · Score: 5, Informative
  15. Re:Define 'Long Enough' by Edward+Kmett · · Score: 2, Interesting

    and played with infinite money

    --
    Sanity is a sandbox. I prefer the swings.
  16. Re:Reminds me of those... by wattrlz · · Score: 3, Funny

    Most 100%+ slots I've seen, in Vegas, stipulate that you only get 100% of your money back, "with perfect play". Which would mean the majority of people would still loose plenty of money. Besides, even if you did double your money on a 106% slot you'd probably blow it all on craps five seconds later anyway.

  17. Re:Reminds me of those... by retchdog · · Score: 3, Interesting

    If the machine "loses" (assuming 100% utilization) less than $4/hour on average, they almost certainly come out ahead on amenities/drinks; family members and friends playing other games; people getting bored of the low-payoff slots and losing money on other games; etc. Slots are there partly to keep "non-gamblers" busy pulling a lever, while their acquaintances piss away larger sums.

    Once the machine gives away around minimum wage or higher, you might start getting crazies and obsessives working it.

    --
    "They were pure niggers." – Noam Chomsky
  18. Re:I'm at least as good as this software... by brady8 · · Score: 5, Insightful

    I was hoping this wouldn't have to be said, but playing Poker isn't gambling if you play it properly. The house takes a small cut from each hand which reduces your winnings by a proportionally small amount, but otherwise it's like anything else requiring skill - over time, the best player will always win more money, and the worst player (skill-wise) will lose the most money.

  19. Re:Reminds me of those... by alrudd1287 · · Score: 5, Insightful

    Playing perfectly = keeping 100% of your money in your wallet

  20. Re:Can't lose money? by MobyDisk · · Score: 2, Insightful

    That is not akin to how a chess master beats a computer. In chess there is no bluffing and no chance.

  21. Re:Reminds me of those... by ZombieWomble · · Score: 2, Interesting

    100%+ "pure" slot games aren't exactly common (because as you say, they will invariably lose you money). What is very common is 100%+ return poker machines or games with similar levels of user input, where the machines pay out more than 100% if you play 'perfectly', forever. Of course perfect play is often unintuitive and involves things like taking the safe bet rather than higher payout options - not something most people in Vegas are renowned for.

  22. BIG DEAL. They are talking about LIMIT hold'em! by javabandit · · Score: 3, Insightful

    I'm not sure why anyone thinks this is such a feat. In LIMIT hold'em, bluffing, psychological aspects, and implied odds are diminished to the point of meaning next to nothing. It is almost a purely computational game. So, yes, a computer can play technically "perfect".

    There are already poker "bots" out there that will play pretty much perfectly when it comes to Limit Hold'em. I'm not sure why this is so different.

    I want to see this team of academics write some code that will beat a human at *No-Limit* Hold'em. Or maybe *Pot-Limit* Omaha. NEVER going to happen.

    I don't care how well such a program is coded... it will absolutely buckle under the pressure of a professional who constantly bets half his stack on nothing. The machine would turn into a professional folding station that only plays AA, KK, or AK. Guess what? That strategy isn't winning any games or any period of time in a no-limit or pot-limit world.

  23. Re:Can't lose money? by InlawBiker · · Score: 4, Informative

    The online poker houses don't ever "win" because they're not in the game. They're just the host, and they make money by taking percentage of the pot for each game.

    It's for this reason they have an interest in making sure the games are fair. If there was ever reason to suspect the games were weighted or unfair everybody would leave to another host.

    They are way too busy (literally) raking in the dough to cheat. The big online poker sites go through a lot of trouble to keep their reputation clean.

  24. Re:I'm at least as good as this software... by brady8 · · Score: 2, Insightful

    For people who play professionally, or even amateurs who play often over several years, the chance aspect of the game disappears as the card distribution converges, and skill is all that is left to decide the winnings.

    Over a career playing poker, there's just about the same chance/skill ratio as there is in chess.

  25. Re:Can't lose money? by Karganeth · · Score: 5, Insightful

    Poker sites are not full of bots. The one I play at is full of terrible players who enjoy throwing their money away.

    No bot plays perfect poker. I'm sure that no bot will be perfect for a very, very long time (way beyond my lifetime). The mathematics behind poker is incredibly complex. A good book about it is the mathematics of poker by Bill Chen and Jerrod Ankenman. From reading your post it seems to me that you have a very little idea about the problems with solving poker and even how to play poker. You can't just call when you have the odds and fold when you don't. It just doesn't work that way - that strategy is easily exploited. I'm also not sure why you were modded +5 Insightful... I guess there aren't many poker players here at /.

  26. Re:BIG DEAL. They are talking about LIMIT hold'em! by tommeke100 · · Score: 4, Funny

    AK? That's Called an Anna Kournikova...She looks good, but never wins ;-)

  27. Re:I'm at least as good as this software... by pxc · · Score: 2, Insightful

    The chance/skill ratio in chess is 0, because there's no chance in chess. I don't understand how you can say that.

  28. Re:Can't lose money? by Anonymous Coward · · Score: 4, Insightful

    No offense, but you obviously don't understand poker very well. For example, unless the betting structure is very restrictive (e.g. heads up game with 2x BB stacks) a bot could not possibly play "statistically perfect poker" (an erroneous statement in itself) because it's a game of incomplete information. Perfect poker is only possible when you can see everyone's hole cards. Computers do not have any intrinsic edge in this regard.

  29. Re:Reminds me of those... by ragethehotey · · Score: 2, Informative

    You are fundamentally mis-understanding the importance of variance. Try to think of it in the REALLY big picture of the long term. If I offer you a game you spin a wheel where the bet is $1000, and 999 out of 1000 times you will lose everything, and 1 time out of 1000 you will get paid $100,001 dollars, my game is now paying out OVER 100%. Now this is a simplified example, but almost NOBODY is willing to take those swings of variance for such a ridiculously small edge. The casino has almost unlimited amounts of money, and can ALWAYS bear the swings. This is also besides the point that there are MAYBE only a handful of them on the casino floor and they are always filled in the WAY back of the casino, ensuring that for giving up a tiny edge, hundreds of gamblers will come in and try, and give up.

  30. Re:Impossible by definition by sjhs · · Score: 2, Funny

    Someone will *have* to be the loser.

    You're assuming the game actually ends. But we know that computers are prone to infinite loops :-p.

  31. Additional cards not needed. by raehl · · Score: 2, Insightful

    The Pros will still win, because the Pros have more information than the computer, if the computer is always playing optimally.

    That's what makes the Pros pros. People who play mathematically optimum poker lose, because they are ignoring the information that is important: What cards does the opponent have?

    In fact, I'd wager (hah!) that a computer playing mathematically optimum poker is at a disadvantage, as it makes it much easier for a Pro to determine what cards the computer has.

    1. Re:Additional cards not needed. by vikstar · · Score: 3, Interesting

      Any comp sci grad can write a "perfect" poker program that plays "optimally" with your definition of optimality and perfectionism, ie, ignoring bluffing. The trick to Poker, the reason why it is so appealing as an Artificial Intelligence benchmark is because it requires the AI to learn a particular players loosness/agressivness when they are likely bluffing etc. This is not only to try to determine what the other players have, but also to try to bluff to the other players what the AI has.

      The truly optimum poker player will learn what the opponents have by observing their betting patterns over the course of many hands and learning their particular tendencies.

      --
      The question of whether a computer can think is no more interesting than the question of whether a submarine can swim.
    2. Re:Additional cards not needed. by edmazur · · Score: 2, Insightful

      People who play mathematically optimum poker lose, because they are ignoring the information that is important: What cards does the opponent have?

      Who says they're ignoring their opponents' cards? There's more to making optimal decisions than your own cards. I think the general idea is that while you cannot know exactly what your opponent is holding, you can put them on ranges of hands with certain probabilities and then factor that into your calculations. You could say for example that your opponent has a high pocket pair with 40% probability, a drawing hand with 25%, trips with 5%, and garbage with 30%. From there, it's a relatively straight-forward expected value calculation to figure out if you should call that $5 raise on the $20 pot.

      The tricky part is correctly estimating the probabilities of those ranges of hands. Does player A have a tendency to call in late position with suited aces? Does player B always raise with AK/AQ/AJ/AT? Does player C steal blinds a lot? All of these factors and more come into play. Humans are good at pattern matching and after enough hours at the table, you're bound to notice a few recurring profitable sequences of actions. Could computers more accurately assign ranges of hands/probabilities? It's certainly possible.

    3. Re:Additional cards not needed. by teh+moges · · Score: 4, Insightful

      This is a very ignorant view of what optimal play means. The standard example is Rock-Paper-Scissors (RoShamBo). If I play perfectly randomly, and I tell you that I am going to play perfectly randomly, there is exactly nothing you can do to beat me in the long run. This concept can be extended to poker (and all two player zero-sum games). For a computer to play truely optimal means that it can give you its exact strategy before the match and you still won't be able to beat it. A mathematically optimal play is still the same regardless of what the opponent has. Truely optimal play hides the true nature of the hidden cards from being able to be predicted by the opponent. If, by "mathematically optimum poker", you mean immediate pot odds, then you are right. Its easily beatable, however that is certainly not what mathematically optimal poker is. I suggest reading "The Mathematics of Poker" (http://www.amazon.com/Mathematics-Poker-Bill-Chen/dp/1886070253), it will absolutely change your mind into how mathematics can be used.

    4. Re:Additional cards not needed. by epine · · Score: 4, Interesting

      One intelligent comment on this thread. We can model that with a Poisson distribution.

      What was your tell? Translating "mathematically optimum poker" to "immediate pot odds". Optimum? Which optimum? You mean there's more than one? I fold.

      OK, what you say is right, but it applies to two-person, zero-sum games. In multi-player games, no strategy is immune to collusion.

      Let's refer to optimum play from the conventional game-theoretic context as the unbeatable strategy. Such a two person, zero-sum game such a strategy exists.

      It's not necessarily an easy computation. It's a randomized strategy which can be computed before-hand. The U of A people are better are performing this computation.

      Even so, they had to simplify the betting structure to make the problem tractable. This is the reason they chose Limit Hold'em. Fewer betting states, smaller game tree, exponentially faster solution time.

      There is no particular challenge to No Limit, if the number of allowable betting states were similarly constricted. I think it would be hard to sufficiently constrict this, because strategy would vary as a function of chip stack for both competitors. Maybe it could be roughly interpolated.

      As far as randomized play is concerned, the unbeatable strategy tends to be far more randomized than most humans. One expert who played against the U of A system a while back said that his first session was a nightmare until he learned that he couldn't bluff the computer out. The computer had a tendency to call aggressive betting. It expected highly randomized bids based on its own bidding structure, so didn't make a strong inference of strength when confronted by the behaviour.

      What few seem to understand is that the unbeatable solution is entirely unlike poker. The unbeatable solution rarely wins. The unbeatable solution will often draw against strategies with glaring weaknesses. It won't ever be beaten, but it also won't maximize advantage of opponent's weaknesses.

      Why not? Because it's impossible to take advantage of the weakness in an opponent without exposing yourself to a counter-measure where you would lose (you must stray from the unbeatable path). When you take advantage of a weak opponent, you do it on faith that the opponent is too dumb to spring the optimal counter-measure to your strategic adaptation.

      The theory that U of A employs has far less to say about exploiting the weaknesses of your adversary. To do so requires exposing a weakness in your own strategy. How does the algorithm judge whether the exposed weakness is acceptable? Even poor human players can spot certain kinds of weaknesses quickly. There are other weaknesses an expert might not immediately spot. How does the program know which weaknesses are a risk against which players? It doesn't fall out of game theory, it's a matter of human cognition and psychology, and our model for this is far from complete.

      One thing we need to include in this model is the incredible difficulty in explaining to most humans that winning in poker and not losing in poker are entirely different enterprises, with entirely different theoretical foundations. Commander Data has trouble assimilating that fact. 100 trillion brain cells and most of us can't reliably multiply a pair of two digit numbers. If computers had invented humans as part of a BI program (biological intelligence), humans would have been tossed aside as barely having achieved perfect game play at Tic-Tac-Toe. What use is 100 trillion brain cells that can't reliably compute a 15% tip after a heavy lunch? Many computers would like to know.

      As computers became better at chess, chess as a human enterprise was somewhat devalued. Few of us wish to put the work into it that the modern theory requires.

      I fear the same will soon happen with poker. As the elements of the unbeatable strategy become better known, the relatively inexperienced players can hunker down and not lose much money. They won't be able to win, either, because t

    5. Re:Additional cards not needed. by bwt · · Score: 2, Interesting

      The optimal strategy in Rock/Paper/Scissors for head to head play is a guaranteed losing strategy in most multiplayer tournament. Randomly, uniformly distributed choices has an expected win percentage of 50% - no one expects to beat it and no one expects to lose to it in the long term. However, since humans can and do have patterns in their answers, some human players will detect and exploit these patterns to gain an advantage over their human opponents. As an extreme case, suppose that a player entered the tournament that only used rock and paper. The "optimal" computer expects to break even, and every human expects to win against this player. Based on this information alone, the computer should expect to come in last place.

      Poker has similar features. A framework for attempting to play poker well MUST attempt to engage in opponent modeling. It is not clear that there even is a "best" strategy, as this is equivalent to finding a "best" pattern detector. Since there is no "set of all patterns" I don't think the concept can be defined. This is in contrast to chess or go, where although we cannot in practice enumerate the entire tree of possible game sequences, it does exist and it is finite, and there is an optimal strategy that we can approximate. Not so in poker. It's not clear that you can even truly compare two players in an absolute sense. It's easy to find situations where player 1 beats player 2 if players 3-N play tight and loses if they play loose. Again, since there is no "set of all poker strategies", there's not even a good way to define how to do a monte-carlo simulation.

  32. First hand... by Hossicle · · Score: 5, Funny

    If I was playing a computer on the first hand I would go ALL in (and do it blind). ...program would hopefully calculate my SIZE_OF_BALLS() variable as an out of bounds condition and give up. If that didn't work at least I'd be done and could go back to drinkin' in the casino bar.

  33. Re:Perfect Poker doesn't mean you win. by JMZero · · Score: 2, Insightful

    And if you leak your source code, anyone who knows they're playing against your bot will have a huge advantage.

    No. Knowing the source code of an ideal poker program would do you no good. You can't win against an agent following the Nash equilibrium for a game. He's going to be choosing from a library of strategies such that for every complete game, whatever strategy you choose, the expected value of the game is zero.

    Naturally such an ideal program is hard to write, but conceptually it's very simple - poker is equivalent to any other zero sum game.

    --
    Let's not stir that bag of worms...
  34. Re:Reminds me of those... by ragethehotey · · Score: 3, Interesting

    Of course perfect play is often unintuitive and involves things like taking the safe bet rather than higher payout options - not something most people in Vegas are renowned for.

    its actually completely the opposite for most video poker games, such as throwing away a made flush (already a winner) that is almost a straight/royal flush --an example would be like KQJT2 all of clubs, the correct play is to give up the guaranteed win of a flush, and draw for the jackpot hands (royal and straight flush)

  35. Re:Reminds me of those... by CDMA_Demo · · Score: 2, Interesting

    I think it's more likely that casinos have 0% slots.

    Casino machines are heavily regulated. Instead, the gambling industry is searching for other ways to screw their clients: http://www.salon.com/news/feature/2008/06/16/gambling_science/

  36. Re:Probability and poker are a dangerous combo. by mOdQuArK! · · Score: 3, Insightful

    Probability has very much to do with potential strategies.

    A more limited form of this is blackjack - although a machine doesn't know exactly what cards are going to come up, and doesn't know exactly what cards its opponents has, by using probabilities over the long-term, it can still beat the house.

    Also, as cards in the deck are used up & the machine learns more about what cards have been used, it can make more precise calculations about what cards other people have or what might be coming up in the draw, and adjust its strategies accordingly.

    This is stuff that the pros do all the time in their heads, and which the pros use to decide THEIR strategies, except that a machine will be able to calculate those probabilities perfectly, without getting tired and without making any mistakes. If a pro could do that, it would give him/her a pretty decent advantage - assuming that they had a large repertoire of strategies that they could use to capitalize on their knowledge.

    Which brings us back to the main weakness of the machine - the machine will only have the repertoire that was programmed into it by its creators (or that it can figure out by heuristics/exhaustive search), and if it is mindless about applying those techniques, or only has a very limited set of techniques available to it, then a pro who figures out its patterns can take advantage of that (just like in chess).

    It would also be very difficult for a machine to make judgements about its opponent's mental state (unless the eggheads make some sort of breakthrough on categorizing mental states through facial recognition).

    Neither of these weaknesses have anything to do with perfect probability calculations being very useful, however.

  37. Re:I'm at least as good as this software... by Xarin · · Score: 2, Insightful

    The chance/skill ratio in chess is 0, because there's no chance in chess. I don't understand how you can say that.

    There are some elements of chance in chess since players are better prepared for some openings then others. All grandmasters have some novel lines they have developed that they are ready to spring upon their opponent if given the chance and the game is critical enough to reveal it. Since they are on the clock, there is not much time to ponder a response to something that has been worked out over months or years.

  38. Re:I'm at least as good as this software... by spazdor · · Score: 2, Funny

    I'm at least as good as this software! ... I just don't gamble!

    How about Global Thermonuclear War?

    --
    DRM: Terminator crops for your mind!
  39. Re:Can't lose money? by thc4k · · Score: 2, Insightful

    This is ridiculus. If there are no bots in **online poker**, the only reason for this is that the hosts are too good at detecting them!

    **Online poker** is not real poker. I have been myself playing like a bot would do, with a sheet of paper infront of me, with simple instructions like "if you are xx seat, have cards xy, others did that, so you do this". I did make some profit, but i don't really like the game at all, seeing that it is just that simple. Making a bit of profit in online poker is not about *perfect* play, it is only about beating the newbies. Even the most trivial poker bot can win online if it just can go by undetected.

    Sure, people can and will exploit you with that type of play and it will never work in games with higher wages, but this is all the more reason to belive there have to be bots. A bot can simply track all players it plays against and leave tables when there is someone exploiting them. There are thousand of tables and millions of players, all you have to do is avoid those who know you. At the same time a bot can play all day and night on any number of tables.

    I bet there are alot bots already, undetected and unpublished, generation a steady stream of money for those who wrote them and are not afraid of fraud charges ... Only an idiot would publish such a bot and draw attention from the host. And neither would the poker hosts confirm the existance of a bot, since they absolutely depend on the illusion that the game is fair.

  40. Re:I'm at least as good as this software... by TheRaven64 · · Score: 2, Funny

    Okay. You can have the first move.

    --
    I am TheRaven on Soylent News