Slashdot Mirror


A Data-Driven Exploration of the Evolution of Chess

HughPickens.com writes Randy Olsen has a interesting article where he explores a data set of over 650,000 chess tournament games ranging back to the 15th century and looks at how chess has changed over time. His findings include:

Chess games are getting longer. Chess games have been getting steadily longer since 1970, increasing from 75 ply (37 moves) per game in 1970 to a whopping 85 ply (42 moves) per game in 2014. "This trend could possibly be telling us that defensive play is becoming more common in chess nowaday," writes Olsen. "Even the world's current best chess player, Magnus Carlsen, was forced to adopt a more defensive play style (instead of his traditional aggressive style) to compete with the world's elite."

The first-move advantage has always existed. White consistently wins 56% and Black only 44% of the games every year between 1850 and 2014 and the first-move advantage becomes more pronounced the more skilled the chess players are. "Despite 150+ years of revolutions and refinement of chess, the first-move advantage has effectively remained untouched. The only way around it is to make sure that competitors play an even number of games as White and Black."

Draws are much more common nowadays. Only 1 in 10 games ended in a draw in 1850, whereas 1 in 3 games ended in a draw in 2013. "Since the early 20th century, chess experts have feared that the over-analysis of chess will lead "draw death," where experts will become so skilled at chess that it will be impossible to decisively win a game any more." Interestingly chess prodigy and world champion Jose Raul Capablanca said in the 1920's that he believed chess would be exhausted in the near future and that games between masters would always end in draws. Capablanca proposed a more complex variant of chess to help prevent "draw death," but it never really seemed to catch on.

68 of 109 comments (clear)

  1. checkmate by Anonymous Coward · · Score: 2, Funny

    first post.

    1. Re:checkmate by Half-pint+HAL · · Score: 1

      Really? I'm pretty sure there's been people doing this the whole time I've been here. In fact, there was a bit of a running gag for several years of people posting "frosty piss" instead of "first post" in the middle of the last decade.

      --
      Got them moderator blues I blieve I walk out the do', With these mod-points I been gettin', I 'most never post no mo'
    2. Re:checkmate by peragrin · · Score: 1

      First piss is a tradition like the cowboy meal option, and stupid people complaining about how it was back in the day when they weren't really paying attention back in the day.

      My uid is much lower than yours so I am right.

      --
      i thought once I was found, but it was only a dream.
    3. Re:checkmate by master_kaos · · Score: 1

      shouldnt that be last post?

  2. fun or obsession? by swell · · Score: 5, Interesting

    We evolve as chess players from enthusiastic amateurs who leverage our native skills to hard core analysts with a library of books on chess strategy. At what point does the game cease to be fun and become an obsession?

    --
    ...omphaloskepsis often...
    1. Re:fun or obsession? by PRMan · · Score: 1

      It ceased to be fun for me about the 2-3 time I played it.

      Give me Scrabble!

      --
      Peter predicted that you would "deliberately forget" creation 2000 years ago...
    2. Re:fun or obsession? by Anonymous Coward · · Score: 1

      Long ago I gave up this game for this very reason. In most games at certain skill level it becomes more about who makes a mistake vs who adopts or invents a better strategy, as all optimal strategies become known. At this level games cease to be fun for me. When a game is so over analyzed that it becomes clear "You must do X or you will lose" it is just not fun. You become forced to play a certain way.

    3. Re:fun or obsession? by phantomfive · · Score: 2

      If you are the type that enjoys hard core analysis and reading strategy books, then I suspect you would enjoy high-level chess.

      As for myself, I wish I could analyze 10 moves deep and keep all the branches of the tree straight. That would make me feel cool. I would be cool.

      --
      "First they came for the slanderers and i said nothing."
    4. Re:fun or obsession? by brantondaveperson · · Score: 1

      as all optimal strategies become known.

      Either you're a grandmaster, or you're a long way away from achieving this. I assume that it's the latter, but please forgive me if it's the former.

    5. Re:fun or obsession? by Half-pint+HAL · · Score: 2

      I think he means "known" in the sense of "documented in the literature". Chess becomes boring when improvement just means looking up another strategy in a book, and when your opponent can beat you not through being more intelligent or creative or practiced than you, but just because he's spent more time reading than you.

      --
      Got them moderator blues I blieve I walk out the do', With these mod-points I been gettin', I 'most never post no mo'
    6. Re:fun or obsession? by kipsate · · Score: 1

      Yes, perhaps the chess game should be started with the first row in random order. So we can at least ditch the opening theories.

      --
      My karma ran over your dogma
    7. Re:fun or obsession? by LaurenCates · · Score: 1

      To some people, obsessions are fun.

      I was going to make a serious statement about coding and people on Slashdot here, but instead, I think I'll just say "there's fan fiction" and leave it at that.

      --
      Some people don't believe in fairies. I don't believe in The Patriarchy.
    8. Re:fun or obsession? by Anonymous Coward · · Score: 2, Interesting

      That exists but is only moderately poplular:

      http://en.wikipedia.org/wiki/Chess960

    9. Re:fun or obsession? by kipsate · · Score: 1

      I'll be damned... honestly did not know!

      --
      My karma ran over your dogma
    10. Re:fun or obsession? by master_kaos · · Score: 2

      I dont know about you, but I always play with the second row in a random order.

    11. Re:fun or obsession? by DerekLyons · · Score: 1

      At what point does the game cease to be fun and become an obsession?

      Why do you presume the two are mutually incompatible? (Other than the negative stereotyping of obsession.)

      I'm accumulating a library of haiku books, translations, commentaries, etc... but that doesn't mean that writing them has become less fun. On the contrary, the deeper I delve, the more fun I'm finding.

    12. Re:fun or obsession? by Daniel+Hoffmann · · Score: 1

      You should try world of warcraft hardcore raiding, it is nothing like that.

  3. Thermonuclear War by Master+Moose · · Score: 1

    A strange game. The only winning move is not to play. How about a nice game of chess?

    --
    . . .gone when the morning comes
  4. Re:Draws only more likely with human players? by Shadow+of+Eternity · · Score: 1

    God dammit... alright I'll give you credit for actually getting me with that one you motherfucker...

    --
    A bullet may have your name on it but splash damage is addressed "To whom it may concern."
  5. This isn't even a problem unique to chess. by Shadow+of+Eternity · · Score: 1

    Unless mechanics prevent them by some hard method any sufficiently analyzable game will inevitably result in nothing but draws between two sufficiently skilled players. There will be variation on an individual level of course, nobody plays at the top of their game all the time, but as a whole the larger trend will be towards universal stalemates. Only games where mechanics do not permit stalemates by optimal play will avoid this.

    --
    A bullet may have your name on it but splash damage is addressed "To whom it may concern."
    1. Re:This isn't even a problem unique to chess. by wwphx · · Score: 3, Funny

      I used to help direct tournaments, including the US Chess Championship. The number of draws is pretty amazing, and part of it is the level of competition. They get material reduced to a certain point and position, realize that neither player is likely to make a catastrophic mistake, and offer a draw. I watched Josh Waitzkin and Boris Gulko battle it out to a closed position where they had lots of movement available, but neither could get a decisive advantage without a blunder, and that just wasn't going to happen. They drew, then went back to the break room to replay the game and see if there was a way around it.

      And then there's a certain player who would offer a quick draw then go to the nearest casino to play poker, which he was quite good at and normally won more than the tournament would have produced. And still get his appearance fee for the tournament.

      --
      When you sympathize with stupidity, you start thinking like an idiot.
    2. Re:This isn't even a problem unique to chess. by mrzaph0d · · Score: 1

      i play "words with friends" with a guy from work, we usually have two or three games going at once. at the start, i'd played for awhile before he started playing. i trounced him. after awhile, he picked up on most of the words, and we were almost even in wins. later, as we each developed new (to us) tricks and strategies, we would leapfrog ahead of the other. now, its really down to luck of the draw. we each use the same tricks and strategies, and its reflected when one of us has say a string of turns with no vowels present. or tons of high-point letters, but no where left to play them at the end of the game.

      --
      this is just a placeholder till i send back my real sig from the future.
  6. Getting boring by KraxxxZ01 · · Score: 1

    More defensive and more draws. Sounds like chess is getting boring.

    1. Re:Getting boring by Urquhardt · · Score: 1

      Which is why Chess2 was invented. To reduce the chance of draws. http://www.sirlingames.com/pro... Plus options for different army balances and other tweaks to increase the interest in chess again.

  7. Draws are much more common nowadays by hcs_$reboot · · Score: 1

    Draws are much more common nowadays, because in 1850 there was no ELO system and competitors were more likely at different levels. Nowadays, in official competitions a lot of games have people with similar ELO playing together, increasing drastically the odds of a draw.

    --
    Slashdot, fix the reply notifications... You won't get away with it...
    1. Re:Draws are much more common nowadays by phantomfive · · Score: 1

      Yeah. The most exciting games are where both sides battle mightily in a hard-fought game, maybe looking 20 moves ahead at points, and each side plays so perfectly it ends up as a draw.

      --
      "First they came for the slanderers and i said nothing."
  8. White goes first. Gee, that's surprising. by CuredPorkBelly · · Score: 1

    Not only is chess inherently racist it is also sexist and dangerously violent.

    https://www.youtube.com/watch?...

  9. Less than 56% for White, really by chipschap · · Score: 5, Insightful

    I actually had to read the article to figure this out. The statement that White wins 56% and Black 44% is for games in which a non-draw decision is reached (per the actual article). But with 10% to 33% draws, the actual difference in score is definitely lower. Conventional scoring is 1 for a win and 0.5 each for a draw.

    So White does have a persistent advantage, but the spread is lower than 8% going by score. And I think you have to go by score, that's what counts in tournament play.

    Let's say over the time period in question there are 20% draws (just for the sake of calculation). Out of 1000 games there are 200 draws. White wins 56% of 800 or 448, so Black wins 352. White scores 548, Black 452, or 54.8% to 45.2%. Still a clear White advantage, but somewhat less, and lesser still as we approach the modern 33% drawn.

    1. Re:Less than 56% for White, really by chipschap · · Score: 2

      "the spread is lower than 8% going by score"

      That should be 12%

  10. Computer chess, program error by Anonymous Coward · · Score: 1

    I had a chess computer, maybe a Kasparov 1985 16K. It had a 'behavioral' error. It would allow it's side to "castle" when the king was in check, a violation of the rules. It would enforce the rule and not allow "your" side to do that.
    As evidence that the programming in chess computer games has been recycled, I have seen that same error happening in a few other chess games on computers, including a mid-2000 'oughts' computer chess by Ubisoft. Check Wikipedia Chessmaster, which only mentions games after 1988.

    Hmmm...

    1. Re:Computer chess, program error by Anonymous Coward · · Score: 2, Interesting

      If you have ever written a chess playing program, or only a chess move validator, you would have seen how hard this very issue is. It is only slightly easier than checkmate & stalemate detection. The reason being, that you have to analyze the opponents' moves. So before you know, even when only validating, you are already recursing.

      Then there are plenty ambiguous situations, like, a piece that could attack the back row, but cannot do so because it would place its king in check. Your next iteration will miss this as a valid move, however for the castling opportunity it matters. So you will have to write code just for such exception. Or you might not want to iterate at all. Other details are pawns that can only move forward but capture diagonal (admittingly more related to check/mate/stalemate). Promoting. En-passent. Castling. It's all stuff that easily eats up kilobytes of code. The rules of chess look clear, straightforward and relative simple, but actually implementing it reveals a truckload of special cases.

      For a computer with only 16kB of memory, it is a forgivable error, since you need some logic for gameplay too, not only move validation. For PC software it's indeed very clumsy and no-one apparently ever bothered to validate it. However, the similarity of the error is most likely pure coincidental.

  11. Banalities.. by romit_icarus · · Score: 4, Informative

    First, for someone who has been playing chess competitively for the last twenty years, none of the results of the analysis is a revelation. Like so many "data" posts that seem to be in vogue, this one states quite the obvious viz the game of chess has evolved and has improved in quality. Hence opening colour matters, games are longer and many end in draws. DUH! As a secondary point, the OP makes a big show of the "steady increase" increase in length of game from the 1970s. On closer inspection, what is implied is that the average game has gone from 37 moves to 42 moves. For a chess player, that increase is hardly significant and can be attributed more as a result of prevailing opening theory and chess playing style than reflective of anything else. A clear case of data-blindness.

    1. Re:Banalities.. by DerekLyons · · Score: 1

      First, for someone who has been playing chess competitively for the last twenty years, none of the results of the analysis is a revelation. Like so many "data" posts that seem to be in vogue, this one states quite the obvious viz the game of chess has evolved and has improved in quality. Hence opening colour matters, games are longer and many end in draws. DUH!

      Like so many on Slashdot, you don't grasp the difference between "Duh, everyone knows that" and "proven by analysis of the available data".

    2. Re:Banalities.. by Comrade+Ogilvy · · Score: 2

      As someone who has played little chess but quite a few war/board games, the article is unsurprising, too. At first glance, chess looks like an offense heavy game. In offense heavy games, aggressive moves, even aggressive moves from novices, often provoke errors from novices forced onto defense. But as the game is studied, how to build efficient defenses with implied counterattacks converts offensive potential into defensive potential. Not every game works out that way, but the ones we keep going back to play again and again certainly do.

      We could imagine a variant of chess where the first player advantage were much larger. If 80% of the victories went to white, chess would just not be considered as interesting a game. A degree of lopsidedness can actually add to the game, playing black is a slightly bigger challenge, but there is a point where people tend to throw up their hands. The lopsidedness between colors in chess is quite small, as these things go.

  12. Re:White goes first. Gee, that's surprising. by hcs_$reboot · · Score: 1

    is chess inherently racist

    And what about when a Black man is offered to play first with the whites against a White man who has the blacks?

    --
    Slashdot, fix the reply notifications... You won't get away with it...
  13. buzz word by phantomfive · · Score: 2

    When did 'data driven' become a buzzword? And why is it a thing? Shouldn't every news article be data driven to some degree?

    --
    "First they came for the slanderers and i said nothing."
    1. Re:buzz word by LaurenCates · · Score: 1

      Eh, I gave up fighting that fight when I started reading and hearing people referencing "The Cloud" everywhere.

      We kinda had that, it's just that we weren't calling it that, and not a lot of people realized it was there.

      --
      Some people don't believe in fairies. I don't believe in The Patriarchy.
    2. Re:buzz word by BarbaraHudson · · Score: 1

      When did 'data driven' become a buzzword? And why is it a thing? Shouldn't every news article be data driven to some degree?

      Bennett Hazelton articles are an obvious exception. Unfortunately.

      --
      "Transparent" is a shit show that trades on every stereotype going. A man in drag is NOT a transsexual.
    3. Re:buzz word by phantomfive · · Score: 1

      lol that is so true........and if they were 'data driven' they would be so much better.

      --
      "First they came for the slanderers and i said nothing."
  14. Re:White goes first. Gee, that's surprising. by pspahn · · Score: 1

    Otherwise known to the rest of us civilized folks as "next game".

    --
    Someone flopped a steamer in the gene pool.
  15. White consistently wins 56% and Black only 44% by codeButcher · · Score: 1

    White consistently wins 56% and Black only 44%

    Que the SJW's in 3, 2, .... oh dang, someone's already done it.

    --
    Free, as in your money being freed from the confines of your account.
  16. RTS Chess by Anonymous Coward · · Score: 1

    I propose getting rid of the First Move advantage by getting rid of turns entirely. Either side can move whenever they want, first come first serve. Should also take care of that trend of chess games taking longer.

  17. Re:"data driven" - *Dangerous* buzz word! by TaoPhoenix · · Score: 1

    It's actually worse!

    Old stories were written with the story idea first, then data to back it up.

    You can tell from this one that someone said "look! I have a bunch of data hanging around! Let's give it a driver's seat and make up a story to go with it!"

    --
    My first Journal Entry ever, in 8 years! http://slashdot.org/journal/365947/aphelion-scifi-fantasy-horror-poetry-webzine
  18. Re:Time control changes by brantondaveperson · · Score: 1

    The study completely ignores the fact

    Pathetic fallacy. Please rewrite.

  19. Re:Chess is... by Half-pint+HAL · · Score: 1

    the only game that can defeat a computer is the game of love..

    I don't know... I can beat a computer at Whack-A-Mole if I've got a big enough hammer....

    --
    Got them moderator blues I blieve I walk out the do', With these mod-points I been gettin', I 'most never post no mo'
  20. Re:Uhh ... Re: checkmate by Geeky · · Score: 1

    It was established well before my time - ask the three and four digit guys...

    --
    Sigs are so 1990s. No way would I be seen dead with one.
  21. Re:Chess is... by Njorthbiatr · · Score: 1

    Variants aren't. Baroque Chess and Alice Chess are really the only forms of chess I play nowadays.

  22. Re:Uhh ... Re: checkmate by kipsate · · Score: 3, Interesting

    Please someone post a link to the first "first post" message on Slashdot. For the sake of documenting history.

    --
    My karma ran over your dogma
  23. Re:Chess is... by LaurenCates · · Score: 1

    So, the only winning move is not to play?

    --
    Some people don't believe in fairies. I don't believe in The Patriarchy.
  24. Shogi by Vermonter · · Score: 1

    I always liked the Shogi variant of chess. Other than a slightly larger board (9x9), and a few more pieces (20), you also have unit promotions, and deployment of captured pieces. The deployment of captured pieces especially keeps the late game from becoming simplified.

    1. Re:Shogi by billyswong · · Score: 1

      I always liked the Shogi variant of chess. Other than a slightly larger board (9x9), and a few more pieces (20), you also have unit promotions, and deployment of captured pieces. The deployment of captured pieces especially keeps the late game from becoming simplified.

      This just turns a draw game into an endless game. Since captured pieces are redeployed, there will be no "true" late game if both players are skilled enough and make no big mistakes.

    2. Re:Shogi by Vermonter · · Score: 1

      It just takes a slight shift of power, or one small mistake, for one player to get momentum and end up with the majority of pieces.

    3. Re:Shogi by billyswong · · Score: 1

      Letting the opponent captures a piece without any tradeoff is a huge mistake, not small mistake. So I would say for top-notch players, it's rare for one side to have majority of pieces that easily.

      The unit promotion mechanism also makes no pieces really "weak". Unlike internatioal chess, pawns don't need to reach the bottom to upgrade. Walking 2/3 of the board will do.

  25. Re:4 move checkmate by RoccamOccam · · Score: 1
    Chess with Death

    Malin Akerman and Michael McKean, plus a Lake Bell bonus!

  26. Reverse Chess by sjbe · · Score: 1

    We used to play a version of chess whereby the purpose was to lose the game. You played in reverse where you were trying to get yourself to lose your king. The wrinkle on playing is that you have to have the rule that if a piece CAN be captured during a players turn then the piece MUST be captured. If there is more than one option to capture the player being forced to capture has choice unless the King is one of the options. (can be played King capture optional too) If your King is captured, you win (by losing).

    It's kind of an interesting mental exercise to play this way because it makes you think about the game very differently.

    1. Re:Reverse Chess by donkwich · · Score: 1

      This has also been thoroughly analyzed as well. Turns out there are lots of moves that lose the game immediately from the first move. http://catalin.francu.com/nila...

  27. Big board size by Twinbee · · Score: 1

    I propose increasing the number of squares to double or quadruple to drastically reduce the number of draws and discourage opening 'book knowledge' over pure brainpower. As a side effect, we may even bew able to beat the top computers gain. I wrote about such a topic on Reddit here: http://www.reddit.com/r/chess/...

    Go has various board sizes. Why not chess?

    --
    Why OpalCalc is the best Windows calc
  28. 64-square Madhouse by Fritz Leiber by Wild_dog! · · Score: 1

    Fun story to read.
    This posting made me think of it.

  29. Re:Chess vs Go by ledow · · Score: 1

    And the complexity is (over a dozen?) orders of magnitude greater. And for which a decent amateur human still stands a pretty good chance against an average computer program.

  30. Re:Chess vs Feudal by ledow · · Score: 2

    Although the opening may seem like that, the complexity of chess is such that it's unlikely that every board position has been played.

    However, this is incredibly counter-intuitive because of the numbers involved.

    Do you know how many combinations there are of a standard 52-card pack of cards? 52! (factorial) = 80658175170943878571660636856403766975289505440883277824000000000000.

    It would take - on average - billions of years of billions of people each shuffling billions of deck a second to end up with the exact same deck twice.

    Chess's complexity provides slightly less more possible states than that but potentially much larger (over twice as complex, so billions of billions of billions of billions of....) actual viable game trees. However, Go's complexity is greater even on a 9x9 board. On the standard 19x19 board it's UNBELIEVABLY more complex.

    Feudal's complexity doesn't even come close.

  31. Re:4 move checkmate by Trax3001BBS · · Score: 1

    You seem a bit too clever for the likes of us simpletons here at Slashdot.

    Yep, knew I was putting myself on a cliff with that but it's how it works.

  32. Re:Chess vs Feudal by Imagix · · Score: 1

    While true that the number of permutations of a standard deck of cards is 52!, but you must consider that for many card games (Bridge, for example), the order of the cards in your hand is irrelevant. This reduces the number of permutations by a fair amount. It's still a big number, just not the plain 52! as presented.

  33. Re:Chess vs Feudal by ledow · · Score: 1

    Agreed.

    Now consider the average casino game, however, where up to seven packs are shuffled together.

    The game rules determine the actual complexity, yes, but the point was that complexity is an inherently difficult and counter-intuitive thing to estimate, let alone calculate.

    A simple pack of cards holds so many possibilities. And chess is approximately that complex (give or take a few orders of magnitude).

  34. Re:4 move checkmate by Anonymous Coward · · Score: 1

    1. e4

  35. Re:White goes first. Gee, that's surprising. by Tyler+Durden · · Score: 1

    Play Go then. Black moves first.

    --
    Happy people make bad consumers.
  36. 600k games is a very limited dataset by gmiller123456 · · Score: 3, Informative

    There are about 300k games played per week just on FICS. There are a few hundred USCF games played each week just in Louisville KY (where I play). I would imagine if you managed to pull from all of the sources, 600k wouldn't even amount to a day's worth of games.

    The set the author used suffers greatly from selection bias. Games are usually only included in commercial databases because they're interesting, or were played by interesting people. So I'm not sure anything interesting can be drawn from his results.

    Also, there needs to be some control put in place to account for rating differences. The Eli system isn't that old, and in the past players with drastically different levels of skill were more likely to play each other.

    1. Re:600k games is a very limited dataset by flopsquad · · Score: 1

      The Eli system isn't that old, and in the past players with drastically different levels of skill were more likely to play each other.

      Actually, the Eli System is pretty much all they had in the past. As in, "Hey Eli, match up the all these chess players, will ya?"

      Now Elo, on the other hand... :)

      --
      Nothing posted to /. has ever been legal advice, including this.
    2. Re:600k games is a very limited dataset by gmiller123456 · · Score: 1

      Autocorrect strikes again.