Humans Hold Off the Machines... For Now
Murr writes "The six game match between Gary Kasparov and the Deep Junior program ended in a draw today. Kasparov won game 1 and lost game 3 to a blunder, while the other 4 games were drawn. While the quality of play was not outstanding, after the recent matches of Kramnik and Kasparov against commercial programs running on (high end) commodity hardware, it's becoming apparent that chess programs are getting quite competitive with top human players."
While computer programs that can play chess are quite sophisticated, Go is a really cool game that is very difficult to play well (from a computer's perspective). I think computer vs human Go matches would be much more interesting now,
-Sean
I watched this last night on ESPN or ESPN2.
The reason Kasparov gave for the match, and the championship ending in a draw was that it was better to draw than to lose.
He claimed that while a human player would have the memories of past moves and past games to deal with, the computer would not. The computer simply makes the 'best' move for the given situation, and then waits to do the same thing again. The human player would consider moves he/she made in the past, compare the situation to others they may have had, second-guess the moves they might have made, and so forth.
It was interesting to see Kasparov attack, and then ask for a draw (which was denied) and then, two moves later, end the game in a draw.
Ever Onward, Forward Bound
Something of a chess novice, I watched this game on ESPN2 yesterday, and I was very confused that Kasparov offered Deep Junior a draw immediately after his rook sacrifice. ESPN's analyst thought, and I agreed, that Kasparov was in a relatively strong position. However Kasparov spent 15 minutes debating that sacrifice. Did he see something nobody else saw? Does anybody here know why he offered a draw, why Deep Junior rejected the offer, and why they agreed to draw a couple of moves later?
My other sig is also a
1. Until very recently, end games have been the weak point of computer programs. Not withstanding end-game databases, which allow them to play a few endings perfectly, they have trouble making plans if there are more than a half-dozen pieces on the board. Recently, they've gotten a lot better, but they are still far from perfect.
2. Openings should be a strong point for computers, but Gary got an advantage in the opening in *every* game in the match. As you point out, the problem for computers is that humans look at their opponents openings, try to figure out weak points, and prepare traps for their opponents. Computers don't do this yet.
3. As you say, in the middle game, computers display a strange dichotomy. In quiet positions, they make stupid moves. E.g., in a couple games with Gary the computer played h3 (P-KR3), a move that had nothing to do with the game and weakened the kingside. On the other hand, they are deadly tacticians. Once Gary commited to an attack, things became tactical and the computer was very tough to beat; it found lots of weird-looking defenses that just barely worked.
Surely a chess computer is only as good as the person who programmed it?
;-) humans. Do we stage races between machines and humans? No, we race machines against (similar) machines and humans against humans, and nobody feels shame because some machine can run faster.
Any by the same reasoning, an auto can only run as fast as the mechanics who designed and built it. And a telescope can only see as far as the people who ground the lenses (or mirrors).
This whole thing is rather silly. And it'll end when we have software that can always beat a human.
After all, 200 years ago it was probably obvious that the ability to do arithmetic was a "uniquely human" thing. Then someone invented a mechanical calculator. Suddenly arithmetic became a merely mechanical capability that didn't imply superiority at all.
We have machines that can out run (and outfly
As soon as a computer can routinely beat a human at chess, we will give up machine-human chess competitions in the same way, and we will only compete with each other. Just like running and other competitions where we would always lose.
Those who do study history are doomed to stand helplessly by while everyone else repeats it.
One thing people don't seem to realize is that Deep Junior was a hell of a lot slower than Deep Blue, even though the Deep Blue match was over 5 years ago. That's because Junior was running on "ordinary" commodity hardware (8-way Xeon I think?) while Blue was a collection of hundreds of custom ASICs that do nothing but calculate chess moves. End result: Blue could search and evaluate ~200 million positions per second, while Junior as configured in this match "only" did ~3 million.
Nonetheless, Junior was almost certainly the better player. For one thing, the terms of the Deep Blue match were heavily tilted against Kasparov: he didn't get a chance to play against Deep Blue or even examine any games Deep Blue played before the match. For another, strategies of "anti-computer" chess are far more developed today than in 1997, when they barely existed (after all, the only way to build a world-class chess playing computer in 1997 was to build a supercomputer out of custom hardware). Third, Kasparov screwed up much more seriously in the 1997 match--one game he accepted a draw when he in fact had a provable win, apparently because he trusted the computer's evaluation of the position, and on several occasions he made terrible blunders.
Indeed indications are that even the normal Junior program on a decent PC plays the Kasparov-Blue games better than Blue did (except for a couple especially "brilliant" moves on Blue's part).
Not only is Junior (marginally) the best computer program available today, it is by a good measure the "most human-like". That is, it is still makes its share of "non-human" moves (although far fewer than Deep Blue), and still has no clue how to analyze certain positions, but its evaluation function has a much better understanding of position and is thus more willing to initiate complex piece exchanges than the other major programs. This showed up several times during the match, in two outstanding moves in particular (which netted come-from-behind draws for Junior in games 4 and 5).
Kasparov, by taking Junior out of its opening book, was able to exit the opening phase with the initiative in every single game. But in every game except for 1 and 6, Junior managed to draw even. In games 2 and 3, it was by virtue of outstanding tactical defense, which should have forced two draws (except that Kasparov screwed up the end of game 3 and lost). In game 5 it was with a shocking bishop sacrifice counterattack (extremely uncomputer-like) which nullified Kasparov's last turn as white (which is an advantage).
Perhaps game 4 is the best synopsis of the state of Junior's play. Kasparov played the opening perfectly according to plan, and ended up in a classic anti-computer position. Normally you can then just wait for the computer to screw up and then rip it apart. But while Junior did make a couple useless non-human moves, for the most part it played extremely well. Kasparov kept waiting to have an opportunity (perhaps too long), until finally Junior broke open the position by initiating an excellent multi-piece exchange. Kasparov had to settle for a draw.
OTOH, Junior had no idea what was going on in the endgame. Kasparov had a provable draw after move 47, but Junior, having no idea how to evaluate the position (no computer program does), thought it was winning. It played on until move 61 before the embarrassed programmers overruled the program and took the draw.
Overall, it seems that computers still have a ways to go before they can pass the Grandmaster Turing test. And it seems Kasparov really did just chicken out by accepting the draw in game 6. But the fact remains that Kasparov played quite well (for the most part) and simply couldn't convert his advantage in any game after the first. Meanwhile, while it still made a few computer-like moves that stuck out like sore thumbs, for the most part Junior played very solid chess with occasional strong speculative moves that would be aggressive even for a human.