AI Taught How To Play Ms. Pac-Man
trogador writes with the news that researchers are working to teach AIs how to play games as an exercise in reinforced learning. Software constructs have been taught to play games like chess and checkers since the 50s, but the Department of Information Systems at Eotvos University in Hungary is working to adapt that thinking to more modern titles. Besides Ms. Pac-Man, game like Tetris and Baldur's Gate assist these programs in mapping different behaviors onto their artificial test subjects. "Szita and Lorincz chose Ms. Pac-Man for their study because the game enabled them to test a variety of teaching methods. In the original Pac-Man, released in 1979, players must eat dots, avoid being eaten by four ghosts, and score big points by eating flashing ghosts. Therefore, a player's movements depend heavily on the movements of ghosts. However, the ghosts' routes are deterministic, enabling players to find patterns and predict future movements. In Ms. Pac-Man, on the other hand, the ghosts' routes are randomized, so that players can't figure out an optimal action sequence in advance."
It just lied that it could play Ms. Pac-Man so it could get more reward food.
live fast, eat chips, big ones are the best and avoid the gosh with ugly faces
I feel I'm beginning to understand ...
Perhaps the greatest achievement of AI would be to understand female behavior
Be very, very careful what you put into that head, because you will never, ever get it out. - Cardinal Wolsey
I was playing quakewars against the computer AI, you know... the bots?
Seven Days with Ubuntu Unity
As if everybody didn't already waste too much time on games, do we have to teach programs to waste time too?
Terrorists can't threaten a country's freedom and democracy. Only lawmakers and voters can do that.
Who's Al?
I was flipping bits on an abacus, newb.
I think most press releases re: AI are misleading. I highly doubt there is anything like "AI" behind the program they have that attempts to solve Ms.Pacman. Consider if you wrote an "AI" that started off with what you as a human starts off with: the ability to see the screen and understand what the various graphics depict or mean; how to control the pac character; what the basic goals and obstacles are; and a desire to rack up points. An "Artificial Intelligence" (AI) would be able to start with that much and build its skill level as it plays. Presumably it would quickly build a talent that can beat average humans, then most humans, then eventually all humans since it has faster reflexes and doesn't get tired (or make errors once it's learned). That, I think, would justify a press release "AI learns to play Ms.Pacman". However, scripting something that plays the game as well as you can imagine it should be played doesn't seem to be news any more than "scripters automate online game play". I only note this because the article mentioned "teaching" the "AI"; that's not very scientific, considering you're trying to see something learn, and should be maintaining scientific control over the learning process.
"Stratigraphically the origin of agriculture and thermonuclear destruction will appear essentially simultaneous" -- Lee
Average score of only 8186 (vs. 8064 by humans). Nothing really amazing here; if the AI could soundly trounce the best humans on a regular basis I might be impressed, but I can consistently score above 10000, and I'm not very good. TFA also notes that humans make better decisions on scoring points, while the AI shows some survival ability. Sounds like they need a better Ms. Pacman program.
"Please describe the scientific nature of the 'whammy'" - Agent Scully
"I feel I'm beginning to understand ...
Perhaps the greatest achievement of AI would be to understand female behavior"
Understand that you can never 'understand' female behavior and be done with the entire exercise...
Only by teaching them to waste time AI will be become truly human...
Be very, very careful what you put into that head, because you will never, ever get it out. - Cardinal Wolsey
So now we're teaching our AI that it's a round, dot hungry trans-gender Miss-Man being chased by ghosts?
When the AI manages to play (and beat!) Baldur's Gate, I'll be seriously impressed. Pacman/Tetris simply aren't that exciting.
The most interesting development came when the machine suddenly stopped killing ghosts and simply displayed the message: "The only way to win is not to play!"
"I like to lick butts!" by MobileTatsu-NJG (#32700246) (Score:5, Informative)
Now we just need one that can play WoW for my friends so they can get their lives back!
The new AI game playing routines can handle Ms. Pacman, Tetris, and Baldur's Gate. Can their mathematics routines find sums of integers, roots of quadratics, and proofs of Fermat's Last Theorem?
I've never been a big Ms. Pac Man player, always preferred the original, but when there's an AI that can pull off a perfect game then I'll be impressed, like that guy who got a perfect score on Pac Man without losing a life in the 80's. When the AI can do that it's done something. Not breaking 10,000 points? Meh.
I'd almost be more impressed if it could have learned the routes of the ghosts in Pac-Man vs learning to avoid random movements. AI in the Ms Pac-Man game just needs to run away while to succeed in Pac-Man you need to first realize there are planned routes and then learn them.
This is cool, being able to choose smart moves against a random opponent could have a lot of uses in enemy AI in other games too. The unpredictability of a human opponent has always been an issue when creating realistic AI. It always kind of bugged me that even in new advanced games like Crysis, enemies will sometimes move in the most stupid ways possible. The next generation of FPS AI could use something similar to this.
Weaksauce as they say...
Can the AI play Tic Tac Toe?
That's it? Get right out of town!
Honest to Jebus, I was writing Netrek bots in 1994 that used a genetic algorithm to self-guide their development, and you don't get more "random" than human opponents. When all those Quake bots hit the scene a couple of years later, it was already old hat as far as I was concerned, and now some Korean MMOs are almost entirely populated by robots. Are people really still getting grants for this?
If you were blocking sigs, you wouldn't have to read this.
So we're now creating AIs that are learning how to eat things and we have that run on meat.
Nope. I don't see any way how this could result in the destruction of the human race!
... between the AI and humans tested playing the game appears to be (last para) that the humans were able to adapt their tactics.
E.g. They learned to lure ghosts close to Ms Pac-man so they would easuer to catch and eat once they became edible.
I'm sure this tactic could be programmed as a new rule and added to appropriate position on the AI's 'priority' list.
But until this 'cross-entropy' learning method (and any other AI learning technique for that) can truly teach the AI to adapt by itself - from it's own observations - then it's just not proper AI, imo.
"He Who Dares Wins"
...and we've had Angband Borg for some time (which is very impressive!)
Would you like to Play a game?
First Ms. Pac-Man... next Skynet.... I'd pull the plug if I were teaching the PC before it's too late.
Oh, sure. These guys get praised for their great research, but when I teach my computer to play WoW I get banned!
...that the only difference was that Ms Pac Man had a bow in her hair.
Tetris, Ms. Pac-Man, and Baldur's Gate... One of these things just doesn't belong!
Religion for nerds. Stuff that really matters
Thought John Koza had Genetic Programs playing pac man over 15 years ago.
There is an xscreensaver hack that is a pacman game with various level styles. I suspect that the monsters in that are a bit more random in their movement. However, the monsters move slower than pacman, and the pacman currently seems rather stupid, running towards monsters, and just collecting air when there's still plenty of pills to pick up. It would be nice to work on the AI in that, then I'd get a more interesting screensaver to watch.
Ask me about repetitive DNA
I'd really like to see these guy's algorithms in the game of Go (wei-qi). :-)
Or imagine one day being able to get some machine learning from Guo Juan http://www.guojuangoschool.com/ - she's pretty nice and (still) understandable high-dan player.
Recently some Chinese professor that participated in the Deep Blue's victory over Gary said with the help of M$ research money he's inking closer on the brute-force approach in Go next http://www.spectrum.ieee.org/oct07/5552 . But it is still a steep curve. The chinese chess projections point to a breakthrough in the next 2-3 years and it is still a couple of exponents simpler than Go.
So, way to go, Ms.Pac-Man
Now, Make Your WISE Move...
The authors state "In most of Pac-Man's sequels, most notably in Ms. Pac-Man, randomness was added to the movement of the ghosts." Anyone who has played MsPacman fully understands that while there is __some__ random behavior, the ghosts are most definitely deterministic. The aggressive red guy (Blinky) is very very different from the passive yellow guy (Clyde). Knowing this is necessary to play the game in an intelligent manner, if you can imagine such a thing. You can always go to MameWorld, get the 6502 source code and see for yourself!
How about a nice game of Ms. Pac-Man?
Shall we play a game?
Love to, how about Global Thermonuclear War?
Wouldn't you prefer a nice game of Chess?
The summary was wrong, should read "AI programmed to play Pacman" I agree that AI is overhyped. Now we can debate the definition of "AI" for days but the fact is, this is simple programming. You tell the computer how to do something, and it does it (heh, i know it's not that simple, but the idea is that simple). AI is a fun topic. But ultimately the question of really defining Artificial intelligence is connected to how we define Human thought. In an abstract sense, humans are just programmable meat bags, controlled by what we sense from the environment and by 'hardwired' innate reactions. The bottom line is, computers will never do anything we don't tell them to do (implicitly or explicitly), and thus, AI will always be limited by human intelligence. ps...i know how funny part of that last line sounds 'computers will never do anything we don't tell them to' when taken in the context of a Blue Screen of Death or some such failure, but remember, a human (loose term) was responsible for the faulty program with the errors that cause the BSD, so my analogy still holds up
Thank you Dave Raggett
People have been using similar things for years to find the most optimal routes for speed runs. These scripts are known as "TASbots" and are used on all sorts of games, mostly 2D platformers.
If you're interested you can check out a bunch of videos made with the help of these tools here.
How long do you think it would take for the AI to figure out the random system of the ghosts and started anticipating all of their moves? That would be interesting.
next thing you know there is Money missing and your Daughter is knocked up.
Dont Judge The situation by the Misfortunate. Goga.
...i see one of these articles, i'm crossing fingers it's not my tax money going to waste here. I kinda get this feeling, that these kinds of scientific AI projects always end with "Neat script doing neat little thing".
Why do they always set that goal? I doubt they come any closer to making a real AI program by making hundres of small programs with individuel tasks.
Take a look at CS or UT bots from the gaming area...way more advanced than any of these small programs. Why do they then keep doing the same "research" over and over?
I rocked at this game back in the day.
Now I've been pwned by a largish calculator.
"Win treats sysadmins better than users. Mac treats users better than sysadmins. Linux treats everyone like sysadmins."
Let's pitch the AI against a chimp.
I'll take this opportunity to advertise the SDLMame interface at http://organicrobot.com/mame/ in case anyone wants to try to replicate this with Ms Pacman or any other MAME game they've got.
You have to bring your own visual parsing tools though (I recommend starting with OpenCV), since all you get is a bitmap, not the ghosts position, number of dots, state of ghosts, etc that these researchers had access to by using a different implementation of Ms Pacman.
(btw, having seen a few very smart people try getting a computer to play Pacman, the results obtained are very impressive. As per usual, 4/5ths of the objections/questions/disses posted here could be answered by reading the paper linked to at the bottom of the article. JAIR is open and free, you do not need to pay or subscribe to read it)
> However, the ghosts' routes are deterministic, enabling players to find patterns and predict future
> movements. In Ms. Pac-Man, on the other hand, the ghosts' routes are randomized, so that players can't
> figure out an optimal action sequence in advance.
How sure are they that this AI hasn't simply learned how the random number generator works, so it CAN predict the ghost's movement patterns? Unless the random number generator is reseeded at unpredictable and unmanipulable intervals, then it will be subject to adaptive learning techniques used to figure out the seed.
Besides Ms. Pac-Man, game like Tetris and Baldur's Gate assist these programs in mapping different behaviors onto their artificial test subjects
BALDUR'S GATE?!
I have a lot of opinions about Cyborgs and Architects
Does constantly running strange processes for no clear reason and rebooting explorer daily count as wasting time?
My first Journal Entry ever, in 8 years! http://slashdot.org/journal/365947/aphelion-scifi-fantasy-horror-poetry-webzine
Otherwise it could replicate me. However, I know this can't be the case. Anytime someone tells me they've successfully created a machine to replicate me, I know they're lying because I'm still me. If they'd replicated me, then I'd be the machine. But, blow the machine up, torture it cruelly, give it pleasure unimaginable, whatever. None of that affects me at all. Then, considering that any truly significant insight I ever have had requires self consciousness, I highly doubt any kind of machine can be truly intelligent.
And why is there so many of him?
the Department of Information Systems at Eotvos University in Hungary is working to adapt that thinking to more modern titles. Besides Ms. Pac-Man, game like Tetris and Baldur's Gate...
I really have to cut down on what I drink, I've woken up in the 80s again.
...what I really want to know, since the AI played Baldurs Gate, is of what alignment our new gameplaying artificially intelligent overlords are.
I read the title as AL taught how to play Ms Pac Man and my first thought was "damn, the day Slashdot reports on Al Gore playing old computer games is the day I stop visiting."
Happily Slashdot is fine - it's my brain that is malfunctioning.
They (google NoN-SeNS Pacman 1.6 with C sourcecode to get the original Courtillat pacman stuff) apparenmtly addressed an artificial MsPacman implementation. People should realize that Pacman is a particular implementation (pacman.zip in mame, the original Midway game) as is Ms Pacman (the mspacman rom in mame). IT DOES NO GOOD TO SOLVE A DERIVATIVE PACMAN OR MSPACMAN! We went through this in the original shannon 4x4 chess board which remained a curiosity until a real chess board with real chess moves (e.g. en passant capture) was used. Same with checkers. In this day and age there is no excuse to dumb down the game. It is my basically uninformed but strongly held opinion that the originals are the real thing. Solving a game that kindof looks like ms pacman should be discouraged. C'mon guys!
Whilst this is indeed a clear case of weak AI, it's not quite as simple as the weak AI vs. strong AI thing. Weak AI in itself can be broken down into different levels, the AI mentioned in this article seems to be just a run of the mill application of symbolic AI, and whilst symbolic AI.
Because such programs like this are the ones that for some reason make the headlines they're also the ones that make people think "well, AI is a bit of a let down then really isn't it" but weak AI goes further than just symbolic AI, many accept that symbolic AI has a much less promising future right now and all the important research that goes into AI that might actually seem more intelligent is in the field of biologically inspired AI which is still right now only providing us with weak AI, but it's weak AI that is often so much more impressive than old fashioned rehashes of various symbolic AI implementations as per this article.
I'm not suggesting that the basis of your comment was wrong - you're certainly correct that this type of AI really isn't that impressive and as such it's hard to call it intelligent, however I do feel you were wrong to dismiss current AI as a whole with your comment that it's the only type of AI we have, because this specific type of AI (symbolic AI) really isn't the only type we have. Biologically inspired computing has been pushing symbolic AI out the spotlight for over a decade now and absolutely demolishing it in terms of the impressive kind of demonstrations it's bringing forth.
Of course, that's not to say symbolic AI is worthless either, it's certainly has it's place for things like this, chess and for expert systems and so forth. The biggest problem is that when AI becomes commonplace and people implement it left right and centre they find it easy to overlook the intelligent part of it and see it as "just another bit of code to implement". This is essentially the case with the poster you were replying to - we find it easier to call something intelligent if we don't understand it ourselves, but when we understand it ourselves we don't see it as intelligent.
I always wondered where "bite my shiny metal ***" came from...
look up automouse sometime. Tons of people use tools like it to play mmorpg games and gain loads of skills as they sleep.
One thing to note: The only ghosts that are random in Ms. Pac-Man are the Red (Blinky) and Pink (Pinky) ghosts. And they are random for only the first few seconds of each level. So... while that would elminate the ability to use Pac-Man-like patterns, you would be able to determine the best way to go in situations after the first few seconds based on what is known of each ghost's tracking strategy - as they would then be just as predictable as the original Pac-Man.
The article continues:
"Researchers report the first thing the AI did was go download a bot to play the game the right way."
(-1: Post disagrees with my already-settled worldview) is not a valid mod option.