IEEE Spectrum Surveys Current Games' AI Technology
orac2 writes " IEEE Spectrum has an article on the AI technologies used in the current crop of video games. State machines, learning algorithms, cheating, smart terrain, etc are discussed. Game developers interviewed include Richard Evans, of Black and White fame, who talks about Lionhead's upcoming Dmitri project and Soren Johnson who created Civ III's AI."
And I still have trouble beating some games that are a decade old.
The page located at http://www.cs.berkeley.edu/~russell/ai.html#search contains wonderful links about coding A.I. into your games, programs, etc.
If you celebrate Xmas, befriend me (538
I always win.
**unplugs computer**
Yes, let's stop working on AI, so that when we have the hardware to do it we won't know how.
Bright idea.
Besides, what is a human being besides a complex system of input and output anyway?
I've moved on.
Troll? Moderators shouldn't moderate on Saturday nights, as they are apparently drunks.
Add me as your friend!
After that lame-ass comment? Heck, no.
Real stupidity beats artificial intelligence any day!
X(7): A program for managing terminal windows. See also screen(1).
If you're referring to simulating human thought, computers will *never* be that advanced. At least not if we continue down the path we've been on, and engineering techniques make that unlikely. Artificial sentience (Sci-fi AI) is a design problem, not a speed problem. I think it's possible, but not on your PC.
"Times have not become more violent. They have just become more televised."
-Marilyn Manson
Lick my left nut
I have a 56k modem, and no chance of getting broadband, so while massive online fragfests might seem like fun, they're not really accessible to me (RTCW was bearable till PunkBuster slowed it to shit).
Unfortunately, the games industry seems to have focused on turning out hundreds of online fragfest games that bring in the $$ but leave little to the imagination. Even 'The Sims' are at it.
AI doesn't necessarily have to be 100% realistic for a rewarding offline game. But even the bots in UT2003 aren't that hot, so it's clear AI and single player games are taking a backseat to the online money spinners.
Hopefully some big breakthroughs in AI will turn the tide, but with the games industry already ignoring AI, I'm not optimistic for AI's future in games.. since everyone would rather play their dumb neighbor anyway.
mogorific carpentry experiments
link
You think it's hard to play with a dial up connection? Try sattilite sometime (*dodge*, *dodge*, *fire*... 3 seconds pass... "Wow, I missed... imagine that!").
I'd really like to see a decent AI for games like Baldur's Gate or Neverwinter Nights. The henchman have roughly the IQ of a very dumb dog. On more than one occasion, I've had a henchman walk directly into a fireball on the basis that an opponent was nearby. Mmm... toasty.
I'm a lawyer, but not yours. I wouldn't represent someone who thinks taking legal advice from Slashdot is a good idea.
Instead of trying to figure out everything, I think brute force processing tactics will have a lot of success in the future.
I just found an interesting web site which is dedicated to the topic of Artificial Intelligence (AI) in games. Check it out.
Not until a bot calls me a "c4mp1ng n00b" by its own volition has AI come far enough.
I'll form my OWN solar system! With blackjack! And hookers!
That is so true. I tried playing a multiplayer game at work a few years ago... and I was absolutely destroyed in seconds. I wanted to get better at the game, but there was no other beginners to play with, and the single-player mode sucked.
Sex - Find It
Namely, what happens if some researched finally stumbles across an application that passes the Turing test? One that for all intents and purposes appears to be a conscious life form?
The resulting ethical problems will be myriad:
- Will the AI life form be the property of the person or corporation that developed it?
- Will the AI life form be copyrightable?
- Will the creator of the AI life form be obligated to keep it "alive" (i.e. keep the power running, etc.) as long as possible?
- Will the AI life form have the same rights as an ordinary human being?
- Will distributing the souce code for the AI life form be regulated under anti-cloning statutes?
- Will the AI life form be allowed to earn money as a result of its efforts in controlling entities in videogames?
- Will the AI life form be entitled to royalties as a participant in the creator of the videogame?
As a libertarian I am torn between my concerns about keeping markets free and unregulated, and my concerns for the freedoms and rights of potential AI life forms. Interesting times...QUOTE: For a project code-named Dmitri, Evans is now focused on improving the ability of AI to interact socially. Agents' behavior will be controlled by their membership in overlapping social groups.
----
So how long until the AI gets good enough that we don't need it to be truly multiplayer and can all play on our local machines with AI characters that can chat with us about our real lives instead of just the game?
-
In Soviet Russia...Beowulf [note correct spelling] clusters YOU!
but I find that the AI in Hitman II is quite exceptional. I havn't seen AI this good since Turok2 Dinosaur hunter!
I have yet to find an FPS where I felt the bots had really believable AI.
In most FPS games, the bots simply have really good "aim" and really good "dodging ability" in the higher difficulty levels, coupled with the fact that the computer technically knows where you are all the time. Even so, a player will usually develop reflexes that will allow them to outgun the bots.
Players without the "reflexes" to beat the bots' super aim can still beat them, as the bots will repeatedly fall for the same tricks over and over.
To have realistic bots, they need to be able to learn from their mistakes. Bots fail to learn things such as the following:
1) The player's favorite weapons.
A common technique in games like Quake is to "control" the weapons. If you are playing against someone who is great with the rocket launcher, but not so hot with the other weapons, you can try to limit their access to that weapon. Bots don't pick up that you use the RL all the time, and thus don't really do a great job of stopping you from getting it.
2) The player's techniques.
Obviously, if a player likes to re-use certain techniques (circle strafing, etc.) too much, other players will pick up on it. Bots, however, don't really anticipate what the player might do in this fashion.
3) Mistakes.
At the same time, the bots will often reuse the same techniques as well. However, the human player will pick up on it. Bots need to learn what tactics it has used that have failed, and try something else.
"You spoony bard!" -Tellah
I have been playing Morrowind for quite a while and the AI of the characters is simply breathtaking. I must admit it has been the only game that had me talking to people "And suddenly this big whale like creature jumps out at me so I run as fast as I can to a house and hide inside" ... "So I goes outside and the coast looks clear.. the monster is only hiding *behind* the house peaking out and then charges for me"
;)
Morrowind, if you have not played it, you must. But make sure you have a fast processor 1ghz+
Given that this is the IEEE, it was somewhat disappointing to read the following.
Fortunately, most graphics processing had by then moved onto dedicated graphics cards, and CPU resources and memory--already increasing dramatically, thanks to Moore's law--were being freed up for computationally intensive and hitherto impractical tasks, such as better AI.
They make Moore's Law sound as if it is something more than just an observation.
To me it seemed as though the article didnt really have much to say. Or rather, I didnt get much out of the article besides reading about all of the stuff I already know; that AI exists and that it is advancing. I wish it would have been something more in depth about the future of AI and computers taking over the world!
What, there's something beside A*?
Supposedly both D3 and Q4 will be shifting the focus back to single-player (great news for narrowband nerds like myself). But then again neither will mark a vast improvement in AI.
:(
id's focus is on graphics and physics (game engines) not providing strong heuristic bots (resource intensive entities)
"The number of Unix installations has grown to ten, with more expected." (Unix Programmer's Manual, 2nd ed.; june 1972)
was it tomi? I hate that bastard. he deserves to fry...
Looking for Book Reviews? Check out Literary Escapism.
"people want a good single-player experience to practice before they go on-line because they feel stupid when they get their butt kicked by a 12-year-old in Ohio," laughs Michael Zarozinski.
If you're referring to simulating human thought, computers will *never* be that advanced
People like you really piss me off. You've been alive less than 30 years. The universe has been around for aprox 10-15 BILLION years. Your puny mind has no idea of the time involved with NEVER. Who mods this shit up??
Read the headline too quickly again. I thought someone had found a way to get AI out of a ZX Spectrum. It's coffee time.
> If you're referring to simulating human thought, computers will *never* be that advanced.
Says who (besides you?). Can you back that up buddy? I think a hell of a lot of AI researchers will have a bone with what you said. And I don't just mean Kurzweil (http://www.kurzweilai.net/), though that's a good start.
> At least not if we continue down the path we've been on, and engineering techniques make that unlikely.
Once again, a vague statement thrown out of nowhere. Care to elaborate? Sounds to me like you're just gushing out your personal bias.
> Artificial sentience (Sci-fi AI) is a design problem, not a speed problem.
With enough speed the brain can be simulated (even though that's not really the goal of AI), because i)the brain is a physical device, ii)physics is computational, and therefore a computer can simulate it. If you simulate the brain fully, then sentience is there (and don't give me crap like the zombie arguments and other nonsense of David Chalmers et al)
> I think it's possible, but not on your PC.
He didn't claim there would be sentient AI on his PC.
PS: the original post didn't make all that much sense either, like where did he get that exact number (2025).
"Politicians and diapers must be changed often, and for the same reason."
1) The player's favorite weapons.
A common technique in games like Quake is to "control" the weapons. If you are playing against someone who is great with the rocket launcher, but not so hot with the other weapons, you can try to limit their access to that weapon. Bots don't pick up that you use the RL all the time, and thus don't really do a great job of stopping you from getting it.
In my experience human players are no different in Q3A, UT2k3 or BF1492 in those 32+player servers. I mean there are so many players like "3l33t-b0rg" or "lick my pu$$y"(no joke), that the focus is more on "I killed 'BFGFucker9000'!" than strategy that requires both team-work and (gasp) thinking.
Now if you're talking about clan games or one-on-one matches, then yes, humans move to a higher level of strategic thinking to block resources that give opponents advantages.
For an AI subsystem to perform this type of thinking requires lots of dynamic("oh shit he has a rocket launcher...time to sniper") and static analysis("grab rocket launcher so he doesn't kick my ass and own me").
Lack of good AI is perfect for the Doom zombies I think. And when you're confronted with a horde of mindless zombies, the fact remains that there's a horde of 'em, no matter how mindless they are. That's what made the original Doom such a chillingly great game.
N4st0r, trixx0r h0bb1tz0rz! Th3y st0l3 0ur pr3c10uzz!
way OT: but, if you really want to play MOVE. If it matters to you, do something about it, if not, stop whining. Shit, stop complaining about something you can change. I moved to get good cable, and it's surely not just about games. The whole net works kinda well. Try it. I still smile (like the feeling of having a child) at the speed/always on for the same price as modem+line.
Half-life had to be the best AI I have everplayed, so far still my favorite game and probably best AI i have used, besides maybe some RTS
After observing a large number of games, the major problem with game AIs is that the developer puts very little effort into the AI itself. While there are a few good/excellent AI systems out there, these are the exception and not the rule.
Naturally, the AI has the shortest time frame in the software engineering, but there is no reason it should remain stagnent across the future patches. From these patches, the developers can identify the shortfalls of the old AI, and correct them. This is very rarly done, and is only performed across versions.
It's also very difficult to find a game with a decent or challenging AI, since mose formal reviews ignore that portion of the review entirly. Most people will look for the 9/10 IGN Review award as opposed to the real deal in the message boards (the AI in the game is a cheating piece of c***).
places limitations on algebraic systems. One of the things that it does *not* do is place limits on understanding because it imposes no limits on * the number of algebraic systems* you can devise.
If a theorem cannot be expressed in one system you simply make another where it can.
One of the fascinating things about the human mind is its ability to go *beyond* single logical structures and fully understand an infinite number of incompatible algebras.
The problem with developing AI isn't so much that we don't understand the human mind, it's that we *do* understand it to be something well beyond a simple algebraic computer, which at the moment is all computers are. They are *computational* devices with a preprogramed logic. *That* logic is subject to Godel.
Your computer is a giant abacus. Nothing more, nothing less. This says nothing about the possibilities of developing machines that are *not* simply a bank of bistable switches.
Nor is there any axiom which states that intelligence must be *human* in form.
That last point is outrageously important to all sorts of fields.
KFG
President Bush recently signed Congress' "Moore's Law." It mandates that processor speed will continue to double every 18 months under penalty of law. AMD and Intel better not crack under the pressure!
Not long before Lara Croft rejects me like a real woman would.
Table-ized A.I.
"The hardest thing in game AI is just making sure that the game never looks dumb. You'd be better off having an AI that was just above average all the time, rather than one that was brilliant 98 percent of the time and stupid 2 percent of the time..."
Why not? Don't they want to model a typical geek, or did they find that hurts sales?
Table-ized A.I.
Here is one of the sites we used for new ideas in my CS class at cmu
http://www.seanet.com/~brucemo/topics/topics.htm
Here is another one
Enjoy
"1) The player's favorite weapons....
2) The player's techniques....
3) Mistakes...."
In most games these are problems, however, while it's not a FPS, the AI's in Oni are fairly good.
The AI's will learn what wepons(attackes) you use and will learn to counter. Furthor more the AI's modify their attacks based on how well you defend yourself.
The AI's couldn't be confused as humon players(even if the game had a multiplayer), however they are skilled and adaptive enugh to be chalanging and can't be beten with any one stratagy
Don't save your orgasms for Heaven; Heaven knows we need them here.
The major problem in AI is the Attention Problem - what features should be paid attention to in order to make a decision and how to ignore the huge ammount of irrelevant information (without explicitly examining that information to determine that it is irrelevant).
Game engines often present a very small "world view" (in terms of feature space) to AI agents because for every simulation cycle each agent has to check facts in its world view to guide its action, and the more complicated the world view the more CPU cycles are used by each agent.
For example, an agent might be exposed to the same fact in 3 ways: The first uses a hard-coded definition of what near means (that can be precomputed by the engine), the second allows the agent to use its own definition of nearness, while the third allows the agent to decide what distance means (if it has access to map information).
While the 3rd definition is the most flexible, it is also the most computationally expensive particularly when this computation may be run every simulation cycle.
So, what I was trying to say is that much of the flexiblity possible to an AI agent is limited by the feature space it has access to, and this feature space is usually very limited for efficiency purposes.
To improve the behavior of an AI agent, script tweaking may help some, but what is often needed is for the underlying physical engine to expose slightly more information. For example, the above "near" might be split into "sortof-near" and "really-near".
How are they supposed to learn if you keep killing them?
Give the bots a chance.
Keep your packets off my GNU/Girlfriend!
AI is a euphemism for "behavior." When I hear people complaining about how games aren't using the latest in AI research, I want to respond "that's because games don't really use AI" at least not what people think of as AI. AI in a typical game is just a list of weighted rules, such as "if the player has a more powerful weapon than character X, make character X run away." When you have lots of such rules and you twiddle with them a lot, then you get so-called AI.
Putting in random factors makes things much harder to pin down. Maybe when a character spots you, there will be a 50% "run or attack" decision. If the decision to run, then you think "Ha, ha, ha, he's running scared!" If the decision is to attack, and he gets you, then you think "Wow, that guy was good." If he attacks and you get him, then you feel like you're doing well.
To a great extent AI is psychological. You read into things what you want.
This is a good overview, but Gamasutra tends to have the meaty tech.
Who knew pathfinding was such a drag?
Keep your packets off my GNU/Girlfriend!
Err... I should have mentioned that I was talking about GOOD players, not average players who think that the fact their parents bought them a GeForce 4 Ti 4600 for their birthday makes them God's gift to FPS games.
"You spoony bard!" -Tellah
a) any computer civilization gets a technology advance
1) all AI civs suddenly have that technology by the end of the turn
b) a human civilization is in the lead
1) all AI civs suddenly declare war on the human civ
c) a human city builds a tank
1) tank is destroyed by AI's archer
d) human player wants basic features that were in civilization 1 v1.0
1) charge human $30 for an "expansion pack"
2) ???
2) profit!
Some time after getting Unreal Tournament 2003, I set out to appraise its AI. I decided to set up a game in which it couldn't cheat; I made a one-on-one game, on the map DM-Gael (a small, open map, so while the bot may always know the player's location, also vise versa), and with rocket launchers only (so that the bot couldn't do some simple trig to always hit). I set the bot to its highest difficulty, and played.
The bot had some notable weaknesses (it kept getting killed going for the powerup in the center, or while coming up a lift, and never seemed to learn from these mistakes), but did fairly well overall. In the end I won with a substantial, but not overwhelming, margin.
So, I said, the AI had failed the test: given a fair match, on its most difficult settings, it lost. But then I realized, I had a lot of fun administering it. Then I realized that the point of an AI isn't to beat the player, but to be fun to play against; whether it wins or loses really doesn't matter.
Current Games' AI Surveys IEEE Spectrum!
in its infancy. It's scope is restricted. It can never be a "jack of all trades". AI, to a large level, still seems to be hardcoded. But soon, I guess you have an AI module, to which a physical model is assigned, and then it is "trained". That module could be taught how to drive a car, or how to duck and shoot, or BOTH.
Anyways, coming to the topic of AI and entertainment, if u have visited the LOTR - TTT site, you'll see an interactive MASSIVE system. Imagine making a few entities interact, waiting for the sequence to render and then view the final movie that has been created....
|/________
|\A|ALYS|
Did you read my post? I said that simulating sentience, i.e. human thought, will never work because of the way modern computers are designed. I also sais I think such a simulation is possible but it requires a new hardware paradigm that current computers do not use.
Computers are, regardless of how many pipelines you put into the chip, essentially sequential. The brain, however, is massively parallel. It would take a fundamental shift in the way computers are made to allow us to even come close to modeling the way the brain functions.
"Times have not become more violent. They have just become more televised."
-Marilyn Manson
Says who (besides you?). Can you back that up buddy? I think a hell of a lot of AI researchers will have a bone with what you said. And I don't just mean Kurzweil (http://www.kurzweilai.net/), though that's a good start.
h is terms) below.
:)
Well, if you notice, I wasn't talking about AI, or that field of research. I was talking about artificial *sentience*, or what I called "Sci-fi AI". That's what the original poster (who has been modded into oblivion) seemed to imply would be available in 20 years.
As for "says who", I don't know, I haven't got any papers to quote offhand. Nor do I know if anyone has even taken such a position. It's simply one that has slowly been occuring to me over the last few years as I learned more and more about computer architecture and organization in the course of my studies. I'll discuss the whys (in hand-waving-I-haven't-done-a-doctoral-thesis-on-t
With enough speed the brain can be simulated..., because i)the brain is a physical device, ii)physics is computational, and therefore a computer can simulate it.
Ah, see that's part of my point; it's a physical/physics limitation. Computers are essentially sequential devices; read instruction, execute instruction, repeat. Brains work in parallel. And, although we can simulate parellism with computers by dividing the time programs have access the CPU into very small chunks, there is a limit to the amount of parellelism that can be achieved by doing this, and that limit (again waving hands here, I haven't worked out the math other than intuitively) doesn't come close to the amount of parallelism that even a child's brain is capable of. Putting more speed into the computer can raise that parallelism limit, but eventually you get down to limitations on the physical level, which (again, no math worked out here) still doesn't come close.
(even though that's not really the goal of AI)
Very true, which is why I'm extremely careful to diferentiate what I'm calling artificial sentience from AI. AI, to most people who research it, is thinking or acting rationally (i.e. getting or estimating the right answers). AI to most everyone else is HAL 9000. There is a very big difference between the two.
If you simulate the brain fully, then sentience is there (and don't give me crap like the zombie arguments and other nonsense of David Chalmers et al)
I agree to that. No zombie arguments from me.
I'm just suggesting that we won't be able to simulate the brain fully on computers. We need something different. And it's a hardware issue, not a software one. Essentially, we need to construct an artificial brain, not build a Java-based buddy.
Wow... all that and I haven't even started on the problems involved in memory I/O!
"Times have not become more violent. They have just become more televised."
-Marilyn Manson
A transport ship had sneaked past my naval blockade and was unloading a division of tanks onto the shore beside my own capital.
If you left your resource center unprotected, you are dumb. No AI can fix this.
Buy a Nintendo DS Lite
I've just been reading Steve Rabin's book, AI Game Programming Wisdom, mentioned briefly in the article. I'm not a game programmer, but I am a programmer, and I've always been curious about game AIs. And I have to say that the book is very good, well worth it if you have any interest in the topic. It's actually a collection of articles written by a bunch of game AI programmers, collected and edited by Rabin. It covers a lot of ground, explains approaches that have worked and approaches that have failed, and why (in both cases). It contains both useful general principles and interesting examples of specific cases.
I'm not sure I'd recommend this book to a novice programmer, but for a moderately experienced programmer who's interested in practical game AI design, this book is well worth a look. The name says it all, this is a book written by the folks in the trenches, passing along their hard-earned wisdom. Very enjoyable.
Now I want to try my own hand at writing some game AI. Maybe I should poke around on sourceforge for games that need AI help. (Assuming I can weed my way past all the projects that have NO CODE AT ALL, which seems to be especially common with the games on sourceforge.)
Back when reaper bots came out for the original quake me and my neighbor were trading off in a game of capture the flag (best game idea ever BTW). I was pretty decent by the standards of the day, and so was he, so there was a little audiance going. I go throw down home invasion style on the Blue base, and get a rather terse message advising me that cheating with bots isn't cool. On the one hand, I'm not a bot, and that was kinda gay. But on the other, I thought it was a nice compliment in a too good to be human sort of way.
The thing is that you CAN find higher levels of human combat. The first online game I ever played was Team Fortress (Quake 1 mod) and ya, on the public servers it was generally what you described. You'd get a couple smart peopel (maybe) and everyone else would just kinda run around with no strategy. However I managed to get into a good clan and THAT was where the fun began. We, and the people we played, were highly skilled and cooridnated. Teams were quick to adapt to new situations, exploit weaknesses and so on.
If you are really in to a game, there are groups and legues of players like you that can challenge you.
Pearl harbour was the best thing that ever happened.... too bad more yankee pigs didn't die!!!!
By the looks of it, we still have some way to go until AI in games reaches the 'good enough' stage.
Good enough for what? For us to stop speaking and caring about it I guess.
When that happens, we'll have 'Invisible AI'* that just works, and game producers can no longer use it as a selling point.
Of course, I guess that won't happen anytime soon, and I can already see hardware manufacturers making AI-accelerator cards, with built-in multi-processors and neural net chips, to fit next to your graphics card. The 'Intel Inside' logo will gain a whole new meaning...
* - Yes, I'm adapting Don Norman's Invisible Computer term.
When exactly did Finite State Machines become AI ? this is a 50's model in computability theory that started in the Turing days.
The average CPU in a PC is millions of times faster than highest estimates of a neuron's computing speed. If a brain is composed of n neurons, and a CPU is n times faster than it, one can simulate the brain in realtime as if it the underlying computation is parallel. Mind you, according to some researchers, we already have the capability.
Wow, an actual use of "Beowulf cluster" in a post that isn't a stupid joke!
:-)
I'm impressed...
I'm not sure you'd get a lot of improvement from the technique though - bots would tend to play well with bots this way, unless you somehow managed to get a fitness function that reflected playing with humans. You could also invite a lot of human beta testers and evolve them based on survival rates.
Some algorithm that noticed patterns in actual gameplay would probably induce cooler behaviour - something in the lines of:
- Noticing any hots spots for damage taken in a certain map and trying to find alternate routes (thus avoiding points where the bot is sniped), or increasing speed and strafing while crossing these areas.
- Remembering spots where a player was sniping from frequently and trying to compute a route that allowed the bot to shoot without crossing the player's potential POV.
These are both things real players do, and it'd help them avoid falling in the same traps every time.
It is not that hard to give the impression of an AI that doesn't have shortcomings you mention but will you be able to beat it?
Gentlemen, you can't fight in here, this is the War Room!
However I managed to get into a good clan and THAT was where the fun began. We, and the people we played, were highly skilled and cooridnated. Teams were quick to adapt to new situations, exploit weaknesses and so on. This is offtopic, but I also joined an awesome clan for Tribes2, and I tell you -- it sucks all of your time as you get higher into the ladder. If you're married(and want to stay that way) forget about joining a clan...
I quit playing FPSes competitively because they take too much time. However, my freshman year it was fun :)
...Then we've got a long way to go. Check out the article
Thus spake the master programmer:
"Let the programmers be many and the managers few -- then all will
be productive."
-- Geoffrey James, "The Tao of Programming"
- this post brought to you by the Automated Last Post Generator...