When Robots Play Games
Roland Piquepaille writes "If the theory of evolution has worked well for us -- even if this is arguable these days -- why not apply it to mobile robots?, asks Technology Research News. Several U.S. researchers just did that and trained neural networks to play the Capture the flag game. Once the neural networks were good enough at the game, they transferred them to the robots' onboard computers. These teams of mobile robots, named EvBots (for Evolution Robots), were then also able to play the game successfully. This method could be used to build environment-aware autonomous robots able to clear a minefield or find heat sources in a collapsed building within 3 to 6 years. But the researchers want to build controllers for robots that adapt to completely unknown environments. And this will not happen before 10 or maybe 50 years. You'll find more details and references in this overview, including a picture of EvBots trying to find their way during a game." Read on for a similar robot competition held this weekend in France.
saunabad writes "The annual Eurobot autonomous robot contest for amateurs is held this weekend on La Férte-Bernard, France. This year's theme is 'coconut rugby,' and the robots are collecting small stress balls from the field and carrying them to the opponent's end, or shooting them in the rugby goal, while avoiding the randomly placed obstacles at the same time. Each team has a one main robot and an optional small assisting robot."
If that's a sop to the creationists, I expected better from Slashdot...
Aimbots have been around in CS for years. Is this really news?
http://www.aaplblog.com/ - News about Apple Inc.
I, for one, accept our flag capturing overlords
we could see some of this in the next "Austin Powers" movie and they can involve the FemBots?
I know it's still a long way off from a Matrix-esque scenario (or better yet, Skynet), but this has me a little jumpy. Not because we are doing amazing things with AI these days, but because we keep advancing it in a totally carefree manner. Perhaps it is time to start applying a little caution in our ever forward moving technology push? I for one would feel stupid if all that 'ridiculous' sci-fi stuff ending up happening.
You know all they're going to do is run into each other and explode.
find heat sources in a collapsed building within 3 to 6 years.
Yeah, I think the body will be cold by then...
You can't take the sky from me...
Real Dolls and QRIO for me to have any vested interest :-)
Kinda like AI.. only replace Jude Law and give me Rebecca
*sigh*... how great the world would be.
until they master jumping around while strafing and shooting..
I am not impressed until I see one jump+crouch and scream 'I pwn j00!'
--- We need more Ron Paul!
If the theory of evolution has worked well for us -- even if this is arguable these days
Do I detect the scent of an evolution denier? And it is interesting that you implicitly question the validity of a theory even as you cite an example of its successful application.
Nope, when they master capture the flag, how soon before these Evil Robots are ready to take over the world...
Enig? Det alt for hot det smor!
Wikipedia mentioned Quake and UT. Bzflag is also a great CTF game, and a classic.
Robots are cool and all, but why bother building and programming robots to find mines when we already have biological robots that can do the same thing while running off of water and a little bit of food. It seems a bit like a wonderful solution to a problem that doesn't exist - evolution has been doing pretty darn well at doing this sort of thing so far, so I'm not really sure why would need robots after all this time.
"I would give my right hand to be ambidextrous."
It would be cool if we could evolve robots so they can make an accurate choices based on facts, like a human being would, without being biased.
Some examples of the tasks a robot could do are judge criminal cases, mark exam papers, and moderate slashdot posts.
However although the robot will probably make the right choice more times than a human we still wouldn't trust these important decisions to them.
...no one asks it to play global thermonuclear war.
I vote we drop capture the flag, and just start up the tic tac toe game right now.
"Infants flesh will be in season throughout the year." -Swift
"After several hundred generations, the neural networks had evolved well enough to play the game competently and were transferred into real robots for testing in a real environment. "The trained neural networks were copied directly onto the real robots' onboard computers," said Nelson. "
As someone who spent a considerable amount of my childhood less interested in 'organized' sports and instead playing this game, it seems the whole point of playing Capture the Flag was to develop strategies in how to win. We had a set of rules that evolved over the years, depending on how many kids were playing, what time sunset (or the first person called back to their house would be), etc. We even had evolving words that were based on nonsense - or the inability of one of the younger kids to say a word (for instance - in some "Steal the Flag" games - the term "electricity" is used to talk about a strategy that involved making a line of kids that attacked from one end - they all held hands in the stragegy so that if anyone was captured they would automatically be "freed" by the "electricity" back to their own side. We deemed this a violation of the intent of the game, so we had a *no electricity* rule some little kids couldn't pronounce right - so it became "no a-la-ca-triss" - or something like that).
The game wasn't about *object avoidance*, it was about kicking ass through completely ad hoc strategies that had to be original because the teams always traded players rapidly, so you didn't want to make a rule or come up with something that would come back to bite you.
In this way - the random nature of our game was more like evolution than the winning was (it shuffled the components and allowed for *mutations*). The fact that the model showed no improvements with greater numbers of computers is not in line with what actually happens. The best games were the huge ones.
This simulation was probably a lot of fun to watch once the program was transferred to the robots though...
why do the French have to make everything, including robots, seem lame? I can remember a time, like 5 minutes before I read the article, when I thought robots were badass. Now the whole favourable perception has been ruined.
It's not as though this approach hasn't been thought of before. The problem is the limitations of contemporary AI tools, combined with limitations on our hardware. Also, as tasks become more and more complex, it becomes much more difficult to "evolve" systems that behave exactly as you want them to. There are a number of stories of neural nets being trained to recognize some feature from a set of training inputs, and instead keying in on some completely different and irrelevant detail.
Given the difficult time the better equipped US forces are having "winning the peace" (since the "war" has been declared to be "won".) in Iraq, I'm sure that political pressure to not let any more US soldiers get killed will cause the military to look at using this same technique to create robots which will be able to replace the US foot soldier in as many scenarios as possible.
They already have a backpackable mobile remote "eyeballs" robot that can roam building interiors while sending back pictures and other sensory data to the soldiers outside. Its not far from there to have a semi-autonomous small caliber weapon carrying robot which has been combat trained the same way these capture the flag bots were.
After many generations, once the training is complete the "State of mind" of the most successfull 'bots can be duplicated and copied into as many "x-thousand" of the little buggers as you want.
There is, of course, the small detail of solving the IFF (Interogate, Friend or Foe?) issue.
And how would the robot know when an enemy wanted to surrender to it ?
(Just a leetle closer lil' fella - I won't hurt you, I just want to surr (CrunCH!)... oops. excuse me. Did I step on you? )
This isn't something very new. Researchers are doing this for some years now. What I wonder most is how long did every evolutionary cycle take? It would be quite nice that a robot could adopt himself to a new environment in let's say, 2 minutes.
Stefano
If they can evoluate, why not try to show them how to find the best solution on a given computer program?
I'd like to see how a robot could work on his own code too, to try to always be faster.
Given the fact these robots (programs after all) can evoluate/learn and re-use this evolution, they should be able to learn until their hardware limis them.
As I see it, its all about a really basic but really well done base code, who will start the comparison, memory and self-modification of the comparison code that will make it evoluate.
Thats a really interesting subject
The problem with robots which are evolved to handle a task, is that you have no idea of what the programming is like in their heads. You have a working robot, but you don't know how to program one yourself. All you can do is train it and analyze the "brain patterns" afterwards. These things are hard to decipher.
The robots-as-dogs method will probably win because it gets results quicker than the programmed-thought-by-human method. Could be dangerous though, because you don't know what makes it tick.
Asimov's three laws of robotics seem appropriate in this case.
- -- Truth addict for life.
I disagree that it will necessarily take even 10 years and it will certainly take less than 50. Pathfinding and object search algorithms are strong even today. With a combination of radar, sonar, lidar, and optical recognition, I think we should be able to create robots which traverse formerly-unknown terrain in ten years or less.
I'm not trying to trivialize the difficulty of the problem, all the stuff we take for granted as we navigate a room is really quite a lot to deal with and it is only through practice that we are so successful, but an awful lot of effort is going into these problems (I know "more than ever before" is cliche and obvious but nonetheless...) and it is a top priority for so many very smart people that I cannot see it taking even a decade for useful robots with these capabilities to be in use.
Of course, it depends on what you want them to do when they get there...
"You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
Friday's A Softer World strip was about this very topic!
Read the rest from their homepage.
And now I have the answer to that question. We need robots that can bowl through minefields! It's all clear to me now.
Because PETA don't get upset when robots explode.
Current Karma Status: Roadkill
The introduction makes it sound like training neural networks is evolution. Neural networks and genetic algorithms are two very different technologies, although they can be combined.
Table-ized A.I.
How 'bout ethics? I know it's kinda old-fashioned and all, but it strikes me as a bit unethical to use living creatures to do this kind of dangerous work. Using a machine would be a great alternative.
Also, as with computers, this things wouldn't be single-purpose. One would expect them to carry on similar tasks in other situations, maybe exploration of dangerous environments.
How much info or intel could one of those rats send back? How would you direct them to a place that was of particular interest to you?
+Raider of the lost BBS
You must be new here ...
> evolution has been doing pretty darn well at doing this sort of thing so far
Specifically, making rodents that sniff out TNT for treats.
Or to clear a warfield of targets or find heat sources in the night at the same warfield. Yeah I'm sure the investors pumping that investigation are very interested in finding heat sources in a collapsed building. That will surely produce a lot of revenue.
Not that I am against any kind of investigation because it could be used for war, but the effort made in hiding any kind of military applications from this kind of news is just disturbing.
- they picked the rats because they're too light to set off the mines and are single-minded enough that they work better/cheaper than sniffer-dogs.
- The article describes using cables/tethers to restrict the rats to a line of interest. Hopefully, you can extend this concept to multiple rats on parallel lines and see how that'd allow efficient mine-sweeps of areas of concern.
- The rats live 6 years and can be bred, travel lightly, etc. This is EXACTLY what the parent poster meant when they talked about evolutionarily handling a cool problem rather than expecting rapid results (cheaply) from robots.
- How little do you figure you can make your smart robot for? A few grand? And where will Afghani's (or third-world citizens anywhere, especially those recovering from the economic impact of the very wars that placed these mines) get that money, a steady source of repair parts, etc? Instructions on training, a pair of rats, and fifty yards of string/wire and a clicker could let any small village have their own demining capability. Somehow, I don't think robots are gonna be as versatile or cost-effective.
Seriously, the parent poster on this should have considered posting it as a story (unless it's old news). It sure seems to me to be a great blend of nerd-interest factor, news, and stuff that matters. Props to the parent poster and the involved researchers. Within my life, we'll likely have cheap devices with artificial noses or GPR or another solution. But abandoned mines are too wicked to wait that long.Even discounting these things, worrying about the ethical implications of hurting an animal by training it as a mine-sniffer ignores the huge ethical implications of going the other way: if nothing is done, people die or are maimed. We've had this argument: using animals to save human lives is not taken lightly, but it is ethically tenable.
I'm sure the religion of atheism has no problem with this, though. I just wish they try reading the Bible some day -- God has a plan for all of us, and it doesn't involve robots.
Have you heard of the tall poppy syndrome?
Interesting that I was reading this article while re-reading Vonnegut's "Player Piano." Probably one of the best books he wrote, in terms of style and clarity.
___
It's the end of my comment as I know it and I feel fine.
I think that applies to people belittling those who are above them in station.
The guy you replied to would have to hold the position of Assistant Rectum Scraper to be below you in the eyes of society.
"Evolution" is not a good basis for morality.
If evolution were the basis of someone's morality, then being able to rape a girl, get her pregnant, and have her raise your kid without supporting her would make you more 'successful' from an evolutionary standpoint. It's won't make you 'successful' though. It's a viciously evil, psychotic, disgusting thing to do.
The word "fittest" in 'survival of the fittest' does not mean 'strongest' or 'smartest' but 'the most successfully selfish'. An evolutionarily successful animal is one that has lots of grandkids. What is the point in designing a robot that is successfully selfish?
To put things another way, why shouldn't people place importance on themselves? It seems you're contradicting yourself here. If you do see evolution as the basis of your morality, then humans SHOULD see their own individual needs as the most important things on earth, and to hell with things like 'truth' or 'beauty.' Deviations from this selfishness would just be so that people could get along better and organize themselves more effectively. In short, unselfish acts would be done for selfish reasons. If we base our morality on our evolved desires (I don't), then if robots can't serve our selfish interests, we have no obligation to create them.
There's somthing to be said for a moral aesthetic based on how well a tool or person does its job, but you're still left with my favorite Kurt Vonnegut question; "what are people for?
___
It's the end of my comment as I know it and I feel fine.
LA? 911? International presence, however late, in Iran - not that long ago a big load of mud huts got wasted?
Oh poor foobie, didn't you get your anti-Bush cereals this morning? Not everything is about war, but of course technology can be adapted.
"So unmerciful is life, that everything afterwards is too late."
Would you mind explaining what Roland did to you?
Besides, his article are posted regularly on Slashdot, because they happen to be interesting. Where are yours? Where are his parent poster's? You guys are underachievers compared to him...
I don't think people object to whether his articles are interesting or not; I think it's using Slashdot as a platform for the self-promotion of his blog that rubs some people the wrong way.
If we ever created warring autonomous sentient robots, we wouldn't accept surrender as an option anyway. We barely do as it is.
[SQL Error ID 10-T: This sig. is above your current threshold.]
Note that the Capture-the-flag contest is _not_ part of the French 'competition'.
(The flag probably wasn't white.)
rib-bit. rib-bit. croak.
Vichy.
Gesundheit!
I for one welcome our new capture the flag playing robotic overlords...
I have no problem with robots playing games, provided:
I think playing with robots might be a great test for us humans and the intelligence thereof. Personally I believe that playing first person shooters is a task so complex and intellectually challenging (much more so than chess or even go, where you only have few objects, simple rules, and a finite number of states) that no robot in our lifetime will be able to play them, maybe even no robot ever. Only time and patience will show us. This is certainly a very important step in robotics and artificial intelligence evolution. Great read.
Sincerely,
Pan Tarhei Hosé, PhD.
"Homo sum et cogito ergo odi profanum vulgus et libido."
% mkdir
% ls -dF
There is a basic fallacy in this sort of research - that evolution will necesarily develop some kind of intelligence to solve problems. Evolution will do "what it takes" to solve a problem - and no more. If you attempt to use evolutionary techniques to, for example, solve mazes, you will end up with a system very good for solving mazes - and nothing else.
This happened in computing in the 70s. Intel found it convenient to solve the problem of calculator design by buoilding the 4040 - the first microprocessor, But this was in no way *necessary* - Intel could have continued down the old line of discrete logic.
Evolution is a powerful tool - but not a panacea
Consciousness is an illusion caused by an excess of self consciousness.
I say use lawyers.
now accoirding to http://www.bls.gov/cps/cpsaat11.pdf there are 952000 lawyers which is almost enough to take care of all the landmines, and if it isn't they keep making more
also lawyers are less lovable than rats, So the trainers will be less attached.
I used to have a cool sig, back when I cared
That isn't the scent of an evolution denier. That is the scent of someone making a goofy little crack about how stupid people are nowadays, despite the effects of billions of years of evolution. There is credible evidence that we really are getting dumber.
Honey, I shrunk the Cygwin
Find Sarah Connor.
the "problems with evolutionary theory" consist of debates as to the details of how evolution works. However, few in the scientific community have any serious doubts that life evolves over time, or that the species we see on earth today evolved from other species, all the way back to single-celled organisms in the distant past. Those who do doubt these facts are about on par with those who think the philogiston theory of combustion has merit.
wants to be the first monkey to touch the monolith
"find heat sources in a collapsed building within 3 to 6 years"
You would think after three years, those heat sources would give up and die already...
Heh heh.
Sorry.
Those who sacrifice security to condemn liberty deserve to repeat history or something. - Benjamin Santayana
google for nelson2004-ras2.pdf, it's the actual report. Don't comment on this stuff until you've read it becuase you don't know what you are talking about. Reading everyones comments it's like you're all talking about something COMPLETELY different to what's in the paper.
Basically all that happened was some "dumb" heuristic (a mish-mash of old technology) was applied in order for these robots to learn nothing more that trajectories in space. THEY DO NOT PLAY CTF!!! However, with a lot of wishful thinking it looks like they do.
Read the paper - please. There are much more "intelligent" robots out there.
Interesting that they use the rodents because they are too light set off the mines. What happens when the rodent walks over a mine without noticing it and the handler walks through?
Free bananas?
Sure, wouldn't be cheaper to just train ppl of countrys with minefields to clean them? Oh, wait that would be dangerous for when you want to deploy mines there. And of course dogs trained to smell ppl are working NOW, not at 10-20 years scope, so no point in showing ppl how to train dogs, that would be very expensive.
As I said, I'm not against any kind of development but I'm annoyed by short-minded ppl like you that like to gulp anything they throw you at.
Technology adapted? Yeah, just like when they adapted radiation therapy to make nuclear bombs.
Oh wait, no the bombs were developed before, and the motto was "the bomb which would end all wars", seems they have to adapt the mottos to the new short-mindeds like you.
If you can't see this is the "Hey ppl, be glad we invest money here, so we can save lifes" while the main goal is another one you are more stupid than blind.
I think whilst this is a very clever achievement, any claims that these things are anywhere near being useful or adaptable in a real sense are totally unjustified. We are very good at finding solutions to carefully crafted problems or "toy situations", such as for example capture the flag, which has finite bounds, and well-defined rules. Thats a very different thing to trying to generalise a robot to be adaptable to different and unforeseen situations (e.g. making a human). The challenge that lies there is probably going to take at lot longer than 50 years. Then comes all those dangerous questions such as "why?" and.. "what will be left for us?"
Well, you didn't get modded up, but I got a kick out of your comment. Beats the rehash of that tired old 'lawyers vs. labrats' piece (which googles up 6800 hits) above, and I liked you stopping short of saying the whole beowulf cliche.
Thumbs up.