Inside DARPA's Robot Race
Belfegor writes "The PBS series Nova has a great feature on their website, regarding the coverage of the DARPA-sponsored 'Robot Race' in which driverless vehicles 'competed' in a 130-mile race across the Mojave Desert. The full show is available on the website, and besides that they have plenty more information about the robotics behind the challenge, and also some pretty cool out-takes from the show."
I remember an old nova special about self-navigating robots, and at first it took about a day to cross a room.
But mostly these robots depend on the assumption that everything remains still.
I don't get it.
PBS broadcast that show last night. While I realise that is is a little 2001 to actually watch a program when it is braodcast, I did. And I really enjoyed it. I am hardly current on the status of autonomous robotics and I was pleasantly surprised by how far along the technology is. 130 miles through the dessert using only GPS and local sensors is a pretty amazing feat, and that course was tough. It features mountain switchbacks, tunnels and other hazards. If you even have a passing interest in robotics I recommend watching the show.
Unlike Carnegie's "H1ghlander" and "Sandstorm", Stanford's "Stanley" VW Touareg had no fancy motion compensated sensors and the team didn't flesh out the race course with more GPS data and tell the vehicle how fast it could drive in certain areas. Stanley's software did all that on the fly.
Also, the SuperDAD Toyota pickup looked like it had a tenth of the tech of Stanley but it was doing almost as well. If only the laser sensor hadn't detached itself from the roof.
it is interesting just how involved the contestants are. This contest is their life. They mentioned several times in the show how many months of long workdays they spent to build and program these cars. And, then, who owns the work? Do they at least get patent recognition on some of the innovations? Some of the software they talked about was truly seriously cool stuff.
Sidenote: One hour of Nova or Frontline is like watching 5 days worth of "learning" and "discovery" shows elsewhere. It's amazing how good some of these shows are.
After watching Why We Fight, I'm not so keen on something like this anymore.
A feeling of having made the same mistake before: Deja Foobar
As an alumnus of Carnegie Mellon, it was great to see the coverage. I did not realize that a lot of the Stanford team came from CMU; certainly says a lot about our robotics dept. Red is certainly a powerhouse there, and congrats that the two vehicles came in second and third.
I'm such a Nova junkie, and this was an excellent episode.
--- witty signature
I will say, I was impressed, and surprised that I did not see an article on it at
I will say, that aside from "Stanley" winning the race on completion and time, I also believe that Stanley was the best technology. The H1lander and friend were micromanaged, and there were two vehicles that had different strategies (the tortoise and the hair) and it took almost the whole 2 hours of a team of people to map out the course and program the robots. They then added the fudge factor for human error with the fast and slow strategies.
Stanley was programmed in minutes of receiving the map, and it calculated its speed dynamically on its own. Stanley had "adaptive vision" which overlaid laser, video, and other sensory data to create a dynamic field of view of what was safe to drive through.
Now, what shocked me, was that so many teams finished this year. Nobody got past 7 or 9 miles last year, and many vehicles passed the entire 132 mile trip this year. Watching the vehicles drive was impressive. Most of the time, they appeared to be manned.
The course was not easy, by any stretch of the imagination. With the success of Stanley, I believe that this will increase the adaptive and learning capabilities in current software controlled systems. Currently, software is brute forced into trying to accommodate all possible logical conditions, which is impossible, and often just wrong.
The interesting thing for me is that the method we use (our eyes) was too difficult for machines. That's why all those robots used lasers, and other techniques. We've come far, but we still have a long way to go.
'Coverage' and 'Darpa' in the same paragraph.
Another interesting point is that it seems to me that this is the development arena for the military's new autonomously roving gun platform.
Moderation in All Things... Especially Moderation - gurutc
http://www.mininova.org/tor/266446
I would have entered a giant mechanical penis shaped robot car with "Kill all humans" written on the sides.
Too bad I've been so busy slacking this year.
"And, then, who owns the work? Do they at least get patent recognition on some of the innovations? Some of the software they talked about was truly seriously cool stuff."
But, but. Software patents are bad. Now I'm confused.
...the Knight Rider prophacy is coming true!
Note to David Hasselhoff: Now's the time to re-invest into your (American) acting career!!
No matter how hot a girl is - some guy somewhere is sick of her shit.
Shouldnt we be all seeing fully functional independent robots by now?
The robotics is taking a long time to mature.
*very very* long time
I believe the problem is that only small set of individual professors and small group of students cannot achieve huge breakthroughs in engineering.
Creating an Atom Bomb was just engineering (since sustained reaction was experimentally proved in 1933 itself).
But how many people could do it?
It took a huge set of scientists (*read - not engineers) and a huge set of engineers working together to achieve it.
And they did it in what 3 years ??
Similarly one big government funded project, and we can see real robots around.
Otherwise, in 50 years from now, we would still have similar news coming out.
rajmohan_h@yahoo.com
Really good documentary! Seriously, you know you are a TRUE nerd when you witness an autonomous vehicle actually complete a race like this... and a tear comes to your eye! Really, I got misty-eyed watching this!!
What do you do in the future when one of these is mass-produced and forgets its turn signal and cuts you off?
Do you scream and give it the finger?
Throw rocks at it?
Run it off the road?
Launch a homing missile at it?
Any way around it, driverless vehicles will have no rights in our future society!
Who will speak up for the robots?
He who knows best knows how little he knows. - Thomas Jefferson
i do keep up with robotics and ai, religiously following the progress of the field for almost twenty years. and i have read every article i could find on the DARPA race, and kept track of the race on the (awful) Flash/shockwave site. after the race was won, i've almost become burnt out on it, almost not caring to watch the NOVA footage. well, i'm glad i did, because it showed the best inside info on how Stanford's AI and sensor fusion worked. and it compared and contrasted Stanley's AI techniques with Carnigie Mellon's. of course, watching multi-ton driverless vehicles veer off course and plow full steam ahead straight towards the spectators was exciting (some of the concrete barriers were knocked farther than when hit by NASCAR stock cars!). and H1ghlander sure had a taste for chewing up haybales! props to the geniuses at all the teams!
i disable sigs
Let PBS know what you thought about the format, show, or anything else.
-Ian
This was a fascinating program. It would have been nice if the Stanford team divulged more of their ideas, what software languages and designs they used etc. It looked like they were doing a Bayesian classification on combined laser ranging and video on the terrain ahead. Doing that for 1 image is complicated enough. Doing 10+/sec is mindblowing. The control system moderated the vehicle's need to follow a prescribed path with how safe the path was. Amazing stuff, very elegant. Pretty much done with a stock Volkwagon SUV. Next time they should conduct this race without GPS. I have no doubt someone will figure it out.
an ill wind that blows no good
A lot of things seems trivial to implement in theory, but in actuality physical and environmental constraints seem to introduce a whole different ball game. A big congrats to all the teams who entered.
One thing that I noticed from the article is that one of the teams has problems with dust accumulating on the sensors. How would one get rid of this dust, so that you don't recieve incorrect readings?
Last Saturday, Digital Village Radio did an interview with Jason Spingarn-Koff, the filmaker of The Great Robot Race, and Sebastian Thrun, the leader of the winning Team Stanford. Here's a link to the mp3.
v nice
So DARPA funds this to create autonomous supply vehicles, which might work in a traditional battle with clearly drawn front lines and relatively secure transport routes behind the lines.
It seems to me like 21st century warfare is a whole different animal - how hard would it be for a motivated, talented individual to figure out some simple attacks for the navigation systems on these vehicles, and get loads of sweet US munitions delivered to their doorstep? How effective would one of these vehicles be in an urban setting? How easy would it be to create a series of obstacles that would paralyze one of these vehicles?
It's amazing technology, for sure, and the Stanford and CMU teams deserve kudos. I'm just concerned that with the current rush to technological solutions and shift away from "boots on the ground", this technology will be in battle zones far too quickly.
Breaking News!!!
Virus outbreak causes cars to crash, responsible for thousands of deaths.
If anyone is really interested in the technical and mathematical side of this stuff, I definitely recommend Probabilistic Robotics by (among others) Sebastian Thrun, director of the Stanford Artificial Intelligence Lab and leader of the winning team in this race.
Does anyone at DARPA, the Defense Department or any of the universities involved watch movies? Have they not seen the Terminator series? Haven't they read Harlan Ellison? Herman Hesse's Steppenwolf? Is this the start of the war between humans and machines? I think they need to require more reading and humanities credits for scientists and engineers. I can see myself in twenty years running from human hunting humvees in the national forest. What are we starting?
Anything you gleaned from the NOVA documentary is bullshit compared to watching the guy explain it himself
Something that could have been brought to my attention yesterday!
Seriously though, I'd been hoping someone would be putting together something like this (though I'd been expecting it form Discovery or TLC - yay for public television). Fortunately, it is available online for those of us who missed it.
The big breakthrough was Stanford's texture vision system. I was very impressed with that. Computer vision in unstructured environments has a terrible track record, yet they made it work. Everything else was basically integration of off the shelf gear.
One accomplishment not oftened mentioned is that, by year two, many of the components that weren't available in year one were available off the shelf. In year one, getting an integrated GPS/INS/compass/odometer system was very tough. Applanix had one that cost $70K, took up a 4U rack, and required air conditioning. (CMU used it.) By year two, you could get something comparable from any of three vendors for about $20-$30K, ruggedized and able to run on 12VDC. All the successful teams had one, usually from Trimble or Novatel. Once you have one of those, just staying on course is straightforward. Then it's all about obstacle avoidance.
Obligatory Simpsons Quote:
"The wars of the future will not be fought on the battlefield or at sea. They will be fought in space, or possibly on top of a very tall mountain. In either case, most of the actual fighting will be done by small robots. And as you go forth today remember always your duty is clear: To build and maintain those robots. Thank you."
-- Military school Commandant's graduation address, "The Secret War of
Lisa Simpson"
-Styopa
It was interesting to see. They didn't however show that TerraMax was paused by officals many times, because of other robots broke down or in the way of the TerraMax Truck. No saying we would have won, but we did have to stop until the next day, because of the pauses. Great job Stanley and all others for completing the race.
It was a pretty interesting show but I was kind of disappointed with the concentration on the Stanford and Carnegie Mellon teams. The team I was most interested in was Team ENSCO - their car Dexter was leading at the half way point but unfortunately it hit something after 81 miles, bending the frame and causing a flat tire. I'm still a little disappointed they didn't win - the academic teams were very clearly the favorites going in to the race and even though ENSCO itself is a (somewhat) defence related company, everyone loves an underdog.
This was a very good NOVA documentary. It moved quickly and covered a lot of new ground in a short time, like the algorithms the robots used and the kinds of problems they solved, unlike most documentaries which repackage the same science anecdotes over and over or only discuss philosophy.
It wasn't as much the fact that Stanley won the race as how Stanley won the race and the differing approaches of the builders that made it interesting.
Unfortunately, it was not in HD. It was widescreen low definition. They can get robots to drive 120 miles but they still can't get HD.
At what point do the robots turn on each other and try to smash one another with saws, hammers and spikes? Wait, I think that is a different show...
Follow the link in this comment
Thanks slashdot!
I watched this show when it aired last night. I'd actually been looking forward to it quite a bit since seeing a preview for it a week or so ago. Is it just me, or is Nova possibly the best show on television? I don't get so interested in every subject they cover, so I don't watch it all the time, but, I must say, every episode I have seen has been excellent. We could use more television like this, and a lot less American Idol and other BS.
There was nothing quite like seeing, for the first time in my life, real vehicles, weighing multiple tons, driving completely by themselves. Awe-inspiring stuff to catch a glimpse of the future like this. Even my wife (who is not geeky at all) really got interested in this show and was practically cheering when Stanley passed Highlander.
All this robotic car stuff is pretty slick. But, you know, I would have been so much more impressed to have seen one of the teams pull up in just a regular car with no special equipment, sensors, or modifications, and then watch they put a humanoid-like robot in the driver's seat to drive the car. How much longer before the tech advances to this step?
Despite what EULAs say, most software is sold, not licensed.
While I didn't find the broadcast show as insightful as the original article in Scientific American article preciously posted, I did find the show very entertaining. It was interesting to see the different contestants, and the projects they spent so much time working on. I can honestly say I'm ready to have an automated vehicle. It will give me more time to do the things I like versus spending copious amounts of time on the road. Wouldn't it be cool to have mobile online access, and a vehicle to drive you from point a to b, and you get to be reading /.
P-)
I was coming from Utah back to California. We had just stopped in Primm, NV to eat. Just after Primm, we saw what we thought was some crazy guy tearing up the desert after drinking way too much beer. The dust cloud behind this "guy" was incredible - I saw it from miles away. The vehicle was coming towards Primm from the California side and probable a mile off the freeway. As the vehicle past us, that thing was bouncing pretty good. I remember commenting to my girlfriend that that "his" suspension wasn't going to be the same after that. It wasn't until a couple of days later that I figured out what we had seen. Had I known, I would have stopped to watch and take pictures.
There were several points made in the program that I hadn't heard elsewhere (and I've been paying attention to the Grand Challenge since the initial press release).
-- The teams get the GPS waypoints a few hours before the race. The waypoints are purposefully vague, so the robots have the choice of driving off a cliff (or into one) while still being within GPS parameters. This is supposed to prevent the race from reducing to "Who can follow GPS the best?" The Red Team had a group of what looked like 20 or 30 people who immediately sat down with the waypoints mapped out on satellite imagery, going through and adding waypoints of their own and adding speed commands for their robots. This seems to me to be a big violation of the spirit of the competition.
-- The Red Team had two entries, which they programmed differently: one more aggressive, the other more conservative (on speed). The faster robot, Highlander, was pulling away from Stanley for the first part of the race, until some unknown issue starting causing problems. Nova didn't say what was wrong, but it looked literally like Highlander was slipping out of gear and rolling back down hills. It _might_ have been doing it on purpose, i.e. a software glitch, but it didn't look that way.
-- One of the Red Team's entries completed the last portion (the hardest portion) of the course with its main sensor non-functional -- it was stuck pointed 90 degrees to the side. This argues even more strongly that the Red Team's vehicles weren't doing much route-finding and were pretty much just following GPS waypoints.
The conclusion I draw from this is that we are still a long way from the DOD's goal of autonomous transport vehicles. In a combat situation, transports need to be able to avoid obstacles put in their way _by the enemy_. The only time during this challenge that the vehicles did anything like this was during the initial trials before the race, and that was very limited. The actual race course was hard -- off-road, dirt, narrow, slippery -- but it didn't have tank traps painted the same color as the dirt they rest on. It didn't have razor-wire barricades, forcing the cars to figure out a route through the bushes around them.
I'm confident that if I had been on the course fifteen minutes before the cars showed up, I could have stalled or disabled all of them. Pile a bunch of bushes across the road and all of them would have stopped. During the trials and race, none of them demonstrated the ability to work around such a very limited obstacle.
All of this is not to minimize what was accomplished. But we're a long way from sitting back sipping champagne while robots do the dirty work of war.
Most interesting stuff. I was glad to see "Stanley" win. The "Highlander" and "Sandstorm" obviously had a lot of tech in them but "Stan" was clearily more reflective of the challange's merit - create a robot that can make decisions. The Red team crammed their vehicles with so much data it was like programming a production line robot. Yeah, it was a robot and a damn impressive one at that, but "Stan" could and had to actually decide things - and it did too. The idea of the laser + video overlay was most brilliant. While watching the program I could not help but been thrown back to those 80's films where the underdogs try to save some place against a heavy muscle of well oiled, militarily organized, and funded up the wazoo industrial juggernaut. Not trying to put down the Red team, obviously a brilliant bunch, but the VW was way [i]brilliant-er[/i].
As a student at Carnegie Mellon who has discovered the extent of his school's ties to development (had I known prior... and no, CMU is not unique in this regard, the problem is everywhere) of military products and has since spoken out against them a few times, thank you for realizing that this DARPA stuff isn't all it's cracked up to be.
I'm perhaps one of four people (an exaggeration, I hope) on my campus that isn't gung-ho about helping the DOD build driverless vehicles, and it's lonely at times.
Whatever moderator marked this down as off-topic was clearly just trying to limit the scope of discussion in the same way that DARPA and military contractors are trying to limit the scope of their moral and ethical liability.
-bugg
I had a close friend at CMU that worked on both of their robots. I got to visit them twice and see their production. H1lander wasn't there the second time because it had a transmission failure. They had to take it to the dealer. Can you imagine an H2 which is completely gutted, loaded with computers and has no steering wheel because it steers itself and having to take it to the dealer.
Also, both CMU robotos ran some form of linux with a all of the hardware donated by Intel. I believe they had a 2TB RAID for storage, a hand full of itaniums and bunch of Pentium M's to run their systems. I didn't get the full specs because my friend is an EE, but the numbers he gave me were pretty astonishing. And it was all donated.
So Stanford's vehicle was smart, and Carnegie Mellon's two vehicles were "dumb".
And guess what vehicles they started with? Stanford built around a Volkswagen diesel (Passat? Golf?)... and Carnegie Mellon worked with.... Hummers.
Very appropriate.
It was definitely brains (Volkswagen with sophisticated software) versus brawn (Hummer with less sophisticated mapping).
Here are two videos I found on Google Video giving you a driverside view of an entire qualifiying round and another where the car rear-ends a parked car (autonomously drunk?).
Princeton DARPA Grand Challenge - NQE Run 5 Princeton University Prospect Eleven 12 min 38 sec
Princeton DARPA Grand Challenge - Crash Video Princeton University Prospect Eleven 54 sec
A bit torrent link to "Why We Fight".
http://www.mininova.org/tor/68961
Purchase this movie if you at all enjoyed it. That is your civic duty. True
The most interesting thing I found from the race was the different approaches of the Stanford team who won, and the other teams. Stanford chose to work on the more difficult of the problems, which is the software side of things. They left the hardware of the car to people more adept at such things (Volkswagon). It was interesting to see the other teams focusing on the hardware problem, and leaving the software as less of a problem. The other interesting thing was seeing the different managerial approaches. The CMU team was headed by a former Marine with this "RA RA RA!" macho attitude. I thought the programmer who commented that he had "pretty much given up on sleep" was really telling to this approach. I'm a believer that pushing this hard only leads to bigger problems in the end (it's been scientifically shown time and time again that people make more and more mistakes with less sleep). Maybe the Macho RA RA RA attitude works well on battlefields, but it doesn't sound like it works well for developing science and technology. The CMU team basically lost because their vehicle broke down. The Stanford car sounded like it had no serious problems, and worked like the Stanford guys designed it.
In the end focusing on your strengths, and letting others do what you lack paid off for Stanford. Knowing your limitations (and not simply denying them) is a good attitude for success at anything. It's great fun to see a team with an approach you like beat everyone else.
AccountKiller
It was a great program, and it prompted me to re-visit the old Slashdot article on this and to look a number of things up. Things that Nova missed:
* It mentioned the Gray team being a dark horse, but in reality, they took only about half an hour longer than Stanley. If anything, it was probably even more of a newcomer than Stanley. CMU has been in the robot driving business for a long time (they had neural-net based self-driving vehicles since the early 90's), so for this unknown team to finish so close to the others was interesting.
* The whole passing thing was a bit overhyped. According to what I read, if there is a passing situation, the chase vehicles will find a wide open area and pause the vehicle that was being passed. So H1ghlander should have been still while it happened. At least one of the robots that failed the race did so when it had problems restarting from a pause.
I was skeptic robots would ever be able to finish in my old slashdot posts. Apparently they got the sensors right in the 2nd year and five competitors finished. I shoulda stuck around with Red Team year2, but I lost my key to the building and they wouldn't issue me another one.
God spoke to me.
I've gotten involved with the Princeton team that competed in the challenge - the cool thing about Princeton's car was that it relied only on GPS and stereo vision (no expensive lasers). The car didn't finish due to a programming bug, but the team took the car back to the course and was able to complete it after the race was over. If you're interested in Princeton's approach and how the car performed in both runs, here's a PDF that explains everything. In general news, DARPA has implied that they are going to announce another challenge soon; all they have said is that it will be "in an urban environment." Should be awesome!
I loved this show. I cannot wait for the day I will be able have my car take over driving. I spend most of my day commuting to and from my work area. I would love to be able to do other work while on the commute. Cudos to all the people involved in this endevor. It was brilliant. One thing bothered me though. The Stanley vehicle used laser and video cameras and differentiated by color the paths to use. If this technology is to ever be used in the public sector it will have to work in all enviroments. I dont believe that the current sensors they used for the race would work on an area covered by fresh fallen snow. The next competition should be in Michigan's upper penninsula
I don't know where you are, but my HD PBS station rebroadcasts Tuesday's NOVA in HighDef on Saturdays and Sundays. KPBS is the local station here in San Diego... you might check your local website and see if they are planning on doing that. I plan to watch it again in HD. And kick my husband's arse if he snores through it again! :P
Sorry man... the Internet pooped on me.