Slashdot Mirror


Photorealistic, Reliable 3D Mapping For Robots

An Anonymous Coward writes: "Hans Moravec at Carnegie Mellon University has updated his DARPA-funded MARS program page , including new info about the possibily of having photo-realistic 3D mapping for robots in the near future. "Our machines will navigate employing a dense 3D awareness of their surroundings, be tolerant of route surprises, and be easily placed by ordinary workers in entirely new routes or work areas. The long-elusive combination of easy installation and reliability should greatly expand cost-effective niches for mobile robots, and make possible a growing market that can itself sustain further development...We expect our new data to bring us further towards photorealism, and more importantly extremely reliable 3D maps." Check out all the slides and movies at the bottom of the page."

33 comments

  1. CounterStrike in my City. by mal0rd · · Score: 1

    I can't wait until this tecnology is used to create a detailed 3D envirment of my home city so I can play counterstrike in it.
    It would also be great for all other sorts of simulations when the actual place couldn't be visited.

    1. Re:CounterStrike in my City. by NonSequor · · Score: 1
      Why play CounterStrike in a simulation of your city when the real thing is all around you. Get some friends together, buy some guns, and play CounterStrike for real.

      Er... Well, y'know. You can't make an omelette without um... destroying a forest. Or something.

      --
      My only political goal is to see to it that no political party achieves its goals.
    2. Re:CounterStrike in my City. by Stephen+Samuel · · Score: 2
      Get some friends together, buy some guns, and play CounterStrike for real.
      Personally, I like being able to taunt my friends, after I kill them (and vice versa!).
      --
      --
      Free Software: Like love, it grows best when given away.
    3. Re:CounterStrike in my City. by jafac · · Score: 2

      Someday, they'll make a loophole for Battlebots, allowing for any bot that is not remotely controlled to use a radio jammer.

      THEN things will get interesting. . .

      (think, the spinning bots will have a 360-degree field of vision, each frame updated once per revolution. . . better drivers, theoretically faster reaction time.. . .)

      --

      These are my friends, See how they glisten. See this one shine, how he smiles in the light.
  2. Interesting by Voltage_Gate · · Score: 2

    The Dalek couldn't climb stairs until the 6th Doctor (or was it the 7th?). Thank God we're waaay ahead of them now!

  3. Lego my robo... by Sayjack · · Score: 1

    Sounds like they implemented an industrial version of the lego robot reported by slashdot earlier in this article.

    Neat stuff...

    --

    -- Good judgement comes with experience. -- Experience comes with bad judgement.

  4. Computer Vision's Goal by fireboy1919 · · Score: 5
    I am a student studying computer vision. It has long been known that CMU, and especially the famous Dr. Takao Kanade have been interested in autonomous vehicles - that and stereo vision have been the major focus of that school. They're very good, but this is really not just an event at their school. Its more like a community (the vision robotics community) effort. Even Slashdot has posted a few of the other contributions.

    HOWEVER, its still a long time coming. In addition, space projects and industry require much more precision and accuracy than academia can offer alone. Keep in mind that CMU already did the "No hands across America" project, where there cars "drove" (they controlled breaks and gas) 99% of the way across the United States autonomously. That was a while ago - so was their total virtual environment mapping dome. Have you seen any autonomous cars for sale? What about 3d videos that you can see from every point of view?

    We still have a long way to go.

    --
    Mod me down and I will become more powerful than you can possibly imagine!
    1. Re:Computer Vision's Goal by bckspc · · Score: 1


      > 3d videos that you can see from every point of view

      Maybe not, but I heard there were some hot and heavy DVD's with this little feature.

      Not that I'd know or anything..

  5. I saw something similair to this at MIT by hooded1 · · Score: 3

    While on a tour of the MIT AI labs i was shown a project they were working on, which has similair components to this. Essentially what they were doing was, creating a system in which they could point to a part of the room (with their hand) and vocally tell the computer to project some image there. The project is called Hal The Next Generation Intelligent Room

    --
    A rabbit in the hand is worth 4 in the cage
  6. Re:Is the program Open Source? by fireboy1919 · · Score: 2

    Well, its not exactly a program...more like a system. The algorithms are published every year in academic conferences such as Computer Vision & Pattern Recognition (CVPR), International Conference on Computer Vision (ICPR), and IEEE Conference on Robots and Automation (not often). There are a lot of 'ifs' here to getting it to work. IF you have access to a University library, and IF you have an extensive background in discrete calculus and signal processing, IF you can program well, and IF you have the expensive equipment, then you can go ahead and make it work. Actually, CMU will probably give you some code if you ask - if you're at a University. Acadamia is where sharing originated after all...

    --
    Mod me down and I will become more powerful than you can possibly imagine!
  7. MIT is doing something similar by Binary+Tree · · Score: 3
    1. Re:MIT is doing something similar by Thurn+und+Taxis · · Score: 2

      As someone who stares out the window at these buildings every day, I can attest to the fact that the models generated by this system are excellent (I should also point out that, although I met Seth Teller once, I don't recognize any of the other names on the page, so I'm not tooting my own horn). They work great for blocky buildings, which are prevalent around Tech Square, but I'll reserve judgment until I see how well they do with the Stata Center designed by Frank Gehry (which right now is a big hole in the ground, but in a year or two should be an ugly wart on the corner of Vassar St.). 4 or 5 years ago there was a student (Ig) in a nearby lab who designed a CCD camera whose output, rather than being the brightness of the object being imaged, was the motion of that object. Unfortunately I don't think anyone in the AI lab picked up on the design; it would make these sorts of models much easier to generate.

      --
      On stereophonic equipment, the monaural sound obtained through multiple channels will enhance your listening pleasure.
    2. Re:MIT is doing something similar by Animats · · Score: 2

      Semi-automated model acquisition in urban areas was achieved around five years ago at U.C. Berkeley. The commercial version was Canoma, which MetaCreations is trying hard to sell off.

  8. Classic example of SMPA by mtDNA · · Score: 5

    Moravec's approach is a classic example of the SMPA (sense-model-plan-act) approach to mobile robotics. A lot of people think this is a dead end - not least among them Rodney Brooks, who advocates what is called the behavior-based approach. Behavior-based robotics basically relies on integrating several independently operating reflexes into a robot, which is much more lifelike. A nifty intermediate approach is taken by Ronald Arkin, who seems a little more pragmatic (and less dogmatic).

    You can read some superficial information about all of these guys (and others) in the book Robo sapiens.

    A review of Robo sapiens can be found here.




    --


    If you watch TV news, you know less about the world than if you just drank gin straight from the bottle.
    1. Re:Classic example of SMPA by mbyte · · Score: 2

      actually I think the newer robots use both sides.

      Brooks never managed to get his beaviour based approach to higher levels than simply evading objects. If you read his (older) papers, you can understand why :)

      So .. I think they use beaviour based functions for the low-level functions (evading objects, etc), and SMPA for the higher levels, like map building, navigation, reaching a goal, etc.

    2. Re:Classic example of SMPA by SpinyNorman · · Score: 2

      There's no reason that Brook's subsumption architecture has to work at the level of raw sensory input - it can just as well work on internal models. If fact, this is along the lines of what Minsky is proposing in his "Society of Mind" - that we're based on a set on low level interacting intelligences.

    3. Re:Classic example of SMPA by isaac_akira · · Score: 3

      Moravec's approach is a classic example of the SMPA (sense-model-plan-act) approach to mobile robotics.

      No it isn't. It's just a vision processing system that creates an internal model of the 3d environment around it. Once you build that model, you can do whatever type of reactive behavior or goal-oriented planning you wish.

    4. Re:Classic example of SMPA by Animats · · Score: 3
      Sigh.

      Early thinking (60s-70s) really was to build a detailed model of the world, grind it down to simple primitives, and run a logic-based planner on it. That had a terrible time dealing with uncertainty and required a very regular world.

      Moravec introduced the idea of "certainty grids", which are probablistic occupancy maps. Originally, he used this as a means of getting useful data from ultrasonic rangefinders, which are very low resolution devices with slow data rates. (I've built a robot that works that way myself, and you really can get maps with more resolution than the sonar beam by taking enough samples as the robot moves.) As enough compute power became available, he moved to laser rangefinders (better resolution, but clunky rotating mirrors) and finally to passive stereo imaging.

      What you get out of systems like this is a map of the neighborhood showing what's open space and what isn't. This is a good input to a repulsive-field type path planner. There's no need to extract a "primal sketch" or do any object recognition just to accomplish navigation using this approach. It works quite well; the CMU Navlab vehicles have been cruising around offroad on this technology for years now. The Denning guard robots used this technology with sonars.

      Extracting range data from stereo imagery was Moravec's thesis topic in the 1960s. It took a mainframe computer 20 minutes per frame back then. Now it can be done in real time. There's commercial software for this. Two cameras are good; three cameras are better. It's actually not that hard; it's basically done by convolution. It's not done by edge recognition any more. Convolution is computationally expensive, but simple. We finally have enough compute power to do this stuff.

      I've commented on Brooks' work previously, so I won't say any more about that now.

  9. Re:Map this! by NSupremo · · Score: 1

    This Looks Familiar

    L. Ron has some strong ganja!

    --
    http://en.wikipedia.org/wiki/2004_U.S._Election_co ntroversies_and_irregularities
  10. One question... by mduell · · Score: 3

    bring us further towards photorealism, and more importantly extremely reliable 3D maps

    Ok, my only question... have they used it for porn yet? (they always seem to use technology first ;p)

    Other posts you are likely to see:
    1. I want a 3D map of Natalie Portman!
    2. Can they make a beowulf of these?
    3. Im gonna pour hot grits on the robot!

    Ok, I just needed to get that out of my system.

    Mark Duell

  11. Re:OT: No hands across America by fireboy1919 · · Score: 1

    Hmm...you seem to have the wrong impression. It ONLY steered, and didn't do breaks or gas...

    --
    Mod me down and I will become more powerful than you can possibly imagine!
  12. Robots with AI by Alien54 · · Score: 2
    Somehow this brings up all of those memories of bad robot movies where the robot goes beserk because of a glitch in the program or a hacker, or some other thing.

    The positive side to this is that this is a necessary prerequisite for things like the robots from the Jetsons.

    Image for the future: the Microsoft OS for Robots. Now why does this produce the reaction I an sure it produces? and why does it make me nervous?

    --
    "It is a greater offense to steal men's labor, than their clothes"
  13. Slashdot rejected this by Wakko+Warner · · Score: 1
    Watch them post a link to this tomorrow afternoon, though. See, news (like the RIAA monitoring IRC, Gnutella, Freenet, FTP, the Web, and just about every other goddamned thing that sends out packets) is only NEWS when the most EYEBALLS will see it. You'll read this story again tomorrow afternoon, but I'm giving it to you now. Oh, there's screenshots of it, too.

    - A.P. (-1, offtopic, I know.)

    --
    * CmdrTaco is an idiot.

    --
    "Remember when the U.S. had a drug problem, and then we declared a War On Drugs, and now you can't buy drugs anymore?"
    1. Re:Slashdot rejected this by cr0sh · · Score: 2

      http://www.ifpi.org/

      Worldcom - Generation Duh!

      --
      Reason is the Path to God - Anon
  14. movie effects by maloi · · Score: 1

    I can't be the only one thinking this technique could be used for some really trippy effects in a sci-fi film...

  15. Microsoft already did this! by small_dick · · Score: 2

    ...navigate employing a dense 3D awareness of their surroundings...

    ...be easily placed by ordinary workers in entirely new routes or work areas...

    we call 'em "MCSEs"


    --


    Treatment, not tyranny. End the drug war and free our American POWs.
    See my user info for links.
  16. Re:OT: No hands across America by cronio · · Score: 1

    ah, I see it now. The way you said it was a bit ambiguous. I must be thinking of another project which steered and did brake/gas (there are a couple prototypes I've heard about). I think.

    --


    My plan is to pimp before they realize I'm a jackass. Hit 'em hard and fast.
  17. Hans Moravec by Kafka_Canada · · Score: 2
    The guy who did this research, Hans Moravec, is a bit of a utopian optimist... he's a good man, but in my views his hopes for the future are a bit unrealistic...

    if i recall correctly, in 100 years (or was it 50?) he claims robots will operate fully autonomously, and act more or less as intelligently as a standard-issue human being. in a little longer, he expects robots will inherit the earth, the stock sci-fi drama of robots being superior to us in every aspect, rationally, physiologically, even creatively/emotionally, and we either make ourselves cyborgs/robots, or the robots proper become the mightiest animal in the urban jungle.

    so... maybe the proverbial grain of salt is in order, but of course it's wonderful to see this kind of vast technological progress.

    --
    Fuck it
  18. Problem with Brook's work... by Anonymous Coward · · Score: 3

    The problem I've always had with Brooks' work (besides the whole "Subsumption Arch is the ONE TRUE WAY" ego trip) is that he always tried to claim some kind of biological relevance where THERE WAS NONE.

    I am currently a graduating senior in both biology and computer science, and am very interested in the integration of both, in the areas of neuroethology and biomimetics. Most of the people doing biomimetic robotics (i.e. robots quite strictly based on biological systems, theories, data, and constraints) don't like Brooks for that reason. He created robots, vaguely insect like - they used no real biomechanical data, neural control data, etc., and seemed to suggest that there was some real insect structural and behavioral aspects to them. I also think he's somewhat of a playboy, going from so-called "insect-like" robots (Genghis, Attila, etc.) to his media/attention/funding grabbing monstrosity COG (not that I think $$$ going to AI research is bad in any way), which he makes claims with hubristic abandon about its learning abilities.

    I bet in a few years, when interest and funding dies, and he sees what a complex, deep hole he's dug himself into, he'll think of something new to grab headlines about...

    BTW for those really interested in more "hard" work on biologically inspired control and networks, look at Eve Marder's page at Brandeis (which I don't have with me at the moment) and have a nice gander at

    http://neuromechanics.cwru.edu

    The Case Western Reserve University's new graduate program in neuro-mechanical systems. There, Dr. Roger Quinn, and many other researcher are working on some great biomemetic projects, including a robo-roach, and cricket. They use hard biological data to design these guys with. They also do significant work in neural basis of behavior, biomechanics, and neural-controlled prosthetics. I'm also plugging it because there is a 50-50 chance I will be attending the PhD program there next year in sunny, gorgeous Cleveland, OH!

    Sincerely,
    Kevin Christie
    kwchri@wm.edu

  19. What's next by Convergence · · Score: 2

    LOL... I wish I knew that this would be coming up... Hans is intending to hire me in a couple of months to do the next step.. Putting this in an actual robot. We're not sure exactly what I'll do. He's been busy on the presentation for the last few weeks for us to discuss it.

    Most of the stuff you see is data collected several years ago. The office scenes are from 1996.

    Gimme a moment to set up a URL.. I'll spit out a binary and a datafile so you can navigate the room yourself. See the result of the program, in all it's brokenness and accuracy. :)

    Current status: (which was interrupted recently due to making the report)

    He's about to collect a new dataset with a trinocular vision system, and redo the code to build the occupancy grids. The new dataset should have fewer errors and 'streak' artifacts. (There are subte reasons why it's screwing up on that dataset) His code should be able to build a new occupancy grid every few seconds.

    The next stage should include putting it in a real robot. (Which I've seen.. It's a cute, its wheels look like saw blades.) building maps automatically. The eventual target is an external 'head' that can be bolted onto any robot.

    (One thing I should finish before he gets back is a new viewer for the occupancy grids. So I can get a 'birds eye idea' of what they look like.. Eyeball them for myself before building code that will be playing with them.)

    Too bad I'm a CS Theory weenie instead of robotics.. But it will be one hell of a cool next year.

    PS: Tip for everyone... Dumb luck strikes, but you have to make your own luck and grab it when you get it. I met Hans only a couple of months ago. Hans was walking out one day. (By the newly key-carded doors). I was talking to him and asked if he thought the CMU administration were malicious, he said he thought they were inept. I asked what his research was, and it went from there.

    1. Re:What's next by Zurk · · Score: 1

      are the algorithms / software ever going to be released as open source ? it would be kewl to hack on this.

    2. Re:What's next by fireboy1919 · · Score: 1

      Read more often. The algorithms are already publicly available. CMU publishes details of all the stuff they do in scientific journals. Its like atomic physics used to be: the knowledge was available, but very few people understood it. Hack all you want...if you understand it. Check these conference proceedings: CVPR, ICPR, IEEE Conference on Robotics & Automation, and of course, CMU's website.

      --
      Mod me down and I will become more powerful than you can possibly imagine!
    3. Re:What's next by Zurk · · Score: 1

      yeah but the code is much better and the papers dont tell you EVERYTHING you need to know..usually important stuff is omitted or missing which the code can clear up really fast.