Slashdot Mirror


MIT Drone Finds Its Way Using Kinect Vision

garymortimer writes "This MIT multicopter is able to fly in GPS denied environments by creating a 3D map of its surroundings on the fly (no pun intended) based on point clouds generated by a Kinect. Also pretty handy for avoiding trees and other obstacles outside at low level. This processing is onboard, unlike other systems that depend on motion capture rigs."

14 of 77 comments (clear)

  1. ROFL Copter by Shikaku · · Score: 3, Funny

    Remote Objective Forensic Lead Copter.

  2. How much would this have cost... by Anonymous Coward · · Score: 3, Insightful

    before the Kinect came out?

    Frankly, I'm pretty sure most of this stuff *already* existed before the Kinect came out. I'm just wondering exactly how much Microsoft mass producing the hardware saved the researchers on having to make their own devices.

    I imagine it's quite a bit since we went from "hardly any talk about robot vision except about how goddamned hard it is" to "A NEW ROBOT/CAMERA/WHAT HAVE YOU USING THE KINECT AS ITS EYEBALLS!!!!!" every week once the Kinect was out for a month.

    I'm complaining, yeah, but I'm also trying to put things into perspective. These aren't leaps and bounds of tech, they're just leaps and bounds of people actually making use of the damned hardware since they don't have to sell their second child to pay for it.

    Crowdsourcing I guess? Instead of 2-3 sterile environments trying to figure out robot vision algorithms, now a bajillion institutes and hobbyists are working on the problem. I guess one way or the other, this is a big step in the fields of autonomous robotics and so on. Now if only we could work on the goddamned speech recognition software... The hardware for that's been around for ages and yet people haven't been messing about with it as much as they do with the Kinect.

    1. Re:How much would this have cost... by AdmiralXyz · · Score: 2

      How much would this have cost before the Kinect came out?

      A lot. Please see an earlier comment I made on the exact same issue: prior to the launch of the Kinect, if you wanted an accurate depth map on a robot, you had to use LIDAR sensors. Not only are those expensive, but they're both heavy and somewhat unreliable (since they have moving parts in the form of rapidly spinning mirrors) which rules out mounting them on a copter. There are ways to estimate depth from 2D images alone, but then accuracy suffers immensely. With Kinect you get the best of both worlds.

      --
      Dislike the Electoral College? Lobby your state to join the National Popular Vote Interstate Compact.
    2. Re:How much would this have cost... by emj · · Score: 2

      Actually 2 years back a quadcopter were flying in the same hall using LIDAR. I think I found a price of ~$5000 for the units they used, but my memory might be an order of magnitude wrong.

      You can get along way with 2D images, a lot further than you think, of course with this tech it's easier.

    3. Re:How much would this have cost... by Missing.Matter · · Score: 2

      The best LIDAR you can buy for the size is probably the Hokuyo UTM and URG. Definitely small enough and light enough to mount on a copter. They'll set you back $2000-$6000 though. To get a 3D image out of them you need to pivot them on the y-axis. They also generate a lot of heat, and suck up a lot of energy.

      Crowdsourcing I guess? Instead of 2-3 sterile environments trying to figure out robot vision algorithms, now a bajillion institutes and hobbyists are working on the problem.

      Not really. The people who have been doing the amazing research are still doing it; the really exciting stuff is still coming out of CMU, MIT, Stanford, etc. It's just that now the hobbyist can implement the research on their own platforms.

  3. I don't buy it by 93+Escort+Wagon · · Score: 2

    This MIT multicopter is able to fly in GPS denied environments by creating a 3D map of its surroundings on the fly (no pun intended) based on point clouds generated by a Kinect.

    No pun intended = "I came up with a weak pun, but I don't want people to blame me for it"

    --
    #DeleteChrome
  4. Tip of the hat to Microsoft by MonsterTrimble · · Score: 3, Insightful

    As much as it's unpopular, we should all thank Microsoft for putting this great piece of kit out in the public and even moreso for not going after the API which is floatng out there like many corporations do nowadays.

    --
    I call it 'The Aristocrats'
    1. Re:Tip of the hat to Microsoft by gstoddart · · Score: 3, Insightful

      Lets not forget MS didn't invent it, they wrapped in a package and sold it. I don't think they could really have a hope stopping any API

      Well, they didn't actively encrypt or obfuscate it. So, at least they decided to play nicely and let people develop for this.

      What corporation would go after a completely home brown [sic] API package for a physical device?

      Well, I know you're not new here ... but, really? I think Sony would sue people into oblivion for something like this at the drop of a hat. It seems to be increasingly the norm for some corporations to more or less say that it is illegal to use hardware they sold you in a way they don't approve of. Seems to be Cuecat did it several years ago.

      And, corporate hand-wringing aside, I think it's really cool that people are using the Kinect to make things like this. From the sounds of it, this is opening up lots of interesting avenues for researchers to be able to build cool things.

      I for one, welcome our new fully autonomous 3D navigating multicopters. :-P

      --
      Lost at C:>. Found at C.
  5. (Partially) misleading summary. by pushing-robot · · Score: 3, Informative

    According to TFV the "multicopter" uses onboard processing to find reference points between successive video frames, which it then uses to determine how fast and how far the drone moves.

    However, the actual map generation and navigation is handled by a separate computer.

    --
    How can I believe you when you tell me what I don't want to hear?
  6. Where's the algorithm? by mangu · · Score: 2

    These aren't leaps and bounds of tech, they're just leaps and bounds of people actually making use of the damned hardware since they don't have to sell their second child to pay for it.

    Crowdsourcing I guess? Instead of 2-3 sterile environments trying to figure out robot vision algorithms, now a bajillion institutes and hobbyists are working on the problem

    Working on *which* problem exactly?

    I don't see any of those people working on artificial vision algorithms. What they are doing is using a "good enough" vision algorithm which comes bundled with the hardware to develop applications for artificial vision.

     

  7. Re:So why didn't Kinect and Wii come from MIT? by pushing-robot · · Score: 2

    It's because the researchers couldn't build factories in China to pump out their equipment by the million. Mass production, economies of scale and all that.

    If you hired a team of engineers to invent and build you a one-off car, how much do you think it would cost?

    --
    How can I believe you when you tell me what I don't want to hear?
  8. Re:So why didn't Kinect and Wii come from MIT? by Colonel+Korn · · Score: 4, Insightful

    Here's a question: All these university researchers are using Wii controllers and Kinect devices to do research. How come they didn't invent this stuff themselves?

    They did, long ago. This sort of thing is usually developed as a demonstrated concept in an academic lab. Proof of concept devices are ungainly, expensive, and incomplete, but they show that the academics' idea works and has potential for further development. Then companies take that public domain knowledge and make products from it. These are much cheaper and better packaged. Now the products are part of our technology culture, so they're natural tools for the next round of academics to use as tools for further innovation.

    Is it because they couldn't think in mass-market terms so their solutions were overly complex and expensive?

    Now here's another question: Why don't Nintendo and Microsoft make developers kits for their devices sans game console? Or even better, make the open source (I can dream)?

    Microsoft is releasing Kinect for PC with an SDK supposedly intended to enable this sort of development. They chose to leave the output from the existing Kinect interface unencrypted, too, resulting in the already large homebrew scene demonstrated in storied like this.

    --
    "I zero-index my hamsters" - Willtor (147206)
  9. Re:So why didn't Kinect and Wii come from MIT? by Archangel+Michael · · Score: 2

    If you hired a team of engineers to invent and build you a one-off car, how much do you think it would cost?

    Depends on the car. Also it depends on what that car could do that other cars couldn't, say something like "fly", and how cheaply it could be made and how the usage could be expanded to markets not quite the intended one. Prototyping is expensive, and I'm sure that Microsoft's prototypes of the Kenect were very expensive, but they had a plan to sell millions of the thing, making it less expensive for others to use and deploy in creative ways Microsoft probably never thought of.

    The point being, good R&D builds products that exceed original scope for the design. What I call the unintended consequences of invention. You know, guy playing with Radar discovers it can cook food. Radar is expensive until Amana takes the idea and mass manufactures the "Radar Range".

    Wait till Ford start putting these things in cars.

    --
    Agent K: A *person* is smart. People are dumb, stupid, panicky animals, and you know it.