Slashdot Mirror


Tiny LIDAR Chip Could Add Cheap 3D Sensing to Cellphones and Tablets

There are expensive dedicated devices that do 3D scanning (like the high-end tablet in Google's Project Tango), and versatile but bulky add-ons, like the Sense from 3D Systems, but it's not a capability built into the typical cellphone or tablet. That could change, thanks to a microsensor being prototyped now (at low resolution) at CalTech. From The Verge's coverage: The tiny chip, called a nanophotonic coherent imager, uses a form of LIDAR (Light Detection And Ranging) technology to capture height, width, and depth information from each pixel. LIDAR, which shines a laser on the target and then analyzes the light waves that are reflected back to the sensor, are best known for their use in precision-guided missile systems and self-driving cars.

While LIDAR itself isn't new, [project lead Ali] Hajimiri explains that "by having an array of tiny LIDARs on our coherent imager, we can simultaneously image different parts of an object or a scene without the need for any mechanical movements within the imager." Each "pixel" on the new sensor can individually analyze the phase, frequency, and intensity of the reflected waves, producing a single piece of 3D data. The data from all of the pixels combined can produce a full 3D scan. In addition, the researchers' implementation allows for an incredibly tiny and low-cost scanner, all while maintaining accuracy. According to the researchers, the chip can produce scans that are within microns of the original.

62 comments

  1. 3D Porn by Anonymous Coward · · Score: 1

    You can bet the porn industry is the first to take advantage of this

    1. Re:3D Porn by Anonymous Coward · · Score: 0

      they are the first to adopt any tech that advances their own industry. the internet itself would be a shell of its current form if it wasn't for them.

    2. Re:3D Porn by Anonymous Coward · · Score: 0

      Women actually. They can take shots of a mans crotch and get back man junk readings.
      If they do that, me can make some interesting measurements on women, including thigh gap.

    3. Re:3D Porn by Holi · · Score: 1

      Thigh gap? do you really like anorexic women?

      --
      Sorry, teleporters just kill you and then make a copy. A perfect, soul-less copy.
  2. Needed for automated cars. by HornWumpus · · Score: 1

    In phones, maybe. But automated cars, obvious application.

    --
    John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
    1. Re:Needed for automated cars. by Anonymous Coward · · Score: 0

      They already are doing that.

      http://www.wired.com/2015/04/d... "The front corners have built-in LIDaR."

    2. Re:Needed for automated cars. by HornWumpus · · Score: 1

      So do Google cars. Those LIDaRs cost $20K/car.

      --
      John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
    3. Re:Needed for automated cars. by Anonymous Coward · · Score: 0

      Custom one off bits of hardware cost a lot of money? Really do go on, I would have never thought that...

    4. Re:Needed for automated cars. by HornWumpus · · Score: 1

      LIDaRs are not custom, one off. They are off the shelf, added to custom, small batch (not one off), automated car projects.

      --
      John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
    5. Re:Needed for automated cars. by Anonymous Coward · · Score: 0

      Spinning mirror LIDAR is a PITA. This is an improvement. Are you really so determined to seem jaded that you can't see that?

    6. Re:Needed for automated cars. by Applehu+Akbar · · Score: 2

      I used to make those spinning mirrors and yes, this new tech is a huge step.

    7. Re:Needed for automated cars. by peragrin · · Score: 1

      Drones is the obvious use actually. The next ar parrot will be able to do indoor mapping. Heck even if data collection and processing needs to be offloaded rescue, fire, hostage negotiations even real estate could all benefit.

      --
      i thought once I was found, but it was only a dream.
    8. Re:Needed for automated cars. by camperdave · · Score: 1

      A snakebot traversing collapsed buildings could buld a 3D map using this tech.

      --
      When our name is on the back of your car, we're behind you all the way!
    9. Re:Needed for automated cars. by bensch128 · · Score: 1

      Those LIDaRs cost $20K/car.

      Or more. They can be high tens to hundreds of thousands of dollars depending on the brand and model.

      This is a big deal if they can get it right...

  3. Imager only by wasteoid · · Score: 1

    This is the imager only, the sensor, not the part that sends out the lasers. You still need laser emitters to use with the sensor.

    1. Re:Imager only by Anonymous Coward · · Score: 0

      Well, there's your business opportunity: Invent "LASERs".

    2. Re:Imager only by Anonymous Coward · · Score: 0

      Happy Easter everybody.

  4. The nanobots are chewing on my butt... by messymerry · · Score: 0

    Resistance is futile, you will be assimilated. As is well understood, homo sapiens has a great propensity for perversion. Like all the amazing technologies being created, this too will be used as a tool for the fearful and greedy. Christos aneste,,,

    --
    Dear Microlimp: I give you 2 valid product keys for win7 and you reject both of them. Piss off you wankers!!!
    1. Re:The nanobots are chewing on my butt... by Anonymous Coward · · Score: 0

      Not only every keystroke and your face on the street is tracked, now they can also spot if you have put on weight!

  5. Smartphone power by Twinbee · · Score: 3, Interesting

    Honestly, it's insane how ludicrously powerful phones are getting. I meant take this one article for example - 4K 120fps slow-motion video recording is coming to smartphones in 2016.

    4K videoing at 120fps?! From a smartphone?

    Isn't progress wonderful.

    --
    Why OpalCalc is the best Windows calc
    1. Re:Smartphone power by Rei · · Score: 2

      Still tiny apertures, though :(

      I'll take more light coming into the sensor over high frame rates and pixel counts any day.

      --
      Trump's plan to get rid of Mueller appears to be 'be so guilty of so many things that Mueller works himself to death.'
    2. Re:Smartphone power by Anonymous Coward · · Score: 0

      You can't get more light in because phone are small, but you can combine several frame to 'increase exposure' and therefore 'get more light' for each pixel.

    3. Re:Smartphone power by Anonymous Coward · · Score: 2, Informative

      Sure, as long as you're happy with progress only in information processing. How long does it take a passenger plane to fly over the Atlantic? Same as in 1969, the year of the maiden flight of the Boeing 747.

      We have no social progress towards a leisure society for all, even though all your "progress" is only used to make the rich richer.

      Keep playing with your phone while you're being robbed.

    4. Re:Smartphone power by Anonymous Coward · · Score: 0

      You can't get more light in because phone are small, but you can combine several frame to 'increase exposure' and therefore 'get more light' for each pixel.

      Blur. Readout noise.

      GP is right - there is NO substitute for light on the sensor.

    5. Re:Smartphone power by Anonymous Coward · · Score: 0

      120fps/3 is still 40fps... Sounds like a pretty good substitute to me...

    6. Re:Smartphone power by ckatko · · Score: 3, Informative

      That's entirely false. Once an senor is reading at 100% of the time for a given interval, the only thing you can do is increase the time interval, which means any movement causes blur because you're averaging more time into a single image.

      There is no replacement for sensor size and lens quality. Read what an airy disc is. None. You cannot violate physics with a PR campaign.

    7. Re:Smartphone power by bn-7bc · · Score: 0

      Hmm 120 fps slow motion ..... And here I thought that was for capturing semi fast motions ( ok it turns into slow motion when you play it bak at a lower frame rate but so does any other material playd back at a slower rate then it was recorded at). But you ar correct a smartphone capturing 4k (is that digital cinama 4k or what broadcasters call uhd, iirc ther is a bit of difference in aspect ratio an pixel count) iat 120 fps is impresive,. On a somehvat related subject : when wil 4:2:2 chroma subsampeling or at least 30 bit rgb filter down to consumer/prosumer gear?

    8. Re:Smartphone power by Anonymous Coward · · Score: 0

      Sure, as long as you're happy with progress only in information processing. How long does it take a passenger plane to fly over the Atlantic? Same as in 1969, the year of the maiden flight of the Boeing 747.

      We call this physics. Stop playing hookie in 3rd period and you might learn why this is.

    9. Re:Smartphone power by peragrin · · Score: 2

      Not quite true. Current 747 have a higher cruise speed and reduced fuel usage compared to the 1969 model. It isn't breathe taking difference but it does exist. Basically all new business jets run at mach .95 instead of the mach .6-.7 of 30 years ago. Why not faster well fuel usage goes up, and viable flight paths go down due to supersonic restriction laws.

      Like batteries we are at limits of chemical energy storage. Even hyper velocities are tough to maintain at a practical level. Improvements are only coming slowly. Without a major energy breakthrough we are going to be hitting some major roadblocks in the future.

      --
      i thought once I was found, but it was only a dream.
    10. Re:Smartphone power by camperdave · · Score: 1

      Ever hear of the Concorde? It took far less time to cross the Atlantic as a 747. Must have been breaking those physics you're talking about.

      --
      When our name is on the back of your car, we're behind you all the way!
    11. Re:Smartphone power by Anonymous Coward · · Score: 0

      Yes. Except fact never stop them from selling 'digital zoom' either. These software hack are good enough for the average selfie cunts.

    12. Re:Smartphone power by Bob+the+Super+Hamste · · Score: 1

      I would include the megapixel count in that PR campaign now. All of the compact point and shoot digital cameras are diffraction limited with their 1/2.3" sensors and silly pixel counts. I recently purchased a new camera for my wife (the digital camera she was using gave up the ghost) and was inundated with the lie that more pixels are better by the "helpful" sales staff. Thus far I haven't found a shibboleth that will let them know I know what I am doing and to go the hell away. Since my wife wants a camera for taking pictures of the kids fast image acquisition and focus speed are the points that differentiate one camera from another but try explaining that to the useless clerk. Sadly the best digital camera we own, going by image quality alone, is the first one we ever got about 12 years ago that strangely still works. It is only 8 megapixels and takes those awful XD cards but has a larger better quality lens, and a larger sensor but it is slow to focus, and slow to write. Also for a different take on the airy disc and what it means to photography there is this page that shows some real world effects.

      I wouldn't get too worked up about cameras most people use they aren't great and will likely never capture great photos that will win awards and be in books. That isn't want people want, they want something that will capture reasonable pictures of their kids first birthday party. On the professional end there are the good DSLRs that wedding photographers and studios use with proper lighting. Finally you have the people who do photography as art and there you see film and digital being used but it is a personal preference at that point, not a technical decision. Personally I like film, I started with film, I learned on film, I understand how film behaves, and I have a camera that doesn't try to do what it wants instead of what I want, no automatic anything,

      --
      Time to offend someone
    13. Re:Smartphone power by Holi · · Score: 1

      Anything to back that up with? Because everything I have seen seems to explain why speeds haven't changed and that to increase speed by say 10% takes 21% more energy. So airlines would rather save fuel then reduce flight times. Drag equals the square of the increase in speed.

      --
      Sorry, teleporters just kill you and then make a copy. A perfect, soul-less copy.
    14. Re:Smartphone power by Anonymous Coward · · Score: 0

      There was a reason that Concorde only took 100 passengers, in small seats, at more than the cost of a 1st class ticket on a 747. Probably related to the laws of physics.

    15. Re:Smartphone power by Anonymous Coward · · Score: 0

      You're right. The best thing to advance social progress is a world war, or at least that's what it's taken in the past.

      Perhaps it's time for one? :S

  6. First person shooters by Anonymous Coward · · Score: 0

    This sort of stuff could be great for creating real world levels!

  7. I want this by Rei · · Score: 1

    No small amount. 123d Catch is usually broken and buggy, and being able to do terrain scans with my phone is important for me.

    Plus, I dream of the day when we can take up full 3d video on our cell phones. Not silly stereoscopy, actual 3d, with the ability to choose any perspective. With good enough quality on the 3d imager to understand transparency and reflection (which are painfully common in real life), and with a good enough software stack to assume "that which I couldn't see between times T1 and T2 is a reasonable interpolation of how it looked and where it was positioned between these two timepoints". Plus the ability to knit together multiple people's recorded 3d data into a single scene.

    Recording full 3d data may sound like a huge recording, but actually when you think about it it's not really, the geometry and texture of scenes doesn't change that much between frames in the real world; most objects are static. And the macroscopic changes should be readily subject to compression. Within a decade or two of 3d video algorithm refinement I could envision the results being smaller than a 2d recording of the same scene.

    But anyway that's all "gee whiz wouldn't that be neat" stuff... right now, I just want to be able to scan landscapes on my phone better than 123D Catch can do. :P

    --
    Trump's plan to get rid of Mueller appears to be 'be so guilty of so many things that Mueller works himself to death.'
    1. Re:I want this by ColdWetDog · · Score: 1

      You're actually using 123D Catch to 'scan' a landscape? Does it even work at all? Are you then transferring them to DEM files?

      Seems like it would never be nearly accurate enough for a landscape. If so, I'm impressed.

      --
      Faster! Faster! Faster would be better!
    2. Re:I want this by Rei · · Score: 1

      Trying... so far I've only gotten little strips to work, not enough to make a coherent whole. But I've been doing it during the winter where there was snow, aka reflection... I'm hoping I'll have better luck the next time I try now that the snow is melted.

      --
      Trump's plan to get rid of Mueller appears to be 'be so guilty of so many things that Mueller works himself to death.'
  8. cost in R&D is not cost in production by Goldsmith · · Score: 1

    When you have a team of PhDs working on a project essentially for free (paid for by the government, not CalTech), in a subsidized (nearly free) clean room, on a device where yield doesn't really matter, "cost" tends to not be realistically estimated.

    It is not more realistic to estimate the cost by looking at the actual money spent by all sources on the project. That's likely a couple hundred thousand dollars on this one (or so) chip, but most of that is NRE.

    When someone tries to fit this into a commercial process and figures out what custom processes are required, we'll find out what the real cost is. It may be $1000/chip, and that may still be very marketable.

    1. Re:cost in R&D is not cost in production by Anonymous Coward · · Score: 0

      When someone tries to fit this into a commercial process and figures out what custom processes are required, we'll find out what the real cost is. It may be $1000/chip, and that may still be very marketable.

      And then Moore's Law takes over and in 10 years it'll cost 50 cents and will be included free in specially marked cereal boxes.

    2. Re:cost in R&D is not cost in production by ColdWetDog · · Score: 1

      And then Moore's Law takes over and in 10 years it'll cost 50 cents and will be included free in specially marked cereal boxes.

      In 10 years it will be part of the cereal itself. Increased fiber and a free colonoscopy by dinner time. The future of American medicine.

      --
      Faster! Faster! Faster would be better!
    3. Re:cost in R&D is not cost in production by Anonymous Coward · · Score: 0

      The R&D for the technology in this article was originally done by defense contractors which then sold the resulting technology to the US military.So the government basically funded the technology. The original device was about the size of a shoe box with a price tag of around $150,000. Since then the chip technology has gotten even better with the chip being able to recognize single photons size and process the information 4 times faster. The price of the device has dropped to around $20,000 in 5 years and is on the verge of becoming even cheaper as the automotive industry works with the 2 primary firms that have licensed the technology.Just like the first optical receiver developed using indium gallium arsenide to provide high-speed telecom networks started out costing $5,000 and in just a few years the price dropped to $10,

  9. Lidar ! = Acronym by Guy+From+V · · Score: 1

    Lidar isn't an acronym, its a compound word from light and radar (radar isn't an acronym anymore either).

    1. Re:Lidar ! = Acronym by oodaloop · · Score: 4, Informative

      Bookworm is a compound word (book + worm = bookworm). Lidar is a portmanteau, like spork or satisfice. Lidar is now a backronym for Light Detection and Ranging.

      --
      Tic-Tac-Toe, Global Thermonuclear War, and relationships all have the same winning move.
    2. Re:Lidar ! = Acronym by Anonymous Coward · · Score: 0

      Thank you, Portmanteau Internet Defense Force.

  10. The Dark Knight by Anonymous Coward · · Score: 0

    Did anyone else think of the massive cellphone surveillance system from The Dark Knight? Imagine that technology in the hands of [insert the usual: NSA, oppressive government, police, hackers, ...].

  11. 3D sensing? by Anonymous Coward · · Score: 0

    "I am sensing a third dimension nearby. It is definitely not 2D nor 4D. It is certainly 3D."

    1. Re: 3D sensing? by Anonymous Coward · · Score: 0

      if it could sense 2D or 4D now THAT would be something

  12. The Cellphone imaging system from Batman movie by Anonymous Coward · · Score: 0

    This will pretty much make the fictional room imaging from that Batman movie doable.

    So now the Feds won't just know where you are, but they'll have a map too.

  13. JotNot Really, Really Pro by Applehu+Akbar · · Score: 1

    I use one of those iPhone apps that lets me scan documents with the phone, emitting a PDF that's just as good as the ones I used to need a flatbed scanner to get. When I need to scan a book chapter at the library or surreptitiously copy someone else's document, no more having to arrange to bring it home to be scanned.

    LIDAR would extend this concept to 3-D output. Most of us don't have 3-D printers at home, and would have no use for one that just works in cheesy plastic. But imagine being able to email a 3-D spec file you scanned in the field to a service that would print, say, a replica of the gold ring you liked at the jewelry store. Not cheap, but a lot better than paying retail markup.

    1. Re: JotNot Really, Really Pro by Anonymous Coward · · Score: 0

      I gotta say this but... PHONES WITH CAMERAS BUILTIN HAVE LENSES TOO SMALL FOR SERIOUS PHOTOGRAPHY.
      It would seem to me if someone wants to imrove the photography industry, wtf are they dicking around with phones????
      Take 123D catch. Lame lame lame. If that stupid crap ap was worth a twat, anyone would be able to take pics with any camera, upload pics (or process local), and get results.
      If anything, make the fucking lenses bigger. To hell with all this james bond for kids crap dumbshit phone aps.

    2. Re: JotNot Really, Really Pro by Applehu+Akbar · · Score: 1

      Of course I bring out the big Olympus when I'm hiking and need to zoom through landscapes or to macro in on tiny flowers, or to do anything that only a lot of pixels can handle. But an 8MP cell camera works just fine for street shooting because it's "invisible" socially. In situations where a big camera stands between me and the subject, people tend to freeze up and can even get suspicious of a photographer. Phones are so ubiquitous that nobody needs to be aware you are using one.

      If Henri Cartier-Bresson were alive today, he would be shooting on an iPhone.

    3. Re: JotNot Really, Really Pro by kylemonger · · Score: 1

      There's no way HCB would be using an iPhone as a camera; he'd be shooting with one of the digital Leicas. A dedicated camera just crushes an iPhone in terms of ease of use and image quality for any kind of serious photography.

    4. Re: JotNot Really, Really Pro by Anonymous Coward · · Score: 0

      This was interesting to read about and watch.

      http://www.bbc.com/news/technology-31747911

      How the BBC filmed a show on mobile phones and edited it on iPad and Surface Pro 3.

    5. Re: JotNot Really, Really Pro by Bob+the+Super+Hamste · · Score: 1

      Unfortunately most people won't understand that there are different tools for different jobs. I remember seeing something on the BBC about a year ago where one of their reporters would use their cellphone camera when doing an interview for exactly the reason you mention, so it woudl seem reasonable to assume that Henri Cartier-Bresson would have used a cell phone camera. It is socially invisible where as a large video camera or still camera wouldn't be. For me having the big camera and proper equipment has opened up some opportunities that I might not have been able to get otherwise. Going to historic places off the beaten path and bringing it I have had offers to go to areas that are off limits to the general public.

      I say this as someone who hasn't made the transition to digital and uses a camera that is at least 39 years old (the last one was made in the middle of 1976) and has been made fun of by numerous people for using an antique while they use their iPhones. The quickest way to put an end to that was to put on one of my large lenses when on top of Mount of Olives and show them that I could capture a full frame shot of Dome of the Rock and see the fine detail on the building, get out the macro tubes and show them a close up of a tiny flour, or get out a wide angle lens and use it in a narrow road or next to a tall building. Then again I like film and my old Pentax Spotmatic F so when it dies I will probably make the jump to an older film Hasselblad since I will have to start over with entirely different gear anyway.

      --
      Time to offend someone
  14. Self-Driving Pedestrians by trenobus · · Score: 2

    Just imagine, there could be a phone app that displays an arrow to show the user which way to walk. Using the Lidar to detect obstacles, the app could enable a phone zombie to become almost self-driving, avoiding obstacles and other people. Almost like a real person.

  15. Caltech by Anonymous Coward · · Score: 0

    It's Caltech, not CalTech, MotherFuckers. Do your research.

  16. For a smartphone a TOF camera could be more suited by Cochonou · · Score: 2

    For a smartphones, I'd rather expect so-called "time of flight" cameras to catch-up before LIDARs. Basically, you have an array of LEDs which illuminate the scene using sine or square wave intensity modulation. The imager works at a high framerate (or uses other windowing techniques) to extract the phase shift in each pixel, which gives you 2D ranging information. Of course, there is still the problem of phase unwrapping.
    So in this kind of system, you trade off dynamic range for accuracy and cost. As most measurements with smartphones will probably be performed at short distance, this system seems more suitable than regular LIDARs.

  17. Aircraft speed. by stoatwblr · · Score: 1

    Firstly: Try catching a concorde flight today.

    Secondly: All new-design contemporary turbofan jet aircraft travel slightly SLOWER than their turbojet predecessors (0.85–0.855 for a 747-400 instead of 0.89-0.91 for turbojet designs such as the Convair 900 and Boeing 707 - the 747 has always been a turbofan engine aircraft). Going faster than this has severe fuel penalties as it causes major issue with the fixed-pitch fans (and the larger the fan the lower the top speed).

    There's a push to make civil transports slightly slower still for fuel economy purposes (bigger fans == greater efficiency/thrust but lower optimal speed as noted above). Having said that, the journey times are slightly faster because higher thrust levels mean that newer aircraft (or re-engined versions of old designs such as the 747) spend less time accelerating to cruise speed and altitude. In addition the higher thrust levels mean that the aircraft can carry far more passengers than original designs at the same or lower overall fuel consumption (same latency, bigger pipes)

    Believe it or not, the big thing currently keeping speeds high is wing sweep. The "traditional" sweep on a jet transport was "set in stone" in 707-727 days and is optimised for near-transonic speeds. It's inefficient at the actual high-subsonic 0.8-0.85 speeds travelled at today - with inefficiency increasing as speed goes down (and of course, swept wings have nasty low speed stall characteristics plus they're a major contributor to the height limitations of current transport aircraft for the same reason - stall characteristics in thin air/high speed - aka "coffin corner", exacerbated by speed limits imposed by the use of fans for thrust instead of pure turbojet)

    Reegnineering the 747 or other classic designs for a lesser sweep is a no-go area. There's been a lot of resistance within the industry to "de-sweep" wings as it's felt that passengers will associate this with turboprops, but this is a concept which _will_ happen with increasing emphasis on fuel consumption.

    Several industry magazines have postulated that the ideal cruisng speed for future civil transports is likely to be in the 0.78-0.80 range, although there's a possibility that higher altitudes will be involved too (going above ~45,000 feet brings ozone into the cabin. This needs mitigation) To get there _will_ require much straighter wings than we currently see. Whether passengers like it will probably not matter in the end.

  18. Re:For a smartphone a TOF camera could be more sui by bensch128 · · Score: 1

    For a smartphones, I'd rather expect so-called "time of flight" cameras to catch-up before LIDARs. Basically, you have an array of LEDs which illuminate the scene using sine or square wave intensity modulation. .

    Unfortunately, emitted IR signals outside get too corrupted for ranges farther then 10m or so.
    I'm not sure about indoors but I can't find any ToF system that can go farther then 10m.
    Light Field cameras almost seem useful but they have their own limitations.
    Lidar is the only reasonable way to obtain depth information over long distances. And it's accurate too.
    ToF does work ok for short distances though, AFAIK