Slashdot Mirror


Tiny LIDAR Chip Could Add Cheap 3D Sensing to Cellphones and Tablets

There are expensive dedicated devices that do 3D scanning (like the high-end tablet in Google's Project Tango), and versatile but bulky add-ons, like the Sense from 3D Systems, but it's not a capability built into the typical cellphone or tablet. That could change, thanks to a microsensor being prototyped now (at low resolution) at CalTech. From The Verge's coverage: The tiny chip, called a nanophotonic coherent imager, uses a form of LIDAR (Light Detection And Ranging) technology to capture height, width, and depth information from each pixel. LIDAR, which shines a laser on the target and then analyzes the light waves that are reflected back to the sensor, are best known for their use in precision-guided missile systems and self-driving cars.

While LIDAR itself isn't new, [project lead Ali] Hajimiri explains that "by having an array of tiny LIDARs on our coherent imager, we can simultaneously image different parts of an object or a scene without the need for any mechanical movements within the imager." Each "pixel" on the new sensor can individually analyze the phase, frequency, and intensity of the reflected waves, producing a single piece of 3D data. The data from all of the pixels combined can produce a full 3D scan. In addition, the researchers' implementation allows for an incredibly tiny and low-cost scanner, all while maintaining accuracy. According to the researchers, the chip can produce scans that are within microns of the original.

33 of 62 comments (clear)

  1. 3D Porn by Anonymous Coward · · Score: 1

    You can bet the porn industry is the first to take advantage of this

    1. Re:3D Porn by Holi · · Score: 1

      Thigh gap? do you really like anorexic women?

      --
      Sorry, teleporters just kill you and then make a copy. A perfect, soul-less copy.
  2. Needed for automated cars. by HornWumpus · · Score: 1

    In phones, maybe. But automated cars, obvious application.

    --
    John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
    1. Re:Needed for automated cars. by HornWumpus · · Score: 1

      So do Google cars. Those LIDaRs cost $20K/car.

      --
      John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
    2. Re:Needed for automated cars. by HornWumpus · · Score: 1

      LIDaRs are not custom, one off. They are off the shelf, added to custom, small batch (not one off), automated car projects.

      --
      John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
    3. Re:Needed for automated cars. by Applehu+Akbar · · Score: 2

      I used to make those spinning mirrors and yes, this new tech is a huge step.

    4. Re:Needed for automated cars. by peragrin · · Score: 1

      Drones is the obvious use actually. The next ar parrot will be able to do indoor mapping. Heck even if data collection and processing needs to be offloaded rescue, fire, hostage negotiations even real estate could all benefit.

      --
      i thought once I was found, but it was only a dream.
    5. Re:Needed for automated cars. by camperdave · · Score: 1

      A snakebot traversing collapsed buildings could buld a 3D map using this tech.

      --
      When our name is on the back of your car, we're behind you all the way!
    6. Re:Needed for automated cars. by bensch128 · · Score: 1

      Those LIDaRs cost $20K/car.

      Or more. They can be high tens to hundreds of thousands of dollars depending on the brand and model.

      This is a big deal if they can get it right...

  3. Imager only by wasteoid · · Score: 1

    This is the imager only, the sensor, not the part that sends out the lasers. You still need laser emitters to use with the sensor.

  4. Smartphone power by Twinbee · · Score: 3, Interesting

    Honestly, it's insane how ludicrously powerful phones are getting. I meant take this one article for example - 4K 120fps slow-motion video recording is coming to smartphones in 2016.

    4K videoing at 120fps?! From a smartphone?

    Isn't progress wonderful.

    --
    Why OpalCalc is the best Windows calc
    1. Re:Smartphone power by Rei · · Score: 2

      Still tiny apertures, though :(

      I'll take more light coming into the sensor over high frame rates and pixel counts any day.

      --
      Trump's plan to get rid of Mueller appears to be 'be so guilty of so many things that Mueller works himself to death.'
    2. Re:Smartphone power by Anonymous Coward · · Score: 2, Informative

      Sure, as long as you're happy with progress only in information processing. How long does it take a passenger plane to fly over the Atlantic? Same as in 1969, the year of the maiden flight of the Boeing 747.

      We have no social progress towards a leisure society for all, even though all your "progress" is only used to make the rich richer.

      Keep playing with your phone while you're being robbed.

    3. Re:Smartphone power by ckatko · · Score: 3, Informative

      That's entirely false. Once an senor is reading at 100% of the time for a given interval, the only thing you can do is increase the time interval, which means any movement causes blur because you're averaging more time into a single image.

      There is no replacement for sensor size and lens quality. Read what an airy disc is. None. You cannot violate physics with a PR campaign.

    4. Re:Smartphone power by peragrin · · Score: 2

      Not quite true. Current 747 have a higher cruise speed and reduced fuel usage compared to the 1969 model. It isn't breathe taking difference but it does exist. Basically all new business jets run at mach .95 instead of the mach .6-.7 of 30 years ago. Why not faster well fuel usage goes up, and viable flight paths go down due to supersonic restriction laws.

      Like batteries we are at limits of chemical energy storage. Even hyper velocities are tough to maintain at a practical level. Improvements are only coming slowly. Without a major energy breakthrough we are going to be hitting some major roadblocks in the future.

      --
      i thought once I was found, but it was only a dream.
    5. Re:Smartphone power by camperdave · · Score: 1

      Ever hear of the Concorde? It took far less time to cross the Atlantic as a 747. Must have been breaking those physics you're talking about.

      --
      When our name is on the back of your car, we're behind you all the way!
    6. Re:Smartphone power by Bob+the+Super+Hamste · · Score: 1

      I would include the megapixel count in that PR campaign now. All of the compact point and shoot digital cameras are diffraction limited with their 1/2.3" sensors and silly pixel counts. I recently purchased a new camera for my wife (the digital camera she was using gave up the ghost) and was inundated with the lie that more pixels are better by the "helpful" sales staff. Thus far I haven't found a shibboleth that will let them know I know what I am doing and to go the hell away. Since my wife wants a camera for taking pictures of the kids fast image acquisition and focus speed are the points that differentiate one camera from another but try explaining that to the useless clerk. Sadly the best digital camera we own, going by image quality alone, is the first one we ever got about 12 years ago that strangely still works. It is only 8 megapixels and takes those awful XD cards but has a larger better quality lens, and a larger sensor but it is slow to focus, and slow to write. Also for a different take on the airy disc and what it means to photography there is this page that shows some real world effects.

      I wouldn't get too worked up about cameras most people use they aren't great and will likely never capture great photos that will win awards and be in books. That isn't want people want, they want something that will capture reasonable pictures of their kids first birthday party. On the professional end there are the good DSLRs that wedding photographers and studios use with proper lighting. Finally you have the people who do photography as art and there you see film and digital being used but it is a personal preference at that point, not a technical decision. Personally I like film, I started with film, I learned on film, I understand how film behaves, and I have a camera that doesn't try to do what it wants instead of what I want, no automatic anything,

      --
      Time to offend someone
    7. Re:Smartphone power by Holi · · Score: 1

      Anything to back that up with? Because everything I have seen seems to explain why speeds haven't changed and that to increase speed by say 10% takes 21% more energy. So airlines would rather save fuel then reduce flight times. Drag equals the square of the increase in speed.

      --
      Sorry, teleporters just kill you and then make a copy. A perfect, soul-less copy.
  5. I want this by Rei · · Score: 1

    No small amount. 123d Catch is usually broken and buggy, and being able to do terrain scans with my phone is important for me.

    Plus, I dream of the day when we can take up full 3d video on our cell phones. Not silly stereoscopy, actual 3d, with the ability to choose any perspective. With good enough quality on the 3d imager to understand transparency and reflection (which are painfully common in real life), and with a good enough software stack to assume "that which I couldn't see between times T1 and T2 is a reasonable interpolation of how it looked and where it was positioned between these two timepoints". Plus the ability to knit together multiple people's recorded 3d data into a single scene.

    Recording full 3d data may sound like a huge recording, but actually when you think about it it's not really, the geometry and texture of scenes doesn't change that much between frames in the real world; most objects are static. And the macroscopic changes should be readily subject to compression. Within a decade or two of 3d video algorithm refinement I could envision the results being smaller than a 2d recording of the same scene.

    But anyway that's all "gee whiz wouldn't that be neat" stuff... right now, I just want to be able to scan landscapes on my phone better than 123D Catch can do. :P

    --
    Trump's plan to get rid of Mueller appears to be 'be so guilty of so many things that Mueller works himself to death.'
    1. Re:I want this by ColdWetDog · · Score: 1

      You're actually using 123D Catch to 'scan' a landscape? Does it even work at all? Are you then transferring them to DEM files?

      Seems like it would never be nearly accurate enough for a landscape. If so, I'm impressed.

      --
      Faster! Faster! Faster would be better!
    2. Re:I want this by Rei · · Score: 1

      Trying... so far I've only gotten little strips to work, not enough to make a coherent whole. But I've been doing it during the winter where there was snow, aka reflection... I'm hoping I'll have better luck the next time I try now that the snow is melted.

      --
      Trump's plan to get rid of Mueller appears to be 'be so guilty of so many things that Mueller works himself to death.'
  6. cost in R&D is not cost in production by Goldsmith · · Score: 1

    When you have a team of PhDs working on a project essentially for free (paid for by the government, not CalTech), in a subsidized (nearly free) clean room, on a device where yield doesn't really matter, "cost" tends to not be realistically estimated.

    It is not more realistic to estimate the cost by looking at the actual money spent by all sources on the project. That's likely a couple hundred thousand dollars on this one (or so) chip, but most of that is NRE.

    When someone tries to fit this into a commercial process and figures out what custom processes are required, we'll find out what the real cost is. It may be $1000/chip, and that may still be very marketable.

    1. Re:cost in R&D is not cost in production by ColdWetDog · · Score: 1

      And then Moore's Law takes over and in 10 years it'll cost 50 cents and will be included free in specially marked cereal boxes.

      In 10 years it will be part of the cereal itself. Increased fiber and a free colonoscopy by dinner time. The future of American medicine.

      --
      Faster! Faster! Faster would be better!
  7. Lidar ! = Acronym by Guy+From+V · · Score: 1

    Lidar isn't an acronym, its a compound word from light and radar (radar isn't an acronym anymore either).

    1. Re:Lidar ! = Acronym by oodaloop · · Score: 4, Informative

      Bookworm is a compound word (book + worm = bookworm). Lidar is a portmanteau, like spork or satisfice. Lidar is now a backronym for Light Detection and Ranging.

      --
      Tic-Tac-Toe, Global Thermonuclear War, and relationships all have the same winning move.
  8. JotNot Really, Really Pro by Applehu+Akbar · · Score: 1

    I use one of those iPhone apps that lets me scan documents with the phone, emitting a PDF that's just as good as the ones I used to need a flatbed scanner to get. When I need to scan a book chapter at the library or surreptitiously copy someone else's document, no more having to arrange to bring it home to be scanned.

    LIDAR would extend this concept to 3-D output. Most of us don't have 3-D printers at home, and would have no use for one that just works in cheesy plastic. But imagine being able to email a 3-D spec file you scanned in the field to a service that would print, say, a replica of the gold ring you liked at the jewelry store. Not cheap, but a lot better than paying retail markup.

    1. Re: JotNot Really, Really Pro by Applehu+Akbar · · Score: 1

      Of course I bring out the big Olympus when I'm hiking and need to zoom through landscapes or to macro in on tiny flowers, or to do anything that only a lot of pixels can handle. But an 8MP cell camera works just fine for street shooting because it's "invisible" socially. In situations where a big camera stands between me and the subject, people tend to freeze up and can even get suspicious of a photographer. Phones are so ubiquitous that nobody needs to be aware you are using one.

      If Henri Cartier-Bresson were alive today, he would be shooting on an iPhone.

    2. Re: JotNot Really, Really Pro by kylemonger · · Score: 1

      There's no way HCB would be using an iPhone as a camera; he'd be shooting with one of the digital Leicas. A dedicated camera just crushes an iPhone in terms of ease of use and image quality for any kind of serious photography.

    3. Re: JotNot Really, Really Pro by Bob+the+Super+Hamste · · Score: 1

      Unfortunately most people won't understand that there are different tools for different jobs. I remember seeing something on the BBC about a year ago where one of their reporters would use their cellphone camera when doing an interview for exactly the reason you mention, so it woudl seem reasonable to assume that Henri Cartier-Bresson would have used a cell phone camera. It is socially invisible where as a large video camera or still camera wouldn't be. For me having the big camera and proper equipment has opened up some opportunities that I might not have been able to get otherwise. Going to historic places off the beaten path and bringing it I have had offers to go to areas that are off limits to the general public.

      I say this as someone who hasn't made the transition to digital and uses a camera that is at least 39 years old (the last one was made in the middle of 1976) and has been made fun of by numerous people for using an antique while they use their iPhones. The quickest way to put an end to that was to put on one of my large lenses when on top of Mount of Olives and show them that I could capture a full frame shot of Dome of the Rock and see the fine detail on the building, get out the macro tubes and show them a close up of a tiny flour, or get out a wide angle lens and use it in a narrow road or next to a tall building. Then again I like film and my old Pentax Spotmatic F so when it dies I will probably make the jump to an older film Hasselblad since I will have to start over with entirely different gear anyway.

      --
      Time to offend someone
  9. Self-Driving Pedestrians by trenobus · · Score: 2

    Just imagine, there could be a phone app that displays an arrow to show the user which way to walk. Using the Lidar to detect obstacles, the app could enable a phone zombie to become almost self-driving, avoiding obstacles and other people. Almost like a real person.

  10. For a smartphone a TOF camera could be more suited by Cochonou · · Score: 2

    For a smartphones, I'd rather expect so-called "time of flight" cameras to catch-up before LIDARs. Basically, you have an array of LEDs which illuminate the scene using sine or square wave intensity modulation. The imager works at a high framerate (or uses other windowing techniques) to extract the phase shift in each pixel, which gives you 2D ranging information. Of course, there is still the problem of phase unwrapping.
    So in this kind of system, you trade off dynamic range for accuracy and cost. As most measurements with smartphones will probably be performed at short distance, this system seems more suitable than regular LIDARs.

  11. Aircraft speed. by stoatwblr · · Score: 1

    Firstly: Try catching a concorde flight today.

    Secondly: All new-design contemporary turbofan jet aircraft travel slightly SLOWER than their turbojet predecessors (0.85–0.855 for a 747-400 instead of 0.89-0.91 for turbojet designs such as the Convair 900 and Boeing 707 - the 747 has always been a turbofan engine aircraft). Going faster than this has severe fuel penalties as it causes major issue with the fixed-pitch fans (and the larger the fan the lower the top speed).

    There's a push to make civil transports slightly slower still for fuel economy purposes (bigger fans == greater efficiency/thrust but lower optimal speed as noted above). Having said that, the journey times are slightly faster because higher thrust levels mean that newer aircraft (or re-engined versions of old designs such as the 747) spend less time accelerating to cruise speed and altitude. In addition the higher thrust levels mean that the aircraft can carry far more passengers than original designs at the same or lower overall fuel consumption (same latency, bigger pipes)

    Believe it or not, the big thing currently keeping speeds high is wing sweep. The "traditional" sweep on a jet transport was "set in stone" in 707-727 days and is optimised for near-transonic speeds. It's inefficient at the actual high-subsonic 0.8-0.85 speeds travelled at today - with inefficiency increasing as speed goes down (and of course, swept wings have nasty low speed stall characteristics plus they're a major contributor to the height limitations of current transport aircraft for the same reason - stall characteristics in thin air/high speed - aka "coffin corner", exacerbated by speed limits imposed by the use of fans for thrust instead of pure turbojet)

    Reegnineering the 747 or other classic designs for a lesser sweep is a no-go area. There's been a lot of resistance within the industry to "de-sweep" wings as it's felt that passengers will associate this with turboprops, but this is a concept which _will_ happen with increasing emphasis on fuel consumption.

    Several industry magazines have postulated that the ideal cruisng speed for future civil transports is likely to be in the 0.78-0.80 range, although there's a possibility that higher altitudes will be involved too (going above ~45,000 feet brings ozone into the cabin. This needs mitigation) To get there _will_ require much straighter wings than we currently see. Whether passengers like it will probably not matter in the end.

  12. Re:For a smartphone a TOF camera could be more sui by bensch128 · · Score: 1

    For a smartphones, I'd rather expect so-called "time of flight" cameras to catch-up before LIDARs. Basically, you have an array of LEDs which illuminate the scene using sine or square wave intensity modulation. .

    Unfortunately, emitted IR signals outside get too corrupted for ranges farther then 10m or so.
    I'm not sure about indoors but I can't find any ToF system that can go farther then 10m.
    Light Field cameras almost seem useful but they have their own limitations.
    Lidar is the only reasonable way to obtain depth information over long distances. And it's accurate too.
    ToF does work ok for short distances though, AFAIK