Slashdot Mirror


Man Says CES Lidar's Laser Was So Powerful It Wrecked His Camera (arstechnica.com)

An anonymous reader quotes a report from Ars Technica: A man attending this week's CES show in Las Vegas says that a lidar sensor from startup AEye has permanently damaged the sensor on his $1,998 Sony camera. Earlier this week, roboticist and entrepreneur Jit Ray Chowdhury snapped photos of a car at CES with AEye's lidar units on top. He discovered that every subsequent picture he took was marred by two bright purple spots, with horizontal and vertical lines emanating from them. "I noticed that all my pictures were having that spot," he told Ars by phone on Thursday evening. "I covered up the camera with the lens cap and the spots are there -- it's burned into the sensor." In an email to Ars Technica, AEye CEO Luis Dussan confirmed that AEye's lidars can cause damage to camera sensors -- though he stressed that they pose no danger to human eyes. "Cameras are up to 1000x more sensitive to lasers than eyeballs," Dussan wrote. "Occasionally, this can cause thermal damage to a camera's focal plane array." Chowdhury says that AEye has offered to buy him a new camera. The potential issue is that self-driving cars also rely on conventional cameras. "So if those lidars are not camera-safe, it won't just create a headache for people snapping pictures with handheld camera," reports Ars. "Lidar sensors could also damage the cameras on other self-driving cars."

"It's worth noting that companies like Alphabet's Waymo and GM's Cruise have been testing dozens of vehicles with lidar on public streets for more than a year," adds Ars. "People have taken many pictures of these cars, and as far as we know none of them have suffered camera damage. So most lidars being tested in public today do not seem to pose a significant risk to cameras."

129 comments

  1. Lies pushed by big Optometry. by Anonymous Coward · · Score: 2, Insightful

    "Cameras are up to 1000x more sensitive to lasers than eyeballs"

    and what was the shutter speed he was using? Something like one 1/500th of a second, so in 1 second the laser would do 500 times the damage it did to the camera? in 2 seconds it'd do just as much damage.

    1. Re:Lies pushed by big Optometry. by Anonymous Coward · · Score: 1

      That's assuming it works like the mythical EM sensitivity. The reality here is that the the mechanism of interaction is absent in human eyes. DSLR cameras use light detector silicon or more exotic material chips, and the circuitry was damaged by energy in a part of the spectrum that human eyes are not sensitive enough to even detect.

    2. Re: Lies pushed by big Optometry. by Anonymous Coward · · Score: 1

      No, sorry. The article says thermal damage... and silicon is -less- sensitive to thermal damage than a retina.

      The mechanism is local heating, and anyone that uses lasers for anything knows that retina damage is not only possible, but likely. That is what the type rating on a laser is about. Directly related to the optical power output.

    3. Re: Lies pushed by big Optometry. by Anonymous Coward · · Score: 0

      Except semiconductor chips using silicon depend on junctions that are MORE sensitive. GOd damn this new generation on Slashdot are fucking idiots!

    4. Re:Lies pushed by big Optometry. by GrpA · · Score: 1

      Science isn't complete unless you consider every aspect, and determining energy on a FPA is about as easy as calculating turbulence.

      Easy enough to test though. Take the camera and the car. Take more pictures. If the car damaged the camera, then more damage will occur. Even if the car did damage the camera initially, but no more damage occurs, then the camera was already in the process of failing and just waiting for the right opportunity, but most likely it would mean, beyond reasonable doubt, that the camera was not damaged by the car.

      Why argue science when a simple empirical test will give the correct answer?

      GrpA

      --
      Enjoy science fiction? "Turing Evolved" - AI, Mecha, Androids and rail-gun battles. What more could you want?
    5. Re:Lies pushed by big Optometry. by Z00L00K · · Score: 1

      Indoors photography would probably be like 1/25 to 1/125th of a second depending on light conditions.

      --
      If builders built buildings the way programmers wrote programs, then the first woodpecker would destroy civilization.
    6. Re:Lies pushed by big Optometry. by Anonymous Coward · · Score: 0

      I think the point missed is that he's using an actual DSLR, and not a cameraphone type of sensor.

      DSLR's contain lens arrays which allow the sensor to be larger and pick up more details with less noise.

      Your average camera/webcam is a simple CMOS sensor and single small lens (eg no optical zoom.)

      So it's certain that the camera was damaged, but the amount of cameras (and eyeballs) that would be damaged from this would be on the low end, only people who have had cataract surgery would possibly see something ( https://petapixel.com/2012/04/17/the-human-eye-can-see-in-ultraviolet-when-the-lens-is-removed/ )

    7. Re:Lies pushed by big Optometry. by Anonymous Coward · · Score: 1

      It is not true at all that the retina is less sensitive to light energy compared to a cmos sensor. For example try making a movie of a 50mW laser pointer beam going into the camera (not a good one obviously). It will take more than 20 seconds of exposure for most sensors before damage appears, if it does at all. On the other hand, this 50mW beam will cause a retina burn in a few tens of ms.

      I think they are using a high powered pulse system on a frequency that is not passed through the human eye, and so never reaches the retina while still being passed by the optical system of some cameras...

    8. Re:Lies pushed by big Optometry. by spth · · Score: 1

      The lidar beam sweeps the area (after all the lidar is meant to give an image of the surroundings, not just a distance measure to a single point). I don't think a human could move quickly enough to keep the beam on their eye.

      I hope lidar systems are designed fail-safe enough to not keep emitting the beam when the mirror rotation fails.

    9. Re:Lies pushed by big Optometry. by Anonymous Coward · · Score: 0

      New tool for hackers of future. Hack million cars and use their lidars to blind everyone they come across. Better than killing because living blind will cost money.

    10. Re:Lies pushed by big Optometry. by Anonymous Coward · · Score: 0

      the circuitry was damaged by energy in a part of the spectrum that human eyes are not sensitive enough to even detect.

      Just like that Star Trek episode where the flying brain cells could be killed by UV and Spock need not have been blinded because UV is so harmless to the retinas, right?

    11. Re: Lies pushed by big Optometry. by NormalVisual · · Score: 1

      Depends on the wavelength of the laser. A Nd:YAG is much more likely to cause retinal damage than a CO2 of the same power, since your cornea and lens will pass 1064 nm IR easily, but are much more opaque to 10600 nm, so you'll feel the heating/burning and blink or otherwise get out of the beam before it can do much (if any) damage to the retina. Of course, if it's a 5 MW steel cutter, you're just well and truly screwed.

      --
      Please stand clear of the doors, por favor mantenganse alejado de las puertas
    12. Re: Lies pushed by big Optometry. by TheoMurpse · · Score: 1

      dude seriously what in the fuck, does everyone have a UID >5M now?

    13. Re:Lies pushed by big Optometry. by arglebargle_xiv · · Score: 1

      Only if you're using ISO 100-400 film. With modern DSLRs you can use much faster shutter speeds than that, particularly if it was a brightly-lit CES stage.

    14. Re:Lies pushed by big Optometry. by Z00L00K · · Score: 1

      That depends on the quality of the pictures you want to get. Higher ISO means more noise and less dynamic range, which makes the pictures look flat and uninteresting.

      --
      If builders built buildings the way programmers wrote programs, then the first woodpecker would destroy civilization.
    15. Re:Lies pushed by big Optometry. by Larry+Lightbulb · · Score: 1

      Have the plans for SCORPION STARE leaked?

  2. Bullshit about eye safety. by Anonymous Coward · · Score: 2, Interesting

    If this is powerful enough to damage a CMOS/CCD sensor then it is most certainly also doing damage to biological tissue in eyeballs.

    If this is doing "thermal damage" to CMOS/CCDs, essentially chunks of glass, then it is doing more damage to biological tissues.

    1. Re:Bullshit about eye safety. by pushing-robot · · Score: 2

      The retina is submerged in a water bath while the camera sensor is surrounded by insulating air and plastic. The sensor may have a higher absolute temperature rating but it can't dissipate heat nearly as well as your retina.

      --
      How can I believe you when you tell me what I don't want to hear?
    2. Re:Bullshit about eye safety. by Bongo · · Score: 1

      Retina is normally submerged, but not when you've just had a vitrectomy and are walking around empty.

    3. Re:Bullshit about eye safety. by eclectro · · Score: 4, Informative

      Stop downplaying the dangers of laser technology. Any coherent radiation hitting they eye should be considered very dangerous. Even the cheap laser pointers have a yellow caution sticker on them!

      Here is a story about lasers blinding concert goers in Russia.

      --
      Take the cheese to sickbay, the doctor should see it as soon as possible - B'Elanna Torres, "Learning Curve"
    4. Re:Bullshit about eye safety. by pushing-robot · · Score: 1

      I'm not trying to downplay the danger of lasers in general; as the saying goes, do not stare into laser with remaining eye.

      But it is also true that localized heating will damage most camera sensors faster than the human retina. Even an 'eye-safe' laser can leave spots and streaks on CMOS and CCDs.

      --
      How can I believe you when you tell me what I don't want to hear?
    5. Re:Bullshit about eye safety. by Anonymous Coward · · Score: 0

      What doesn't have a caution sticker on it these days, some jeans come with warning labels about getting your junk caught in the zipper and Prop 65 lists the contents of your pocket change as a carcinogen (estrogen, nickel, testosterone & wood dust are some of the more humerus examples on that list).

    6. Re:Bullshit about eye safety. by PseudoAnon · · Score: 1

      I had to remove a ")" character from the end of that link to read it, but it was fascinating. Thanks for sharing it!

    7. Re:Bullshit about eye safety. by Anonymous Coward · · Score: 0

      Totally agree, especially when you consider walking down busy streets being bombarded by thousands of them per minute over the span of decades.

    8. Re:Bullshit about eye safety. by Anonymous Coward · · Score: 0

      Stop downplaying the dangers of laser technology. Any coherent radiation hitting they eye should be considered very dangerous. Even the cheap laser pointers have a yellow caution sticker on them!

      Here is a story about lasers blinding concert goers in Russia.

      corrected link: https://www.reuters.com/article/us-russia-rave/ravers-lose-sight-at-laser-show-idUSL1452972520080716

    9. Re: Bullshit about eye safety. by Anonymous Coward · · Score: 0

      I got a visectomy and I'm walking around constantly full.

    10. Re:Bullshit about eye safety. by tlhIngan · · Score: 2

      If this is powerful enough to damage a CMOS/CCD sensor then it is most certainly also doing damage to biological tissue in eyeballs.

      If this is doing "thermal damage" to CMOS/CCDs, essentially chunks of glass, then it is doing more damage to biological tissues.

      It depends on the laser. Common ones used for LIDAR is 800nm and 1550nm. 800nm can injure the eye, so its use in LIDARs and such where it might hit an eye accidentally mean its power limited to prevent damage.

      The thing with 1550nm is that it can't make it to the retina - the fluid in the eyeball is opaque to light at 1550nm, so the power limits are higher because it takes a lot more power to damage the eye when you have to go through the eyeball liquid first (and it's a lot of water so it will take a fair amount of energy before you actually cause real damage).

      Of course, camera sensors aren't filled with eyeball fluid and thus the full power of the laser will be able to destroy the sensitive pixels in the array.

    11. Re:Bullshit about eye safety. by Anonymous Coward · · Score: 0

      There is no "eye-safe" laser.

    12. Re: Bullshit about eye safety. by Anonymous Coward · · Score: 0

      Itâ(TM)s like a sippy cup lid, no matter how fast you move around, at least it wonâ(TM)t spill anymore

    13. Re:Bullshit about eye safety. by Cmdln+Daco · · Score: 1

      If you've never gotten your foreskin stuck in your zipper you've missed a new threshold of suffering. I once zipped an area of it INTO the zipper. The only way to stop the pain was to zip BACK over it to get it free.

    14. Re:Bullshit about eye safety. by hankwang · · Score: 1

      It's much more complicated than that. The silicon substrate of the image sensor has a thermal conductivity that is over 100x higher than that of water and human tissue, which more than compensates the smaller volume of material. But a high-quality camera lens can focus a laser beam much better than the eye lens, at least for visible light. The camera lens aperture (for a DSLR or mirrorless camera) is larger than that of the human eye, so it may collect more laser power, depending on the beam diameter.

    15. Re: Bullshit about eye safety. by Anonymous Coward · · Score: 0

      Try wearing underwaer

    16. Re: Bullshit about eye safety. by Aristos+Mazer · · Score: 1

      Untrue. Any coherent stream of photons is a laser, and that can be made very sparse. All a laser means is that the photons are flowing in a way that does not make them disperse.

    17. Re: Bullshit about eye safety. by Highdude702 · · Score: 1

      No shit right. After the first time that happened I decided I needed protection.

    18. Re: Bullshit about eye safety. by Anonymous Coward · · Score: 0

      Maybe if your pecker wasn't so small it wouldn't get stuck in the zipper. I freeball and have never gotten mine stuck. Also well endowed, so it hangs well below the zipper.

    19. Re: Bullshit about eye safety. by Anonymous Coward · · Score: 0

      Bandit got the edge of it's coronal ridge stuck in the pants zipper once. It got mad and started nym'ing on me, so I had to squeeze it's dome to discipline it/calm it down.

  3. Cool! by Anonymous Coward · · Score: 1

    Cool! I wonder if a powerful IR laser would also zorch speed cameras and/or surveillance cameras.

    1. Re: Cool! by Anonymous Coward · · Score: 0

      They actually can. There was someone going around a few years ago burning out cameras with a handheld laser. I think those were toll booth cameras.

  4. "as far as we know" by SlaveToTheGrind · · Score: 4, Insightful

    "People have taken many pictures of these cars, and as far as we know none of them have suffered camera damage. So most lidars being tested in public today do not seem to pose a significant risk to cameras."

    Or maybe, just maybe, this was one of the few instances where (1) camera damage happened; (2) the camera owner realized the damage must have been due to snapping a picture of a self-driving car; and (3) the camera owner knew who owned the self-driving car so they could complain?

    1. Re:"as far as we know" by somenickname · · Score: 1

      More likely these guys dialed it up to 11 for CES demos and got caught.

    2. Re:"as far as we know" by Dayze!Confused · · Score: 3, Interesting

      It's pretty obvious which picture it is when 1-100 are good, picture 101 has two dots and a self driving car, and pictures 102 and beyond have that too. Anyone with a camera who detects that problem would go back through their photos and find 101, and self driving cars aren't being sold to the masses yet, it would be easy to track down who owns it; it's not one of millions of individuals, it's one of a handful of companies licensed to operate them.

      --
      "All tyranny needs to gain a foothold is for people of good conscience to remain silent." [Thomas Jefferson]
    3. Re:"as far as we know" by SlaveToTheGrind · · Score: 1

      picture 101 has two dots

      Assuming every incidence of lidar damage to a digital camera is this extreme and well-defined. That seems like it would have a lot to do with the angle the light hit the lens, the distance from the car, the focal length of the beam, and so on.

      and a self driving car

      Which apparently the average Joe would immediately deduce from the big banner reading "SELF DRIVING" on the side?

    4. Re:"as far as we know" by jrumney · · Score: 1

      Or, the guy deliberately pointed his camera directly at the laser at short range hoping to see it.

    5. Re:"as far as we know" by Kjella · · Score: 1

      Well since it's a mirrorless camera the sensor doesn't have to be damaged by taking a picture, it's constantly exposing. So if the camera is say on a tripod pointing towards an intersection and you're busy fiddling with some camera settings it could easily be that this car stops at the intersection, damages your sensor - I assume it takes more than one burst, that it's the laser pound the same spot - and drives on before you take a photo. Heck, if you're wrapping up your shoot you might not even notice until you get home or the next time you use the camera. This time the culprit was obviously, but it might not be so every time.

      --
      Live today, because you never know what tomorrow brings
    6. Re:"as far as we know" by Anonymous Coward · · Score: 0

      Why would they need to turn up the laser power for CES demos? The laser is invisible to the human eye, so it isn't like anyone can see it.

      It is likely this camera got damaged because the photographer was using a zoom lens to get good photos, which amplified the effects of the laser, and quite possible has the camera pointed at the car for some time.

    7. Re:"as far as we know" by Anonymous Coward · · Score: 0

      Why would they need to turn up the laser power for CES demos? The laser is invisible to the human eye, so it isn't like anyone can see it.

      Well, for radio equipment there are regulations for how much you are allowed to emit.
      I would assume that the same goes for lasers and if there aren't any rules for that frequency there should be since you can damage people and/or equipment otherwise.

    8. Re:"as far as we know" by freeze128 · · Score: 1

      When your cellphone cannot reach a cell tower, it turns up the gain on the radio to try to make contact. Maybe there is a similar effect with the lidar. Since it was at CES (I don't know if it was indoor or outdoor), maybe the crowd or enclosed space was way too different from what the vehicle was expecting, and was unable to get a solid image. Turning up the gain on the laser may have been some kind of built-in compensation.

  5. Responsibility. by msauve · · Score: 1, Interesting

    A camera should withstand being pointed at the sun. If something puts out more power and damages a camera, shame (and liability) on them.

    Broadcasting light interference is no different than broadcasting radio interference (in terms of responsibility, not physics).

    --
    "National Security is the chief cause of national insecurity." - Celine's First Law
    1. Re:Responsibility. by Anonymous Coward · · Score: 4, Informative

      Eyes don't withstand being pointed at the sun for very long. Neither do most cameras.

    2. Re:Responsibility. by Anonymous Coward · · Score: 1

      A camera should withstand being pointed at the sun. If something puts out more power and damages a camera, shame (and liability) on them.
       

      In the good old days if you pointed any reflex camera, in fact any camera directly at the sun it would burn the camera's shutter. What makes you think if you pointed a digital reflex directly at the sun the sun wouldn't damage the sensor ?

    3. Re: Responsibility. by Anonymous Coward · · Score: 0

      I particularly enjoyed the very brief mention of AEye replacing the camera. I didnt see anything about posing for pictures or the company mission statement

    4. Re:Responsibility. by Anonymous Coward · · Score: 0

      check this out. https://petapixel.com/2017/08/19/shooting-sun-without-filter-can-melt-dslr/

    5. Re:Responsibility. by Anonymous Coward · · Score: 0

      Why would that be the case? In pinch you can use that same DSLR lens to start a fire. If you've got one that has a tripod ring it works really well with the only downside being that you'll likely wind up with dust that you'll need to clean off next time you want to take photos.

      Since there's enough energy in those photons to start a fire, then on what basis do you think that focusing that same energy onto the sensor isn't going to do damage to the sensor, the shutter and your eye?

      And as others have said, staring at the sun can and does result in permanent damage. You might not notice it at first, but that doesn't mean there's been no harm done. It can sometimes take time before the damage becomes apparent.

    6. Re:Responsibility. by thegarbz · · Score: 2

      A camera should withstand being pointed at the sun.

      a) why? It's not what they are designed for.
      b) sun happily damages cameras too, it all depends on exposure.

      Broadcasting light interference is no different than broadcasting radio interference (in terms of responsibility, not physics).

      Which is why we have part 15 of the FCC rules. You will accept the interference and you will like it.

    7. Re:Responsibility. by Cmdln+Daco · · Score: 1

      Part 15 applies to narrow bands of the spectrum. Small 'free for all' bands. Said equipment MUST only radiate within that band. Equipment that produces harmonic radiation outside that band is prohibited.

    8. Re:Responsibility. by thogard · · Score: 2

      Lasers are controlled in the US by 21 CFR 1040 and have been for a very long time. There is a odd loop hole in that if you if have your laser hit a lens that spreads out the beam so that at the end of the laser is larger than an eyeball, it can deliver far more power even if the beam is much smaller far away. Some early traffic speed lasers took advantage of that. The ANSI standard has the same problem. They should require the test at the end of the laser and 100 meters away.

    9. Re:Responsibility. by thegarbz · · Score: 1

      Part 15 applies to narrow bands of the spectrum.

      It does not. Several subparts to part 15 apply to broad spectrum, and unlicensed spectrum. Your post is only correct for some clauses of Part 15.

      Some parts definitely do apply to narrow bands of the spectrum. But quite critically Part 15 in a general case for an non-intentional radiator (reads consumer electronics) specifically says it must accept interference without any specification to the interference's spectrum. So the idea of having the FCC regulate this the same way as they would the radio spectrum would result in no change. Cameras would still be allowed to be damaged by lasers.

  6. Not just cameras by ColaMan · · Score: 4, Interesting

    When I use multiple LIDARs on a machine their beam sweep has to be synchronised otherwise the reflections of one beam can interfere with the other.

    I'm waiting to see what happens with a freeway full of cars with LIDARs, all flinging their beams at each other willy-nilly with direct beams and reflections all over the place. If you're unlucky you'll get a beam from another vehicle just after yours has sent a pulse out - resulting in a false return showing something right in front of you.

    I'm guessing that most of the time with enough units around you all you'd get is the equivalent of "static" on your laser sweeps, where you briefly get invalid results for a few degrees of sweep. If you're really unlucky, you blind your sensor, temporarily (bad), or permanently damage it (bad and expensive).

    --

    You are in a twisty maze of processor lines, all alike.
    There is a lot of hype here.
    1. Re:Not just cameras by Anonymous Coward · · Score: 0

      When I use multiple LIDARs on a machine their beam sweep has to be synchronised otherwise the reflections of one beam can interfere with the other.

      This isn't an issue for any decent LIDAR. They have a very low duty cycle time and only LIDARs that are in close proximity to one another have to worry about interference from returns from other devices. In practice, this is a solved problem.

    2. Re:Not just cameras by somenickname · · Score: 2

      Your "static" scenario is exactly what will happen with AM pulsed lidar. It's (one of many) dirty secrets of the lidar industry: AM lidar doesn't scale. There are alternative ways to do lidar (FMCW for one) that can scale much, much better but, these kinds of systems are still a bit expensive and so won't see widespread adoption for a few years.

    3. Re:Not just cameras by Anonymous Coward · · Score: 0

      Furthermore, I'm pretty sure all governments will require "compliant" LIDARs to transmit a bit pattern that's unique to the car (think: digital license plate / registration #).

    4. Re:Not just cameras by Anonymous Coward · · Score: 0

      can't you just use a random frequency and look for that?

    5. Re:Not just cameras by Anonymous Coward · · Score: 0

      Does not scale. So 2-3 years of testing one car on the roads to get 'approval'. The after mass production pedestrians get killed because other cars interference blindsided the dumb units. As for modulation, it costs very little to do, now asics are around. I also ask who pays for a lens filter in high risk areas?

    6. Re:Not just cameras by Solandri · · Score: 5, Interesting

      Radar and sonar overcome this problem by constantly varying the frequency in a series of chirps. It's highly unlikely that there's another radar/sonar transmitting at the same frequency at near the same time. And even if there is, it's unlikely to be varying the frequency at the same rate/range.

      Another advantage of this is that you don't need as strong a sweep signal. With a single frequency, you're emitting a pulse, then waiting for the reflections of the pulse. In order to avoid the possibility of spurious noise from another source being interpreted as a reflection, your pulse has to be high-power (basically make the reflected signal stronger in strength than any noise). 1000 to 5000 Watts was typical for boat radars using pulse beams. But when you use a varying frequency, you can compare reflections at one frequency with subsequent reflections at a different frequency (there's no need to wait for return reflections - subsequent pulses will not interfere with previous pulses, so can be sent before reflections from previous pulses arrive). Noise will show up at just one frequency, making it easy to spot and trivial to filter out. Consequently newer frequency sweeping boat radars only need to emit at a few tens of Watts.

      That said, the parking sensors in your car use this frequency varying sonar. And I've noticed other cars' parking sensors trigger mine about once a day. So some more work needs to be done on standardizing frequency sweeps and noise filtering to reduce signal collisions. But the problem is not as insurmountable as you'd think from your LIDAR experience.

    7. Re:Not just cameras by guruevi · · Score: 2

      People in the industry know. Right now self-driving cars are an easy way to raise funds. Much like the .com era, everyone wants a piece of the pie. Eventually after about 20 years we'll laughing at the time we were awed by the self-driving car equivalent of Badger badger and lament the situation with Pewdiepie while everyone just uses self-driving cars to get delivery of hookers and blow.

      There is less and less reason to keep driving around like fools every day for work. Cars, self driving or not, will feel that pressure as the next generation will demand more to flex home and work. So cars will once again become a thing for leisure and the powerful who will either be driven around by someone experienced or doing it themselves for the thrill of it.

      Self-driving cars for the 'common folk' will be around but will be very simple automatons without all the high-tech gadgets driven in tandem with a skilled delivery driver much like today's truckers, taxi and UPS drivers.

      --
      Custom electronics and digital signage for your business: www.evcircuits.com
    8. Re:Not just cameras by ColaMan · · Score: 2

      I didn't say it was insurmountable, but as another poster has pointed out, there's very few LIDARs on the market right now that modulate their beam. Unlike radar, it's difficult to vary the actual frequency as such as they're diode lasers and generally fixed. So we're kind of stuck with just beam modulation unless we want to do something fancy like driving multiple lasers, which gets tricky when you're all sharing the same optical path.

      LIDARs also have the difficulty (or advantage, depending on which way you look at it) of having a much tighter beamwidth. So it's much more difficult to rotate onwards in your scan and listen to previous reflections as you're using the same optics to both transmit and receive your signal. Even at one foot per nanosecond, you start to have trouble out at 300 feet with the typical half or quarter degree resolution and 50-100Hz scan rate of recent LIDARs. With the telescope-type lensing on them, it would be fairly easy to blind/overload the sensor assembly with a beam (not a reflection) from another unit - they are already significantly blinded by the setting sun on the horizon or other brightly lit environments, for example.

      Anyway, it just seems that every autonomous vehicle manufacturer right now is all "oh wow, look at what our vehicle can do!", with very little info on how they'll go when there's 20 of them at a stop light. Hopefully technology will catch up to them before they're at scale, or full-scale production will force the solution, one or the other I guess.

      --

      You are in a twisty maze of processor lines, all alike.
      There is a lot of hype here.
    9. Re:Not just cameras by somenickname · · Score: 2

      You are 100% correct but, you are describing frequency modulation. The vast majority of lidar companies (on the order of 99%) are producing amplitude modulation systems that shoot out strong amplitude signals and cross their fingers hoping they can see and distinguish it when it comes back. These systems often use "avalanche detectors" to help their probability of return detection (look it up, it's insane). Driving directly towards a sunset can literally cause these systems to emit their magic smoke. Accidentally hit the wrong angle on a retro-reflector? Smoke. Having another system pointed in their direction means "something made a peak" and there is no way distinguish your light from another sensors light.

      These problems are solved in the radar space but, the solutions are taking a long time to trickle down into lidar space. Mostly because it's very easy and very cheap to produce an AM lidar.

    10. Re:Not just cameras by jrumney · · Score: 1

      I'm waiting to see what happens with a freeway full of cars with LIDARs, all flinging their beams at each other willy-nilly with direct beams and reflections all over the place. If you're unlucky you'll get a beam from another vehicle just after yours has sent a pulse out - resulting in a false return showing something right in front of you.

      If only someone could come up with a way of encoding signals so that a desired signal can be distinguished amongst a mass of other signals using the same wavelength.

    11. Re:Not just cameras by Gimric · · Score: 1

      LIDARs that are in close proximity to each other - you mean like on a freeway?

    12. Re: Not just cameras by Anonymous Coward · · Score: 1

      Avalanche detectors are not damaged by too high light input (well, within reason) assuming competent sensor readout circuit design. Otherwise they would fail when imaging a diffuse mirror :).

    13. Re:Not just cameras by Cmdln+Daco · · Score: 1

      Yes, that is the challenge with laser modulation. It has significant limits that mean it won't scale very well. Others have explained it well in other comments in this discussion.

    14. Re:Not just cameras by Anonymous Coward · · Score: 0

      Interference leads to false positives, not false negatives.
      The cars will see people that aren't there and stop when they shouldn't.

    15. Re:Not just cameras by freeze128 · · Score: 1

      "while everyone just uses self-driving cars to get delivery of hookers and blow."

      Boober?

    16. Re:Not just cameras by jrumney · · Score: 1

      It's a solved challenge. You're probably thinking many of the solutions from current digital radio technology are not directly usable because they rely on spread spectrum to further increase the noise immunity and thus increase the bandwidth that can be carried, but there are still solutions in there that can be applied in fixed wavelength scenarios.

  7. LIDAR protection by Anonymous Coward · · Score: 0

    You should have brought your LIDAR blocking sunglasses. You now have retina damage for life.

    1. Re: LIDAR protection by Anonymous Coward · · Score: 0

      Some defense range finders work in bands that pass through the front of the eye. They are an optical hazard if viewed closely. Modern units use lower power or 1.5um which doesn't penetrate the eye.

  8. What's good for the goose... by Arzaboa · · Score: 2

    All I hear is that there will now be some "smart" people trying to outsmart new tech and cameras by firing lasers, not strong enough to poke your eyes out, but strong enough to burn the retina of the machine.

    --
    When you have confidence, you can have a lot of fun. And when you have fun, you can do amazing things. - Joe Namath

    1. Re:What's good for the goose... by AmiMoJo · · Score: 1

      This has been happening for ages already. You can buy high power laser pointers and even higher power laser modules online for very little money, and they are more than capable of destroying CCTV cameras and the like. The tricky part is doing it without being caught on the camera itself.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
  9. Simple solution, well, not *simple* by fustakrakich · · Score: 1

    We need to develop passive sensors. I mean, we have them, we're just not using them.

    --
    “He’s not deformed, he’s just drunk!”
  10. 1550 nm wavelength is (relatively) eye-safe by Vadim+Makarov · · Score: 5, Interesting

    As the original article duly explains, the laser light at the wavelength of 1550 nm used by this lidar scanner does NOT reach the retina of the eye. At this wavelength, it is fully absorbed in outer parts of the eye (cornea, lens, etc.) before it could get focused into a tight spot on the retina. This makes this wavelength (relatively) eye-safe, comparing to visible and some other wavelength ranges. There is no such protection for the camera however, whose glass optics happily focuses 1550 nm into a small spot... so the sensor damage may happen.

    Laser safety regulations are primarily concerned with (a) no damage to humans, especially their eyes, and (b) laser beams not setting things on fire. Neither of this has happened in this incident. So we are good.

    If you are interested in technical details of laser safety, read ANSI Z136.1 standard. Warning: it requires technical expertise.

    --
    17779 eligible voters in a district, 17779 'vote' as one. This is Russia.
    1. Re: 1550 nm wavelength is (relatively) eye-safe by Anonymous Coward · · Score: 0

      Don't cameras have ir filters? So they can be used outside in daylight without ir swamping the sensor?

    2. Re: 1550 nm wavelength is (relatively) eye-safe by Vadim+Makarov · · Score: 2

      While I don't know the actual filter construction, a couple possibilities come to mind. First, the filter may be bonded or integrated or be a deposited layer on the sensor itself, and a physical crack in the filter may propagate into the sensor chip. Second, any filter has a finite suppression, and I don't see why the one in the camera has to have it high. So some fraction of light can still get through it, and that could be enough to damage the sensor.

      --
      17779 eligible voters in a district, 17779 'vote' as one. This is Russia.
    3. Re: 1550 nm wavelength is (relatively) eye-safe by Vadim+Makarov · · Score: 1

      P.S. An additional possibility: for Si sensor, the filter has to reject 700-1100 nm band. Si is transparent beyond 1100 nm, i.e., the sensor is completely insensitive to longer IR wavelengths. So the filter doesn't need to be effective at rejecting 1550 nm, and I guess it isn't.

      --
      17779 eligible voters in a district, 17779 'vote' as one. This is Russia.
    4. Re:1550 nm wavelength is (relatively) eye-safe by jfdavis668 · · Score: 1

      The filter built into a DSLR would block light of that wavelength. The reason I had it removed for taking astrophotos, to get maximum red transmission. With it in place, transmission of wavelengths greater than 600nm is significantly reduced and close to zero by 1100nm. 1550nm is well into the IR band, and the longer the wavelength, the less energetic the photons. Also, the camera lens wouldn't focus it. Glass lenses are like prisms, and refract different wavelengths of light differently. Camera lenses and refractor telescopes use multiple lens elements with different refracting properties to bring red, green and blue to the same focus point. Not so with IR. If the camera was focused for visible light, IR would be out of focus.

    5. Re:1550 nm wavelength is (relatively) eye-safe by Swave+An+deBwoner · · Score: 2

      Retinal damage is not the only ocular risk.

      https://velodynelidar.com/newsroom/guide-to-lidar-wavelengths/

      1550 nm systems use a wavelength that is allowed to run more power compared to 905 nm. However, under certain conditions, the 1550 nm wavelength of light can still cause corneal damage and potential damage to the eye lens.

    6. Re:1550 nm wavelength is (relatively) eye-safe by Vadim+Makarov · · Score: 1

      If the camera was focused for visible light, IR would be out of focus.

      ...unless the camera was focused at something else at another distance, or simply moved out-of-focus, and the 1550 nm image accidentally came in-focus.

      Also, as I've written in another comment, the filter doesn't have to be effective at 1550 nm, because the Si sensor itself is insensitive that far into IR. This depends on the technology used to make the filter. For example, an interference-type spectral filter may perform very well in its designed wavelength range, but simply becomes transparent outside of it.

      --
      17779 eligible voters in a district, 17779 'vote' as one. This is Russia.
    7. Re:1550 nm wavelength is (relatively) eye-safe by Vadim+Makarov · · Score: 5, Informative

      Maximum permitted exposure (MPE) in 1500-1800 nm band is the same for the eye and the skin. For continuous-wave light it is 0.1 W/cm2, for pulsed light it is 1 J/cm2. Reference: ANSI Z136.1, see Tables 5a and 7.

      In other words, if the 1550 nm laser beam is not burning your skin, it is safe for your eye.

      This is remarkably untrue at other wavelengths, where light is dramatically more dangerous to the eye than it is to the skin.

      --
      17779 eligible voters in a district, 17779 'vote' as one. This is Russia.
    8. Re: 1550 nm wavelength is (relatively) eye-safe by Anonymous Coward · · Score: 0

      I would suspect that the sensor is sensitive to particular wavelengths only (I have vague memories of band gaps corresponding to the energy of the photon of wavelength whatever, but I haven't studied solid state stuff since the mid 90s). No (obvious, before above article) reason to filter it out pre sensor if the sensor doesn't "see" it anyhow.

    9. Re: 1550 nm wavelength is (relatively) eye-safe by Anonymous Coward · · Score: 0

      Or the camera damage was actually not a broken sensor but a blemish the filter

    10. Re:1550 nm wavelength is (relatively) eye-safe by NormalVisual · · Score: 1

      This is remarkably untrue at other wavelengths, where light is dramatically more dangerous to the eye than it is to the skin.

      For sure. You can let an unfocused 100 watt Nd:YAG beam fall on your hand and you might feel a tiny bit of warmth. Letting that same beam hit you in the eyes is a different story.

      --
      Please stand clear of the doors, por favor mantenganse alejado de las puertas
    11. Re:1550 nm wavelength is (relatively) eye-safe by mark-t · · Score: 1

      The filter built into a DSLR would block light of that wavelength. The reason I had it removed for taking astrophotos, to get maximum red transmission.

      One is compelled to wonder why one would use a camera that has been custom modified to be sensitive to frequencies that are needed for astrological observation to take pictures of passing automobiles.

    12. Re:1550 nm wavelength is (relatively) eye-safe by Anonymous Coward · · Score: 0

      What I do know is a friend worked for a lidar company. They wore safety glasses ALWAYS. In a couple of cases the laser did not scan properly and went full bore on the rather expensive sensor that literally went up in flames. After that he double checked he had his googles on before turning the thing on.

    13. Re:1550 nm wavelength is (relatively) eye-safe by mark-t · · Score: 1

      Typo - doh! I meant "astronomical".... wow, I just noticed that error.

    14. Re:1550 nm wavelength is (relatively) eye-safe by Anonymous Coward · · Score: 0

      This is false. Does standing in the sunshine burn your skin within seconds? Nope, but it does burn your retina within seconds, causing permanent damage. It may be that the numbers you are looking at don't take into account the concentration of light by the eye's lens onto the retina.

  11. Re:Kiss my piss! KISS! MY! PISS! by Anonymous Coward · · Score: 0

    Go away fatass

  12. Looks like Elon was right not to choose LIDAR by Anonymous Coward · · Score: 0

    Seems like Elon was right when he decided to use RADAR, cameras, image processing and AI, rather than LIDAR on Tesla cars

    1. Re:Looks like Elon was right not to choose LIDAR by dgatwood · · Score: 1

      This has nothing to do with the LIDAR that is currently in use on self-driving cars. This is entirely different (and fundamentally unsafe) new tech.

      Current-generation LIDAR uses low-power (5 mW-ish) lasers in the short end of the near infrared spectrum (905 nm), which can be detected by normal cameras and do not cause them harm. The light frequency is within the detection range of cameras, and they produce about the same amount of output per unit of area as the sun. Pointing at the sun for seconds at a time can harm your camera, but you won't get damage from shooting a single momentary shot where the sun happens to be in view. In much the same way, typical LIDAR does not damage cameras unless the LIDAR is badly malfunctioning and the beam stops moving while pointing at the camera.

      What caused this damage, reportedly, was a high-power (1W-ish) laser in the longer end of the near-infrared spectrum (1550 nm). At 200x the power of typical LIDAR, the safe exposure time for a camera drops from seconds to milliseconds. That means in normal use, these lasers can damage cameras.

      Eye safety is just one part of the safety discussion, and by focusing only on that when deciding their power output limits, these hardware manufacturers have failed in their duty to protect the public. If they cannot bring their power down enough to avoid causing damage to cameras, then their hardware is fundamentally unsafe for use on roads. After all, a lot of vehicles use cameras to perform safety-critical tasks. Worse, even ignoring the liability issues, the majority of cars on the road today have at least one (backup) camera, which means if they really do damage cameras that easily, then the sheer magnitude of the economic harm that these LIDAR systems could do if broadly deployed is unimaginable.

      I don't get why these 1550 nm LIDAR systems are being made. What advantage am I missing? They are arguably quite unsafe, and they still don't do as well as 905 nm LIDAR in bad weather (rain, fog) because of higher attenuation. Why do these even exist?

      --

      Check out my sci-fi/humor trilogy at PatriotsBooks.

  13. ...an invisble beam that destroys cameras? by Anonymous Coward · · Score: 0

    Bwa ha ha ha ha!!

  14. Why not just use Stereo Vission by aberglas · · Score: 1

    Why use expensive Lidar when stereo vision will also provide good depth perception. Two cameras pointing in the same direction. Line up the dots and do the Trig.

    That is a genuine question. I wonder why the focus on Lidar.

    1. Re:Why not just use Stereo Vission by somenickname · · Score: 1

      A good lidar system doesn't provide depth perception, it provides a centimeter(-ish blah, blah, Guassian) accurate 3D model of the world. It's actually pretty easy to take the point cloud from a lidar and, as long as it's accurately timestamped (PTP works well), synchronize it with GPS and an IMU and get a very accurate 3D model of your surroundings. Some flavors of lidar also provide doppler on every point in the point cloud. You aren't comparing frames against either other to determine if something is moving towards or away from you, every point in the point cloud will tell you that. To the point where you can see a pedestrians legs shift before they decide to cross the street.

    2. Re:Why not just use Stereo Vission by Anonymous Coward · · Score: 1

      So how is "3D model" different from "Depth Perception"? You want to know how far away things are, so that you can build a 3D model. Both passive Stereo vision and Lidar do that.

      Incidentally, there is an intermediate approach with active stereo -- you use a laser a next to the camera, and measure the offset rather than the timing, which should be cheaper.

      All three address the same problem. The question is, why do people prefer Lidar.

    3. Re: Why not just use Stereo Vission by Anonymous Coward · · Score: 0

      Because stereo vision isn't very good, and distance accuracy degrade severely with distance. Fine for hunting. Not great at 140 kph

    4. Re: Why not just use Stereo Vission by Anonymous Coward · · Score: 0

      If I were to have a car with one of the LIDAR systems, I would like a way to be able to capture the raw data, and stream it to a portable hard drive or some other device so I could analyze the data later.
      It dosen't need to control or take over the system, just fetch the raw data as it's being streamed to the systems in the car.

    5. Re:Why not just use Stereo Vission by tepples · · Score: 1

      Perhaps they're making do with time of flight lidar while waiting for active stereo patents to expire. Or they don't want resolution to decrease dramatically for faraway objects.

  15. There go the police ticketing cameras by Flexagon · · Score: 3, Interesting

    So, how long will the various municipalities' automatic red light ticketing cameras last with this?

  16. Shutter speed doesn't matter for mirrorless camera by JoeyRox · · Score: 4, Informative

    The camera in question is a Sony A7rII, which is a mirrorless camera. Such cameras constantly expose the sensor to light in the scene [while not taking photos], which is necessary to provide the video-like image stream used for the electronic viewfinder and LCD display.

  17. Laser Might Be Over Legal Limit by BrendaEM · · Score: 1

    As someone who has aimed a laser at a CMOS sensor for hours at a time, I would want to check to make sure the laser might be over the legal limit. Laser Shined at CMOS sensor, for hours. https://www.youtube.com/watch?... I have seen videos of laser strikes ruin sensor, but often at laser light shows, which might also be over the legal limit.

    --
    https://www.youtube.com/c/BrendaEM
  18. Rear view cameras by drinkypoo · · Score: 1

    Manufacturer designs camera-killing laser to be mounted on the front of vehicles which have cameras on their rears. What could possibly go wrong?

    --
    "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
  19. War driving by Anonymous Coward · · Score: 0

    So now we have cars weaponized with high energy electromagnetic weapons. Great for attacking other "intelligent cars". Only the strongest will rule the roads.

  20. They're less sensitive than skin cells. by Anonymous Coward · · Score: 0

    So, yeah, claming they're "sensitive" CCD pixels just goes to show you really only care about sticking it to CES, not about reality.

  21. Sony and security... by zmooc · · Score: 2

    Sony does not have a good security track record so this does not come as a surprise to me.

    OWASP Secure Coding Practices Checklist section 1 about input validation was clearly not applied at all. Specifically, they failed to implement "Validate data range" :p

    --
    0x or or snor perron?!
  22. Take a picture in the daytime? by Anonymous Coward · · Score: 0

    Ever see the sun in it? then it's being pointed at the sun. The entire sensitive area is equally sensitive on a CCD, it's the human eyeball that has the central area covered with colour receptors whose robustness can be damaged by sunlight. Why do you think looking straight at the sun is bad while having it in the field of view isn't?

    CCD cameras don't have an area that is different from the rest.

    Human eyes do.

    But I see why there's so much arsewiping on reality going on here: it's self driving cars, therefore satan's plan, therefore it MUST BE EVIL. Don't care if it's valid, do you, as long as self driving cars are killed, that's all you care about.

  23. First world problem! by Anonymous Coward · · Score: 0

    Just saying...

  24. LIDAR - grad students have used it more by Anonymous Coward · · Score: 0

    Because all the cool kids in the schools working the problem (Stanford, CMU) have large enough development budgets to use LIDAR which is available off the shelf as a box with a computer interface. Gives you a great point cloud and lots of data.

    It's a natural outgrowth of the vision/video processing - they've already got years of software for processing 2d and stereo pairs, building world models, etc.

    Radar isn't like this - nobody sells a "radar camera" with a USB or Ethernet (or any) interface.

    Ultimately it comes down to this: you do your research in an area where you're likely to be able publish papers - there's a lot more activity in the vision based and LIDAR area.

    So Why LIDAR - it's easier for grad students to get experience.

  25. License plate camera by Anonymous Coward · · Score: 0

    Well that could be one way to end the red light camera money making scam from city's. "Officer that red dot is not me"

    (.)-(.)

    1. Re:License plate camera by Anonymous Coward · · Score: 0

      It didn't destroy his camera. It destroyed a single tiny pixel out of thousands of pixels.

  26. Car, or mobile speed-camera zapper? by petes_PoV · · Score: 1

    Also, what effect would that LIDAR have on surveillance cameras? I assume they could be fitted with filters, provided their IR operations are not affected.

    --
    politicians are like babies' nappies: they should both be changed regularly and for the same reasons
  27. He missed the warning sticker. by fahrbot-bot · · Score: 1

    "Do not look into LASER with remaining eye / camera."

    --
    It must have been something you assimilated. . . .
  28. Go read up on the BoLM ranger that got blinded... by Anonymous Coward · · Score: 0

    at Burning Man a few years back.

    They have a ban on personal lasers and a moratorium on vehicle mounted lasers without a serious inspection (and with limited operating times) as a result of a pair of debilitating laser injuries to the same person while on bouncer duty during the burning of the man (they have security personnel to keep people from running into the blaze.) One was a personal laser pointer and the other was a miscalibrated laser display on a mutant vehicle.

    Long story short, she lost her job, is legally blind in one eye and partially blind in the other, can barely drive, and has no real career options now.

    That is how dangerous lasers are.

  29. Speed Cameras by Anonymous Coward · · Score: 0

    More subtle than throwing a burning tyre on them?