Camera that Sees through Smoke and Fog Underway

tomschuring writes "The Age has a story about IATIA, who have been given $2.7 million by the Defence Department to fund development of a military spy camera capable of seeing through fog, smoke and dust storms. The technology uses a highly sophisticated camera that captures three images simultaneously through a single lens. Images thus resolved from between the particles making up fog, smoke, and dust storms are formed into a single picture of the hidden target."

Comments

Warning: Registraton Required

[RKBA]

BugMeNot username and password:
Username: registrationsucks1 Password: asdoestheage

density

[Coneasfast]

how dense can the fog particles be? this camera would have to have an extremely large resolution to do this kind of thing. anyone have any specs on this?

the uses for this are endless, eg, if the technology becomes cheap enough, we can have this in cars to help driving during foggy weather.

Re:density

[ajna]

This system does not rely on resolution. You might be imagining it as taking two (or more) pictures shifted horizontally, perhaps, and somehow subtracting the intervening particle's optical effects, leaving only the subject matter. This is not how the system works, however: instead, as the summary briefly but correctly stated it relies on three images being taken, one focused in the plane being studied and the other two focused before and after that plane. Quantitative Phase Microscopy is the process of extracting additional data about the subject in the plane from the data in all three images. Why it doesn't rely on the resolution of the sensor is because the addition information is derived from the optical properties of the light passing through/reflected off the surface, not from sensor trickery.

I guess this could be used on cars given enough processor speed, but it's really not applicable in this case, as it yields additional information about something in a plane (parallel to the sensor of the imaging device -- imagine a brick wall ahead of you when driving). When driving, the plane, say, 50m ahead of the car is moving just as fast as you are, and seeing ultra-crisp images of that plane for the instant that it is 50m ahead would be of dubious utility imo.

Other versions available...

[physicsphairy]

"that captures three images simultaneously through a single lens." There is also a Kodak version, where one set of pictures is lost, another is misdeveloped, and the third is inadvertently sent to your ex with the same middle initial.

Re:also

[brocheck]

I wonder if it would let you see through the particles that many dresses consist of.

I'd buy one.

Unused links on how it works - some detail

[tqft]

Some detailed links on how it works

http://www.iatia.com.au/technology/insideQpi.asp

http://www.iatia.com.au/technology/applicationNo te s.asp

he algorithm has a number of key advantages, including:

* Returns phase and intensity information independently
* Provides quantitative, absolute phase (with DC offset)
* Is a rapid, stable, non-iterative solution
* Works with non-uniform and partically coherent illumination
* Offers relaxed beam conditioning
* Solves the twin image problem of holography
* Has been experimentally applied to a number of radiations

You can find their list of patents on theire site. Digging into these should give you more detail.

I don't care I am going on holidays for 3 weeks in 3hours

Can it see through smoke and mirrors?

[telly333]

Just in time for politics.slashdot.org!


telly

Dense Camera Arrays for seeing through bushes

[vectra14]

These guys at stanford have done some really amazing stuff that's directly related. Except that they has literally dozens of cameras (as seen in their ppt), and their research seems to concentrate on multifocal image reconstruction (see ppt slides, presentation is quite good)

Link (has cool results links)

Re:Dense Camera Arrays for seeing through bushes

[ajna]

The Stanford work is actually entirely different. They utilize parallax -- in other words, their cameras are in physically distinct locations and see the scene with different perspectives. The IATIA work utilizes a single point of view, with images captured with the focal plane at the desired location and then slightly fore and aft. Read more here, at a Columbia site.

Quantitative phase microscopy is a relatively new technique that can generate phase images and phase-amplitude images. In practice, to obtain a quantitative phase image one collects an in-focus image and very slightly positively and negatively defocused images, and uses these data to estimate the differential with respect to the defocus of the image. These images (a through-focal series) can be easily obtained in our system with our z-motion nano-positioner. The resulting data can be solved to yield the phase distribution by Fourier-transform methods. Results are obtained by essentially solving an optical transport equation. Significantly, the phase that is obtained does not have to be unwrapped, as is required for interferometry.

I'd be lying if I told you I completely understand the quoted paragraph, specifically what "essentially solving an optical transport equation" refers to, but I'm sure some cursory googling will lead the curious to specifics, certainly more than googling on terms in the article summary would yield.

Re:Dense Camera Arrays for seeing through bushes

[TiggertheMad]

What they are saying is this: They take three pictures. On a camera there is a point somewhere in front of the lens that is the 'focus point'. The distance it is away from the camera will vary by the lenses and their distance apart, but it is basically a fixed distance for any given setting. The first picture that point is set too far behind the subject, the second right on the subject (In focus) and the third in front of the subject. Because you know how the lenses were made, you can do some math and figure out how far away each element in the picture is by how the focus changes between the shots, and get a (quasi) 3d model of everything in the picture. The concept is simple enough, although having a proc that can do that in real time could be a challenge.

The real challenge is this: You are building a 3d model by interpolating data from a scene, but you are only doing it in one dimension. I bet a 3d picture would look like a scene from Doom1. You can create flat sprites and position them, but you can't capture any depth information without paralax interpolation either via lateral movement and reshooting or additional cameras.

Keith Nugent

[metlin]

Hmm, Keith Nugent is fairly well known in some niche areas of optics. If I remember right, his initial work on the use of x-rays and the like to compensate for normal visible hindrances were met with some opposition, but he is quite famous otherwise.

That was because, ironically, this was developed as a method to visualize biological stuff, and some felt that his methods would not quite be suitable for such a task. His ideas were to use various parameters such as phase, intensity and angle of vision to extract information which could be correlated and converge to recreate images with minimal amount of information, which later gained acceptance.

I guess he developed on that technique, and later on evolved to have the military to take notice. Interesting neverthless.

Re:We don't need this

[Darthmalt]

Probably because it's easier for him to get moner for his research from the military. Many things we use as consumers everyday were started by the military.

GPS, Radar, heck even the microwave (though that was more the British military.

Re:also

[AndroidCat]

If they make one that can see through fingers and lenscaps, I am so there!

Re:also

[Rufus211]

ABCNEWS.com : Cameras Let Voyeurs See Through Clothes

Re:We don't need this

[rebelcool]

Who are you to say "we dont need this"? You can forsee all applications of a technology before its made? And you automatically assume just because the money is initially military its going to be used to "kill people"? What nonsense.

This would useful for finding people in a burning building full of smoke. Or imagine putting it onto a car as a warning system in heavy fog that you're approaching an obstacle too fast. Same with planes. Surely more creative people than I can dream up a dozen applications for this.

Here's a tip about research: The military has a ton of money, and they spend it on all kinds of things that have nothing to do with "killing people". As pointed out already, the internet was a defense project. So was GPS. So was radar. So was a million other extremely useful things.

"We dont need this" - we don't need you and your cluelessness.

Already exists

[leabre]

I was in the US Navy from 1994-1996 and the damage control teams already have a special camera (forget what it is called) that can see through dense smoke (the type you would expect from a jet fuel fire or amunition fire on a ship) and help you to see clearly through the smoke.

Wonder what makes the camera in this article so different from the technology the Navy already uses... I'm sure the current navy breed is much more advanced than it was 10 years ago.

Thanks,
Leabre

my thoughts

[Large Bogon Collider]

I'm not a 100% sure, but the technique involves phase shift. As light of a single frequency passes though an medium, its phase is altered and light propagation is delayed. If you can computationally filter out all out of phase shift information caused by fog, for example, you can "see" what the hidden object looked like. This process is quite CPU intensive. It seemed that about a grayscale SVGA sized image (0.41 mp) took 1.5 secs on a PIV 2.4GHz to calculate. This should improve with algorith tweaking and using FPGAs.

This may also have medical applications in terms of optical imaging - see through the patient (arms and legs only, probably). Shine a bright light at the patient. Capture the ealiest photos that emerge (the ones that had a direct path to the camera). Ignore slow photons (ones that were absorbed and release or bounced around). Voila, instant imaging without x-rays. IIRC, this was in development years ago.

Re:We don't need this

[whorfin]

Yeah, nothing that was ever funded by military research has ever come to any good for society.

Well, except for computers and the internet. Everything else was crap. And I guess those satellites that let us talk all over the world and get sports and softcore porn beamed into our house are pretty neat too, except for the lite beer ads. And did I mention the GPS I've got on my cell phone?

Yeah, military research is a total dead end.

Re:also

[wwelch]

Hopefully fire departments will be able to afford this technology so that fire fighters will be able to see people through the smoke of the fire...

Re:also

[Gordonjcp]

Actually, it was because it *didn't* have an IR filter - that was how the "NightShot" stuff worked. Images had an odd greyish tinge with weirdly glowing eyes. If you can stand it, look at the dark bits in the video for All Saints - Pure Shores for an example.

Nearly all CCD cameras are sensitive to infrared. You can test IR emitters by pointing a camcorder at them and watching for the flashes. I made a very effective IR surveillance camera by popping the front off the lens of a Philips Vesta Pro webcam (get the blade of a table knife into the little groove a couple of mm back from the front and twist) and removing the IR filter.

I don't know about this...

[NathanM412]

Sounds like vaporware to me!

OASys

[philipsblows]

In college my clinic team worked with Northrop Electronic Systems on their OASys project, or Obstacle Avoidance System. It was a laser + computer navigation system that would scan the horizon through smoke or other aerosols and generate a "safe passage" navigation image to the helicopter pilot using it. Supposedly it worked pretty well (they were still working on it after our 9 months on our piece of the project). It was basically a rotating laser optics assembly that would trace a cone in space, and the assembly would scan in the horizontal plane to yield the losenge shape (they used that term).

Here's a funny little twist. When we went to the site to visit the developers of the project at Northrop, we stopped off in a meeting room that had on one of the walls a poster for the OASys project, featuring a helicopter with a losenge-shaped window of visibility depicted against some trees with some smoke and other debris in the air.

Nearby on the same wall was another poster for a weapon system, the name of which escapes me. It was the same poster, but in the middle of the losenge-shaped window of visibility was a little gunsight, and I think the helecopter had some weapons slung.

We asked our liason person whether the two projects were related, and he assured us they were completely different as we were brought to another area.

Our professor on the project was a Yugoslavian National, and this was in 1992, so you can imagine how fun the rest of our visit was when they found that out....

Re:We don't need this

[d474]

You brought up some good points. I'm just playing the Devil's advocate here...just for sake of discussion:

This would useful for finding people in a burning building full of smoke... and once the targets have been acquired, neutralize them.

Or imagine putting it onto a car as a warning system in heavy fog that you're approaching an obstacle too fast... or taking advantage of a dust storm and locating the enemy before he can locate you.

Same with planes... same reason, faster visual target acquisition is an advantage.

the internet was a defense project... that could allow us to maintain communication after a nuclear strike which is necessary if orders for a counter-strike are no be disemminated

So was GPS... to guide precision munitions to targets to increase kill ratios

So was radar... to detect any and all potential aerial and sea going enemy targets

"We dont need this" - we don't need you and your cluelessness... nor your innocence.

Just wanted let you know that there is always a way technology can be used by the military that is related to killing people. Especially if the military is involved in it's development.

Re:also

[WhiteDeath]

I found this site about 6 years ago...

they sell the filters, and give a good run-down on the theory.

Pfff, had that already in...

[thrill12]

..[name your favourite war-game here] - it's called:

Turn fog of war off