Light Field Photography Is the New Path To 3-D
waderoush writes "In November, Lytro, the maker of the first light field camera for consumers, upgraded its viewer software to enable a feature called 'Perspective Shift.' In addition to refocusing pictures after they've been taken, Lytro audiences can now pivot between different virtual points of view, within a narrow baseline. This 3-D capability was baked into Lytro's technology from the start: 'The light field itself is inherently multidimensional [and] the 2-D refocusable picture that we launched with was just one way to represent that,' says Eric Cheng, Lytro's director of photography. But while Perspective Shift is currently little more than a novelty, the possibilities for future 3-D imaging are startling, especially as Lytro develops future devices with larger sensors — and therefore larger baselines, allowing more dramatic 3-D effects. Cheng says the company is already exploring future versions of its viewer software that would work on 3-D televisions. 'We are moving the power of photography from optics to computation,' he says. 'So when the public really demands 3-D content, we will be ready for it.'"
Returned it.
It was awful, and the resolution wasn't hot
Enhance 224 to 176. Enhance, stop. Move in, stop. Pull out, track right, stop. Center in, pull back. Stop. Track 45 right. Stop. Center and stop. Enhance 34 to 36. Pan right and pull back. Stop. Enhance 34 to 46. Pull back. Wait a minute, go right, stop. Enhance 57 to 19. Track 45 left. Stop. Enhance 15 to 23. Give me a hard copy right there.
Wow, TFA is really glossing over an inherent limitation:
If the goal of this is to produce useful stereo content that replicates the parallax seen by humans, then the image sensor needs to be at least as big as the average distance between two human pupils. That's roughly six centimeters. The Lytro's sensor is around six millimeters. Somehow I doubt they're going to increase their form factor by ten times in each dimension, and since the point of a Lytro is to avoid fancy lenses they can't bend the light path to compensate.
Combine the data from 12 or so of these in a matrix and you have a really powerful, accurate, self optimizing point cloud capture device for voxel 3d content.
'when the public really demands 3-D content'
When it doesn't require glasses and doesn't give you headaches.
I have a Lytro as well. I know that currently its limitations are so severe that have rendered the Lytro cameras to nothing but a novelty.
Its limitations right now are in the computational power --- it does take a whole lot more computational power to make it useful --- and the HORRENDOUS AMOUNT OF DATA to make it any useful.
But, I still have hope in this 3D imaging thing --- I do not see it as mere toy, I see a future link, in between 3D imagine and 3D printing, and beyond.
Currently, to gather data on 3D imagery we use technologies such as MRI, which in itself not really portable.
The concept behind the Lytro 3D camera may offer us a possible alternative.
Muchas Gracias, Señor Edward Snowden !
Those are awesome. I don't see what you are seeing with the plant image.
"When life gives you lemons, don't make lemonade. Make life take the lemons back!" -- Cave Johnson
Look again. Pay attention to the bubble that masks the rear stair column. As you shift the image, the placement of the column within the bubble shifts (the amount of plant displayed varies).
This is beyond stereoscopy, and is a direct result of how they are capturing images. Stereoscopy only works on a single axis of view. This works on multiple axis.
The reason why it looks "fake" to you, is because none of this is done by the camera itself. Everything is done by running computations on the captured image. And as a result, the only way to display it is via an interactive container like Flash. The computations aren't done in realtime, so you only get whatever focus planes the algorithm (or artist) picked out when running the processing. Presumably, you could reprocess for different focal depth points.
I'm out of my mind right now, but feel free to leave a message.....
Huh? The image with glasses works perfectly. I'm almost certain that you're completely incorrect here. It looks like it loads a full set of pre computed images for all available POV and focal points. Sure there is probably a rough threshold but that's a limitation of bandwidth, not the data.
A fool throws a stone into a well and a thousand sages can not remove it.
It looks like it loads a full set of pre computed images for all available POV and focal points. Sure there is probably a rough threshold but that's a limitation of bandwidth, not the data.
No. This is an image taken from one camera position, with one sensor, with tiny lenses of different focal length over adjacent pixels. There is only one point of view, but depth can be inferred from depth of focus.
This is not a hologram, a time of flight image, or a 3D composite of images taken from multiple locations. It's much simpler than that.
In November, Lytro, the maker of the first light field camera for consumers, upgraded its viewer software to enable a feature called 'Perspective Shift.' In addition to refocusing pictures after they've been taken, Lytro audiences can now pivot between different virtual points of view, within a narrow baseline.
It sounds like the techniques Lytro uses could make for a really good Borescope/Endoscope. Imagine being able to virtually shift your view to get another perspective (even if only a few millimeters), without moving your scope. If you could process the shifting fast enough, you might use it as a way to compensate for the motion of a beating heart or moving probe. Or upon reviewing a recording, re-focusing on a newly-found item of interest, even after you've pulled your scope out of the patient.
It might also be used to build a compact yet superior type of Fundus Camera -- current cameras are often rather bulky things. The Lytro has a single aperture, yet might be capable of imagine the retina in 3-D (it is a multi-layered structure). The light field info might even allow you to compensate for some kinds of cornea or lens aberration.
No, you're completely wrong. The image through the bubbles and glass move. Also, you're thinking 3D, this isn't 3D. Your monitor isn't 3D. This is a change in perspective. It's like having remote control over a far away webcam. But it's a single image, from a single moment in time. It's like they took a picture of a scene and now you can travel around and look at it form different angels.
How does one form different angels? Why, what's wrong with the one's we've got?
Here's a virtual focus photo I did a few years ago, placing the focal plane on a skew.
If you take photos from a large enough set of positions with a normal camera and some time, you can get the same thing lytro does, but only with still subjects.
There isn't a single point of view. The lens isn't a pinhole lens: there's a circular area of view. That's what Lytro is doing here: simulating pinhole cameras at various positions on the lens. You can't get a point of view that isn't covered by the camera's lens.
If you're talking about the last image, where they have a row of drinking glasses, it only works at first glance. The background through that first glass moves as it should. But the background through the further glasses does not.
Ha! Now all those nitpickers who complained that Deckard's inspection of Leon's photo in his Esper machine shows an impossible "perspective shift" will have to eat their words!
I guess with a good-sized light field, you really can photograph around corners!
"Slow down, Cowboy! It has been 3 years, 7 months and 26 days since you last successfully posted a comment."
All three images you point to seem okay.
In particular the row of glasses clearly shows a different perspective in the background; you can see from the kid's arm and the second glass from the background of the first glass.
As you describe from the plant image, I gather you were expecting all kinds of visual layers, but this is pretty much what you should expect; objects at a distance have far less parallax effect, this holds true for normal photography a well.
I think you have to keep in mind that the change in perspective are very minimal even in the foreground; It's like moving your head less than a centimeter to the side.
I agree though that that it's not breakthrough. That will happen when we see pictures of what we all know is the killer app for this type of camera (or any type of camera, really).
Slashdot social media options: AIM, ICQ, Yahoo, Jabber and Mobile Text. Why no MySpace?
So when the public really demands 3-D content, we will be ready for it.
I thought the public had already weighed in on 3D and their opinion is basically, "Meh".
Have gnu, will travel.
Mostly they show up when in creative mode because you can have areas of the scene that can't be pulled into focus, and when shooting dirty glass. I've been really happy with the picture quality in general though, and am sure that improvements in the software/algorithms will help a lot.
https://pictures.lytro.com/tophertuttle/pictures/544030
https://pictures.lytro.com/tophertuttle/pictures/544050
https://pictures.lytro.com/tophertuttle/pictures/531986
Also this article makes for an interesting read.
http://eclecti.cc/computervision/reverse-engineering-the-lytro-lfp-file-format