Slashdot Mirror


Sony Develops TVs That Zoom in for True Close-ups

prakslash writes "Sony has unveiled version 2 of its 'Digital Reality Creation' technology that allows viewers to pan around a TV image and then zoom in. Unlike the current TVs that simply scale the image, Sony's technology does 'true' zooming by digitally enhancing the signal to communicate gloss, depth and texture.

36 of 275 comments (clear)

  1. Sometimes, you don't want to see the gloss. by Anonymous Coward · · Score: 5, Funny

    digitally enhancing the signal to communicate gloss, depth and texture

    Ya know, I was going to make the obvious joke, then I realized that what I'm thinking about, I actually *don't* want to zoom in on. Some things are best left to the imagination, lest you see the reality (and the bumps and blisters and pimples). Ewww.

    So, umh, this would be cool for zooming in on puppies and stuff. Yeah.

  2. About a week too late! by millisa · · Score: 4, Funny

    If only this was around for a certain Australian beauty queens strut down the catwalk last week. *sigh* Pan Baby!

  3. Digital Zoom is a MYTH! by LostCluster · · Score: 5, Informative

    I refuse to accept "digital zoom" as being any better than just putting a magnifying glass next to the same old low res image.

    Come on, it's trying to create data that just plain isn't coming from the original source, therefore it's nothing but guess and check logic. Sure it my smooth out what it thinks is a rough edge... but that's still only guessing and making up detail that just wasn't there.

    1. Re:Digital Zoom is a MYTH! by Anonymous Coward · · Score: 5, Funny

      Dude, don't you watch any of those crime dramas? Digital zoom is the greatest thing since sliced bread. With digital zoom and special software you can enhance a single pixel into the killers face!

    2. Re:Digital Zoom is a MYTH! by fajaboard · · Score: 5, Informative
      If you are familiar with any image processing algorithms then you might find digital zooming easier to swallow. There is a lot of mathematics and statistics involved.

      In fact, it may not only smooth out but actually create rough edges not in the original. Think of the case recently where the girl was kidnapped and the FBI enhanced the kidnapper's image from the crappy surveliance tape.

      The article doesn't specify if it zooms a frozen screen (like a paused image) or during a sequence. Either way it could use past information from previous image frames to enhance the result.

      Its one of those things that you need to actually see to believe the hype.

    3. Re:Digital Zoom is a MYTH! by catwh0re · · Score: 4, Interesting
      I think the idea is that on devices which can rec'v HD signal there is alot of image lost in the down scaling process. I'm guessing here, that the sony chip would allow you to "zoom" back to the source resolution. Anything more than that and you're playing the marketing game of something out of nothing.

      Reminds me people that try to add quality to their 96kbps mp3 collection by upsampling them to 256, or recording radio then upsampling that.

    4. Re:Digital Zoom is a MYTH! by Anonymous Coward · · Score: 4, Insightful

      I refuse to accept "digital zoom" as being any better than just putting a magnifying glass next to the same old low res image.

      Well, it is better because in the digital domain it is possible to do a lot of operations more complex than just a magnification. A lot of these operations get lumped in to the "digital zoom" name.


      Come on, it's trying to create data that just plain isn't coming from the original source, therefore

      This is somewhat true but not completely. What you're forgetting is that the human visual apparatus is part of the complete system and can't be left out. Our vision system is good at detecting certain features at certain resolutions, and not so good at others. Some image processing algorithms might just "make up stuff". This too, is not necessarily bad if it can give a pleasing effect to the eye. Especially if there is a high degree of likelihood that what it is making up is an accurate representation of what actually existed before it was lost by the original signal recording.

      Manytimes however, the enhancement consists of emphasizing certain things in the time or frequency domain that really do exist in the original signal but our vision does not detect because of the relationship to other nearby features. Image enhancement is not necessarily making things up. It is just using known facts about the human visual system to selectively bring out certain features that might be missed with our brain's stock detection circuitry.

      What is funny about a lot of "anti digital effects" people is that they think they are automatically getting better results by having say a 48-bit scanner vs a 30-bit one because there is more information, nevermind that the lower bits are completely overwhelmed by noise and shitty A-D conversion path.

      In your defense, the posting sounds very stupid and marketing influenced (redundant, I know) Calling something like this true zoom, even with the single quotes is very disingenous.

    5. Re:Digital Zoom is a MYTH! by rebelcool · · Score: 4, Insightful

      All electronic cameras have fixed noise patterns. They vary from camera to camera usually, but with several frames and now commonly available software, you can detect the pattern, clean it up, and interpolate the data from where it was with a good deal of precision.

      --

      -

    6. Re:Digital Zoom is a MYTH! by EvilCabbage · · Score: 4, Funny

      With digital zoom and special software you can enhance a single pixel into the killers face!

      I can see the "CSI" episode now...
      Ditzy cop: "Here's that footage you wanted enhanced sir, I ran it through our SomethingAwful lab guys!"
      Police Chief: "Put out an APB on this Admiral Ackbah character..."

      etc...etc...etc...

    7. Re:Digital Zoom is a MYTH! by Anonymous Coward · · Score: 5, Informative

      Specifically, look at http://www.sigcom.net/PDF/SIGCOMTPS.pdf, http://www.ece.gatech.edu/research/labs/MCCL/pubs/ dwnlds/YucelITVT02.pdf, or any google search for subpixel video image enhancement.

      The basic idea is to use statistical methods over a series of slightly "jittered" video frames to create a high resolution or high quality still image. When an image in front of the camera is shifted by a non integer number of pixels, the images are lined up exactly with each other so that the edges of pixels overlap each other. Taking the average of these sup-pixel overlapped images at a higher resolution yields a higher quality image than the simple mosaic or blur you would get by scaling or interpolation. If the physical shape and response function of individual camera "pixels" is known, even more accuracy can be contained. The method can probably even be applied to rotating or enlarging/shrinking images of objects as well, but with more complex mathematical models for the motion and camera viewing transformation

      A generic system as described in the article probably uses the frequency information about the image to construct the textures, but it wouldn't be difficult (but processor intensive) to track translational sub-pixel movement of objects and apply the above process to increase the resolution. MPEG already takes advantage of the fact that more compression for fast changes in an image are unlikely to be noticed, so it wouldn't have to improve the moving parts, just the 8x8 blocks that have B frames, since they are relatively unchanging. I bet they will even get a patent on the process, despite the fact that it's been published and I can think up most of the rest within a few minutes...

    8. Re:Digital Zoom is a MYTH! by gfxguy · · Score: 4, Funny

      Actually, yes... people did think it was great. Have you ever tried to slice a fresh loaf of bread?

      --
      Stupid sexy Flanders.
  4. OK by pHatidic · · Score: 5, Funny

    Wow and I thought FCC regulations were the only thing to come out of Janet Jackson's boobies. It goes to show that pornography still provides the incentive for innovation for all major developing technologies. It's actually a little known fact that the people offering the incentives for new space elevator technology are only doing so in hopes of losing their virginity in it one day.

  5. 'True Zoom' by RobPiano · · Score: 5, Insightful

    True zoom is a bit of a stretch.. The only way you could have a true zoom is if you have a higher resolution digital image to look at, or an analog image... This produce creates sophisticated, but generated results. There is nothing true about it.

    Regardless, this is one of those features that "sounds nice", but I think its the company telling the consumer what to want rather than vice versa. Never once have I wanted to zoom in on a modern or high def television image.

  6. Grassy knoll, anyone? by Steve+G+Swine · · Score: 4, Funny

    Glad we'll finally be able to clear that Kennedy thing up.

    --
    "Consider yourself a member of a virtual corporation with Mr. Torvalds as your Chief Executive Officer." - Linux Advocac
  7. digital zoom vs real zoom by randomized · · Score: 5, Informative

    real zoom requires additional information, ie higher resolution than tv is capable of displaying. all attempts at "simulation" of higher resolution will result in digital zoom artifacts, that we all are familiar with.

    unless tv has lower resolution than broadcast quality this is as fake as 200X DIGITAL ZOOM.

    --
    -- shortcut - the longest distance between two points.
    1. Re:digital zoom vs real zoom by damiangerous · · Score: 4, Informative
      All consumer TV's have lower resolution than broadcast quality. If you buy a really expensive NTSC TV, it might be able to resolve 600 lines. The NTSC signal is comprised of 720 lines.

      Where did you ever get that idea? If that were true broadcast TVs and DVD would look exactly the same. I mean if broadcast TV is already better than a TV could support, how could DVDs possibly improve the picture? I would think anyone who has ever watched a DVD on their television has already empirically proved your statement incorrect.

      In fact, broadcast TV is a far lower resolution than your TV can support (525 scanlines, of which 480 is picutre information, of which 330 is the theoretical max that will be displayed). Rather than try to explain it myself, some very good technical explanations of how it all works can be found here and here.

  8. yay, more hype by SpookyFish · · Score: 4, Insightful


    Come on. "true zoom" requires data that simply isn't there in a TV signal.

    Sure, an HD signal can be zoomed and interpolated to some extent, but call it "creation" or not, there is only so much info that can be "guessed".

  9. Re:PVR by LostCluster · · Score: 5, Insightful

    Yet all DVRs on the market currently use MPEG compression to put more data on the HD at the expense of video quality... so, they're not even storing all the video in that came from the original TV station feed to begin with. I'm not quite sure what Sony's magic tech will do when asked to zoom in on an MPEG artifact...

  10. 4 year old dvd player by Anonymous Coward · · Score: 5, Insightful

    my 4 year old dvd player has 16x zoom. big deal. used it once.

  11. official press release by phreakv6 · · Score: 5, Informative

    for those of u wondering which one of Sony's model would come out with this technology.. its SONY WEGA series.. check out the official press release

    --
    fifteen jugglers, five believers
  12. Just another algorithm..... by HonkyLips · · Score: 5, Informative

    There's already at least 12 algorithms around for scaling up an image:

    http://www.digitalanarchy.com/toolbox/toolbox_re si zer.html

    I'm guessing that Sony have simply come up with another one. Regardless of what they claim, you can't "zoom in" on an image with a fixed resolution, you're always going to be using some type of interpolation and this will introduce digital artefacts.

    --
    Putting syrup in coffee is some form of blasphemy.
    1. Re:Just another algorithm..... by PitaBred · · Score: 4, Interesting

      No, but with video, you have a hell of a lot more information. If they are doing any kind of statistical relationships using more than one frame of the video, they have a LOT more information to work with. A few comparative algorithms, and as things move through lower resolution areas, you can actually get a high resolution picture because of the data that is contained in aggregate.
      That's a hell of a processor they have if it can do that, though.

  13. Good existing zoom implementations by Clown+Jizz · · Score: 5, Informative

    Though it's easy enough to decry digital zoom as a gimmick, and in most cases it probably is, there are some (admittedly, highly specialized) implementations that produce really great results. Look at HQ4x ( http://www.hiend3d.com/hq4x.html )and its associated projects. It's primarily for images which don't breach 256 colors, of course, and it works best on simple shapes, but it's realtime, and it looks fantastic.

    1. Re:Good existing zoom implementations by grammar+fascist · · Score: 5, Interesting

      I figured I'd post my own results here.

      It's true that digital zoom can't replace information that was lost due to scaling and sampling. It's possible to get something reasonably close, though. There are a bunch of algorithms available for photographs, but their biggest problem seems to be execution time. It's not pretty.

      Here's mine. Please be kind to the server...

      I've gotten better-looking results since I put that together but I haven't had time to put them up yet. The slowest part of my algorithm requires solving a nonlinear system of nine equations for the least sum squared error per pixel. That's orders of magnitude slower than bicubic interpolation (which is standard).

      I don't know which interpolation algorithms are used for so-called digital zoom. Is there someone in the industry here that knows?

      --
      I got my Linux laptop at System76.
  14. lemme guess by jjeffries · · Score: 3, Funny

    It operates via voice commands and goes CLICK-CLICK-CLICK when it's zooming?

  15. Uh-oh by d2_m_viant · · Score: 3, Funny

    Hmmm, I'll have to try that one with my girlfriend when she catches me watching the pr0n...

    ...but honey! They just digitally enhanced the signal to communicate gloss, depth and texture...i'm just evaluating this in the name of technology! Honest!

  16. I can see the ads now... by Fex303 · · Score: 5, Funny
    The new Sony's will feature magic Hand-Wavey Technology(TM) to suck information that wasn't in the orginal signal into your TV from outer space.

    It's not zoom, it's digital enhancement. Which is what zoom is. But this is different. Yeah, right.

    More marketing BS.

  17. Like Blade Runner by jorgef · · Score: 4, Funny

    Remember Deckard's Sony photo machine?
    It's like that?

  18. I've always hated... by zarthrag · · Score: 5, Insightful

    ...Sci-fi's that use arbitrary plot fixes on photos that lack the resolution they need by using a computer to "zoom in and enhance" the image. Sometimes it's so ridiculous that I wanna belch. The only way this could truely be accurate is if the TV signal carries more data (for example, zooming on a 1080i HD signal). But HD has yet to approach critical mass...ugh.

    --
    Why can't all fpga/microcontroller manufacturers just release free optimizing compilers???
  19. It's a bird, it's a plane... by Effugas · · Score: 4, Informative

    It's superresolution!

    There's actually a whole host of algorithms that go well beyond the junk they throw at us for "digital zoom". The two most applicable algorithms for this particular problem -- increasing the resolution of video above and beyond the source data available in a particular frame -- are temporal integration (collecting data across multiple frames) and superresolution by example (automatically associating and recalling high resolution imagery when a low resolution equivalent is shown). Some example code:

    Temporal Integration: ALE
    Superresolution by Example: Image Analogies -- not automated, but remains one of the cooler pieces of code ever shown at SIGGRAPH.

    From the article, I'm guessing it's another ALE style stacker. They probably needed to write one for their cameras anyway.

    --Dan

  20. Re:yet another invention of the (not so ?) obvious by rebelcool · · Score: 4, Informative

    I mean zooming an image is no rocket science

    Yeah, its way harder. At least high quality image interpolation is. Theres been decades of research into it and dozens of different methods have been the topic of phd papers. Lots of high end math and very complex algorithms.

    Ever printed a photo on an inkjet printer? You're seeing a pretty strenuous use of interpolation algorithms there. A typical resolution image coming off of a digital camera only prints at maybe 2 or 3 inches across at the resolution a typical printer operates. So if say, you want an 8x10, your printing software does some serious interpolating.

    And not all printing software is equal, either. The algorithm makes all the difference. Its why you can get a so-so large image out of photoshop's print facilities (that uses bicubic) and a noticably better one from QImage (at the moment, pyramid)

    --

    -

  21. Useful for transition to HDTV by utexaspunk · · Score: 3, Insightful

    This may be useful for helping (pardon the pun) smooth the transition to HDTV. Right now most of our cable channels are not HD, and the difference between the HD and regular digital TV channels is quite stark. On a large screen, regular digtal TV becomes almost unbearable once you get used to HD. But more importantly, perhaps many people are uninterested in buying an HDTV because they know how little content is available and realize that most TV is going to look just as crappy anyway. This could be a good marketing point for Sony- a processor that helps non-HD TV look better on your big-screen TV.

  22. Fractal expansion by DMUTPeregrine · · Score: 3, Insightful

    could it be some sort of fractal expansion? Probably too cpu intensive. eg... http://www.lizardtech.com/solutions/gf/

    --
    Not a sentence!
  23. "digitally enhancing the signal" by tod_miller · · Score: 3, Insightful

    As anyone dabbling in image processing knows. Given any image information, you cannot add entropy to an image with certainty that it is correct.

    However they label thier zooming, if they are introducing information into the image then you have a false image.

    However, like the DivX 'warmth' plugin, randomised information can give us perceptual detail that is interpretted by our visual system to 'look right'

    Otherwise all are doing is zooming with subpixel antialiasing.

    In this day and age I think the signal is digital, so how is any modification of the original signal enhancing?

    Now enhancing is a very broad word, but to me this article is a marketting trip to consumer land, nothing new here, move along.

    --
    #hostfile 0.0.0.0 primidi.com 0.0.0.0 www.primidi.com 0.0.0.0 radio.weblogs.com
  24. True resolution of inkjet printers is much lower by hung_himself · · Score: 4, Informative

    A typical resolution image coming off of a digital camera only prints at maybe 2 or 3 inches across at the resolution a typical (inkjet) printer operates.

    Not true, because inkjet "resolutions" are really dot densities and not resolution (resolution would be how many distinct dots can you print per inch.) That's why laser printers with nominally "lower resolution" output crisper text. Also the dot density is for a single colour - complex hues such as skin tones have to be simulated by digital halftoning (essentially multiple dots forming larger colour pixels) techniques which reduce the effective resolution several fold depending on the colour being simulated and the accuracy desired. That's why continous tone printers such as dye subs with nominally "lower resolution" can give much sharper colour prints.

    Software would have a major effect on the quality of colour prints from inkjets but that would mostly be from how the halftoning was done rather than the interpolation per se...

  25. Poor article text by Jugalator · · Score: 3, Interesting

    Sony Develops TVs That Zoom in for True Close-ups

    No, they've developed a new version of a chip.

    They don't even know when they'll start developing "TVs that zoom in for true close-ups".

    Unlike the current TVs that simply scale the image, Sony's technology does 'true' zooming by digitally enhancing the signal to communicate gloss, depth and texture.

    Using which definition of "true"?

    --
    Beware: In C++, your friends can see your privates!