Slashdot Mirror


Google Brain Creates Technology That Can Zoom In, Enhance Pixelated Images (softpedia.com)

Google Brain has created new software that can create detailed images from tiny, pixelated images. If you've ever tried zooming in on an image, you know that it generally becomes more blurry. You'd just get larger pixels and not a clear image. Google's new software effectively extracts details from a few source pixels to enhance pixelated images. Softpedia reports: For instance, Google Brain presented some 8x8 pixel images which it then turned into some pretty clear photos where you can actually tell facial features apart. What is this sorcery, you ask? Well, it's Google combining two neural networks. The first one, the conditioning network, works to map the 8x8 pixel source image against other high-resolution images. Basically, it downsizes other high-res images to the same 8x8 size and tries to make a match on the features. Then, the second network comes into play, called the prior network. This one uses an implementation of PixelCNN to add realistic, high-res details to that 8x8 source image. If the networks know that one particular pixel could be an eye, when you zoom in, you'll see the shape of an eye there. Or an eyebrow, or a mouth, for instance. The technology was put to the test and it was quite successful against humans. Human observers were shown a high-resolution celebrity face vs. the upscaled image resulted from Google Brain. Ten percent of the time, they were fooled. When it comes to the bedroom images used by Google for the testing, 28 percent of humans were fooled by the computed image.

8 of 146 comments (clear)

  1. No CSI by Thelasko · · Score: 5, Informative

    I don't care how fancy the algorithm is, the original data was lost. This is still just a guess about the original content. It's just a better guess than was possible before.

    I just hope law enforcement doesn't think they can use this to solve any crimes.

    --
    One of our competitors trademarked the term "hypothesis". From now on, we will call them "boneheaded ideas".
    1. Re:No CSI by rmdingler · · Score: 5, Insightful

      Law enforcement would never rely upon unproven methods to improve conviction rates.

      --
      Happiness in intelligent people is the rarest thing I know.

      Ernest Hemingway

  2. Re:Blade Runner-esque? by threadsafe · · Score: 4, Funny

    I'm actually a dog on the internet because I didn't proof or spell check my previous reply.

  3. It's about time! by npslider · · Score: 4, Funny

    So in other words... from a small picture of the earth viewed from orbit, Google can now show me my house AND the address on the UPS package sitting at my doorstep?

    Amazing!

  4. Re:What about zoom out ? by K.+S.+Kyosuke · · Score: 5, Interesting
    --
    Ezekiel 23:20
  5. They've been watching too much TV by taustin · · Score: 4, Insightful

    TV Detective: "We have this security video showing the murder."

    TV Lab Rat: "It's too grainy to tell how is it?"

    TV Detective: "Can't you enhance it?"

    TV Lab Rat: "Sure. Who do you want it to look like?"

  6. Bad summary by swillden · · Score: 5, Informative

    The summary's explanation of what this does isn't correct. It says:

    Google's new software effectively extracts details from a few source pixels to enhance pixelated images.

    It doesn't extract details from a few source pixels. It invents details to add to those source pixels, based on the knowledge that the pixelated image is of a face, and of what faces look like. It produces something that plausibly fits the input data. How close this is to the original image, pre-pixelation, depends on what images were in its training set.

    This is an interesting piece of work, but it doesn't mean that you can recover data that has been discarded.

    --
    Note to ACs: I usually delete AC replies without reading them. If you want to talk to me, log in.
  7. Re:Blade Runner-esque? by FatdogHaiku · · Score: 4, Funny

    I'm actually a dog on the internet because I didn't proof or spell check my previous reply.

    Just paws before you hit Submit...

    --
    You have the right to remain sentient. If you give up the right to remain sentient, you will be elected to public office