Slashdot Mirror


HP Restores Creased Photos With Flatbed Scanners

An anonymous reader writes "Scientists at HP have developed a technique to detect creases in photographs using standard, unmodified flatbed scanners. Once correctly scanned into a computer, software can determine where the photograph's defect is, and artificially correct it to remove any trace of a crease or fold. The result is a spotless JPEG scan from a creased photo, with absolutely no modified hardware and no technical know-how required on the part of the user." They're using multiple light sources to do this, in a way that reminds me of last year's description of 3D image creation using an ordinary digital camera.

27 of 125 comments (clear)

  1. Nice by thewils · · Score: 4, Funny

    A fold-less centerfold :)

    --
    Once I was a four stone apology. Now I am two separate gorillas.
    1. Re:Nice by BadAnalogyGuy · · Score: 4, Funny

      It makes my blood run cold.

    2. Re:Nice by needs2bfree · · Score: 3, Interesting

      My memory has just been sold.

    3. Re:Nice by The+Archon+V2.0 · · Score: 2, Funny

      This will be great for pictures that are old, though not for ones that have been damaged by mold.

    4. Re:Nice by gEvil+(beta) · · Score: 5, Funny

      ...and it suddenly dawns on everyone exactly why Archon V2.0 failed in his childhood dream to become a lyricist...

      --
      This guy's the limit!
  2. Wait, wait by sottitron · · Score: 5, Funny

    Won't this ruin my collection of photographs of creased paper?

    1. Re:Wait, wait by SlashDotDotDot · · Score: 5, Informative

      Won't this ruin my collection of photographs of creased paper?

      Actually, no, it won't. Since the method uses different light sources to build a partial 3D model of the actual shape of the crease, your mere photographic creases won't be detected. You can breathe a sigh of relief.

      --
      /...
  3. !unmodified by muyla · · Score: 3, Interesting

    In the article it says that they use an unmodified scanner, but later on they claim to control the lights of the scanner individually... how is this not modifing the hardware?

    1. Re:!unmodified by muyla · · Score: 2, Informative

      Yeah, but I'm guessing there was no reason for the scanners to come with individual controls for each light before this technology

    2. Re:!unmodified by blackraven14250 · · Score: 2, Insightful

      There's also no reason for them to include the switches for each light in hardware when they can do it in firmware.

    3. Re:!unmodified by mcgrew · · Score: 2, Informative

      From a different FA:

      Now Malzbender's team has achieved the same effect using an off-the-shelf flatbed scanner. They rely on the fact that modern scanners use two separate light bulbs. This feature was added to scanners to improve colour quality, but it also lets you capture the image from two different angles. Re-scanning the object after rotating it 90 degrees provides a total of four different angles, more than enough to deduce 3D information about the object - mathematically, you only need three.

      To fix old, damaged photographs, the software flags every pixel in the scanned image that isn't lying flat against the scanner, an indication that there is a tear or a fold there. Then it automatically replaces those pixels by copying adjacent ones, smoothing over the damaged region

  4. Not really by Radagast · · Score: 5, Insightful

    I was hoping they were using that 3D information to do something interesting to actually restore the image. They're not.

    They're basically using rudimentary 3D information that they can get out of the scanner to determine that a crease exists. They then remove it with a simple infill algorithm, which is as basic as it gets (although it often works ok), and which you can find in most image editing software. It's no coincidence that the example image they use has a crease going over mostly similarly colored and low-detail areas.

    So what they're doing is not an improvement to restoration, it's just an improvement to defect detection. Basically, it saves you having to tell the software where the defect to be fixed is, the fixing is the same quality as it's always been.

    --
    --Joakim Ziegler
    1. Re:Not really by TheRaven64 · · Score: 2, Interesting

      Could still save some people a lot of money. I did some consulting a while back for a company that, among other things, digitises archives. Libraries send them books and they scan them then manually open each file, draw a line along the curve of the page, and then let the machine deform the image to remove the curve along the line of the text. This step takes several times longer than the scanning phase to do well. If a machine can recognise the creases then they can get rid of the humans in this process and increase their throughput considerably.

      --
      I am TheRaven on Soylent News
  5. Other uses for 3D info by bugnuts · · Score: 4, Insightful

    The rudimentary 3D info can be used for improving all sorts of scans.

    How about...

    - Flattening a scan of a book (by the spine)
    - Focusing an area that's raised (products like Focus magic assume a section is all out of focus at the same level, whereas a map of the amount of lost focus is possible here).
    - Using the above, scanning non-flat items.
    - Scanning nearly-flat 3d surfaces.

    Add a lens that can vary focus (based on the light differential) and you'd have a good 3D scanner for one side of a mostly-flat item, and a flatbed scanner that wouldn't lose focus on slightly-raised papers.

  6. Book valley detection by gurps_npc · · Score: 5, Insightful

    What we really need is a copy machine/scanner that can detect the valley formed by the spine of a book being copied and automatically correct for it. That would be worth it.

    --
    excitingthingstodo.blogspot.com
    1. Re:Book valley detection by Anonymous Coward · · Score: 3, Interesting

      Xerox did this already a few years back. And Google does it for their book scanning by projecting a laser grid and determining the 3d surface curvature of the book.

    2. Re:Book valley detection by BACPro · · Score: 3, Informative
  7. Quite so... by denzacar · · Score: 2, Interesting

    From the examples shown in the .PDF it seems that it is once again a case of a quick fix that only works on low-res and low detail photos, preferably in single color.

    And for it to work at all, you would need a 2-lamp scanner.
    Which are standard, but in high-quality print studios and other places that would do this kind of retouching by hand anyway in order to preserve or achieve better quality of the final product.

    --
    Mit der Dummheit kämpfen Götter selbst vergebens
    1. Re:Quite so... by nine-times · · Score: 4, Insightful

      From the examples shown in the .PDF [hp.com] it seems that it is once again a case of a quick fix that only works on low-res and low detail photos, preferably in single color.

      That doesn't seem like a terribly bad thing to me. If you were a professional looking for extremely high-quality results, then yes, you're going to want to spend a lot of time screwing around with things manually on each photo. Even if it's a largely automatic procedure, you'll probably still want to tweak the parameters a little for each photo, including things like brightness, contrast, and hue.

      However, there's another real-world application for this sort of thing: someone like my grandmother scanning lots of old pictures that may have been folded, crumpled, or otherwise damaged. Even if it's not giving the highest quality results, if the results are at all better than not processing the photo, then it's probably fine. Without automatic quick fixes, people might either scan it and leave the damage, or decide not to scan it at all. Giving even barely passable results is an improvement.

    2. Re:Quite so... by dangitman · · Score: 2, Informative

      Which are standard, but in high-quality print studios and other places that would do this kind of retouching by hand anyway in order to preserve or achieve better quality of the final product.

      Actually, most images are restored using digital techniques these days, because it can achieve better results than doing it by hand. You'd only do it by hand if you were talking about something like a historical artifact or unique artwork.

      --
      ... and then they built the supercollider.
  8. Uses of multiple light sources by Animats · · Score: 4, Informative

    Multiple light sources offer some interesting options. A few years ago, someone modified a digital camera (I think a Canon PowerShot) to have four flash sources instead of the usual one. The camera would take four pictures in quick succession, one with each flash. This allowed better edge detection.

    It was useful for applications like taking a picture of complex, dirty machinery (as under a car hood) and locating the edges, even where everything was roughly the same shade. It also helped when photographing very shiny objects, where the reflection from the flash was a problem. With each reflection from each flash unit in a different place, all reflections could be removed.

    It was too specialized to become mainstream, though. That seems to be the fate of 3D from 2D systems. Good ones have been built, but most have been either discontinued or turned into very expensive products for specialized use.

    1. Re:Uses of multiple light sources by Spy+Hunter · · Score: 2, Interesting

      There will soon be much less need for 3D from 2D hacks, because there's a new technology coming that produces 3D pictures directly: Time-of-flight cameras. Today they are really expensive but they're going to become much cheaper very soon. This is what XBox's Project Natal is based on.

      --
      main(c,r){for(r=32;r;) printf(++c>31?c=!r--,"\n":c<r?" ":~c&r?" `":" #");}
  9. This is all so ironic by vandelais · · Score: 2, Funny

    since it will restore the upskirt I took of Carly Fiorina that I accidentally creased.

    --
    Game: Player 'Donald J Trump' now has AI skill level 'experimental'.
    1. Re:This is all so ironic by Eternauta3k · · Score: 2, Funny

      I believe you'd have to scan her face. Good luck getting her to comply (tell her it's laser surgery!)

      --
      Yeah. Would you choose a neurosurgeon who pokes around people's brains in his spare time? I wouldn't.
  10. Re:Beer Goggle ware by ericski · · Score: 2, Funny

    Drink more beer. Problem solved.

  11. Re:Doesn't restore photographs by dangitman · · Score: 2, Interesting

    As a practitioner of traditional photography, I'm annoyed to no end by people who talk as if the concepts of "photograph" and "image" were one and the same. Photographs are unique physical objects that have mass. Speaking as if photographs are digital images is like speaking as if symphonies are .mp3 files.

    That's stupid. A traditional print is made from a negative or slide, so by your purist philosophy, restoring the print isn't actually restoring "the photograph." Digital images are photographs and vice versa. What matters is the image, not the medium it is presented on.

    Your idea of the photograph would be considered silly and outdated by the photographers of 50 years ago.

    --
    ... and then they built the supercollider.
  12. Re:Doesn't restore photographs by dangitman · · Score: 2, Insightful

    P.S:

    I probably shouldn't have used the term "purist philosophy" to describe your attitude towards photography in my previous post. Because it is neither pure or philosophy. A more apt description would be "nostalgic shortsightedness" or "ludditism."

    The word "photography" at its root, means painting, drawing or writing with light. And "light" is really the key theme, the other root of the word describing "capturing" the light more than anything else. A digital image displayed on a screen that is never printed, fits the definition perfectly, and could be argued to be more "pure" than a print because you are observing the emission of light directly. But I won't argue about purity, because that's a completely irrelevant concept here, as photography was never "pure" to begin with.

    I find your attitude to be insulting to photography. What is "traditional photography" anyway? Photography is a science, a craft, and an artform that has always been changing, and always at the cutting edge of technology and culture. Photographers have always been striving for new techniques and tools. To say that there is some "traditional" form that has some kind of purity or superiority to others is ludditism. Do you think that any of the pioneers of traditional photography would shun the digital form, rather than embrace it as a tool?

    I say this as a person who has explored your idea of traditional photography for many years, and who still sometimes uses film and darkrooms and cameras that are half a century old. I too, have nostalgia for black-and-white film and beautiful prints. But to say that a digital image is not a photograph, or is some how less worthy, is nonsense.

    Why is it that you are so annoyed by people who use "photograph" and "image" interchangeably? They are the same thing. Are you upset by people using language accurately? I think you're suffering from a very misplaced sense of romanticism and nostalgia. That's not good. Imagine if in earlier years, people acted on such romanticism, and decided that the Daguerreotype was the only real photography (it's certainly more "pure" than negatives and prints) and never developed flexible film, 35mm film, rangefinder cameras, SLRs and the like. Where would your traditional photography be now?

    Isn't your idea of traditional photography just a bastard stepchild of Daguerre and Talbot? Why aren't you using those metal plates instead of those newfangled films?

    --
    ... and then they built the supercollider.