Detecting Faked Photographs Gets Easier

nusratt writes "Some years ago, an issue of 'Whole Earth' had a convincing cover-photo of a flying saucer cruising low over downtown San Francisco in broad daylight. The accompanying feature article proclaimed that photographs can no longer be trusted as evidence of anything, because of the ease of doctoring images digitally and undetectably. Now, Dartmouth Professor Hany Farid and graduate student Alin Popescu 'have developed a mathematical technique to tell the difference between a "real" image and one that's been fiddled with.' Farid says, 'as more authentication tools are developed it will become increasingly more difficult to create convincing digital forgeries'." There's also an NYT story.

Comments

Seamless Math Next?

[mfh]

While it may become increasingly difficult to forge digital images, and even forge hard currency, the result could be of two possibilities;

1. Forgers get smart and use older cameras to take a picture of a digital forgery to pass as an original, using blurring techniques offered by physical means and lens... etc (easy)
2. Forgers quit being forgers (unlikely)
3. Alteration technologists create armor against image forgery detection algorithms (possible)

For me, I think any time spent trying to beat the detection of forgeries would be a good thing in terms of art and creativity -- not to mention the possibility of better digital growth algorithms to join layers mathematically seamlessly (which could be used in games and simulation engines for better realism). However, law enforcement agencies might try to combat the circumvention of forgery detection by charging people with crimes for only trying to make their images more realistic and improve technology. It's a messy issue, that will sort itself out over time.

In Doom 3 Bloopers, a mod I've started on, I am looking at ways of integrating realworld imagery into the mod, and this detection stuff could actually help me to better integrate my own art and images if I can find a way around it. Let's face it, if the math says it's an original, the human eye will be fooled, which is the goal of most video game design. If anyone wants to help along those lines, they should contact me!

Re:Seamless Math Next?

[Anonymous Coward]

I gotta say, while the first half of your comment was certainly insightful, that was one of the most blatant attempts to force your pet project into an unrelated comment I've ever seen!

You, sir, have balls!

Re:Seamless Math Next?

[Ieshan]

It seems as though the algorithm they have works on the fact that there's some statistical difference between a real image and a faked one, but not 100% of the time.

Why wouldn't someone simply build a filter into a program that changed bits in an image until it passed a check by their algorithm - on failing, it would simply go back and change more appropriate bits?

Seems as though it would be a computationally intensive but a logically easy task.

Re:Seamless Math Next?

[yintercept]

My first thought on the article was the same. The mathematical tests to determine fake photos will have value only until the fake photo industry builds the tests into their software. For that matter, I suspect that the main use of the Hany Falid method will be to make your fake photos even more realistic.

The most interesting line in the article was:

but computers make it easier for more and more people to manipulate images.

One could read into these lines that the ability to fake photographs was great until anyone could do it. Now that we know how easy it is to fake photographs, we no longer implicitly trust messages...but we will trust mathematically authenticated fake photographs because math is infallable.

Re:Seamless Math Next?

[Megahurts]

One could read into these lines that the ability to fake photographs was great until anyone could do it. Now that we know how easy it is to fake photographs, we no longer implicitly trust messages...but we will trust mathematically authenticated fake photographs because math is infallable.

Or you could read into them that when it was rare and difficult to fake photographys, most of the photographs you saw were genuine, so you could place a decent amount of trust in what you were seeing. Now that faking photos is easy and commonplace, you can no longer place much trust in photos. With mathematically verified photos, you can place more (though not complete) trust back in the photo. It isn't foolproof but the level of assurance is significantly higher.

Or you could realize there's inherent error in any statistical method, and that with a little bitof foresight, this error could be expoited to provide false results. The best detector of falsified photography is still a well-trained human eye. The key to knowing whether or not to trust images is to train your eye.

Re:Seamless Math Next?

[NanoGator]

"Seems as though it would be a computationally intensive but a logically easy task."

Probably. Consider this, though: Fingerprints are common knowledge. We ALL know that if we commit a crime, fingerprints will be lifted to try to catch us. There are well known ways to defeat this, but remarkably, LOTS of people are still leaving fingerprints as clues at a crime.

I hope you can forgive me for reading a little more into your post than you actually said. I don't know for sure if you were going the "this could easily be defeated, thus it is ineffective" route. But I thought this would be as good of time as any to mention this.

Actually...

[julesh]

I think authentication tools make it easier. As someone who's tried a little photo manipulation in the past, I can tell you that the hardest thing is knowing when something's right. If you have an automated tool that can tell you when it's right, it becomes easier. Of course, that relies on the tools working...

Self Defeating

[Dozix007]

While an equation to make sure that a photo is not forged is all well and good, it is self deafeating. Just like simple encryption, which is good for people with simple problems, exploring the equation will yield a way to fool it. If you have someone who truely wants to forge a photo, they probably could still defeat the check.

So much for my faked photo of Rumsfeld & Sadda

[The I Shing]

Now they'll be able to prove that my photo of Rumsfeld shaking hands with Saddam in 1983 is a fake.

Rumsfeld was really shaking hands with an alien, and Saddam was shaking hands with Elvis, but the resulting merger of the two photos was much more provocative.

Just a thought...

[julesh]

Farid and his students have built a statistical model that captures the mathematical regularities inherent in natural images.

I wonder if they've considered the potential applications in image compression?

What kind of digitized photos does this work on?

[multiplexo]

If I take a high resolution TIFF image and start mucking with it I can see how it would be easy to find the manipulations (especially if you're as thumb-fingered as I am with PhotoShop). However with most digital cameras using various compression schemes to store the images how can you tell what is a result of manipulation versus what is an artifact of compression and or digitization? Certainly some gross manipulations will be obvious compared to the properties of compressed images, but I would imagine at some point you'd be hard pressed to say "this image was deliberately manipulated" instead of "this is a compression or digitization artifact".

While this might not be a problem for gross manipulations (the faked John Kerry/Jane Fonda photo being a recent example) I can imagine a class of images where subtle manipulations caused great effects and were not readily distinguishable from compression artifacts.

Okay, but here's my question.

[Anonymous Coward]

Farid's algorithm looks for the evidence inevitably left behind after image tinkering. Statistical clues lurk in all digital images, and the ones that have been tampered with contain altered statistics.

That makes sense. However, it seems like these statistics would be based on very minor details. What happens if you run their analyzer on an image that has been altered by using lossy image compression, such as JPEG compression? Lossy image compression is designed to obliterate details humans wouldn't notice; some of these details might be significant to their statistical model. Would JPEG-compressing an image make it impossible to determine its veracity? Would their software just tag all JPEG images with compression below a certain threshold as being "unnatural" (since they have been, after all, digitally altered-- just not digitally altered in a content-relevant way...)

And don't some digital cameras use lossy formats such as JPEG as their native storage format?

The unfortunate thing

[Anonymous Coward]

The article says the research is founded by the Department of Homeland Security. That means that despite the many useful possible aspects of this technology, it will probably never see the light of day. If the DHS is going to be using this technology to identify faked photos, it would be greatly in their interest for the full algorithm and its implementations to not be made available to the public-- since after all if people know what the DHS is using to determine faked photos, they can target the algorithm.

Now that I have written that, looking around, it appears I am actually wrong. If you look at Mr. Farid's personal page, it appears he will be publically presenting a paper covering the fakeness-detection algorithm. I hope the full algorithm will be presented to the academic community.

A more in-depth article

[asterism]

If you are looking for more detailed information, along with equasions, here is a link to one of their recent publications on the topic: http://www.cs.dartmouth.edu/~farid/publications/sp 04.html

practical use

[Slothy]

Run it on the goatse guy! If the results are positive I can finally start sleeping again.

Admissibility of Digital photographs as evidence?

[walmass]

There are stories about successful defense against digital photographs in criminal cases. "Enhancements" using photoshop can be considered evidence tampering. So this technique can have a life-altering implication for some people.

Re:What kind of digitized photos does this work on

[blonde rser]

The NY Times article deals with this directly.

But Professor Farid said that for now the technique does not work as well with files created in JPEG, the compressed picture format most commonly used online. As the size of a JPEG file shrinks, the correlations between pixels become much less obvious. "At 90 percent quality, it falls apart very quickly," Professor Farid noted.

So good point. That does seem to be a problem. The NY Times article has more details than the other; it is worth reading.