Slashdot Mirror
Photoshop CS5's Showpiece — Content-Aware Fill
Barence writes "If you're looking for reasons to upgrade to Photoshop CS5 when it arrives, a new demo video might just persuade you. Narrated by Bryan O'Neil-Hughes, a product manager on the Photoshop team, the video shows the new content-aware fill tool, which has the potential to revolutionise the way you clean up photos. If you're not happy with an item in your picture, select it, delete it, and Photoshop will analyse the surrounding area and plug the gap as if it never existed."
Content-aware fill is different from content-aware resizing. Content-aware fill is basically a clone brush that automatically decides how to make the cloned area match into its surroundings instead of just copying and pasting content.
Photoshop has had that capability natively (ie, not requiring a plugin) since CS4, this is the ability to select an object in an image - litter on a lawn was the example given in the article - and replace its former location in the image with content derived from the surrounding areas. Basically it's like an intelligent, automated version of the Clone Brush tool on steroids.
UNIX? They're not even circumcised! Savages!
Liquid rescale is an implementation of the Seam Carving technology which was incorporated into Photoshop CS4 as a feature titled Content Aware Scale.
This new feature comes from an algorithm titled PatchMatch which was presented at SIGGRAPH 2009:
http://www.cs.princeton.edu/gfx/pubs/Barnes_2009_PAR/index.php
Welcome my "getting modded Insightful for not RTFA and spreading bullshit" overlords at Slashdot.
Content-aware scaling has been included in Photoshop since CS4.
But this is no scaling, it's filling. The first 3 minutes of the video are not so interesting (nothing one could not do with a clone stamp in 2 seconds), but the last 2 minutes are breath-taking.
GREYCstoration or liquidrescale don't even come close.
In fact the first one he removed he had to undo and do it over again because it didn't look right.
I'm guessing you know very little about Photoshop. The one that he undid the first time was because he used the Healing Brush tool (which has been in PS for several versions now) to show how poorly the closest tool that Photoshop currently has would do the job. He then showed us how the Content Aware Fill Tool would do it. This was very clearly explained in the voiceover. Also, this isn't intended to be the only tool you use. He's showing us how far you can get by using the new tool. You'll still need to go through the image carefully and touch up edges here and there. But as a first step, to use the words of the Vice President, this is a big fucking deal!
Nope not put you out of a job, just lower your wages to $8.95 an hour because monkeys can now do your job.
Welcome to what us in Photography have had to deal with. I just saw an AD on the TV for a mall photo studio that will give you 20 shots in their studio for $9.95. and 8X10 prints start at $4.95 each. Yes I know it's done by no talent kids or minimum wage people, but the average consumer does not know that. They still think that it's all in the cost of the equipment and has nothing to do with skill and experience.
Do not look at laser with remaining good eye.
Includes more detail about the algo
- Developed with researches at Princeton
- Demo'd at SIGGRAPH in Aug. 2009
- Old spot-healing tool tried to find one match for the hole; new tool copies multiple patches from the surrounding BG to fit into the hole, as well as finding & copying surrounding patterns
http://www.youtube.com/watch?v=S9vbHRcrbdQ&feature=related
The English word fart is one of the oldest words in the English vocabulary.
That capability has been available for a while in the Gimp as part of the Resynth plugin:
http://www.logarithmic.net/pfh/resynthesizer
It lets you resynthesize a texture, fill in a selection with surrounding content, and synthesize images "in the theme" of another image.
A few days ago I was reading about some of the algorithms for doing this, shown at Siggraph in recent years. I think it's real.
GCHQ Quantum Insert installed. If only our tongues were made of glass, how much more careful we would be when we speak
Reminds me of this old story:
Content-Aware Image Resizing
http://tech.slashdot.org/article.pl?sid=07/08/25/1835256
It's a very cool GIMP plugin for some things, but...
This is my source image:
http://s3.images.com/huge.28.142421.JPG
I want to remove the lady on the right, so I select her:
http://img714.imageshack.us/img714/1346/resynthesizerselection.jpg
And then, per the Resynthesizer page's recommendations, I use "Script-Fu/Enhance/Smart remove selection..."
http://img121.imageshack.us/img121/228/resynthesizerresultradi.jpg
Oh dear.
Anybody with access to the Photoshop beta feature want to give that image a stab? For all I know it fails just as spectacularly - but from the research it's based on, I highly suspect it'll fare better.
They sorta have it.. http://www.youtube.com/watch?v=dCr96ldClz4
obvious question: workflow / parameters?
Generally I use the foreground select tool* to select the smallest area to cover the object, then grow selection by a few pixels so that none of the object's edges are poking out and confusing it, then filters - map - resynthesize (ie, use the plugin rather than the script), and have the "tilable" options disabled since they tend to grab samples from the opposite edge of the image (if I want a tilable image, I'll use the tiling filter separately...)
Probably the biggest factor for simple success is to have the object you want to remove be on its own (surrounded on all sides by similar textures) -- if it isn't, then you need to do things the long way -- eg, if you want to remove the leftmost wheelchair from this image, and you want it to be replaced by grass when three of its borders are touching non-grass, then you'll find that it ends up somewhat messy since it attempts to merge four different edge textures. In this case you'll need to copy a section of your desired fill texture (ie, a rectangle of pure grass) into a separate image (specifically, a single layer image with no transparency); then on the original image select the object to remove, open resynthesizer, and select the "fill texture" image as the texture source; this way the generated texture will both match the surroundings of the original as much as possible, while being filled with the "surroundings" that you've specifically chosen. Having taken a sample of "pure grass" and a sample of "pure stone", then removing the top and bottom halves of the wheelchair with each respectively, the results are nicer. (with the exception that the first two images were produced with a mouse and twenty minutes of careful selecting, and the final one was 5 minutes work with a laptop nipple, so there are still some bits of wheelchair poking out of the sides...)
Incidentally, does photoshop have SIOX yet? Having the features "vaguely scribble in the general area of an object to have the object selected precisely" and "automatically and realistically remove a selection" could potentially combine to form "one-click realistic object removal" \o/
I mod down anyone who says "I will be modded down for this", regardless of the rest of their comment