The Algorithm That 'Sees' Beauty In Photographic Portraits

KentuckyFC (1144503) writes "Beauty is in the eye of the beholder. But what if the beholder is a machine? Scientists from Yahoo Labs in Barcelona have trained a machine learning algorithm to pick out beautiful photographic portraits from a collection of not-so-beautiful ones. They began with a set of 10,000 portraits that have been rated by humans and then allowed the algorithm to "learn" the difference by taking into account personal factors such as the age, sex and race of the subject as well as technical factors such as the sharpness of the image, the exposure and the contrast between the face and the background and so on. The trained algorithm was then able to reliably pick out the most beautiful portraits. Curiously, the algorithm does this by ignoring personal details such as age, sex, race, eye colour and so on and instead focuses only on technical details such as sharpness, exposure and contrast. The team say this suggests that any subject can be part of a stunning portrait regardless of their looks. It also suggests that "perfect portrait" algorithms could be built in to the next generation of cameras, rather like the smile-capturing algorithms of today."

Comments

Beauty of the photo, not the subject

[hcs_$reboot]

From TFA

The good news for many of us is that that the visual qualities of the person in the photographic have little impact on the beauty of the resulting portrait. “We find that race, gender, and age are largely uncorrelated with photographic beauty,” Instead, many of the factors that do correlate with beauty relate to the technical quality of the image. “Aesthetic score is related to sharpness of facial landmarks, image contrast, exposure, homogeneity, illumination pattern, uniqueness, and originality,”

So, no worries, here.

Re:a wasted effort.

[oodaloop]

beauty and ugliness, rich and poor, black and white, these are all concepts that in technology hold no relevance or meaning because theyre metrics by which we categorize and qualify people in often arbitrary and flawed ways.

And yet men the world over prefer women with waist/hip ratios between .68 and .71. What we consider physically attractive is directly tied to health and fitness to bear/raise children, not some arbitrary value.

Re:a wasted effort.

[bws111]

Did you actually read all the way through the summary? For that matter, did you even read the title? It finds beautiful PORTRAITS, not beautiful SUBJECTS. It does this by IGNORING age, sex, etc and concentrates on sharpness, contrast, and exposure. What exactly is the problem?

Re:Great....

[gstoddart]

You know, if amateur photographers would learn how to frame shots, that would be great. It would make most pictures suck less. The framing has been well described for decades. But there's more to it than just that.

But if you think all of the hacks with iPhones are suddenly going to make beautiful portrait photography, you underestimate just how bad most amateurs are.

In a world where the selfie stick is a real thing, I'm pretty sure the pros have nothing to worry about it your average person with a cell phone magically learned how to frame a portrait.

Indeed, the single most important factor is the sharpness of the image. But other important factors include the contrast between the face and background. Curiously, exposure quality is negatively correlated with beauty suggesting that photographers can create beautiful images by playing with under and overexposed images.

By the time you're talking about professional (or really good) photographers doing "fine art" photography, and understanding the mechanics of cameras it's simply a different thing.

And, I say this not as a "pro", but someone who has been taking pictures for much of his life -- taking decent pictures is more than just pointing the camera, and taking beautiful pictures involves a lot of technique.

Even gear isn't a guarantee ... I've seen people take shit pictures with an SLR, and I've seen people take quite good shots with a point and shoot.