Slashdot Mirror


GPU Accelerated Realtime Skin Smoothing Algorithms Make Actors Look Perfect

dryriver writes: A recent Guardian article about the need for actors and celebrities -- male and female -- to look their best in a high-definition media world ended on the note that several low-profile Los Angeles VFX outfits specialize in "beautifying actors" in movies, TV shows and video ads. They reportedly use a software named "Beauty Box," resulting in films and other motion content that are -- for lack of a better term -- "motion Photoshopped." After some investigating, it turns out that "Beauty Box" is a sophisticated CUDA and OpenGL accelerated skin-smoothing plugin for many popular video production software that not only smooths even terribly rough or wrinkly looking skin effectively, but also suppresses skin spots, blemishes, scars, acne or freckles in realtime, or near realtime, using the video processing capabilities of modern GPUs.

The product's short demo reel is here with a few examples. Everybody knows about photoshopped celebrities in an Instagram world, and in the print magazine world that came long before it, but far fewer people seem to realize that the near-perfect actor, celebrity, or model skin you see in high-budget productions is often the result of "digital makeup" -- if you were to stand next to the person being filmed in real life, you'd see far more ordinary or aged skin from the near-perfection that is visible on the big screen or little screen. The fact that the algorithms are realtime capable also means that they may already be being used for live television broadcasts without anyone noticing, particularly in HD and 4K resolution broadcasts. The question, as was the case with photoshopped magazine fashion models 25 years ago, is whether the technology creates an unrealistic expectation of having to have "perfectly smooth looking" skin to look attractive, particularly in people who are past their teenage years.

24 of 138 comments (clear)

  1. Comment removed by account_deleted · · Score: 4, Interesting

    Comment removed based on user account deletion

  2. Won't 4k kill this for a while? by wonkavader · · Score: 3, Funny

    "The question...is whether the technology creates an unrealistic expectation of having"
    blurry, featureless skin.

    1. Re: Won't 4k kill this for a while? by Anonymous Coward · · Score: 3, Funny

      So we've gone full circle, we have invented SD video

    2. Re: Won't 4k kill this for a while? by Anonymous Coward · · Score: 2, Interesting

      I saw a discussion with a few professional directors at Broadcast Video Expo a few years ago and the interviewer goes 'so are you excited for 4k'? and one answered that as most ladies wouldn't want to be seen in that sharp detail they would have to use smoothing filters (like real glass ones) so you didn't have 4k and so was a bit pointless. they were all more interested in HDR.

      on personal opinion.. whens the last time you watched a film and said 'that was quite good, but it would be better if it was sharper'. my complaints about movies dont involve being sharper (unless the focus puller fucked up)

    3. Re:Won't 4k kill this for a while? by AmiMoJo · · Score: 2

      That's the default setting on most camera apps for phones. All they did was accelerate it to realtime.

      Unfortunately photoshopping is basically the default now. No skill required, the app magically makes you look better without even bothering to ask if that's what you want, before offering to upload to Facebook or Instagram.

      Either we have to build the tech into every mirror or start educating people how harmful it is pushing for natural beauty and imperfections to be the standard. Just as some magazines and fashion brands were doing that we got hit with the apps.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
    4. Re:Won't 4k kill this for a while? by mentil · · Score: 2

      Not going outside without a box over my head with a QR code on it that leads to an app that lets you see a digitally-enhanced version of my face. Take that, reality!

      --
      Corruption is convincing someone that the selfless ideal is the same as their selfish ideal.
  3. Re:Probably not. by iggymanz · · Score: 4, Interesting

    It looks silly to me, especially knowing the actors' real life appearance, to see a bunch of living mannequins in a movie. Even the piled on makeup opera or play performers wear looks ridiculous, they're like clowns and I must laugh.

  4. Re:Technology Curve? by DontBeAMoran · · Score: 2

    Americans have been using 60-years-old as teenagers in sitcoms for decades, so it's not really going to change anything.

    --
    #DeleteFacebook
  5. The problem... by mholve · · Score: 4, Interesting

    This technique has been used for still photography for years now, and has the same issue under video (even more so)... There's a very fine line between skin smoothing - and making it look like plastic. When it's overdone, even slightly, you do notice it, and it doesn't look right.

    1. Re:The problem... by geekmux · · Score: 5, Insightful

      This technique has been used for still photography for years now, and has the same issue under video (even more so)... There's a very fine line between skin smoothing - and making it look like plastic. When it's overdone, even slightly, you do notice it, and it doesn't look right.

      Let's be realistic here. Any amount of digital manipulation isn't going to change the shock value once you meet the actor or actress in meatspace. They're all going to look different/look older/look like shit by comparison.

      And the fact that photo manipulation is still alive and well after decades tells you the popularity in which video manipulation will be welcomed with open arms. The world is full of lies, and people love it.

    2. Re:The problem... by ShanghaiBill · · Score: 2

      The next step should be to virtualize the concept of "celebrities" and just completely regenerate the appearance of the actors. So a filmmaker could hire anyone for the role, based solely on their ability to perform, and then switch their face and appearance in post-production to match the "star" of the film who doesn't actually exist.

      There are virtual celebrities like Hatsune Miku, but in the future they will look like real people, only perfect.

  6. Fucking stupid by reanjr · · Score: 5, Interesting

    If the resolution of movies is so high that they are essentially applying a blur filter everywher, then maybe we should back off the higher resolutions. What's the point of high res capture if you're just going to muddy the image in post processing?

    1. Re:Fucking stupid by Roger+W+Moore · · Score: 3, Insightful

      ...or maybe they should stop using blur filters because it is fine to see actors and actresses with a few wrinkles. However, I don't think this is a blur filter because otherwise, it will look terrible on a big movie screen where it is intended to be used.

    2. Re:Fucking stupid by Solandri · · Score: 4, Informative

      What's the point of high res capture if you're just going to muddy the image in post processing?

      In photography, the basic algorithm is to use a high-pass filter to identify high-contrast regions (places with lots of edges. Turn that into a mask and invert it. Apply a blurring algorithm to the picture, using the mask to exempt the high-contrast parts of the pic (places with lots of edges.) The final result is a pic where low-contrast surfaces (like skin and sky and blurred backgrounds) are blurred, but high-contrast edges which contain detail are untouched.

      I never liked doing it (I prefer realistic photos), but it was sometimes necessary to counter a sharpening algorithm run across the entire picture, and prevent skin blemishes from being exaggerated. Also, I found that if I first showed my female friends their photo after running it through the above algorithm, they were much less likely to threaten to kill me if I ever released that photo to the public. Who says flattery never got you anywhere?

  7. Re:Probably not. by Roger+W+Moore · · Score: 2

    I have no problem doing this for fiction.

    So, actually, you really don't have a problem with using it in political ads.

  8. Nothing new here by petes_PoV · · Score: 4, Insightful

    whether the technology creates an unrealistic expectation of having to have "perfectly smooth looking" skin

    As the article alludes, this is nothing more than a digital form of makeup. And that has been used for decades for TV and films - and even longer in the real world.

    There really aren't any additional issues here. If is simply a modern version of an old, old, tradition.

    --
    politicians are like babies' nappies: they should both be changed regularly and for the same reasons
    1. Re:Nothing new here by dryriver · · Score: 2

      Except that makeup is bound by "physical universe" constraints. Like photons bouncing off it and into the camera sensor or photochemical film. Image processing algorithms on the other hand are NOT bound by these constraints. Image processing can create "skin looks" that are practically impossible to achieve with even the best makeup. You are looking a celebs that have a "heavenly glow" or "saintly glow" to them anywhere, in all locations, under all lighting conditions. You are essentially creating "digitally enhanced Gods and Goddesses" out of slightly-better-than-ordinary looking mortals who are famous for doing whatever. People who look supernaturally amazing, always, in any situation. And of course this tech is eventually going to deliver "super beautiful skin looks" when it goes 3D-aware as well. You'll be able to play God with the specularity, reflectance, sub-surface scattering and other aspects of actor or model skin, resulting in skin that looks so "alluring" that no man or woman in real life can match it with ANY skin product. Thus lifting "celebrities" very high above "ordinary mortals" in terms of how they look. Today you can go out on the street and see real-life people who look just as good as the best looking celebs or better. Tomorrow, you may find that digitally enhanced millionaire or billionaire celebrities look so amazing that everyone else just looks tired or ugly by comparison. Is that a good thing?

      --
      Why did the chicken cross the road? Because Elon Musk put an AI chip in its head.
    2. Re:Nothing new here by argStyopa · · Score: 2

      It only matters until they replace the troublesome, expensive, neurotic human actors anyway.

      --
      -Styopa
  9. Should be banned for beauty commercials by ET3D · · Score: 3, Insightful

    Anyone trying to sell a beauty product and using this should be sued.

    Other than this, yes, I think it's a problem that people can't be accepted as they are. Of course we already use makeup, etc., but if anything we should move in the direction of accepting how people look instead of trying to stylise them further.

    1. Re:Should be banned for beauty commercials by Anonymous Coward · · Score: 2, Informative

      If you watch the demo reel, you will see that it is being used with regards to beauty products. That is a level of deceit that should not be tolerated. If the industry cannot effectively prohibit this, then the government needs to step in.

      If you can achieve the result in the real world with your cosmetics, go ahead and do so. If the result shown requires digital effects, then it should be banned.

  10. Sigh by nospam007 · · Score: 2

    That's why I prefer English movies and series.
    There at least you see real people, not a bunch of 27 year old model types with fake hair, fake teeth, fake boobs and fake noses.
    That just makes it look unreal and this will make it still worse, if that is possible.

  11. Take my money! by paiute · · Score: 2

    I can't wait to get a pair of Google Glasses with this software installed so I don't have to loot at your all's ugly faces anymore. Is there a setting of 11 on this menu?

    --
    If Slashdot were chemistry it would look like this:Cadaverine
  12. Re:Probably not. by ceoyoyo · · Score: 2

    Apparently the best predictor of electoral success is candidate appearance (not money spent). So many people DO base their vote on zit counts. Although beautifying might not be the best idea for political ads. The predictor for US presidential elections was the candidate who looked "most presidential," which might not be the same as "youngest" or "prettiest."

  13. When making a video of your product by quonset · · Score: 5, Informative

    Make sure you include snippets of other videos which bounce around so much you can't tell what you're looking at.

    That way you can show off your product to its full effect.