Slashdot Mirror


AI Can Generate a 3D Model of a Person After Watching a Few Seconds of Video (sciencemag.org)

An anonymous reader shares a report: A new algorithm creates 3D models using standard video footage from one angle. The system has three stages. First, it analyzes a video a few seconds long of someone moving -- preferably turning 360-degree to show all sides -- and for each frame creates a silhouette separating the person from the background. Based on machine learning techniques -- in which computers learn a task from many examples -- it roughly estimates the 3D body shape and location of joints. In the second stage, it "unposes" the virtual human created from each frame, making them all stand with arms out in a T shape, and combines information about the T-posed people into one, more accurate model. Finally, in the third stage, it applies color and texture to the model based on recorded hair, clothing, and skin.

43 comments

  1. So . . . by Anonymous Coward · · Score: 0

    It's a scan without a scanner. Again, though more convenient, we already have this, I'm failing to see the 'revolution'.

    1. Re:So . . . by Wraithlyn · · Score: 1

      Every armchair genius in here commenting about how this is nothing new or impressive is completely missing that this creates a fully posable and articulated model with joints, etc.

      Please show me a prior example of an existing solution that accomplishes the same thing from regular video footage.

      --
      "Mind, as manifested by the capacity to make choices, is to some extent present in every electron." -Freeman Dyson
  2. I can see this being popular with the gamer crowd by mark-t · · Score: 1

    Assuming that it can be made to run on home computers, that is.

  3. rotating 360 degrees? by Anonymous Coward · · Score: 0

    "preferably turning 360-degree to show all sides"

    So it's a 3D scanner where the object rotates rather than the camera.

    https://en.wikipedia.org/wiki/3D_reconstruction_from_multiple_images

  4. Motion is still lacking by glenebob · · Score: 1

    Based on the video, what we should really be working on is how to make such models move like a real human.

    1. Re:Motion is still lacking by Anonymous Coward · · Score: 1

      Based on the video, what we should really be working on is how to make such models move like a real human.

      And yet another reason I grow to hate AI. It easily brings as much bad as good, if not more.

      Simply put, once you have an accurate model of a human, that you can't easily tell from a real one, then you just green screen an actor with the same basic body shape and positioning pads in a camera, and we have "proof" of whatever you wanted proof of.

      Perhaps you could still spot such fakes today, but for how much longer? And, really, how many people would notice even today? I know this isn't the first story that has a similar ability to generate fake video...

      I'm still half expecting a tape of Trump in a Russian hotel to appear, regardless of whether one originally existed. Republicans might fake one or prop a weak one up as a target dummy just so they could uncover the evil conspiracy theory. Slaying the straw men is a popular fad with them. Hell, I wouldn't put it past some particularly angry democrat, or just a foreign nation wanting to stir the pot.

      The point being, what if we reach the point that video proof means nothing if it is not backed up by half a dozen witnesses with no apparent axe to grind? I suppose some of that might be mitigated by having the video created by certified hardware with encryption and signatures every step of the way, maybe...

    2. Re:Motion is still lacking by glenebob · · Score: 2

      Hating the inevitable doesn't seem very useful. It isn't "what if", it's "when".

    3. Re: Motion is still lacking by javaman235 · · Score: 1

      Yes, hardware on blockchain, distributed so no one can be "ministry of truth". Video editing software then must publish their source videos, with veracity to be trusted, and final product also checksumed on chain.

      --
      -The art of programming is the pursuit of absolute simplicity.
    4. Re:Motion is still lacking by Anonymous Coward · · Score: 1

      Well, the terrorists in Douma didn't even need automatic 3D scan or AI. They only needed to spread the rumor of a chemical attack, film panicked people dousing each other with water, fetch a few corpses of babies and add them to the "movie stage".
      This requires to have a few suffocating people (they had inhaled smoke due to being in a war zone) and a few dead babies around.

      Then, everyone can call the US, UK and France for their bullshit. But will the journalist and their so-called free press dare question the story? Not at all it seems. Not in print or airwaves.

      Possibly, there will fake videos made with 3D models some day, you'll be able to spot them if you really want, but we'll be collectively coerced into believing or stating they're real.

    5. Re:Motion is still lacking by flux · · Score: 1

      There exists some pretty compelling research on having a 3d model walk a complicated terrain in a natural looking fashion.

      But I was unable to find the video :(. It probably isn't older than a year or so..

    6. Re:Motion is still lacking by Anonymous Coward · · Score: 0

      Trump's wife is Russian. How more fucking proof do you want?

    7. Re: Motion is still lacking by Anonymous Coward · · Score: 0

      Jus wait until the Deepfakes cloud integrates this tech.

  5. You call that AI? by Anonymous Coward · · Score: 1

    Doesn't seem like it has much to do with artificial intelligence.

    Neat scanner program, though.

    1. Re:You call that AI? by K.+S.+Kyosuke · · Score: 1

      Presumably, this is domain-specific: it seems to use the limited information available to solve a constraint problem. So it's not just a scanner program.

      --
      Ezekiel 23:20
  6. 3d by Anonymous Coward · · Score: 0

    And next it shows you killing Kennedy.

  7. AI? Oh wait, "algorithm" by Anonymous Coward · · Score: 0

    Yup, Slashdot is nothing but a garbage outlet for AI hype. Guess msmash is using this site as their thesis for their A.S. in Marketing.

    1. Re:AI? Oh wait, "algorithm" by nonBORG · · Score: 0

      AI meaning a program or system using A Nural network with deep learning.
      Don't confuse AI with actual intelligence it can look like it is intelligent especially with a specific task (which it has been trained for.) Similar to how a human learns a task in some ways but still obviously takes some steps all of which need to be trained to produce the required result.
      If you think of these tasks as functions any of which may or may not require a Nural network they you can see that AI can provide advanced programming techniques. But you don't just load it onto your car and say learn to drive, it is a bit more step by step like understand this input and that input and produce these outputs form that.

      AI is a buzz word but it is not inaccurately used in the situation where someone is actually using these techniques.

      What the article shows them doing is cool their method aside.

      --
      You can't handle the truth! - Because I don't post left all my comments get modded down, bye bye Karma.
  8. Generalizing The Entire Person by pubwvj · · Score: 1

    ...In the next stage the system uses the phenotype information shown in the video combined with the 99.9999% shared genetic information between all humans to create a nearly exact genome for the person. ...In the final step the AI system uses your likes, preferences, cookie trails and other information gleaned from your online life to fill in the life experience portion and recreate your personality.

    This all allows the marketers to then pinpoint your exact weaknesses to advertising so that you BUY, BUY, BUY, BUY!!!!

    1. Re:Generalizing The Entire Person by TimMD909 · · Score: 1

      ...In the next stage the system uses the phenotype information shown in the video combined with the 99.9999% shared genetic information between all humans to create a nearly exact genome for the person. ...In the final step the AI system uses your likes, preferences, cookie trails and other information gleaned from your online life to fill in the life experience portion and recreate your personality.

      This all allows the marketers to then pinpoint your exact weaknesses to advertising so that you BUY, BUY, BUY, BUY!!!!

      You've got two different Futurama episodes mashed together there. Seriously, do yourself a favor and brush up on our religious texts.

  9. Stop with the AI by TimMD909 · · Score: 1

    Jesus... Everything is AI these days. That's like calling a newborn baby making fart noises a classical musician. At best, the baby could be employed for background music in mumble rap songs. A classical musician? Heavens no.

  10. AI porn by kcelery · · Score: 1

    This is one step closer to the computer generated porn.

    1. Re:AI porn by Anonymous Coward · · Score: 0

      Um, no. Did you even watch the video? The people looked like zombies from a crappy 90's video game.

    2. Re: AI porn by Anonymous Coward · · Score: 0

      First thing I thought of was to map the generated model into a game like Honey Select and it's exactly that. Someone really needs to offer a complete turnkey software solution for this--wherein you'd be able to drag and drop a video clip of the person you're interested in and a second later a character model ready for export to Honey Select would be generated. Dang, someone will get rich selling that app. Hurry up with it already!

    3. Re:AI porn by Bite+The+Pillow · · Score: 1

      It isn't useful till it can differentiate the booty between Jessica Alba in Idle Hands and Jessica Biel. Until then body modeling is only a vague suggestion that people are different.

      Locating the joints automatically is nust a step above marking them manually and using a generic body.

  11. Re:Maybe AI can find proof of chem attack by Anonymous Coward · · Score: 0

    Please, 911 attacks definitely happened and were carried out by Saudis. The proof that it happened is : two enormous planes flew into two enormous towers.

    The last thing we need is that people seeking truth and denouncing the crimes of the US, UK and France get smeared as WTC conspiracy lunatics.
    In fact, being skeptical of unsubstantiated conspiracies is maybe what's needed to denounce real conspiracies.
    My take : WTC wasn't an inside job. Iraq didn't have chemical weapons. Syria never used chemical weapons in the current war.

  12. Of course this is AI. by Anonymous Coward · · Score: 1

    Watching a video and from that being able to build a 3d model of a person.... ....is something that normally requires intelligence. Rocks can't do it. Neither can plants. Nor steam engines.

    This fits the definition of Artificial Intelligence exactly.

    You just have some kind of chip on your shoulder.

    1. Re:Of course this is AI. by Anonymous Coward · · Score: 0

      So basically anything "...with computers" is AI. All my shell scripts are AI. Got it.

    2. Re:Of course this is AI. by Anonymous Coward · · Score: 0

      No, moron, here is the definition straight from the dictionary:

      "the capability of a machine to imitate intelligent human behavior"

      See how SIMPLE that is??? AI does not need to BE intelligent, it just needs to imitate intelligence. And there is NOTHING here about it being just like a thinking person in every way.

    3. Re:Of course this is AI. by Anonymous Coward · · Score: 0

      Humans don't make 3d models of humans to 5mm accuracy. This isn't human behavior.

      See how simple that is?

  13. Expect Rapid Physical Modeling by Gravis+Zero · · Score: 1

    This is actually one of the advances I had predicted many years ago. The next steps are interesting but ultimately you end up with what I refer to as "Rapid Physical Modeling" where in you can take an object, do a quick 360 view of it and then capture it's physical properties by manipulating it. A simple example is demonstrating how a potted plant can bend and it's ability to bend and spring back are inferred. The obvious benefit of this is that you can quickly model things with complex interactive response. With a little data regarding the material, clothing for your character could quickly be modeled and react properly (think folding) to the characters physical movements.

    I'm looking forward to characters in Final Fantasy XVIII having to constantly adjust their clothing because it's construction patently absurd. ;)

    --
    Anons need not reply. Questions end with a question mark.
  14. Why are these described as AI? by oobayly · · Score: 1

    Even the summary describes it as a [learning] algorithm. Yes, it's bloody impressive, but it's an algorithm tuned to execute one specific task. If anything it's an Artificial Savant.

  15. So just record a secret video of your crush by Anonymous Coward · · Score: 0

    Then generate the 3D model, then 3D print a sex doll of her.

  16. Contradiction by wonkey_monkey · · Score: 1

    A new algorithm creates 3D models using standard video footage from one angle. The system has three stages. First, it analyzes a video a few seconds long of someone moving -- preferably turning 360-degree to show all sides

    That's not one angle, then, is it?

    --
    systemd is Roko's Basilisk.
  17. What? by Anonymous Coward · · Score: 0

    I don't see the word "revolution" that you are citing and disagreeing with anywhere in the article, where is it?

  18. Trump true weight? by Anonymous Coward · · Score: 0

    So we could model Trump, and calculate his true weight? I mention it, because his doctor Ronny L. Jackson, says he is 6 foot 3, and 239 pounds. Which he isn't. But is it a big lie or a little lie?

    Normally lying like this wouldn't matter, its just vanity, but Trump appointed his doctor as head of the Veterans Affairs, so this mans lying for Trump is now a government matter. His government VA job requires he tell the truth even if Trump wants him to lie.

  19. This isn't AI by Anonymous Coward · · Score: 0

    Photogrammetry is called AI now? Cyber cloud AI coders come and get your BS right here!

  20. What is artificial and intelligent about this? by Anonymous Coward · · Score: 0

    What is artificial and intelligent about this?

  21. Re: I can see this being popular with the gamer cr by Anonymous Coward · · Score: 0

    Nope, I know the perils of NERV gear, and I certainly do not want two years worth of semen to glop into my hand.