Slashdot Mirror


Experiment Shows Stylized Rendering Enhances Presence In Immersive AR

An anonymous reader writes William Steptoe, a senior researcher in the Virtual Environments and Computer Graphics group at University College London, published a paper (PDF) detailing experiments dealing with the seamless integration of virtual objects into a real scene. Participants were tested to see if they could correctly identify which objects in the scene were real or virtual. With standard rendering, participants were able to correctly guess 73% of the time. Once a stylized rendering outline was applied, accuracy dropped to 56% (around change) and even further to 38% as the stylized rendering was increased. Less accuracy means users were less able to tell the difference between real and virtual objects. Steptoe says that this blurring of real and virtual can increase 'presence', the feeling of being truly present in another space, in immersive augmented reality applications.

75 comments

  1. Simulated Universe by kauaidiver · · Score: 0

    Since we are living withing a simulation already this doesn't surprise me.

    1. Re:Simulated Universe by Spy+Handler · · Score: 4, Funny

      some of us see the world in green vertical Greek letters.

    2. Re:Simulated Universe by Tablizer · · Score: 1

      Your eyes are written in Perl?

    3. Re:Simulated Universe by enoz · · Score: 4, Informative

      the rest of us saw it in green vertical Katakana

    4. Re:Simulated Universe by Stormwatch · · Score: 2

      All I see now is blonde, brunette, redhead.

    5. Re:Simulated Universe by Beardo+the+Bearded · · Score: 1

      So what does that make Saint's Row IV?

      --

      ---
      ECHELON is a government program to find words like bomb, jihad, plutonium, assassinate, and anarchy.
    6. Re:Simulated Universe by SeaFox · · Score: 1

      some of us see the world in green vertical Greek letters.

      the rest of us saw it in green vertical Katakana

      I saw both. Does that make me a more "worldly" person?

    7. Re:Simulated Universe by NotDrWho · · Score: 1

      If you put on the sunglasses too, you'll see all the signs that say "Conform."

      --
      SJW's don't eliminate discrimination. They just expropriate it for themselves.
    8. Re:Simulated Universe by Oligonicella · · Score: 1

      Great reference, great flick.

    9. Re:Simulated Universe by Minwee · · Score: 1

      I see a schooner.

    10. Re:Simulated Universe by ArcadeMan · · Score: 1

      Those sunglasses gave me a headache. Didn't you hear about the contact lenses?

  2. Porn ... by chuckugly · · Score: 2

    "A natural next step would be to add haptic feedback allowing users to touch virtual objects. Users could pick up physical items and computer generated ones at the same time while still thinking both are real. Adding the ability to walk around would expand one’s sense of presence as well. This allows individuals to explore computer generated environments further immersing them into the experience." - Article

    Yeah, it's for porn

    1. Re:Porn ... by rebelwarlock · · Score: 4, Insightful

      Everything will be used for porn. That doesn't make it a bad thing. Technology has been driven in large part by sex, and will continue to be. If people think something can be used for porn, they'll put more money into it, and then you can use it for other things too.

    2. Re: Porn ... by Anonymous Coward · · Score: 0

      Sure we might get some cool tech out of it, but we will also get more porn, which will continue to destroy families and relationships by commoditizing sex, spreading promiscuitity, and creating unreal expectations of sex.

      The ends dont always justify the means.

    3. Re: Porn ... by Anonymous Coward · · Score: 0

      You sound like a repressed Puritan. I don't care what you do, as long as you don't try to restrict what others do.

      So, by all means, feel free to believe porn is evil and something to be avoided. However, the instant you take that belief and try to force it on others via laws, policies, or social stigmatization, *you* become the evil.

    4. Re: Porn ... by brainboyz · · Score: 2

      You're doing it wrong. Unreal expectations for sex? More like idea generator according to my wife.

      Also, based on some of the relationships I've seen, porn is the reason they still have a family. If not for porn as an outlet, they would have long ago ditched the wife (who let herself go) and kids for the fun and bubbly 20-something at work.

    5. Re: Porn ... by Beardo+the+Bearded · · Score: 3, Informative

      I'm imagining this conversation as the same guy talking to himself, since both are AC...

      --

      ---
      ECHELON is a government program to find words like bomb, jihad, plutonium, assassinate, and anarchy.
    6. Re: Porn ... by julesh · · Score: 1

      more porn, which will continue to destroy families and relationships by commoditizing sex, spreading promiscuitity, and creating unreal expectations of sex.

      [citation needed]

    7. Re: Porn ... by tehcyder · · Score: 1

      Also, based on some of the relationships I've seen, porn is the reason they still have a family. If not for porn as an outlet, they would have long ago ditched the wife (who let herself go) and kids for the fun and bubbly 20-something at work.

      Masturbation existed before the widespread availability of porn. Purely on the basis of sexual relief, no one would ever have run off with a younger man/woman.

      Hint: it's a bit more complicated than having the ability to blow your load easily.

      --
      To have a right to do a thing is not at all the same as to be right in doing it
    8. Re: Porn ... by Anonymous Coward · · Score: 0

      Okay, so now I'm 34. Does anyone else this age or older find the "fun and bubbly 20 somethings" (i.e. early 20's) to be naive and annoying? I mean, sure, they are hot but in general I wouldn't want to spend any time interacting with them.

      I mean, in the scenario described above, I would envision having to be brain damaged in order to leave the wife *and* trade that for an annoying, naive girl. I would rather be alone than deal with that.

      Perhaps I just have the equivalent of progeria in terms of crotchetiness.

    9. Re: Porn ... by Anonymous Coward · · Score: 0

      You should see the fun and bubbly 20-something year old at my work

      She's hot enough that my partner would ditch me for her. Now that's some girl-on-girl action.

    10. Re:Porn ... by NoNonAlphaCharsHere · · Score: 1

      I still don't understand the bit about "Immersive Accounts Receivable".

    11. Re: Porn ... by Anonymous Coward · · Score: 1

      I'm imagining your claim is all too true, as I'm imagining it was you writing those two preceding comments followed by a meta comment posted while logged in in order to raise visibility and garner interest.

      Maybe you're even posting this one, too. Who knows how deep the rabbit hole goes?

    12. Re: Porn ... by MightyYar · · Score: 2

      which will continue to destroy families

      You are confusing porn with fluoridated water. It's a common mistake for those who have been subject to so many government satellite brain scans.

      --
      W..w..W - Willy Waterloo washes Warren Wiggins who is washing Waldo Woo.
    13. Re:Porn ... by qwijibo · · Score: 1

      Understandable - the concept of immersive is really hard to explain to accountants. It's probably similar to the arousal you would feel from balancing your checkbook.

    14. Re: Porn ... by RavenLrD20k · · Score: 1

      I am 35 and completely agree with your assessment. I regularly interact with my wife's cousin's fiancee who is in her early 20's and I have to say that I am completely baffled by her naivete and gullibility. I look back to my own time at that age and I just can't understand it. I don't remember 20 somethings of the late 90's and early 2k's as being nearly as damaged as she, her friends, and others that I've seen seem to be, and be able to make it through life.

      Let me clarify that a bit. Yes, I've seen plenty of ditzes back then, but they never really made anything of themselves and nor were they expected to. They usually wound up getting out of high school and becoming the trophy wife riding on the curtails of a successful arm to hang from... and that was if they looked decent. God help them if they didn't fit the mold of what society deemed even mildly attractive. The majority of women who did have the intelligence would go on to college and invest in learning something that would give them a good career that they could live off of without having to rely on a man to keep them afloat.

      Fast forward to the girls I see today and there are few that live up to the expectations of what I saw from my time...and they are usually in school for Law or on course for a Doctorate. It's a far greater majority that I see that are more like the Trophy wife bound type of my day in mentality...but without fitting into the what was then required mold of attractiveness. This is the group that I see going for nursing and advanced nursing degrees and other career paths that the intelligent ones were going for in my day. I keep seeing this and I try to relate it. Would we have done the same stupid mistake these girls are repeatedly making without learning? without thinking? Was it as difficult for us to keep out of trouble as it seems to be for these girls? Why did we have the concept of spend for living first, then for your wants...but the average girl I see this day don't seem to have this basic concept? I'm not saying we always made the perfect decision, but it just seems that life was a whole lot easier for us than it is for the current generation to live day to day, and I just can't understand why.

      Is it "No child left behind" that we have to thank for this because that's the generation we're starting to see hit their 20's now. I observe this generation coming into their own, both in the specific anecdotes that are part of my day to day interactions as well general observations of behaviors of people from all walks of life while I'm out and about and traveling and I can't help but wonder; In leaving no child left behind and bringing everyone down to the same level of mediocrity, have we left our entire nation behind?

    15. Re:Porn ... by theronb · · Score: 2

      Better driven by sex than by war. Most big tech innovations have come out of "defense" R&D.

    16. Re:Porn ... by bluefoxlucid · · Score: 1

      "A natural next step would be to add haptic feedback allowing users to touch virtual objects. Users could pick up physical items and computer generated ones at the same time while still thinking both are real. Adding the ability to walk around would expand one’s sense of presence as well. This allows individuals to explore computer generated environments further immersing them into the experience." - Aristotle

    17. Re: Porn ... by Anonymous Coward · · Score: 0

      Tricksy Anonymous Coward. Gollum! Gollum!

    18. Re: Porn ... by Anonymous Coward · · Score: 0

      Several years ago, when I first came across Slashdot, I initially thought Anonymous Coward was an actual user. Then I saw how many posts that guy had in every.single.thread, and started thinking, "now, that's funny..."

    19. Re: Porn ... by ArcadeMan · · Score: 1

      It doesn't have to be one or the other. Can you say Ménage-à-trois?

    20. Re: Porn ... by bassman2k · · Score: 1

      You answered your own question at the beginning of your post: "I am 35".

  3. Duh! by nman64 · · Score: 5, Insightful

    It isn't terribly surprising that adding a cartoonish rendering effect to both real and virtual objects would make them more difficult to discern as such. I certainly wouldn't call it more immersive - quite the opposite, in fact. It is extremely obvious that what you are looking at has been altered and that you are not looking at "reality".

    1. Re:Duh! by Anonymous Coward · · Score: 0

      Which reality is that?

      Currently I am taking a course on the stability of a "Free" society that lacks suitable checks and balances. It is a total immersion course. Of course, death here means I must take a final in my "Reality". Yet, is that not yet another simulation in a "Higher Reality"..

      Computer End Program(?)

    2. Re:Duh! by Animats · · Score: 5, Insightful

      Right. The original post doesn't make it clear that the system applies edge enhancement filters to the "real world" objects as well as the virtual ones. So everything looks crappy. It's not clear what this is supposed to prove.

      Watching the video, the easiest way to tell real from virtual objects is that the amount of lag on the real and virtual objects differs.

    3. Re:Duh! by julesh · · Score: 4, Insightful

      It isn't terribly surprising that adding a cartoonish rendering effect to both real and virtual objects would make them more difficult to discern as such. I certainly wouldn't call it more immersive - quite the opposite, in fact. It is extremely obvious that what you are looking at has been altered and that you are not looking at "reality".

      Right, but "immersive" doesn't mean "difficult to distinguish from reality" but rather "easy to treat as if it were real". I mean, I used to find playing Elite on my Sinclair Spectrum "immersive", but there's not a chance I'd ever fail to know it wasn't real. Being immersive means allowing people to retain what's often called "willing suspension of disbelief" -- as long as the system I'm looking at behaves consistently, I can treat it as if it were real, so I can (at least sort-of) believe in its existence as a real thing. And maintaining that sense of existence is what people mean when they say immersion.

      The filters they applied in the video make the scenes look less realistic overall, but they make them more consistent, and that lets me believe in them as real in a way I can't easily believe in the unfiltered scene.

    4. Re:Duh! by nman64 · · Score: 1

      Judging by the article, it doesn't seem like the experiment supports the conclusion. The experiment demonstrates that applying the filters makes it more difficult to distinguish real objects from virtual objects, but it does not necessarily follow that this makes the experience more immersive than the unfiltered version. In general, a consistent experience is important to suspension of disbelief, but that is only one factor. Most people didn't have a problem "getting into" "Who Framed Roger Rabbit?" or "Space Jam". Believable interactions is another important factor - one that these visual filters will impair. Obviously, the effectiveness of this approach will vary from person to person.

      In any case, I can't imagine a use case for this technique. Such an approach would make interaction with the environment (including walking) more dangerous and frustrating. Attempting to interact with the environment would likely result in increased stress as your mind fights to determine what is real and what is not. If you're forced to remain stationary and can't trust what you see, what's the point in augmented reality?

    5. Re:Duh! by hackertourist · · Score: 1

      Cartoon movies have shown us a world doesn't need to be photorealistic to be immersive. Worlds that stay away from the uncanny valley by being obvious cartoons do better than worlds that try to be, but aren't quite photorealistic.

    6. Re:Duh! by Anonymous Coward · · Score: 0

      I don't see what is so interesting about this study. Feels like the only reason it even got any attention is because it uses a trendy gadget like the rift.

      Applying filters to a image after adding virtual/fake info to make them "fit together" it is a (cheap) technique that is older than Photoshop itself. A "modern" VR google is just a smartphone screen. The same principle applies.

    7. Re:Duh! by marcansoft · · Score: 1

      And since this is a camera passthrough, not an optical overlay, that's a glaring implementation flaw. Properly aligning the head tracking framerate, camera framerate, and rendering would let them render the virtual objects in lockstep with the physical ones (at least at speeds where motion blur isn't a significant issue; you can fake that by minimizing motion blur in the real image by using a short shutter time on the cameras).

    8. Re:Duh! by Anonymous Coward · · Score: 0

      I'm not having anyone stare in disbelief at MY willy suspension thankyou very much

    9. Re:Duh! by Wycliffe · · Score: 1

      It isn't terribly surprising that adding a cartoonish rendering effect to both real and virtual objects would make them more difficult to discern as such. I certainly wouldn't call it more immersive - quite the opposite, in fact. It is extremely obvious that what you are looking at has been altered and that you are not looking at "reality".

      immersive != realistic

      Basically, by making the real world less realistic you can increase the immersiveness of the experience.
      You obviously know that it's not real just like you know that a movie is not real but you still get a more immersive feel.
      I think the real takeaway from this isn't that it's harder to tell real from virtual when you make the real look virtual (duh!) but
      rather that a seemless less realistic cartoon environment feels more immersive than a realistic environment with virtual items
      added.

    10. Re:Duh! by Anonymous Coward · · Score: 0

      It doesn't prove anything! Researchers do stupid shit like this all day long and call it science.

    11. Re:Duh! by Anonymous Coward · · Score: 0

      The author spent a lot of time (and presumably some money) building a pretty cool AR system. Something has to come out of it. It's not a product, so it must be an experiment :p

    12. Re:Duh! by BarbaraHudson · · Score: 1

      Exactly. Make everything blurry enough, and it all looks fake. Or real. Or whatever. How did this make it out of the firehose? (Oh, right, too many people don't actually READ the summary in the firehose, never mind the actual article(s). Just the headline ).

      --
      "Transparent" is a shit show that trades on every stereotype going. A man in drag is NOT a transsexual.
  4. Captain Obvious University by Tablizer · · Score: 1

    "The more you distort things, the less you can tell them from fakes." Surprise surprise surpriiiise!

    1. Re:Captain Obvious University by Anonymous Coward · · Score: 0

      Less accuracy means users were less able to tell the difference between real and virtual objects.

      I hope people are not so stupid that they need this explanation.

    2. Re:Captain Obvious University by Agent0013 · · Score: 1

      I bet if we distorted the image so far that everything is just a black screen then people would drop to 0% accuracy in determining the fake objects! Wow, it's so awesome! [sarcasm tag here]

      --

      -- ssoorrrryy,, dduupplleexx sswwiittcchh oonn.. -Quote found on actual fortune cookie.
    3. Re:Captain Obvious University by Tablizer · · Score: 1

      By the way, that's heavily paraphrased. I forgot to mention it.

  5. Around Chance by Anonymous Coward · · Score: 0

    The summary has misquoted from the video caption. 56% is not "(around change)", it is "(around chance)".

    1. Re:Around Chance by Tablizer · · Score: 1

      So is the proof-reading

  6. Borderlands by evilsofa · · Score: 1

    This made me think immediately of the Borderlands games, which uses a black outline shader. Lots of PC gamers turn off the black lines (which are separate from the cell shading, by the way) but I left them on because I liked them, for reasons I couldn't ever explain very well.

  7. Lag! by Anonymous Coward · · Score: 0

    From the video, the lag was horrible. I guess I see why the whole VR scene is focusing on the lag issue.

  8. SUMARY OF THE ARTICLE- by arfonrg · · Score: 2

    "Boffins have found that when you alter the appearance of an object, humans find it more difficult to perceive it as it actually is".

    --
    Your thin skin doesn't make me a troll
  9. Mind Blowing! ;) by ihaveamo · · Score: 2

    Not even the article author knows what's real any more! Quote from TFA: For example, users avoided simulated boxes in one of the experiments when walking around despite knowing that they were real.

  10. I stepped outside once by ihtoit · · Score: 4, Funny

    It reminded me that I needed to upgrade my video card.

    "Dude, the colour depth out there is fucking *amazing*!"

    --
    Political debates have me rolling my eyes so much I think I got optical whiplash. I should sue. - Foamy The Squirrel
    1. Re:I stepped outside once by Anonymous Coward · · Score: 0

      Oh what a clever joke that you recycled from some ancient "user friendly" or "penny arcade" comic! How innovative and interesting!

    2. Re:I stepped outside once by Anonymous Coward · · Score: 0

      He's a Space Nutter too, recycling lame crap he read as a kid is his culture...

    3. Re:I stepped outside once by ihtoit · · Score: 2

      the NPCs and gameplay suck though.

      (OLD meme, even older than memebase or cheezburger or whatever, it probably predates 7th Guest!)

      --
      Political debates have me rolling my eyes so much I think I got optical whiplash. I should sue. - Foamy The Squirrel
  11. News story : by Anonymous Coward · · Score: 0

    Making everything look crappy results in people not being able to tell what's real. Mainly because everything looks crappy.

  12. Perfect VR by Anonymous Coward · · Score: 0

    In the next experiment, the test subjects were wearing a blindfold under the VR goggles and the recognition dropped to exactly chance level! The VR presence has been perfected.

  13. That's amazing by Anonymous Coward · · Score: 0

    Combine this with your 3D printer so you actually think you've 3D printed a car.

  14. Alternate Headline by Anonymous Coward · · Score: 0

    Alternate Headline: Experiment shows stylized rendering degrades quality to the point where you can't tell which is degraded reality and what's fake.

    If they're serious about research, they should analyze the information that has been removed from the real ones to try to understand what the fakes are missing.
    (e.g. Animats mentioned the weird lag that made the fake ones stand out like sore thumbs when the scene rotated.)

    Just a guess: Poor simulated material properties and indirect lighting are probably some of the bigger giveaways for the fakes.

  15. That's "around chance", not "around change" by Walking+The+Walk · · Score: 1
    I couldn't figure out what this part of the summary meant:

    accuracy dropped to 56% (around change)

    Then I watched the video in the article, where they actually say:

    Participants demonstrated 56% accuracy (around chance)

    i.e.: 56% is pretty close to the 50% you'd expect from just guessing. That one letter makes a big difference.

    --
    A recursive sig
    Can impart wisdom and truth
    Call proc signature()
  16. File paper under D for "Duh" by Anonymous Coward · · Score: 0

    How is it suprising that throwing an outline around real objects (thus removing shading and light-edge cues) makes the objects harder to differentiate as real/virtual?

    Consider also the source and the publisher. (Yes, I actually RTFP)

  17. Other "duh" news include... by Anonymous Coward · · Score: 0

    So, making a natural image look artificial makes it harder to distinguish from artificial images?

    In other news, putting a cat inside a box makes it harder to distinguish that cat from a box, covering McDonald's burgers in ketchup makes them taste less like bad meat and more like bad ketchup, and water was found to be rather wet.

  18. It's a Motion Thing by jafwatt · · Score: 1

    Stylised rendering might make it harder to detect the difference between real and virtual objects but clearly at the (great) expense of realism. What seems very obvious to me is the difference in latency between updating the scene for a real object and updating the scene for a virtual object. The virtual objects seem to be catching up with the real objects when the subject pans their view. That 'lag' combined with our natural sensitivity to motion is the problem.

  19. He's just a dirty old man, what does he know? by Anonymous Coward · · Score: 0

    What is a rag & bone man doing in this field anyway?

  20. Uncanny Valley? by Anonymous Coward · · Score: 0

    The summary is deceptive (what a shock). It implies that if you make the rendering of the virtual objects worse, they feel more "real". That could be evidence for the existence of the "uncanny valley" - you'd naively expect that better rendering makes things more real, so something (the Uncanny Valley) must be interfering. But what the experiment actually did was distort the real objects until users had trouble telling them from the virtual objects. That's not nearly as interesting.

    However, a variation of this setup might still be useful for investigating the Valley. Compare heavily distorted real objects with lightly distorted ones - which ones are users more likely to treat as fake?

    If you do find an Uncanny Valley effect, it would be interesting to see if it applied more strongly to human faces than to inanimate objects.

  21. This doesn't mean what it sounds like by pla · · Score: 1

    TFA didn't make it harder to identify virtual objects as TFS implies - It made real objects look more like virtual ones.

    Aka, "if we make everything look like cartoons, people can't tell which cartoons came from the real world".

  22. Stylized Rendering? by Toad-san · · Score: 1

    Is that a fancy phrase for "out of focus"? "Low definition"? Why does this "scientific" study evoke a huge, resonating "DOH!" ??

  23. welcome to, what, 1980? by Anonymous Coward · · Score: 0

    military HUD designers demonstrated that simple raster lines that showed threats in one shape and friendlies in another, allowed for better absorption of critical details than a photorealistic rendering of all data that radar/FLIR/whatever sensors were returning. All the extra crap, like pushing polygons in the latest BlackMedalofWarfare shooter not only confuses the mind but distracts it.

    And after that, you can apply "Uncanny Valley" phenomena. If you get it "close" to "perfect" a flaw drags one out of their state of disbelief or leaves distracting "discomfort" that affects the experience. As long as your environment is consistent and smooth, "stylized" works better because you run your system smooth, and can eliminate the flaws your system can't handle.