Slashdot Mirror


Tele-Immersion at UC Berkeley

Roland Piquepaille writes "Tele-immersion is a technology which allows cooperative interaction between groups of distant people working in the same virtual environment. At the Center for Information Technology Research in the Interest of Society (CITRIS) at UC Berkeley, interdisciplinary teams are deploying this technology. It involves three real-time steps: taking images of a subject with 48 cameras, transmitting the images over a network, and implanting them in a virtual world. For example, it will allow students and professors on different campuses to meet -- virtually -- and discuss -- lively -- while being in ancient sites of Greece or Italy. The technology offers more promises than academics discussions. Imagine a nurse telling a diabetic how to make an insulin injection while being far away from him. Of course, this technology is facing some hurdles, such as the cost involved to model you with so many cameras. This summary shows you some details about the image processing involved in this project."

73 comments

  1. Nurse by mekanizer · · Score: 2, Funny

    It would be better if I would tell the Nurse...

  2. Good idea by dickeya · · Score: 1, Funny

    That will keep tuition prices down.

  3. Other Universities doing this by Anonymous Coward · · Score: 5, Informative
  4. Telepresense: together, or apart? by QuantumFTL · · Score: 5, Insightful

    I have a general question for the /.ers out there: do you feel that this kind of technology will tend to bring people together more, or apart?

    I mean, when you can be 100 cool places at the flip of a button, why settle for wherever you are right now? Same with social stuff - why "put up with" the boring people next door instead of flipping on the immersive internet and talking to others who share your interests?

    This is happenning already. Most of my communication with friends is IM, email, or cell phone. The amount of face-to-face talking, in real life, is astoundingly low. Is this a good thing? I mean, I can keep tabs with people around the country - and around the world. But it's not the same.

    I can see a lot of legitimate business uses for this technology, and who wouldn't want to be able to attend famous lecturer's sessions without the need to travel (or fear of being caught sleeping)? I'm just worried that it will become an even stronger isolating force in our society.

    Also, will telepresense bring about more outsourcing - why pay for a secretary who's right there, when for 1/10th the price you can have one from India, by telepresence, for the 90% or whatever things that need done that don't require actual presense.

    Just some questions to think about.

    Cheers,
    Justin Wick

    1. Re:Telepresense: together, or apart? by pipingguy · · Score: 3, Insightful


      ...why pay for a secretary who's right there...

      Because she's there when you need her. I've never had a private secretary, but shared experience is that they are worth at least double what they are usually paid.

    2. Re:Telepresense: together, or apart? by Dejohn · · Score: 2, Interesting

      I have to suggest that maybe being connected in the sense that this article describes is close enough to "real" face-to-face communicate as to fulfull any additional human need.

      From a philisophical standpoint, being face-to-face is really just light, sound, and feelings being transmitted to and interpreted by your brain. If a virtual reality system (or whatever it might be) can adequatly stimulate these senses, I see no psycological problems with being "less connected" in a geographical sense. I think technology that allows us to connect with people, even at lower intensity levels than in-person, such as IM, email, or a video chat thingy can fulfill the human need for connection in a very similar way to reality. Maybe we'd all be safer and healthier if we were isolated to a little box with a computer terminal?

    3. Re:Telepresense: together, or apart? by Anonymous Coward · · Score: 0

      The difference is made up in semen.

    4. Re:Telepresense: together, or apart? by blue+trane · · Score: 1

      From a philisophical standpoint, being face-to-face is really just light, sound, and feelings being transmitted to and interpreted by your brain

      Please to include a filter on the "feelings" in the vr software, for those of us for whom the "feelings" transmission has been overwhelmingly negative in nature.

    5. Re:Telepresense: together, or apart? by lonb · · Score: 1

      I believe this questions is thoroughly answered in "The Age of Spiritual Machines" -- phenomenal book (if you haven't already read it)

      --
      "Ain't I a stinka..." - Bugs
    6. Re:Telepresense: together, or apart? by Anonymous Coward · · Score: 0

      lol. damn. an AC made me laugh.

    7. Re:Telepresense: together, or apart? by radio_babylon · · Score: 0

      do you feel that this kind of technology will tend to bring people together more, or apart?

      further apart, definitely... its already happening... a fine example of this can be seen in how the console gaming market has changed with the advent of online capabilities... the number of console games that feature non-network (splitscreen, whatever) multiplay has declined dramatically... and the ones that do are mostly limited to sports games... and it seems games that offer some form of network multiplay but no same-station multiplay are becoming increasingly common...

      evidently, people just dont gather around the tv with real people for some gaming goodness anymore...

      i dunno, maybe it just seems that way to me, it isnt like ive been doing any kind of real tracking on it... but i cant help thinking that instantly finding an illiterate jackass opponent at any time day or night (and just as easily ditching them when youre done) must feel so much more convenient than the hassle of maintaining real relationships with quality people to most gamers... and the market is shifting in accordance with this preference for "tele-gaming"...

      hell, now we even have online fighting games, which is just sad... half the fun of a fighting game is humiliating your opponent (or being humiliated as the case may be), and i really doubt anonymous "tele-humiliation" is very satisfying...

  5. Oh man... by Stephen+Samuel · · Score: 1

    I can already see the porn site owners going "Kaching!!!!"
    two different ways.

    --
    Free Software: Like love, it grows best when given away.
  6. Hello again, Ronald by contagious_d · · Score: 1

    [sarcasm]And thank you for the summary![/sarcasm]

    --
    - /home is where the food is.
  7. Diabetic? Get real by donutz · · Score: 1, Insightful

    Imagine a nurse telling a diabetic how to make an insulin injection while being far away from him

    Why would a diabetic need a nurse miles away to tell him how to give himself an injection? Shouldn't he already know how to do this? Or are we talking about amnesiac diabetics?

    1. Re:Diabetic? Get real by mekanizer · · Score: 1

      Right, the example was pretty bad. Should went for the sex one.

    2. Re:Diabetic? Get real by temojen · · Score: 2, Insightful

      I think the reasoning is for arctic settlements or something, but flying in all the equipment, technicians, communications lines etc would probably be more expensive than just setting up a clinic staffed by a nurse.

    3. Re:Diabetic? Get real by blue+trane · · Score: 1

      Maybe no nurse wants to go. Also, if it caught on, the price of the tech would likely come down.

  8. Up-Front Cost? by pipingguy · · Score: 4, Insightful


    This is neat, but what is the minimum cost for a setup? All kinds of nifty communication technologies have been envisioned, but the cost and compatibility is always the deal-breaker.

    Often the cost of upkeep on systems exceeds their actual worth.

    1. Re:Up-Front Cost? by Anonymous Coward · · Score: 0

      What was the cost of ENIAC?

  9. Use this for Porn by wheelbarrow · · Score: 4, Funny

    Porn would be a good cash cow for funding the research.

    1. Re:Use this for Porn by Anonymous Coward · · Score: 0

      Mod parent up! Honestly, who doesn't believe that the first application of some kind of virtual reality/simulated enviroment will be in either pr0n or games?
      Seems a more slightly more likely scenario to me than academia...

  10. It's been done, two years ago by GrAfFiT · · Score: 5, Informative

    In France, the Research and Development dept of France Telecom has been doing this since 2002.
    Here's some nice flash presentation, some documentation and a PDF
    And they use H263+ and G722 !

  11. 48 Cameras? by Anonymous Coward · · Score: 0

    Does my virtual ass really need to attend the virtual meetings?

  12. Everyone already knows its real purpose... by brxndxn · · Score: 4, Insightful

    For example, it will allow students and professors on different campuses to meet -- virtually -- and discuss -- lively -- while being in ancient sites of Greece or Italy.

    No, this will be used so that horny people can play 'student and professor' virtually.. I mean, I read this and thought, "Wow, now I can do Paris Hilton without getting a disease."

    In other words, the main purpose of this is porn. Shuddup.. PORN.

    --
    --- We need more Ron Paul!
  13. My virtual bot by mekanizer · · Score: 1

    Good, now I can bring my virtual bot for those boring job meetings while enjoying Golf.

  14. Cost limitation? by Tracer_Bullet82 · · Score: 5, Interesting

    Not really.

    On days like these, I cant help to love capitalism.

    Given enough 'return on investments'; that is a smooth talking entreprenuer, it will be funded.

    a viable project would be golf lessons. I'm sure it wil be popular with the suit types. Cost have never really been an issue.

    The nurse thing works well too. Of course, "that kind" of nurse. :)

    --


    Timang tinggi tinggi
    parang sudah asah
    alang alang mandi
    biar sampai basah
  15. Kafkaesque by Infonaut · · Score: 3, Insightful
    I'm reminded of "The Metamorphosis" by Kafka. The absurdist tale is really all about the alienation of modern Man. We exist in vast societies that even as they become larger make our role in them and ability to cope smaller.

    Does our fracturing into interest-based communities bode ill for the future? I'm not sure, but it does seem that at least here in the United States it has helped to create a society where people talk past each other, avoiding unpleasant in-person discussions about social issues or political issues. Instead we retreat behind virtual walls, haul out Blogger, and start pounding on each other.

    It is of course possible that I'm looking at this the wrong way, because as towns and cities become increasingly impersonal, gobbled up by cloned shopping malls, the need to find people you can relate to on any level increases. Slashdot is a great example of this. How many people in my home town with whom I could share Slashdotish interests could I actually meet through random encounters in the computer section of the bookstore?

    I guess this sort of immersive virtual technology is just like most technology in that it is value neutral. It all depends on how we humans make use of it.

    --
    Read the EFF's Fair Use FAQ
    1. Re:Kafkaesque by Anonymous Coward · · Score: 0

      Man this is how I felt the first time I visited Silicon Valley, back in 1990.
      "a society where people talk past each other, avoiding unpleasant in-person discussions"
      Perhaps it's a friendlier place for those who live there. I've no interest in returning.

  16. 48 Cameras by Nom+du+Keyboard · · Score: 3, Insightful
    ...taking images of a subject with 48 cameras, transmitting the images over a network

    That should generate more than a little network traffic.

    --
    "It's the height of ridiculousness to say for those 9 lines you get hundreds of millions."
  17. Novel idea by timeOday · · Score: 4, Interesting
    Instead of having 48 cameras around the subject so you can select a vantage point from any angle, why not just have one camera and ask the lazy bum to move around a little?

    Besides, I'd rather not be looked at from all sides at once. Of 48 cameras, odds are at least one is looking exactly up your nose.

    1. Re:Novel idea by Rie+Beam · · Score: 1

      I dunno about you, but I question the ability of communication via spinning in little circles for hours.

    2. Re:Novel idea by ScrewMaster · · Score: 1

      Nah ... just put the subject on a motorized turntable and spin him round sixty times per second (fifty for European versions.)

      --
      The higher the technology, the sharper that two-edged sword.
    3. Re:Novel idea by Anonymous Coward · · Score: 0

      Dump the cameras, go with avatars...

  18. ooh by Matt_Joyce · · Score: 5, Interesting

    "Dealing with such large amounts of data is an enormous task--just to start the cameras you must press 50 start buttons," he said.


    pfft. sounds sophisticated. not.
    Anyone else think 48 cameras seem like overkill ?

    This is not the future of telepresence.
    Plow the cash into better avatar modeling I say.
    If your not going to be there (wherever there is), why project images of yourself at all, just send an agent.

    Gibson, Stevenson and Egan were on the right track regarding avatars.
  19. Why journalists are annoying by zatz · · Score: 4, Insightful

    "Dealing with such large amounts of data is an enormous task -- just to start the cameras you must press 50 start buttons," he said.

    They always select a quote which paints you as a simpleton.

    --

    Java: the COBOL of the new millenium.
  20. Wow! by frank_adrian314159 · · Score: 1
    It involves three real-time steps: taking images of a subject with 48 cameras, transmitting the images over a network, and implanting them in a virtual world.

    OK, so when does it get real enough for porn? That is, after all, the goal to which all web technology aspires!

    --
    That is all.
  21. thats an amazing feat... by JeanBaptiste · · Score: 4, Insightful

    from summary: "Tele-immersion is a technology which allows cooperative interaction between groups of distant people working in the same virtual environment. " Wow, considering we barely have cooperative interaction between groups of different people working in the same office building

  22. Togehter/Apart by nellahcir · · Score: 0

    why do people want to spend so much time and money to spend time together but be apart? seems like a bit of a waste

    --
    - hcir
  23. Stick to what you are good at by Anonymous Coward · · Score: 0

    Stick to what you are good at: tree-hugging, granola-chewing, sap-drinking, Kerry-voting idiocy.

  24. Re:Hello again, Ronald [Roland] by Anonymous Coward · · Score: 0

    Doe he pay Michael or is Michael in fact Roland? They're both assholes.

  25. Damn Kids... by Unnngh! · · Score: 1

    ..Back in my day, tele-immersion was sitting in front of the TV for 15 hours a day!

  26. why 48 by Shadow+of+Eternity · · Score: 0

    Didn't they do the same thing in Matrix with only about 5 cameras and some good programming?

    --
    A bullet may have your name on it but splash damage is addressed "To whom it may concern."
  27. Watch Sims mod this down! :-) by Anonymous Coward · · Score: 0

    He hovers over all his posts, waiting for replies such as these.

    Oh watch how fast your IP gets blocked too! HAHAHA!

  28. Offshorer/Outsourcer's wet dream by shibuya_boy · · Score: 3, Insightful

    The big use for this technology will be companies that are offshoring high value jobs to low wage countries. Communication has been the only effective barrier to this happening... the more stuff like this comes out the worse the job market looks in high wage countries.

    If the tech is "real" enough then people like sales and management, thought to be immune to the whole offshoring thing, will be that much less safe.

    1. Re:Offshorer/Outsourcer's wet dream by Anonymous Coward · · Score: 0

      Exactly. Burn this fricken invention.

  29. The summary by Stanistani · · Score: 4, Informative

    (To save poor Ronald's site from being cash, er slashdotted)
    Meeting Your Professor in Ancient Sicily
    Tele-immersion is a technology which allows cooperative interaction between groups of distant people working in the same virtual environment.
    At the Center for Information Technology Research in the Interest of Society (CITRIS) at UC Berkeley, interdisciplinary teams are deploying this technology. It involves three real-time steps: taking images of a subject with 48 cameras, transmitting the images over a network, and implanting them in a virtual world. For example, it will allow students and professors on different campuses to meet -- virtually -- and discuss -- lively -- while being in ancient sites of Greece or Italy.
    The technology offers more promises than academics discussions. Imagine a nurse telling a diabetic how to make an insulin injection while being far away from him. Of course, this technology is facing some hurdles, such as the cost involved to model you with so many cameras. But read more...
    Here is the inroduction of the Daily Californian article, which really is a news release from the University of California.
    UC Berkeley students may soon be able to meet professors at UC Davis in ancient Sicily for lively intellectual discussions. Recent visual computer science advances by Ruzena Bajcsy, director of the Center for Information Technology Research in the Interest of Society (CITRIS) at UC Berkeley, may make such interactions possible.
    Bajcsy's technology takes pictures of a subject in her laboratory from 48 different cameras and combines them into a 3-D image. The image can then be placed into historical Sicily, one of the three cyberspace environments created so far. But how does this work?
    Here is an illustration of the three-step process of the project: real-time image processing, followed by real-time data transmission and finally real-time image rendering. (Credit: CITRIS)
    You'll find more details about this process at the CITRIS Tele-Immersion Project home page, which adds this about the above image.
    First, a three dimensional structure and appearance of the scene is captured by processing image data from multiple viewpoints using stereo algorithm. Second, the acquired scene information is then transmitted to remote sites through high-bandwidth networks, where lastly it is combined with the interactions of the user and displayed dichoptically to reproduce realistic scene rendering.
    And what can we expect from such a technology?
    "Bajcsy has been really visionary with all of this. We've imagined these things and she's been working with us to make them real," said David Goldberg, director of the UC system Center of Humanities, a collaborator on the project. Art historians, anthropologists and archeologists working with Goldberg have imagined a virtual museum using Bajcsy's technology where both experts and the public could virtually pick up objects and study them.
    The new insights could be far-reaching. Bajcsy aims to impact common people, by studying how people behave and trust each other in cyber environments. Specifically, one could study the difference between cyberspace interaction and a face-to-face interaction, or between interactions where the whole body or just the face or hands are visualized.
    However, this technolgy faces several hurdles, such as confusing colors between the user's clothes and the virtual environment. But there are others, such as the fact that this technology is not -- currently -- wireless, and that this huge number of cameras invoves a hefty pricetag.
    Currently, a cable is required to transmit the large amount of information from the two sites to the digital environment. The cable is expensive and can only be used between the two sites, but Bajcsy hopes to make the technology available to many social scientists who have only meager funding.
    "Digitizing (approximately) 50 cameras into the computer is not easy," said Professor Takeo Kanade, a Carnegie Mellon professor who has performed similar research. "Dealing with such large amounts of data is an enormous task -- just to start the cameras you must press 50 start buttons," he said.
    Sources: Erica Rosenberg, The Daily Californian, October 27, 2004; and various websites

  30. one word by circletimessquare · · Score: 1

    teledildonics

    --
    intellectual property law is philosophically incoherent. it is your moral duty to ignore it or sabotage it
  31. TMI by Anonymous Coward · · Score: 0

    Too Much Information.

    If a nurse is demonstrating an insulin injection, is there really any need to see that his fly is unzipped?

    Speech is move about at 2kbps these days.

    Music is acceptable to most of the population at 128kbps.

    If we're studying scrambled egg residue in a beard, it's a good thing to be able to transfer
    detail in 3-d, but all we really need in detail is the beard. The rest of the image may be highly compressed 3-D and still provide the 'experience' of presence.

    Look at some of the 3-D imaging for the human model making industry. Three cameras does a reasonable job for a cameo and 6 for a full bust.

    Tracking algorithms are sophisticated enough to the portion of a 3-D image that's of interest for detail. The background never changes, most of the subject, once conveyed, only requires transmission and reconstruction of the spatial orientation.

    IMO ther is a lot of cart before horse in this project. Bt then the cart is so much flashier...

  32. how about better examples of technology uses by revery · · Score: 1

    It involves three real-time steps: taking images of a subject with 48 cameras, transmitting the images over a network, and implanting them in a virtual world... Imagine a nurse telling a diabetic how to make an insulin injection while being far away from him.

    Yes, because this is currently impossible with a single camera... or just a video.

  33. This is the best application he can think of? by ObjetDart · · Score: 1
    Imagine a nurse telling a diabetic how to make an insulin injection while being far away from him.

    Sorry, but I'm having trouble imagining a person who is too poor or too remotely located to be able to visit a nurse in person, but somehow has access to a state-of-the-art tele-immersion VR whatsit.

    --
    I read Usenet for the articles.
  34. Who the hell is this Roland guy? by MrDomino · · Score: 2, Insightful

    And why is he posting an article on a subject that was featured in Scientific American in 2001?

    1. Re:Who the hell is this Roland guy? by ObjetDart · · Score: 2, Informative
      Do a little research on Mr. Piquepaille and you'll find out that this is his standard MO:

      1) Plagiarize a story about technology written elsewhere; re-package it and post it on his site
      2) Submit story to Slashdot in order to drive huge number of hits to his site
      3) Sell ads to web advertisers
      4) Profit!

      --
      I read Usenet for the articles.
  35. Next VR by Anonymous Coward · · Score: 0

    Like VR (virtual reality) i hope it does well.

    Now, I'll pay over 10% for a "learning" session.
    Yes i like my Pr0n fully clothed and educated thank you.

  36. Virtual Doctor by Anonymous Coward · · Score: 0

    If there's one thing that all virtual reality technology proposals have had in common in the past fifty years, it's the promise of facilitation of sharing of information between two doctors across the globe. Can't they be more creative? I mean, sure, that's one use, but do you really thing that's where this tech is going? Let's discuss the implications of this technology, a la William Gibson or Neal Stephenson, on sociology and psychology in the 21st century.

  37. University of Tokyo did it first! by tatewake · · Score: 1

    This is kind of interesting as the University of Tokyo came out with something similar with their Tele-Existance/Crystal Vision/X-tal Vision projects.

    (Remember the article on slashdot about the "cloaking" technology they were working on?)

    Though their goal appeared to be to project a user's image onto a robot dummy and have the robot do things remotely. (Which is probably overkill anyway.)

    A while back, I wrote an article on how this could be applied to education, interestingly enough, which can be read here:

    http://tatewake.com/WhatIsTheFutureOfDistanceLearn ing.htm

    --
    --Terence J. Grant
  38. Alot more by MacFury · · Score: 1
    How many people in my home town with whom I could share Slashdotish interests could I actually meet through random encounters in the computer section of the bookstore?

    Alot more if you'd stop posting on slashdot and go to those bookstores ;-)

    1. Re:Alot more by Anonymous+Writer · · Score: 1

      Alot more if you'd stop posting on slashdot and go to those bookstores ;-)

      Ofcourse, you're assuming they actually go to bookstores and don't just order online.

  39. Oh for God's sake... by cuteseal · · Score: 0

    ... get off the computer, walk to the next cubicle and talk to your co-worker face to face, will ya? :)

  40. ? Insulin? by Anonymous Coward · · Score: 0
    Imagine a nurse telling a diabetic how to make an insulin injection while being far away from him.
    Sorry, but I'm having trouble imagining a person who is too poor or too remotely located to be able to visit a nurse in person, but somehow has access to a state-of-the-art tele-immersion VR whatsit.
    That is exactly what I thought! Who lives in such a remote location that a nurse can't show them how to inject themselves with insulin, and yet they can take 48 digital images of themselves and hook into a high-bandwidth virtual clinic?