Slashdot Mirror


Using Kinect For a Touch-Free Interface In Surgery

cylonlover writes "While Microsoft probably isn't thrilled open source drivers for its Kinect have led to it being used for 3D virtual sex games, a new application for the device developed by members of the Virtopsy research project at the Institute of Forensic Medicine at the University of Bern in Switzerland is likely to be more welcome. The team has developed a functional prototype using Kinect that provides users with a hands-free way to review radiological images."

53 comments

  1. TSA by Tablizer · · Score: 1

    Whatever you do, please keep this technology away from TSA!

    1. Re:TSA by Anonymous Coward · · Score: 0

      Wait. I thought we're trying to encourage the TSA to keep their hands off us.

    2. Re:TSA by Anonymous Coward · · Score: 0

      As an alien abductee, I should note that being groped and probed by machines is far worse than by people or other beings.

    3. Re:TSA by Anonymous Coward · · Score: 0

      Damn, and here I was about to make a joke about my balls being a touch free interface without the touch free part. Way to ruin it for me.

    4. Re:TSA by flaming+error · · Score: 1

      We are encouraging the entire federal government to read an obscure memo entitled "Constitution of the United States of America"

  2. Sterile by Dan+East · · Score: 5, Insightful

    The summary fails to connect the viewing of radiographs to surgery. The point of this is to allow interaction with a computer without having to touch anything, in order to select, view, zoom, pan, etc radiographs. Hands-free is fantastic in this case, as it maintains a sterile environment, and keeps blood from being smeared all over physical computer controls. Obviously there would be many uses for this in surgery besides just viewing radiographs, but that is a good place to start.

    --
    Better known as 318230.
    1. Re:Sterile by Anonymous Coward · · Score: 5, Insightful

      This isn't hands-free. Hands-free would mean that you can use the interface while doing something else with your hands. It is touch-free.

    2. Re:Sterile by Concerned+Onlooker · · Score: 1

      Not only that, but the headline gave me the impression that surgery was being performed using a Kinect.

      --
      http://www.rootstrikers.org/
    3. Re:Sterile by Anonymous Coward · · Score: 0

      Sure it will prevent blood from being smeared all over a keyboard and mouse, but thats probably still better then flinging blood all over the place

    4. Re:Sterile by Anonymous Coward · · Score: 0

      Though the idea of a surgeon waving sharp metal things about does disturb me a little...

      Also, will we hear reports of surgeons embedding scalpels and other assorted medical implements in screens? Might need to start looking at wrist straps!!

    5. Re:Sterile by DigiShaman · · Score: 4, Insightful

      Auto mechanics could find good use out of this technology as well. No need to drop the tools and/or get the console all greasy. I'm sure it would work great for mechanics working in aviation as well. No need to pick up that book of schematics anymore.

      --
      Life is not for the lazy.
    6. Re:Sterile by arivanov · · Score: 4, Insightful

      Kind'a

      The point is to give a pink slip to the (usually senior) qualified nurse or junior radiographer who are sitting at the manual controls now and doing exactly the same function on surgeon request.

      C'est la vie. Such are the inevitable results of technological progress...

      --
      Baker's Law: Misery no longer loves company. Nowadays it insists on it
      http://www.sigsegv.cx/
    7. Re:Sterile by Anonymous Coward · · Score: 0

      Hey, if it means I can get my boobs, eh, I mean my girlfriend's boobs, enlarged cheaper, I'm all for it!

    8. Re:Sterile by Alicat1194 · · Score: 2

      Or, for a less cynical viewpoint, to allow said nurse or radiographer to be redeployed to somewhere else in the hospital where they can be of more use (and considering the current shortage of medical personnel, that can't be a bad thing).

      --
      You can learn a lot about a person if you just take the time to inject them with sodium pentathol
    9. Re:Sterile by Sky+Cry · · Score: 1

      You know, if we eliminate all the jobs by automating everything, we get the benefit of all the work being done without us having to work at all. In the end everybody wins.

    10. Re:Sterile by Dr_Barnowl · · Score: 1

      Not without a social and cultural revolution.

      I would put a link to Marshall Brain's "Manna" story here, but the stupid lame Slashdot Javascript somehow disables cut & paste in Chrome. Grr.

      Essentially - if we have a technological revolution that allows robotic labour to do most human jobs, in our current model of capitalism, most people are screwed, because your only value to a capitalist system is the value of your labour (although your compensation for that labour is usually orthogonal to it's actual value).

      Whether it's the Roddenberry "the economics of the future are somewhat ... different", or Marshall's "Australia Project", a technological revolution in robotic labour must come with a social revolution, or dark times are ahead for many of us.

    11. Re:Sterile by Captain+Hook · · Score: 1

      +1 Naively Optimistic

      --
      These comments are my personal opinions and do not necessarily reflect the opinions of the other voices in my head.
    12. Re:Sterile by natehoy · · Score: 1

      True, but I think you'd want to design the user interface to take somewhat more subtle cues than the doctor jumping on the patient and dancing the funky chicken. Like, for example, he raises one hand a few inches over the surgical area. Tilting the hand pans the image around, clenched fist zooms in, outstretched fingers zoom out. Something that doesn't involve painting the walls with O-Negative.

      --
      "This post contains words, known to the State of California to cause thought. Wash brain thoroughly after reading."
    13. Re:Sterile by initialE · · Score: 1

      You'd be an idiot if you just sacked them instead of finding other ways to utilize their skills and experience. These are not jobs at the same level of a burger flipper, they are highly trained people who hopefully have a diverse set of skills and talents. Technology is not meant to make people redundant, it is to free them up to be even more productive.

      --
      Starbucks, Harbuckle of Breath.
    14. Re:Sterile by wwood_98 · · Score: 1

      The circulating nurses in my OR are excellent at being circulating nurses, not at being CT scan navigators. It is quite painful to watch a nurse "scroll down to that inflammatory process in the right lower quadrant". It is a task that would take me 1-2 seconds with a mouse, but takes seemingly an eternity for someone not accustomed to interpreting CT scans.

      Trust me, moving that task to the surgeon would not come CLOSE to eliminating the job of the circulating nurse. The vast majority of their job has nothing to do with navigating radiographs. But it would speed up the operation (good) and make things MUCH less frustrating for the surgeon (also good).

    15. Re:Sterile by BBTaeKwonDo · · Score: 1

      If a $1000 device (after the certification and installation) allows a $100/hour person to be used somewhere else, that device pays for itself pretty quickly. Obviously, a human is much more versatile than some image processing kit, but if ORs have people whose sole function is manipulating images and that job can be replaced, the decision is a no-brainer. Whether you can use the person elsewhere is, frankly, not material - hospitals are not make-work operations. Medical care is far too expensive - I'd much rather see technology reduce costs instead of driving them higher as it so often does.

    16. Re:Sterile by merreborn · · Score: 1

      Auto mechanics could find good use out of this technology as well. No need to drop the tools and/or get the console all greasy

      All the mechanics I've seen just cover their keyboards in plastic. Cheap, simple and reliable. Trying to replace 50 cents worth of plastic with hundreds of dollars worth of electronics would be an uphill battle.

    17. Re:Sterile by Nyder · · Score: 1

      The summary fails to connect the viewing of radiographs to surgery. The point of this is to allow interaction with a computer without having to touch anything, in order to select, view, zoom, pan, etc radiographs. Hands-free is fantastic in this case, as it maintains a sterile environment, and keeps blood from being smeared all over physical computer controls. Obviously there would be many uses for this in surgery besides just viewing radiographs, but that is a good place to start.

      yes, because foot pedals would be too obvious to use instead...

      --
      Be seeing you...
    18. Re:Sterile by BlackBloq · · Score: 1

      I very well could be if they chose to use voice commands duhh :P

  3. Why? by Datamonstar · · Score: 0

    Why did the Wii get practically ignored, but Kinect gets all the attention. I mean aside from the badonkadonk-sized Microsoft PR/hype machine. I'm guessing the simplicity of the device with regard to how similar the 360 is to a standard PC, but there has to be more to it than that.

    --
    The eternal struggle of good vs. evil begins within one's self.
    1. Re:Why? by Lord_of_the_nerf · · Score: 1

      I don't think it was ignored, it's just there are fewer applications for the Wii-mote in medicine.

      Maybe when surgeons find a reason to break televisions in theatre, Wii will get another look.

    2. Re:Why? by Anonymous Coward · · Score: 0

      "Song used without permission. Please don't sue me." Classic sign of the times!

    3. Re:Why? by Anonymous Coward · · Score: 1

      The Wii was not ignored - it was a very adaptable controller. Just do a search for Wii remote hacks. However it is completely different technology from the Kinect. The Wii tracks the movements of a controller. The Kinect generates a realtime 3D map of its environment and tracks moving objects, not just a controller.

    4. Re:Why? by Datamonstar · · Score: 1

      I never knew that, and now I have the answer I was looking for. Thanks. I must acquire one of these now.

      --
      The eternal struggle of good vs. evil begins within one's self.
    5. Re:Why? by demonlapin · · Score: 1

      It's quite difficult to sterilize a Wii controller - it takes a lot of time, because you can't use the typical heat methods to do the job. The Kinect system can use existing sterile equipment so that surgeons can manipulate things off the field without having to scrub out and scrub back in.

    6. Re:Why? by Anonymous Coward · · Score: 0

      "Why did the Wii get practically ignored, but Kinect gets all the attention."

      Because contrary to fanboy trolls proclaiming the opposite, Kinect is actually a pretty big step forward in interfaces.

      The problem with Move and Wii controllers is that you need to fill your hands to use them, with Kinect you don't. This means Move and the Wii controllers are limited to applications where you must have your hands full with the controllers, whilst Kinect works hands free, or with whatever you need to be holding at the time. In this particular case it's good for surgeons because if they're wearing gloves in the middle of operating and have their hands covered in the patients blood the last thing they want to do is get a Wii mote covered in blood, because it's not easy to sterilise afterwards. In contrast, Kinect works without ever having to touch anything or even having to put your scalpel down or whatever.

      Other applications stem from the camera, again whilst fanboy trolls just liken it to the Eye toy- a simple 2D camera, that's simply not the case. It sees in 3D and you can build 3D models from what it sees- if you had say 4 of them all around you you could potentially build a motion capture system as good as any of the professional ones that cost thousands.

      If you look at Kinect with a degree of hatred because you're a fanboy you'll miss the fact that it does actually open a lot of doors for new types of interaction- the Wii mote did too for sure, but to a much lesser extent. The response towards Kinect you cite is in itself evidence enough of the fact that many people recognise the potential of it.

    7. Re:Why? by Journe · · Score: 1

      From my experience, a big part is not needing a wiimote. It also tracks movement extremely well. I'm a rather portly gentleman who tends to wear loose flappy clothes, and it has no trouble dropping a skeleton overlay over my limbs.

      I can't see using it in something delicate like surgery, though. I do notice a definite bit of lag with the kinect that the wii doesn't get, but I digress. It's a much more complex piece of equipment, and far more worthy than I originally deemed it upon learning I wasn't going to be finding an xbox that didn't come bundled with it. It's worth having, if only to hold for when some decent open source software gets release.

      Not to mention it's the same price as a wii, but offers beaucoup options for those of us who don't enjoy only wiimote gaming.

  4. 3D virtual sex games? by Anonymous Coward · · Score: 0

    The summary fails to provide the relevant link(s).

    Do I look like a doctor?

    1. Re:3D virtual sex games? by Anonymous Coward · · Score: 0

      Exactly! Finally a reason to buy a Microsoft product!

    2. Re:3D virtual sex games? by Anonymous Coward · · Score: 0

      Well, /. lately covered a sex game being rejected by MS, but that had nothing to do with open-source drivers. I'd guess TFS is just wrong, but if it is true, we NEED that link, please!

    3. Re:3D virtual sex games? by Sky+Cry · · Score: 1

      You could just try searching for "Kinect": Microsoft Puts the Kibosh On Kinect Sex Game Plans

  5. I'll Be Back! by Anonymous Coward · · Score: 0

    The tech-head they have in clip has a definite Arnie voice!

  6. Surgery != Viewing Images by adamdoyle · · Score: 1

    Worst. Title. Ever.

  7. Hands-free, eh? by noidentity · · Score: 1

    a hands-free way to review radiological images

    Hands-free, eh? I do not think that term means what you think it means.

    1. Re:Hands-free, eh? by kkwst2 · · Score: 1

      Inconceivable! (Anybody want some pork and beans?)

  8. Hypocricy! Shenanigans! Unacceptable! by Anonymous Coward · · Score: 0

    So they put a stop to someone trying to make an entertaining, sexy time game yet they let this crap fly?

    I mean, they are saying they want to look at and interact with pictures of your INSIDES! The porn game did not even aspire to go this far! They just wanted to make something that we would probably all buy. Yet, a bunch of nerds are suddenly geniuses for developing something that only they will probably use and nobody will buy. You think hospitals have a budget for the xbox needed to even use the kinect? Do you think ANYONE is going to buy this surgery "game"? Get real.

    I'm convinced Microsoft really is bad at making business decisions. Who do they have working there, dopes in suits?

    And no, I didn't read anything other than the subject. Why should I?

  9. Modern medecine by hcs_$reboot · · Score: 1

    Surgeon: we are sorry, he is dead
    Wife: what happened, a medical error?
    Surgeon: not at all, just another MS bug. But a patch should be delivered soon..

    --
    Slashdot, fix the reply notifications... You won't get away with it...
    1. Re:Modern medecine by Anonymous Coward · · Score: 0

      That would be a really sad thing to happen. Web design

  10. Worst. Reading. Comprehension. Ever. by Anonymous Coward · · Score: 0

    The title is fine, it is you that fail.

    1. Re:Worst. Reading. Comprehension. Ever. by Anonymous Coward · · Score: 0

      No, no. It is you, don't worry.

  11. Also the Kinect is a lot more advanced by Sycraft-fu · · Score: 4, Informative

    Which is one of the reason there's so much excitement. The Wiimote has a somewhat imprecise accelerometer that is uses to measure gross movements, and a reasonably high resolution IR camera in the front that it uses to look for two dots (that its bar generates) to do precise aiming. Ok, cool, and there are many hacks out there for it. However Kinect takes it all a step further. It uses the same kind of IR camera (hell might be the same camera in both units) but instead of looking for a couple dots, it projects a whole field of them. That allows it to be stationary, and to measure things in 3D that it sees. This is then combine with other information from a visible light camera.

    So as the parent said, for this application the interest is in the "hands off no sterilization" thing but in general it is because Kinect is more advanced. What you can do with it is cooler in general, things like realtime 3D capture (though at a rather low resolution) and so on. That is going to lead to more interest.

    You have to realize that what the Wiimote does has kinda been done before. Gyration, among others, have made motion sensing controllers that you can use. Gyration makes mice. Their Pro Air mouse is a wireless optical mouse, when on a desk, and then becomes a motion sensing mouse when lifted up. You just tilt it around to control things (it has a trigger so you can tell it when you want it to move the pointer, and when you are just moving around). Thus while there is some interest in the Wiimote, in part because it is much cheaper than devices like that, it is really nothing new.

    The Kinect is the first device, at least the first consumer one, that can do a good job of tracking what it happening completely visually and passively. You don't have to hold anything or have anything on you (like a reflective strip). It just watches what you do and can get useful 3D data from that, which can then be processed by programs. That's pretty amazing.

    1. Re:Also the Kinect is a lot more advanced by Ihlosi · · Score: 1
      The Kinect is the first device, at least the first consumer one, that can do a good job of tracking what it happening completely visually and passively. You don't have to hold anything or have anything on you (like a reflective strip). It just watches what you do and can get useful 3D data from that, which can then be processed by programs. That's pretty amazing.

      The luddite in me wonders if you can use Kinect to create a battery-free wireless mouse by pointing the camera at the mousepad and using an old optical mouse with the cable removed to simulate the look and feel of an actual mouse to the user?

    2. Re:Also the Kinect is a lot more advanced by PPalmgren · · Score: 1

      That's a pretty damn good idea, albeit a very expensive method to simply remove battery weight. Also, I'd be very surprised if the resolution was as good as today's optical mice.

      I could see that being useful in a living room environment for use with an HTPC though.

  12. Open source drivers also from the manufacturer by Sun · · Score: 4, Informative

    I should just point out that PrimeSense, the hardware manufacturer behind the Kinect, also has open source drivers, as well (closed source, free of charge) libraries for skeleton detection and other stuff. Info in this, still pending, Slashdot article.

    Shachar

  13. Citation by Anonymous Coward · · Score: 0

    "While Microsoft probably isn't thrilled open source drivers for its Kinect have led to it being used for 3D virtual sex games" [Citation Needed]

    1. Re:Citation by boristdog · · Score: 1

      I think MS might not "officially" be thrilled the Kinect is being used for virtual sex, I'm sure they are quite happy that millions more units will be sold because of it.

  14. Mod parent down by Anonymous Coward · · Score: 0

    I'm a surgeon, and the parent poster hasn't the slightest clue what he is talking about. This would just free up the circulating nurse to do his/her actual job, rather than messing with a computer because the surgeon is scrubbed and can't touch it.

    I'm not sure which is more depressing:
    1. That people feel compelled to post opinions in the complete absence of actual knowledge.
    or
    2. That /. is filled with other equally clueless folks who consider such BS to warrant "+5, Insightful"

    David Bruce