Slashdot Mirror


Wiimote as Multi-Touch Display Controller

Tmack writes "While hard-hacks with the Wiimote are somewhat old news, this particular implementation is quite interesting. Using the infrared camera on the Wiimote, pens with LEDs instead of ink, and an LCD projector, Johnny Chung Lee of Carnegie Mellon University has created software to use them as a (relatively) cheap multi-touch display. Any surface onto which you can project becomes an interactive multi-touch display, as demonstrated in the video at the link. He has the software available for download, along with some other neat projects. Lee has also documented another impressive Wiimote hack.

12 of 107 comments (clear)

  1. I can get one now? by FatAlb3rt · · Score: 3, Funny

    What's this...a way to pass time until the demand for the Wii consoles goes down enough that I don't have to crawl over people to get one? Sign me up!

    Oh...the Wiimotes are out of stock too? *walking away, hanging head*

    1. Re:I can get one now? by DrWho520 · · Score: 3, Funny

      I have seen Wiimotes everywhere, Buy Buy, Circuit City, Target and Walmart. Maybe they should contract to the Wiimote manufacturer to also start cranking out Wii's.

      --
      The cancel button is your friend. Do not hesitate to use it.
    2. Re:I can get one now? by Smidge204 · · Score: 3, Informative

      Just about any CMOS webcam can be easily modified to see only IR light. It involves removing the IR filter (usually a small glass plate with special coating inside the lens assembly) and adding a filter to block visible light (usually a fully exposed piece of film negative).

      =Smidge=

  2. Wiimote is a Wii-Detector by imstanny · · Score: 4, Informative

    The Wii-mote is actually a sensor that is used as a remote. It doesn't just send a signal, but rather it 'sees' the location of the 'motion detection' bar. In the traditional usage, it has only 1 point that it detects - the bar. But if you have 'many of these bars' the Wiimote is used as a detector of multi-inputs.

    1. Re:Wiimote is a Wii-Detector by Paralizer · · Score: 4, Informative

      The sensor bar has two IR points on either end to help with calculating things like distance. The wiimote itself can see up to 4 IR sources at any given time. So the multitouch interface would be limited to 4 pens, not that you'd need more than that though.

  3. My project by pkadd · · Score: 3, Interesting

    I am currently working on using a wii controller as primary pointing-device for my livingroom. The goal is to make it the only device needed to controll the projector + PC i use for DVD, TV, and Music playback in my home. I will post info when i've figured it all out.

  4. Detecting Parkinsons Tremors by superid · · Score: 5, Interesting

    My own trival "hack". I'm using Darwiinremote to read xyz accelerometer data and Octave to make/graph ffts of Parkinson's tremors. It's remarkably sensitive!

  5. Better than the last one by TheLostSamurai · · Score: 3, Insightful

    When Johnny Lee posted his last hack, it seemed like a cool idea to track your fingers in the air, but not all that practical, as was discussed at length. This hack however could actually have very practical applications for discussion and presentation, without the $5000 price tag of many interactive white board products. I'd like to see if anyone ever attempts to implement this in a small business environment, such as a design studio.

    --
    I am Jack's complete lack of surprise.
  6. Re:they have size... by slim · · Score: 4, Informative

    ... you see how big/close they are as well, so it's not just position. No, the Wii software expects the Wiimote to see two IR dots (one on each end of the 'sensor' bar). Everything is calculated from these two points. X/Y position is the X/Y position of the midpoint between the two dots. Roll is the angle between the two dots. Z position (closeness) is the distance between the two dots.
  7. Re:Nothing new... by skorch · · Score: 3, Insightful

    Some of the most important innovations are not about making something completely novel but about coming up with creative and more efficient ways of using what we already have. If this hack reproduces 75% of the performance of a commercial product at a fraction of the cost, then this is already a more cost-effective solution for simple touch-screen presentation software. It also puts it well within reach of the at-home user and not something that can only even be considered for large corporate presentations. All of a sudden an 8ft sq canvas for digital art is not out of the question, and it's scalable to a simple laptop as a tablet-pc replacement.

    And considering the application he offers is free this can only encourage more experimentation that can lead to even more innovative applications of a relatively cheap and abundant product which is (Nintendo sanctioned or not) becoming more and more of a multi-purpose tool.

  8. Re:sure you can... Re:I can get one now? by AKAImBatman · · Score: 4, Informative

    I keep wanting to bash the thing against my coffee table because it won't detect that it is pointing at the screen.

    Check that there are no bright IR light sources nearby. Sunlight and Christmas lights are two common ones that confuse the Wii Remote. Also make sure that your Sensor Bar is far enough forward that it isn't blocked at certain angles.

    An easy way to figure things out is to go into the Wii Remote settings screen. There's a black and white image there that effectively shows you exactly what the Wii Remote "sees". You should see a few dots that do not flicker or go away as you move the remote around. If the dots disappear at any point during your tests, you may need to adjust your sensor bar.

    If the lights appear to be working okay, but the remote is still confused, try turning down the sensitivity of the remote. That will encourage the remote to ignore light sources other than the sensor bar.
  9. Re:sure you can... Re:I can get one now? by beckerist · · Score: 3, Funny

    Oh man I used to throw my 64 controllers in hissy fits of rage. Whoever the fuck had to play as Oddjob every god damn time was nothing short of a cheater! (Yes, the pun was intended!)