Slashdot Mirror


Wiimote as Multi-Touch Display Controller

Tmack writes "While hard-hacks with the Wiimote are somewhat old news, this particular implementation is quite interesting. Using the infrared camera on the Wiimote, pens with LEDs instead of ink, and an LCD projector, Johnny Chung Lee of Carnegie Mellon University has created software to use them as a (relatively) cheap multi-touch display. Any surface onto which you can project becomes an interactive multi-touch display, as demonstrated in the video at the link. He has the software available for download, along with some other neat projects. Lee has also documented another impressive Wiimote hack.

19 of 107 comments (clear)

  1. I can get one now? by FatAlb3rt · · Score: 3, Funny

    What's this...a way to pass time until the demand for the Wii consoles goes down enough that I don't have to crawl over people to get one? Sign me up!

    Oh...the Wiimotes are out of stock too? *walking away, hanging head*

    1. Re:I can get one now? by morgan_greywolf · · Score: 2, Funny

      There, there. On to the good news: we still have plenty of PS3's in stock, Mr. Alb3rt.

    2. Re:I can get one now? by DrWho520 · · Score: 3, Funny

      I have seen Wiimotes everywhere, Buy Buy, Circuit City, Target and Walmart. Maybe they should contract to the Wiimote manufacturer to also start cranking out Wii's.

      --
      The cancel button is your friend. Do not hesitate to use it.
    3. Re:I can get one now? by Smidge204 · · Score: 3, Informative

      Just about any CMOS webcam can be easily modified to see only IR light. It involves removing the IR filter (usually a small glass plate with special coating inside the lens assembly) and adding a filter to block visible light (usually a fully exposed piece of film negative).

      =Smidge=

  2. Wiimote is a Wii-Detector by imstanny · · Score: 4, Informative

    The Wii-mote is actually a sensor that is used as a remote. It doesn't just send a signal, but rather it 'sees' the location of the 'motion detection' bar. In the traditional usage, it has only 1 point that it detects - the bar. But if you have 'many of these bars' the Wiimote is used as a detector of multi-inputs.

    1. Re:Wiimote is a Wii-Detector by Paralizer · · Score: 4, Informative

      The sensor bar has two IR points on either end to help with calculating things like distance. The wiimote itself can see up to 4 IR sources at any given time. So the multitouch interface would be limited to 4 pens, not that you'd need more than that though.

  3. My project by pkadd · · Score: 3, Interesting

    I am currently working on using a wii controller as primary pointing-device for my livingroom. The goal is to make it the only device needed to controll the projector + PC i use for DVD, TV, and Music playback in my home. I will post info when i've figured it all out.

    1. Re:My project by BobMcD · · Score: 2, Funny

      That's nothing a little duct-tape can't fix!

  4. Re:sure you can... Re:I can get one now? by ByOhTek · · Score: 2, Insightful

    or Nintendo predicted a higher demand for the Wiimotes

    either
    (A) the Wiis are used less for multiplayer than Nintendo expected
    or
    (B) the Wiimotes have a higher survival rate than Nintendo expected
    or
    (C) A+B

    --
    Self proclaimed typo king, and inventor of the bear destroying coffee table (patent not pending).
  5. Detecting Parkinsons Tremors by superid · · Score: 5, Interesting

    My own trival "hack". I'm using Darwiinremote to read xyz accelerometer data and Octave to make/graph ffts of Parkinson's tremors. It's remarkably sensitive!

  6. Better than the last one by TheLostSamurai · · Score: 3, Insightful

    When Johnny Lee posted his last hack, it seemed like a cool idea to track your fingers in the air, but not all that practical, as was discussed at length. This hack however could actually have very practical applications for discussion and presentation, without the $5000 price tag of many interactive white board products. I'd like to see if anyone ever attempts to implement this in a small business environment, such as a design studio.

    --
    I am Jack's complete lack of surprise.
  7. Re:sure you can... Re:I can get one now? by damn_registrars · · Score: 2, Funny
    I particularly like option

    (B) the Wiimotes have a higher survival rate than Nintendo expected
    Since this could imply that perhaps Nintendo expected more people to (inadvertently) send their wiimotes crashing through their TVs or sailing across the room...
    --
    Damn_registrars has no butt-hole. Damn_registrars has no use for a butt-hole.
  8. they have size... by emj · · Score: 2, Informative

    ... you see how big/close they are as well, so it's not just position.

    1. Re:they have size... by slim · · Score: 4, Informative

      ... you see how big/close they are as well, so it's not just position. No, the Wii software expects the Wiimote to see two IR dots (one on each end of the 'sensor' bar). Everything is calculated from these two points. X/Y position is the X/Y position of the midpoint between the two dots. Roll is the angle between the two dots. Z position (closeness) is the distance between the two dots.
  9. Re:Nothing new... by skorch · · Score: 3, Insightful

    Some of the most important innovations are not about making something completely novel but about coming up with creative and more efficient ways of using what we already have. If this hack reproduces 75% of the performance of a commercial product at a fraction of the cost, then this is already a more cost-effective solution for simple touch-screen presentation software. It also puts it well within reach of the at-home user and not something that can only even be considered for large corporate presentations. All of a sudden an 8ft sq canvas for digital art is not out of the question, and it's scalable to a simple laptop as a tablet-pc replacement.

    And considering the application he offers is free this can only encourage more experimentation that can lead to even more innovative applications of a relatively cheap and abundant product which is (Nintendo sanctioned or not) becoming more and more of a multi-purpose tool.

  10. Re:sure you can... Re:I can get one now? by gallwapa · · Score: 2, Informative

    semi OT, but...

    A few notes if you're having trouble:

    First, make sure your IR sources don't confuse the wiimote. Example: Opening my drapes on the window behind the TV on a warm, sunny day, made the wiimote useless.

    Second, set the proper height for the "sensor" bar in the Wii console itself. It does make a difference, especially if you have a large TV

    Third, make sure your batteries are properly charged. Don't wait for the warning to go to red. When it gets to 1 bar, put the batteries in the recharger.

    The "IR Pollution" is the biggest factor affecting the performance of your wiimote, in addition to distance. If you're standing 20ft away, you may wish to get a separate wireless IR emitter ($6 on amazon)that you can mount somewhere closer in your room.

    Hope this helps

  11. Re:sure you can... Re:I can get one now? by AKAImBatman · · Score: 4, Informative

    I keep wanting to bash the thing against my coffee table because it won't detect that it is pointing at the screen.

    Check that there are no bright IR light sources nearby. Sunlight and Christmas lights are two common ones that confuse the Wii Remote. Also make sure that your Sensor Bar is far enough forward that it isn't blocked at certain angles.

    An easy way to figure things out is to go into the Wii Remote settings screen. There's a black and white image there that effectively shows you exactly what the Wii Remote "sees". You should see a few dots that do not flicker or go away as you move the remote around. If the dots disappear at any point during your tests, you may need to adjust your sensor bar.

    If the lights appear to be working okay, but the remote is still confused, try turning down the sensitivity of the remote. That will encourage the remote to ignore light sources other than the sensor bar.
  12. But you can make IR patterns by emj · · Score: 2, Insightful

    You can have three paintings on the wall, a phone, a radio and a TV, which all have different IR patterns. Then when you point you Wiimote on the phone painting, the Wii mote will see the pattern and tell your computer what you are pointing at. The computer will then activate the Twinkle (sip) on your computer and you can interface with it.. :-)

    Using the motion sensors to answer calls might be a bit awkward (some minutes into the clip).

  13. Re:sure you can... Re:I can get one now? by beckerist · · Score: 3, Funny

    Oh man I used to throw my 64 controllers in hissy fits of rage. Whoever the fuck had to play as Oddjob every god damn time was nothing short of a cheater! (Yes, the pun was intended!)