Slashdot Mirror
Open-Source Multitouch Display
shankar writes "Engineers at Eyebeam, an art and technology center based in New York, have created a scaled-down open-source version of Surface, called Cubit. By sharing the Cubit's hardware schematics and software source code, the engineers are significantly reducing the cost of owning a multitouch table. 'Multitouch displays are not new technology; in fact, they've been built in research labs for decades. Mitsubishi Electric Research Labs created an iconic multitouch table called DiamondTouch; more recently, Jeff Han, founder of Perceptive Pixel, based in New York, developed wall-sized multitouch screens that he sells to corporations and major government agencies. But because of the falling costs of many touch-screen components, such as infrared light sources and small cameras and projectors, it's now becoming feasible for people without access to a lab or venture-capital money to make their own multitouch displays.'"
http://reactrix.com/
I think the answer that you are looking for is that it allows joe sixpack (joe bloggs) to use a computer in a more natural fashion. Personally I manage to type at about 45-50 wpm and keyboard shortcuts as well as some mouse effects make me quite a bit more efficient than the low end of computer skills users.
With a multitouch surface and appropriate desktop UI software, it allows anyone to do things that they would be hindered in doing with keyboard and mouse. This type of interface is much more intuitive in as much as it works like our brain wants to work. That is not to say that it doesn't take learning, but it is easier/more natural to the way we work with other things in life. The keyboard and mouse are NOT natural interfaces.
Some demos I've seen let people work with documents and folders in much the way they would on their own desks with paper documents and folders. Ergonomics aside, I think this would help those who can least afford it the most.
Support NYCountryLawyer RIAA vs People
I'm a little skeptical at this point that a multitouch display will be faster than a keyboard and mouse for most tasks. I've used touch screens, and they are faster than a mouse for certain tasks, but they are also frustrating and often cumbersome.
I type around 80 wpm, and I bounce back and forth between keyboard and mouse, depending on which is faster for a given task. I've even become really accustom to hitting Win+R or Alt+F2 and then typing a program name, as opposed to using a Start or KDE Menu, and often this is faster.
The keyboard isn't "natural" but often it is the fastest tool available to me, even though the mouse seems more like a natural means of pointing, selecting, moving, marking, etc. I do use a mouse for selecting, but only when shift+direction isn't faster.
There are a few multi-touch specific gestures, such as pinching with two fingers to close a window, but throwing my mouse to the right corner and clicking X, or hitting Alt-F4 is just as fast. Pinching might seem fun, but I have yet to see a full interface designed around a multi-touch display to take advantage of it, and really make it a faster system to work with.
Furthermore, I touch Surface was not designed for a single user, but rather multi-touch for multiple users.
Am I mistaken?
http://blindscribblings.com - Tasty pop-culture in conceptual fashion.
No, you are right on target. That is why I said that the people it will help the most are the ones least able to afford it.
Whether it is for multiple people or not, it does change the interface for the computer to a more 'natural' environment. You and I and many others are quite adept with mouse and keyboard for one reason or another, but joe bloggs is not. It is joe bloggs that it will help the most. In a "failure mode test" (TM) it will succeed where keyboard and mouse do not. Think of the physically impaired, or mentally handicapped. Where you can simply show them how to do something with a finger or hand and they can repeat it. Trying to teach them to type is often the barrier to entry for some classes of users.
The usefulness of this technology has yet to be shown for users of your/my class.
Remember, "there is need of maybe 5 computers in the whole world"... "The phonograph is a swell toy, but it will never catch on" and many other early quotes about technology that later became indispensables.
The mere fact that it radically changes the UI for a computer means that it will open up computing to those who find keyboards/mice a barrier to entry. Yes, it doesn't seem to have immediate game changing applications, but it will.
Support NYCountryLawyer RIAA vs People
but the ways that it is being used are. With more powerful processors being smaller and cooler, now devices like the iPhone and the Surface can be built. In addition, these devices have only really become applicable in a time where people are already linked by technology, not 20 years ago when there was no processing power for such a device. One of the more interesting features of Surface is that it can detect digital cameras or cell phones placed on it and (somehow) download photos and videos from it, this too was worthless back in the day before these devices existed or became as common as the wristwatch. The iPhone would have been worthless without the processing power to run the animations used with multi-touch features and the desire for a device more versatile (in user interaction) than the traditional mobile phone or smart phone, which was already pretty good. Having an open source multi-touch kit doesn't provide the software that make devices like the iPhone and Surface what they are, but merely demonstrates to the average guy that multitouch is not a new idea and is easily implemented.
Here are Cubit's project websites:
http://nortd.com/cubit/
http://eyebeam.org/project/cubit
Well, when it comes down to it, surface computing will not be optimal for the typical paradigms that we have grown to love/hate with keyboard/mouse interaction. A single-touch device is basically applying/mapping an already solid interface (the mouse) to a lesser approach. The whole point of multi-touch technology is to break away from the typical one-process-at-a-time task, and move into the realm of a computing adapting itself to the user's preferences.
I've had the chance to play around with the MS surface table... It's true that there isn't much there besides (for me anyway, an advanced computer user) the flash. However, watching the more typical user (and especially kids) interact with it, was a blast. Most multiplayer games require separate controller-type gameplay, but with surface we had our game immersed into a combined space.
In short, I think that multi-touch is a much better approach to computational collaboration that the single node per user approach... but one has to realize that it's still in its infantile state (for a typical, off-the-street user).
In short, I think that multi-touch is a much better approach to computational collaboration that the single node per user approach... but one has to realize that it's still in its infantile state (for a typical, off-the-street user).
Indeed, and I think before it matures we're going to have to figure out what "a much better approach to computational collaboration that the single node per user approach" means.-- "In order to have power, I must be taken seriously." -Mojo Jojo
If you've been to a Bjork show recently you've seen one of those. Check out the reactrix demos on youtube.
Only the State obtains its revenue by coercion. - Murray Rothbard
johnny chung lee's had it down for years: http://www.cs.cmu.edu/~johnny/projects/wii/
And he used a Mac. Much cooler.
Uuuuh? You think that someone who's attempting to do something is cooler than someone with an actual finished product, that you can build yourself right now as the designer's have published the software & hardware schematics?
Seriously? What makes this kid's attempt at something much cooler than eyebeam's table?
(Oh, and your name is like my sig)
There are shills on slashdot. Apparently, I'm one of them.
This url should be in the summary, I wonder why they missed it.
Seriously. Even if they just get the fire/water effects of compiz going with a device like this, it would be much more awesome than the demo videos. Could have a small table like this as an input device, and a larger screen to show all the compiz coolness. I don't have the requisite skills, but I hope someone in the community hears me :)
Geeks like to think that they can ignore politics, you can leave politics alone, but politics won't leave you alone.-rms
I researched multi-touch homebrews a couple of years ago after seeing this video:
http://www.youtube.com/watch?v=peWX0hcqGdc
Figured it was frustrated total internal reflection at work and managed to find out that the concept is pretty much unpatentable due to prior art. Not very often you see that!
That video does go to show that 'nifty' goes a lot farther than just computer based interaction. I'm imagining some cool new video game concepts, like virtual air-hockey or pong, plus games whose imputs might be better based on touching a panel than joystick and buttons.
One neat application for a touchscreen table would be for a gaming table with the equivalent of board games running on it. You could have a regular coffee table when it's off, and have an assortment of games when company comes over. You wouldn't have to worry if someone spills a drink on the table or if pieces are lost. It probably wouldn't be hard to have display components that have a limited aspect ratio so opposing players wouldn't be able to see parts of the game for ones that require it.
(oops - meant to say viewing angle, not aspect ratio.)
Personally I manage to type at about 45-50 wpm ...
As a side note, I'd wager that you never learned to type properly. Put another way, there is no reason why someone who can type at 45 wpm shouldn't be typing at 65 wpm minimum comfortably and with increased accuracy.
Not worth the effort? Perhaps, but consider the time required for a course and some initial practice versus gaining a 50% improvement in speed for the rest of your typing days.
Me, I took typing class way back when in high school because I thought it was an easy way to meet girls. I didn't consider the possibility that they would resent me when I learned to type faster than they did, or that I would be making a living using a keyboard.
Comment removed based on user account deletion
DUDE! you are SOOOO wrong.
In high school I was the ONLY guy in the typing class. I took it because I figured some how, some way, I'd be working with computers some day.
Yes, back then I could hit 60wpm pretty good. Now, I'm just a little lazy really. If I wanted to be faster I would.
I've been to meetings where when asked if I'll share my notes and I reply yes, everyone else (including the secretary types there) will shut down their notebooks. I type and talk at the same time and only fuck up if I look at the keyboard.
I used to type up trip reports in the airport bar while waiting for the flight home. One time a guy asked me if I was taking notes because I tend to look around the room while I'm typing. I know the words, and don't need to look... guess he thought I was spying and taking notes on people in the bar. Several people thought I was being pretentious and only pretending to type on the keyboard.
Yes, I did learn how to type correctly. I just suffer from some digital dyslexia, such as:
from = form
thes = this
and several other 'right finger, wrong hand' issues. Normally I don't do too badly. I just don't care to type more than about 45wpm. It does not do me much good to try to type faster.
Online I keep up with people who type in excess of 100wpm so I don't feel badly about it. It just is.
Support NYCountryLawyer RIAA vs People
Most people have more than one finger. Multitouch is important for intuitive gestures. Gestures are pretty critical for touch screens.
I've really been wanting to do this. Maybe even have the table recognize actual game pieces and change the board to match.
I have an overhead projector, a few 15" LCDs, some projection lenses, and some Lexan. Alas, it seems I'll have to wait to see if this Cubit thing will be helpful to me.
I think the answer that you are looking for is that it allows joe sixpack (joe bloggs) to use a computer in a more natural fashion.
Is there a "natural fashion" to use a computer?
As a drafting table-trained draftsman (back 25 years or so ago) I had to learn how to interpret the real world at a small scale. Going to CAD and a 14" screen was tough because I couldn't see the extents of my normal 22"x34" (or larger - some older P&IDs were on scrolls many feet long) field of view. Later I used dual 21" CRTs, then went to 4 22" LCDs and am now using a single 30" monitor.
None of these solutions are "natural", since zooming around inside an active screen is extremely artificial. On the other hand, old draftsmen will be all dead soon, so this perception of natural will go away.
The display is very cool. But has anyone here looked at the openFrameworks library that they used in building the software? People are doing some things with it that I, at least, have never seen before, by the looks of this video (which I found by linking through their site): http://www.vimeo.com/921725
Personally I don't find it intuitive at all to use more than one finger in gestures. eg. the iphone - I used the pinch thing once and abandoned it (the double click action is much better).. it's just feels like a totally unnatural thing to do.. Same with using two fingers to double click on the MBP... just not a natural way of thinking about it.
NUI Group has been doing this for a while. They have an active community of amateurs as well for anyone interested.
http://www.nuigroup.com/
and I had exactly the opposite. I picked up the iphone and was resizing images and pages quickly. Of course I can get used to any GU OS in seconds so I am hardly a good example.
you are right about the double click though, a double click is a double tap.
i thought once I was found, but it was only a dream.
I just want to chime in here and say that when I put my fingers on the home keys, it causes me physical pain. I have gigantic hands (on most keyboards I can press the two control keys with one hand without depressing their neighbors) and as no one makes a keyboard large enough for me, it is impossible to touch type. Perhaps one day I will get a chorded keyboard, but until then, you will be wrong :P
"You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
You are mistaken. Recently, my 55-year-old aunt, a Boston College Law School grad, called me to ask me how to copy a URL link into an e-mail message. Now, she used *none* of those words in her request, so it took me some time to translate.
The answer to her question was simple of course (on a Mac: CMD-L, CMD-C, CMD-`, CMD-V). But my instructions fell on deaf ears for two reasons: one, she didn't understand how to perform keystroke combinations and two, she didn't understand that her e-mail client was just another Web browser window.
Multi-touch is for people like my aunt, people whose brains lack the circuitry to utilize arbitrary, abstract tools (even old Mr. QWERTY) to perform otherwise objective tasks.
Those are keyboards for retards and children. None of them have a full character set and every key is in the wrong place. I want a proper layout, in which keys are where they belong, but scaled up 15% or so (like me.)
I'd also like a 10% taller and ~7% wider Ford GT40. 6'2" is about the height limit, and I want one :)
"You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
One day, the old draftsman will be the computer users who cut their teeth using programs like ed, vi, emacs, pine, and even old Word Perfect 5.1. I've spent the last 20 years searching for keyboard shortcuts for every application that I depend on. It's actually hard for me use more "natural" approaches like multi-touch.
But it's probably the way to go. As much as I like vi, its command/mode syntax is basically an abomination.
check out libavg
and for early examples of this, check out sony's holowall - over 10 years old:
holowall
Two fingers to double click on a MBP? I've apparently never found that setting. It's two fingers to right click, or to scroll. Both are fantastic. Everybody I've shown it to love them as well.
Despite your preferences there are many people who like multitouch gestures. Probably a majority.
You're saying we need to design a slower and worse interface around the lowest common denominator?
Little kids learn how to use a keyboard with no problem. Just because older folks are scared of technology doesn't mean we should cater exclusively to them.
I couldn't explain the concept of a mouse to my grandmother, because she didn't get why you would need to point on a computer. Should we cater everything to her?
http://blindscribblings.com - Tasty pop-culture in conceptual fashion.
Bah, keyboard command input is the way to go for CAD, and certain companies keep moving around and redefining the cute icons so that veterans that don't follow all the latest trends get lost with new releases.
When I see a 35 year veteran stumbling around trying to plot a 22x34 to scale I know something's wrong.
Many changes are/were made to uncomplicate the work of CAD support drones, not for the fricking guys/gals that actually do the REAL work. That was a nice sneaky slide into making ones self irreplaceable and the designers resent it.
Maybe the problems it can solve are just not ones you ever have?
I'm an artist. When I do art in the real world I'm working on a big surface. When I do art in the computer I'm squinting at it through the lens of my laptop screen. I would much rather spend about $1000 for a table-size display I could draw directly onto than the $2500 a 21" Cintiq tablet would cost.
If your main use for the computer is "writing" - whether it be code, text, mail, irc, or whatever - then yes, a keyboard is your best choice.
egypt urnash minimal art.
Its good for musicians, dude. Think about it - you want to create a nice software synth. Do you only allow the player to modulate one parameter at a time (as is the case now with mouse-based soft synths) or should there be more performance? The performance is the key ..
; -- the corruption of government starts with its secrets. a truly free people keep no secrets. --
Surface is much, much more expensive than a tablet. You're saying you want the benefits of a Cintiq tablet, but much larger, and cheaper.
Wait 10 years.
http://blindscribblings.com - Tasty pop-culture in conceptual fashion.
Or why I want to play with homebrewing one. These things aren't that much more than a big piece of acrylic plus a projector and an IR camera. And a big slab of acrylic with a light beneath it is handy for ANY artist!
egypt urnash minimal art.
Ah yes, the surface... http://youtube.com/watch?v=CZrr7AZ9nCY
If you'd bothered to RTFA or watch the VIDEO, you'd known this was a Mac too. Plus, they have a DIY-kit that you can buy.
Apart from that, the kid does give some instructions, but not nearly detailed enough for them to be useful, at least for me. This kit is totally FTW.
What if they were cheap enough to use in highways, streets, and even sidewalks to allow detailed analysis of human traffic patterns.
Smart sidewalks. Wow. Where did I park my car? Just check Googleped!