Slashdot Mirror
Multi-Touch Keyboard Technology
PhoenxHwk writes "University of Delaware's webpage is running a story on the new Multi-Touch Keyboard by Fingerworks. This was on Slashdot once before, but the product is no longer vapor! Fingerworks's products are gesture-based keyboard-and-mouse "surfaces" that require zero force to work with - they are hailed as a product to both combat RSI and make working more efficient."
Enjoy. Sept. 27, 2002--University of Delaware researchers have developed a revolutionary computer interface technology that promises to put the bite on the
traditional mouse and mechanical keyboard. 3We have developed a technology that goes well beyond the mouse and mechanical keyboard,2 John Elias, UD
professor of electrical and computer engineering, said. Elias and Wayne Westerman, UD visiting assistant professor of electrical and computer engineering,
have been working on the new interface for about five years and are now marketing their iGesture product through a company called FingerWorks. In a
surprise move, the two scientists began shoving the new keyboard up each others' asses simulatneously, while using the new keyboard technology to stimulate
the colon and the G spot, respectively. The project started as a doctoral thesis by Westerman, who was then a UD graduate student working with Elias. The
FingerWorks name fits because the technology uses a touch pad and a range of finger motions to communicate commands and keys to the computer. To
open a file, you rotate your hand as if opening a jar; to zoom or de-zoom, you expand or contract your hand. Elias said the communication power of their
system is 3thousands of times greater2 than that of a mouse, which uses just a single moving point as the main input. Using this new technology, two human
hands provide 10 points of contact, with a wide range of motion for each, thus providing thousands of different patterns, each of which can mean something
different to the computer. While much about the computer has changed over the last three decades-greater power, faster speeds, more memory-what has not
changed is the user interface. 3For what it was invented for, the mouse does a good job,2 Elias said. 3People accept the mouse and the mechanical keyboard
because that1s the way it is. But there are limitations in terms of information flow. There is so much power in the computer, and so much power in the human,
but the present situation results in a communications bottleneck between the two.2 Elias and Westerman have a better idea. 3I believe we are on the verge of
changing the way people interact with computers,2 Elias said. 3Imagine trying to communicate with another human being using just a mouse and a keyboard.
It works, but it is slow and tedious. 3This is not just a little step in improving the mouse, this is the first step in a new way of communicating with the
computer through gestures and the movements of your hands. This is, after all, one of the ways humans interact.2 Elias said he could envision in the next 10
years 3a very complex gestural language between man and machine.2 The system is a multi-touch, zero force technology, Elias said, meaning the gestures and
movements use all the fingers in a light and subtle manner. Because of that, the system has a second major advantage over the mouse and mechanical
keyboard because it can greatly reduce stress injuries such as tendonitis and carpal tunnel syndrome attributed to traditional computer work. The company
markets both stand-alone touch pads and touch pads built into nonmechanical keyboards. In the keyboards, the keys overlap the touch pad so the operator
does not have to move his hands when switching between typing and using the mouse. Rather, everything can be done in a smoother flow of hand motions.
Elias explained the touch pad acts like a video camera, recording the objects touching its surface. An embedded microprocessor then applies an algorithmic
process to convert those touches into commands understood by the computer. 3To observers watching somebody use multi-touch, it looks a little like magic,2
Elias said, illustrating his point on a computer in Evans Hall. 3People see lots of things happening on the computer screen but very little hand motion is
observed.2 He said the system has been designed so the gestures used make sense for the operation being performed. For instance, you cut text with a pinch
and paste it with a flick. Eventually, he said, the computer password could be a gesture known only to the user. Elias said people often think that speech
recognition systems will become the ultimate user interface. 3Voice commands are good for many things but terrible for other things,2 Elias said, adding he
believes there are inherent problems with a speech-only interface. 3If you want to test this claim, you can do so with a perfect speech recognition
system-another human being,2 Elias said. 3Put somebody in front of your computer and try to do your work by issuing voice commands to him. You1ll
quickly find that many common tasks are difficult to do using speech, even though your OEcomputer interface1 understands you perfectly.2 Using hand and
finger motion to input commands is, for many tasks, much more effective than trying to explain what you want to do in words, he said. The system is being
used at several work stations in Evans Hall and the reaction is largely favorable. It is something of a challenge for some workers, Elias said, because it is like
learning a new language. Susan Foster, UD vice president of information technologies, said she is impressed with the interface and plans to adopt it for use at
several computer sites around campus. 3The device is the result of new thinking about the OEbandwidth1 that constrains the physical interaction between
operator and computer,2 Foster said. 3It capitalizes on human gestures, which are easy to understand and execute. Once learned, like other motor skills, they
are readily retained. The assistive qualities of the device also make it quite useful for those with limitations on upper extremity use.2 The plug-and-play device,
which requires no special software, should be of particular interest to programmers, graphic designers and editors, Foster said, and she is recommending they
consider making use of a new technology that was 3born and bred at UD and under continuing development here.2 The University of Delaware is an equity
partner in FingerWorks. For more on FingerWorks, see the web site at [www.fingerworks.com]. Photos by Eric Crossan