Slashdot Mirror
The iPad As a Shape-Recognition System
An anonymous reader writes with an interesting use for the iPad: "The guys over at the Volumique blog have a different idea as to how to tackle apps for Apple's devices. They aren't just thinking about a digital activity on such devices, they are experimenting with using physical objects through Apple's multi-touch screens. Imagine being able to buy the playing pieces for a board game, but then loading up an app on your iPad for the actual board. The pieces would be recognized when placed on the iPad's screen, it would even recognize which direction they were facing. This may sound like an impossible feat unless you use a much more expensive device like Microsoft Surface, but Bertrand Duplat and Etienne Mineur at Volumique already have it working."
That wasn't intrusive.
Soon the thing will take your fingerprints and surreptitiously send them off...
For justice, we must go to Don Corleone
Comments attached to TFA indicate it may be a hoax, after watching the videos carefully.
Without more details or having this app actually for download it's hard to say whether real or fake. Indeed it sounds too good to be true, so it probably is.
I build apps like this for Microsoft Surface and other systems. This technology has been around a long time and there are many apps that do it already. Not news. Congratulations on missing the short bus.
The last choice (“jeux vidéo”) clearly selects itself a moment before the token is actually set down onto it in the first video on their blog.
Alexander Peter Kristopeit bought his basement from his mommy for one dollar.
Microsoft Surface is also much larger (the size of a coffee table or so) where it might make sense to put objects on it. Board gaming on a Surface would be quite an experience, but with an iPad you'd be covering most of the display unless you stuck to just a few playing pieces. You also have to fit the entire board on the screen, as it won't be able to scroll with pieces on it. The example given in the article, Monopoly, just wouldn't wouldn't work at all.
"A week in the lab saves an hour in the library"
Uh, even the article summary says that this has already been done on the Surface, which is a big "no duh!" since Surface was designed to interact with real-world objects in such a manner.
The news here is that is has been done on the much smaller, much cheaper iPad, which was not designed to perform such a function-- assuming the demo videos are not faked as some have alleged.
How does the pogo stylus work for the iDevices? This likely works the same way. They embed capacitive dots on the device. Different size dots and or multiple dots can be used to differentiate objects. Each app would have a limited number of pre-defined objects that it would recognize. By using multiple dots at different spacial coordinates you could distinguish different objects and the direction that they are pointed. You would likely run into a limitation on the number of multi-touches detected for a game like chess though.
I'm 24 years old. I don't want to go through the next 50 years of my life living in an international air of worry and uncertainty. I don't want to live in a permanent state of fear, generated by a megalomaniacal American government taking advantage of the majority low IQ populous' capacity for being brainwashed.
I don't want to live like Israel, fighting militant Muslims round every corner. The problem of Muslim extremists exists and needs to be dealt with, not encouraged by invading innocent countries and waging war on people who have done nothing to deserve it. I want my children to grow up in a world free from military oppression and I want a government that understands that the wars of the future are guerrilla ones which can never be won, even if they are waged for noble purposes (which theirs never are).
The world is fu*cked up enough as it is. The food chain has been poisoned so badly the average human is full of chemicals normally found in plastics and toxic waste. I'm sick of global warning and environmental damage to the planet and the fact the all this time the greenies were right. I'm sick of America being the biggest wilful contributor to the pollution of the planet.
I'm sick of an American school system that produces children who are brought up to believe that America IS the world and anything that goes on outside is irrelevant. Children so stupid they think America invented the Internet, computer, motor car, light bulb, telephone etc ad infinitum....
The Internet or it's successor is the future of entertainment and I'm sick of stupid low IQ, ignorant Americans infecting every corner of it with their insular, jingoistic mindsets, their whiny voices and manifestations of their low self esteem driven by the fact that despite it being their turn as the world's super power, no one actually takes them seriously or gives them the respect that the British or the Ancient Greeks got because a superpower best known for producing mass produced crap is never going to get the respect that one who gave the world Shakespeare, culture, philosophy or mathematics will get.
I'm sick of hypocrisy and two facedness. I'm sick of Gangsta Rap and hamburgers, Political Correctness and TV programmes that begin with 'When' and end in 'go bad and attack people'. I'm sick of reality TV and I'm sick of news programmes that are more censored than accurate. I'm sick of tokens, token minorities, token universities, token degrees, token attempts at the truth, tokens. I'm sick of fat people, ugly people, stupid people, gay people, coloured people, female people, whiny people all complaining they don't have the opportunities in life they would like and it must be someone else's fault. I'm sick of women that act like men and femininity being a crime, unless you're a man in which case you're a new man which nobody ever wanted because there was nothing wrong with the old one. I'm sick of people falling over and suing the ground and people watching nipples and suing the TV and I'm sick of coffee cups with 'don't pour over yourself, you may get burnt' on the side to try and counter this.
I'm sick of stupid Americans who don't know the difference between patriotism and jingoism and who think flag waving should be an Olympic event. I'm sick of Americans who cry that people hate them or are jealous of them or who are anti them because someone dares to point out that the America they've been programmed to believe in from birth bears no relation to the one that exists in real life.
Could be a trick, of course. Could be not.
Looking at example with two figurines and iphone it seems that they have different weights - check out the bases. These seem to be button-batteries of different types and weights. In the video, however, look at 00:52 how one of responses highlights before figurine is put down.
With multiple figurines and ipad also see bases - they seem to have different radius. Detection of direction could be a bit of a hoax, maybe figurine is pressed in a specific way to help the system.
"Coloured paper" example could be explained by different amount of surface pressed against screen. Patterns are just to confuse viewers. This one is probably a trick, while the previous ones are more practical.
Comments from people who know how Apple's touchpads work (what they are able to detect) are more than welcome.
What is with Slashdot incessantly Slashvertising for the iPad? Why is it that any trivial thing done on an iPad becomes a news story here?
What next? Steve Jobs lets a fart rip?
Device with large multi-touchscreen can be used as a large multi-touchscreen! How about we just gut it and use the screen as a sensor? I know it would leave Apple out, but I'm okay with that.
I thought about this quite a bit: I don't think it will be long before a major RPG system like D&D publishes an entirely paper-free edition, where the players and the DM all have touchpads. Instead of miniatures, you have avatars of your character on the game board, and certain combat actions (like determining whether a hit landed) can be automated. Basically, the "I attack this guy with my +3 sword" command would be selected on your digital character sheet, and then you just get a prompt to roll a d20 on your touchpad. All the stuff about armor adjustments, size compensation, and whatever other rules, would be calculated automatically.
I can't wait for this obvious streamlining step. I think it will most benefit rule-heavy games like Hackmaster, which are a lot more fun than D&D but rather tedious when combat situations get big. Once we get used to this, we can actually make the hit and damage modifier system even more complicated and realistic, because using weapon speed factors, armor type modifiers, armor damage, hit location determination, etc. will actually not slow down the game at all. This stuff can return the focus of the personal interaction to where it should be, which is fantasy and role-playing. As a bonus, combat rounds can be rendered and animated once this gets good enough to help with immersion.
It won't be long before the purchase of a nice touchpad will cost you less than the purchase of a set of D&D rulebooks. Then, instead of reading about character creation, it will make much more sense to just load up the character creation wizard on the touchpad and start rolling. In more advanced versions, the software will show you the first-person view of "what you see" when you kick down a door. This really is the first step.
It is a capacitive touch screen - right? These work by having a sheet of glass with a conductive material that when your finger (also conductive) touches it is sensed. The question then becomes - how small a "spot" can it sense and how many multi-touches at the same time? If it can sense small enough and a large enough number then a braille like symbol on the bottom of the playing pieces would be plenty to identify the item along with its direction. Some of the items they are placing on the screen *aren't* conductive so they are either faking it or have something else on it. If the latter there are a number of other applications that use capacitive dots so other than applying this to game pieces not really much new.
If the screen *can not* see like that then I can't figure out how it would work. Most bases for board games are round and there is no way to "see" which way the top of the piece is facing - round items do not have direction from their bases. One may be able to have some patterns indicate direction - say each time a piece is placed you are required to move it (maybe even a really small amount) in the direction it is facing, but that isn't inherent in just dropping the piece on the surface and it knowing where it is. Further if it is just a round base and no indentifying marks can be read there is no way to know which piece is what from just setting it on the board. Again, one could make a a system where other information is used - for instance have all the pieces start in known locations. Double tap to remove a piece from the board and every time a piece is picked up it is being "moved" to the next location it touches - basically the pieces are a mouse.
Of course those are how other things "sense" what item is on the surface and direction - the hard part is the surface.
The real issue is why? How many board games can be played on a 10" surface let alone a 4" one? At least with respect to board games (would have to think a bit about other applications) I can't see playing much of anything that way. Even with something that already uses a small board (chess) you would have to have *really* small pieces and would be hard to accurately pick them up and place them. Like many products in search of an audience if their goal is to play with some neat hardware and learn something then there is no answer to why needed past that, if they are looking to make money from this good luck - I think you are going to need it (better get a a patent so you can at least hold onto the idea until screen surfaces catch up with your idea).
------- Sorry about the spelling, I suffer from two problems. Dyslexia makes it difficult to spell well, lazy makes it
I'm suspicious this is a hoax (after all, doesn't the iPad's screen detect capacitance- not visuals like patterns and shapes?) ...but even if it's real, I noticed the guy was consistently pressing down pretty hard with everything it detected. I wonder if the object's own weight isn't enough to trip whatever sensor they're using.
The ReacTable...Bjork had one of these on her most recent US tour. Lots of fun to watch in action.
I tried googling around to find what was behind the toucscreen technology of the iPAD but could not find enough info. Anyway it all depend on the x/y resolution. There are many tech of capacitive display (see wiki) but to my udnerstanding it all boil down to knowing an array of (x,y) points where the voltage dropped/capacitance changed. If the resolution in x/y of those change is fine enough, one could have conducting material in form of bar code or dot/line (like you mentionned) to show the orientation and value of a card/piece. So if it is a capacitive display it all hinge on the resolution. Other technology you would not have such luck (IR type for example).
I do not see either the interrest of using board game piece with such a small screen, even the smallest encounter in D&D took more place with the tin figurine we use. For other board, maybe it could be interresting, and easier to transport the figurine on holiday , than say, the board AND the figurine. That said, it is more of a gimmick as you could as well *draw* the figurine on the board instead of bringing them with you.
it's not fake. It can only work for one object at a time though. It's pretty simpe... there are two contact points on each object that simulate the touch of a finger. the distance between the points indicates the type of object. and the angle between the points indicates rotation of course ! But they can't scale this up... from what I can tell, one object at a time is a hard limit. But this is a software limitation probably, not a hardware limitation.
You mean an RPG game like this: http://www.youtube.com/watch?v=n94E3IeBquY
And a cheap DIY Surface like this: http://www.maximumpc.com/article/features/maximum_pc_builds_a_multitouch_surface_computer?page=0,0
-Rick
"Most people in the U.S. wouldn't know they live in a tyrannical state if it walked up and grabbed their junk." - MyFirs
NOT buying an iPad.
Yours In Moscow,
Kilgore T.
Three dots, sufficiently not in a row, are called a triangle.
Not if you do not draw lines between them. But lines do not enter into touch detection in iOS, all you ever have are points.
"There is more worth loving than we have strength to love." - Brian Jay Stanley
On the second demo, notice that the thumb on the bottom part of the card is ALWAYS right over the home button? And notice that they don't show the app quitting? I suspect they're just tapping the home button, which the app is capturing and showing a static image in a fixed order. FAKE.
Did anyone notice the Eldar model they were using in the second image? I wonder if Games Workshop know about this? Even though its free advertising, their IP watchdogs will will probably litigate this into nonexistence.
Imagine a surface where EVEN THE GAME PEICES are simulated! Like an entire board game with no physical parts at all! REVOLUTIONARY!
Why?