Slashdot Mirror


Handwriting Recognition on DS

JamesO writes "Zi Corporation has announced a licensing agreement with Nintendo that will allow developers to make use of handwriting recognition. PDAs have been offering handwriting recognition for some time and with the DS's touch screen it seemed inevitable that the console would eventually gain handwriting recognition technology. An agreement between Zi Corporation and Nintendo means that DS developers will be able to utilise Zi Decuma handwriting recognition technology when creating software for the handheld."

26 of 112 comments (clear)

  1. SDK by kevin_conaway · · Score: 4, Interesting

    What kind of SDK is available for the DS? What language(s) can you use?

    On a side note, are there any phones / pdas that have a Python sdk available?

    1. Re:SDK by RevAaron · · Score: 5, Informative

      You can code in Python for Windows CE 3.0+ (2.11+ maybe?), and specifically Pocket PC 2000, 2002, Windows Mobile 2003, 2003 SE and presumably 2005. There is a subset of Python, called Pippy, available for Palm OS. The WinCE port is pretty much a full port of Python; Pippy is very much stripped down. There are also the Zaurus Linux PDAs, which can run Python, though it's not as useful for writing full-on apps as it is on Pocket PC, at least within the Qtopia GUI last time I checked.

      Perl too on PocketPC/WinCE; there's even Perl/Tk support. Works pretty well.

      --

      Working toward a usable PDA environment in the spirit of Newton OS: Dynapad
    2. Re:SDK by Paladine97 · · Score: 5, Informative

      A pretty basic SDK is provided. C and C++ are your options. Feel free to compile Python for it!

      See www.dsdev.org for all the DS development info you need.

    3. Re:SDK by RevAaron · · Score: 2, Informative

      And this answers the parent's question how exactly?

      Seems pretty obvious to me. At the end of the post he asked:

      On a side note, are there any phones / pdas that have a Python sdk available?

      And I then told himabout Python support for two important PDA and Phone OSes, Palm and CE. Incidentally, there's also a Python SDK for Series 60 Nokia phones. So make that 3 important PDA/Phone OSes.

      --

      Working toward a usable PDA environment in the spirit of Newton OS: Dynapad
  2. Eat Up Martha by Anonymous Coward · · Score: 2, Funny

    cue the Newton fanboys...

    1. Re:Eat Up Martha by RevAaron · · Score: 4, Interesting

      The NDS main CPU is pretty slow- 66 MHz. I've used Decuma on Palm OS on a 200 MHz ARM (Sony Clie NX70v), and used Decuma fine, albeit a bit slowly, with the Clie underclocked at 100 MHz to save power. Decuma is decent HWR; it is in between the character-based stuff like Graffiti and the proper and good word-sentence based real HWR of the Newton or PocketPC's Transcriber or Calligrapher. It makes you write in a box- but you write a full word, it recognizes it letter by letter, and then you have to press a button to actually accept/write the text. Or make corrections, overwriting maybe 'e' for the misrecognized 'o'; then you press that button. On Palm OS, Decuma is about the best you're going to get if you want real HWR, but it isn't too horrible.

      --

      Working toward a usable PDA environment in the spirit of Newton OS: Dynapad
  3. Eat Up Martha by thatguywhoiam · · Score: 3, Interesting

    This certainly makes the DS more interesting to me (not that I'd use it as a PDA or anything). But if you can jot notes into the thing, and have it OCR'd for you, it would make it a lot handier than it is right now. Can anyone comment intelligently on how the DS CPU would handle such a thing?

    --
    If Jesus wants me it knows where to find me.
  4. Extra lives? by Krazyweasl · · Score: 4, Funny

    This is going to make 'up up down down left right left right b a b a select start' a pain to enter

  5. Finally by Edunikki · · Score: 3, Funny

    Now I can trash talk other people in multiplayer mode!

    1. Re:Finally by JonXP · · Score: 2, Interesting

      The DS has a microphone built in. Theoretically you could already do that with your voice, unlike another popular handheld system.

  6. Vorks evem b3ttar than... by Anonymous Coward · · Score: 2, Funny

    ...my Prlm.

  7. Animal Crossing DS by vodevil · · Score: 3, Interesting

    I sure hope they put this to good use in Animal Crossing DS, it was a pain in the butt to use the controller to write letters to the villagers.

    1. Re:Animal Crossing DS by Allison+Geode · · Score: 2, Informative

      based on screenshots i've seen, animal crossing DS will use a software keyboard. however, this will still be much less annoying than the original, since, of course, you'll use the stylus to hunt and peck, rather than d-pad and A-button (as seen in the original gamecube version.)

  8. Expanding their demographic by evil+agent · · Score: 2, Insightful

    Nintendo will now be marketing this to very young kids, once games come out that can teach kids how to write. Of course, this will depend on how good the handwriting recognition will be. This could be really good news for the future of penmanship, or really bad.

    --
    End transmission.
  9. AIN'T nuthin nobody can ever do . . . . . by craker · · Score: 2, Insightful

    No matter how well you develop this thing, AIN'T nuthin nobody can ever do to figure out my chicken scratch. I can't even read it right after I write it. They made keyboards for a reason - geeks can't write.

  10. Dictionary by dancingmad · · Score: 3, Interesting

    There's already a Japanese-English dictionary for the DS, but it's so so at best. A good handwriting system for the machine would be an incredible boon - often times I'm presented with a kanji I simply don't know the reading for (and I can't input it into my electronic dictionary's QWERTY interface). I do know enough kanji to be able to copy many down by writing them, so being able to write say a compund and having the DS spit out a list of possible readings and defintions would be amazing and would help me learn Japanese in the real world (here in Japan anyway) more easily as I could begin decoding stuff in the world witout need of my onerous New Nelson Kanji dictionary.

    --
    "There is no time, sir, at which ties do not matter," Jeeves, (Jeeves and the Impending Doom)
  11. The loss of Penmanship. by nlinecomputers · · Score: 2, Insightful
    This could be really good news for the future of penmanship, or really bad.


    Would that really be so awful. My penmanship was never good to begin with but I find that I so rarely sit down and write with a pen that the skill has badly deteriorated. More so with cursive then printing. I'm not sure that it is a skill we badly need any more in modern society.
    --
    Slashdot, home of supporters of free software, free music, and free speech.Except for Moderators that disagree with you.
    1. Re:The loss of Penmanship. by mrgreen4242 · · Score: 2, Interesting

      I was going to moderate this topic, but wanted to post about the difference between the ability to write and the skill of penmanship. They are not at all the same. Being able to write simply means that you know what a letter looks like and are physically capible of holding a writing utensil with enough dextarity to form that symbol.

      Good penmanship, on the otherhand, is almost an art. It's a step below calligraphy, and a step above your average scrawl. My HANDWRITING is horrible, but I can still write; I have seen some beautiful penmanship on old letters, though. I agree that the ability to write like that is fairly unneeded now-a-days, but I don't think that the GP poster was suggesting we give up handwriting all together.

  12. I For One by Paul+Slocum · · Score: 5, Funny

    Welcane aur new hondwriting recogmition ouerlonds!

  13. Re:Just a nitpick... by poot_rootbeer · · Score: 2, Informative

    Not necessarily. More advanced handwriting recognition algorithms can derive not only from a completed glyph, but also from the series of strokes you use in the process of drawing it.

    Try writing out the numeral 5, and then the letter S. Notice that even though the end results may look largely similar, the velocity and direction of your pen as you drew them were considerably different.

  14. Not the same problem at all. by brunes69 · · Score: 2, Informative

    While both involve analyzing glyphs, one involves extracting a glyph from an interpolated image (a scanned document or simmilar), while the other has the benefit of having direct digital input.

    The prior is a different problem to solve. The hardest problem with OCR is reliably differentiating between a letter and a non-letter pixel on the page. Once you have the pixels that are just the letter, it is usually simple to figure out what letter it is. This is the idea behind Captchas, to make it as hard as possible to figure out those pixels.

    Handwriting recognition is a different problem. You know the input exactly, but it is harder to figure out what letter it belongs to.

    Of course, the corss between the two is OCR'ing handwriting, which I have never seen done in any kind of reliable fashion.

  15. Pen is Mightier by Doc+Ruby · · Score: 2, Interesting

    I've really been disappointed by the tiny progress in using a stylus for input. A decade and a half ago, "pen computing" was "the next big thing". Microsoft even marketed a "Word for Windows for Workgroups for Pen Computing" edition (presumably with a "Spellcheck for Word for..."). The Palm Pilot actually delivered on the Apple Newton's promise to use our pen skills to deal with little mobile devices. But now even Palm devices, like Treos, usually disregard the pen. I think it's not so much the lack of writing recognition (which is more than adequate, though it does have problems), as the lack of any unique pen advantages to compensate for having to use a separate pen rather than an integrated keyboard.

    Pens offered an opportunity to use an expressive, intuitive gestural interface. Even mouse gestures have run circles around pen gestures. I'd like to use a pen to indicate multiple selections, associations, layouts, flows, scales, shapes. I think an interface that used chinese symbols as commands on selected objects would have tremendous popularity, and maybe even work with a huge new global zeitgeist that could jump all kinds of boundaries represented by keyboards, especially QWERTY.

    We still have the opportinity to use pointers for a really expressive, simple interface "for the masses". I built a "light pen" for my Atari PC over 20 years ago. Even Treos still come with styluses, and now the DS will recognize handwriting. Most people use pens, probably even more than keyboards, especially worldwide. That input mode isn't going away, even if it's not being pushed. Even though OSes and apps still haven't delivered on their potential, there's still lots of pent-up (pun intended) demand to use them. I don't think the breakthru lies in dropping the pen in favor of a fingertip, though I'd like to see some working software that tested that avenue. I think that once we get a pen-centric UI paradigm that does things keyboards and mice cannot, we'll get pens that people won't put down.

    --

    --
    make install -not war

  16. Re:Nintendo is Desparate by bugbeak · · Score: 5, Insightful

    The Nintendo DS is falling behind in sales against the superior Sony PSP.

    From a Gamespot article:

    "Recent sales figures provided by Dengeki Online revealed that cumulative shipments of the DS have nearly doubled those of the PSP in Japan since both launched in the country last December. As of the end of September 2005, Nintendo sold 3.2 million units of its DS handheld in Japan, while Sony Computer Entertainment shipped only 1.7 million units."

    . Dependency on Cartridges: The age of the game cartridge has come and gone. The overwhelming success of the Sony Playstation and its "intellegent" use of CD-ROM based media effectively killed the cartridges as a viable media format for software.

    Maybe for home consoles. But do you really want something portable that has moving parts? No matter how damn hard you try, you're going to treat anything handheld pretty badly.

    3. Lack of Wi-Fi Internet Connectivity: The DS only allows for multiplayer games via its wi-fi connection with oher DS units but users cannot access public wi-fi drops like with the PSP and different PDA models. Because of this it would be impossible to sync data on the DS and a PC or another PDA because of this design.

    And just how much more convenient is it to browse the web with a PSP? Ever heard of something called "input"? Besides, what's McDonald's for? Or the 50-dollar Mario Kart/Wi-Fi dongle package.

    4, No Support for Storage Media: The DS does not natively support any form of flash media cards for storing data.

    Just how "universal" is the so-called Universal Media Disc? Seen any blanks on sale recently?

    5. Dominant Childen Marketing Angle:(not even going to bother with this one...)

    Quantity doesn't really matter if Nintendo is the only one who can stay in black. So what if games are aimed for chilren? I don't think adults have gone "Eww" at Mario Party.

    The company is too slow to change and adapt with the current market and current technology.

    Who came up with Rumble? Who came up with the analog stick? Who came up with the shoulder buttons? Rather, just look at the fscking Revolution controller.

    It's flaimbait, it's troll, but I bit.

  17. Re:Nintendo is Desparate by juched · · Score: 5, Interesting

    I actually created an account on slash dot just to reply to this initial posting. It seems to me that everyone of his/her comments was inaccurate. The DS is outselling the PSP. Cartridges load much faster and hence the DS does not have the crippling load times of the PSP. The wireless is standard 802.11b and hence it can connect to the PC if the software was written for it. And yes, the DS can play only, as we will all be doing when Mario Kart comes out! Don't even get me started on keeping up with current technology. Nintendo invents the new technology... The examples of analong stick, shoulder buttons, rumble and more are all good examples of that. Just because the didn't use DVD or CD? They might be easy to create, but they are also just as easy to copy! No wonder they are trying to stay away.

  18. Re:This is very doable by Psykechan · · Score: 2, Informative

    The (Newton) Message Pad 2x00 processor was a 162MHz StrongARM 110 but the older ones were only 20MHz ARM6. Incidentally, the MP120(2.0) and the MP130 ran the newer OS (same as the 2x00) that was very capable of decent handwriting recognition unlike the original lineup. Having extensively used both a MP120(2.0) and a MP2100 I can attest to this. The 2100's only advantage was speed.

    The DS has a 66MHz ARM9 and a 33MHz ARM7. Logically, unless the ARM7 is needed for some specific DS tasks you could have it doing as good of HWR as the MP120 and still have the ARM9 free for whatever other task you required.

    Links to more info about ARM Archetecture and Newton hardware.

  19. Re:Nintendo is Desparate by amdotaku · · Score: 2, Insightful

    It's pretty clear that Nintendo has somehow acquired a kiddie image. However, when I actually look at game lists for the PSP and DS and look at titles that at least have a hope of being "good", I don't really see much of a distinction between games that would be appealing to mature audiences between PSP and DS. If anything, the DS matches count and adds greater variety to the mix with games like Advance Wars that the PSP, sticking to more stereotypical genres like plain shooters and rpgs, just won't offer.

    Also, I have no idea how much Nintendo is spending on their carts for DS, but its obviously less than $30 bucks a pop, being many games launch at that price. Also, I thought that solid state memory was the FUTURE of computing...in fact, how many times has this been brought up on /. in the past week?