Slashdot Mirror


Point, Shoot and Translate into English

edstromp points out this New York Times "story on using a pocket pc to translate a street sign. It requires at least a dialup connection as it sends the photo to a server for the majority of the processing: OCR, translation, English overlay for new image, and then transmission back to the user. All said and done, it takes about 15 seconds to translate a street sign. Put this with some augumented reality, and you have a rather useful tool."

40 of 159 comments (clear)

  1. Augmented Reality Porn by mikosullivan · · Score: 5, Funny
    You walk down the street and the cute girls are modified so that they appear interested in you.

    ... oh wait, we already have beer for that.

    -Miko

    --
    Miko O'Sullivan
    1. Re:Augmented Reality Porn by sean23007 · · Score: 2

      I though beer just made the girls who are interested in you appear cute?

      --

      Lack of eloquence does not denote lack of intelligence, though they often coincide.
  2. A voice enabled translation tool by darnellmc · · Score: 2, Informative

    Go to News.com and click the link on the right side of the page that says "Does your PDA parler français?". It is video for a translation device. It's pretty amazing.

    The guy was talking into it in English and this thing repeats the words in the selected language.

    I'm sure it's far from perfect, but this thing is like one step closer to some Star Trek like technology in regards to translation.

    1. Re:A voice enabled translation tool by Peyna · · Score: 2

      'parler' is an infinitive, and doesn't fit in the sentence, it should be 'parle'. I just found it amusing that it had to do with translation, and had something simple like that incorrect. oh well.

      --
      What?
    2. Re:A voice enabled translation tool by Peyna · · Score: 2
      and what would The Language be? English is only the 3rd most widely spoken language in the world. Chinese/Mandarin is the most at about 900 million, Spanish has about 330 million, and English has around 320 million. If you include all the different dialects of Indian languages, I'm sure they would well surpass English as well.

      Besides, while English may be the United States 'official language' in practice, there really is no such thing.

      The ACLU has good information about language and the United States here.

      The other end of the spectrum (wanting the country to go entirely English speaking and nothing else, is available here.

      --
      What?
    3. Re:A voice enabled translation tool by Peyna · · Score: 2
      Yep, if you read the first definition, American should be used in the same way that Asian, European, and African are. A German is also a European, but being a European does not make him a German anymore than being an American makes someone a United States Citizen. I *believe* Fidel Castro is even an American (not sure if those islands are included in the continent or not).

      Anyway, the point is "American" is amibigous. It doesn't apply solely to the United States, it applies to the entire N/S American continents. It's just that so many people use "American" and "United Statesian" synonymously that it is listed as such in the dictionary, and so many people accept it that way. I can see why, "United Statesian" just doesn't roll of the tongue. Nor does Usian. However, many people in South America refer to USian's as: estadounidense, which is basically "United Statesian".

      Anyway, the point is, the US does not have sole rights to the use of the term America, American, etc., and should not treat them as such. You should always consider the fact that what you mean and how others perceive it will not always be the same, and therefore, by referring to something as American, you are making quite a broad generalization, and could very well cause many problems you did not forsee.

      I surely hope that people like you aren't the ones doing excessive business with our friends in Latin America. Maybe you should consult an anthropologist on this one, eh?

      --
      What?
  3. What I'd like to see... by Space+Coyote · · Score: 3, Interesting

    ...Would be a similar system that can use OCR to read street signs and then send the text to a voice synthesyzer. Seems like that would be endlessly useful for people with low vision who have trouble reading signs in awkward locations.

    --
    ___
    Cogito cogito, ergo cogito sum.
  4. Combine this technology... by TrebleJunkie · · Score: 3, Funny

    Combine this technology with last summer's craze, hotornot.com, and I think you got something. (15 seconds to know if the chick you wanna pick up in a bar is really hot? Priceless.)

    --

    Ed R.Zahurak

    You know, oblivion keeps looking better every day.

  5. How long... by theMAGE · · Score: 2, Funny

    How long till' people will drive using this as input? "Computer: what is that red sign over there?" ... crunch scan crunch ocr crunch exception: macromedia plugin required crunch downloading... ... 15 seconds later, from the car's wreckage: IT'S A STOP SIGN. REPEAT IT'S A STOP SIGN

  6. Scientific American on Augmented Reality by willybur · · Score: 3, Interesting

    On that note, this month's issue of Scientific American features an article on augmented reality. It's a good read.

    --

    --
    "Everybody wants a rock to wind a piece of string around." - They Might Be Giants, "We Want a Rock"
  7. 15 seconds? by InsaneCreator · · Score: 2

    Driving down the street...

    What's that sign?

    *click* (take a photo)

    *CRASH! BOOOM!*

    Translation comes in: "STOP" sign

  8. this is gonna scare the hell out of tourists... by bob@dB.org · · Score: 2

    ...just imagine visiting some far-away place, sending of a picture of a street-sign for translating, and getting back "beware the polar bears"!

    --
    Acts@core.mailboks.com Acrux@core.mailboks.com Adam@core.mailboks.com Adar@core.mailboks.com Ada@core.mailboks.com
  9. Suspicious by EvilBastard · · Score: 2, Funny

    I was messing with the Prototype for this, and after I tried about the 40th sign, I got this back

    Warning !
    Wrong Way
    **** HELPI'MBEINGHELDPRISONERINAWIRELESSTRANSLATINGFACI LITY ****
    Go Back

  10. Cached by BrianGa · · Score: 3, Informative
  11. yeah, but... by KingPrad · · Score: 2, Funny

    ...can you get through the airport with it? Carry any more technology and those security guards will tear you apart.

    --
    Stop the Slashdot Effect! Don't read the articles!
  12. Re:Timeline by Dimensio · · Score: 2

    What, are you suggesting that the Babel Fish is fictional?

  13. Why Translate Street Signs? by cporter · · Score: 4, Insightful
    I don't see this as a positive development. It's an excuse for crappier signs in a world where signs, schedules, maps, and notices are confusing even if you're fluent in the language. We should focus on standards and intuitive design.

    OK, maybe translating train schedules and restaurant menus is good. But street signs, especially, are supposed to be unambiguous, their meaning readily apparent to anyone, whether literate in their native language or not.

    And does this thing work on signs that some redneck has shot holes in with a 12-gauge?

    1. Re:Why Translate Street Signs? by sporty · · Score: 2

      What are you talking about? You want unambiguous, you use longitude and latitude. "Yeah, I'm only a few seconds away from 40 degrees latitude and a minute from 43 degrees longitude" :)

      Flame me for not knowing where 40x43 is :P Its a joke son, ya' hear'?!

      --

      -
      ping -f 255.255.255.255 # if only

    2. Re:Why Translate Street Signs? by Peyna · · Score: 2

      The latitude and longitude you gave could correspond to 4 different locations on earth, so I'd say that's pretty amibiguous too. =]

      Although, if you go with 40 N 43 E, it's approximately somewhere in the middle east. (Some people use a +- system, searching this was the first time I had seen that, I've only used N S E W, etc.)

      --
      What?
  14. Commoditize this thing by WillWare · · Score: 2
    Configure the translator as a web service with a fairly-obvious SOAP API. Do everything in Unicode. Allow a wide range of both input and output languages. Make plenty of clones of the server, sprinkled all over the planet. Start in tourist spots and big cities, and let them trickle out to other places.

    In the 1950s and 60s, TV commoditized and homogenized American speech patterns and culture. This will commoditize understanding between cultures, but nobody has to give up their native language. Ideas and commerce will flow more easily. It'll be a good thing.

    --
    WWJD for a Klondike Bar?
    1. Re:Commoditize this thing by Rentar · · Score: 2
      In the 1950s and 60s, TV commoditized and homogenized American speech patterns and culture.

      Do you thing this is A Good Thing (tm)? (This is not ment as a flame, but food for thought, but on second thought, maybe it is a flame.)

      Disclaimer: I'm not from the US of A, but from Europe and I really like finding a different culture every 100 kilometers (or miles).

    2. Re:Commoditize this thing by WillWare · · Score: 3, Interesting
      Do you thing [the homogenization of American culture in the 50s and 60s] is A Good Thing?

      I didn't say that. We don't need to homogenize world culture for this thing to work. What gets homogenized is understanding of other cultures. Each person stays within the dialects and habits of his or her own culture, but sometimes learns a little bit about others.

      Maybe if there had been something like this for America in the 50s and 60s, a Texas/Maine translator say, we wouldn't have ended up with our cultural homogeneity today. Though really, neither folks from Maine nor Texas have made many concessions to cultural homogenization.

      The real evil of American cultural homogenization, such as it is, is the influence of big corporations. They'd benefit by commoditized cultural understanding, but individuals would benefit even more. So I don't see this as a call to arms for the Dark Side.

      --
      WWJD for a Klondike Bar?
  15. Somewhat Related... by peterdaly · · Score: 3, Interesting

    On a somewhat related topic I have been thinking about recently:

    Java (J2ME) is now in cell phones, I have one and have played around a bit. Biggest problem with real applications is lack of a good input device. Now, for speed dialing, my phone has "voice recognition", which is really a pattern match against a saved database of me saying each person's name. It is an i85 Nextel Phone.

    Why not have a voice recognition processor? Now, the phone does not have enough horsies to crunch the stuff needed to do that...but: The phone has direct-connect. Why not a feature like direct connect, but instead of 2-way radioing another person, a voice processor system, which returns the processed speech as text into whatever is running on the phone? Take the time used out of alloted minutes...it's not like they have to connect anything in your call to the phone system to establish a call for you.

    Data connection is only about 300 baud or so, but how much faster can you really talk (so that a computer can uderstand you) than 300 baud worth of text? Same thing for reading. I can't read my email while driving (at least not safely), but why not have a "my phone" (really a computer talking to my phone) read it to me? That solves the small screen display problem too.

    Ok, enough crazy thinking for now, I could go on and on about this stuff.

    -Pete

    1. Re:Somewhat Related... by slamb · · Score: 2

      Data connection is only about 300 baud or so, but how much faster can you really talk (so that a computer can uderstand you) than 300 baud worth of text?

      If your phone were doing the translation, that might be true. But combine that statement with one you made earlier:

      Why not a feature like direct connect, but instead of 2-way radioing another person, a voice processor system, which returns the processed speech as text into whatever is running on the phone?

      ... and you've got a lot more than 300 baud of information being sent. If your phone knew enough to filter it down to 300 baud, it wouldn't need to send it at all.

    2. Re:Somewhat Related... by spike666 · · Score: 2

      theres new low power chipsets that allow you to do voice recognition processing in small devices. it all comes down to cost, power consumption (they're designed for low power devices aka handhelds,phones etc) and trainability of the chip software - aka usability.

      in other words, its probably more likely that you'll see the functionality rolled into your pda or phone.

  16. Chicken and egg situation by suso · · Score: 3, Funny

    What do you do if you're trying to read signs that would lead you to a cybercafe?

  17. I'm suprised by madenosine · · Score: 2, Informative

    I'm suprised that nearly nobody has carried the story of the brown reaserchers who put a microchip into a monkey's brain which allowed them to control a computer mouse by thinking

    They first played a game with a joystick, then played the same game controlling it with their mind, and they got about the same score both ways

    Very interesting story.....has anybody seen anything on this? It's on brown's website at http://www.brown.edu/Administration/News_Bureau/20 01-02/01-098.html

  18. I can see it now... by Eric+Damron · · Score: 2, Funny

    I'm on a business trip in Paris. My wife flys in to be with me. Fourteen hours later I show up at the airport.

    Wife: "Where the hell have you been!!!"

    Me: "server was slow..."

    --
    The race isn't always to the swift... but that's the way to bet!
  19. Yeah... by mcrbids · · Score: 2
    Put this with some augumented reality, and you have a rather useful tool.

    ... Just stay out of Canadian Airports, eh?

    --
    I have no problem with your religion until you decide it's reason to deprive others of the truth.
  20. Re:Microbes (was: Re:Timeline) by Renraku · · Score: 2

    In the book, they were earbuds.

    --
    Job? I don't have time to get a job! Who will sit around and bitch about being broke and unemployed then?
  21. the amazing thing is by gtx · · Score: 2
    i've trained myself to do similar things without computers. i was enrolled in a state funded training program for 12 years, where they taught me to identify english road signs, read them, translate them into english, and understand them. i also learned how to translate the following things into english:
    • books written in english
    • product labels written in english
    • movie subtitles written in english
    • magazine articles written in english
    then, after my 12 years of state funded black-ops training, i decided to continue my education in a private 4 year institution where they even taught me how to WRITE in english, a topic which wasn't quite covered well by the state-funded institution. perhaps if the government would make this type of training available to all members of our society, we wouldn't need computers to understand these cryptic road signs that nobody seems to be able to decode.

    -c
    --


    "I hope I don't make a mistake and manage to remain a virgin." - Britney Spears
  22. Improvement idea by Timid_Monkey · · Score: 2, Insightful
    With the processor speeds and storage abilities of current Pocket PCs, why require a dialup connection? Especially when the majority of users wouldn't have one while, say, traveling in a foreign country. (GSM still has yet to pick up here in the US).


    Why not allow the OCR program, and any necessary foreign language translation dictionaries to live in the PDA's memory? I can't see it taking up anymore than several MB, (which could certaintly be offloaded when not traveling).


    Is there something I really don't understand here?

  23. It just might be possible by mikosullivan · · Score: 2
    If everybody started wearing the systems, and you could hack the systems, you could be walking down the street and your server could discover that the girl walking towards you (it knows who she is because she's wearing the system too) subscribes to certain magazines, is a mamber of such and such clubs, and has participated in certain discussions. Then the system could provide info for picking up.

    It could happen.

    -Miko

    --
    Miko O'Sullivan
  24. But just don't... by AndroidCat · · Score: 2

    Try to wear it through airport security! (The last thing your LCD goggles/speakers report is "Pleeze come this w4y to thiz small priv4t3 roam so that we might radish you." Uhoh.)

    --
    One line blog. I hear that they're called Twitters now.
  25. Wierd Translations... by gnovos · · Score: 2

    I know this is a little bit off topic, but while the technology is cool, you'd get some really kooky translations if you went around some foreign country translating the signs. I used to live in Japan, and after I learned a little of the language, I started thinking that the Japanese have very odd naming schemes. My house was loaced between the train stops "Cherry Blossom Palace" and "Happy Island" and I lived on the street "Middle of the rice field" right across from the megamart "Big Circle". Needless to say, there were neither palaces nor islands anywhere in sight, and the closest thing to a "field" was the parking lot, and I never saw any rice there... I did see some circles, but none of them were particularly large :) Still, I'll bet it would be great for reading menues in korean resturants and finding out just which part of the cow that last slice of beef came from... or I HOPE it was a cow!

    --
    "Your superior intellect is no match for our puny weapons!"
  26. Neat idea, but the latency... by Sivar · · Score: 3, Funny

    "Dear, what does that sign over there say?"

    [15 seconds later]

    "It says: 'Road ends: Bridge constru...'"

    --
    Computer Science is no more about computers than astronomy is about telescopes. --E. W. Dijkstra
  27. Very useful by quintessent · · Score: 2

    "Hey, what does that one say?"

    "Hold on, I'll check."

    (a few seconds pass)

    SCReeeeeeeeeeechh!!!!

    "Um, this says it was a stop sign."

    "Thanks."

  28. I want to know what it can do... by msouth · · Score: 2

    ...with a picture of a beautiful, but clothed, member-of-the-appropriate-sex.

    --
    Liberty uber alles.
  29. Trouble in Tokyo Station?!?! by anonymous+loser · · Score: 4, Informative
    "The translation service is a great application of augmented reality," said Dr. Seth Teller, an associate professor of computer science and electrical engineering at the Massachusetts Institute of Technology. "I had a terrible time finding my way through the Tokyo train station last month."

    Just about every meaningful sign in Tokyo station is already translated into English. In fact, there are few train stations within a 50-mile radius of Tokyo that don't have English language signs, at least for the essential stuff (this way to Harajuku, etc.). It's only when you start getting out in the country that reading signs becomes a problem for English-speaking foreigners. E.g. most stations on the Meitetsu line outside of Nagoya completely lack English-language signs. As a tip for foreign travellers in that situation I offer the following advice: follow the crowd. You are pretty much guaranteed by natural law to end up in the city center.

  30. been doing it for years... by spike666 · · Score: 2

    i got a device that fills your requirements. it tells me what street i'm on, what street i'm approaching and even what time it is! and it doesnt even need to be able to see the street signs. of course, it needs to be able to see at least 3 of its friends to know exactly where i am, but that isnt too hard when you're outside.

    i of course am talking about my GPS.