Slashdot Mirror


Word Lens — Augmented Reality Translation

Barence writes "PC Pro has a review of a new augmented reality iPhone app that translates from Spanish to English on the fly. 'Point the camera at a decent-sized chunk of Spanish text and within a couple of seconds you'll get a rough and ready translation,' said the reviewer. 'And most magnificently of all, the translation is overlaid, at the correct size, on the original object.' The team behind the project has produced a video of Word Lens in action."

19 of 203 comments (clear)

  1. Not going to lie by FredFredrickson · · Score: 3, Interesting

    This is pretty damn cool. But no android app. No news if they plan on releasing one. In fact, their site is pretty void of any information at all. I would buy this just to play with it, but I'll never be an iphone guy.

    --
    Belief? Hope? Preference?The Existential Vortex
    1. Re:Not going to lie by mveloso · · Score: 5, Insightful

      Sorry, the iPhone is the easiest platform to monetize right now. It'll almost always be the first choice for apps.

      Being an android user is a lot like being a Mac user waiting for Windows games back in the day. It sucks, but that's how it is.

    2. Re:Not going to lie by mark72005 · · Score: 4, Insightful

      I'm guessing it's probably the easiest for a corporation to develop for, since the hardware is a known quantity and for the most part the OS versioning is too, you will get consistent function across devices. It will also be tested by Apple before they allow it on the app store.

      Certainly a slick and quick way to get an app to market.

    3. Re:Not going to lie by icebike · · Score: 5, Informative

      Here, try this: http://www.appbrain.com/search?q=translation

      There are many to choose from. None have the cutsy, but useless superimposition upon the original, but digging around in there will find page after page of ocr and translation apps.

      Lets be perfectly frank. This is an app you will use three times then forget you even have it. It is simply not useful. By the time you run around shooting pictures of signs and finally find one that says "El baño" you will have already peed your pants in Mexico.

      Far more useful is Google Translate, which uses voice recognition allowing you to speak your sentence, and will then speak it back in the language of choice. (You can use text input and copy and paste from dozens of free scanner apps as well).

      --
      Sig Battery depleted. Reverting to safe mode.
    4. Re:Not going to lie by Stele · · Score: 4, Interesting

      Also, the API is basically C (Objective C++). I had no trouble pulling in a ton of my existing C++ imaging code and just compiling it right up, layering a nice UIKit UI over it.

      I have an Android phone, but I'll have to learn Java and *PORT* my C++ code to it.

  2. Monty Pythons Hungarian Translation Book by goombah99 · · Score: 5, Funny

    Okay let's see, we combine the terror of OCR with mangled language translation and the pit fall of cropped or intersecting text patches and variable fonts and multiple contexts? My hovercraft is indeed full of eels.

    --
    Some drink at the fountain of knowledge. Others just gargle.
    1. Re:Monty Pythons Hungarian Translation Book by wjousts · · Score: 3, Interesting

      Indeed. Sometimes a bad translation is worse than no translation since it might convince you that you do actually understand the foreign text.

    2. Re:Monty Pythons Hungarian Translation Book by goombah99 · · Score: 3, Funny

      Will you please fondle my bum?

      --
      Some drink at the fountain of knowledge. Others just gargle.
    3. Re:Monty Pythons Hungarian Translation Book by citizenr · · Score: 3, Insightful

      Google Goggles already does translations of pictures. Google Translate already turns voice English to voice Spanish. Word Lens sounds pretty cool, but it's really not that far ahead of other similar projects.

      It doesn't require Internet connection.

      --
      Who logs in to gdm? Not I, said the duck.
  3. the cool thing is that it's so cheap by alen · · Score: 5, Interesting

    i remember the days when all the new cool tech was only seen in the government and large corporations first and then trickled down to us peons. these days with our rampant consumerism it's the opposite. we see cool stuff like this first and it's cheap and the big boys are now playing catch up because things move so fast

    if it wasn't for our vane consumerism this would be a government project costing tens of millions of $$$ in R&D and the devices would be single use devices that also cost some ridiculous amount of money

  4. Too bad that it does not work very well by Anonymous Coward · · Score: 4, Informative

    Too bad that this system only works with limited amount of texts. I installed this app on my iPod Touch and tried the default text reversing filter. If I used a Serif font, this could not read the words realiably. Fonts needed to be Sans Serif. Also this uses some dictionaries so if the word is not in dictionary (eg. deemed offensive) or some random gibberish, this could not recognize it. And all this I did with large black text on white background so viewing conditions are definitely not the issue.

  5. The killer app for augmented reality by psydeshow · · Score: 3, Interesting

    These guys just opened a gold mine.

    I'm sure there will be a ton of cynical and jaded comments here, but this is a working prototype of augmented reality that is actually immediately and unquestionably useful, even in its infant state. Even non-technical people can see the promise of this, and graspable promise equals investment.

    Bravo, and congratulations to the developers!

  6. Another story about how badly it works by smooth+wombat · · Score: 5, Interesting

    Just read this on MSNBC. The author shows what happens when trying it on basic Spanish.

    Overall, not worth the money until it gets heavily reworked.

    --
    We will bankrupt ourselves in the vain search for absolute security. -- Dwight D. Eisenhower
    1. Re:Another story about how badly it works by MrMarket · · Score: 4, Insightful

      Overall, not worth the money...

      What did you expect for 5 bucks?

    2. Re:Another story about how badly it works by pushing-robot · · Score: 3, Interesting

      In the future it would be nice if sign makers were required to include a data matrix in some corner, and put various translations into an online database. That way, any device with the most rudimentary camera and data service could translate it accurately, and it would be a lot cleaner than putting multilingual signs everywhere.

      --
      How can I believe you when you tell me what I don't want to hear?
  7. They are cheating from the start by FedeTXF · · Score: 4, Informative

    "LO TRADUCE EL TEXTO" is not a Spanish phrase, unless you want to say "Text translates it". The Spanish phrase would have been "TRADUCE TEXTO" but I think the result with that tool was so bad they changed the Spanish text until the bad translation rendered a good English phrase.
    The same happens with other examples from that video such as "ROPAS OPCIONAL EN ESTA PLAYA". The only way you are going to read that sign is if you ask an English speaker to write it.
    What they did was write the English phrases, translate them to Spanish and then translate them back for the video.

  8. Re:This shows how full of shit Steve Jobs is by Anrego · · Score: 3, Informative

    Much as I hate apple.. I hate flash more. And it wouldn't surprise me if what you described _is_ actually less resource intensive than flash.

    I have a higher-end quad core i7 and 12GB ram .. playing a flash video makes all 4 cores work and uses a rediculous amount of ram.

  9. Re:This shows how full of shit Steve Jobs is by dzfoo · · Score: 4, Insightful

    I call your bullshit. I don't ever recall Steve Jobs saying that the iPhone does not have the processing power to run Flash. He has said that Flash is buggy, crashes often, and does not have good performance in mobile devices. (All of which I agree with.)

    Basically, his position has been that Flash is too crappy for the iPhone, irrespective of whether the iPhone can run it or not.

                -dZ.

    --
    Carol vs. Ghost
    ...Can you save Christmas?
  10. No, it's not generally ungrammatical. by Estanislao+Mart�nez · · Score: 3

    "Lo traduce el texto" is definitely not grammatical in standard Spanish, because it has two direct objects: "lo" and "el texto". It might be acceptable in some dialect I haven't come across.

    Oh boy. This was one of the things I studied in my first year of grad school in Linguistics, so it was a long time ago. This is called "clitic doubling." I remember things being as follows:

    1. Clitic doubling of indirect objects (Le dije a Juan vs. Dije a Juan) is obligatory or optional depending on dialect and register.
    2. Some dialects, most notably Argentinian, allow clitic doubling of direct objects quite freely (or was it obligatorily? don't rememeber). I think there are also Andean Highland dialects that are highly influenced by native languages, and have a high degree of direct object clitic doubling.
    3. Other dialects have restrictions on clitic doubling, but not an absolute prohibition; many analysts, however, fail to spot this fact, so I would not be surprised if you came across claims that it's ungrammatical.

    Direct object clitic doubling in most Spanish dialects is permissible only in some conversational contexts, and IIRC depends on things like topic/focus structure of the dialogue, and parallel structure of coordinate clauses. The best examples I concocted in my research went something like this: A Pedro le mataron al hermano, a María le mataron a su madre, pero a Juan lo mataron a él. ("Peter, they killed his brother, Mary, they killed her mother, but John, they killed him"). In the final clause of that sentence, the direct object clitic doubling is in fact obligatory.