Point, Shoot and Translate into English
edstromp points out this New York Times "story on using a pocket pc to translate a street sign. It requires at least a dialup connection as it sends the photo to a server for the majority of the processing: OCR, translation, English overlay for new image, and then transmission back to the user. All said and done, it takes about 15 seconds to translate a street sign. Put this with some augumented reality, and you have a rather useful tool."
going down the highway having to stop for 15 seconds every quarter mile or so really makes that 70 mph speed limit rather slow
I can't wait until that is embedded in a contact lens.
This story conjures up images in my mind of a person walking dowm the street with a wearable computer and visor-mounted display, having a good belly laugh at everything around him whilst passers-by look on in bemusement. He's laughing because he's configured his translator to run everything through English->Foo->English translation.
...while driving.
http://www.yourmothernaked.com
-Miko
Miko O'Sullivan
This can't be too far away, then. in Michael Crichton's "Timeline," they have little earbuds that can translate spoken words into something that the wearer can understand, on the fly. If only we had something like this in reality. Not too much farther away...
Job? I don't have time to get a job! Who will sit around and bitch about being broke and unemployed then?
I believe Linux Conf Australia had a speaker (see http://www.linux.org.au/conf/abstracts.html#tinmit h) who discussed converting predefined glyphs into 3D overlays. Extending this capability to a wider set of real-world signage would be a worthy project for the Linux-based PSX2 and it would require insane amounts of image processing.
LL
Go to News.com and click the link on the right side of the page that says "Does your PDA parler français?". It is video for a translation device. It's pretty amazing.
The guy was talking into it in English and this thing repeats the words in the selected language.
I'm sure it's far from perfect, but this thing is like one step closer to some Star Trek like technology in regards to translation.
i can see it being useful if you have some way of connecting, but without it, all you will get are some pictures of signs in a foreign language.
Guns are like umbrellas and condoms. Better to have one and not need it, than need it and not have one.
...Would be a similar system that can use OCR to read street signs and then send the text to a voice synthesyzer. Seems like that would be endlessly useful for people with low vision who have trouble reading signs in awkward locations.
___
Cogito cogito, ergo cogito sum.
Combine this technology with last summer's craze, hotornot.com, and I think you got something. (15 seconds to know if the chick you wanna pick up in a bar is really hot? Priceless.)
Ed R.Zahurak
You know, oblivion keeps looking better every day.
Went to one them countries abroad 'while back. Filled with foreigners, it was. Everywhere I looked was foreigners yammering in some strange foreign tongue. I can't see why they just don't learn to speak English...much easier than wasting my time with some sort of pocket translater.
Think of all the better things they could do. They could translate it from Enligsh to hax0r! "5p33d l1m17: 55 mph" "570p!" "j00 c4n 4d0p7 4 h1ghw4y!"
How long till' people will drive using this as input? "Computer: what is that red sign over there?" ... crunch scan crunch ocr crunch exception: macromedia plugin required crunch downloading... ... 15 seconds later, from the car's wreckage: IT'S A STOP SIGN. REPEAT IT'S A STOP SIGN
On that note, this month's issue of Scientific American features an article on augmented reality. It's a good read.
--
"Everybody wants a rock to wind a piece of string around." - They Might Be Giants, "We Want a Rock"
Driving down the street...
What's that sign?
*click* (take a photo)
*CRASH! BOOOM!*
Translation comes in: "STOP" sign
...just imagine visiting some far-away place, sending of a picture of a street-sign for translating, and getting back "beware the polar bears"!
Acts@core.mailboks.com Acrux@core.mailboks.com Adam@core.mailboks.com Adar@core.mailboks.com Ada@core.mailboks.com
I was messing with the Prototype for this, and after I tried about the 40th sign, I got this back
I LITY ****
Warning !
Wrong Way
**** HELPI'MBEINGHELDPRISONERINAWIRELESSTRANSLATINGFAC
Go Back
Definately reminds me of the babelfish... although I don't think they worked for reading... I read an article a month or so ago about a research group working on AR (augmented reality). The setup they had weighed about 50 pounds and required a big bulky headset. But with the rate of miniturization these days... who knows what'll be possible in the not-too-distant future. I envision everyone wearing glasses that project the AR, and connect to a computer in a pocket somewhere... Maybe it'll be contacts.
So what happens when the translation site gets slashdotted?
"Honey, what's that sign say?"
"I don't know dear, it's just not responding"
skreeech BAM! (test of Pauli exclusion principle on a macro scale completed...)
"Now the site's up honey....Oh, it's a stop sign."
Ok, so what about China or Japan? If you are going for travel, you can learn a few Kanji. It's the least you could do. If you're going on business, as the article suggests, you should be a good little representative and be chosen because you know something about where you're going. Hopefully you know a lot, or at least enough to be able to order food from a menu.
It's kind of sad that no people won't even have to make the smallest step into being somewhere new of calling places by their real names. If you lovingly name your kid George, would you be upset if the Mexicans only refered to him with the pronunciation "hor-hey"?
Google has a cache of the PopSci article.
...can you get through the airport with it? Carry any more technology and those security guards will tear you apart.
Stop the Slashdot Effect! Don't read the articles!
For all those who need one:
l: slashdotter1
p: slashdotter1
Enjoy
Well, this is about as useful as my flying toaster!
Seriously though, i wonder about what happens when the sign gets babelfished and you end up eating dog testicles instead of the "beefy camel tips" you thought you ordered.
-=The Dude=-
OK, maybe translating train schedules and restaurant menus is good. But street signs, especially, are supposed to be unambiguous, their meaning readily apparent to anyone, whether literate in their native language or not.
And does this thing work on signs that some redneck has shot holes in with a 12-gauge?
In the 1950s and 60s, TV commoditized and homogenized American speech patterns and culture. This will commoditize understanding between cultures, but nobody has to give up their native language. Ideas and commerce will flow more easily. It'll be a good thing.
WWJD for a Klondike Bar?
On a somewhat related topic I have been thinking about recently:
Java (J2ME) is now in cell phones, I have one and have played around a bit. Biggest problem with real applications is lack of a good input device. Now, for speed dialing, my phone has "voice recognition", which is really a pattern match against a saved database of me saying each person's name. It is an i85 Nextel Phone.
Why not have a voice recognition processor? Now, the phone does not have enough horsies to crunch the stuff needed to do that...but: The phone has direct-connect. Why not a feature like direct connect, but instead of 2-way radioing another person, a voice processor system, which returns the processed speech as text into whatever is running on the phone? Take the time used out of alloted minutes...it's not like they have to connect anything in your call to the phone system to establish a call for you.
Data connection is only about 300 baud or so, but how much faster can you really talk (so that a computer can uderstand you) than 300 baud worth of text? Same thing for reading. I can't read my email while driving (at least not safely), but why not have a "my phone" (really a computer talking to my phone) read it to me? That solves the small screen display problem too.
Ok, enough crazy thinking for now, I could go on and on about this stuff.
-Pete
Soccer Goal Plans
So if somebody flips you the bird, take a picture and find out what he was really saying!
...oOOo..'(_)'..oOOo...
>> why they just don't learn to speak English...
Because English is very confusing, very complicated. If it was (were?) more logical... 20+ years of English and I learn something "different" now and then.
I grokked my native language when I was 11, I believe. Not to mention Esperanto, which is waaaaay easier and more logical.
But don't take this as offensive... because this means English-speaking people are in some ways very intelligent to deal with it.
What do you do if you're trying to read signs that would lead you to a cybercafe?
But why not just have a bluetooth type chip embeded into all signs and landmarks? Walk up to it with some type of reciever/pda/device and wha-la. Even embed a gps etc.
thirsty*i^2
"Ya I finished that last week, it just doesn't work"
This all relies too much on sight. These things, no matter how efficiently designed, do get in the way of your sight, even if transparent. Why use sight at all? Personally, I would prefer a system with a larger learning curve but effectively bringing a new sense into play. Electrodes applied to the body would send raw singles, which we would learn to interpret. This could have many possibilies. "Oh, would you look at that dream-woman, my alarm is going off. Hold on, let me set it back an hour." All while sleeping. Well, maybe not, but I think its cool. Just an idea.
Question
http://www.ironfroggy.com/
I'm suprised that nearly nobody has carried the story of the brown reaserchers who put a microchip into a monkey's brain which allowed them to control a computer mouse by thinking
0 01-02/01-098.html
They first played a game with a joystick, then played the same game controlling it with their mind, and they got about the same score both ways
Very interesting story.....has anybody seen anything on this? It's on brown's website at http://www.brown.edu/Administration/News_Bureau/2
I think calling "microbes" "earbuds" is a bit out of proportion (literally) - or did i miss an episode? :-)
Now this is what im talking about. I want this! Do you think there are any legal issues against doing this to myself? And does this work both ways? ie, could the joystick in their head have "force feedback", therefor applying a new sense?
Question
http://www.ironfroggy.com/
I'm on a business trip in Paris. My wife flys in to be with me. Fourteen hours later I show up at the airport.
Wife: "Where the hell have you been!!!"
Me: "server was slow..."
The race isn't always to the swift... but that's the way to bet!
... Just stay out of Canadian Airports, eh?
I have no problem with your religion until you decide it's reason to deprive others of the truth.
Does it do American to standard English road sign translation? You know... something for the tourists:
<STOP>: "Prepare for car-jacking"
<DRIVE-THRU>: "Drive By"
<WELCOME TO LOS ANGELES>: "Welcome to HELL!"
:)
no one cares about. Uh, what's wrong with your brain and using a Berlitz guide??
Oh yeah.. thaaaat's great! 15 seconds. I can see it know... "waiting.. waiting.. waiting.. oh, it said, 'BRIDGE OUT'... DOOOOOOooooohhhhh" [splash]
New York Times new slogan: "All the news fit for nerds"
Slasdot's: "News from New York. Stale links that mattered 6 hours ago."
<a href="http://www.joblessjimmy.com">Work is dumb and so is Jobless Jimmy.</a>
These augmented street signs would be incredibly cool if they showed up as small popup boxes on your field of vision as you're looking for streets. Better yet, augment with mapquest, and have a line to follow to get to your destination. Adjusting for traffic and the ilk. That would be cool.
n/t
I'm a firm believer in the philosophy of a ruling class. Especially since I rule. -Randal, Clerks
- books written in english
- product labels written in english
- movie subtitles written in english
- magazine articles written in english
then, after my 12 years of state funded black-ops training, i decided to continue my education in a private 4 year institution where they even taught me how to WRITE in english, a topic which wasn't quite covered well by the state-funded institution. perhaps if the government would make this type of training available to all members of our society, we wouldn't need computers to understand these cryptic road signs that nobody seems to be able to decode.-c
"I hope I don't make a mistake and manage to remain a virgin." - Britney Spears
While driving along some roads...
Take a picture of that sign and see what it says.
-15 seconds later-
"STOP"
Outdoor digital photography, mostly in New Engl
Mod this up, it's the funniest damn thing I've read since Christmas.
Why not allow the OCR program, and any necessary foreign language translation dictionaries to live in the PDA's memory? I can't see it taking up anymore than several MB, (which could certaintly be offloaded when not traveling).
Is there something I really don't understand here?
....I'm an English speaker, living in Korea.
One button push for automatic translation. Voice operated and 100% accurate voice recognition.
I have this device that you can speak Korean into, and then have it come back as English. It's called a cell phone.... all you need is a friend that speaks both languages on the other end.
Of course, this assumes you are too lazy to learn another language.
You guys can't get over your own lack of imagination....shame.
It could happen.
-Miko
Miko O'Sullivan
I have this device that you can speak Korean into, and then have it come back as English. It's called a cell phone.... all you need is a friend that speaks both languages on the other end. Mine happens to be 24, and she sports a TOEIC of 982.
Voice operated and 100% accurate voice recognition.
Of course, this assumes you are too lazy to learn another language.
You guys can't get over your own lack of imagination....shame.
Not bloody useful when I'm walking down Broadway, is it then? (rimshot)
Wrists killing you? Not in 2 weeks. Learn Dvorak.
It took 2 weeks and used all open source tools:
- Perl
- Apache
- Linux
- Fetchmail
- Imager.pm
- Mime::Parser
- JOCR (was Gnu OCR but renamed for SourceForge)
- other stuff
Of course, that was for proof-of-concept: I then redid the application using SOAP::Lite for receiving an XML payload with the same data.It was a load of fun and proved to me that CPAN, SourceForge, Freshmeat, and Google are the only tools I need to get stuff done on a grand scale
Regarding JOCR - it's not OmniPage by a long shot, but for specific OCR needs is worth looking at.
-- @rjamestaylor on Ello
bummer
page widening no longer is supported by my browser
Cliff's been doing it for years. This is good stuff, my friends... and you get to fulfill your Linux and individuality dreams. What could be cooler?
HAHAHA! your shit gets wrapped in mozilla 0.9.9. My page is no wider than usual. so you suck.
Try to wear it through airport security! (The last thing your LCD goggles/speakers report is "Pleeze come this w4y to thiz small priv4t3 roam so that we might radish you." Uhoh.)
One line blog. I hear that they're called Twitters now.
Think about how pissed off the people behind you in the toll lane will be, as you do a 15 second translation on the automatic toll machine instructions.
I know this is a little bit off topic, but while the technology is cool, you'd get some really kooky translations if you went around some foreign country translating the signs. I used to live in Japan, and after I learned a little of the language, I started thinking that the Japanese have very odd naming schemes. My house was loaced between the train stops "Cherry Blossom Palace" and "Happy Island" and I lived on the street "Middle of the rice field" right across from the megamart "Big Circle". Needless to say, there were neither palaces nor islands anywhere in sight, and the closest thing to a "field" was the parking lot, and I never saw any rice there... I did see some circles, but none of them were particularly large :) Still, I'll bet it would be great for reading menues in korean resturants and finding out just which part of the cow that last slice of beef came from... or I HOPE it was a cow!
"Your superior intellect is no match for our puny weapons!"
"Dear, what does that sign over there say?"
[15 seconds later]
"It says: 'Road ends: Bridge constru...'"
Computer Science is no more about computers than astronomy is about telescopes. --E. W. Dijkstra
"Hey, what does that one say?"
"Hold on, I'll check."
(a few seconds pass)
SCReeeeeeeeeeechh!!!!
"Um, this says it was a stop sign."
"Thanks."
Donate background CPU time to fight cancer.
It's not April 1 is it??????
I am not impressed at all by this. Recognizing street signs is a simple image processing task. The most difficult task is to locate the sign in the picture. Once you're there, you are basically done. And why would I need an uplink for this? There is plenty of conputing power in a PocketPC. I've seen this done on an ARM7 @ 72Mhz.
And I am cowardly lazy.
the chicken and the egg situation is not really a situation.
the egg came first. why? because anything that is not born out of an egg can not be a chicken, by my definition of a chicken.
so there is no way for the chicken to come first.
"when life gets complicated, I like to take a nap in a tree and wait for dinner" - Hobbes.
...with a picture of a beautiful, but clothed, member-of-the-appropriate-sex.
Liberty uber alles.
The first chicken egg had to have been laid by an almost-chicken. The whole chicken/egg cliche seems to completely ignore evolution, and until eggs can be created out of thin air, a chicken always has to come first.
Just tack on a voice synthesizer and it could become a useful tool for the blind. They would be able to hear the words written around them.
OHHHH, "Stop"...
Just about every meaningful sign in Tokyo station is already translated into English. In fact, there are few train stations within a 50-mile radius of Tokyo that don't have English language signs, at least for the essential stuff (this way to Harajuku, etc.). It's only when you start getting out in the country that reading signs becomes a problem for English-speaking foreigners. E.g. most stations on the Meitetsu line outside of Nagoya completely lack English-language signs. As a tip for foreign travellers in that situation I offer the following advice: follow the crowd. You are pretty much guaranteed by natural law to end up in the city center.
i got a device that fills your requirements. it tells me what street i'm on, what street i'm approaching and even what time it is! and it doesnt even need to be able to see the street signs. of course, it needs to be able to see at least 3 of its friends to know exactly where i am, but that isnt too hard when you're outside.
i of course am talking about my GPS.
This stuff is only useful if you're gonna go outside. That's a huge step. Being the type of hermit-nerd who never goes outside unless there's a fire or a bomb threat, I must say that this little gadget lacks in appeal. Street signs? Posh. That's so, like... 1990's.
And if you use it indoors?
"Gadget-thingie, what is this?"
A little window comes up on your goggles that says "this is your computer." If its really sophisticated, it might show a timer underneath that displays how many decades you've wasted in front of your screen, but that gets old after about two minutes. Maybe it'll give you directions on the most efficient route back to your computer from say, the bathroom or the fridge, which might actually be useful if you've moved your computer recently (not you, the computer).
Maybe if they added some sort of program debugging overlay support...ooo...now *that* would be cool. You could have little windows pop up on your screen while you're hacking through some stuff in your favorite text editor
"Hey, lines 285-289 are seriously hosed."
"I can't believe you just wrote this garbage, what's wrong with you?"
"You know you really shouldn't be on crack when you're programming. Didn't your mom tell you that last week?"
"I'm getting tired of looking at your face."
The list of possibilities is endless....
It seems like a more useful tool, would be a standard translator, where you could type in the words, and get the equivalent in your target language. Verb conjugation would also be very important. Franklin / Larousse makes some decent translators, but they are a little too large, and don't hold up very well. Does anyone know if there is a port or similar product for handheld devices?
-- -- Warning. Do not stare directly at the sun.
We already have augmented reality devices, it is called "beer". It makes every woman look good and every guy your best friend/enemy.
It is by the juice of the coffee bean that thoughts acquire speed, the teeth acquire stains. The stains become a warning
That sounds a lot like "The World's Most Expensive Card Trick" which Penn and Teller did in late 80's early 90's with two SGI or MicroVaxes and a times square Jumbotron.
Penn had someone pick a card and hold it up. No one could see it. Then Penn fanned the entire deck in front of the camera--SANS THE MISSING CARD. Teller frame grabbed the image and scanned it with one of the computers, identifying which card was missing by process of elimination (or missingness).
Teller then used the second computer to CGI a card and display it on the JumboTron.
Absolutely Brilliant!!!!!
a chicken comes first only if you define an almost-chicken as a chicken, which I do not.
"when life gets complicated, I like to take a nap in a tree and wait for dinner" - Hobbes.
It really does a lot more for international understanding if you actually try to speak to people when you go abroad. You might learn something and make some friends.
MUahahahaha, LOL, that is funny as hell, what retarded fucker modded that down, it's a valid comment, it's true and funny as hell too...