Slashdot Mirror
Romancing The Rosetta Stone
Roland Piquepaille writes "Not only this news release from the University of Southern California has a fantastic title, it also has a great content. This story is about one of their scientists, Franz Josef Och, whose software ranks very high among translation systems. "Give me enough parallel data, and you can have a translation system for any two languages in a matter of hours," said Dr. Och, paraphrasing Archimedes. His approach relies on two concepts, gathering huge amounts of data, and applying statistical models to this data. It completely ignores grammar rules and dictionaries. "Och's method uses matched bilingual texts, the computer-encoded equivalents of the famous Rosetta Stone inscriptions. Or, rather, gigabytes and gigabytes of Rosetta Stones." Read my summary for more details."
Romancing the Rosetta Stone
'Give me enough parallel data, and you can have a translation system in hours'
University of Southern California computer scientist Franz Josef Och echoed one of the most famous boasts in the history of engineering after his software scored highest among 23 Arabic- and Chinese-to-English translatio systems, commercial and experimental, tested in in recently concluded Department of Commerce trials.
"Give me a place to stand on, and I will move the world," said the great Greek scientist Archimedes, after providing a mathematical explanation for the lever.
"Give me enough parallel data, and you can have a translation system for any two languages in a matter of hours," said Dr. Och, a computer scientist in the USC School of Engineering's Information Sciences Institute.
Och spoke after the 2003 Benchmark Tests for machine translation carried out in May and June of this year by the U.S. Commerce Department's National Institute of Standards and Technology.
Och's translations proved best in the 2003 head-to-head tests against 7 Arabic systems (5 research and 2 commercial-off-the-shelf products) and 14 Chinese systems (9 research and 5 off-the-shelf). In the previous, 2002 evaluations they had proved similarly superior.
The researcher discussed his methods at a NIST post-mortem workshop on the benchmarking held July 22-23 at Johns Hopkins University in Baltimore, Maryland.
Och is a standout exponent of a newer method of using computers to translate one language into another that has become more successful in recent years as the ability of computers to handle large bodies of information has grown, and the volume of text and matched translations in digital form has exploded, on (for example) multilingual newspaper or government web sites.
Och's method uses matched bilingual texts, the computer-encoded equivalents of the famous Rosetta Stone inscriptions. Or, rather, gigabytes and gigabytes of Rosetta Stones.
"Our approach uses statistical models to find the most likely translation for a given input," Och explained
"It is quite different from the older, symbolic approaches to machine translation used in most existing commercial systems, which try to encode the grammar and the lexicon of a foreign language in a computer program that analyzes the grammatical structure of the foreign text, and then produces English based on hard rules," he continued.
"Instead of telling the computer how to translate, we let it figure it out by itself. First, we feed the system it with a parallel corpus, that is, a collection of texts in the foreign language and their translations into English.
"The computer uses this information to tune the parameters of a statistical model of the translation process. During the translation of new text, the system tries to find the English sentence that is the most likely translation of the foreign input sentence, based on these statistical models."
This method ignores, or rather rolls over, explicit grammatical rules and even traditional dictionary lists of vocabulary in favor of letting the computer itself find matchup patterns between a given Chinese or Arabic (or any other language) texts and English translations.
Such abilities have grown, as computers have improved, by enabling them to move from using individual words as the basic unit to using groups of words -- phrases.
Different human translators' versions of the same text will often vary considerably. Another key improvement has been the use of multiple English human translations to allow the computer to more freely and widely check its rendering by a scoring system.
This not coincidentally allows researchers to quantitatively measure improvement in translation on a sensitive and useful scale.
The original work along these lines dates back to the late 1980s and early 1990s and was done by Peter F. Brown and his colleagues at IBM's Watson Research Center.
Much of the improvement and
when it's in the form of a fish, and can fit in my ear...
"I turn away with fright and horror from the lamentable evil of functions which do not have derivatives."
This is exactly NOT a universal translator as it uses matched bilingual texts. You need an already translated text for his system to work.
You know, it's not really a summary when you just delete half the article.
That reference to DARPA has me a little worried about the sort of uses this technology will be put to. I wonder, are the CIA trying to shore up holes in their translation abilities (particularly for Arabic/etc) by using software. What happens when you pair this technology up with the Echelon project? Are we going to see a dramatic rise in the ability of the government to spy on nationals and particularly foreign nationals now?
All those moments will be lost in time, like tears in rain.
The uber-geeks are going to have a field day with Klingon...
"Give me enough" is a key element of the Law of Eventuality. Give me enough money, and I'll solve the Microsoft monopoly threat with a hostile takeover. Give me enough time and I'll clean up almost any unnatural disaster site by leveraging nature's own methods.
Give me enough simulated neurons and enough truisms and I'll make a sentient machine.
Eventually, with enough resources, anything is possible. Throwing more time and resources to a problem is rarely exciting science. Reducing the inconveniently large values of 'eventually' and 'enough' are the real problem.
[
'Almost everyone'? What *are* you talking about? You must be an American. From a recent online Harris poll, most Americans think at least half the world speaks English. This is just plain wrong. The truth of the matter is that it's more like 20%. That's it. Most people on the NET might speak English, but most people in the world? Hardly.
My journal has hot
English may be the closest thing we have to a universally-spoken language, but it certainly isn't going to become the -only- language any time soon, if ever. If all other languages disappeared, though, we would definitely need translation for all the literature we have that isn't written in English.
Here is Japanese Slashdot, and I'm sure there are others.
That's an example from a few years' back of an attempt to translate "the spirit is willing but the flesh is weak" from English to Russian and back to English using a different translator.
Can anyone try this on the new (or some other recent) algorithm?
BTW here's Doc Och's most recent website:
Franz Josef Och
Esteem isn't a zero sum game
I believe that using a statistical approach like this is a step in the right direction. Manually building sets of rules, dictionaries, etc., is a waste of time and hard to do. And manuall-built systems become stale as languages evolve, unless a lot of continuing work is done.
For me the holy grail is when I can converse with a computer meaningfully. I believe a similar approach will be required for the computer to "understand" language, and to be able to formulate a coherent and appropriate response.
If email, IRC/"chat rooms" *spit* and SMS are anything to go by, a great number of young and not-so-young people who *do* have English as a first language are barely capable of forming even simple sentences in it correctly.
Regards,
Tim. (Grumpy old man day)
DARPA actually proposed that a forced conversion to English policy would be more cost effective for the defense department to implement through military invasion than some complicated translation scheme. Hence congress's support for the translation project.
From the article: his software scored highest among 23 Arabic- and Chinese-to-English translatio systems
Oops - guess we need some more parallel data (or a few more gigs of rosetta stones).
A man who speaks three languages is trilingual.
A man who speaks two languages is bilingual.
A man who speaks one language is American.
DG
Want to learn about race cars? Read my Book
English --> French --> English --> Korean --> English. Of course, it helps that the first sentence is munged anyway ;-)
When I am king, you will be first against the wall.
Sounds like a brilliant idea. Hopefully this is something that could eventually be compacted enough to fit into consumer electronics. It would be great to be able to watch TV from every country without any language barrier!
DeviantArt Page
NSFWFirstly we could consider the enormous body of work currently available in other languages.
Having this able to be translated into English or other languages could be very valuable for scholars.
Secondly, English is not the primary tongue for the majority of people on the planet - to suggest that because a lot of people can manage to converse in it that the ability to translate between other languages isn't valuable is foolish.
Also note that the article specifically mentions Arabic and Chinese, which I don't think crossed your mind. China has the largest population on the planet, remember.
Translation is far from obsolete, especially given that the majority of the Western world, and especially America, is piss poor at being bilingual.
How can this system compensate for the different dialects of all of the different languages?
"Some fight for law. Some fight for justice. What will you fight for? One day, you will see."
> Americans think at least half the world speaks English.
Better-informed Americans (a small miniority of the class) would be aware that Spanish is well on the way to becoming the predominant language in the USA.
But, IMHO, English could become the next Latin: the dead language that everybody has to learn if they're going to try and influence the world.
BTW, every "% of humanity" statistic has to consider that most humans are Chinese.
What is the novelty of this?
It's hardly news that you can always find correlations in two sufficiently large sets of data.
Reminds me of the Steve Martin joke:
"Chicks go for the intellectual types. I figured the best way to impress 'em was to read a lot of books. But hey, do you know how many books there are? Why, there must be, hundreds of them. But I was already a pretty smart guy. I didn't waste my time reading all those books. Heck no.
I read, the dictionary. Hey--I figure it's got all the other books in it."
http://www.britishcouncil.org/english/engfaqs.htm# howmany
Translators are needed for 3/4ths of the world. Not what I would call close to obsolete.
The surprise isn't how often we make bad choices; the surprise is how seldom they defeat us.
"One of the great advantages of the statistical approach," Och explained, "is that most of the work goes into components that are language-independent. As long as you give me enough parallel data to train the system on, you can have a new system in a matter of days, if not hours."
This statistical method is probably the best approach to computerized translation. It seems to approximate how the human mind will translate a give sentence most efficiently. Language can get awfully complex, and individual words often have, at best, an ambiguous meaning when interpreted alone. One must take into account the context of that word to specify and refine its meaning. This obviously leads to a huge number of permutations to represent a huge variety of thoughts, but the relative size of this number is diminishing as computers become more powerful.
Therefore, instead of playing with messy grammars and sentence structures, we can simply have a catalogue of thoughts as represented by words, and correlate that catalogue with a different set of words to facilitate translation. This software would operate on a deeper level than it would if it operated with the words and symbols themselves. It would utilize a map of the deep structures of language, instead of a map of the less-meaningful words and grammars.
I really like this method, and while it may seem like a brute-force hack applied to translation, the simple fact that languages do not contain elegant patterns must be accepted. It also appears to be a most efficient method, as the simple comparisons involved would bring the speed of translation into realtime.
University of Southern California computer scientist Franz Josef Och echoed one of the most famous boasts in the history of engineering after his software scored highest among 23 Arabic- and Chinese-to-English translatio systems, commercial and experimental, tested in in recently concluded Department of Commerce trials.
Maybe what Dr. Och should do next is write some software to double-check the work of whoever translates his press releases from the original Latin. The translator seems to have missed a few words here and there.
I'm not sure this is really applicable to translating literary works. These kinds of translations require an understanding of the native culture of both the source and target languages, as well as the intent of the writer, in order to generate an understandable translation that the target group can appreciate. A computer translation system like this one is incapable of performing these sorts of analysis.
What this is really good for is on-the-fly translation of material where the reader simply wants to comprehend what was written (think the old babelfish engine). This has obvious applications on the web, as well as many other areas (on-the-fly server-side translation for IM systems, etc, etc).
You know, that actually does sound like something that would be a Russian aphorism...
The use of three languages is critical. Grammar isn't consistant, and words have multiple meanings. By using two known languages, you can eliminate many of the errors thus introduced, because the chances of some error fitting both known languages in the same way is much smaller.
If you double the number of known languages, you more than quarter the number of errors, because although errors can occur in either or both, they're unlikely to be the same error. Once more information exists, you can re-scan the same text and fill in the blanks.
Me, personally - I'd require four languages, three of which were known. The number of texts required would be considerably smaller and the number of residual errors would be practically non-existant.
They chose two languages for the obvious reason: It's simple. It's easy to find a student who knows two languages. At least, easier than finding one who knows four.
However, the price of simplicity is bad science. The volume of information they require makes their system little better than an infinite number of very smart monkeys with text editors and a grep function. That they're being paid signficant money on such stuff is a joke.
If they offered me the same money (and one of those Linux NetworX clusters) I could have a superior system in a month, although (as stated above) it would require more than one known language.
It's a small world and it smells funny; I'd buy another if it wasn't for the money; Take back what I paid (SoM)
***WHAT THE FUCK ARE YOU THINKING?***
:)
Look, seriously, even if everyone did speak English, there are still tonnes of literary works in other languages - the original texts of the Ancient Greek classics, for example. To read in the original language is often a much more rewarding experience. Besiders, relying on past translations of non-english material can lead to errors. And consider how many different English translations of the Bible there are.
Almost everyone can speak, read and write at least tolerable english
Almost everyone can communicate using gestures, facial expressions and grunts, but is that any reason to use that as our primary communication method? I mean, to really stretch a metaphor from human languages to programming languages, we can write any computer program "tolerably" in assembler (it's Turing-complete), but that doesn't mean it's the best way to do it. If I can only speak one language "tolerably", but another exceptionally well, which one is better for conveying my ideas?
most young people can have full fledged discussions in it
I don't think we can rely on "d00d, u r so l33t" to teach people true literacy. Young people are increasingly using SMS and online chat and are actually losing their ability to correctly spell words or write grammatically correct sentences. The number of young adults I see who cannot distinguish correctly between there, their and they're is ABSOLUTELY TERRIBLE. Literacy is a major problem in English-speaking nations.
Just look at Slashdot, I'm quite sure I'm not the only one who doesn't have english as primary language
that doesn't mean you can use it well. Take a good look at slashdot - many, many people mangle the English language. The American people are probably the biggest infringers here...
It's not that farfetched idea that in the (near) future everyone uses or at least knows english well enough to make translations meaningless
Human languages don't map to each other 1:1. Some languages have words that basically cannot be translated without a serious loss of accuracy. (I guess you could ssay that no human language is Turing-Complete, in that it can't totally express every conceivable human thought). Having everything translated to english is NOT a solution. Brevity, language tricks (such as puns, rhyming, etc) cannot always be substituted across languages.
If it wasn't 2:15am in Melbourne right now, I'd try to order my thoughts and express them more clearly, but after 4 hours of Java debugging I'm off to get some sleep before uni tomorrow. Goodnight.
The PowerPC includes for this purpose two instructions called SYNC and EIEIO.
This is a bit of a worry for privacy concerns, given that if I want to keep something secret from the world and private just between me and my intended recipient I have one less option.
If you are using foreign languages or even lexically analyzable scemes to do your encription, you deserve what you get
Life isn't like a box of chocolates. It's more like a jar of jalapenos. What you do today, might burn your ass tomorrow.
Even existing translation programs could benefit from a ranking system. Wouldn't it be helpful if you could tell just how confident the translator is about a certain phrase or word? That way, you could rephrase your sentence before you foolishly ask someone to "taste" you....
It's not quite done yet, but the system does show promise. Dictionaries have already been created in Spanish, English, German, Japanese, Italian, French and several other languages.
20 mil and I will! Learn Esperanto with 20M others.
I understand that this is a cool idea for building automatic translators, but is it practical? Basically what they are doing is taking a well-researched domain of languages and trying to make something new and cool in it by completely ignoring the domain knowledge. My intuition tells me that "always use as much domain knowledge as posssible" is an engineering axiom.
I passed the Turing test.
As press releases tend to do, this leaves much to be desired for folks who are familiar with the discipline. As I read it, it seems to imply that the main driver is phrase-matching. What does it do with phrases it hasn't seen before? The problem is solved by throwing lots of data at it -- how much data is needed for a reasonable system? How well does it generalize to text outside the domains of the training data?
Incidentally, had my brother been a girl, he was in serious danger of being named Rosetta Stone.
-- Trevor Stone, aka Flwyd
Ceci n'est pas une signature.
I don't think this translation program would be able to deal with his Texan affectations.
I always thought it would be interesting if google applied its page rank algorithm to provide a translation service. Like poll the top 5 translation service sites for a translated sentence and then based on what each of them return, generate a 'average' or best possible result for that sentence.
Spanish Slashdot: Barrapunto. It's been around for almost as long as Slashdot itself.
In Soviet Russia, Jesus asks: "What Would You Do?"
Actually, I think that this may be an interesting way to translate the Bible (assuming you didn't use the Bible itself as a reference...that would skew the translation).
Think about it: every translation of the Bible is always criticized for some reason. If the Bible were translated this way it could be like the Google news of Bible translations: completely independent of human bias and editing.
How about piping in various algorirhtms encoded in Pascal and C into the thing and seeing what it does to convert arbitrary sources. Where Can I get the soource? Pawel
So, can I train this program with a bunch of requirements documents, and a bunch of implementations, and have it learn how to code? :-) If so, I think I am obsolete. *poof*
BTW, every "% of humanity" statistic has to consider that most humans are Chinese.
If you want to be even remotely close to statistically significant you have to include citizens of India as well most of whom are very different from those of Chinese descent. . In fact most people will probably be an Indian citizen within the next 20 years. However citizens of India are a more heterogeneous population than that of China. Then again, Chinese of the diaspora (eg. in Malaysia, Indonesia, the Philipines, Vancouver etc.) are also a large population but can be very different than mainland Chinese. So I guess in the end every % of humanity statistic that measures some culturally derived phenomenon has to be considered BS.
I wonder how this would fare putting two computer languages side by side? I mean... take a few thousand programs, coded using the same algorithms but different computer languages... would his language translation software translate between them? Would it be able to differentiate between languages that manually allocate memory and those that use garbage collection? How about between procedural langauages like C, and more esoteric and oddly structured languages like LISP?
An interesting challenge, eh?
Would there be any benefit to this?
"I will trust Google to 'do no evil' until the founders no longer run it." Hello Alphabet.
You're right, traditional machine translation is difficult, primarily due to context. However, you're also right that the example you gave is a bad one - in english it only has one meaning (the second one you give). A HDD controller would never have an assigned gender. Of course in German for example, it would (not sure which though - neuter?).
However you're missing what I think is the most important point. If an example is so ambiguous as to confuse an "ideal" machine, it would confuse us too. What you're really saying is "it is possible to write sentences with ambiguous meaning in most languages" - which is of course true. That doesn't however make it impossible to create a machine which is at least as good as a human at translating (and wouldn't that be good enough?). When you read something you interpret it according to a set of learned rules. Obviously there's the basic syntax and vocab, but then you add context like the other clauses in the prose, the identity of the author, the subject matter. We're a long way off getting those concepts into a machine reader, but I would be very hesitant to say we'll never get there.
Besides, the artical is about taking a different approach to the problem - one which should be quite happy with ambiguity. They're looking at essentially pattern matching, so provided your sample data sets include enough info to describe the ambiguity it should have a decent enough chance of working it out.
---- Den ene knappen er powerknapp, den andre er Bender voice knapp "Bite My Shiny Metal Ass"
...and I will make pseudo-insightful comments based on the headline text without reading any of the source articles, until my karma is excellent?
I think what was implied was that if you already had a translation engine trained for English/Japanese, when you are training it for English/French you can use the already existing "metadata" for English/Japanese to make the process quicker (requires smaller datasets to achieve the same precision).
I might be far out here. Excuse my crappy English, btw.
Are you a grammar Nazi? I'm trying to improve my English; please correct my errors!
Now that would be cool.
Seriously though, this leaves only the odd tribal languages of African (and perhaps South American?) tribes that are comprised entirely of clicks and gutteral sounds as not easily comprehended. Could this system's approach finally result in a Babelfish-like universality even for languages such as Chinese and Japanese? The added complexity makes it much more challenging for things like Babelfish, but if this system can do it, it's going to be a landfall discovery.
Anybody have any further research by this guy? I'm interested! Who knows, maybe I could have gotten a better grade in French thanks to this research...
The Rosetta stone itself did not do much in the way of our knowledge of the egyptian language.
What it did do, was provide insight into their method of writing.
It was the latter discovery of the the relation between Coptic and Egyptian that revealed most of the actual language.
(IIRC)
- Improved Statistical Alignment Models (2000) - Franz Josef Och, Hermann Ney, which investigates and compares several models
- A Syntax-based Statistical Translation Model - Yamada, Knight (2001), which tries to treat sentences structurally instead of just a stream of words
- A Finite-State Approach to Machine Translation - Bangalore, Riccardi (2001), which uses a different way of looking at the problem than usual
Kevin Knight prepared an excellent (if now somewhat outdated) introduction to statistical machine translation that you can see in HTML or RTF (the formatting was corrupted when the RTF was converted to HTML - I recommend the RTF).--
I romp with joy in the bookish dark
Time for inflamatory reasoning. The statistical approach will beat out the grammar and rule based ones, at least for English, is for the simple reason:
English is not a language
Or rather, it resembles one but is more not than is, IMO. It is a large collection of idiomatic expressions that changes quite rapidly (and not only in colloquial forms, just look at what the political-correctness movement has done to phraseology). You know the story... more exceptions than rules, things that are legitimate to say language-wise are considered incorrect anyways, and vice versa, etc. etc.
That's not to say it doesn't have advantages; it's relatively easy to learn the basics of communication since it's weakly conjugated, has genderless articles, fairly simple uncased sentence structure. But, it is monstrous to master and I suspect most native speakers aren't true masters (not to mention the orthographical nightmare; is English the only language with spelling bee contests?)
The reason it's the new lingua franca (or should it be lingua angla now?) is techno-socio-political as is always the case. Stop harping on Americans for being largely mono-lingual. "Why didn't the Romans learn the local languages when they controlled Europe? Because they didn't have to." If every state spoke a different language, which would be more akin to Europe, then there would be need.
I'm not, incidentally, saying just live with it. I'm saying, you can't stop the technology, you have to fight it on the level of policy and practice. Get interested in the work of privacy advocates, work for a consitutional amendment guaranteeing privacy in the same manner as freedom of expression, protest egregious violations of privacy (basically, be against John Ashcroft).
It Is the Nature of Information to Transgress Artificial Boundaries
... where the more available examples of actual spam and actual non-spam the better the accuracy of the result, and where you basically let the computer work out the probability, rather than feeding it hard and fast rules up front.
Can anyone say if the two procedures are technically related?
"You look nice..." --> "Shall I compare thee to a Summer's day..."
-- Sig down
They've had the same technology at CMU's LTI for years now, called EBMT. This officially stands for Example-Based Machine Translation, but those of us who worked with it called it Extremely Bad Machine Translation because it took millions of example sentences before it started to not suck, and even then it required manual tweaking and the addition of primitive grammar rules.
So yeah, this method learns fast, but it generally learns to a useless level for anything other than a rough assessment of some of the phrases that were in the original text.
-- Fratz, human
For starters, we specifically target young people when asking questions where a non-native language will be required. 3-4 of the people were employees, indicating at least a passing knowlege of "What track is this train on?" in a few European languages might be a job-relevant talent. Additionally, the sneer. Attitude is attitude regardless of what country you're in.
We don't expect people to know foreign languages. We *DO* find it amusing when people who are razzing *US* for not knowing THEIR language do not know any foreign languages.
paintball
Given the impressive progress made by Bayesian algorithms in spam detection, I wouldn't be surprised to see impressive results from this method either.
So bravo for Franz Och! He's taken what appeared to be an intractible problem requiring magic AI to solve, and perhaps found a way to solve it effectively using the stupid brute force methods computers are so good at.
I don't care if it's 90,000 hectares. That lake was not my doing.
1: Create a set of "Rosetta Stone" data by taking thousands of recorded phone calls to customer service/operators, etc.
2: For each call, track what the customer service rep/operator typed into their computer terminal.
The result would be natural language voice-recognition that would probably achieve a high degree of accuracy because it would be limited in scope (e.g. asking for a credit line increase, reporting a lost card, checking your balance, etc.) and be based on real queries from real customers.
Since the biggest majority of calls are for very simple problems (I forgot my password is the most common tech support call we get) this should be pretty useful.. you could probably automate "Level 1 Tech support"!
The facts have a liberal bias. --The Daily Show
Franz Josef Och homepage is at:
http://www.isi.edu/~och/
There are links to 3 software packages for download.
This has already been done some years ago in Canada, where the translation system was fed the complete text of parliamentary debates for umpteen years (required by law to be translated by humans into French, if originally in English, and vice versa). I don't know how it fares when presented with a sample of parliament-speak (I concede, this is not a fair approximation of human language), but it fails miserably on a simple rhyme. Read your Hofstadter, guys.
I can assure you, the best way to get rid of dragons is to have one of your own.
I just had to. Besides, I think it's proving a point, or something.
--
Romancing of the Rosetta stone
' you give me sufficient parallel data, and you can have translation a system in the hours '
University southern California of the computer scientist Franz Josef, which Och of most famous against-resounded, praises itself in the history of the technology, after its software counted the Arab strongly under 23 and Chinese English translatio systems, commercially and experimentally, examined inside in recently concluded Ministry of Trade of attempts.
"you indicate a place to me to the location, and I shift the world,", after to to order a mathematical explanation for the lever said the large Greek scientist Archimedes place.
"you give me sufficient parallel data, and you can have translation a system for all possible two languages in an affair of hours,", said Dr. Och, a computer scientist in the USC school of the institute for information science of the technology.
Och spoke after the benchmark tests 2003 for the machine translation, which was accomplished in the May and June of this yearly by the National Institute of Standards and Technology United States of the trade department.
Translations Ochs examined well into the 2003 head ton head tests against 7 Arab systems (5 research and 2 commercial away dregal products) and 14 Chinese systems (9 research and 5 from stock). In preceding 2002 evaluations had examined it similarly superior.
The researcher discussed his methods held at a NIST Postmortemseminar over the Benchmarking July 22-23 of John Hopkins at the university in Baltimore, Maryland.
Och is an outstanding exponent of a newer method of using the computers to touch in order to translate a language into other one, which became more successful in the last years, while the ability of the computers grew, large bodies of the information, and the volume of the text and the brought together translations in the digital form has, on (for example) multilingual newspaper or government net places of assembly explodes.
Method Ochs uses brought together bilingual texts, the computer-coded equivalents of the famous Rosetta descriptions of stone. Or rather gigabytes and gigabyte Rosetta of stones.
"our approximation uses statistic models, in order to find the most probable translation for a given entrance," Och avowedly
"it is rather different to the older, symbolic approximations for the machine translation, which in most existing the commercial systems is used, which try, to code the grammar and the encyclopedia of a foreign language in a computer program the grammatical structure of the strange text analyzed, and produced then English, which on hard guidelines," it is based, continued.
"employs, explaining from the computer, how one, we left it it out explains translated. First we draw the system it with a parallel korpus i.e. an accumulation of texts in the foreign language and their translations into English.
"the computer uses these information, in order to co-ordinate the parameters of a statistic model translation of the process. During the translation of the new text, the system tries to find English sentence which is the most probable translation strange entrance of the sentence, be based in these statistic models."
This method ignores or rolls over rather, finds express grammatical guidelines and even traditional dictionary lists of the vocabulary in favor of leaving the computer matchup samples between given Chinese or Arab (or any another language) texts and English translations.
Such abilities grew, while computers improved, by making possible for them, from using the individual words as the fundamental unit on using the groups of words to move -- cliches.
Versions of the different human translators of the same text change frequently considerably. Another key improvement was the use of repeated English human translations to permit the computer too its transmission by an ana
"Mind, as manifested by the capacity to make choices, is to some extent present in every electron." -Freeman Dyson
Interesting method.
It seems to me this is more similar to natural learning of a language (usually at a young age) by exposure and immersion, as opposed to scholar learning of a language in classrooms, etcetera.
It shouldn't be surprising that in humans, the first method also works best at acquiring fluency in multiple languages. As a matter of fact, it's the only method through which we come to understand our FIRST language, which is in almost every case the one we command the best.
I think most people get, by consuming huge amounts of information, a feeling of "what sounds right" and "what sounds wrong" that is more effective for them at predicting the unwritten rules and exceptions, both in translations and in original sentence-creation, than memorizing a set of grammar rules which, in the end, are just codifications of the current state of the language.
I don't think the success of the approach means the symbolic methods are pointless for this endeavor, any more than the formal study of languages and their grammars is for human translators.
Professional writers and translators do study such rules to dramatically improve their command of the different languages, and do get much better results.
But it seems to me they are more successful going from "statistical matching with massive real-use data" to "optimized grammar rules matching the data" than going backward, from "scholastic grammar rules" to "consumption of massive data to acquire exceptions, and correct and complement the rules".
What would be interesting, I think, is if one can study the state of the system after it's performing well and extract/deduct grammar rules, algorithmically.
It would be interesting to see the results of a program doing that, collecting (and correcting) the grammar using the data, and using the grammar rules when no match in the dictionaries is found to, say, apply a greater weight to the gramatically-correct choice among the alternatives.
If the results were good with this approach, one could consider decreasing the size of the database as the grammar gains stability. Use that memory for other processes, other languages, or new sample data that could not be examined before.
Freedom is the freedom to say 2+2=4, everything else follows...
This software would operate on a deeper level than it would if it operated with the words and symbols themselves. It would utilize a map of the deep structures of language, instead of a map of the less-meaningful words and grammars.
Actually, as a result, it operates on a shallower level. In fact, it's almost like you wrote this comment for an article in a parallel universe where statistical translation was the norm, and somebody was just now proposing symbolic translation, so much so that it's almost spooky.
This translation technique is so shallow it doesn't even particularly care what languages it works with. In a way, it can't really be said to be "translating" in the traditional sense; it's just correlating phrases with no clue what they are.
Traditional symbolic translation is better described by what you said:
Therefore, instead of playing with messy grammars and sentence structures, we can simply have a catalogue of thoughts as represented by words, and correlate that catalogue with a different set of words to facilitate translation.
Word(/phrase) -> symbol -> word(/phrase) is traditional tranlation. This is word -> word translation.
It's working better because we've had little or no success creating the middle part of the symbolic translation; matching the symbology used in our head has proven impossible to date. This works better by skipping that step, which introduces horrible distortions by forcing the words to fit into an incredibly poor symbology (compared to what we're actually using).
However, in theory, traditional translation should still have a brighter future; this is a hack around our ignorance, perhaps even a good one, but eventually we will want to extract the symbols.
(Incidentally, it's also why this same technique can't be used to match words -> symbols; we don't know how to represent the symbols yet! This kind of technique could eventually potentially be hybridized with something else to attack that problem, but simple, direct application can't result in the complicated relationships between symbols that exist, and we'd want a computer to "understand" those relations before we'd say it was truly translating or understanding English.)
Anyways, just flip your comments around 180 degrees and you're pretty close.
And where are you going to find gigabytes of parallel Klingon-English texts?
No seriously, this is the fallacy behind any statistical approach to automated translation.The news release gives the telling comment:
This paragraph just doesn't make any sense to me. Either it's badly explained, or the entire approach is flawed:
Statistical methods just cannot deal with the subtlety of meaning to be found in natural language texts. It's a little like believing that you can always win at chess if you can just look ahead far enough. I believe that this approach is inherently limited and any apparent success is illusory. This news release hasn't changed my opinion.
Sorry to be a party-pooper, but that's how I feel.