IBM's Question-Answering System "Watson" Revisited
religious freak writes "IBM has created and made the question answering algorithm, Watson, available online. Watson has competed in and won a majority of (mock) matches against humans in Jeopardy. Watson does not connect to the Internet to answer his questions, but rather seeks answers using many different algorithms then employs a ranking algorithm to choose the best answer." We mentioned Watson last year as well.
Part of the deal with Jeopardy! is that they will have as part of the 2010-2011 season be a televised episode in which record-breaking champ Ken Jennings will play against Watson, with a to-be-named-later champion in the third slot. This has been in the works since 2009, but the staff of the show finally thinks the system is ready for it's televised match.
One key factor is how the human behavior will change when prize money is at stake. Jennings has proven in numerous appearances on GSN that he's willing to play in any test of knowledge and the fact that he knew he was Jeopardy's first millionaire in regular season play didn't stop his long Jeopardy! run. He also studied for the show, particularly alcoholic beverages (which he doesn't drink) because he had seen the Potent Potables category on TV.
But, what about that player-to-be-named later? Will they know more than the grad students... and play the game not as if it's for points but real dollars?
and see students from the MIT Robotics Lab test their machine that they say can avoid the Bankrupts and find that Million Dollar wedge on the Wheel of Fortune!
Why can't I ask it my own questions?
If it can properly rate if these people are hot or not.
Attention... all grammer nazi"s! Is they're anything; wrong with: my post,
Watson has competed in and won a majority of (mock) matches against humans in Jeopardy.
Against mock humans? I killed it, easily.
Brett
What is the air speed velocity of an unladen swallow?
__ Someday, but not this morning, I'll finally learn to use the preview button.
Capital, not as in letter, of the state ending with Jersey which begins with New, is what?
The answer is 42.
I prefer the term "Artificial Stupidity" or "Artificial Stupidity in Software" (ASS), but I'm afraid much of Congress wouldn't even consider funding studies in this direction for fear that they'd finally have competition.
Joking aside, that's a pet peeve I don't fully understand partially because we've already lost the war on defining "hacker;" the mainstream press has managed to twist and desecrate the latter in spite of the campaigns on our side of the fence. There isn't much hope for AI "purists" in this particular case, specifically when you consider how generic the term "AI" has become. What better term is there, anyway? Would a "question and answer simulation system" be a better fit? Statistical fact-checking device? I think AI is suitable in this case.
Really, does it matter? Our brains may be massively parallel analog devices, but when you strip away culture, creativity, insight, and all the other things that separates us from other organisms, you're really just left with a machine that responds to input (stimuli) and generates output. I guess that begs the question: What is your definition of "intelligence," and what should intelligence of the artificial sort look like?
He who has no
What is an example of a tongue twister?
The Tao of math: The numbers you can count are not the real numbers.
Why is there nothing interesting anymore on /.?
Just news from yesterday...
Against a programmer, oh, and an algorithm, both with a PhD....
-Weird Al Parodied
Responsibility is an addiction
Virtue is a temptation
Community is a cartel
I wonder if a website where people subscribed to artificial friends, shrinks, lovers would be a viable business model if it was as good at mimicking these things in conversations. An Eliza frontend on this Jeopardy beast might work. Plus Eliza was always giving questions as answers too!! I'd rather talk to a computer program about certain things anyway......and this one *would* be connected to the internet and would hone into your tastes quickly.
Careful What You Wish For....
If you had even read the first 3 paras of the article, you would know that YES it can answer questions posed like that. The whole point of WATSON is that it has very advanced natural language processing, enough that it can even understand the puns and strange grammar of jeopardy questions.
use answer "iced!!!" or "pwned!!!" for a silly reply :P
I could make a program that could beat people in a mock jeapordy contest too if I controlled the categories....
A woodchuck would chuck as much wood as a woodchuck could chuck wood.
"The question of whether a computer can think is no more interesting than the question of whether a submarine can swim."
-Edsger W. Dijkstra
the answer is 42 :)
Never antropomorphize computers, they do not like that
Intelligence requires thought on the part of the thing which we are assigning it to.
The computer isn't 'deciding' anything any more than the rock you stubbed your toe on 'decided' to get in your way, or your car, decided to use less fuel when you took your foot off the gas.
Computers aren't any more intelligent than is a piece of paper can be 'happy' simply because a smiley face has been drawn on it.
If the sample questions I just tried are anything to go by, and they've been running this thing against a variety of international volunteers online (I've no idea if this is the case), then damn right it's going to win - practically every question needed some knowledge of modern US brands/media/folklore. That ignores the fact that you need to know a bit about the premise of jeopardy to play, but I can forgive that. I just kept seeing the correct answer and thinking 'oh right. who?'
Eat that, you big blue lump of metal!
(And it took me two questions what the hell how "before and after" worked)
Confucius say, "Find worm in apple - bad. Find half a worm - worse."
without seeing the architecture of the application.
Anybody can write an quiz game that beats you every time. What is (might be) impressive is how you are beaten. If I understand this, the impressive part is supposed to be that the system processes the questions as natural language, generates a number of matches, then chooses the one that it "thinks" matches the sense of the question most closely.
That's a pretty tall order, but still as a demo the app isn't impressive, because the app designer chooses the question or constructs the question in a certain way. This is the kind of demo I, as a programmer, would be delighted to be able to create as a proof of concept, but it's a far cry from being able to answer questions that originate outside the development team.
It's like the old security conundrum: any idiot can create security measures he himself is unable to break.
Post may contain irony: discontinue use if experiencing mood swings, nausea or elevated blood pressure.
Both Watson and Google relied on statistically analyzed word occurrences with a veneer of procedural/rule intelligence. Waston seeks the correct answer, while Google the most popular document containing the answer. Neither incorporate "deep" understanding like CYC's rule ontology. But it may not be that necessary if the statistics are large enough.
"Computers are useless. They can only give you answers." - Pablo Picasso
So, is true intelligence will come once they are able to ASK the questions?
...it's a "pre-recorded" session. I played the NYTimes game twice in a row. The first time, the computer beat me. The second time, given the exact same questions, I handily beat the computer. I learned from my mistakes and was able to apply that knowledge to a similar scenario improving the outcome on my end. It's definitely an interesting study.
http://www.bynarystudio.com
Where is the link, if this is available online?
Researches also asked Watson, "What is the meaning of life, the universe and everything?"
It replied 41.9999999999, so I think the technology still has a ways to go.