Slashdot Mirror
IQ Test Pegs ConceptNet 4 AI About As Smart As a 4-Year-Old
An anonymous reader writes "Artificial and natural knowledge researchers at the University of Illinois at Chicago have IQ-tested one of the best available artificial intelligence systems to see how intelligent it really is. Turns out–it's about as smart as the average 4-year-old. The team put ConceptNet 4, an artificial intelligence system developed at M.I.T., through the verbal portions of the Wechsler Preschool and Primary Scale of Intelligence Test, a standard IQ assessment for young children. They found ConceptNet 4 has the average IQ of a young child. But unlike most children, the machine's scores were very uneven across different portions of the test." If you'd like to play with the AI system described here, take note of the ConceptNet API documentation, and this Ubuntu-centric installation guide.
From the article: “If a child had scores that varied this much, it might be a symptom that something was wrong,” said Robert Sloan, professor and head of computer science at UIC, and lead author on the study.
Some people die at 25 and aren't buried until 75. -Benjamin Franklin
No!
Does the AI use contractions?
sudo make me a sandwich
We are nowhere near getting an AI that can navigate the world at the level of a 4 year old. All the program can do is simple tasks in vocabulary and such with no real understanding of those words. Nothing to see here.
They didn't assess how intelligent this AI is. They assessed the IQ test and found it to be a poor indication of intelligence.
Let me get started:
* IQ tests don't measure intelligence
* IQ tests only measure a certain *type* of intelligence.
* Your jealous because I have an IQ of -2147483648.
* I'm too smart for IQ tests.
* You're book smart but I'm street/code smart
* random troll at -1
Have I missed anything?
SJW n. One who posts facts.
How to this compare to the IQ of the average dupe-posting editor?
In that case when will it be old enough to by liquor?
And when will it be smart enough to fire up Sky Net?
Wouldn't the average IQ of a 4 year old child be 100?
The ED-209 unit from the Robocop movie was measured as a 5 year old.
The link seems to point to ConceptNet 5 now.
If they re-run their IQ test, I think they will gleefully find it is now as smart as a 5yr old.
Join the Slashcott! Feb 10 thru Feb 17!
While I am excited about advancements in AI it makes one wonder what is the use of such scores beyond some marketing?
IQ is debunked. It's not a true measure of intelligence. If anything it can measure of much a person is willing to invest (time/effort) in scoring well on said test.
Compared to other children the scores vary wildly unlike any normal child.
While it's still an achievement to have a sophisticated program worthy of an "AI" label we are, unfortunately nowhere near true AI.
A 'singular oddity' is an event that cannot be explained and only happens when you are alone.
That's not a bug, that's the beta version of GPP.
Get free satoshi (Bitcoin) and Dogecoins
These tests don't tell us much about the power of an AI and here is why. If you give a human test with a million questions, then giving one more question is not going to tell you much more. You could probably remove some of the questions too without removing much information about how smart the person is. It turns out some of the questions are much more valuable when it comes to figuring how smart someone is. If you put enough statistics work into that, you'll be able to condense those million questions into a quite short list of questions that can be administered in an hour or so, to a human, yet still tell you almost as much information as the million question test did. That's what an IQ test is.
The problem is, if you give that test to an AI, then the IQ number you get at the end won't tell you how well the AI would have done at a million/billion/trillion question test. You do get that information for a human because the test has been carefully constructed to be like that. For an AI, all you learn is how well the AI does at the questions in the test, which is much less interesting than the information you get from a human taking an IQ test.
Unfortunately the AI also lied that it had completed its arithmetic assignment so that it could go out to recess early. It is also suspected of taking an extra snack at snack time, and caused a disturbance during nap time.
Humans are not programmed to be intelligent. Intelligence is just an aspect of how the brain (specifically the cortex) works.
Even very stupid children or other mammals can learn to do things like catch a ball, walk, remember someone's face or voice or that they had spaghetti for dinner. AI is concentrating on trying to duplicate the wrong types of behavior, starting from the wrong end. It doesn't tell us anything useful about humans or intelligence.
Until we start teaching out AI "consequence" and pain. Our entire existence is based on mitigating the effects of problems. As it stands, engineers have been focusing on data collection. Then they move on to the "why". But they have never tried to instill "fear" in their new creations. People make their best efforts in response to "fear" and until our machines understand that getting something wrong can be detrimental to them (which in turn means they have to understand the ultimate fear on non-existence) they will never achieve the level of intelligence we have.
It just shows how worthless an IQ test is for testing intelligence. There isn't even anybody home in this software.
"ConceptNet 4 did dramatically worse than average on comprehension—the ‘why’ questions.” - Robert Sloan, lead author of the study.
This comment strengthens my feeling that current AI is making progress in faking many of the accidental attributes of intelligence, but has not discovered the essence.
The development of childrens' mental abilities seems to accelerate over time, as if there is positive feedback, but this does not seem to have emerged in AI yet, especially if we factor out Moore's law. On the contrary, any given exercise in developing AI through machine learning seems to hit a wall of diminishing returns at some point. Is anyone aware of a project that has not experienced this effect?
LOL.
Because we all know 'the races are all the same', or 'race is just a social construct', right?
What are the Jews going to do when an artificial intelligence system becomes as intelligent as a human, yet ISN'T a human (obviously), and therefore will tell the truth about race, and the ongoing invasion of every white country on earth, by millions of third world parasites?
Will they pull the plug if people ask it 'awkward' questions, like "Don't white people have the right to have their own countries any more?"
Anyone knows where to access technical information about the actual study, or how did they conducted the IQ test? ConceptNet is just a database + a library with some NLP parsing tools and database (the concept hypergraph) accessors, but I wonder how did they actually conducted the test as that doesn't seem to be a trivial extension of the available tools...
It's not the fall that kills you. It's the sudden stop at the end. -Douglas Adams