4

And if so, what was the highest score so far?

Some news articles suggest only parts of tests were aced.

Update since people censored this question and closed it. There was an AI that has taken an IQ test and scored similar to a 4 year old.

http://phys.org/news/2015-10-ai-machine-iq-score-young.html

The AI system which they used is ConceptNet, an open-source project run by the MIT Common Sense Computing Initiative. Results: It scored a WPPSI-III VIQ that is average for a four-year-old child, but below average for 5 to 7 year-olds

Abstract

We administered the Verbal IQ (VIQ) part of the Wechsler Preschool and Primary Scale of Intelligence (WPPSI-III) to the ConceptNet 4 AI system. The test questions (e.g., "Why do we shake hands?") were translated into ConceptNet 4 inputs using a combination of the simple natural language processing tools that come with ConceptNet together with short Python programs that we wrote. The question answering used a version of ConceptNet based on spectral methods. The ConceptNet system scored a WPPSI-III VIQ that is average for a four-year-old child, but below average for 5 to 7 year-olds. Large variations among subtests indicate potential areas of improvement. In particular, results were strongest for the Vocabulary and Similarities subtests, intermediate for the Information subtest, and lowest for the Comprehension and Word Reasoning subtests. Comprehension is the subtest most strongly associated with common sense. The large variations among subtests and ordinary common sense strongly suggest that the WPPSI-III VIQ results do not show that "ConceptNet has the verbal abilities a four-year-old." Rather, children's IQ tests offer one objective metric for the evaluation and comparison of AI systems. Also, this work continues previous research on Psychometric AI.

Update. A robot has passed the Japanese college entrance test and has an 80% chance of being accepted. Since it scored more than the average, that would make the IQ > 100, especially since college applicants have an IQ greater than average, and especially since Japanese are smarter than average humans. http://gizmodo.com/an-ai-program-in-japan-just-passed-a-college-entrance-e-1742758286

The Wall Street Journal reports that the program, developed by Japan’s National Institute of Informatics, took a multi-subject college entrance exam and passed with an above-average score of 511 points out of a possible 950. (The national average is 416.) With scores like that, it has an 8 out of 10 chance of being admitted to 441 private institutions in Japan, and 33 national ones.

Community
  • 1
Chloe
  • 159
  • 6

4 Answers4

4

Well, there have been many AI programs written specifically to ace IQ tests. Like this one and this one. I don't think there have been any robots (computer programs which control mechanical components) which have been administered an IQ test, but, TBH, you don't need a robot for this -- just a program.

Update: looks like I'm wrong, this 2012 paper says (I've only skimmed) that while AI may be able to be written to solve certain types of IQ problems, others are beyond our current reach.

Manishearth
  • 1,833
  • 2
  • 21
  • 28
  • The second example is not representative. They claim "IQ tests are based on two types of problems: progressive matrices, which test the ability to see patterns in pictures, and number sequences, which test the ability to see patterns in numbers." when there are many other types of questions: http://www.intelligencetest.com/questions/. I believe this program is referenced in the top hit in Google as a news article, but that didn't answer my question so that is why I asked here. I'll have to spend more time reading your 1st answer. – Chloe Apr 01 '13 at 01:44
  • 1st example: I jumped to the conclusion: "Although some human pre-processing admittedly takes place with some forms of questions, it should be emphasised (see Section 3) that both viable improvements in the parser(s) and an increase in the number of question forms attempted should enhance the program’sscorewhilereducingoreveneliminating human pre-processing requirements." I consider human pre-processing cheating. I would like to know what it would score without ANY help, even if it is very low. – Chloe Apr 01 '13 at 01:52
  • 1st example: "The aim of picture question is to check for pattern recognition. It will be hard for a program to solve picture questions (see, e.g., Figure 1)." Yes, I want to test the robot for that too! I want it to test it and see if it understands the questions, and if it can analyze pictures as well. What kind of score would it get then? – Chloe Apr 01 '13 at 03:03
  • @Chloe it really depends. In the end, One can roughly categorize IQ problems into various types, and one can write an AI for each. Paper 1, after all, seems to have been a student project (which is why it was so limited). It wouldn't be hard to make a good IQ test AI with a fair amount of resources at your disposal. – Manishearth Apr 01 '13 at 05:45
  • 1
    See edit. I was wrong. – Manishearth Apr 01 '13 at 05:49
  • That's what I thought. So what score would it get if it did the parts it could and guessed the parts it can't? I'm guessing 30. – Chloe Apr 01 '13 at 06:49
  • @chloe You seem to have the impression that there's one type of IQ test. There are many, with widely different patterns. I'd say that on average, a computer can probably reach human levels (70+) but not much more. 30 is 4 sigmas down, a bit much. – Manishearth Apr 01 '13 at 07:15
2

To the best of my knowledge no robot has ever been subjected to an IQ test. This is in part because the IQ test is not considered a valid test of intelligence amongst. It was originally developed as a test to determine whether any given child needed special attention in school and was later altered to apply to adults. Since then it has been shown to really only measure awareness of social norms. Some have argued that this awareness is indicative of intelligence but it's not generally accepted. Dr. Rolf Pfeifer's book Understanding Intelligence has a great discussion of this topic in chapter 1.

DaemonMaker
  • 3,921
  • 3
  • 21
  • 32
  • I'm pretty sure it was originally developed to test military recruits to determine the best position for them. It doesn't just measure awareness of social norms neither. These are examples of the categories of questions on IQ tests: http://www.intelligencetest.com/questions/. – Chloe Mar 29 '13 at 04:16
  • 1
    That's not correct. The IQ test was created by Alfred Binet in the 19th century. The military didn't start using intelligence type tests until the 20th century (around WWI by most accounts). – DaemonMaker Mar 29 '13 at 04:52
  • 1
    Wikipedia backs up @DaemonMaker in this regard. The French used mental aptitude tests first for judging mental development in children, but the military in World War I developed similar tests that eventually overtook Binet's in popularity. As for what it measures, the Wikipedia article nicely tried to avoid that subject as much as possible. – ThomasH Mar 30 '13 at 01:17
1

Just FYI since this is not about exactly the IQ test and also this might be more suitable for computer science community, but Japanese researchers have started a project "Can a Robot Pass the University of Tokyo Entrance Exam?" where by 2021 they aim to achieve the goal.

IsaacS
  • 4,502
  • 1
  • 13
  • 13
  • It gets a 60% score. It's a start. I wonder what IQ that translates too? 50? – Chloe Jul 31 '15 at 07:08
  • 1
    It has gotten a passing score now which is enough to be accepted to 80% of universities. http://gizmodo.com/an-ai-program-in-japan-just-passed-a-college-entrance-e-1742758286 – Chloe Nov 17 '15 at 00:15
1

I've created an AI, which solves given IQ tests. You may test it on http://iqsolver.eu

user1848072
  • 11
  • 1
  • Can you provide more information regarding this site? At a glance, it looks like a spam link, but I did follow it and it appears to solve the "find the next number in a sequence" style test. – Chuck Aug 04 '15 at 13:34
  • It solves exactly this kind of test. More informatation about it and comparison with other such programs may be found at: http://iqsolver.blogspot.com/2015/09/comparison-with-other-solvers.html – user1848072 Aug 03 '16 at 13:20