WORDSUM & IQ & the correlation

By Razib Khan | May 4, 2010 3:08 pm

Every time I use the WORDSUM variable from the GSS people will complain that a score on a 10-question vocabulary test is not a good measure of intelligence. The reality is that “good” is too imprecise a term. The correlation between adult IQ and WORDSUM = 0.71. The source for this number is a 1980 paper, The Enduring Effects of Education on Verbal Skills. I’ve reproduced the relevant table…

Estimated Correlations for Variables in a Model of Enduring Effects of Education for White, Native-Born People 25 to 72 Years Old in the Contemporary [1970s] United States
  Child IQ Age Sex Father’s Educ Father’s SEI Educ Adult IQ WORDSUM
Child IQ - 0 0 0.31 0.30 0.51 0.80 -
Age - - 0.026 -0.304 -0.130 -0.304 -0.42 -0.005
Sex - - - -0.054 0.058 0.050 0 -0.121
Father’s Educ - - - - 0.488 0.469 0.30 0.302
Father’s SEI - - - - - 0.347 0.31 0.285
Educ - - - - - - 0.66 0.511
Adult IQ - - - - - - - 0.71
WORDSUM - - - - - -   -
                 

Obviously since the WORDSUM test was not given to those under 18 you can’t calculate the correlation between childhood IQ and WORDSUM score. Additionally, I suspect since 1980 there’s been a bit more cognitive stratification by education. I notice in the GSS sample that there are many older people, especially women, who have high WORDSUM scores but no college education. In the younger age cohorts this pattern is not as evident because if you are intelligent the probability is much higher that you’ll obtain a university education.

A correlation of 0.71 is not mind-blowing, there’s a significant difference between IQ and WORDSUM as they relate to each other linearly. But I think it’s good enough to get a sense that WORDSUM is a serviceable substitute for a more rigorous measure of g in lieu of any alternatives, and not so clumsy a proxy so as to be useless. Though that call is up to you, and readers are free to disagree with the methodology of the model used to obtain this correlation. Additionally, I would point out that WORDSUM is a subset of the vocabulary subsection of the Wechsler Adult Intelligence Scale. WORDSUM is in effect a slice of an IQ test.

I am bookmarking this post so that in the future I can simply place a link in the comment threads in response to objections to WORDSUM.

Note: Thanks to Bryan Caplan for pointing me to this paper.

Citation: Lee M. Wolfle, Sociology of Education, Vol. 53, No. 2 (Apr., 1980), pp. 104-114

CATEGORIZED UNDER: Blog, Data Analysis, GSS
MORE ABOUT: Data, GSS, IQ, WORDSUM
  • Jason Malloy

    I’ve linked this paper before as well. The WORDSUM is an IQ test, and not simply a “proxy” for IQ, as many have called it. This is determined by its construct validity.

    It’s clearly tapping a cognitive dimension; vocabulary strongly correlates (.83) with the general intelligence factor: content validity. The WORDSUM correlation with the AGCT is within the range that IQ tests correlate with each other: concurrent validity. It is a reliable independent predictor and predicts external outcomes in a similar manner as other IQ tests: criterion validity.

    I wouldn’t recommend it for clinical or admissions purposes, but the GSS is an adequate cognitive test for the purposes of the GSS.

  • Tom Bri

    I would say that WORDSUM is useful but very limited. I easily scored 10 of 10 on it. My IQ, estimated from GRE scores, is probably in the 125 to 130 range. WORDSUM is crude. It shows that I am above average, but no more than that. Averaged across groups it gives a measure of their group intelligence. I wouldn’t want to rely on it to judge an individual.

  • http://blogs.discovermagazine.com/gnxp Razib Khan

    tom, wordsum obviously sucks at the tails of the distribution.

  • http://religionsetspolitics.blogspot.com/ Joshua Zelinsky

    Wordsum as a rough correlation seems ok but it has other problems. In particular, wordsum score is very highly correlated with maternal education levels (this is straight from the GSS data) . This is a serious potential confounding issue.

  • Jason Malloy

    IQ tests in general are just as correlated with maternal education levels. I can’t think of a scenario where they wouldn’t be, given that a) intelligence is heritable, and b) intelligence correlates with education level.

    wordsum-degree = .44
    wordsum-ma degree = .24
    wordsum-pa degree = .24
    wordsum-spouse dg = .35

  • LongMa

    Is it possible to get the Wordsum test somewhere online?

  • Divalent

    “Obviously since the WORDSUM test was not given to those under 18 you can’t calculate the correlation between childhood IQ and WORDSUM score.”

    Why not? You don’t give the WORDSUM test to children, you give it to an adult, then correlate to their childhood IQ. (Just like when you examine the correlation between Adult IQ and Childhood IQ). Or am I missing something here?

  • Pingback: WORDSUM and IQ, and their Correlation « Martial Culture()

  • JL

    Apparently the ten WORDSUM words have always been the same. The list of words and the six options for each can easily be found with Google. I got 10/10, even though I am not a native English speaker, and my IQ is not off the charts by any means.

  • Laura

    That correlation figure (0.71) has a suspiciously high precision given that it came from a 10 question test. I’m no statistician, and I’m only browsing through, but I’d approach this whole matter with a healthy dose of scepticism.

NEW ON DISCOVER
OPEN
CITIZEN SCIENCE
ADVERTISEMENT

Discover's Newsletter

Sign up to get the latest science news delivered weekly right to your inbox!

Gene Expression

This blog is about evolution, genetics, genomics and their interstices. Please beware that comments are aggressively moderated. Uncivil or churlish comments will likely get you banned immediately, so make any contribution count!

About Razib Khan

I have degrees in biology and biochemistry, a passion for genetics, history, and philosophy, and shrimp is my favorite food. In relation to nationality I'm a American Northwesterner, in politics I'm a reactionary, and as for religion I have none (I'm an atheist). If you want to know more, see the links at http://www.razib.com

ADVERTISEMENT

See More

ADVERTISEMENT

RSS Razib’s Pinboard

Edifying books

Collapse bottom bar
+

Login to your Account

X
E-mail address:
Password:
Remember me
Forgot your password?
No problem. Click here to have it e-mailed to you.

Not Registered Yet?

Register now for FREE. Registration only takes a few minutes to complete. Register now »