Wonderlic test explained

Wonderlic Personnel Test (WPT-R)
Image Alt:Wonderlic logo
Type:Multiple choice
Test Admin:Wonderlic, Inc.
Skills Tested:Math, vocabulary, and reasoning
Purpose:Assessing cognitive ability and problem-solving aptitude of prospective employees
Duration:12 minutes
Score Range:0–50 (1 point per question; score of 20 intended to represent average intelligence)
Language:12 different languages
Score Users:Prospective employers; notably administered at the NFL Scouting Combine
Free Label:Variants
Free:Wonderlic Personnel Test – Quicktest (WPT-Q); Wonderlic Scholastic Level Exam (SLE); WonScore

The Wonderlic Contemporary Cognitive Ability Test (formerly the Wonderlic Personnel Test) is an assessment used to measure the cognitive ability and problem-solving aptitude of prospective employees for a range of occupations. The test was created in 1939 by Eldon F. Wonderlic. It consists of 50 multiple choice questions to be answered in 12 minutes.[1] [2] [3] The score is calculated as the number of correct answers given in the allotted time, and a score of 20 is intended to indicate average intelligence.[2]

The most recent version of the test is WonScore, a cloud-based assessment providing a score to potential employers.[4] [5] The Wonderlic test was based on the Otis Self-Administering Test of Mental Ability with the goal of creating a short form measurement of cognitive ability.[1] [3] [6] It may be termed as a quick IQ test.[7]

History

Created in 1936 by E. F. Wonderlic, the Wonderlic Personnel Test was the first short-form cognitive abilities test.[2] [8] It was developed to measure general cognitive ability in the areas of math, vocabulary, and reasoning.[2] Wonderlic created and distributed the test as a graduate student in the psychology department at Northwestern University.[8] Regarding the time allotted to take the test, Wonderlic, in an article released in 1939, stated that "the length of the test was made such that only about two to five per cent of average groups complete the test in the twelve-minute time limit."[3]

Originally designed to aid in employee selection at companies such as AT&T[9] and Oscar Mayer in the 1940s, the Wonderlic Personnel Test has been used by both the United States Armed Forces and the National Football League. During World War II, the Navy began using the Wonderlic Personnel Test to select candidates for pilot training and navigation. From 1940–1960 the test was supplied for free as the data was valuable to E. F. Wonderlic. In the 1970s Tom Landry, coach of the Dallas Cowboys, was the first to use the Wonderlic Personnel Test to predict player performance.[2] Formerly used in the annual NFL Combine as a form of pre-draft assessment,[2] [8] the NFL stopped administering the test in 2022.[10]

The Wonderlic test is continually updated with repeated evaluations of questions.[11] Also, beginning in the 1970s, Wonderlic began to develop other forms of the Wonderlic Personnel, some of which include: Wonderlic Perceptual Ability Tests, Wonderlic Scholastic Level Exam, or the Wonderlic Contemporary Cognitive Ability Test.

Current Wonderlic tests

The Wonderlic company released the Wonderlic Personnel Test in the 1990s, measuring an individual's problem solving and learning capability. The Wonderlic Personnel Test has two different forms: the Wonderlic Personnel Test--Quicktest (30 questions in 8 minutes) and the Wonderlic Personnel Test (50 questions, 12 minutes). The Wonderlic Personnel Test – Quicktest differs from the Wonderlic Personnel Test in that it is not proctored. The Wonderlic Personnel Test is a much more comprehensive test.[12] [13]

The Wonderlic SLE is the scholastic version of the Wonderlic Personnel Test and is commonly administered to nursing school and medical program applicants.[14]

Sample questions

Similar to other standardized tests, the Wonderlic Cognitive Ability Test presents its questions in an open response.[3] The types of questions that have appeared in the oldest versions of the Wonderlic test include: analogies, analysis of geometric figures, arithmetic, direction following, disarranged sentences, judgment, logic, proverb matching, similarities, and word definitions. However, the questions may take different angles depending upon the ‘intelligence’ of the question setters.[3] [7] Practice questions will include:

Application to industrial-organizational psychology

See also: Industrial and organizational psychology. The Wonderlic test, as a vocational and intelligence test, falls under the field of Industrial and Organizational Psychology. As a personnel test the Wonderlic is used to gauge an applicant's job potential, educational potential, and training potential. Six forms of this test are made available (A, B, C, D, E, and F) in which Wonderlic suggests that when two of these versions are to be used, the best combinations are A and B or D and F.[17] However, a study conducted by psychologists Kazmier and Browne (1959) shows that neither of these forms can be regarded as directly equivalent. While there is no lack of tests that could be used in place of the Wonderlic, such as the IQ or the Mechanical Aptitude Test, it is a quick and simple vocational test for personnel recruitment and selection.[18] The Wonderlic test has been peer reviewed by the American Psychological Association and has been deemed worthy of field applications to the industrial use of personnel testing.[19] Other sources can be found on the database APA PsycNET.[20]

Reliability

In 1956, Weaver and Boneau reported in the Journal of Applied Psychology that two of the five forms, A and B, that were published at the time were harder than the others which caused scores on those forms to be significantly lower than scores obtained on forms C–F.[21] Concerning these observed differences, Weaver and Boneau state: "This accords with the history of the development of the test. Forms D, E, and F are made up of items selected from the Otis Higher, while A and B were developed later and include types of items not found in the Otis."[21] Those findings, seemingly, invalidate the claim that those forms were equivalent or consistent.[21] E. N. Hay made a similar observation as well. Hay found that form F was significantly easier than Form D.[22] Furthermore, Kazmier found Form B to be the most difficult of the five forms and, thus, recommended that it "not be regarded as directly equivalent to any of the forms."[6] Kazmier also found Forms D and F to be significantly different from each other and recommended that these forms be regarded as inequivalent.[6] In a study of the Wonderlic's test-retest reliability, conducted in 1992, Stuart McKelvie "concluded that conscious repetition of specific responses did not seriously inflate the estimate of test-retest reliability."[23] To put it simply, one's memory of some of the answers does not significantly affect one's score on the Wonderlic.[23]

In 1982, Carl Dodrill conducted a study in which 57 adults were administered the Wonderlic twice over a five-year period. In the Journal of Consulting and Clinical Psychology, Dodrill reported that the test-retest reliability for the Wonderlic was .94.[24] According to a 1989 article in Psychological Reports, the Wonderlic scored a r=.87 on the reliability scale compared along with the Pearson test score of r=.21.[25]

Validity

See also: Validity (statistics). In an article written in Psychological Reports, T. Matthews and Kerry Lassiter report that the Wonderlic test "was most strongly associated with overall intellectual functioning," which is what it is purported to measure. However, Matthews and Lassiter did not find the Wonderlic to be a successful measure of fluid and crystallized intelligence, and they stated that "the Wonderlic test scores did not clearly show convergent or divergent validity evidence across these two broad domains of cognitive ability." In academic testing, the Wonderlic test has shown high correlations with aptitude tests such as the General Aptitude Test Battery.

A more recent study by Hicks and colleagues from the Georgia Institute of Technology similarly argued that evidence concerning the test's validity was limited. Their research showed "that Wonderlic has no direct relationship to fluid intelligence once its commonality to working memory capacity is accounted for", and that the Wonderlic "was a significant predictor of working memory capacity for subjects with low fluid intelligence, but failed to discriminate as well among subjects with high fluid intelligence". These findings suggest that the Wonderlic is less informative when administered to higher-than-average ability individuals or groups, meaning there is more measurement error and less practical utility in giving the test to individuals higher in cognitive ability. Partially on this basis, they argued that organizations interested in personnel selection should consider administering measures of established constructs that are grounded in a more theoretical framework, such as fluid intelligence or working memory capacity.[26]

Legal matters

Jordan v. New London

In May 1997, Robert Jordan filed a lawsuit against the city of New London, Connecticut, alleging violation of the Equal Protection Clause of the United States and Connecticut constitutions, in a case that was referred to by several media outlets as "Too Smart To Be A Cop",[27] [28] based on the city's application of scores generated by the Wonderlic test.

Jordan was born and raised in New London, and had previous experience in law enforcement, working as a part-time officer in near-by Groton Long Point, and as a seasonal officer for the Connecticut Department of Environmental Protection. In fall 1996, Jordan requested an interview with Keith Harrigan, New London's Assistant City Manager in charge of personnel. Harrigan informed Jordan that he was ineligible because he scored too high on the written portion of the Wonderlic test intended to evaluate cognitive ability. New London had decided to consider only applicants who scored between 20 and 27 on the written examination. Jordan scored a 33 on the exam, the equivalent of having an IQ of 125.

Jordan filed suit in the United States District Court for the District of Connecticut, where his case was dismissed by Judge Peter C. Dorsey, who noted: "The guarantee of equal protection under the Fifth Amendment is not a source of substantive rights or liberties, but rather a right to be free from invidious discrimination in statutory classifications and other governmental activity. It is well settled that where a statutory classification does not itself impinge on a right or liberty protected by the Constitution, the validity of the classification must be sustained unless the classification rests on grounds wholly irrelevant to the achievement of [any legitimate government] objective....[Jordan] may have been disqualified unwisely but he was not denied equal protection."[29] The dismissal was upheld on appeal to the United States Court of Appeals for the Second Circuit.

Griggs v. Duke Power Co.

See main article: Griggs v. Duke Power Co..

Central tendency of Wonderlic scores

See also: Central tendency. Serving as a quantitative measure for employers, scores are collected by the employers and the applicant's score may be compared to a professional standard, as is the case with security guards or, simply, compared to the scores of other applicants who happen to be applying for the same or similar positions at that time.[30] Each profession has its own, unique, average; therefore, different professions require different standards.[3] [30] Wonderlic, Inc. claims a minimum score of 10 points suggests a person is literate.[31]

Average score in the NFL by position

The Wonderlic test is used in the NFL Scouting Combine. Paul Brown introduced the test to the league in the late 1960s.[32] According to Paul Zimmerman's The New Thinking Man's Guide to Pro Football,[33] the average score of an NFL player by position was:

An average football player usually scores around 20 points.[31] Quarterbacks and offensive linemen usually have higher scores. Most teams want at least 21 for a quarterback.[34]

Predictor of success in the NFL

John P. Lopez of Sports Illustrated proposed a 26–27–60 rule to predict a quarterback's success in the NFL (at least a 26 on the Wonderlic, at least 27 college starts, and at least 60% pass completion) and listed several examples of successes and failures based on the rule.[35] A 2005 study by McDonald Mirabile found that there is no significant correlation between a quarterback's Wonderlic score and a quarterback's passer rating, and no significant correlation between a quarterback's Wonderlic score and a quarterback's salary.[36] Similarly, a 2009 study by Brian D. Lyons, Brian J. Hoffman, and John W. Michel found that Wonderlic scores failed to positively and significantly predict future NFL performance, draft position, or the number of games started for any position.[32] Lyons said that Wonderlic's "limited return on investment" for the NFL is contrary to general mental ability being a very strong predictor of job performance for most careers; "because it's so physically based, the results point to that [GMA] really doesn't matter". Donovan McNabb, whose score was the lowest of the five quarterbacks taken in the first round of the 1999 NFL draft, had the longest and most successful career.[37]

The Lyons study also found that the relationship between Wonderlic test scores and future NFL performance was negative for a few positions, indicating the higher a player scores on the Wonderlic test, the worse the player will perform in the NFL.[38] For tight ends and defensive backs, it was found that lower scores indicated increased achievements.[39] According to Pat McInally, who was selected by the Cincinnati Bengals in the fifth round of the 1975 NFL draft, George Young told him that his perfect score caused him to be selected later than he would have otherwise.[40] NFL reporter Matt Verderame reported that New England Patriots offensive lineman Joe Thuney avoided answering Wonderlic questions so he would not score too high.[41] McInally speculated that "coaches and front-office guys don't like extremes one way or the other, but particularly not on the high side. I think they think guys who are intelligent will challenge authority too much".[42] Mike Florio of Profootballtalk.com agreed with McInally:[43]

Job performance in the NFL also includes deviance. A 2016 study found that the Wonderlic significantly predicted future arrests, referred to as criminal off-duty deviance, with players testing below the league average being almost twice as likely to get arrested in the future as players who scored above the league average.[44]

In popular culture

A simplified and condensed version of the Wonderlic test appeared in older editions of the Madden NFL video game series.[2] The questions usually consist of basic math and English questions. For example, "If Adrian Peterson rushes for 125 yards in a game, how many yards will he have at the end of the season if he keeps up with this pace?". Players have four answers to choose from when taking this version of the test.[45]

See also

External links

Notes and References

  1. Book: Aiken, L. R.. Tests and Examinations: Measuring abilities and performance. 1998. John Wiley & Sons. New York. 978-0-4711-9263-3. 293.
  2. Web site: Pollick. Michael. What is the Wonderlic Personnel Test. www.wisegeek.com. March 29, 2012.
  3. Wonderlic. E. F.. Hovland, C. I. . The Personnel Test: a restandardized abridgment of the Otis S–A test for business and industrial use. Journal of Applied Psychology. December 1939. 23. 6. 685–702. 10.1037/h0056432.
  4. https://reviews.financesonline.com/p/wonderlic/ "WonScore by Wonderlic Review"
  5. https://newtonsoftware.com/blog/2017/12/21/newton-partners-with-wonderlic-for-pre-hire-assessments/ "Newton Partners With Wonderlic for Pre-Hire Assessments"
  6. Kazmier. Leonard J.. Browne, C .J. . Comparability of Wonderlic Test Forms in Industrial Testing. Journal of Applied Psychology. 1959. 43. 2. 129–132. 10.1037/h0045688.
  7. Web site: Personality and Aptitude Career Tests. (2004). "Wonderlic personnel test: A short and quick iq test . November 20, 2012 . personality-and-aptitude-career-tests.com.
  8. Web site: 2012. History. wonderlic.com.
  9. https://fivethirtyeight.com/features/how-a-multiple-choice-test-became-a-fixture-of-the-nfl-draft/ "How A Multiple-Choice Test Became A Fixture Of The NFL Draft"
  10. Web site: O'Connell. Robert. Without the Wonderlic, the N.F.L. Finds Other Ways to Test Football I.Q.. https://web.archive.org/web/20220303015018/https://www.nytimes.com/2022/03/02/sports/football/nfl-wonderlic-test.html. subscription. The New York Times. March 2, 2022. March 3, 2022. January 21, 2023.
  11. Web site: History . wonderlic.com . May 14, 2012.
  12. Web site: Ready. Test. Go . Wonderlic . December 8, 2012.
  13. Web site: Wonderlic Test – Cognitive Ability Test. December 6, 2011 . All Practice Test. April 12, 2012.
  14. News: What Is the Wonderlic?. Beat the Wonderlic. 2017-03-13. en.
  15. News: Free Wonderlic Practice Test – 50 Questions, 12 Minutes. Beat the Wonderlic. 2017-03-13. en.
  16. News: Professional Wonderlic Practice Test. CognitiveMetrics. 2024-06-13. en.
  17. Kazmier, L.J. & Browne C.G.(1959). Comparability of Wonderlic test forms in industrial testing. Journal of Applied Psychology. 43(2):129–132.
  18. News: Remarks on the use of the Wonderlic Personnel Test as a 'pre-test.'. Journal of Clinical Psychology. November 1, 1949 . March 8, 2012 . Lindzey, Gardner.
  19. Dobrill. Carl. Warner, Holly . Further studies of the Wonderlic Personnel Test as a brief measure of intelligence. Journal of Consulting and Clinical Psychology. February 1988. 56. 145–147. 1. 10.1037/0022-006X.56.1.145. 3346441.
  20. Web site: PsycNET. psycnet.apa.org.
  21. Weaver. H. B.. Boneau, C. A. . Equivalence of Forms of the Wonderlic Personnel Test: A Study of Reliability and Interchangeability. Journal of Applied Psychology. 1956. 40. 2. 127–129. 10.1037/h0047065.
  22. Hay. E. N.. Some research findings with the Wonderlic Personnel Test. Journal of Applied Psychology. 1952. 36. 5. 344–345. 10.1037/h0061766.
  23. McKelvie. Stuart J.. Does memory contaminate test-retest reiliability. Journal of General Psychology. January 1992. 119. 1. 59–72. 10.1080/00221309.1992.9921158. 1613489.
  24. Dodrill. Carl. Long-Term Reliability of the Wonderlic Personnel Test. Journal of Consulting and Clinical Psychology. 1983. 51. 2. 316–317. 10.1037/0022-006X.51.2.316.
  25. Matthews. T. Kerry S. Lassiter . Psychological Reports. 2007. 100. 707–712. 10.2466/pr0.100.3.707-712. 3. 17688083. What Does the Wonderlic Personnel Test Measure?. 41253312.
  26. Hicks, K. L., Harrison, T. L., & Engle, R. W. (2015). "Wonderlic, working memory capacity, and fluid intelligence". Intelligence, 50, 186–195 .
  27. Web site: Too Smart to be a Cop?. CBS News. September 10, 1999 .
  28. Too Smart to be a Cop?. Slate . May 2013. Yglesias . Matthew .
  29. Web site: Jordan v. New London. www.aele.org.
  30. Book: Wonderlic Personnel Test Manual. 1983. E.F. Wonderlic & Associates, INC. Northfield, IL.
  31. Web site: Merron. Jeff. 2007. Taking Your Wonderlics. ESPN.
  32. News: NFL's success using Wonderlic Test subject to interpretation . Ledbetter . D. Orlando . March 6, 2010 . Atlanta Journal-Constitution . May 14, 2012 . dead . https://web.archive.org/web/20100527074021/https://www.ajc.com/sports/atlanta-falcons/nfls-success-using-wonderlic-352405.html . 2010-05-27.
  33. Book: Zimmerman, Paul . The New Thinking Man's Guide to Pro Football . 1984 . Simon and Schuster . registration . The New Thinking Man's Guide to Pro Football. . 9780671453947.
  34. News: Pompei . Dan . Notre Dame's Clausen wild card in NFL draft . Chicago Tribune . April 19, 2010.
  35. The Rule of 26–27–60 helps predict NFL quarterback success or failure . Lopez . John P. . July 8, 2010 . Sports Illustrated . dead . https://web.archive.org/web/20131018000523/http://sportsillustrated.cnn.com/2010/writers/john_lopez/07/08/qb.rule/index.html?xid=cnnbin&hpt=Sbin . 2013-10-18.
  36. Intelligence and Football: Testing for Differentials in Collegiate Quarterback Passing Performance and NFL Compensation . United States Sports Academy . Spring 2005 . April 25, 2011 . Mirabile . McDonald P. . The Sport Journal . 8 . 2.
  37. Most Likely to Succeed . The New Yorker . December 15, 2008 . January 12, 2013 . Gladwell . Malcolm.
  38. Not Much More than g? An Examination of the Impact of Intelligence on NFL Performance . Brian D. . Lyons . Brian J. . Hoffman . John W. . Michel . July 1, 2009 . Human Performance . 22 . 3 . 10.1080/08959280902970401 . 225. 145416436 .
  39. News: Shipley. Amy. Ryan Fitzpatrick's Wonderlic score: What does it mean?. https://web.archive.org/web/20120224113417/http://www.washingtonpost.com/sports/redskins/ryan-fitzpatricks-wonderlic-score-what-does-it-mean/2011/10/20/gIQAvz51GM_story.html. subscription. The Washington Post. October 25, 2011. February 24, 2012. January 21, 2023.
  40. News: Harvard's Ryan Fitzpatrick gets passing grades for 3–0 Bills . USA Today . September 26, 2011 . October 3, 2011 . Lopresti . Mike.
  41. Web site: Patriots player avoided Wonderlic questions so he wouldn't 'scare teams off' with his intelligence. en. Jordan Heck. 30 July 2019. Sporting News.
  42. Web site: McClellan . Bob . McInally continues to perfect the Wonderlic . . June 15, 2006 . April 25, 2011 . https://web.archive.org/web/20131024125307/http://collegefootball.rivals.com/content.asp?CID=553028 . October 24, 2013 . live . mdy-all .
  43. Web site: Greg McElroy gets a 48 on the Wonderlic . NBC Sports . Profootballtalk.com . February 28, 2011 . April 25, 2011 . Florio . Mike.
  44. Web site: Using data to predict arrest rates of NFL draft picks . Seifert . Kevin . 2016-04-12 . ESPN.com . en . 2019-02-10.
  45. EA Sports (2005). "NFL Superstar", Madden NFL 2006 (manual) (in English). Electronic Arts, page 11.