Flynn effect explained
The Flynn effect is the substantial and long-sustained increase in both fluid and crystallized intelligence test scores that were measured in many parts of the world over the 20th century, named after researcher James Flynn (1934–2020).[1] [2] When intelligence quotient (IQ) tests are initially standardized using a sample of test-takers, by convention the average of the test results is set to 100 and their standard deviation is set to 15 or 16 IQ points. When IQ tests are revised, they are again standardized using a new sample of test-takers, usually born more recently than the first; the average result is set to 100. When the new test subjects take the older tests, in almost every case their average scores are significantly above 100.
Test score increases have been continuous and approximately linear from the earliest years of testing to the present. For example, a study published in the year 2009 found that British children's average scores on the Raven's Progressive Matrices test rose by 14 IQ points from 1942 to 2008.[3] Similar gains have been observed in many other countries in which IQ testing has long been widely used, including other Western European countries, as well as Japan and South Korea.[2]
There are numerous proposed explanations of the Flynn effect, such as the rise in efficiency of education, along with skepticism concerning its implications. Similar improvements have been reported for semantic and episodic memory.[4] Some research suggests that there may be an ongoing reversed Flynn effect (i.e., a decline in IQ scores) in Norway, Denmark, Australia, Britain, the Netherlands, Sweden, Finland, and German-speaking countries.[5] This is said to have started in the 1990s[6] [7] [8] and to be occurring despite the average performance of 15-year-olds in those same countries ranking above the international average on the OECD Programme for International Student Assessment in reading, mathematics, and science in 2000,[9] 2003,[10] [11] 2006,[12] 2009,[13] 2012,[14] 2015,[15] and 2018.[16] In certain cases, this apparent reversal may be due to cultural changes which render parts of intelligence tests obsolete.[17] Meta-analyses indicate that, overall, the Flynn effect continues, either at the same rate,[18] or at a slower rate in developed countries.[19] [20]
Origin of term
The Flynn effect is named for James Robert Flynn, who did much to document it and promote awareness of its implications. The term was coined by Richard Herrnstein and Charles Murray in their 1994 book The Bell Curve.[21] [22] [23] Flynn stated that, if asked, he would have named the effect after Read D. Tuddenham[24] who "was the first to present convincing evidence of massive gains on mental tests using a nationwide sample" in a 1948 article.[25]
Although the general term for the phenomenon—referring to no researcher in particular—continues to be "secular rise in IQ scores", many textbooks on psychology and IQ testing have now followed the lead of Herrnstein and Murray in calling the phenomenon the Flynn effect.[26]
Rise in IQ
IQ tests are updated periodically. For example, the Wechsler Intelligence Scale for Children (WISC), originally developed in 1949, was updated in 1974, 1991, 2003, and again in 2014. The revised versions are standardized based on the performance of test-takers in standardization samples. A standard score of IQ 100 is defined as the mean performance of the standardization sample. Thus one way to see changes in norms over time is to conduct a study in which the same test-takers take both an old and new version of the same test. Doing so confirms IQ gains over time. Some IQ tests, for example, tests used for military draftees in NATO countries in Europe, report raw scores, and those also confirm a trend of rising scores over time. The average rate of increase seems to be about three IQ points per decade in the United States, as scaled by the Wechsler tests. The increasing test performance over time appears on every major test, in every age range, at every ability level, and in every modern industrialized country, although not necessarily at the same rate as in the United States. The increase was continuous and roughly linear from the earliest days of testing to the mid-1990s.[27] Though the effect is most associated with IQ increases, a similar effect has been found with increases in attention and of semantic and episodic memory.[4]
Ulric Neisser estimated that using the IQ values of 1997, the average IQ of the United States in 1932, according to the first Stanford–Binet Intelligence Scales standardization sample, was 80. Neisser states that "Hardly any of them would have scored 'very superior', but nearly one-quarter would have appeared to be 'deficient.'" He also wrote that "Test scores are certainly going up all over the world, but whether intelligence itself has risen remains controversial."[27] Quantitative psychologist, Joseph Lee Rodgers argues that the effect occurs outside of families in any case.[28]
Trahan et al. (2014) found that the effect was about 2.93 points per decade, based on both Stanford–Binet and Wechsler tests; they also found no evidence the effect was diminishing.[29] In contrast, Pietschnig and Voracek (2015) reported, in their meta-analysis of studies involving nearly 4 million participants, that the Flynn effect had decreased in recent decades. They also reported that the magnitude of the effect was different for different types of intelligence ("0.41, 0.30, 0.28, and 0.21 IQ points annually for fluid, spatial, full-scale, and crystallized IQ test performance, respectively"), and that the effect was stronger for adults than for children.[30]
Raven (2000) found that, as Flynn suggested, data interpreted as showing a decrease in many abilities with increasing age must be re-interpreted as showing that there has been a dramatic increase of these abilities with the date of birth. On many tests this occurs at all levels of ability.[31]
Some studies have found the gains of the Flynn effect to be particularly concentrated at the lower end of the distribution. Teasdale and Owen (1989), for example, found the effect primarily reduced the number of low-end scores, resulting in an increased number of moderately high scores, with no increase in very high scores.[32] In another study, two large samples of Spanish children were assessed with a 30-year gap. Comparison of the IQ distributions indicated that the mean IQ scores on the test had increased by 9.7 points (the Flynn effect), the gains were concentrated in the lower half of the distribution and negligible in the top half, and the gains gradually decreased as the IQ of the individuals increased.[33] Some studies have found a reverse Flynn effect with declining scores for those with high IQ.
In 1987, Flynn took the position that the very large increase indicates that IQ tests do not measure intelligence but only a minor sort of "abstract problem-solving ability" with little practical significance. He argued that if IQ gains did reflect intelligence increases, there would have been consequent changes of our society that have not been observed (a presumed non-occurrence of a "cultural renaissance").[27] By 2012 Flynn no longer endorsed this view of intelligence, having elaborated and refined his view of what rising IQ scores meant.[34]
Precursors to Flynn's publications
Earlier investigators had discovered rises in raw IQ test scores in some study populations, but had not published general investigations of that issue in particular. Historian Daniel C. Calhoun cited earlier psychology literature on IQ score trends in his book The Intelligence of a People (1973).[35] Robert L. Thorndike – not to be confused with his famous father Edward – drew attention to rises in Stanford-Binet scores in a 1975 review of the history of intelligence testing.[36] In 1982, Richard Lynn recorded an increase in average IQ among the population of Japan.[37]
Intelligence
See also: g factor (psychometrics) and Intelligence (trait). There is debate about whether the rise in IQ scores also corresponds to a rise in general intelligence, or only a rise in special skills related to taking IQ tests. Because children attend school longer now and have become much more familiar with the testing of school-related material, one might expect the greatest gains to occur on such school content-related tests as vocabulary, arithmetic or general information. Just the opposite is the case: abilities such as these have experienced relatively small gains and even occasional decreases over the years. Meta-analytic findings indicate that Flynn effects occur for tests assessing both fluid and crystallized abilities. For example, Dutch conscripts gained 21 points during only 30 years, or 7 points per decade, between 1952 and 1982.[27] This rise in IQ test scores is not wholly explained by an increase in general intelligence. Studies have shown that while test scores have improved over time, the improvement is not fully correlated with latent factors related to intelligence.[38] Other researchers argue that the IQ gains described by the Flynn effect are due in part to increasing intelligence, and in part to increases in test-specific skills.[39] [40] [41] One study suggested that the IQ gains reflected changes in modes of thinking that better reflected cognitive skills assessed by IQ tests rather than raw intelligence itself.[42]
Proposed explanations
See also: Impact of health on intelligence.
Schooling and test familiarity
The duration of average schooling has increased steadily. However, a criticism of this explanation is that if (in the United States) older and younger subjects, with similar educational levels, are compared together, then the IQ gains appear almost undiminished in each group compared to when they are considered individually.[27]
Many studies find that children who do not attend school score drastically lower on the tests than their regularly attending peers. During the 1960s, when some Virginia counties closed their public schools to avoid racial integration, compensatory private schooling was available only for White children. On average, the scores of African-American children who received no formal education during that period decreased at a rate of about six IQ points per year.[27]
Another explanation is an increased familiarity of the general population with tests and testing. For example, children who take the very same IQ test a second time usually gain five or six points. However, this seems to set an upper limit on the effects of test sophistication. One problem with this explanation and others related to schooling is that in the US, the groups with greater test familiarity show smaller IQ increases.[27]
Early intervention programs have shown mixed results. Some preschool (ages 3–4) intervention programs like "Head Start" do not produce lasting changes of IQ, although they may confer other benefits. The "Abecedarian Early Intervention Project", an all-day program that provided various forms of environmental enrichment to children from infancy onward, showed IQ gains that did not diminish over time. The IQ gains in the experimental group compared to the control group was 4.4 points. These gains persisted until at least age 21.[43]
Citing a high correlation between rising literacy rates and gains in IQ, David Marks has argued that the Flynn effect is caused by changes in literacy rates.[44]
Nutrition
Improved nutrition is another possible explanation. Today's average adult from an industrialized nation is taller than a comparable adult of a century ago. That increase of stature, likely the result of general improvements in nutrition and health, has been at a rate of more than a centimeter per decade. Available data suggest that these gains have been accompanied by analogous increases in head size, and by an increase in the average size of the brain.[27] [45] This argument had been thought to suffer the difficulty that groups who tend to be of smaller overall body size (e.g. women, or people of Asian ancestry) do not have lower average IQs.[32]
A 2005 study presented data supporting the nutrition hypothesis, which predicts that gains will occur predominantly at the low end of the IQ distribution, where nutritional deprivation is probably most severe.[33] An alternative interpretation of skewed IQ gains could be that improved education has been particularly important for this group.[32]
A century ago, nutritional deficiencies may have limited body and organ functionality, including skull volume. The first two years of life are a critical time for nutrition. The consequences of malnutrition can be irreversible and may include poor cognitive development, educability, and future economic productivity.[46] On the other hand, Flynn has pointed to 20-point gains on Dutch military (Raven's type) IQ tests between 1952, 1962, 1972, and 1982. In 1962 he observed that Dutch 18-year-olds had a major nutritional handicap. They were either in the womb or were recently born, during the great Dutch famine of 1944—when German troops monopolized food and 18,000 people died of starvation.[47] Yet, concludes Flynn, "they do not show up even as a blip in the pattern of Dutch IQ gains. It is as if the famine had never occurred."[48] [49] It appears that the effects of diet are gradual, taking effect over decades (affecting mother as well as the child) rather than a few months.
In support of the nutritional hypothesis, it is known that, in the United States, the average height before 1900 was about 10 cm (~4 inches) shorter than it is today.[50] Possibly related to the Flynn effect is a similar change of skull size and shape during the last 150 years. A Norwegian study found that height gains were strongly correlated with intelligence gains until the cessation of height gains in military conscript cohorts towards the end of the 1980s.[51] Both height and skull size increases probably result from a combination of phenotypic plasticity and genetic selection over this period.[52] With only five or six human generations in 150 years, time for natural selection has been very limited, suggesting that increased skeletal size resulting from changes in population phenotypes is more likely than recent genetic evolution.
It is well known that micronutrient deficiencies change the development of intelligence. For instance, one study has found that iodine deficiency causes a fall, on average, of 12 IQ points in China.[53]
Scientists James Feyrer, Dimitra Politi, and David N. Weil have found in the U.S. that the proliferation of iodized salt increased IQ by 15 points in some areas. Journalist Max Nisen has stated that with this type of salt becoming popular, that "the aggregate effect has been extremely positive."[54]
Daley et al. (2003) found a significant Flynn effect among children in rural Kenya, and concluded that nutrition was one of the hypothesized explanations that best explained their results (the others were parental literacy and family structure).[55]
Generally more stimulating environment
Still, another theory is that the general environment today is much more complex and stimulating. One of the most striking 20th-century changes in the human intellectual environment has come from the increase of exposure to many types of visual media. From pictures on the wall to movies to television to video games to computers, each successive generation has been exposed to richer optical displays than the one before and may have become more adept at visual analysis. This would explain why visual tests like the Raven's have shown the greatest increases. An increase only of particular forms of intelligence would explain why the Flynn effect has not caused a "cultural renaissance too great to be overlooked."[27]
In 2001, William Dickens and James Flynn presented a model for resolving several contradictory findings regarding IQ. They argue that the measure "heritability" includes both a direct effect of the genotype on IQ and also indirect effects such that the genotype changes the environment, thereby affecting IQ. That is, those with a greater IQ tend to seek stimulating environments that further increase IQ. These reciprocal effects result in gene environment correlation. The direct effect could initially have been very small, but feedback can create large differences in IQ. In their model, an environmental stimulus can have a very great effect on IQ, even for adults, but this effect also decays over time unless the stimulus continues (the model could be adapted to include possible factors, like nutrition during early childhood, that may cause permanent effects). The Flynn effect can be explained by a generally more stimulating environment for all people. The authors suggest that any program designed to increase IQ may produce long-term IQ gains if that program teaches children how to replicate the types of cognitively demanding experiences that produce IQ gains outside the program. To maximize lifetime IQ, the programs should also motivate them to continue searching for cognitively demanding experiences after they have left the program.[56] [57]
Flynn, in his 2007 book What Is Intelligence?, further expanded on this theory. Environmental changes resulting from modernization—such as more intellectually demanding work, greater use of technology, and smaller families—have meant that a much larger proportion of people are more accustomed to manipulating abstract concepts such as hypotheses and categories than a century ago. Substantial portions of IQ tests deal with these abilities. Flynn gives, as an example, the question 'What do a dog and a rabbit have in common?' A modern respondent might say they are both mammals (an abstract, or a priori answer, which depends only on the meanings of the words dog and rabbit), whereas someone a century ago might have said that humans catch rabbits with dogs (a concrete, or a posteriori answer, which depended on what happened to be the case at that time).[58] [59]
Infectious diseases
See also: Impact of health on intelligence. Eppig, Fincher, and Thornhill (2011) conducted a study looking at different US states found that states with a higher prevalence of infectious diseases had lower average IQ. The effect remained after controlling for the effects of wealth and educational variation.[60]
Atheendar Venkataramani (2010) studied the effect of malaria on IQ in a sample of Mexicans. Malaria eradication during the birth year was associated with increases in IQ. It also increased the probability of employment in a skilled occupation. The author suggests that this may be one explanation for the Flynn effect and that this may be an important explanation for the link between national malaria burden and economic development.[61] A literature review of 44 papers states that cognitive abilities and school performance were shown to be impaired in sub-groups of patients (with either cerebral malaria or uncomplicated malaria) when compared with healthy controls. Studies comparing cognitive functions before and after treatment for acute malarial illness continued to show significantly impaired school performance and cognitive abilities even after recovery. Malaria prophylaxis was shown to improve cognitive function and school performance in clinical trials when compared to placebo groups.[62]
Heterosis
Heterosis, or hybrid vigor, associated with historical reductions of the levels of inbreeding, has been proposed by Michael Mingroni as an alternative explanation of the Flynn effect.[63] [64] However, James Flynn has pointed out that even if everyone mated with a sibling in 1900, subsequent increases in heterosis would not be a sufficient explanation of the observed IQ gains.[65]
Reduction of lead in gasoline
See also: Lead abatement and Lead–crime hypothesis.
One study found the drop in blood lead levels in the United States from the 1970s to 2007 correlated with a 4-5 point increase in IQ.[66]
Possible end of progression
Jon Martin Sundet and colleagues (2004) examined scores on intelligence tests given to Norwegian conscripts between the 1950s and 2002. They found that the increase of scores of general intelligence stopped after the mid-1990s and declined in numerical reasoning sub-tests.[51]
Teasdale and Owen (2005) examined the results of IQ tests given to Danish male conscripts. Between 1959 and 1979 the gains were 3 points per decade. Between 1979 and 1989 the increase approached 2 IQ points. Between 1989 and 1998 the gain was about 1.3 points. Between 1998 and 2004 IQ declined by about the same amount as it gained between 1989 and 1998. They speculate that "a contributing factor in this recent fall could be a simultaneous decline in proportions of students entering 3-year advanced-level school programs for 16–18-year-olds."[67] The same authors in a more comprehensive 2008 study, again on Danish male conscripts, found that there was a 1.5-point increase between 1988 and 1998, but a 1.5-point decrease between 1998 and 2003/2004.[68]
In Australia, the IQ of 6–12-year-olds (as measured by colored progressive matrices) has shown no increase from 1975 to 2003.[69]
In the United Kingdom, a study by Flynn (2009) himself found that tests carried out in 1980 and again in 2008 show that the IQ score of an average 14-year-old dropped by more than two points over the period. For the upper half of the results, the performance was even worse. Average IQ scores declined by six points. However, children aged between five and 10 saw their IQs increase by up to half a point a year over the three decades. Flynn argues that the abnormal drop in British teenage IQ could be due to youth culture having "stagnated" or even dumbed down.[70]
Bratsberg & Rogeberg (2018) present evidence that the Flynn effect in Norway has reversed between the years 1962-1991, and that both the original rise in mean IQ scores and their subsequent decline within this period can be observed within families consisting of native-born parents and their children, indicating that environmental factors were the likely cause for these changes. Because IQ data was only available for male Norwegians, who were subject to military conscription, years of schooling were used as an approximation for female IQ to support this conclusion.
One possible explanation of a worldwide decline in intelligence is an increase in air pollution; coal burning emits mercury, and intelligence has continued to climb in areas, like the southern United States, where coal burning has declined.[71] [72] [73]
IQ group differences
See also: Nations and intelligence and Sex differences in intelligence. If the Flynn effect has ended in developed nations but continues in less developed ones, this would tend to diminish national differences in IQ scores.
Also, if the Flynn effect has ended for the majority in developed nations, it may still continue for minorities, especially for groups like immigrants where many may have received poor nutrition during early childhood or have had other disadvantages. A study in the Netherlands found that children of non-Western immigrants had improvements for g, educational achievements, and work proficiency compared to their parents, although there were still remaining differences compared to ethnic Dutch.[40]
In the United States, the IQ gap between black and white people was gradually closing over the last decades of the 20th century, as black test-takers increased their average scores relative to white test-takers. For instance, Vincent reported in 1991 that the black–white IQ gap was decreasing among children, but that it was remaining constant among adults.[74] Similarly, a 2006 study by Dickens and Flynn estimated that the difference between mean scores of black people and white people closed by about 5 or 6 IQ points between 1972 and 2002, a reduction of about one-third. In the same period, the educational achievement disparity also diminished.[75] Reviews by Flynn and Dickens,[76] Nicholas Mackintosh,[77] and Nisbett et al.[78] [79] all concluded that the gradual closing of the gap was a real phenomenon.
Flynn has commented that he never claimed that the Flynn effect has the same causes as observed differences in average IQ test performance between blacks and whites, but that it shows that environmental factors can create IQ differences of a magnitude similar to that gap.[80] Wicherts et al. had previously suggested a similar interpretation in a 2004 paper.[81] Flynn also argued that his findings undermine the so-called Spearman's hypothesis, which hypothesized that differences in g factor are the major driver of the blacks-whites IQ gap.[82]
See also
Further reading
- te Nijenhuis, Jan, & van der Flier, H. (2013). "Is the Flynn effect on g?: A meta-analysis." Intelligence, 41(6), 802–807. doi:10.1016/j.intell.2013.03.001
- Rodgers, Joseph Lee (1998). "A critique of the Flynn Effect: Massive IQ gains, methodological artifacts, or both?" Intelligence, 26(4), 337–356. doi:10.1016/S0160-2896(99)00004-5
- 10.1037/0033-2909.95.1.29 . Flynn, James R. . The Mean IQ of Americans: Massive Gains 1932 to 1978 . . 95 . 29–51 . 1984 . https://web.archive.org/web/20120310210720/http://www.iapsych.com/iqmr/fe/LinkedDocuments/flynn1984b.pdf . 2012-03-10 . live . May 16, 2013 .
- Flynn, James R. . Massive IQ Gains in 14 Nations: What IQ Tests Really Measure . . 101 . 2 . 171–91 . March 1987 . https://web.archive.org/web/20110124091833/http://www.iapsych.com/iqmr/fe/LinkedDocuments/flynn1987.pdf . 2011-01-24 . live . May 13, 2013 . 10.1037/0033-2909.101.2.171 .
- Book: Flynn, James R. . Are We Getting Smarter? Rising IQ in the Twenty-first century . Cambridge . . 978-1-107-60917-4 . 2012 . registration .
- Lea . Winerman . Smarter than ever? . Monitor on Psychology . 44 . 3 . 30. March 2013.
- Book: The Rising Curve: Long-Term Gains in IQ and Related Measures . Neisser . Ulric . Ulric Neisser . James R. Flynn . Carmi Schooler . Patricia M. Greenfield . Wendy M. Williams . Marian Sigman . Shannon E. Whaley . Reynaldo Martorell . Richard Lynn . Robert M. Hauser . David W. Grissmer . Stephanie Williamson . Sheila Nataraj Kirby . Mark Berends . Stephen J. Ceci . Tina B. Rosenblum . Matthew Kumpf . Min-Hsiung Huang . Irwin D. Waldman . Samuel H. Preston . John C. Loehlin . 1998 . American Psychological Association . Washington DC . 978-1-55798-503-3 . APA Science Volume Series . registration.
External links
- Web site: Flynn . James Robert . James Flynn (academic) . 2006-12-15 . Beyond the Flynn Effect . live . https://web.archive.org/web/20171011193938/https://www.psychometrics.cam.ac.uk/about-us/directory/beyond-the-flynn-effect . 2017-10-11 . 2024-05-30 . University of Cambridge.
- Web site: Graham . Charles . 2001 . The Flynn Effect . dead . https://web.archive.org/web/20051025230525/http://www.indiana.edu/%7Eintell/flynneffect.shtml . 2005-10-25 . 2024-05-30 . Indiana University.
- Holloway . Marguerite . 1999-01-01 . Flynn's Effect . dead . . 280 . 37–38 . 10.1038/scientificamerican0199-37 . https://web.archive.org/web/20050910211047/http://www.sciam.com/article.cfm?articleID=00037F65-D9C0-1C6A-84A9809EC588EF21 . 2005-09-10 .
- Dickens . William Theodore . William Dickens . Flynn . James Robert . James Flynn (academic) . 2001 . Heritability Estimates Versus Large Environmental Effects: The IQ Paradox Resolved . . en . 108 . 2 . 346–369 . 10.1037/0033-295X.108.2.346 . 0033-295X . 1939-1471 . American Psychological Association.
- Johnson . Steven . 2005-05-01 . Dome Improvement . live . . 1059-1028 . 1078-3148 . https://web.archive.org/web/20161019222711/https://www.wired.com/2005/05/flynn-2/ . 2016-10-19 .
- Web site: Heylighen . Francis Paul . Francis Heylighen . 2000-08-22 . Increasing intelligence: the Flynn effect . live . https://web.archive.org/web/20070704094614/http://pespmc1.vub.ac.be/FLYNNEFF.html . 2007-07-04 . 2024-05-30 . Principia Cybernetica.
Notes and References
- Trahan . Lisa H. . Stuebing . Karla K. . Fletcher . Jack M. . Hiscock . Merrill . 2014 . The Flynn effect: A meta-analysis. . Psychological Bulletin . en . 140 . 5 . 1332–1360 . 10.1037/a0037173 . 24979188 . 4152423 . 1939-1455.
- Baker . David P. . Eslinger . Paul J. . Benavides . Martin . Peters . Ellen . Dieckmann . Nathan F. . Leon . Juan . March 2015 . The cognitive impact of the education revolution: A possible cause of the Flynn Effect on population IQ . Intelligence . 49 . 144–58 . 10.1016/j.intell.2015.01.003 . 0160-2896.
- Flynn . James R. . March 2009 . Requiem for nutrition as the cause of IQ gains: Raven's gains in Britain 1938–2008 . Economics and Human Biology . 7 . 1 . 18–27 . 10.1016/j.ehb.2009.01.009 . 1873-6130 . 19251490.
- Rönnlund M, Nilsson LG . Flynn effects on sub-factors of episodic and semantic memory: parallel gains over time and the same set of determining factors . Neuropsychologia . 47 . 11 . 2174–80 . September 2009 . 19056409 . 10.1016/j.neuropsychologia.2008.11.007 . 15706086 .
- Al-Shahomee . etal . 2018 . An increase of intelligence in Libya from 2008 to 2017 . Personality and Individual Differences . 130. 147–149. 10.1016/j.paid.2018.04.004 . 149095461 .
- 10.1016/j.paid.2005.01.029. A long-term rise and recent decline in intelligence test performance: The Flynn Effect in reverse. Personality and Individual Differences. 39. 4. 837–43. 2005. Teasdale. Thomas W. Owen. David R.
- 10.1016/j.intell.2015.10.004. A reversal of the Flynn effect for spatial perception in German-speaking countries: Evidence from a cross-temporal IRT-based meta-analysis (1977–2014). Intelligence. 53. 145–53. 2015. Pietschnig. Jakob. Gittler. Georg.
- Bratsberg. Bernt. Rogeberg. Ole. June 6, 2018. Flynn effect and its reversal are both environmentally caused. Proceedings of the National Academy of Sciences. en. 115. 26. 6674–78. 10.1073/pnas.1718793115. 0027-8424. 6042097. 29891660. 2018PNAS..115.6674B . free.
- Literacy Skills for the World of Tomorrow: Further Results from PISA 2000. 2003. OECD/UNESCO. https://web.archive.org/web/20180408224817/https://www.oecd.org/education/school/programmeforinternationalstudentassessmentpisa/33690591.pdf . 2018-04-08 . live. November 24, 2022.
- PISA 2003: A Profile of Student Performance in Mathematics. 2004. OECD. https://web.archive.org/web/20160909060945/http://www.oecd.org/education/school/programmeforinternationalstudentassessmentpisa/33917867.pdf . 2016-09-09 . live. November 24, 2022.
- PISA 2003: A Profile of Student Performance in Reading and Science. 2004. OECD. https://web.archive.org/web/20130227020033/http://www.oecd.org/education/school/programmeforinternationalstudentassessmentpisa/33918060.pdf . 2013-02-27 . live. November 24, 2022.
- PISA 2006: Science Competencies for Tomorrow's World Executive Summary. 2007. OECD. https://web.archive.org/web/20141129011126/http://www.oecd.org/pisa/pisaproducts/39725224.pdf . 2014-11-29 . live. November 24, 2022.
- PISA 2009 Results: Executive Summary. 2010. OECD. https://web.archive.org/web/20120820070727/http://www.oecd.org/pisa/46643496.pdf . 2012-08-20 . live. November 24, 2022.
- PISA 2012: Results in Focus. 2014. OECD. https://web.archive.org/web/20131203204731/http://www.oecd.org/pisa/keyfindings/pisa-2012-results-overview.pdf . 2013-12-03 . live. November 24, 2022.
- PISA 2015: Results in Focus. 2018. OECD. https://web.archive.org/web/20161208150138/https://www.oecd.org/pisa/pisa-2015-results-in-focus.pdf . 2016-12-08 . live. November 24, 2022.
- PISA 2018 Results: Combined Executive Summaries, Volumes I, II, & III. 2019. OECD. https://web.archive.org/web/20191206115004/https://www.oecd.org/pisa/Combined_Executive_Summaries_PISA_2018.pdf . 2019-12-06 . live. November 24, 2022.
- Gonthier . Corentin . Grégoire . Jacques . Besançon . Maud . No negative Flynn effect in France: Why variations of intelligence should not be assessed using tests based on cultural knowledge . Intelligence . January 2021 . 84 . 101512 . 10.1016/j.intell.2020.101512. 230538271 . free .
- Trahan . Lisa H. . Stuebing . Karla K. . Fletcher . Jack M. . Hiscock . Merrill . The Flynn effect: A meta-analysis. . Psychological Bulletin . 2014 . 140 . 5 . 1332–1360 . 10.1037/a0037173. 24979188 . 4152423 .
- Pietschnig . Jakob . Voracek . Martin . One Century of Global IQ Gains: A Formal Meta-Analysis of the Flynn Effect (1909–2013) . Perspectives on Psychological Science . May 2015 . 10 . 3 . 282–306 . 10.1177/1745691615577701. 25987509 . 12604392 .
- Wongupparaj . Peera . Kumari . Veena. Veena Kumari . Morris . Robin G. . A Cross-Temporal Meta-Analysis of Raven's Progressive Matrices: Age groups and developing versus developed countries . Intelligence . March 2015 . 49 . 1–9 . 10.1016/j.intell.2014.11.008.
- Book: Flynn, James R. . What Is Intelligence: Beyond the Flynn Effect . expanded paperback . Cambridge . . 978-0-521-74147-7 . 2009 . 1–2 . The 'Flynn effect' is the name that has become attached to an exciting development, namely, that the twentieth century saw massive IQ gains from one generation to another. To forestall a diagnosis of megalomania, the label was coined by Herrnstein and Murray, the authors of The Bell Curve, and not by myself..
- Web site: Cosma . Shalizi . The Domestication of the Savage Mind . Review . University of Michigan . 27 April 2009 . July 19, 2012 . https://web.archive.org/web/20120719062416/http://www.cscs.umich.edu/~crshalizi/reviews/flynn-beyond/ . August 13, 2010.
- Book: Herrnstein. Richard J.. The Bell Curve: Intelligence and Class Structure in American Life. Murray. Charles. The Free Press. 1994. 0-02-914673-9. New York. 307.
- Haig . Brian D. . 2013-07-01 . Detecting Psychological Phenomena: Taking Bottom-Up Research Seriously . The American Journal of Psychology . en . 126 . 2 . 135–153 . 10.5406/amerjpsyc.126.2.0135 . 23858950 . 0002-9556.
- Tuddenham . R. D. . 1948 . Soldier intelligence in World Wars I and II . The American Psychologist . 3 . 2 . 54–56 . 10.1037/h0054962 . 0003-066X . 18911933.
- Book: Fletcher . Richard B. . Hattie . John . Intelligence and Intelligence Testing . August 31, 2013 . 2011 . Taylor & Francis . 978-1-136-82321-3 . 26 . Indeed, this effect, now called the 'Flynn effect', is well established. Nations, almost without exception, have shown gains of about 20 IQ points per generation (30 years). These gains are highest for IQ tests that are most related to reasoning and the capacity to figure out novel problems (this is often called 'fluid intelligence', see Chapter 5); and least related to knowledge, which arises from better educational opportunity, a history of persistence and good motivation for learning (this is often called 'crystallized intelligence', see Chapter 5)..
- Book: Freeman, Joan . Gifted Lives: What Happens when Gifted Children Grow Up . 2010 . Routledge . London . 978-0-415-47009-4 . 290–91 . A strange new phenomenon has been growing since about 1950, called the 'Flynn Effect' after Professor James Flynn of the University of Otago, New Zealand. In his book What is Intelligence ?, Flynn describes a year-on-year rise in measured intelligence, about three IQ points a decade..
- News: Annalisa . Barbieri . Young, gifted and likely to suffer for it . The Guardian . 8 October 2010 . December 14, 2016 . November 11, 2020 . https://web.archive.org/web/20201111215132/https://www.theguardian.com/lifeandstyle/2010/oct/09/gifted-children-joan-freeman-psychologist . live .
- Book: Urbina, Susana . Essentials of Psychological Testing . 2004 . John Wiley & Sons . 978-0-471-41978-5 . 103 . A puzzling longitudinal trend in the opposite direction, known as the 'Flynn effect', has been well documented in successive revisions of major intelligence tests (like the S-B and the Wechsler scales) that invariably involve the administration of both the old and new versions to a segment of the newer standardization sample, for comparative purposes. Data from revisions of various intelligence tests in the United States as well as in other countries—extensively analyzed by J.R. Flynn (1984, 1987)—show a pronounced, long-term upward trend in the level of performance required to obtain any given IQ score. The Flynn effect presumably reflects population gains over time in the kinds of cognitive performance that intelligence tests sample.. Book: Wasserman, John D. . Weiner . Irving B. . Graham . John R. . Naglieri . Jack A. . Handbook of Psychology . 10: Assessment Psychology . Chapter 18: Assessment of Intellectual Functioning . 2012 . John Wiley & Sons . 978-0-470-89127-8 . 486 . Both definitions also specify that the intellectual functioning criterion for a diagnosis of intellectual disability is approximately 2 SDs or more below the normative mean, but factors such as test score statistical error (standard error of measurement), test fairness, normative expectations for the population of interest, the Flynn effect, and practice effects from previous testing need to be considered before arriving at any diagnosis..
- Book: Chamorro-Premuzic, Tomas . Tomas Chamorro-Premuzic . Personality and Individual Differences . 2011 . Wiley . 978-1-4051-9927-8 . 221 . Flynn effect The finding by sociologist James Flynn that there are generational increases in IQ across nations..
- Neisser U . Rising Scores on Intelligence Tests . American Scientist . 85 . 5 . 440–47 . 1997 . bot: unknown . https://web.archive.org/web/20161104214157/http://www.americanscientist.org/issues/feature/rising-scores-on-intelligence-tests/99999 . November 4, 2016 . 1997AmSci..85..440N .
- [Joseph Lee Rodgers]
- Trahan. LH. Stuebing. KK. Fletcher. JM. Hiscock. M. The Flynn effect: a meta-analysis.. Psychological Bulletin. September 2014. 140. 5. 1332–60. 10.1037/a0037173. 24979188. 4152423.
- Jakob Pietschnig . Martin Voracek . 12604392 . May 1, 2015 . One Century of Global IQ Gains: A Formal Meta-Analysis of the Flynn Effect (1909–2013) . Perspectives on Psychological Science . en . 10 . 3 . 282–306 . 10.1177/1745691615577701 . 25987509 . 1745-6916.
- Raven John . 2000 . The Raven's Progressive Matrices: Change and Stability over Culture and Time . Cognitive Psychology . 41 . 1 . 1–48 . 10.1006/cogp.1999.0735 . 10945921 . 26363133 . July 9, 2011 . April 28, 2019 . https://web.archive.org/web/20190428221444/http://eyeonsociety.co.uk/resources/RPMChangeAndStability.pdf . live .
- 10.1016/0160-2896(89)90021-4 . Teasdale . T. . Continuing secular increases in intelligence and a stable prevalence of high intelligence levels . Intelligence . 13 . 3 . 255–62 . 1989 .
- The generational intelligence gains are caused by decreasing variance in the lower half of the distribution: Supporting evidence for the nutrition hypothesis . Colom, R. . Lluis-Font, J.M. . Andrés-Pueyo, A. . amp . Intelligence . 2005 . 33 . 1 . 83–91 . 10.1016/j.intell.2004.07.010 . October 4, 2012 . August 13, 2012 . https://web.archive.org/web/20120813042004/http://synapse.princeton.edu/~brained/chapter15/colom_andres-pueyo05_intelligence_Spanish-schoolchildren-nutrition-hypothesis.pdf . live .
- News: James Flynn: IQ may go up as well as down. Tucker. Ian. 2012-09-22. The Guardian. 2019-01-21. en-GB. 0261-3077. January 21, 2019. https://web.archive.org/web/20190121232649/https://www.theguardian.com/technology/2012/sep/23/james-flynn-iq-scores-environment. live.
- Book: Calhoun, Daniel . The Intelligence of a People . 1973 . Princeton University Press . 978-0-691-04619-8 . registration.
- Thorndike . Robert L. . Robert L. Thorndike. Mr. Binet's Test 70 Years Later . Educational Researcher . 4 . 5 . 1975 . 3–7 . 0013-189X . 10.3102/0013189X004005003 . 1174855 . 145355731 .
- Lynn . Richard . Richard Lynn. May 1982 . IQ in Japan and the United States shows a growing disparity . Nature . en . 297 . 5863 . 222–223 . 10.1038/297222a0 . 1982Natur.297..222L . 4331657 . 1476-4687.
- Must O, Must A, Raudik V . 2003 . The secular rise in IQs: In Estonia, the Flynn effect is not a Jensen effect . . 31 . 5 . 461–71 . 10.1016/S0160-2896(03)00013-8 . September 13, 2011 . October 11, 2017 . https://web.archive.org/web/20171011193700/http://www.iapsych.com/iqmr/fe/LinkedDocuments/Must2003.pdf . live .
- Wicherts, J.M. . Dolan, C.V. . Hessen, D.J. . Oosterveld, P. . Baal, G.C.M. van . Boomsma, D.I. . Span, M.M. . amp . 2004 . Are intelligence tests measurement invariant over time? Investigating the nature of the Flynn effect . . 32 . 5 . 509537 . 10.1016/j.intell.2004.07.002 . The overall conclusion of the present paper is that factorial invariance with respect to cohorts is not tenable . . . . The fact that the gains cannot be explained solely by increases at the level of the latent variables (common factors), which IQ tests purport to measure, should not sit well with explanations that appeal solely to changes at the level of the latent variables. . dead . https://web.archive.org/web/20050529034027/http://users.fmg.uva.nl/jwicherts/wicherts2004.pdf . May 29, 2005 . 10.1.1.207.4350 .
- Te Nijenhuis J, De Jong MJ, Evers A, Van Der Flier H . Are cognitive differences between immigrant and majority groups diminishing? . . 2004 . 18 . 5 . 405–34 . 10.1002/per.511 . 4806581 . November 10, 2019 . February 21, 2021 . https://web.archive.org/web/20210221012426/https://research.vu.nl/ws/files/1957002/Nijenhuis%20European%20Journal%20of%20Personality%2018%202004%20u.pdf . live .
- Secular Gains in Fluid Intelligence: Evidence from the Culture-Fair Intelligence Test . Colom R, Garcia-Lopez O. . 2003 . 35 . 33–39 . 10.1017/S0021932003000336 . 12537154 . 1. 24493926.
- Flynn . James Robert . Te Nijenhuis . Jan te Nijenhuis . Jan . Metzen . Daniel . May–June 2014 . The g beyond Spearman's g: Flynn's paradoxes resolved using four exploratory meta-analyses . . 44 . 1–10 . 10.1016/j.intell.2014.01.009 . 2 July 2023.
- Book: Plomin R. . Robert Plomin. DeFries J.C. . Craig I.W. . McGuffin P. . Behavioral genetics in the postgenomic era . 2003 . 4th .
- Marks . David Francis . 2010-06-01 . IQ Variations across Time, Race, and Nationality: An Artifact of Differences in Literacy Skills . Psychological Reports . en . 106 . 3 . 643–664 . 10.2466/pr0.106.3.643-664 . 0033-2941 . Sage Publishing.
- Jantz . R. . Meadows Jantz . L. . 2000 . Secular change in craniofacial morphology . American Journal of Human Biology . 12 . 3. 327–38 . 10.1002/(SICI)1520-6300(200005/06)12:3<327::AID-AJHB3>3.0.CO;2-1 . 11534023. 22059721 . free .
- Web site: The Lancet Series on Maternal and Child Undernutrition . 2008 . February 11, 2011 . July 17, 2011 . https://web.archive.org/web/20110717005704/http://www.thelancet.com/series/maternal-and-child-undernutrition . live .
- C. Banning (1946). "Food Shortage and Public Health, First Half of 1945". Annals of the American Academy of Political and Social Science Vol. 245, The Netherlands during German Occupation (May 1946), pp. 93–110
- Flynn J.R. . 1987 . Massive IQ gains in 14 nations: What IQ tests really measure . Psychological Bulletin . 101 . 2. 171–91 . 10.1037/0033-2909.101.2.171.
- Flynn, James R. (2009). What Is Intelligence? (p. 103). Cambridge University Press. Kindle Edition.
- Samaras . Thomas T. . Elrick . Harold . May 2002 . Group Height, body size, and longevity: is smaller better for the human body? . West J Med . 176 . 3 . 206–08 . 1071721 . 12016250 . 10.1136/ewjm.176.3.206.
- 10.1016/j.intell.2004.06.004. Sundet . J. . Barlaug . D. . Torjussen . T. . Intelligence . 32 . 4 . 349–62 . The end of the Flynn effect?: A study of secular trends in mean intelligence test scores of Norwegian conscripts during half a century. 2004 .
- Jantz RL, Meadows Jantz L . Secular change in craniofacial morphology . Am. J. Hum. Biol. . 12 . 3 . 327–38 . May 2000 . 11534023 . 10.1002/(SICI)1520-6300(200005/06)12:3<327::AID-AJHB3>3.0.CO;2-1. 22059721 . free .
Jantz RL . Cranial change in Americans: 1850–1975 . J. Forensic Sci. . 46 . 4 . 784–87 . July 2001 . 10.1520/JFS15047J . 11451056 .
- Qian M . The effects of iodine on intelligence in children: a meta-analysis of studies conducted in China . Asia Pacific Journal of Clinical Nutrition . 14 . 1 . 32–42 . 2005 . 15734706. Wang D. Watkins WE. 3. Gebski. V. Yan. YQ. Li. M. Chen. ZP.
- Web site: Nisen. Max. How Adding Iodine To Salt Resulted In A Decade's Worth Of IQ Gains For The United States. 2013-07-22. 2023-01-23. Business Insider. en-US.
- Daley. TC. Whaley. SE. Sigman. MD. Espinosa. MP. Neumann. C. 12315212. IQ on the rise: the Flynn effect in rural Kenyan children.. Psychological Science. May 2003. 14. 3. 215–19. 12741743. 10.1111/1467-9280.02434.
- 10.1037/0033-295X.108.2.346 . Dickens WT, Flynn JR . Heritability estimates versus large environmental effects: The IQ paradox resolved . Psychological Review . 108 . 2 . 346–369 . 2001 . 11381833 . 10.1.1.139.2436 .
- Dickens WT, Flynn JR . The IQ Paradox: Still Resolved . Psychological Review . 109 . 4 . 2002 . 10.1037/0033-295x.109.4.764 . 764–71 . dead . https://web.archive.org/web/20070319031706/http://www.brookings.edu/views/papers/dickens/20020205.pdf . March 19, 2007 .
- Book: Flynn, James R. . James Flynn (academic) . . August 2012 . Cambridge University Press . 9780511605253 . 24–29.
- Gladwell . Malcolm . None of the Above . The New Yorker . July 6, 2024 . December 10, 2007 . limited.
- Eppig C, Fincher CL, Thornhill R . Parasite prevalence and the distribution of intelligence among the states of the USA . Intelligence . 39 . 2–3 . 155–60 . 2011 . 10.1016/j.intell.2011.02.008.
- Venkataramani A . Early Life Exposure to Malaria and Cognition and Skills in Adulthood: Evidence from Mexico . September 18, 2010 . 1679164.
- Fernando SD, Rodrigo C, Rajapakse S . The 'hidden' burden of malaria: cognitive impairment following infection . Malar. J. . 9 . 1 . 366 . 2010 . 21171998 . 3018393 . 10.1186/1475-2875-9-366 . free .
- Mingroni, M. A. (2007). "Resolving the IQ paradox: Heterosis as a cause of the Flynn effect and other trends" (PDF). Psychological Review, 114(3), 806–829. doi:10.1037/0033-295X.114.3.806
- Mingroni, M.A. (2004). "The secular rise in IQ: Giving heterosis a second look" (PDF). Intelligence, 32, 65-83.
- [Nicholas Mackintosh|Mackintosh, N.J.]
- The possible societal impact of the decrease in U.S. blood lead levels on adult IQ . Alan S. . Kaufman . Xiaobin . Zhou . Matthew R. . Reynolds . Nadeen L. . Kaufman . Garo P. . Green . Lawrence G. . Weisse . 10.1016/j.envres.2014.04.015 . Environmental Research . 132 . July 2014 . 413–420. 24853978 . 2014ER....132..413K .
- Teasdale. Thomas W.. Owen. David R.. 2005. A long-term rise and recent decline in intelligence test performance: The Flynn Effect in reverse. Personality and Individual Differences. 39. 4. 837–43. 10.1016/j.paid.2005.01.029.
- 10.1016/j.intell.2007.01.007 . Teasdale TW, Owen DR . Secular declines in cognitive test scores: A reversal of the Flynn Effect . Intelligence . 36 . 2 . 121–26 . 2008 . April 18, 2010 . October 15, 2012 . https://web.archive.org/web/20121015184832/http://www.iapsych.com/iqmr/fe/LinkedDocuments/teasdale2008.pdf . live .
- Cotton . S.M.. Kiely. P.M.. Crewther. D.P.. Thomson. B.. Laycock. R.. Crewther. S.G. . 2005. A normative and reliability study for the Raven's Colored Progressive Matrices for primary school aged children in Australia. Personality and Individual Differences. 39. 3. 647–60. 10.1016/j.paid.2005.02.015.
- 10.1016/j.ehb.2009.01.009 . 19251490. Flynn . J.R. . Requiem for nutrition as the cause of IQ gains: Raven's gains in Britain 1938–2008 . Economics & Human Biology . 7 . 1 . 18–27 . 2009 .
- Robin P.. Clarke. Rising–falling mercury pollution causing the rising–falling IQ of the Lynn–Flynn effect, as predicted by the antiinnatia theory of autism and IQ. Personality and Individual Differences. 1 August 2015. 0191-8869. 46–51. 82. 10.1016/j.paid.2015.02.039.
- Ivica. Pesovski. Andrea. Kulakov. Vladimir. Trajkovikj. Differences in cognitive ability assessment results between Millennial and Generation Z cohorts. 2022. The 19th International Conference on Informatics and Information Technologies – CIIT 2022.
- Bernt. Bratsberg. Ole. Rogeberg. Flynn effect and its reversal are both environmentally caused. Proceedings of the National Academy of Sciences. 26 June 2018. 0027-8424. 6674–6678. 115. 26. 29891660. 6042097. 10.1073/pnas.1718793115. free .
- Vincent . Ken R. . March 1991 . Black/white IQ differences: Does age make the difference? . Journal of Clinical Psychology . 47 . 2 . 266–270 . 10.1002/1097-4679(199103)47:2<266::aid-jclp2270470213>3.0.co;2-s . 2030133 .
- Neisser, Ulric (Ed). 1998. The rising curve: Long-term gains in IQ and related measures. Washington, DC, US: American Psychological Association
- Dickens . William T . Flynn . James R . 2006 . Black Americans Reduce the Racial IQ Gap: Evidence from Standardization Samples . dead . Psychological Science . 17 . 10 . 913–20 . 10.1.1.186.2540 . 10.1111/j.1467-9280.2006.01802.x . 17100793 . 6593169 . https://web.archive.org/web/20091009095003/http://www.brookings.edu/views/papers/dickens/20060619_IQ.pdf . 2009-10-09 .
- Book: Mackintosh, N. J. . Nicholas Mackintosh. IQ and Human Intelligence . Oxford University Press . 2011 . 978-0-19-958559-5 . second . Oxford.
- Nisbett . Richard E. . Aronson . Joshua . Blair . Clancy . Dickens . William . Flynn . James . Halpern . Diane F. . Turkheimer . Eric . 2012a . Intelligence: new findings and theoretical developments . American Psychologist . 67 . 130–159 . 10.1037/a0026699 . 0003-066X . 22233090 . 22 July 2013 . 2 . November 8, 2020 . https://web.archive.org/web/20201108132004/http://people.virginia.edu/~ent3c/papers2/nisbett2012int.pdf.
- Web site: Dan . Willingham . The latest on intelligence . Daniel Willingham—Science & Education . 10 May 2012.
- 10.1016/j.intell.2010.05.001 . Flynn . J.R. . The spectacles through which I see the race and IQ debate . Intelligence . 38 . 4 . 363–66 . 2010 .
- Wicherts . Jelte M. . Dolan . Conor V. . Hessen . David J. . Oosterveld . Paul . van Baal . G. Caroline M. . Boomsma . Dorret I. . Span . Mark M. . 2004 . Are intelligence tests measurement invariant over time? Investigating the nature of the Flynn effect . Intelligence . 32 . 5 . 509–537 . 10.1016/j.intell.2004.07.002 . It appears therefore that the nature of the Flynn effect is qualitatively different from the nature of B–W differences in the United States. Each comparison of groups should be investigated separately. IQ gaps between cohorts do not teach us anything about IQ gaps between contemporary groups, except that each IQ gap should not be confused with real (i.e., latent) differences in intelligence..
- 10.1037/0003-066X.54.1.5 . Searching for justice: the discovery of IQ gains over time . 1999 . Flynn . J.R. . American Psychologist . 54. 5–9 . 26 October 2017 . 25 June 2010 . https://web.archive.org/web/20100625085640/http://www.stat.columbia.edu/~gelman/stuff_for_blog/flynn.pdf . live.