Statistics education explained

Statistics education is the practice of teaching and learning of statistics, along with the associated scholarly research.

Statistics is both a formal science and a practical theory of scientific inquiry, and both aspects are considered in statistics education. Education in statistics has similar concerns as does education in other mathematical sciences, like logic, mathematics, and computer science. At the same time, statistics is concerned with evidence-based reasoning, particularly with the analysis of data. Therefore, education in statistics has strong similarities to education in empirical disciplines like psychology and chemistry, in which education is closely tied to "hands-on" experimentation.

Mathematicians and statisticians often work in a department of mathematical sciences (particularly at colleges and small universities). Statistics courses have been sometimes taught by non-statisticians, against the recommendations of some professional organizations of statisticians and of mathematicians.

Statistics education research is an emerging field that grew out of different disciplines and is currently establishing itself as a unique field that is devoted to the improvement of teaching and learning statistics at all educational levels.

Goals of statistics education

Statistics educators have cognitive and noncognitive goals for students. For example, former American Statistical Association (ASA) President Katherine Wallman defined statistical literacy as including the cognitive abilities of understanding and critically evaluating statistical results as well as appreciating the contributions statistical thinking can make.[1] [2]

Cognitive goals

In the text rising from the 2008 joint conference of the International Commission on Mathematical Instruction and the International Association of Statistics Educators, editors Carmen Batanero, Gail Burrill, and Chris Reading (Universidad de Granada, Spain, Michigan State University, USA, and University of New England, Australia, respectively) note worldwide trends in curricula which reflect data-oriented goals. In particular, educators currently seek to have students: "design investigations; formulate research questions; collect data using observations, surveys, and experiments; describe and compare data sets; and propose and justify conclusions and predictions based on data."[3] The authors note the importance of developing statistical thinking and reasoning in addition to statistical knowledge.

Despite the fact that cognitive goals for statistics education increasingly focus on statistical literacy, statistical reasoning, and statistical thinking rather than on skills, computations and procedures alone, there is no agreement about what these terms mean or how to assess these outcomes. A first attempt to define and distinguish between these three terms appears in the ARTIST website[4] which was created by Garfield, delMas and Chance and has since been included in several publications.[5] [6] Brief definitions of these terms are as follows:

  1. Statistical literacy is being able to read and use basic statistical language and graphical representations to understand statistical information in the media and in daily life.
  2. Statistical reasoning is being able to reason about and connect different statistical concepts and ideas, such as knowing how and why outliers affect statistical measures of center and variability.
  3. Statistical thinking is the type of thinking used by statisticians when they encounter a statistical problem. This involves thinking about the nature and quality of the data and, where the data came from, choosing appropriate analyses and models, and interpreting the results in the context of the problem and given the constraints of the data.

Further cognitive goals of statistics education vary across students' educational level and the contexts in which they expect to encounter statistics.

Statisticians have proposed what they consider the most important statistical concepts for educated citizens. For example, Utts (2003) published seven areas of what every educated citizen should know, including understanding that "variability is normal" and how "coincidences… are not uncommon because there are so many possibilities."[7] Gal (2002) suggests adults in industrialized societies are expected to exercise statistical literacy, "the ability to interpret and critically evaluate statistical information… in diverse contexts, and the ability to… communicate understandings and concerns regarding the… conclusions."[8]

Non-cognitive goals

Non-cognitive outcomes include affective constructs such as attitudes, beliefs, emotions, dispositions, and motivation.[9] According to prominent researchers Gal & Ginsburg,[10] statistics educators should make it a priority to be aware of students' ideas, reactions, and feelings towards statistics and how these affect their learning.

Beliefs

Beliefs are defined as one's individually held ideas about statistics, about oneself as a learner of statistics, and about the social context of learning statistics.[11] Beliefs are distinct from attitudes in the sense that attitudes are relatively stable and intense feelings that develop over time in the context of experiences learning statistics. Students' web of beliefs provides a context for their approach towards their classroom experiences in statistics. Many students enter a statistics course with apprehension towards learning the subject, which works against the learning environment that the instructor is trying to accomplish. Therefore, it is important for instructors to have access to assessment instruments that can give an initial diagnosis of student beliefs and monitor beliefs during a course.[10] Frequently, assessment instruments have monitored beliefs and attitudes together. For examples of such instruments, see the attitudes section below.

Dispositions

Disposition has to do with the ways students question the data and approach a statistical problem. Dispositions is one of the four dimensions in Wild and Pfannkuch's[12] framework for statistical thinking, and contains the following elements:

Scheaffer states that a goal of statistics education is to have students see statistics broadly. He developed a list of views of statistics that can lead to this broad view, and describes them as follows:[13]

Attitudes

Since students often experience math anxiety and negative opinions about statistics courses, various researchers have addressed attitudes and anxiety towards statistics. Some instruments have been developed to measure college students' attitudes towards statistics, and have been shown to have appropriate psychometric properties. Examples of such instruments include:

Careful use of instruments such as these can help statistics instructors to learn about students' perception of statistics, including their anxiety towards learning statistics, the perceived difficulty of learning statistics, and their perceived usefulness of the subject.[17] Some studies have shown modest success at improving student attitudes in individual courses,[18] [19] but no generalizable studies showing improvement in student attitudes have been seen.

Nevertheless, one of the goals of statistics education is to make the study of statistics a positive experience for students and to bring in interesting and engaging examples and data that will motivate students. According to a fairly recent literature review,[17] improved student attitudes towards statistics can lead to better motivation and engagement, which also improves cognitive learning outcomes.

Primary–secondary education level

New Zealand

In New Zealand, a new curriculum for statistics has been developed by Chris Wild and colleagues at Auckland University. Rejecting the contrived, and now unnecessary due to computer power, approach of reasoning under the null and the restrictions of normal theory, they use comparative box plots and bootstrap to introduce concepts of sampling variability and inference.[20] The developing curriculum also contains aspects of statistical literacy.

United Kingdom

In the United Kingdom, at least some statistics has been taught in schools since the 1930s.[21] [22] At present, A-level qualifications (typically taken by 17- to 18-year-olds) are being developed in "Statistics" and "Further Statistics". The coverage of the former includes: Probability; Data Collection; Descriptive Statistics; Discrete Probability Distributions; Binomial Distribution; Poisson Distributions; Continuous Probability Distributions; The Normal Distribution; Estimation; Hypothesis Testing; Chi-Squared; Correlation and Regression. The coverage of "Further Statistics" includes: Continuous Probability Distributions; Estimation; Hypothesis Testing; One Sample Tests; Hypothesis Testing; Two Sample Tests; Goodness of Fit Tests; Experimental Design; Analysis of Variance (Anova); Statistical Process Control; Acceptance Sampling. The Centre for Innovation in Mathematics Teaching (CIMT)[23] has online course notes for these sets of topics.[24] Revision notes for an existing qualification[25] indicate a similar coverage. At an earlier age (typically 15–16 years) GCSE qualifications in mathematics contain "Statistics and Probability" topics on: Probability; Averages; Standard Deviation; Sampling; Cumumulative Frequency Graphs (including median and quantiles); Representing Data; Histograms.[26] The UK's Office for National Statistics has a webpage[27] leading to material suitable for both teachers and students at school level. In 2004 the Smith inquiry made the following statement:

"There is much concern and debate about the positioning of Statistics and Data Handling within the current mathematics GCSE, where it occupies some 25 per cent of the timetable allocation. On the one hand, there is widespread agreement that the Key Stage 4 curriculum is over-crowded and that the introduction of Statistics and Data Handling may have been at the expense of time needed for practising and acquiring fluency in core mathematical manipulations. Many in higher education mathematics and engineering departments take this view. On the other hand, there is overwhelming recognition, shared by the Inquiry, of the vital importance of Statistics and Data Handling skills both for a number of other academic disciplines and in the workplace. The Inquiry recommends that there be a radical re-look at this issue and that much of the teaching and learning of Statistics and Data Handling would be better removed from the mathematics timetable and integrated with the teaching and learning of other disciplines (e.g. biology or geography). The time restored to the mathematics timetable should be used for acquiring greater mastery of core mathematical concepts and operations."[28]

United States

In the United States, schooling has increased the use of probability and statistics, especially since the 1990s.[29] Summary statistics and graphs are taught in elementary school in many states. Topics in probability and statistical reasoning are taught in high school algebra (or mathematical science) courses; statistical reasoning has been examined in the SAT test since 1994. The College Board has developed an Advanced Placement course in statistics, which has provided a college-level course in statistics to hundreds of thousands of high school students, with the first examination happening in May 1997.[30] In 2007, the ASA endorsed the Guidelines for Assessment and Instruction in Statistics Education (GAISE), a two-dimensional framework for the conceptual understanding of statistics in Pre-K-12 students. The framework contains learning objectives for students at each conceptual level and provides pedagogical examples that are consistent with the conceptual levels.

Estonia

Estonia is piloting a new statistics curriculum developed by the Computer-Based Math foundation based around its principles of using computers as the primary tool of education.[31] [32] [33] in cooperation with the University of Tartu.[34]

University level

General

Statistics is often taught in departments of mathematics or in departments of mathematical sciences. At the undergraduate level, statistics is often taught as a service course.

United Kingdom

By tradition in the U.K., most professional statisticians are trained at the Master level. A difficulty of recruiting strong undergraduates has been noted: "Very few undergraduates positively choose to study statistics degrees; most choose some statistics options within a mathematics programme, often to avoid the advanced pure and applied mathematics courses. My view is that statistics as a theoretical discipline is better taught late rather than early, whereas statistics as part of scientific methodology should be taught as part of science."

In the United Kingdom, the teaching of statistics at university level was originally done within science departments that needed the topic to accompany the teaching of their own subjects, and departments of mathematics had limited coverage before the 1930s.[21] For the twenty years subsequent to this, while departments of mathematics had started to teach statistics, there was little realisation that essentially the same basic statistical methodology was being applied across a variety of sciences.[21] Statistical departments have had difficulty when they have been separated from mathematics departments.

Psychologist Andy Field (British Psychological Society Teaching and Book Award) created a new concept of statistical teaching and textbooks that goes beyond the printed page.[35]

United States

Enrollments in statistics have increased in community colleges, in four-year colleges and universities in the United States. At community colleges in the United States, mathematics has experienced increased enrollment since 1990. At community colleges, the ratio of the students enrolled in statistics to those enrolled in calculus rose from 56% in 1990 to 82% in 1995.[36] One of the ASA-endorsed GAISE reports focused on statistics education at the introductory college level. The report includes a brief history of the introductory statistics course and recommendations for how it should be taught.

In many colleges, a basic course in "statistics for non-statisticians" has required only algebra (and not calculus); for future statisticians, in contrast, the undergraduate exposure to statistics is highly mathematical.[37] As undergraduates, future statisticians should have completed courses in multivariate calculus, linear algebra, computer programming, and a year of calculus-based probability and statistics. Students wanting to obtain a doctorate in statistics from "any of the better graduate programs in statistics" should also take "real analysis".[38] Laboratory courses in physics, chemistry and psychology also provide useful experiences with planning and conducting experiments and with analyzing data. The ASA recommends that undergraduate students consider obtaining a bachelor's degree in applied mathematics as preparation for entering a master program in statistics.[39]

Historically, professional degrees in statistics have been at the Master level, although some students may qualify to work with a bachelor's degree and job-related experience or further self-study.[40] Professional competence requires a background in mathematics—including at least multivariate calculus, linear algebra, and a year of calculus-based probability and statistics.[41] In the United States, a master program in statistics requires courses in probability, mathematical statistics, and applied statistics (e.g., design of experiments, survey sampling, etc.).

For a doctoral degree in statistics, it has been traditional that students complete a course in measure-theoretic probability as well as courses in mathematical statistics. Such courses require a good course in real analysis, covering the proofs of the theory of calculus and topics like the uniform convergence of functions.[38] [42] In recent decades, some departments have discussed allowing doctoral students to waive the course in measure-theoretic probability by demonstrating advanced skills in computer programming or scientific computing.[43]

Who should teach statistics?

The question of what qualities are needed to teach statistics has been much discussed, and sometimes this discussion is concentrated on the qualifications necessary for those undertaking such teaching. The question arises separately for teaching at both school and university levels, partly because of the need for numerically more such teachers at school level and partly because of need for such teachers to cover a broad range of other topics within their overall duties. Given that "statistics" is often taught to non-scientists, opinions can range all the way from "statistics should be taught by statisticians", through "teaching of statistics is too mathematical" to the extreme that "statistics should not be taught by statisticians".

Teaching at university level

In the United States especially, statisticians have long complained that many mathematics departments have assigned mathematicians (without statistical competence) to teach statistics courses, effectively giving "double blind" courses. The principle that college-instructors should have qualifications and engagement with their academic discipline has long been violated in United States colleges and universities, according to generations of statisticians. For example, the journal Statistical Science reprinted "classic" articles on the teaching of statistics by non-statisticians by Harold Hotelling;[44] [45] [46] Hotelling's articles are followed by the comments of Kenneth J. Arrow, W. Edwards Deming, Ingram Olkin, David S. Moore, James V. Sidek, Shanti S. Gupta, Robert V. Hogg, Ralph A. Bradley, and by Harold Hotelling, Jr. (an economist and son of Harold Hotelling).

Data on the teaching of statistics in the United States has been collected on behalf of the Conference Board of the Mathematical Sciences (CBMS). Examining data from 2000, Schaeffer and Stasny[47] reported

By far the majority of instructors within statistics departments have at least a master’s degree in statistics or biostatistics (about 89% for doctoral departments and about 79% for master’s departments). In doctoral mathematics departments, however, only about 58% of statistics course instructors had at least a master’s degree in statistics or biostatistics as their highest degree earned. In master’s-level mathematics departments, the corresponding percentage was near 44%, and in bachelor’s-level departments only 19% of statistics course instructors had at least a master’s degree in statistics or biostatistics as their highest degree earned. As we expected, a large majority of instructors in statistics departments (83% for doctoral departments and 62% for master’s departments) held doctoral degrees in either statistics or biostatistics. The comparable percentages for instructors of statistics in mathematics departments were about 52% and 38%.
The principle that statistics-instructors should have statistical competence has been affirmed by the guidelines of the Mathematical Association of America, which has been endorsed by the ASA. The unprofessional teaching of statistics by mathematicians (without qualifications in statistics) has been addressed in many articles.[48] [49]

Teaching methods

See also: Mathematics education, Pedagogy and Didactics.

The literature on methods of teaching statistics is closely related to the literature on the teaching of mathematics for two reasons. First, statistics is often taught as part of the mathematics curriculum, by instructors trained in mathematics and working in a mathematics department. Second, statistical theory has often been taught as a mathematical theory rather than as the practical logic of science --- as the science that "puts chance to work" in Rao's phrase--- and this has entailed an emphasis on formal and manipulative training, such as solving combinatorial problems involving red and green jelly beans. Statisticians have complained that mathematicians are prone to over-emphasize mathematical manipulations and probability theory and under-emphasize questions of experimentation, survey methodology, exploratory data analysis, and statistical inference.[50]

Notes and References

  1. Wallman, K.S. . Enhancing statistical literacy: Enriching our society . . 88 . 421 . 1–8 . 1993 . 2290686 . 10.1080/01621459.1993.10594283.
  2. Bond, M.E. . Perkins, S.M. . Ramirez, C. . Students' Perceptions of Statistics: An Exploration of Attitudes, Conceptualizations, and Content Knowledge of Statistics . Statistics Education Research Journal . 11 . 2 . 6–25 . 2012 . 10.52041/serj.v11i2.325 . 140436759 .
  3. Book: Carmen . Batanero . Gail F. . Burrill . Chris . Reading . Teaching Statistics in School Mathematics—Challenges for Teaching and Teacher Education: A Joint ICMI/IASE Study: The 18th ICMI Study . 2011 . Springer . 978-94-007-1131-0 .
  4. Web site: Assessment Resource Tools for Improving Statistical Thinking – Home Page . 2013-02-28 .
  5. [Joan Garfield|Garfield, J.]
  6. [Joan Garfield|Garfield, J.]
  7. Utts, J. . What educated citizens should know about statistics and probability . . 57 . 2 . 74–79 . 2003 . 10.1198/0003130031630 . 10.1.1.193.2420 . 14289727 .
  8. Gal, I. . Adults' statistical literacy: Meanings, components, responsibilities . . 70 . 1 . 1–25 . 2002 . 10.1111/j.1751-5823.2002.tb00336.x . 122781003 .
  9. Book: Bloom, Benjamin Samuel . Taxonomy of educational objectives: the classification of educational goals. Handbook I, Cognitive domain . 1956 . David McKay . 9780582323865 . 220283628 .
  10. Gal, I. . Ginsburg, L. . The role of beliefs and attitudes in learning statistics: towards an assessment framework . Journal of Statistics Education . 2 . 2 . November 1994 . 10.1080/10691898.1994.11910471. free .
  11. Book: Monitoring attitudes and beliefs in statistics education . Iddo . Gal . Joan B. . Garfield. Joan Garfield . Y. . Gal . The Assessment Challenge in Statistics Education . https://books.google.com/books?id=xxdJgnFzNRsC&pg=PA37 . 1997 . IOS Press . 978-90-5199-333-2 . 37–51.
  12. Wild, C.J. . Pfannkuch, M.. Maxine Pfannkuch . Statistical thinking in empirical enquiry . International Statistical Review . 67 . 3 . 223–265 . 1999 . 10.1111/j.1751-5823.1999.tb00442.x . 17076878 .
  13. Scheaffer, R. . Statistics education: perusing the past, embracing the present, and charting the future . Newsletter for the Section on Statistical Education . 7 . 1 . 2001 .
  14. Schau, C. . Stevens, J. . Dauphinee, T. . Del Vecchio, A. . The development and validation of the Survey of Attitudes Toward Statistics . Educational and Psychological Measurement . 55 . 5 . 868–876 . 1995 . 10.1177/0013164495055005022 . 145141281 .
  15. Wise, S.L. . The development and validation of a scale measuring attitudes toward statistics . Educational and Psychological Measurement . 45 . 2 . 401–5 . 1985 . 10.1177/001316448504500226 . 142923582 .
  16. Roberts, D. . Bilderback, W. . Reliability and Validity of a Statistics Attitude Survey . Educational and Psychological Measurement . 40 . 1 . 235–8 . April 1980 . 10.1177/001316448004000138 . 145497772 .
  17. Zieffler, A. . Garfield, J. . Joan Garfield. Alt, S. . Dupuis, D. . Holleque, K. . Chang, B. . What does research suggest about the teaching and learning of introductory statistics at the college level? A review of the literature . Journal of Statistics Education . 16 . 2 . 2008 . 10.1080/10691898.2008.11889566. 118200782 . free .
  18. Harlow, L.L. . Burkholder, G.J. . Morrow, J.A. . Evaluating attitudes, skill and performance in a learning-enhanced quantitative methods course: A structural modelling approach . Structural Equation Modeling . 9 . 3 . 413–430 . 2002 . 10.1207/S15328007SEM0903_6 . 143847777 .
  19. Carlson, K.A. . Winquist, J.R. . Evaluating an active learning approach to teaching introductory statistics: A classroom workbook approach . Journal of Statistics Education . 19 . 1 . 2011 . 10.1080/10691898.2011.11889596. 122759663 . free .
  20. Wild, C.J. . Pfannkuch, M. . Regan, M. . Horton, N.J. . Towards more accessible conceptions of statistical inference . . 174 . 2 . 247–295 . 2011 . 10.1111/j.1467-985X.2010.00678.x . free .
  21. Conway, F. . Statistics in schools . . 149 . 1 . 60–64 . 1986 . 2981885. 10.2307/2981885 .
  22. Holmes, P. . 50 years of statistics teaching in English schools: some milestones (with discussion) . . 52 . 4 . 439–474 . 2003 . 10.1046/j.1467-9884.2003.372_1.x .
  23. Web site: CIMT – Page no longer available at Plymouth University servers.
  24. http://www.cimt.plymouth.ac.uk/projects/mepres/alevel/alevel.htm CIMT A-level course notes
  25. http://www.mathsrevision.net/alevel/statistics/ mathsrevision.net A-level notes
  26. http://www.mathsrevision.net/gcse/index.php matherevision.net GCSE maths notes
  27. http://www.stats4schools.gov.uk/ ONS stats4schools teacher/student resources
  28. Book: Smith, Adrian. Adrian Smith (academic)

    . Making Mathematics Count: The Report of Professor Adrian Smith's Inquiry into Post-14 Mathematics Education . 2004 . Adrian Smith (academic) . London, England . The Stationery Office. 2/04 937764 .

  29. In the United States, there was a "wide growth of statistical training in grades K-12, led by the implementation of an Advanced Placement (AP) course in statistics." p. 403 in 10.1214/088342304000000404 . A Report on the Future of Statistics . Bruce G. . Lindsay. Jon. Kettenring. David O. . Siegmund. Statistical Science. 19. 3 . August 2004. 387–407 . 4144386. 2185624. free.
  30. Page 403 in 10.1214/088342304000000404 . A Report on the Future of Statistics . Bruce G. . Lindsay. Jon. Kettenring. David O. . Siegmund. Statistical Science. 19. 3 . August 2004. 387–407 . 4144386 . 2185624. free.
  31. https://blogs.wsj.com/tech-europe/2013/02/11/estonian-schools-to-teach-computer-based-math/ Estonian Schools to Teach Computer-Based Math
  32. https://www.wired.com/wiredenterprise/2013/02/computer-based-math-in-estonia/ Math Rebels Invade Estonia With Computerized Education
  33. http://news.err.ee/education/34fea787-9203-4811-9f5a-eb62ad8567e5 Estonia Chosen as Testing Ground for Math Education Experiment
  34. http://news.postimees.ee/1135472/estonian-british-experts-team-up-to-develop-computer-based-math-education Estonian, British experts team up to develop computer-based math education
  35. http://newsbreaks.infotoday.com/NewsBreaks/SAGE-Strikes-Gold-with-Andy-Fields-New-Statistics-TextbookEbook-88546.asp SAGE Strikes Gold with Andy Field’s New Statistics Textbook/Ebook
  36. Page 616 in 10.2307/2589117 . Statistics and Mathematics: Tension and Cooperation . Cobb . George W. . Moore . David S. . David S. Moore . The American Mathematical Monthly . 107 . 7 –September . August 2000. 615–630 . 2589117. 1543690. 10.1.1.422.4356 .
  37. "Undergraduate major programs should include study of probability and statistical theory, along with the prerequisite mathematics, especially calculus and linear algebra. Programs for nonmajors may require less study of mathematics. Programs preparing for graduate work may require additional mathematics." Web site: Curriculum Guidelines for Undergraduate Programs in Statistical Science . American Statistical Association . 2010-05-14 . American Statistical Association .
  38. Page 622 in 10.2307/2589117 . Statistics and Mathematics: Tension and Cooperation . Cobb . George W. . Moore . David S. . David S. Moore . The American Mathematical Monthly . 107 . 7 . August 2000. 615–630 . 2589117 . 1543690. 10.1.1.422.4356 .
  39. The ASA makes the following recommendations for undergraduates wishing to become statisticians: "Major in applied mathematics, or a closely related field. If you do major in a nonstatistical field, minor in mathematics or statistics. Develop a background in mathematics, science, and computers and gain knowledge in a specific field of interest. A master's degree or PhD is very helpful and often recommended or required for higher-level positions." Web site: How Do I Become a Statistician? . American Statistical Association . 2010-05-14 . American Statistical Association .
  40. "A master's degree or PhD is very helpful and often recommended or required for higher-level positions." Web site: How Do I Become a Statistician? . American Statistical Association . 2010-05-14 . American Statistical Association .
  41. Web site: Curriculum Guidelines for Undergraduate Programs in Statistical Science . American Statistical Association . 2010-05-14 . American Statistical Association .
  42. Terry Speed. Terry. Speed. A Dialogue (Terence's Stuff). IMS Bulletin. November 2009. 38 . 9 . 14 . 1544-1881 .
  43. Stanford University statistician Persi Diaconis wrote that "I see a strong trend against measure theory in modern statistics departments: I had to fight to keep the measure theory requirement in Stanford's statistics graduate program. The fight was lost at Berkeley." A Frequentist does this, a Bayesian that (Review of Probability Theory: The Logic of Science by E.T. Jaynes) . Persi Diaconis . Persi . Diaconis . SIAM News . March 2004 . 14 May 2010 . https://web.archive.org/web/20071007204931/http://www.siam.org/news/news.php?id=81 . 7 October 2007 . dead .
  44. 10.1214/aoms/1177731833. The Teaching of Statistics . Harold Hotelling. The Annals of Mathematical Statistics. 11. 4. Dec 1940. 457–470. 2235726. Harold Hotelling . free.
  45. Golden Oldies: Classic Articles from the World of Statistics and Probability: 'The Teaching of Statistics'. Harold Hotelling. Statistical Science. 3 . 1 . 1988 . 63–71 . 10.1214/ss/1177013001. Harold Hotelling. free.
  46. Golden Oldies: Classic Articles from the World of Statistics and Probability: 'The Place of Statistics in the University'. Harold Hotelling. Statistical Science. 3 . 1 . 1988 . 72–83. 10.1214/ss/1177013002. Harold Hotelling. free.
  47. The State of Undergraduate Education in Statistics: A Report from the CBMS. Scheaffer, Richard L. Scheaffer . Stasny, Elizabeth A . amp . The American Statistician. 58. 4 . November 2004. 265–271. 10.1198/000313004X5770. Conference Board of the Mathematical Sciences . 123312251 .
  48. 10.2307/2686686. Should Mathematicians Teach Statistics? . Moore, David S. David S. Moore . The College Mathematics Journal. 19. 1. Jan 1988. 3–7. 2686686.
  49. 10.2307/2975286 . Mathematics, Statistics, and Teaching . Cobb . George W. . David S. Moore . Moore . David S. . The American Mathematical Monthly. 104. 9. November 1997. 801–823 . 2975286.
  50. Hotelling. Cobb and Moore.