William Sanders (statistician) explained

William L. Sanders (26 April 1942[1] – 16 March 2017) was an American statistician, a senior research fellow with the University of North Carolina at Chapel Hill. He developed the Tennessee Value-Added Assessment System (TVAAS), also known as the Educational Value-Added Assessment System (EVAAS), a method for measuring a teacher's effect on student performance by tracking the progress of students against themselves over the course of their school career with their assignment to various teachers' classes.

Life

Sanders was born in 1942 in Shelbyville, Tennessee and received a bachelor of science degree in animal science (1964) and a doctorate in statistics and quantitative genetics (1968) from the University of Tennessee. From 1972 to 2000, Sanders was a statistical consultant for the Institute of Agricultural Research, which is part of the UT system; he also was an adjunct professor in the school's College of Business. Sanders left the university to join the SAS Institute.[2]

In 2015, Sanders was awarded the James Bryant Conant Award.

He died on 16 March 2017 at the age of 74.[3]

Value-added assessment

Sanders's primary contributions, however, were in education. In 1982, Sanders happened upon a newspaper article about attempts by then-Governor Lamar Alexander to introduce merit pay for teachers, which raised questions as to the qualifications for merit. He sent a letter to the governor explaining a potential method, and while he did not use it, the idea was revived eight years later by Ned McWherter. The system depends on calculating expected versus actual growth trajectories for students as scored on standardized exams; these "value-added" scores fell into a bell curve. Tennessee began using the system in 1993, and it since has been adopted by a number of other school districts across the United States.[4] Sanders' approach has been used to support the theory that the quality of teachers is central to educational achievement.

The Pennsylvania and New Hampshire Departments of Education sponsor pilots, and the Iowa School Board Association sponsors his value-added work in that state. Battelle for Kids provides interpretation and use trainings for the SAS EVAAS services for the participating districts in Ohio.

"Using mixed model equations, TVAAS uses the covariance matrix from this multivariate, longitudinal data set to evaluate the impact of the educational system on student progress in comparison to national norms, with data reports at the district, school, and teacher levels."[5] The model focuses on academic gains rather than raw achievement scores.

Criticism

Dr. Ballou, in Lissitz (Ed.), 2005, "Value Added Models in Education: Theory and Applications," analyzed the TVAAS and determined that value added-assessment of teachers are fallible estimates of teacher contribution to student learning, stating that standard errors of value-added estimates are large. Author thinks that value added models are merely one useful tool that should be used as one of many assessments in a comprehensive system of evaluation.

Researchers from the RAND Corporation studied Dr. Sanders' method and determined that his approach does not satisfactorily account for bias, cautioning that non-educational effects may be attributed by mistake to teachers, with no way of effectively determining the magnitude of the error.[6] Ballou (2002) and Kupermintz (2003) further support this claim, claiming that non-educational factors have a noticeable impact on the evaluation of teachers despite efforts to account for them in the model.[7]

The use of merit pay based on VAM has been discredited in articles by Dan Pink[8] and more generally as a business practice in the Harvard Business Review.[9] The accuracy of VAM for evaluating individual teachers has been further discredited by the Economic Policy Institute[10] and by mathematician John Ewing.[11]

See also

Notes and References

  1. Web site: Dr. William "Bill" Sanders. 18 March 2017. The Tennessean. 22 May 2017.
  2. Web site: SAS. The man behind VAM: Bill Sanders honored for a lifetime of education service. 19 June 2015. Nadja. Young. 22 May 2017.
  3. News: The New York Times. 19 May 2017. 22 May 2017. The Little-Known Statistician Who Taught Us to Measure Teachers. Kevin. Carey.
  4. Web site: Using Student Progress To Evaluate Teachers: A Primer on Value-Added Models. Henry. Braun. ETS. 2005.
  5. Growth Models in Action: Selected Case Studies. Practical Assessment, Research and Evaluation. 10. 11. 2005. Jessica. Goldstein. Peter. Behuniak.
  6. Web site: RAND. Evaluating Value-Added Models for Teacher Accountability. Daniel F. McCaffrey . Daniel Koretz . J. R. Lockwood . Laura S. Hamilton . 2004.
  7. Web site: Contemporary Report . 2007-04-12 . https://web.archive.org/web/20070927063928/http://harcourtassessment.com/NR/rdonlyres/2C54ADBA-9959-4F82-82B3-8E65FB822088/0/ValueAdded.pdf . 2007-09-27 .
  8. News: As teacher merit pay spreads, one noted voice cries, 'It doesn't work'. Lyndsey. Layton. The Washington Post. 15 February 2012. 22 May 2017.
  9. Web site: Stop Tying Pay to Performance. Harvard Business Review. Bruno S. Frey . Margit Osterloh . Jan–Feb 2012. 22 May 2017.
  10. Problems with the Use of Student Test Scores to Evaluate Teachers. 29 August 2010. EPI Briefing Paper. Eva L. Baker . Paul E. Barton . Linda Darling-Hammond . Edward Haertel . Helen F. Ladd . Robert L. Linn . Diane Ravitch . Richard Rothstein . Richard J. Shavelson . Lorrie A. Shepard . 22 May 2017. https://web.archive.org/web/20160308004403/http://epi.3cdn.net/b9667271ee6c154195_t9m6iij8k.pdf. 8 March 2016. dmy-all.
  11. Notices of the AMS. Mathematical Intimidation: Driven by the Data. John. Ewing. May 2011. 22 May 2017.