David Hand (statistician) explained

David Hand
Birth Name:	David John Hand
Birth Date:	30 June 1950
Birth Place:	Peterborough, England
Fields:	Statistics Machine learning Data mining Data science Big data
Workplaces:	Open University Imperial College London Winton Capital Management
Alma Mater:	University of Oxford (BA) University of Southampton (PhD)
Thesis Title:	The Classification of Incomplete Vectors
Thesis Year:	1977
Thesis Url:	https://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.458058
Awards:	Guy Medal (2002) George Box Medal (2016)

David John Hand (born 30 June 1950 in Peterborough)^[1] is a British statistician. His research interests include multivariate statistics, classification methods, pattern recognition, computational statistics and the foundations of statistics.^[2] He has written technical books on statistics, data mining, finance, classification methods, and measuring wellbeing, as well as science popularisation books including The Improbability Principle: Why Coincidences, Miracles, and Rare Events Happen Every Day; Dark Data: Why What You Don't Know Matters; and Statistics: A Very Short Introduction. In 1991 he launched the journal Statistics and Computing.

Education

Hand was educated at the University of Oxford and the University of Southampton where he was awarded a PhD in 1977^[3] for research supervised by .

Career and research

Hand served as professor of statistics at the Open University from 1988 until 1999, when he moved to Imperial College London, where he is now Emeritus Professor of Mathematics. Between 2010 and 2018 he took an extended sabbatical to serve as chief scientific advisor at Winton Capital Management. He served as president of the Royal Statistical Society from 2008 to 2009, then again in 2010 after Bernard Silverman stood down.^[4]

Books

Hand has published 31 books, inter alia:

• 2001. Principles of Data Mining^[5]
• 2007. Measurement Theory and Practice: the World Through Quantification ^[6]
• 2014. (with Paul Allin). The Wellbeing of Nations: Meaning, Motive and Measurement. Wiley.^[7]
• 2014. The Improbability Principle: Why Coincidences, Miracles and Rare Events Happen All the Time^[8]
• 2020. From GDP to Sustainable Wellbeing: Changing Statistics or Changing Lives? ^[9]
• 2020. Dark Data: Why What You Don't Know Matters^[10]

Articles

Hand has published over 300 scientific articles, inter alia:

• Hand D.J. and Henley W.E. (1997) Statistical classification methods in consumer credit scoring: a review. Journal of the Royal Statistical Society, Series A, 160, 523-541^[11]
• Hand D.J., Blunt G., Kelly M.G., and Adams N.M. (2000) Data mining for fun and profit. Statistical Science, 15, 111-131^[12]
• Hand D.J. and Yu K. (2001) Idiot's Bayes - not so stupid after all? International Statistical Review, 69, 385-398^[13]
• Bolton R.J. and Hand D.J. (2002) Statistical fraud detection: a review. Statistical Science, 17, 235-255 ^[14]
• Hand D.J. (2006) Classifier technology and the illusion of progress (with discussion). Statistical Science, 21, 1-34^[15]
• 2008. Top 10 algorithms in data mining^[16]
• Hand D.J. (2009) Measuring classifier performance: a coherent alternative to the area under the ROC curve. Machine Learning, 77, 103-123^[17]
• Hand D.J. (2018) Statistical challenges of administrative and transaction data (with discussion). Journal of the Royal Statistical Society, Series A, 181, 555-605^[18]

Awards and honours

Hand has received various awards for his work, including being elected Honorary Fellow of the Institute of Actuaries in 1999, the Guy Medal in Silver of the Royal Statistical Society in 2002, the IEEE ICDM Outstanding Contributions Award in 2004, the Credit Collections and Risk Award for Contributions to the Credit Industry in 2012, the George Box Medal for Business and Industrial Statistics in 2016, and the International Federation of Classification Societies Research Medal in 2019. He was appointed Officer of the Order of the British Empire (OBE) in the 2013 New Year Honours for services to research and innovation.^[19] He was elected a Fellow of the British Academy (FBA) in 2003.^[1]

In April 2013 until June 2021 he served on the board of the board of the UK Statistics Authority as a non-executive director^[20] and served on the European Statistical Advisory Committee, advising the European Commission from 2016 to 2021. He chaired the Administrative Data Research Network from 2014 to 2017 and serves on many other advisory committees, including chairing the Advisory Board of the ONS's Centre for Applied Data Ethics and the National Statistician's Expert User Advisory Committee.

Notes and References

1. http://www.debretts.com/people/biographies/browse/h/23232/David%20John+HAND.aspx Prof David Hand Authorised Biography
2. Web site: Professor David Hand. Imperial College London. 27 January 2011.
3. PhD. University of Southampton. David John. Hand. 1977. . 1116600745.
4. Web site: Past President . 27 January 2011 . The Royal Statistical Society. . dead . https://web.archive.org/web/20120317044817/http://www.rss.org.uk/site/cms/contentviewarticle.asp?article=486 . 17 March 2012 .
5. (with Mannila H. and Smyth P). Principles of Data Mining. MIT Press.
6. Measurement Theory and Practice: the World Through Quantification. Wiley,
7. (with Paul Allin). The Wellbeing of Nations: Meaning, Motive and Measurement. Wiley.
8. The Improbability Principle: Why Coincidences, Miracles and Rare Events Happen All the Time. Farrar Straus Giroux.
9. 2020. (with Paul Allin) From GDP to Sustainable Wellbeing: Changing Statistics or Changing Lives? Palgrave Macmillan,
10. Dark Data: Why What You Don’t Know Matters
11. Statistical Classification Methods in Consumer Credit Scoring: A Review . 2983268 . Hand . D. J. . Henley . W. E. . Journal of the Royal Statistical Society. Series A (Statistics in Society) . 1997 . 160 . 3 . 523–541 . 10.1111/j.1467-985X.1997.00078.x . 18547380 .
12. Data Mining for Fun and Profit . 2676725 . Hand . David J. . Blunt . Gordon . Kelly . Mark G. . Adams . Niall M. . Statistical Science . 2000 . 15 . 2 . 111–126 .
13. Idiot's Bayes: Not So Stupid after All? . 1403452 . Hand . David J. . Yu . Keming . International Statistical Review / Revue Internationale de Statistique . 2001 . 69 . 3 . 385–398 . 10.2307/1403452 .
14. 10.1214/ss/1042727940 . Statistical Fraud Detection: A Review . 2002 . Bolton . Richard J. . Hand . David J. . Statistical Science . 17 . 3 . free .
15. 10.1214/088342306000000060 . Classifier Technology and the Illusion of Progress . 2006 . Hand . David J. . Statistical Science . 21 . 16325617 . free .
16. with Ross Quinlan, Qiang Yang, Philip S. Yu and Zhou Zhihua et al.. Knowledge and Information Systems 14.1: 1-37
17. 10.1007/s10994-009-5119-5 . Measuring classifier performance: A coherent alternative to the area under the ROC curve . 2009 . Hand . David J. . Machine Learning . 77 . 103–123 . 207211591 . free . 10044/1/18420 . free .
18. 10.1111/rssa.12315 . Statistical challenges of administrative and transaction data . 2018 . Hand . David J. . Journal of the Royal Statistical Society, Series A (Statistics in Society) . 181 . 3 . 555–605 . 126301517 . free . 10044/1/61527 . free .
19. Web site: New Year Honours List 2013 - General List . Cabinet Office . 29 December 2012.
20. Web site: Appointments to the Board of the UK Statistics Authority Imperial News Imperial College London. Imperial News. 7 June 2019.