Measurement dysfunction explained

Measurement dysfunction describes a situation or behavior where actual data metrics, statistics and especially their meaning (or communicated meaning), can become problematic due to misuse.^{[1] [2] [3]} Specifically, in areas such as Human Resources (Performance measurements^[4]), Technology (Safety^[5]), Finance or Health, measurement dysfunctionality are critical, as it can lead to negative outcomes, wrong predictions or forecasts.

Practices to avoid:^[6]

• Reward of wrong behavior (also persons who manipulate^[7])
• Measuring the wrong things
• Measuring either not enough or too much
• Cheating or data manipulation (intentional or unintentional due to wrong calculation models, systematic errors, human errors, etc.)

On eliminating dysfunctional measurement:^[8]

• Establish, and monitor the move to and adherence to ‘policies’ for good, functional measurement
• Support technical correctness
• Periodically evaluate the information need and value delivered by measurements

Trivia

"What gets measured gets manipulated."^{[9] [10]}

See also

• Measurement uncertainty
• Leadership
• Performance measurement
• Plagiarism
• OKR
• Corporate culture
• Verification and validation
• Scientific rigor

References

1. Web site: Presentations and Papers. 2021-02-22. www.osel.co.uk.
2. Book: Austin, Robert D.. Measuring and managing performance in organizations. 1996. Dorset House Publishing. Tom DeMarco, Timothy R. Lister. 0-932633-36-6. New York. 34798037.
3. Web site: Measurement Dysfunction. 2021-02-22. proactsafety.com.
4. Web site: Measurement Madness: Recognizing and Avoiding the Pitfalls of Performance Measurement Wiley. 2021-02-22. Wiley.com. en-us.
5. Book: Vincent, Charles, Dr. The measurement and monitoring of safety : drawing together academic evidence and practical experience to produce a framework for safety measurement and monitoring. 2013. Susan Burnett, Jane Carthey. 978-1-906461-44-7. London. 861644942.
6. Web site: When Measurement Goes Bad. 2021-02-22. www.amanet.org. en.
7. Web site: How to Spot and Stop Manipulators. 2021-02-22. Psychology Today. en-US.
8. Web site: Shelley. C. C.. October 2009. 2009. eXtreme Measurement: recognizing, understanding and avoiding measurement dysfunction. 2021-02-22. www.osel.co.uk. Oxford Software Engineering.
9. Book: https://www.taylorfrancis.com/chapters/gets-measured-gets-manipulated-sidney-dekker/e/10.4324/9780203733455-5. What gets measured, gets manipulated. 2017-10-19. Routledge. 978-0-203-73345-5. en. 10.4324/9780203733455-5. The Safety Anarchist. Dekker. Sidney. 75–98.
10. Web site: Managing the Unmanageable: More Rules of Thumb. 2021-02-22. www.managingtheunmanageable.net.