Gary A. Klein Explained

Gary Klein
Birth Date:	February 5, 1944
Birth Place:	New York City, New York, U.S.
Education:	B.A. in Psychology, Ph.D. in Experimental Psychology
Occupation:	Research Psychologist
Spouse:	Helen Klein (deceased)

Gary Klein (born February 5, 1944, in New York City, New York, U.S.) is a research psychologist famous for pioneering in the field of naturalistic decision making.^[1] By studying experts such as firefighters in their natural environment, he discovered that laboratory models could not adequately describe decision making under time pressure and uncertainty. His recognition-primed decision (RPD) model has influenced changes in the ways the Marines and Army train their officers to make decisions.^[2] The concept of expertise has been central to the models he has developed, the research he has conducted, and the training and design efforts he has accomplished.

Klein received his B.A. in psychology from City College of New York (1964) and his Ph.D. in Experimental Psychology from the University of Pittsburgh (1969). He listed his main influences as Hubert Dreyfus, Adriaan de Groot, and Karl Duncker in an October 2013 interview with Bob Morris.^[3]

Since 2009, Klein has been a Senior Scientist at MacroCognition LLC.^[4]

He spent the first phase of his career in academia as an assistant professor of psychology at Oakland University (1970–1974). He also spent a few years as associate professor of psychology at Wilberforce University in Ohio.

The second phase was spent working for the government as a research psychologist for the U.S. Air Force (1974–1978). The Arab oil embargo of 1973 meant that pilots needed to do more of their training in simulators, and Klein began his investigations into the way people develop expertise.

The third phase began in 1978 when he founded his own R&D company, Klein Associates, to study a range of topics that are now described as the Naturalistic Decision Making framework.^[5] Klein Associates grew to 37 people by the time he sold it to Applied Research Associates (ARA) in 2005.

During this third phase, Dr. Klein developed a Recognition-Primed Decision (RPD) model in 1985 to describe how people actually make decisions in natural settings. This research was subsequently incorporated in Army doctrine for command and control.^[6] He presented a PreMortem method of risk assessment in 1998.^[7] In 2007, he developed a naturalistic model of sensemaking, the Data/Frame model. In 2009, he presented a Management by Discovery account of how people plan when faced with ill-defined goals. He described a multi-path model of insight in 2011. He has led teams that developed several methods of cognitive task analysis for uncovering the tacit knowledge that goes into decision making and for studying cognition in complex settings, including the Critical Decision Method and the Knowledge Audit. He was one of the leaders of a team that redesigned the White House Situation Room.^[8] Dr. Klein and his colleagues have also developed the Artificial Intelligence Quotient (AIQ) toolkit, including the Cognitive Tutorial, to help people better manage specific AI systems they need to manage.

In 2015, Gary founded ShadowBox LLC, a cognitive skills training company. The ShadowBox Training Method originated from a Master's thesis in 2008, conducted by now-retired fire battalion chief, Neil Hintze. Gary and Neil worked together to refine this method for training cognitive skill development.^[9] The goal of the ShadowBox method is to provide a flexible, scenario-based training technique, that allows trainees to see the world through the eyes of experts — without the experts having to be present. Klein and others report that ShadowBox training has been employed in the military, law enforcement, healthcare, social services, and petrochemical domains.^[10]

He is a Fellow of both the American Psychological Association and the Human Factors and Ergonomics Society. In 2008, he received the Jack A. Kraft Innovator Award from the Human Factors and Ergonomics Society.^[11]

Publications

• Books
  • Sources of Power: How People Make Decisions. Cambridge, MA: MIT Press 1999
  • The Power of Intuition: How to Use Your Gut Feelings to Make Better Decisions at Work. Currency, 2004
  • Streetlights and Shadows: Searching for the Keys to Adaptive Decision Making. Cambridge, MA: MIT Press 2009
  • Working Minds: A Practitioner's Guide to Cognitive Task Analysis. Cambridge, MA: A Bradford Book 2006
  • Seeing What Others Don't: The Remarkable Ways We Gain Insights. New York, NY: Public Affairs 2013
  • Snapshots of the Mind. Cambridge, MA: MIT Press 2022
  • Ed. (with Judith Orasanu, and Roberta Calderwood) Decision Making in Action: Models and Methods Ablex, 1993
  • Ed. (with Eduardo Salas) Linking Expertise and Naturalistic Decision Making Erlbaum, 2001
  • Ed. (with Caroline Zsambok) Naturalistic Decision Making Erlbaum, 1996
• Selected articles in refereed journals
  • with Roberta Calderwood and Beth W. Crandall Time Pressure, Skill, and Move Quality in Chess The American Journal of Psychology, Vol. 101, No. 4 (Winter, 1988), 481–493
  • with Calderwood, R. and MacGregor, D. Critical decision method for eliciting knowledge Systems, Man and Cybernetics, IEEE Transactions on May/Jun 1989 Vol. 19, 3, 462–472
  • with Karen J. Peio Use of a Prediction Paradigm to Evaluate Proficient Decision Making The American Journal of Psychology, Vol. 102, No. 3 (Autumn, 1989), pp. 321–331
  • Klein, G., & Jarosz, A. (2011). A naturalistic study of insight. Journal of Cognitive Engineering and Decision Making, 5, 335–351.
  • Klein, G. (2011). Critical thoughts about critical thinking. Theoretical Issues in Ergonomics Science, 12:3, 210–224.
  • Klein, G., Calderwood, R., & Clinton-Cirocco, A. (2010). Rapid decision making on the fire ground: The original study plus a postscript. Journal of **Cognitive Engineering and Decision Making, 4, 186–209.
  • Kahneman, D., & Klein, G. (2009). Conditions for intuitive expertise: A failure to disagree. American Psychologist, 64, 515–526.
  • Klein, G. (2008). Naturalistic decision making. Human Factors, 50 (3), 456–460.
  • Klein, G. (2007). Performing a project PreMortem. Harvard Business Review, September, 18–19.
  • Klein, G., Phillips, J. K., Rall, E., & Peluso, D. A. (2007). A data/frame theory of sensemaking, In R. R. Hoffman (Ed.) Expertise out of Context. Erlbaum: **Mahweh, NJ
  • Klein, G., Pliske, R. M., Crandall, B., & Woods, D. (2005). Problem detection. Cognition, Technology, and Work, 7, 14–28.
  • Klein, G., Ross, K. G., Moon, B. M., Klein, D. E., Hoffman, R. R., & Hollnagel, E. (2003). Macrocognition. IEEE Intelligent Systems, 18(3), 81–85.
  • Lipshitz, R., Klein, G., Orasanu, J., & Salas, E. (2001). Focus article: Taking stock of naturalistic decision making. Journal of Behavioral Decision Making, 14, 331–352.
  • Klein, G., & Weick, K. (June 2000). Making better decisions. Across the Board, 37(6), 16–22.
  • Klinger, D. W., & Klein, G. (1999). Emergency response organizations: An accident waiting to happen. Ergonomics in Design, 7(3), 20–25.

External links

• Gary Klein's blog on insight
• Gary Klein's blog on Psychology Today
• Website of Macrocognition LLC
• ASK Talks with Dr. Gary Klein. NASA ASK Issue 20 undated
• Seeing through Expert Eyes: Ace decision makers may perceive distinctive worlds Science News Vol. 154, No. 3, July 18, 1998, p. 44
• What's Your Intuition ? Fast Company August, 2000
• Bruce Bower, Reworking Intuition: Business simulations spark rapid workplace renovations Science Week Oct. 23, 2004; Vol. 166, No. 17, p. 263
• Daniel D. Frey and Kemper Lewis The Deciding Factor: Design engineers make decisions for a living: Research looks for ways to make the process go smoother. Mechanical Engineering Design March 2005
• Brown, Paul B. What's Offline: Analyzing Failure Beforehand New York Times September 22, 2007
• MacroCognition, About Us: Gary Klein, Ph.D 2011
• Noblis, Profile: Gary Klein, Ph.D.
• Human Factors and Ergonomics Society Fellow Profile
• The Recognition Primed Decision Model, An Alternative to the MDMP for GWOT
• Naturalistic Decision Making, Human Factors
• ShadowBox, LLC Website

Notes and References

1. Web site: Academy Sharing Knowledge (ASK) Talks with Gary Klein. NASA. September 6, 2012. https://web.archive.org/web/20130526010258/http://askmagazine.nasa.gov/issues/20/interview/. May 26, 2013. dead.
2. Web site: Breen. Bill. What's Your Intuition?. Fast Company. September 6, 2012.
3. Web site: Morris. Bob. Gary Klein: an interview by Bob Morris. November 14, 2013.
4. Web site: About Us: Gary Klein, Ph.D. MacroCognition. September 6, 2012. https://web.archive.org/web/20120827045836/http://macrocognition.com/au_gary.html. August 27, 2012. dead.
5. Web site: Naturalistic Decision Making. Human Factors. September 6, 2012. March 27, 2014. https://web.archive.org/web/20140327162233/http://www.ise.ncsu.edu/nsf_itr/794B/papers/Klein_2008_HF_NDM.pdf. dead.
6. Web site: Recognition Primed Decision Model . United States Army.
7. Web site: Brown. Paul. Analyzing Failure Beforehand. The New York Times. September 6, 2012.
8. Web site: Gary Klein, Ph.D. Senior Scientist, MacroCognition LLC. Noblis. September 6, 2012. https://web.archive.org/web/20121120025458/http://www.noblis.org/NewsPublications/Pages/GaryKlein.aspx. November 20, 2012. dead.
9. https://a998242a-7d63-4ee6-870e-b4afd13cabce.filesusr.com/ugd/2360d8_f10a0dd34a20429a9e130284001b5fd5.pdf Klein, G., & Borders, J. (2016). The ShadowBox approach to cognitive skills training: An empirical evaluation. Journal of Cognitive Engineering and Decision Making, 10(3), 268-280.
10. 10.1016/j.promfg.2015.07.444 . Shadow Box™: Flexible Training to Impart the Expert Mindset . 2015 . Borders . Joseph . Polander . Noel . Klein . Gary . Wright . Corinne . Procedia Manufacturing . 3 . 1574–1579 . free .
11. Web site: Human Factors and Ergonomics Fellow Profile. HFES. September 6, 2012. March 13, 2017. https://web.archive.org/web/20170313130633/http://www.hfes.org/web/awards%26fellows/fellowprofiles/profile_klein.pdf. dead.