Risk matrix explained

A risk matrix is a matrix that is used during risk assessment to define the level of risk by considering the category of likelihood (often confused with one of its possible quantitative metrics, i.e. the probability) against the category of consequence severity. This is a simple mechanism to increase visibility of risks and assist management decision making.[1]

Definitions

Risk is the lack of certainty about the outcome of making a particular choice. Statistically, the level of downside risk can be calculated as the product of the probability that harm occurs (e.g., that an accident happens) multiplied by the severity of that harm (i.e., the average amount of harm or more conservatively the maximum credible amount of harm). In practice, the risk matrix is a useful approach where either the probability or the harm severity cannot be estimated with accuracy and precision.

Although standard risk matrices exist in certain contexts (e.g. US DoD, NASA, ISO),[2] [3] [4] individual projects and organizations may need to create their own or tailor an existing risk matrix. For example, the harm severity can be categorized as:

The likelihood of harm occurring might be categorized as 'certain', 'likely', 'possible', 'unlikely' and 'rare'. However it must be considered that very low likelihood may not be very reliable.

The resulting risk matrix could be:

The company or organization then would calculate what levels of risk they can take with different events. This would be done by weighing the risk of an event occurring against the cost to implement safety and the benefit gained from it.

The following is an example matrix of possible personal injuries, with particular accidents allocated to appropriate cells within the matrix:

NegligibleMarginalCriticalCatastrophic
CertainStubbing toe
LikelyFall
PossibleMajor car accident
UnlikelyAircraft crash
RareMajor tsunami
The risk matrix is approximate and can often be challenged. For example, the likelihood of death in an aircraft crash is about 1:11 million[5] but death by motor vehicle is 1:5000, but nobody usually survives a plane crash, so it is far more catastrophic.

Development

On January 30 1978,[6] a new version of US Department of Defense Instruction 6055.1 ("Department of Defense Occupational Safety and Health Program") was released. It is said to have been an important step towards the development of the risk matrix.[7]

In August 1978, business textbook author David E Hussey defined an investment "risk matrix" with risk on one axis, and profitability on the other. The values on the risk axis were determined by first determining risk impact and risk probability values in a manner identical to completing a 7 x 7 version of the modern risk matrix.[8]

A 5 x 4 version of the risk matrix was defined by the US Department of Defense on March 30 1984, in "MIL-STD-882B System Safety Program Requirements".[9] [10]

The risk matrix was in use by the acquisition reengineering team at the US Air Force Electronic Systems Center in 1995.[11]

Huihui Ni, An Chen and Ning Chen proposed some refinements of the approach in 2010.[12]

In 2019, the three most popular forms of the matrix were:

Other standards are also in use.[14]

Problems

In his article 'What's Wrong with Risk Matrices?',[15] Tony Cox argues that risk matrices experience several problematic mathematical features making it harder to assess risks. These are:

Thomas, Bratvold, and Bickel[16] demonstrate that risk matrices produce arbitrary risk rankings. Rankings depend upon the design of the risk matrix itself, such as how large the bins are and whether or not one uses an increasing or decreasing scale. In other words, changing the scale can change the answer.

An additional problem is the imprecision used on the categories of likelihood. For example; 'certain', 'likely', 'possible', 'unlikely' and 'rare' are not hierarchically related. A better choice might be obtained through use of the same base term, such as 'extremely common', 'very common', 'fairly common', 'less common', 'very uncommon', 'extremely uncommon' or a similar hierarchy on a base "frequency" term.

Another common problem is to assign rank indices to the matrix axes and multiply the indices to get a "risk score". While this seems intuitive, it results in an uneven distribution.

Cybersecurity

Douglas W. Hubbard and Richard Seiersen take the general research from Cox, Thomas, Bratvold, and Bickel, and provide specific discussion in the realm of cybersecurity risk. They point out that since 61% of cybersecurity professionals use some form of risk matrix, this can be a serious problem. Hubbard and Seiersen consider these problems in the context of other measured human errors and conclude that "The errors of the experts are simply further exacerbated by the additional errors introduced by the scales and matrices themselves. We agree with the solution proposed by Thomas et al. There is no need for cybersecurity (or other areas of risk analysis that also use risk matrices) to reinvent well-established quantitative methods used in many equally complex problems."[17]

Notes and References

  1. Web site: What's right with risk matrices?. Julian Talbot on Risk, Success and Leadership. en. 2018-06-18. 2018-07-14. https://web.archive.org/web/20180714183028/http://www.juliantalbot.com/single-post/2018/07/31/Whats-right-with-risk-matrices. dead.
  2. Web site: Risk, Issue, and Opportunity Management Guide for Defense Acquisition Programs. January 2017. United States Department of Defense. 2018-06-18. 2017-07-04. https://web.archive.org/web/20170704192215/https://www.acq.osd.mil/se/docs/2017-RIO.pdf#page=36. dead.
  3. Web site: NASA, Goddard Space Flight Center, Goddard Technical Standard GSFC-STD-0002, Risk Management Reporting. 2009-05-08. 2018-06-17.
  4. International Organization for Standardization, Space Systems Risk Management, ISO 17666,
  5. Web site: NOVA The Deadliest Plane Crash How Risky Is Flying? PBS . 2022-06-27 . www.pbs.org.
  6. Web site: HRD-80-20 Workplace Health and Safety Hazards at DOD Installations.
  7. Clemens . Pat . The RAC Matrix: A Universal Tool or a Toolkit? . Journal of System Safety . 2005 . 41 . 2 . 14–19.
  8. Hussey . David . Portfolio analysis: Practical experience with the Directional Policy Matrix . Long Range Planning . 1 August 1978 . 11 . 4 . 2–8 . 10.1016/0024-6301(78)90001-8 . en . 0024-6301.
  9. Web site: MIL-STD-882B SYSTEM SAFETY PROGRAM REQUIREMENTS . sunnyday.mit.edu.
  10. Philley . Jack O. . Acceptable risk—an overview . Plant/Operations Progress . 1992 . 11 . 4 . 218–223 . 10.1002/prsb.720110409 . en . 1549-4632.
  11. Garvey . Paul . Landsdown . Zachary . Risk Matrix: An Approach for Identifying, Assessing and Ranking Program Risks . Air Force Journal of Logistics . 1998 . 22 . 1 . 18–21 . DIANE Publishing . 9781428990890 . en.
  12. Some extensions on risk matrix approach . . 1 December 2010 . 48 . 10 . 1269–1278 . 10.1016/j.ssci.2010.04.005 . en . 0925-7535. Ni . Huihui . Chen . An . Chen . Ning . free .
  13. Kovačević . Nenad . Stojiljković . Aleksandra . Kovač . Mitar . Application of the matrix approach in risk assessment . Operational Research in Engineering Sciences: Theory and Applications . 11 December 2019 . 2 . 3 . 55–64 . 10.31181/oresta1903055k . en . 2620-1747. free .
  14. Ristić . Dejan . A tool for risk assessment . Safety Engineering . 2013 . 3 . 3 . 10.7562/SE2013.3.03.03 . free .
  15. Cox, L.A. Jr., 'What's Wrong with Risk Matrices?', Risk Analysis, Vol. 28, No. 2, 2008,
  16. Thomas, Philip, Reidar Bratvold, and J. Eric Bickel, 'The Risk of Using Risk Matrices,' SPE Economics & Management, Vol. 6, No. 2, pp. 56-66, 2014,
  17. Book: How to Measure Anything in Cybersecurity Risk. Hubbard. Douglas W.. Seiersen. Richard. Wiley. 2016. Kindle Locations 2636–2639.