Causal AI explained

Causal AI is a technique in artificial intelligence that builds a causal model and can thereby make inferences using causality rather than just correlation. One practical use for causal AI is for organisations to explain decision-making and the causes for a decision.[1] [2]

Systems based on causal AI, by identifying the underlying web of causality for a behaviour or event, provide insights that solely predictive AI models might fail to extract from historical data.[3] An analysis of causality may be used to supplement human decisions in situations where understanding the causes behind an outcome is necessary, such as quantifying the impact of different interventions, policy decisions or performing scenario planning.[4] A 2024 paper from Google DeepMind demonstrated mathematically that "Any agent capable of adapting to a sufficiently large set of distributional shifts must have learned a causal model".[5] The paper offers the interpretation that learning to generalise beyond the original training set requires learning a causal model, concluding that causal AI is necessary for artificial general intelligence.

History

The concept of causal AI and the limits of machine learning were raised by Judea Pearl, the Turing Award-winning computer scientist and philosopher, in 2018's The Book of Why: The New Science of Cause and Effect. Pearl asserted: “Machines' lack of understanding of causal relations is perhaps the biggest roadblock to giving them human-level intelligence.”[6] [7]

In 2020, Columbia University established a Causal AI Lab under Director Elias Bareinboim. Professor Bareinboim’s research focuses on causal and counterfactual inference and their applications to data-driven fields in the health and social sciences as well as artificial intelligence and machine learning.[8] Technological research and consulting firm Gartner for the first time included causal AI in its 2022 Hype Cycle report, citing it as one of five critical technologies in accelerated AI automation.[9] [10]

One significant advance in the field is the concept of Algorithmic Information Dynamics:[11] a model-driven approach for causal discovery using Algorithmic Information Theory and perturbation analysis. It solves inverse causal problems by studying dynamical systems computationally. A key application is causal deconvolution, which separates generative mechanisms in data with algorithmic models rather than traditional statistics. [12] This method identifies causal structures in networks and sequences, moving away from probabilistic and regression-based techniques, marking one of the first practical Causal AI approaches using Algorithmic Complexity and Algorithmic Probability in Machine Learning. [13]

Notes and References

  1. Web site: Blogger . SwissCognitive Guest . 2022-01-18 . Causal AI . 2022-10-11 . SwissCognitive, World-Leading AI Network . en-US.
  2. Sgaier . Sema K . Huang . Vincent . Grace . Charles . 2020 . The Case for Causal AI . . 18 . 3 . 50–55 . 1542-7099 . .
  3. Web site: 2024-06-29 . Beyond the Limits of Historical Data causa . 2024-06-29 . causa.tech . en-US.
  4. Web site: 2023-02-28 . How to Understand the World of Causality causaLens . 2023-10-07 . causalens.com . en-US.
  5. Web site: Robust agents learn causal world models. 267740124 .
  6. Book: Pearl, Judea . Penguin Books. The book of why : the new science of cause and effect . 2019 . Dana Mackenzie . 978-0-14-198241-0 . . 1047822662.
  7. Web site: Hartnett . Kevin . 15 May 2018 . To Build Truly Intelligent Machines, Teach Them Cause and Effect . 11 October 2022 . Quanta Magazine.
  8. Web site: What AI still can't do . 2022-10-18 . MIT Technology Review . en.
  9. Web site: What is New in the 2022 Gartner Hype Cycle for Emerging Technologies . 2022-10-11 . Gartner . en-GB.
  10. Web site: Sharma . Shubham . 2022-08-10 . Gartner picks emerging technologies that can drive differentiation for enterprises . 2022-10-11 . VentureBeat . en-US.
  11. Zenil . Hector . Algorithmic Information Dynamics . Scholarpedia . 25 July 2020 . 15 . 7 . 10.4249/scholarpedia.53143 . free . 2020SchpJ..1553143Z . 10754/666314 . free . Book: Zenil . Hector . Kiani . Narsis A. . Tegner . Jesper . Algorithmic Information Dynamics: A Computational Approach to Causality with Applications to Living Systems . Cambridge University Press . 2023 . 10.1017/9781108596619 . 978-1-108-59661-9 .
  12. Zenil . Hector . Kiani . Narsis A. . Zea . Allan A. . Tegner . Jesper . Causal deconvolution by algorithmic generative models . Nature Machine Intelligence . 1 . 1 . 58–66 . 2019 . 10.1038/s42256-018-0005-0 . 10754/630919 . free .
  13. Hernández-Orozco . Santiago . Zenil . Hector . Riedel . Jürgen . Uccello . Adam . Kiani . Narsis A. . Tegnér . Jesper . Algorithmic Probability-Guided Machine Learning on Non-Differentiable Spaces . Frontiers in Artificial Intelligence . 3 . 567356 . 2021 . 10.3389/frai.2020.567356 . free . 33733213 . 7944352 .