Dynamic Bayesian network explained

A dynamic Bayesian network (DBN) is a Bayesian network (BN) which relates variables to each other over adjacent time steps.

History

A dynamic Bayesian network (DBN) is often called a "two-timeslice" BN (2TBN) because it says that at any point in time T, the value of a variable can be calculated from the internal regressors and the immediate prior value (time T-1). DBNs were developed by Paul Dagum in the early 1990s at Stanford University's Section on Medical Informatics.^{[1] [2]} Dagum developed DBNs to unify and extend traditional linear state-space models such as Kalman filters, linear and normal forecasting models such as ARMA and simple dependency models such as hidden Markov models into a general probabilistic representation and inference mechanism for arbitrary nonlinear and non-normal time-dependent domains.^{[3] [4]}

Today, DBNs are common in robotics, and have shown potential for a wide range of data mining applications. For example, they have been used in speech recognition, digital forensics, protein sequencing, and bioinformatics. DBN is a generalization of hidden Markov models and Kalman filters.^[5]

DBNs are conceptually related to probabilistic Boolean networks^[6] and can, similarly, be used to model dynamical systems at steady-state.

See also

• Recursive Bayesian estimation
• Probabilistic logic network
• Generalized filtering

Further reading

• Book: Murphy, Kevin. Dynamic Bayesian Networks: Representation, Inference and Learning. 2002. UC Berkeley, Computer Science Division.
• Book: Ghahramani, Zoubin . 10.1.1.56.7874 . Learning dynamic Bayesian networks . Lecture Notes in Computer Science . 1998 . Adaptive Processing of Sequences and Data Structures . 1387 . 168–197 . 10.1007/BFb0053999 . 978-3-540-64341-8 .
• 10.1.1.75.2969 . Friedman . N. . Murphy . K. . Russell . S. . 1998 . Learning the structure of dynamic probabilistic networks . UAI’98 . 139–147 . Morgan Kaufmann .
• 10.1109/ACCESS.2021.3105520 . Shiguihara . P. . De Andrade Lopes . A. . Mauricio . D. . 2021 . Dynamic Bayesian Network Modeling, Learning, and Inference: A Survey . IEEE Access . free .

Software

• : the Bayes Net Toolbox for Matlab, by Kevin Murphy, (released under a GPL license)
• Graphical Models Toolkit (GMTK): an open-source, publicly available toolkit for rapidly prototyping statistical models using dynamic graphical models (DGMs) and dynamic Bayesian networks (DBNs). GMTK can be used for applications and research in speech and language processing, bioinformatics, activity recognition, and any time-series application.
• DBmcmc : Inferring Dynamic Bayesian Networks with MCMC, for Matlab (free software)
• : Modeling gene regulatory network via global optimization of dynamic bayesian network (released under a GPL license)
• libDAI: C++ library that provides implementations of various (approximate) inference methods for discrete graphical models; supports arbitrary factor graphs with discrete variables, including discrete Markov Random Fields and Bayesian Networks (released under the FreeBSD license)
• aGrUM: C++ library (with Python bindings) for different types of PGMs including Bayesian Networks and Dynamic Bayesian Networks (released under the GPLv3)
• FALCON: Matlab toolbox for contextualization of DBNs models of regulatory networks with biological quantitative data, including various regularization schemes to model prior biological knowledge (released under the GPLv3)

Notes and References

1. Dynamic Network Models for Forecasting. Paul Dagum. Paul Dagum. Adam Galper. Adam Galper. Eric Horvitz. Eric Horvitz. Proceedings of the Eighth Conference on Uncertainty in Artificial Intelligence. 1992. AUAI Press. 41–48.
2. Uncertain Reasoning and Forecasting. Paul Dagum. Paul Dagum. Adam Galper. Adam Galper. Eric Horvitz. Eric Horvitz. Adam Seiver. Adam Seiver. International Journal of Forecasting . 11 . 1 . 1995 . 73–87 . 10.1016/0169-2070(94)02009-e. free.
3. Temporal Probabilistic Reasoning: Dynamic Network Models for Forecasting. Paul Dagum. Paul Dagum. Adam Galper. Adam Galper. Eric Horvitz. Eric Horvitz. Knowledge Systems Laboratory. Section on Medical Informatics, Stanford University. June 1991.
4. Forecasting Sleep Apnea with Dynamic Network Models. Paul Dagum. Paul Dagum. Adam Galper. Adam Galper. Eric Horvitz. Eric Horvitz. Proceedings of the Ninth Conference on Uncertainty in Artificial Intelligence . 1993. AUAI Press. 64–71.
5. Book: Stuart Russell. Stuart J. Russell. Peter Norvig. Peter Norvig. Artificial Intelligence: A Modern Approach. 2010. Prentice Hall. 978-0136042594. 566. Third. 22 October 2014. dynamic Bayesian networks (which include hidden Markov models and Kalman filters as special cases). dead. https://web.archive.org/web/20141020191456/http://51lica.com/wp-content/uploads/2012/05/Artificial-Intelligence-A-Modern-Approach-3rd-Edition.pdf. 20 October 2014.
6. 1847796. Harri Lähdesmäki. Harri Lähdesmäki. Sampsa Hautaniemi. Sampsa Hautaniemi. Ilya Shmulevich. Ilya Shmulevich. Olli Yli-Harja. Olli Yli-Harja. Relationships between probabilistic Boolean networks and dynamic Bayesian networks as models of gene regulatory networks. Signal Processing. 86. 4. 2006. 814–834. 17415411. 10.1016/j.sigpro.2005.06.008.