List of model checking tools explained
This article lists model checking tools and gives an overview of the functionality of each.
Overview of some model checking tools
The following table includes model checkers that have
- a web site from which it can be downloaded,
- a declared license,
- a description published in archived literature, and
- a Wikipedia article describing it.
In the below table, the following abbreviations are used:
- Equivalences:
- SB: Strong Bisimulation
- WB: Weak Bisimulation
- BB: Branching Bisimulation
- STE: Strong Trace Equivalence
- WTE: Weak Trace Equivalence
- me: May Equivalence
- ME: Must Equivalence
- OE: Observational Equivalence
- SE: Safety Equivalence
- t*E: tau*.a Equivalence
- Software license:
- FUSC: Free Under Specific Condition (e.g., free for academics)
| Name | Model Checking | Equivalence checking | GUI | Availability |
|---|
| Plain, Probabilistic, Stochastic, ... | Modelling language | Properties language | Supported equivalences | Counter example generation | GUI | Graphical Specification | Counter example visualization | Software license | Programming language used | Platform, OS< | --------- Java Pathfinder ------------> |
|---|
| Java Pathfinder | Plain and timed | Java | unknown | unknown | No | GUI | Graphical spec | unknown | NASA | Java | macOS, Windows, Linux--> |
| BLAST | Code analysis | C | Monitor automata | | | | | | | OCaml | Windows, Unix related |
| CADP | Plain and probabilistic | LOTOS, FC2, FSP, LNT | AFMC, MCL, XTL | SB, WB, BB, OE, STE, WTE, SE, tau*E | | | | | | C, Bourne shell, Tcl/Tk, LOTOS, LNT | macOS, Linux, Solaris, Windows |
| CPAchecker | Code analysis | C | Monitor automata | | | | | | | Java | Any |
| DREAM | Real-time | C++, Timed automata | Monitor automata | | | | | | | C++ | Windows, Unix related |
| FizzBee Specification Language | Plain and probabilistic | Python | LTL | | | | | | | Go | macOS, Windows, Linux |
| Java Pathfinder | Plain and timed | Java | unknown | | | | | | Open Source Agreement | Java | macOS, Windows, Linux |
| Murφ (Murphi) | Plain | Murφ | Invariants, assertions | | | | | | | C++ | Linux |
| NuSMV | Plain | SMV input language | CTL, LTL, PSL | | | | | | | C | Unix, Windows, macOS |
| PAT | Plain, real-time, probabilistic | CSP#, timed CSP, probabilistic CSP | LTL, assertions | | | | | | | C# | Windows, others with Mono |
| PRISM | Probabilistic | PEPA, PRISM language, Plain MC | CSL, PLTL, PCTL | | | | | | | C++, Java | Windows, Linux, macOS |
| Rumur | Plain | Murφ | Invariants, assertions | | | | | | | C | macOS, Linux |
| SPIN | Plain | Promela | LTL | | | | | | | C, C++ | Windows, Unix related |
| TAPAAL | Real-time | Timed-Arc Petri Nets, age invariants, inhibitor arcs, transport arcs | TCTL subset | | | | | | | C++, Java | macOS, Windows, Linux |
| TAPAs | Plain | CCSP | CTL, μ-calculus | SB, WB, BB, STE, WTE, me, ME, OE | | | | | | Java | Windows, macOS, Unix related |
| UPPAAL | Real-time | Timed automata, C subset | TCTL subset | | | | | | | C++, Java | macOS, Windows, Linux |
| ROMEO | Real-time | Time Petri Nets, stopwatch parametric Petri nets | TCTL subset | | | | | | | C++, Tcl/Tk | macOS, Windows, Linux |
| TLA+ Model Checker (TLC) | Plain | TLA+, PlusCal | TLA | | | | | | | Java | macOS, Windows, Linux | |
Modelling languages
- CCSP: A process calculus obtained from CCS by incorporating some operators of CSP. It is defined by Olderog[1] and by van Glabbeek/Vaandrager.[2]
- CSP
Communicating sequential processes; formal language for describing patterns of interaction in concurrent systems. FDR2 is a refinement checking tool for CSP, comparing two models for compatibility.
- DVE input language: a system is described as Network of Extended Finite State Machines communicating via shared variables and unbuffered channels. Does not contain support for buffered channels and for checking the type of message to be received without performing the receive proper.
- FC2: (Common Format V2) Machine-level ASCII representation for synchronized (hierarchical) networks of automata. Defined by the Esprit Basic Research Action CONCUR, 1992. Used as an input and exchange format by a number of verification tools, mainly in the area of process algebras.
- FSP: Finite State Processes language defined at Imperial College.
- Java
Object-oriented programming language.
- LNT: LOTOS New Technology; a specification language inspired by process calculi, functional programming languages, and imperative programming languages; LNT was designed as a modern replacement for LOTOS and E-LOTOS.
- LOTOS
Language Of Temporal Ordering Specification (ISO standard 8807); formal specification language based on temporal ordering used for protocol specification in ISO OSI standards.
- mCRL2: A specification language for describing concurrent discrete event systems.
- Murφ
Guarded commands and an asynchronous, interleaving model of concurrency, with all synchronization and communication done through global variables.
Performance Evaluation Process Algebra; it is a stochastic process algebra designed for modelling computer and communication systems.
- Plain MC: simple text-file formats used in MRMC and PRISM.
- Promela
Process or Protocol Meta Language; it is a verification modeling language. The language allows for the dynamic creation of concurrent processes to model, for example, distributed systems.
General-purpose specification language based on the Temporal Logic of Actions, originally used for distributed and concurrent systems. The language for the specifications and their properties is the same.
Properties language
Imperative assertion statements.
- CSL: Continuous Stochastic Logic, characterizes bisimulation of continuous-time Markov processes.
- CSRL: Continuous Stochastic Reward Logic; a logic to specify measures over CTMCs extended with a reward structure (so-called Markov reward models).
- CTL
Computation Tree Logic; a branching-time logic, meaning that its model of time is a tree-like structure in which the future is not determined; there are different paths in the future, any one of which might be an actual path that is realized.
Predicates over a system state.
Linear temporal logic; a modal temporal logic with modalities referring to time.
- MCL: Model Checking Language; Alternation-Free Modal μ-calculus extended with user-friendly regular expressions and value-passing constructs; subsumes CTL and LTL.
- mCRL2 mu-calculus: Kozen's propositional modal μ-calculus (excluding atomic propositions), extended with: data-depended processes, quantification over data types, multi-actions, time, and regular formulas.
- PCTL
Probabilistic CTL; an extension of CTL which allows for probabilistic quantification of described properties.
- PLTL: Probabilistic Linear Temporal Logic.
- PRCTL: Probabilistic Reward Computation Tree Logic; it extends PCTL with reward-bounded properties.
- PSL
Property specification language
- SVA: SystemVerilog standards assertion language subset, standardized as IEEE 1800
- XTL: eXtended Temporal Language; a domain-specific language for quickly implementing action-based, explicit-state, value-passing model checkers.
Comparison of model checking tools
Scientific publications
There exists a few papers that systematically compare various model checkers on a common case study. The comparison usually discusses the modelling tradeoffs faced when using the input languages of each model checker, as well as the comparison of performances of the tools when verifying correctness properties. One can mention:
- In 1999, Judi Romijn compared two model checkers (CADP and SPIN) on the HAVi interoperability audio-video protocol for consumer electronics.[3]
- In 2003, Yifei Dong, Xiaoqun Du, Gerard J. Holzmann, and Scott A. Smolka published a comparison of four model checkers (namely: Cospan, Murphi, SPIN, and XMC) on a communication protocol, the GNU i-protocol.[4]
- In 2005, Elena M. Bortnik, Nikola Trcka, Anton Wijs, Bas Luttik, J. M. van de Mortel-Fronczak, Jos C. M. Baeten, Wan Fokkink, and J. E. Rooda published a comparison of four model checkers (namely: CADP, muCRL, SPIN, and UPPAAL) on an industrial manufacturing system, a rotating drilling machine.[5]
- In 2018, F. Mazzanti and A. Ferrari published a comparison of ten model checkers (namely: CADP, CPN Tools, FDR4, NuSMV/nuXmv, mCRL2, ProB, SPIN, TLA+, UMC, and UPPAAL) on a train supervision problem, taking into account both the user-friendliness of the languages and the performance of the tools.[6]
International software competitions
- Since 2007, the Hardware Model Checking Competition (HWMCC) compares the performances of model checking tools oriented towards hardware design.
- Since 2011, the Model Checking Contest (MCC) compare performances of model checking tools designed to analyze highly concurrent systems.
See also
External links
- Common benchmarks
- MCC (models of the Model Checking Contest): a collection of hundreds of Petri nets originating from many academic and industrial case studies.
- VLTS (Very Large Transition Systems): a collection of Labelled Transition Systems of increasing sizes, used in many scientific publications.
Notes and References
- [Ernst-Rüdiger Olderog|E.R. Olderog]
- Rob van Glabbeek, Frits Vaandrager: Bundle Event Structures and CCSP
- Romijn . Judi . Model Checking a HAVi Leader Election Protocol . CWI . SEN-R9915 . Amsterdam . June 1999 . 2018-06-14 . 2019-09-11 . https://web.archive.org/web/20190911021053/http://cadp.inria.fr/case-studies/99-a-havi.html . live .
- Dong . Yifei . Du . Xiaoqun . Holzmann . Gerard . Smolka . Scott . Fighting Livelock in the GNU i-Protocol: A Case Study in Explicit-State Model Checking . Software Tool for Technology Transfer . 4 . 4 . 505–528 . 2003.
- Bortnik . Elena M. . Trcka . Nikola . Wijs . Anton . Luttik . Bas . van de Mortel-Fronczak . J. M. . Baeten . Jos C. M. . Fokkink . Wan . Rooda . J. E. . Analyzing a chi model of a turntable system using Spin, CADP and Uppaal . Journal of Logical and Algebraic Methods in Programming . 65 . 2 . 51–104 . 2005 . 10.1016/j.jlap.2005.05.001 . 2018-05-25 . 2021-01-27 . https://web.archive.org/web/20210127031416/https://pure.tue.nl/ws/portalfiles/portal/2448829/200423.pdf . live . free .
- Mazzanti . Franco . Ferrari . Alessio . 2018 . Ten Diverse Formal Models for a CBTC Automatic Train Supervision System . Proceedings of the 3rd Workshop on Models for Formal Analysis of Real Systems and 6th International Workshop on Verification and Program Transformation (MARS/VPT’18), Thessaloniki, Greece . Electronic Proceedings in Theoretical Computer Science . 268 . 104–149 . 10.4204/EPTCS.268.4 . 1803.10324v1.
