Structural identifiability explained

In the area of system identification, a dynamical system is structurally identifiable if it is possible to infer its unknown parameters by measuring its output over time. This problem arises in many branch of applied mathematics, since dynamical systems (such as the ones described by ordinary differential equations) are commonly utilized to model physical processes and these models contain unknown parameters that are typically estimated using experimental data.[1] [2]

However, in certain cases, the model structure may not permit a unique solution for this estimation problem, even when the data is continuous and free from noise. To avoid potential issues, it is recommended to verify the uniqueness of the solution in advance, prior to conducting any actual experiments. The lack of structural identifiability implies that there are multiple solutions for the problem of system identification, and the impossibility of distinguishing between these solutions suggests that the system has poor forecasting power as a model.[3] On the other hand, control systems have been proposed with the goal of rendering the closed-loop system unidentifiable, decreasing its susceptibility to covert attacks targeting cyber-physical systems.[4]

Examples

Linear time-invariant system

[5]

Consider a linear time-invariant system with the following state-space representation:

\begin{align} x

1(t)&=-\theta1x1,\\

x

2(t)&=\theta1x1,\\ y(t)&=\theta2x2, \end{align}

and with initial conditions given by

x1(0)=\theta3

and

x2(0)=0

. The solution of the output

y

is

y(t)=\theta2\theta3

-\theta1t
e

\left(

\theta1t
e

-1\right),

which implies that the parameters

\theta2

and

\theta3

are not structurally identifiable. For instance, the parameters

\theta1=1,\theta2=1,\theta3=1

generates the same output as the parameters

\theta1=1,\theta2=2,\theta3=0.5

.

Non-linear system

[6]

A model of a possible glucose homeostasis mechanism is given by the differential equations[7]

\begin{aligned} &

G

=u(0)+u-(c+siI)G,\\ &

\beta

=\beta\left(

1.4583 ⋅ 10-5-
1+\left(8.4\right)1.7
G
1.7361 ⋅ 10-5
1+\left(G\right)8.5
8.4

\right),\\ &

I

=p\beta

G2
\alpha2+G2

-\gammaI, \end{aligned}

where (c, si, p, α, γ) are parameters of the system, and the states are the plasma glucose concentration G, the plasma insulin concentration I, and the beta-cell functional mass β. It is possible to show that the parameters p and si are not structurally identifiable: any numerical choice of parameters p and si that have the same product psi are indistinguishable.

Practical identifiability

Structural identifiability is assessed by analyzing the dynamical equations of the system, and does not take into account possible noises in the measurement of the output. In contrast, practical non-identifiability also takes noises into account.[8]

Other related notions

The notion of structurally identifiable is closely related to observability, which refers to the capacity of inferring the state of the system by measuring the trajectories of the system output. It is also closely related to data informativity, which refers to the proper selection of inputs that enables the inference of the unknown parameters.[9] [10]

The (lack of) structural identifiability is also important in the context of dynamical compensation of physiological control systems. These systems should ensure a precise dynamical response despite variations in certain parameters.[11] [12] In other words, while in the field of systems identification, unidentifiability is considered a negative property, in the context of dynamical compensation, unidentifiability becomes a desirable property.

Identifiability also appears in the context of inverse optimal control. Here, one assumes that the data comes from a solution of an optimal control problem with unknown parameters in the objective function. Here, identifiability refers to the possibility of infering the parameters present in the objective function by using the measured data.[13]

Software

There exist many software that can be used for analyzing the identifiability of a system, including non-linear systems:[14]

See also

Notes and References

  1. Miao . Hongyu . Xia . Xiaohua . Perelson . Alan S. . Wu . Hulin . 2011 . On Identifiability of Nonlinear ODE Models and Applications in Viral Dynamics . SIAM Review . en . 53 . 1 . 3–39 . 10.1137/090757009 . 0036-1445 . 3140286 . 21785515.
  2. Wensing . Patrick M. . Niemeyer . Günter . Slotine . Jean-Jacques E. . 2024 . A geometric characterization of observability in inertial parameter identification . The International Journal of Robotics Research . en . 1711.03896 . 10.1177/02783649241258215 . 0278-3649.
  3. Fiacchini . Mirko . Alamir . Mazen . 2021 . The Ockham's razor applied to COVID-19 model fitting French data . Annual Reviews in Control . en . 51 . 500–510 . 10.1016/j.arcontrol.2021.01.002 . 7846253 . 33551664.
  4. 2308.15493 . Xiangyu . Mao . Jianping . He . Unidentifiability of System Dynamics: Conditions and Controller Design . 2023. eess.SY .
  5. Raue . A. . Karlsson . J. . Saccomani . M. P. . Jirstrand . M. . Timmer . J. . 2014-05-15 . Comparison of approaches for parameter identifiability analysis of biological systems . Bioinformatics . en . 30 . 10 . 1440–1448 . 24463185 . 10.1093/bioinformatics/btu006 . free . 10052322 . 1367-4803.
  6. Villaverde . Alejandro F. . 2019-01-01 . Observability and Structural Identifiability of Nonlinear Biological Systems . Complexity . en . 2019 . 1–12 . 10.1155/2019/8497093 . 1076-2787. free . 1812.04525 .
  7. Karin . Omer . Swisa . Avital . Glaser . Benjamin . Dor . Yuval . Alon . Uri . 2016 . Dynamical compensation in physiological circuits . Molecular Systems Biology . en . 12 . 11 . 886 . 10.15252/msb.20167216 . 1744-4292 . 5147051 . 27875241.
  8. Raue . A. . Kreutz . C. . Maiwald . T. . Bachmann . J. . Schilling . M. . Klingmüller . U. . Timmer . J. . 2009-08-01 . Structural and practical identifiability analysis of partially observed dynamical models by exploiting the profile likelihood . Bioinformatics . en . 25 . 15 . 1923–1929 . 10.1093/bioinformatics/btp358 . 1460-2059 . 19505944. free .
  9. Van Waarde . Henk J. . Eising . Jaap . Camlibel . M. Kanat . Trentelman . Harry L. . 2023 . The Informativity Approach: To Data-Driven Analysis and Control . IEEE Control Systems . 43 . 6 . 32–66 . 10.1109/MCS.2023.3310305 . 1066-033X. 2302.10488 . 257050367 .
  10. Book: Gevers . Michel . Bazanella . Alexandre S. . Coutinho . Daniel F. . Dasgupta . Soura . 52nd IEEE Conference on Decision and Control . Identifiability and excitation of polynomial systems . 2013 . https://ieeexplore.ieee.org/document/6760547 . Firenze . IEEE . 4278–4283 . 10.1109/CDC.2013.6760547 . 978-1-4673-5717-3 . 7796419.
  11. Karin . Omer . Swisa . Avital . Glaser . Benjamin . Dor . Yuval . Alon . Uri . 2016 . Dynamical compensation in physiological circuits . Molecular Systems Biology . en . 12 . 11 . 886 . 10.15252/msb.20167216 . 1744-4292 . 5147051 . 27875241.
  12. Sontag . Eduardo D. . 2017-04-06 . Komarova . Natalia L. . Dynamic compensation, parameter identifiability, and equivariances . PLOS Computational Biology . en . 13 . 4 . e1005447 . 10.1371/journal.pcbi.1005447 . 1553-7358 . 5398758 . 28384175. 2017PLSCB..13E5447S . free .
  13. Zhang . Han . Ringh . Axel . 2024 . Inverse optimal control for averaged cost per stage linear quadratic regulators . Systems & Control Letters . en . 183 . 105658 . 10.1016/j.sysconle.2023.105658. 2305.15332 .
  14. Barreiro . Xabier Rey . Villaverde . Alejandro F. . 2023-01-31 . Benchmarking tools for a priori identifiability analysis . Bioinformatics . en . 39 . 2 . btad065 . 10.1093/bioinformatics/btad065 . 36721336 . 9913045 . 1367-4811.
  15. Dong . Ruiwen . Goodbrake . Christian . Harrington . Heather A. . Pogudin . Gleb . 2023-03-31 . Differential Elimination for Dynamical Models via Projections with Applications to Structural Identifiability . SIAM Journal on Applied Algebra and Geometry . en . 7 . 1 . 194–235 . 10.1137/22M1469067 . 2111.00991 . 245650629 . 2470-6566.
  16. Díaz-Seoane . Sandra . Rey-Barreiro . Xabier . Villaverde . Alejandro F. . 2022-07-15 . STRIKE-GOLDD 4.0: user-friendly, efficient analysis of structural identifiability and observability . eess.SY . 2207.07346 .