System identification explained

The field of system identification uses statistical methods to build mathematical models of dynamical systems from measured data.[1] System identification also includes the optimal design of experiments for efficiently generating informative data for fitting such models as well as model reduction. A common approach is to start from measurements of the behavior of the system and the external influences (inputs to the system) and try to determine a mathematical relation between them without going into many details of what is actually happening inside the system; this approach is called black box system identification.

Overview

A dynamic mathematical model in this context is a mathematical description of the dynamic behavior of a system or process in either the time or frequency domain. Examples include:

One of the many possible applications of system identification is in control systems. For example, it is the basis for modern data-driven control systems, in which concepts of system identification are integrated into the controller design, and lay the foundations for formal controller optimality proofs.

Input-output vs output-only

System identification techniques can utilize both input and output data (e.g. eigensystem realization algorithm) or can include only the output data (e.g. frequency domain decomposition). Typically an input-output technique would be more accurate, but the input data is not always available.

Optimal design of experiments

The quality of system identification depends on the quality of the inputs, which are under the control of the systems engineer. Therefore, systems engineers have long used the principles of the design of experiments.[2] In recent decades, engineers have increasingly used the theory of optimal experimental design to specify inputs that yield maximally precise estimators.[3] [4]

White- and black-box

One could build a white-box model based on first principles, e.g. a model for a physical process from the Newton equations, but in many cases, such models will be overly complex and possibly even impossible to obtain in reasonable time due to the complex nature of many systems and processes.

A more common approach is therefore to start from measurements of the behavior of the system and the external influences (inputs to the system) and try to determine a mathematical relation between them without going into the details of what is actually happening inside the system. This approach is called system identification. Two types of models are common in the field of system identification:

In the context of nonlinear system identification Jin et al.[9] describe grey-box modeling by assuming a model structure a priori and then estimating the model parameters. Parameter estimation is relatively easy if the model form is known but this is rarely the case. Alternatively, the structure or model terms for both linear and highly complex nonlinear models can be identified using NARMAX methods.[10] This approach is completely flexible and can be used with grey box models where the algorithms are primed with the known terms, or with completely black-box models where the model terms are selected as part of the identification procedure. Another advantage of this approach is that the algorithms will just select linear terms if the system under study is linear, and nonlinear terms if the system is nonlinear, which allows a great deal of flexibility in the identification.

Identification for control

In control systems applications, the objective of engineers is to obtain a good performance of the closed-loop system, which is the one comprising the physical system, the feedback loop and the controller. This performance is typically achieved by designing the control law relying on a model of the system, which needs to be identified starting from experimental data. If the model identification procedure is aimed at control purposes, what really matters is not to obtain the best possible model that fits the data, as in the classical system identification approach, but to obtain a model satisfying enough for the closed-loop performance. This more recent approach is called identification for control, or I4C in short.

G0(s)

:

G0(s)=

1
s+1
and an identified model

\hat{G}(s)

:

\hat{G}(s)=

1
s

.

From a classical system identification perspective,

\hat{G}(s)

is not, in general, a good model for

G0(s)

. In fact, modulus and phase of

\hat{G}(s)

are different from those of

G0(s)

at low frequency. What is more, while

G0(s)

is an asymptotically stable system,

\hat{G}(s)

is a simply stable system. However,

\hat{G}(s)

may still be a model good enough for control purposes. In fact, if one wants to apply a purely proportional negative feedback controller with high gain

K

, the closed-loop transfer function from the reference to the output is, for

G0(s)

KG0(s)
1+KG0(s)

=

K
s+1+K
and for

\hat{G}(s)

K\hat{G
(s)}{1+K\hat{G}(s)}

=

K
s+K

.

Since

K

is very large, one has that

1+KK

. Thus, the two closed-loop transfer functions are indistinguishable. In conclusion,

\hat{G}(s)

is a perfectly acceptable identified model for the true system if such feedback control law has to be applied. Whether or not a model is appropriate for control design depends not only on the plant/model mismatch but also on the controller that will be implemented. As such, in the I4C framework, given a control performance objective, the control engineer has to design the identification phase in such a way that the performance achieved by the model-based controller on the true system is as high as possible.

Sometimes, it is even more convenient to design a controller without explicitly identifying a model of the system, but directly working on experimental data. This is the case of direct data-driven control systems.

Forward model

A common understanding in Artificial Intelligence is that the controller has to generate the next move for a robot. For example, the robot starts in the maze and then the robot decides to move forward. Model predictive control determines the next action indirectly. The term “model” is referencing to a forward model which doesn't provide the correct action but simulates a scenario.[12] A forward model is equal to a physics engine used in game programming. The model takes an input and calculates the future state of the system.

The reason why dedicated forward models are constructed is because it allows one to divide the overall control process. The first question is how to predict the future states of the system. That means, to simulate a plant over a timespan for different input values. And the second task is to search for a sequence of input values which brings the plant into a goal state. This is called predictive control.

The forward model is the most important aspect of a MPC-controller. It has to be created before the solver can be realized. If it's unclear what the behavior of a system is, it's not possible to search for meaningful actions. The workflow for creating a forward model is called system identification. The idea is to formalize a system in a set of equations which will behave like the original system.[13] The error between the real system and the forward model can be measured.

There are many techniques available to create a forward model: ordinary differential equations is the classical one which is used in physics engines like Box2d. A more recent technique is a neural network for creating the forward model.[14]

Notes and References

  1. Book: System identification. Torsten. Söderström. Stoica. P.. 1989. Prentice Hall. 978-0138812362. New York. 16983523. Peter Stoica.
  2. Spall, J. C. (2010), “Factorial Design for Efficient Experimentation: Generating Informative Data for System Identification,” IEEE Control Systems Magazine, vol. 30(5), pp. 38–53. https://doi.org/10.1109/MCS.2010.937677
  3. Book: Dynamic System Identification: Experiment Design and Data Analysis. Goodwin. Graham C.. Payne. Robert L.. Academic Press. 1977. 978-0-12-289750-4. amp.
  4. Book: Identification of Parametric Models from Experimental Data. Walter. Éric. Pronzato. Luc. Springer. 1997. amp.
  5. Nielsen. Henrik Aalborg. Madsen. Henrik. December 2000. Predicting the Heat Consumption in District Heating Systems using Meteorological Forecasts. https://web.archive.org/web/20170421000847/https://pdfs.semanticscholar.org/797f/e008adf5fa2b8ccb6977299c2faa6c99c454.pdf. dead. 2017-04-21. Lyngby. Department of Mathematical Modelling, Technical University of Denmark. 134091581.
  6. Nielsen. Henrik Aalborg. Madsen. Henrik. January 2006. Modelling the heat consumption in district heating systems using a grey-box approach. Energy and Buildings. 38. 1. 63–71. 10.1016/j.enbuild.2005.05.002. 0378-7788.
  7. Wimpenny. J.W.T.. April 1997. The Validity of Models. Advances in Dental Research. en. 11. 1. 150–159. 10.1177/08959374970110010601. 9524451. 23008333. 0895-9374.
  8. Forssell. U.. Lindskog. P.. July 1997. Combining Semi-Physical and Neural Network Modeling: An Example of Its Usefulness. IFAC Proceedings Volumes. 30. 11. 767–770. 10.1016/s1474-6670(17)42938-7. 1474-6670. free.
  9. Book: Gang Jin. Sain. M.K.. Pham. K.D.. Billie. F.S.. Ramallo. J.C.. Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148) . Modeling MR-dampers: A nonlinear blackbox approach . 2001. 429-434 vol.1 . en-US. IEEE. 10.1109/acc.2001.945582. 978-0780364950. 62730770.
  10. Book: Billings, Stephen A. 2013-07-23. Nonlinear System Identification: NARMAX Methods in the Time, Frequency, and Spatio–Temporal Domains. 9781118535561. en. 10.1002/9781118535561.
  11. Gevers. Michel. January 2005. Identification for Control: From the Early Achievements to the Revival of Experiment Design*. European Journal of Control. 11. 4–5. 335–352. 10.3166/ejc.11.335-352. 13054338. 0947-3580.
  12. Model learning for robot control: a survey . Nguyen-Tuong, Duy and Peters, Jan . Cognitive Processing . 12 . 4 . 319–340 . 2011 . Springer . 10.1007/s10339-011-0404-1. 21487784 . 8660085 .
  13. Learning modular and transferable forward models of the motions of push manipulated objects . Kopicki, Marek and Zurek, Sebastian and Stolkin, Rustam and Moerwald, Thomas and Wyatt, Jeremy L . Autonomous Robots . 41 . 5 . 1061–1082 . 2017 . Springer . 10.1007/s10514-016-9571-3. free .
  14. Model predictive neural control of a high-fidelity helicopter model . Eric Wan and Antonio Baptista and Magnus Carlsson and Richard Kiebutz and Yinglong Zhang and Alexander Bogdanov . 2001 . American Institute of Aeronautics and Astronautics . .