Lyapunov vector explained

In applied mathematics and dynamical system theory, Lyapunov vectors, named after Aleksandr Lyapunov, describe characteristic expanding and contracting directions of a dynamical system. They have been used in predictability analysis and as initial perturbations for ensemble forecasting in numerical weather prediction. In modern practice they are often replaced by bred vectors for this purpose.

Mathematical description

Lyapunov vectors are defined along the trajectories of a dynamical system. If the system can be described by a d-dimensional state vector

x\inRd

the Lyapunov vectors

v(k)(x)

,

(k=1...d)

point in the directions in which an infinitesimal perturbation will grow asymptotically, exponentially at an average rate given by the Lyapunov exponents

λk

.

Numerical method

If the dynamical system is differentiable and the Lyapunov vectors exist, they can be found by forward and backward iterations of the linearized system along a trajectory. Let

xn+1

=M
tn\totn+1

(xn)

map the system with state vector

xn

at time

tn

to the state

xn+1

at time

tn+1

. The linearization of this map, i.e. the Jacobian matrix

~Jn

describes the change of an infinitesimal perturbation

hn

. That is
M
tn\totn+1

(xn+hn)

M
tn\totn+1

(xn)+Jnhn=xn+1+hn+1


Starting with an identity matrix

Q0=I~

the iterations

Qn+1Rn+1=JnQn


where

Qn+1Rn+1

is given by the Gram-Schmidt QR decomposition of

JnQn

, will asymptotically converge to matrices that depend only on the points

xn

of a trajectory but not on the initial choice of

Q0

. The rows of the orthogonal matrices

Qn

define a local orthogonal reference frame at each point and the first

k

rows span the same space as the Lyapunov vectors corresponding to the

k

largest Lyapunov exponents. The upper triangular matrices

Rn

describe the change of an infinitesimal perturbation from one local orthogonal frame to the next. The diagonal entries
(n)
r
kk
of

Rn

are local growth factors in the directions of the Lyapunov vectors. The Lyapunov exponents are given by the average growth rates

λk=\limm\toinfty

1
tn+m-tn
m
\sum
l=1

log

(n+l)
r
kk


and by virtue of stretching, rotating and Gram-Schmidt orthogonalization the Lyapunov exponents are ordered as

λ1\geλ2\ge...\geλd

. When iterated forward in time a random vector contained in the space spanned by the first

k

columns of

Qn

will almost surely asymptotically grow with the largest Lyapunov exponent and align with the corresponding Lyapunov vector. In particular, the first column of

Qn

will point in the direction of the Lyapunov vector with the largest Lyapunov exponent if

n

is large enough. When iterated backward in time a random vector contained in the space spanned by the first

k

columns of

Qn+m

will almost surely, asymptotically align with the Lyapunov vector corresponding to the

k

th largest Lyapunov exponent, if

n

and

m

are sufficiently large. Defining

cn=

T
Q
n

hn

we find

cn-1=

-1
R
n

cn

. Choosing the first

k

entries of

cn+m

randomly and the other entries zero, and iterating this vector back in time, the vector

Qncn

aligns almost surely with the Lyapunov vector

v(k)(xn)

corresponding to the

k

th largest Lyapunov exponent if

m

and

n

are sufficiently large. Since the iterations will exponentially blow up or shrink a vector it can be re-normalized at any iteration point without changing the direction