Subshift of finite type explained

In mathematics, subshifts of finite type are used to model dynamical systems, and in particular are the objects of study in symbolic dynamics and ergodic theory. They also describe the set of all possible sequences executed by a finite state machine. The most widely studied shift spaces are the subshifts of finite type.

Motivating examples

A (one-sided) shift of finite type is the set of all sequences, infinite on one end only, that can be made up of the letters

A, B, C , like AAA … , ABAB … , ... . A (two-sided) shift of finite type is similar, but consists of sequences that are infinite on both ends.

A subshift can be defined by a directed graph on these letters, such as the graph

A \to B \to C \to A . It consists of sequences whose transitions between consecutive letters are only those allowed by the graph. For this example, the subshift consists of only three one-sided sequences: ABCABC … , BCABCA … , CABCAB … . Similarly, the two-sided subshift described by this graph consists of only three two-sided sequences.

Other directed graphs on the same letters produce other subshifts. For example, adding another arrow

A\to C to the graph produces a subshift that, instead of containing three sequences, contains an uncountably infinite number of sequences.

Markov and non-Markov measures

Given a Markov transition matrix and an invariant distribution on the states, we can impose a probability measure on the set of subshifts. For example, consider the Markov chain given on the left on the states

A, B _{1,} B _{2} , with invariant distribution \pi = ( 2 / 7 , 4 / 7 , 1 / 7 ) . If we "forget" the distinction between B _{1,} B _{2} , we project this space of subshifts on A, B _{1,} B _{2} into another space of subshifts on A, B , and this projection also projects the probability measure down to a probability measure on the subshifts on A, B .

The curious thing is that the probability measure on the subshifts on

A, B is not created by a Markov chain on A, B , not even multiple orders. Intuitively, this is because if one observes a long sequence of B ^{n} , then one would become increasingly sure that the Pr(A | B ^{n)} \to (23)/() , meaning that the observable part of the system can be affected by something infinitely in the past.

Conversely, there exists a space of subshifts on 6 symbols, projected to subshifts on 2 symbols, such that any Markov measure on the smaller subshift has a preimage measure that is not Markov of any order (Example 2.6).

Definition

Let be a finite set of symbols (alphabet). Let denote the set of all bi-infinite sequences of elements of together with the shift operator . We endow with the discrete topology and with the product topology. A symbolic flow or subshift is a closed -invariant subset of ^[1] and the associated language is the set of finite subsequences of .^[2]

Now let be an adjacency matrix with entries in Using these elements we construct a directed graph with the set of vertices and the set of edges containing the directed edge in if and only if . Let be the set of all infinite admissible sequences of edges, where by admissible it is meant that the sequence is a walk of the graph, and the sequence can be either one-sided or two-sided infinite. Let be the left shift operator on such sequences; it plays the role of the time-evolution operator of the dynamical system. A subshift of finite type is then defined as a pair obtained in this way. If the sequence extends to infinity in only one direction, it is called a one-sided subshift of finite type, and if it is bilateral, it is called a two-sided subshift of finite type.

Formally, one may define the sequences of edges as

\Sigma ^{+} _{A} = \left\{ (x _{0,x} _{1,\ldots): x} _{j} \in V, A _{x _{j} x _{j+1}} =1 , j \in \N \right\}.

This is the space of all sequences of symbols such that the symbol can be followed by the symbol only if the -th entry of the matrix is 1. The space of all bi-infinite sequences is defined analogously:

\Sigma _{A} = \left\{ (\ldots, x _{-1} ,x _{0,x} _{1,\ldots): x} _{j} \in V, A _{x _{j} x _{j+1}} =1 , j\in Z \right\}.

The shift operator maps a sequence in the one- or two-sided shift to another by shifting all symbols to the left, i.e.

\displaystyle(T(x)) _{j} = x _{j+1} .

Clearly this map is only invertible in the case of the two-sided shift.

A subshift of finite type is called transitive if is strongly connected: there is a sequence of edges from any one vertex to any other vertex. It is precisely transitive subshifts of finite type which correspond to dynamical systems with orbits that are dense.

An important special case is the full -shift: it has a graph with an edge that connects every vertex to every other vertex; that is, all of the entries of the adjacency matrix are 1. The full -shift corresponds to the Bernoulli scheme without the measure.

Terminology

By convention, the term shift is understood to refer to the full -shift. A subshift is then any subspace of the full shift that is shift-invariant (that is, a subspace that is invariant under the action of the shift operator), non-empty, and closed for the product topology defined below. Some subshifts can be characterized by a transition matrix, as above; such subshifts are then called subshifts of finite type. Often, subshifts of finite type are called simply shifts of finite type. Subshifts of finite type are also sometimes called topological Markov shifts.

Examples

Many chaotic dynamical systems are isomorphic to subshifts of finite type; examples include systems with transverse homoclinic connections, diffeomorphisms of closed manifolds with a positive metric entropy, the Prouhet–Thue–Morse system, the Chacon system (this is the first system shown to be weakly mixing but not strongly mixing), Sturmian systems and Toeplitz systems.^[3]

Generalizations

A sofic system is an image of a subshift of finite type where different edges of the transition graph may be mapped to the same symbol. For example, if one only watches the output from a hidden Markov chain, then the output appears to be a sofic system.^[4] It may be regarded as the set of labellings of paths through an automaton: a subshift of finite type then corresponds to an automaton which is deterministic.^[5] Such systems correspond to regular languages.

Context-free systems are defined analogously, and are generated by phrase structure grammars.

A renewal system is defined to be the set of all infinite concatenations of some fixed finite collection of finite words.

Subshifts of finite type are identical to free (non-interacting) one-dimensional Potts models (-letter generalizations of Ising models), with certain nearest-neighbor configurations excluded. Interacting Ising models are defined as subshifts together with a continuous function of the configuration space (continuous with respect to the product topology, defined below); the partition function and Hamiltonian are explicitly expressible in terms of this function.

Subshifts may be quantized in a certain way, leading to the idea of the quantum finite automata.

Topology

A subshift has a natural topology, derived from the product topology on where

V ^{\Z=} \prod _{n} V = \{ x = (\ldots,x _{-1} ,x _{0,x} _{1,\ldots)} : x _{k} \in V \forall k \in \Z \}

and is given the discrete topology. A basis for the topology of which induces the topology of the subshift, is the family of cylinder sets

C _{t[a} _{0,} \ldots, a _{s]=} \{x \in V ^{\Z} : x _{t} = a _{0,} \ldots ,x _{t+s} = a _{s} \}

The cylinder sets are clopen sets in Every open set in is a countable union of cylinder sets. Every open set in the subshift is the intersection of an open set of with the subshift. With respect to this topology, the shift is a homeomorphism; that is, with respect to this topology, it is continuous with continuous inverse.

The space is homeomorphic to a Cantor set.

Metric

A variety of different metrics can be defined on a shift space. One can define a metric on a shift space by considering two points to be "close" if they have many initial symbols in common; this is the -adic metric. In fact, both the one- and two-sided shift spaces are compact metric spaces.

Measure

A subshift of finite type may be endowed with any one of several different measures, thus leading to a measure-preserving dynamical system. A common object of study is the Markov measure, which is an extension of a Markov chain to the topology of the shift.

A Markov chain is a pair consisting of the transition matrix, an matrix for which all and

\sum ^{np} _{ij} =1

for all . The stationary probability vector has all, $\backslash sum\; \backslash pi\_i\; =\; 1$ and has

\sum ^{n} _{i =1} \pi _{i} p _{ij} = \pi _{j.}

A Markov chain, as defined above, is said to be compatible with the shift of finite type if whenever . The Markov measure of a cylinder set may then be defined by

\mu(C _{t[a} _{0,\ldots,a} _{s])} = \pi _{a _{0}} p _{a _{0,a} _{1}} … p _{a _{s-1} , a _{s}}

The Kolmogorov–Sinai entropy with relation to the Markov measure is

s _{\mu} = - \sum ^{n} _{i =1} \pi _{i} \sum ^{n} _{j =1} p _{ij} log p _{ij}

Zeta function

The Artin–Mazur zeta function is defined as the formal power series

\zeta(z) = \exp\left(\sum ^{inf ty} _{n =1} l | rm{Fix} (T ^{n)} r | (z ^{n})/(n) \right),

where is the set of fixed points of the -fold shift. It has a product formula

\zeta(z) = \prod _{\gamma} \left( 1- z ^{|\gamma|} \right) ^{-1}

where runs over the closed orbits.^[6] For subshifts of finite type, the zeta function is a rational function of :^[7]

\zeta(z) = (\det(I - zA)) ^{-1} .

See also

• Transfer operator
• De Bruijn graph
• Quantum finite automata
• Axiom A

References

• Book: Introduction to Dynamical Systems . Michael . Brin . Garrett . Stuck . 2nd . . 2002 . 0-521-80841-3 .
• David Damanik, Strictly Ergodic Subshifts and Associated Operators, (2005)
• Book: Pytheas Fogg, N. . Valérie . Berthé . Valérie Berthé. Ferenczi . Sébastien . Mauduit . Christian . Siegel . A. . Substitutions in dynamics, arithmetics and combinatorics . Lecture Notes in Mathematics . 1794 . Berlin . . 2002 . 3-540-44141-7 . 1014.11015 .
• Natasha Jonoska, Subshifts of Finite Type, Sofic Systems and Graphs, (2000).
• Michael S. Keane, Ergodic theory and subshifts of finite type, (1991), appearing as Chapter 2 in Ergodic Theory, Symbolic Dynamics and Hyperbolic Spaces, Tim Bedford, Michael Keane and Caroline Series, Eds. Oxford University Press, Oxford (1991). (Provides a short expository introduction, with exercises, and extensive references.)
• Book: Douglas . Lind . Brian . Marcus . An introduction to symbolic dynamics and coding . . 1995 . 0-521-55124-2 . 1106.37301 .
• Book: Teschl. Gerald. Gerald Teschl. Ordinary Differential Equations and Dynamical Systems. American Mathematical Society. Providence. 2012. 978-0-8218-8328-0.
• Book: Xie, Huimin . Grammatical Complexity and One-Dimensional Dynamical Systems . 6 . Directions in Chaos . World Scientific . 1996 . 9810223986 .

Further reading

• Book: Symbolic Dynamics and Its Applications: American Mathematical Society, Short Course, January 4-5, 2002, San Diego, California . 60 . Proceedings of symposia in applied mathematics: AMS short course lecture notes . Susan G. . Williams . . 2004 . 0-8218-3157-7 . 1052.37003 .

Notes and References

1. Xie (1996) p.21
2. Xie (1996) p.22
3. Matthew Nicol and Karl Petersen, (2009) "Ergodic Theory: Basic Examples and Constructions",Encyclopedia of Complexity and Systems Science, Springer https://doi.org/10.1007/978-0-387-30440-3_177
4. Sofic Measures: Characterizations of Hidden Markov Chains by Linear Algebra, Formal Languages, and Symbolic Dynamics - Karl Petersen, Mathematics 210, Spring 2006, University of North Carolina at Chapel Hill
5. Pytheas Fogg (2002) p.205
6. Brin & Stuck (2002) p.60
7. Brin & Stuck (2002) p.61