Hewitt–Savage zero–one law explained

The Hewitt–Savage zero–one law is a theorem in probability theory, similar to Kolmogorov's zero–one law and the Borel–Cantelli lemma, that specifies that a certain type of event will either almost surely happen or almost surely not happen. It is sometimes known as the Savage-Hewitt law for symmetric events. It is named after Edwin Hewitt and Leonard Jimmie Savage.^[1]

Statement of the Hewitt-Savage zero-one law

Let

\left\{ X _{n} \right\} ^{inf ty} _{n =1} be a sequence of independent and identically-distributed random variables taking values in a set X . The Hewitt-Savage zero–one law says that any event whose occurrence or non-occurrence is determined by the values of these random variables and whose occurrence or non-occurrence is unchanged by finite permutations of the indices, has probability either 0 or 1 (a "finite" permutation is one that leaves all but finitely many of the indices fixed).

Somewhat more abstractly, define the exchangeable sigma algebra or sigma algebra of symmetric events

l{E} to be the set of events (depending on the sequence of variables \left\{ X _{n} \right\} ^{inf ty} _{n =1} ) which are invariant under finite permutations of the indices in the sequence \left\{ X _{n} \right\} ^{inf ty} _{n =1} . Then A \in l{E} \implies P (A) \in \{ 0 , 1 \} .

Since any finite permutation can be written as a product of transpositions, if we wish to check whether or not an event

A is symmetric (lies in l{E} ), it is enough to check if its occurrence is unchanged by an arbitrary transposition (i, j) , i, j \in N .

Examples

Example 1

Let the sequence

\left\{ X _{n} \right\} ^{inf ty} _{n =1} of independent and identically distributed random variables take values in [ 0 , inf ty) . Then the event that the series \sum ^{inf ty} _{n =1} X _{n} converges (to a finite value) is a symmetric event in l{E} , since its occurrence is unchanged under transpositions (for a finite re-ordering, the convergence or divergence of the series—and, indeed, the numerical value of the sum itself—is independent of the order in which we add up the terms). Thus, the series either converges almost surely or diverges almost surely. If we assume in addition that the common expected value E [X _{n]} > 0 (which essentially means that P (X _{n} = 0 ) < 1 because of the random variables' non-negativity), we may conclude thatP \left( \sum ^{inf ty} _{n =1} X _{n} = + inf ty \right) = 1 ,

i.e. the series diverges almost surely. This is a particularly simple application of the Hewitt–Savage zero–one law. In many situations, it can be easy to apply the Hewitt–Savage zero–one law to show that some event has probability 0 or 1, but surprisingly hard to determine which of these two extreme values is the correct one.

Example 2

Continuing with the previous example, define

S _{N=} \sum ^{N} _{n =1} X _{n,}

which is the position at step N of a random walk with the iid increments X_n. The event is invariant under finite permutations. Therefore, the zero–one law is applicable and one infers that the probability of a random walk with real iid increments visiting the origin infinitely often is either one or zero. Visiting the origin infinitely often is a tail event with respect to the sequence (S_N), but S_N are not independent and therefore the Kolmogorov's zero–one law is not directly applicable here.^[2]

Notes and References

1. Hewitt . E. . Edwin Hewitt . Savage . L. J. . Leonard Jimmie Savage . Symmetric measures on Cartesian products . Trans. Amer. Math. Soc. . 80 . 1955 . 470–501 . 10.1090/s0002-9947-1955-0076206-8 . free .
2. This example is from Book: Shiryaev, A.. Albert Shiryaev

   . Albert Shiryaev . Probability Theory . Second . Springer-Verlag . New York . 1996 . 381–82 .