Stopping time explained

In probability theory, in particular in the study of stochastic processes, a stopping time (also Markov time, Markov moment, optional stopping time or optional time[1]) is a specific type of “random time”: a random variable whose value is interpreted as the time at which a given stochastic process exhibits a certain behavior of interest. A stopping time is often defined by a stopping rule, a mechanism for deciding whether to continue or stop a process on the basis of the present position and past events, and which will almost always lead to a decision to stop at some finite time.

Stopping times occur in decision theory, and the optional stopping theorem is an important result in this context. Stopping times are also frequently applied in mathematical proofs to “tame the continuum of time”, as Chung put it in his book (1982).

Definition

Discrete time

Let

\tau

be a random variable, which is defined on the filtered probability space

(\Omega,lF,(lFn)n,P)

with values in

N\cup\{+infty\}

. Then

\tau

is called a stopping time (with respect to the filtration

F=((lFn)n

), if the following condition holds:

\{\tau=n\}\inlFn

for all

n

Intuitively, this condition means that the "decision" of whether to stop at time

n

must be based only on the information present at time

n

, not on any future information.

General case

Let

\tau

be a random variable, which is defined on the filtered probability space

(\Omega,lF,(lFt)t,P)

with values in

T

. In most cases,

T=[0,+infty)

. Then

\tau

is called a stopping time (with respect to the filtration

F=(lFt)t

), if the following condition holds:

\{\tau\leqt\}\inlFt

for all

t\inT

As adapted process

Let

\tau

be a random variable, which is defined on the filtered probability space

(\Omega,lF,(lFt)t,P)

with values in

T

. Then

\tau

is called a stopping time if the stochastic process

X=(Xt)t

, defined by

Xt:=\begin{cases}1&ift<\tau\ 0&ift\geq\tau\end{cases}

is adapted to the filtration

F=(lFt)t

Comments

Some authors explicitly exclude cases where

\tau

can be

+infty

, whereas other authors allow

\tau

to take any value in the closure of

T

.

Examples

To illustrate some examples of random times that are stopping rules and some that are not, consider a gambler playing roulette with a typical house edge, starting with $100 and betting $1 on red in each game:

To illustrate the more general definition of stopping time, consider Brownian motion, which is a stochastic process

(Bt)t\geq

, where each

Bt

is a random variable defined on the probability space

(\Omega,l{F},P)

. We define a filtration on this probability space by letting

l{F}t

be the σ-algebra generated by all the sets of the form
-1
(B
s)

(A)

where

0\leqs\leqt

and

A\subseteqR

is a Borel set. Intuitively, an event E is in

l{F}t

if and only if we can determine whether E is true or false just by observing the Brownian motion from time 0 to time t.

\tau:=t0

is (trivially) a stopping time; it corresponds to the stopping rule "stop at time

t0

".

a\inR.

Then

\tau:=inf\{t\geq0\midBt=a\}

is a stopping time for Brownian motion, corresponding to the stopping rule: "stop as soon as the Brownian motion hits the value a."

\tau:=inf\{t\geq1\midBs>0foralls\in[t-1,t]\}

. It corresponds to the stopping rule "stop as soon as the Brownian motion has been positive over a contiguous stretch of length 1 time unit."

\left(\Omega,l{F},\left\{l{F}t\right\}t,P\right)

then their minimum

\tau1\wedge\tau2

, their maximum

\tau1\vee\tau2

, and their sum τ1 + τ2 are also stopping times. (This is not true for differences and products, because these may require "looking into the future" to determine when to stop.)

Hitting times like the second example above can be important examples of stopping times. While it is relatively straightforward to show that essentially all stopping times are hitting times,[2] it can be much more difficult to show that a certain hitting time is a stopping time. The latter types of results are known as the Début theorem.

Localization

Stopping times are frequently used to generalize certain properties of stochastic processes to situations in which the required property is satisfied in only a local sense. First, if X is a process and τ is a stopping time, then Xτ is used to denote the process X stopped at time τ.

\tau
X
t=X

min(t,\tau)

Then, X is said to locally satisfy some property P if there exists a sequence of stopping times τn, which increases to infinity and for which the processes
1
\{\taun>0\
}X^ satisfy property P. Common examples, with time index set I = [0, ∞), are as follows: <blockquote>'''Local martingale process'''. A process ''X'' is a [[local martingale]] if it is càdlàg and there exists a sequence of stopping times τn increasing to infinity, such that
1
\{\taun>0\
}X^ is a martingale for each n.

Locally integrable process. A non-negative and increasing process X is locally integrable if there exists a sequence of stopping times τn increasing to infinity, such that

\operatorname{E}\left

[1
\{\taun>0\
}X^ \right ]<\infty for each n.

Types of stopping times

Stopping times, with time index set I = [0,∞), are often divided into one of several types depending on whether it is possible to predict when they are about to occur. A stopping time ''τ'' is '''predictable''' if it is equal to the limit of an increasing sequence of stopping times ''τ''<sub>''n''</sub> satisfying ''τ''<sub>''n''</sub> < ''τ'' whenever ''τ'' > 0. The sequence ''τ''<sub>''n''</sub> is said to ''announce'' ''τ'', and predictable stopping times are sometimes known as ''announceable''. Examples of predictable stopping times are [[hitting time]]s of continuous and adapted processes. If τ is the first time at which a continuous and real valued process X is equal to some value a, then it is announced by the sequence τn, where τn is the first time at which X is within a distance of 1/n of a.

Accessible stopping times are those that can be covered by a sequence of predictable times. That is, stopping time τ is accessible if, P(τ = τn for some n) = 1, where τn are predictable times.

A stopping time τ is totally inaccessible if it can never be announced by an increasing sequence of stopping times. Equivalently, P(τ = σ < ∞) = 0 for every predictable time σ. Examples of totally inaccessible stopping times include the jump times of Poisson processes.

Every stopping time τ can be uniquely decomposed into an accessible and totally inaccessible time. That is, there exists a unique accessible stopping time σ and totally inaccessible time υ such that τ = σ whenever σ < ∞, τ = υ whenever υ < ∞, and τ = ∞ whenever σ = υ = ∞. Note that in the statement of this decomposition result, stopping times do not have to be almost surely finite, and can equal ∞.

Stopping rules in clinical trials

Clinical trials in medicine often perform interim analysis, in order to determine whether the trial has already met its endpoints.However, interim analysis create the risk of false-positive results, and therefore stopping boundaries are used to determine the number and timing of interim analysis (also known as alpha-spending, to denote the rate of false positives).At each of R interim tests, the trial is stopped if the likelihood is below a threshold p, which depends on the method used. See Sequential analysis.

See also

Further reading

Notes and References

  1. Book: Kallenberg . Olav . Olav Kallenberg . 2017 . Random Measures, Theory and Applications. 77 . Switzerland . Springer . 10.1007/978-3-319-41598-7. 978-3-319-41596-3. 347. Probability Theory and Stochastic Modelling .
  2. Fischer. Tom. On simple representations of stopping times and stopping time sigma-algebras. Statistics and Probability Letters. 2013. 83. 1. 345–349. 10.1016/j.spl.2012.09.024. 1112.1603.