Itô's lemma explained

In mathematics, Itô's lemma or Itô's formula (also called the Itô–Doeblin formula, especially in the French literature) is an identity used in Itô calculus to find the differential of a time-dependent function of a stochastic process. It serves as the stochastic calculus counterpart of the chain rule. It can be heuristically derived by forming the Taylor series expansion of the function up to its second derivatives and retaining terms up to first order in the time increment and second order in the Wiener process increment. The lemma is widely employed in mathematical finance, and its best known application is in the derivation of the Black–Scholes equation for option values.

Kiyoshi Itô published a proof of the formula in 1951.^[1]

Motivation

Suppose we are given the stochastic differential equation$$dX\_t\; =\; \backslash mu\_t\backslash \; dt\; +\; \backslash sigma\_t\backslash \; dB\_t,$$where is a Wiener process and the functions

\mu _{t,} \sigma _{t} are deterministic (not stochastic) functions of time. In general, it's not possible to write a solution X _{t} directly in terms of B _{t.} However, we can formally write an integral solution$$X\_t\; =\; \backslash int\_0^t\; \backslash mu\_s\backslash \; ds\; +\; \backslash int\_0^t\; \backslash sigma\_s\backslash \; dB\_s.$$

This expression lets us easily read off the mean and variance of

X _{t} (which has no higher moments). First, notice that every d B _{t} individually has mean 0, so the expected value of X _{t} is simply the integral of the drift function:$$\backslash mathrm\; E[X\_t]=\backslash int\_0^t\; \backslash mu\_s\backslash \; ds.$$

Similarly, because the

dB terms have variance 1 and no correlation with one another, the variance of X _{t} is simply the integral of the variance of each infinitesimal step in the random walk:$$\backslash mathrm[X\_t]\; =\; \backslash int\_0^t\backslash sigma\_s^2\backslash \; ds.$$

However, sometimes we are faced with a stochastic differential equation for a more complex process

Y _{t,} in which the process appears on both sides of the differential equation. That is, say$$dY\_t\; =\; a\_1(Y\_t,t)\; \backslash \; dt\; +\; a\_2(Y\_t,t)\backslash \; dB\_t,$$for some functions a _{1} and a _{2.} In this case, we cannot immediately write a formal solution as we did for the simpler case above. Instead, we hope to write the process Y _{t} as a function of a simpler process X _{t} taking the form above. That is, we want to identify three functions f(t,x), \mu _{t,} and \sigma _{t,} such that Y _{t=f(t,} X _{t)} and dX _{t} = \mu _{t dt} + \sigma _{t dB} _{t.} In practice, Ito's lemma is used in order to find this transformation. Finally, once we have transformed the problem into the simpler type of problem, we can determine the mean and higher moments of the process.

Informal derivation

A formal proof of the lemma relies on taking the limit of a sequence of random variables. This approach is not presented here since it involves a number of technical details. Instead, we give a sketch of how one can derive Itô's lemma by expanding a Taylor series and applying the rules of stochastic calculus.

Suppose is an Itô drift-diffusion process that satisfies the stochastic differential equation

dX _{t=} \mu _{t} dt + \sigma _{t} dB _{t,}

where is a Wiener process.

If is a twice-differentiable scalar function, its expansion in a Taylor series is

df = (\partial f)/(\partial t) dt + (1)/(2) (\partial ^{2} f)/(\partial t ^{2}) dt ^{2} + … + (\partial f)/(\partial x) dx + (1)/(2) (\partial ^{2} f)/(\partial x ^{2}) dx ^{2} + … .

Substituting for and therefore for gives

df = (\partial f)/(\partial t) dt + (1)/(2) (\partial ^{2} f)/(\partial t ^{2}) dt ^{2} + … + (\partial f)/(\partial x) (\mu _{tdt} + \sigma _{tdB} _{t)} + (1)/(2) (\partial ^{2} f)/(\partial x ^{2}) \left (\mu ^{2 (dt)} _{t} ^{2} + 2 \mu _{t\sigma} _{tdtdB} _{t} + \sigma ^{2} _{t)} \right ) + … .

In the limit, the terms and tend to zero faster than, which is . Setting the and terms to zero, substituting for (due to the quadratic variation of a Wiener process), and collecting the and terms, we obtain

df = \left( (\partial f)/(\partial t) + \mu _{t (\partial f)/(\partial x)} + (\sigma ^{2} _{t})/(2) (\partial ^{2} f)/(\partial x ^{2}) \right)dt + \sigma _{t (\partial f)/(\partial x)} dB _{t}

as required.

Geometric intuition

Suppose we know that

X _{t,} X _{t+dt} are two jointly-Gaussian distributed random variables, and f is nonlinear but has continuous second derivative, then in general, neither of f(X _{t),} f(X _{t+dt} ) is Gaussian, and their joint distribution is also not Gaussian. However, since X _{t+dt} \mid X _{t} is Gaussian, we might still find f(X _{t+dt} ) \mid f(X _{t)} is Gaussian. This is not true when dt is finite, but when dt becomes infinitesimal, this becomes true.

The key idea is that

X _{t+dt} = X _{t} + \mu _{t} dt + dW _{t} has a deterministic part and a noisy part. When f is nonlinear, the noisy part has a deterministic contribution. If f is convex, then the deterministic contribution is positive (by Jensen's inequality).

To find out how large the contribution is, we write

X _{t} = X _{t} + \mu _{t} dt + \sigma _{t} \sqrt{dt} z , where z is a standard Gaussian, then perform Taylor expansion. (X_t) (\sigma_t^2 z^2 \, dt + 2 \mu_t \sigma_t z \, dt^ + \mu_t^2 dt^2) + o(dt) \\&= \left(f(X_t) + f'(X_t) \mu_t \, dt + \frac 12 f(X_t) \sigma_t^2 \, dt + o(dt)\right) + \left(f'(X_t)\sigma_t \sqrt \, z + \frac 12 f(X_t) \sigma_t^2 (z^2-1) \, dt + o(dt)\right)\endWe have split it into two parts, a deterministic part, and a random part with mean zero. The random part is non-Gaussian, but the non-Gaussian parts decay faster than the Gaussian part, and at the dt \to 0 limit, only the Gaussian part remains. The deterministic part has the expected f(X _{t)} + f'(X _{t)} \mu _{t} dt , but also a part contributed by the convexity: (12)/(f''(X) _{t)} \sigma ^{2} _{t} dt .

To understand why there should be a contribution due to convexity, consider the simplest case of geometric Brownian walk (of the stock market):

S _{t+dt} = S _{t} ( 1 + dB _{t)} . In other words, d( ln S _{t)} = dB _{t} . Let X _{t} = ln S _{t} , then S _{t} = e ^{X _{t}} , and X _{t} is a Brownian walk. However, although the expectation of X _{t} remains constant, the expectation of S _{t} grows. Intuitively it is because the downside is limited at zero, but the upside is unlimited. That is, while X _{t} is normally distributed, S _{t} is log-normally distributed.

Mathematical formulation of Itô's lemma

In the following subsections we discuss versions of Itô's lemma for different types of stochastic processes.

Itô drift-diffusion processes (due to: Kunita–Watanabe)

In its simplest form, Itô's lemma states the following: for an Itô drift-diffusion process

dX _{t=} \mu _{t} dt + \sigma _{t} dB _{t}

and any twice differentiable scalar function of two real variables and, one has

df(t,X _{t)} = \left( (\partial f)/(\partial t) + \mu _{t} (\partial f)/(\partial x) + (\sigma ^{2} _{t})/(2) (\partial ^{2f})/(\partial x ^{2}) \right)dt + \sigma _{t} (\partial f)/(\partial x) dB _{t.}

This immediately implies that is itself an Itô drift-diffusion process.

In higher dimensions, if

X _{t} = (X ^{1} _{t,} X ^{2} _{t,} \ldots, X ^{T} _{t)} is a vector of Itô processes such thatd X _{t} = \boldsymbol{\mu} _{t} dt + G _{t} d B _{t}

for a vector

\boldsymbol{\mu} _{t} and matrix G _{t} , Itô's lemma then states that\begin{align} df(t, X _{t)} & = (\partial f)/(\partial t) dt + \left (\nabla _{X} f \right ) ^{T} d X _{t} + (1)/(2) \left(d X _{t} \right ) ^{T} \left( H _{X} f \right) d X _{t,} \\[ 4 pt] & = \left\{ (\partial f)/(\partial t) + \left (\nabla _{X} f \right) ^{T} \boldsymbol{\mu} _{t} + (1)/(2) \operatorname{Tr} \left[ G ^{T} _{t} \left( H _{X} f \right) G _{t} \right] \right\} dt + \left (\nabla _{X} f \right) ^{T} G _{t} d B _{t \end{align}}

where

\nabla _{X} f is the gradient of w.r.t., is the Hessian matrix of w.r.t., and is the trace operator.

Poisson jump processes

We may also define functions on discontinuous stochastic processes.

Let be the jump intensity. The Poisson process model for jumps is that the probability of one jump in the interval is plus higher order terms. could be a constant, a deterministic function of time, or a stochastic process. The survival probability is the probability that no jump has occurred in the interval . The change in the survival probability is

d p _{s(t)} = - p _{s(t)} h(t) dt.

So

p _{s(t)} = \exp \left( - \int ^{t} _{0} h(u) du \right).

Let be a discontinuous stochastic process. Write

S(t ^{-)} for the value of S as we approach t from the left. Write d _{j} S(t) for the non-infinitesimal change in as a result of a jump. Thend _{j} S(t) = \lim _{\Delta} (S(t + \Delta t) - S(t ^{-))}

Let z be the magnitude of the jump and let

η (S(t ^{-),z)} be the distribution of z. The expected magnitude of the jump isE[d _{j} S(t)] = h(S(t ^{-))} dt \int _{z} z η (S(t ^{-),z)} dz.

Define

d J _{S(t)} , a compensated process and martingale, asd J _{S(t)=d} _{j} S(t) - E[d _{j} S(t)] = S(t) - S(t ^{-)} - \left ( h(S(t ^{- ))\int} _{z} z η \left (S(t ^{-),z} \right) dz \right ) dt.

Then

d _{j} S(t) = E[d _{j} S(t)] + d J _{S(t)} = h(S(t ^{-))} \left (\int _{z} z η (S(t ^{-),z)} dz \right ) dt + d J _{S(t).}

Consider a function

g(S(t),t) of the jump process . If jumps by then jumps by . is drawn from distribution η _{g} which may depend on g(t ^{-)} , dg and S(t ^{-)} . The jump part of g isg(t) - g(t ^{-)} = h(t) dt \int _{\Delta} \Delta g η _{g( ⋅ )} d\Delta g + d J _{g(t).}

If

S contains drift, diffusion and jump parts, then Itô's Lemma for g(S(t),t) isd g(t) = \left( (\partial g)/(\partial t) + \mu (\partial g)/(+ \partial S) (\sigma ^{2})/(2) (\partial ^{2} g)/(\partial S ^{2}) + h(t) \int _{\Delta} \left (\Delta g η _{g( ⋅ )} d{\Delta}g \right ) \right) dt + (\partial g)/(\partial S) \sigma d W(t) + d J _{g(t).}

Itô's lemma for a process which is the sum of a drift-diffusion process and a jump process is just the sum of the Itô's lemma for the individual parts.

Non-continuous semimartingales

Itô's lemma can also be applied to general -dimensional semimartingales, which need not be continuous. In general, a semimartingale is a càdlàg process, and an additional term needs to be added to the formula to ensure that the jumps of the process are correctly given by Itô's lemma.For any cadlag process, the left limit in is denoted by, which is a left-continuous process. The jumps are written as . Then, Itô's lemma states that if is a -dimensional semimartingale and f is a twice continuously differentiable real valued function on then f(X) is a semimartingale, and

\begin{align} f(X _{t) &= f(X} _{0) +\sum} ^{t} ^{0} f _{i} (X _{s-} )dX ^{i} _{s +} (1)/(2) \sum ^{d} _{i,j =1} \int ^{t} _{0} f _{i,j} (X _{s-} )d[X ^{i,X} ^{j]} ^{s\\ & +} \sum _{s\le} \left(\Delta f(X _{s)-\sum} ^{df} ^{i} (X _{s-} )\Delta X ^{i} _{s - (1)/(2)} \sum ^{d} _{i,j =1} f _{i,j} (X _{s-} )\Delta X ^{i} _{s} \Delta X ^{j} _{s\right). \end{align}}

This differs from the formula for continuous semi-martingales by the additional term summing over the jumps of X, which ensures that the jump of the right hand side at time is Δf(X_t).

Multiple non-continuous jump processes

There is also a version of this for a twice-continuously differentiable in space once in time function f evaluated at (potentially different) non-continuous semi-martingales which may be written as follows:

\begin{align} f(t,X ^{d} _{t) =} {} & f( 0 ,X ^{d} _{0 ) + \int} ^{t} ^{0} • f ({s ^{1} _{s _{-}} ,\ldots,X ^{d} _{s _{-}} ) d{s}\\ & {} + \sum ^{d} _{i =1} \int ^{t} _{0} f _{i} ({s ^{1} _{s _{-}} ,\ldots,X ^{d} _{s _{-}} )dX ^{(c,i)} _{s\\ &} {} + (1)/(2) \sum ^{d} _{i _{1,\ldots,i} _{d=1}} \int ^{t} _{0} f _{i _{1,\ldots,i} _{d}} ({s ^{1} _{s _{-}} ,\ldots,X ^{d} _{s _{-}} )dX ^{(c,i _{1)}} _{s …} X ^{(c,i _{d)}} _{s\\ &} {} + \sum _{0<s\leq} \left[ f(s,X ^{d} _{s)} - f({s ^{1} _{s _{-}} ,\ldots,X ^{d} _{s _{-}} ) \right] \end{align}

where

X ^{c,i} denotes the continuous part of the ith semi-martingale.

Examples

Geometric Brownian motion

dS _{t} = \sigma S _{tdB} _{t} + \mu S _{tdt} , for a Brownian motion B. Applying Itô's lemma with f(S _{t)} = log (S _{t)} gives\begin{align} df & = f ^{\prime(S} _{t)dS} _{t} + (1)/(2) f ^{\prime\prime} (S _{t)} (dS ^{2} _{t)} \\[ 4 pt] & = (1)/(S _{t}) dS _{t} + (1)/(2) ( - S ^{-2} _{t} ) (S ^{2 \sigma} _{t} ^{2dt)} \\[ 4 pt] & = (1)/(S _{t}) \left( \sigma S _{tdB} _{t} + \mu S _{tdt\right)} - (1)/(2) \sigma ^{2dt} \\[ 4 pt] & = \sigmadB _{t} + \left (\mu - \tfrac{\sigma ^{2}{2}} \right )dt. \end{align}

It follows that

log (S _{t)} = log (S _{0)} + \sigma B _{t} + \left (\mu - \tfrac{\sigma ^{2}{2}} \right )t,

exponentiating gives the expression for S,

S _{t=S} _{0\exp\left(\sigma} B _{t+} \left (\mu - \tfrac{\sigma ^{2}{2}} \right )t\right).

The correction term of corresponds to the difference between the median and mean of the log-normal distribution, or equivalently for this distribution, the geometric mean and arithmetic mean, with the median (geometric mean) being lower. This is due to the AM–GM inequality, and corresponds to the logarithm being concave (or convex upwards), so the correction term can accordingly be interpreted as a convexity correction. This is an infinitesimal version of the fact that the annualized return is less than the average return, with the difference proportional to the variance. See geometric moments of the log-normal distribution for further discussion.

The same factor of appears in the d₁ and d₂ auxiliary variables of the Black–Scholes formula, and can be interpreted as a consequence of Itô's lemma.

Doléans-Dade exponential

The Doléans-Dade exponential (or stochastic exponential) of a continuous semimartingale X can be defined as the solution to the SDE with initial condition . It is sometimes denoted by .Applying Itô's lemma with f(Y) = log(Y) gives

\begin{align} d log (Y) & = (1)/(Y) dY - (1)/(2 Y ^{2}) d[Y] \\[ 6 pt] & = dX - \tfrac{ 1 }{ 2 }d[X]. \end{align}

Exponentiating gives the solution

Y _{t} = \exp\left(X _{t-X} _{0-\tfrac{1}{2}} [X] _{t\right).}

Black–Scholes formula

Itô's lemma can be used to derive the Black–Scholes equation for an option.^[2] Suppose a stock price follows a geometric Brownian motion given by the stochastic differential equation . Then, if the value of an option at time is f(t, S_t), Itô's lemma gives

df(t,S _{t)} = \left( (\partial f)/(\partial t) + (1)/(2) \left(S ^{2 (\partial ^{2} f)/(\partial S ^{2})} _{t\sigma\right)} \right)dt + (\partial f)/(\partial S) dS _{t.}

The term represents the change in value in time dt of the trading strategy consisting of holding an amount of the stock. If this trading strategy is followed, and any cash held is assumed to grow at the risk free rate r, then the total value V of this portfolio satisfies the SDE

dV _{t} = r\left(V _{t - (\partial f)/(\partial S)} S _{t\right)dt} + (\partial f)/(\partial S) dS _{t.}

This strategy replicates the option if V = f(t,S). Combining these equations gives the celebrated Black–Scholes equation

(\partial f)/(\partial t) + (\sigma ^{2S} ^{2})/(2) (\partial ^{2} f)/(\partial S ^{2}) + rS (\partial f)/(\partial S) - rf = 0 .

Product rule for Itô processes

Let

X _{t} be a two-dimensional Ito process with SDE:d X _{t} = d\begin{pmatrix}X ^{2 \end{pmatrix}} _{t} = \begin{pmatrix}\mu ^{2 \end{pmatrix}} _{t} dt + \begin{pmatrix}\sigma ^{2 \end{pmatrix}} _{t} dB _{t}

Then we can use the multi-dimensional form of Ito's lemma to find an expression for

d(X ^{2 )} _{t} .

We have

\mu _{t=\begin{pmatrix}\mu} ^{2 \end{pmatrix}} ^{t} and G = \begin{pmatrix}\sigma ^{2 \end{pmatrix}} _{t} .

We set

f(t, X _{t)=X} ^{2} ^{t} and observe that (\partial f)/(\partial t) =0 , (\nabla ^{T} _{Xf)} = (X ^{1 )} _{t} and H _{Xf=\begin{pmatrix}0&1\\1&0\end{pmatrix}}

Substituting these values in the multi-dimensional version of the lemma gives us:

\begin{align} d(X ^{2 )} _{t} & = df(t, X _{t)\\ &=} 0 ⋅ dt + (X ^{1 )} _{t} d X _{t} + (12)/((dX) ^{2} ^{t} dX ^{1} _{t} + X ^{1} _{t} dX ^{2} _{t} + dX ^{1} _{t} dX ^{2} _{t} \end{align}

This is a generalisation of Leibniz's product rule to Ito processes, which are non-differentiable.

Further, using the second form of the multidimensional version above gives us

\begin{align} d(X ^{2 ) & = \left\{ 0} _{t} + (X ^{2 \end{pmatrix} +} _{t} (12)/(\operatorname{Tr} \left[ (\sigma) ^{2 \end{pmatrix} \right] \right\}} ^{t} dt + (X ^{1} _{t} + X ^{1} _{t} \sigma ^{2 )} _{t} dB _{t\\[5pt] &=} \left(X ^{1} _{t} + X ^{1} _{t} \mu ^{2} _{t} + \sigma ^{2 \right)} _{t} dt + (X ^{1} _{t} + X ^{1} _{t} \sigma ^{2 )} _{t} dB _{t \end{align}}

so we see that the product

X ^{2} _{t} is itself an Itô drift-diffusion process.

Itô's formula for functions with finite quadratic variation

An idea by Hans Föllmer was to extend Itô's formula to functions with finite quadratic variation.^[3]

Let

f\in C ^{2} be a real-valued function and x:[ 0 , inf ty]\to R a RCLL function with finite quadratic variation. Then\begin{align} f(x _{t)} = {} & f(x _{0)+\int} ^{t} ^{0} f'(x _{s-} ) d x _{s} + (1)/(2) \int _{]0,t]} f''(x _{s-} ) d[x,x] _{s \\&+\sum} _{0\leq} \left(f(x _{s)-f(x} _{s-} ) - f'(x _{s-} )\Delta x _{s} - (1)/(2) f''(x _{s-} )(\Delta x ^{2 )\right).\end{align}} _{s)}

Infinite-dimensional formulas

There exist a couple of extensions to infinite-dimensional spaces (e.g. Pardoux,^[4] Gyöngy-Krylov,^[5] Brzezniak-van Neerven-Veraar-Weis^[6]).

See also

• Wiener process
• Itô calculus
• Feynman–Kac formula
• Euler–Maruyama method

References

• Kiyosi Itô (1944). Stochastic Integral. Proc. Imperial Acad. Tokyo 20, 519–524. This is the paper with the Ito Formula; Online
• Kiyosi Itô (1951). On stochastic differential equations. Memoirs, American Mathematical Society 4, 1–51. Online
• Bernt Øksendal (2000). Stochastic Differential Equations. An Introduction with Applications, 5th edition, corrected 2nd printing. Springer. . Sections 4.1 and 4.2.
• Philip E Protter (2005). Stochastic Integration and Differential Equations, 2nd edition. Springer. . Section 2.7.

External links

• Derivation, Prof. Thayer Watkins
• Informal proof, optiontutor

Notes and References

1. Kiyoshi. Itô. 1951. On a formula concerning stochastic differentials. Nagoya Math. J.. 3. 55–65. 10.1017/S0027763000012216 .
2. Book: Malliaris, A. G. . Stochastic Methods in Economics and Finance . New York . North-Holland . 1982 . 0-444-86201-3 . 220–223 .
3. Hans. Föllmer. Calcul d'Ito sans probabilités. Séminaire de probabilités de Strasbourg. 15. 1981. 143–144.
4. Étienne. Pardoux. Équations aux dérivées partielles stochastiques de type monotone. Séminaire Jean Leray. 3. 1974.
5. Encyclopedia: István. Gyöngy. Nikolay Vladim Vladimirovich. Krylov. 1981. Ito formula in banach spaces. M. Arató. D. Vermes, D.. A.V. Balakrishnan. Stochastic Differential Systems. Lecture Notes in Control and Information Sciences . 36. 69–73 . Springer, Berlin, Heidelberg. 10.1007/BFb0006409. 3-540-11038-0 .
6. Ito's formula in UMD Banach spaces and regularity of solutions of the Zakai equation. Zdzislaw. Brzezniak. Jan M. A. M.. van Neerven. Mark C.. Veraar. Lutz. Weis. Journal of Differential Equations. 245. 1. 2008. 30–58 . 10.1016/j.jde.2008.03.026 . 0804.0302 .