In probability, weak dependence of random variables is a generalization of independence that is weaker than the concept of a martingale. A (time) sequence of random variables is weakly dependent if distinct portions of the sequence have a covariance that asymptotically decreases to 0 as the blocks are further separated in time. Weak dependence primarily appears as a technical condition in various probabilistic limit theorems.
Fix a set, a sequence of sets of measurable functions
\{l{F}d\}
infty | |
d=1 |
infty | |
\in\prod | |
d=1 |
{\left(Sd\toR\right)}
\{\theta\delta
infty | |
\} | |
\delta=1 |
\to0
\psi\inl{F}2 x (Z+)2\toR+
\{Xn\}
infty | |
n=1 |
(\{l{F}d\}
infty | |
d=1 |
,\{\theta\delta\}\delta,\psi)
j1\leqj2\leq...\leqjd<jd+\delta\leqk1\leqk2\leq...\leqke
\phi\inl{F}d
\theta\inl{F}e
|\operatorname{Cov}{(\phi(X | |
j1 |
,...,X | |
jd |
),
\theta(X | |
k1 |
,...,X | |
ke |
))}|\leq\psi(\phi,\theta,d,e)\theta\delta
Note that the covariance does not decay to uniformly in and .[2]
Weak dependence is a sufficient weak condition that many natural instances of stochastic processes exhibit it. In particular, weak dependence is a natural condition for the ergodic theory of random functions.[3]
A sufficient substitute for independence in the Lindeberg–Lévy central limit theorem is weak dependence. For this reason, specializations often appear in the probability literature on limit theorems. These include Withers' condition for strong mixing,[4] Tran's "absolute regularity in the locally transitive sense,"[5] and Birkel's "asymptotic quadrant independence."[6]
Weak dependence also functions as a substitute for strong mixing.[7] Again, generalizations of the latter are specializations of the former; an example is Rosenblatt's mixing condition.[8]
Other uses include a generalization of the Marcinkiewicz–Zygmund inequality and Rosenthal inequalities.
Martingales are weakly dependent, so many results about martingales also hold true for weakly dependent sequences. An example is Bernstein's bound on higher moments, which can be relaxed to only require[9] [10]
\begin{align} \operatorname{E}\left[Xi\midX1,...,Xi-1\right]&=0,\\ \operatorname{E}\left[
2 | |
X | |
i |
\midX1,...,Xi-1\right]&\leqRi\operatorname{E}\left[
2 | |
X | |
i |
\right],\\ \operatorname{E}\left[
k | |
X | |
i |
\midX1,...,Xi-1\right]&\leq\tfrac{1}{2}\operatorname{E}\left[
2 | |
X | |
i |
\midX1,...,Xi-1\right]Lk-2k! \end{align}