Weakly dependent random variables explained

In probability, weak dependence of random variables is a generalization of independence that is weaker than the concept of a martingale. A (time) sequence of random variables is weakly dependent if distinct portions of the sequence have a covariance that asymptotically decreases to 0 as the blocks are further separated in time. Weak dependence primarily appears as a technical condition in various probabilistic limit theorems.

Formal definition

Fix a set, a sequence of sets of measurable functions

\{l{F}d\}

infty
d=1
infty
\in\prod
d=1

{\left(Sd\toR\right)}

, a decreasing sequence

\{\theta\delta

infty
\}
\delta=1

\to0

, and a function

\psi\inl{F}2 x (Z+)2\toR+

. A sequence

\{Xn\}

infty
n=1
of random variables is

(\{l{F}d\}

infty
d=1

,\{\theta\delta\}\delta,\psi)

-weakly dependent iff, for all

j1\leqj2\leq...\leqjd<jd+\delta\leqk1\leqk2\leq...\leqke

, for all

\phi\inl{F}d

, and

\theta\inl{F}e

, we have[1]
|\operatorname{Cov}{(\phi(X
j1
,...,X
jd

),

\theta(X
k1
,...,X
ke

))}|\leq\psi(\phi,\theta,d,e)\theta\delta

Note that the covariance does not decay to uniformly in and .[2]

Common applications

Weak dependence is a sufficient weak condition that many natural instances of stochastic processes exhibit it. In particular, weak dependence is a natural condition for the ergodic theory of random functions.[3]

A sufficient substitute for independence in the Lindeberg–Lévy central limit theorem is weak dependence. For this reason, specializations often appear in the probability literature on limit theorems. These include Withers' condition for strong mixing,[4] Tran's "absolute regularity in the locally transitive sense,"[5] and Birkel's "asymptotic quadrant independence."[6]

Weak dependence also functions as a substitute for strong mixing.[7] Again, generalizations of the latter are specializations of the former; an example is Rosenblatt's mixing condition.[8]

Other uses include a generalization of the Marcinkiewicz–Zygmund inequality and Rosenthal inequalities.

Martingales are weakly dependent, so many results about martingales also hold true for weakly dependent sequences. An example is Bernstein's bound on higher moments, which can be relaxed to only require[9] [10]

\begin{align} \operatorname{E}\left[Xi\midX1,...,Xi-1\right]&=0,\\ \operatorname{E}\left[

2
X
i

\midX1,...,Xi-1\right]&\leqRi\operatorname{E}\left[

2
X
i

\right],\\ \operatorname{E}\left[

k
X
i

\midX1,...,Xi-1\right]&\leq\tfrac{1}{2}\operatorname{E}\left[

2
X
i

\midX1,...,Xi-1\right]Lk-2k! \end{align}

See also

External links

Notes and References

  1. 1999-12-01. A new weak dependence condition and applications to moment inequalities. Stochastic Processes and Their Applications. en. 84. 2. 313–342. 10.1016/S0304-4149(99)00055-1. 0304-4149. Doukhan. Paul. Louhichi. Sana. free.
  2. Book: 2007 . 190. en-gb. 10.1007/978-0-387-69952-3. 978-0-387-69951-6. Dedecker. Jérôme. Doukhan. Paul. Lang. Gabriel. Louhichi. Sana. Leon. José Rafael. José Rafael. León R.. Prieur. Clémentine. Weak Dependence: With Examples and Applications . Lecture Notes in Statistics .
  3. Wu. Wei Biao. Wei Biao Wu. Shao. Xiaofeng. June 2004. Limit theorems for iterated random functions. Journal of Applied Probability. en. 41. 2. 425–436. 10.1239/jap/1082999076. 335616. 0021-9002.
  4. Withers. C. S.. December 1981. Conditions for linear processes to be strong-mixing. Zeitschrift für Wahrscheinlichkeitstheorie und Verwandte Gebiete. en. 57. 4. 477–480. 10.1007/bf01025869. 122082639. 0044-3719. free.
  5. Tran. Lanh Tat. Recursive kernel density estimators under a weak dependence condition. Annals of the Institute of Statistical Mathematics. en. 42. 2. 305–329. 10.1007/bf00050839. 0020-3157. 1990. 120632192.
  6. 1992-07-11. Laws of large numbers under dependence assumptions. Statistics & Probability Letters. en. 14. 5. 355–362. 10.1016/0167-7152(92)90096-N. 0167-7152. Birkel. Thomas.
  7. Wu. Wei Biao. Wei Biao Wu. 2005-10-04. Nonlinear system theory: Another look at dependence. Proceedings of the National Academy of Sciences. en. 102. 40. 14150–14154. 10.1073/pnas.0506715102. 0027-8424. 16179388. 1242319. 2005PNAS..10214150W. free.
  8. Rosenblatt. M.. 1956-01-01. A Central Limit Theorem and a Strong Mixing Condition. Proceedings of the National Academy of Sciences. en. 42. 1. 43–47. 10.1073/pnas.42.1.43. 0027-8424. 16589813. 534230. 1956PNAS...42...43R. free.
  9. Fan. X.. Grama. I.. Liu. Q.. 2015. Exponential inequalities for martingales with applications. Electronic Journal of Probability. 20. 1–22. 10.1214/EJP.v20-3496. 1311.6273. 119713171.
  10. Bernstein. Serge. December 1927. Sur l'extension du théorème limite du calcul des probabilités aux sommes de quantités dépendantes. Mathematische Annalen. fr. 97. 1. 1–59. 10.1007/bf01447859. 122172457. 0025-5831.