Kirkwood approximation explained

P(x1,x2,\ldots,xn)

is given by

P\prime(x1,x2,\ldots,xn) =

n-1
\prod
i=1

\left[\prodl{Ti\subseteq

(-1)n-1-i
l{V}}p(l{T}=
i)\right]
\prodl{T n-1\subseteql{V
}p(\mathcal_)}

where

\prodl{Ti\subseteql{V}}p(l{T}i)

is the product of probabilities over all subsets of variables of size i in variable set

\scriptstylel{V}

. This kind of formula has been considered by Watanabe (1960) and, according to Watanabe, also by Robert Fano. For the three-variable case, it reduces to simply
\prime(x
P
1,x

2,x

3)=p(x1,x2)p(x2,x3)p(x1,x3)
p(x1)p(x2)p(x3)

The Kirkwood approximation does not generally produce a valid probability distribution (the normalization condition is violated). Watanabe claims that for this reason informational expressions of this type are not meaningful, and indeed there has been very little written about the properties of this measure. The Kirkwood approximation is the probabilistic counterpart of the interaction information.

Judea Pearl (1988 ยง3.2.4) indicates that an expression of this type can be exact in the case of a decomposable model, that is, a probability distribution that admits a graph structure whose cliques form a tree. In such cases, the numerator contains the product of the intra-clique joint distributions and the denominator contains the product of the clique intersection distributions.

References

Notes and References

  1. Kirkwood . John G. . Statistical Mechanics of Fluid Mixtures . The Journal of Chemical Physics . AIP Publishing . 3 . 5 . 1935 . 0021-9606 . 10.1063/1.1749657 . 300โ€“313. 1935JChPh...3..300K .