Lewandowski-Kurowicka-Joe distribution explained

Lewandowski-Kurowicka-Joe distribution
Type:mass
Notation:

\operatorname{LKJ}(η)

Parameters:

η\in(0,infty)

(shape)
Support:

R

is a positive-definite matrix with unit diagonal
Mean:the identity matrix

In probability theory and Bayesian statistics, the Lewandowski-Kurowicka-Joe distribution, often referred to as the LKJ distribution, is a probability distribution over positive definite symmetric matrices with unit diagonals.[1]

Introduction

The LKJ distribution was first introduced in 2009 in a more general context [2] by Daniel Lewandowski, Dorota Kurowicka, and Harry Joe. It is an example of the vine copula, an approach to constrained high-dimensional probability distributions.

The distribution has a single shape parameter

η

and the probability density function for a

d x d

matrix

R

is

p(R;η)=C x [\det(R)]η-1

with normalizing constant
d
\sum(-2+d-k)(d-k)
k=1
C=2
d-1
\prod
k=1

\left[B\left(η+(d-k-1)/2,η+(d-k-1)/2\right)\right]d-k

, a complicated expression including a product over Beta functions. For

η=1

, the distribution is uniform over the space of all correlation matrices; i.e. the space of positive definite matrices with unit diagonal.

Usage

The LKJ distribution is commonly used as a prior for correlation matrix in Bayesian hierarchical modeling. Bayesian hierarchical modeling often tries to make an inference on the covariance structure of the data, which can be decomposed into a scale vector and correlation matrix.[3] Instead of the prior on the covariance matrix such as the inverse-Wishart distribution, LKJ distribution can serve as a prior on the correlation matrix along with some suitable prior distribution on the scale vector. It has been implemented in several probabilistic programming languages, including Stan and PyMC.

External links

Notes and References

  1. Book: Gelman . Andrew . Bayesian Data Analysis . Carlin . John B. . Stern . Hal S. . Dunson . David B. . Vehtari . Aki . Rubin . Donald B. . Chapman and Hall/CRC . 2013 . 978-1-4398-4095-5 . Third . Andrew Gelman . John Carlin (professor) . Donald Rubin.
  2. Lewandowski. Daniel. Kurowicka. Dorota. Joe. Harry. 2009. Generating Random Correlation Matrices Based on Vines and Extended Onion Method. Journal of Multivariate Analysis. 100. 9 . 1989–2001. 10.1016/j.jmva.2009.04.008 . free.
  3. Barnard . John . McCulloch . Robert . Meng . Xiao-Li . Modeling Covariance Matrices in Terms of Standard Deviations and Correlations, with Application to Shrinkage . 2000 . Statistica Sinica . 10 . 4 . 1281–1311 . 24306780 . 1017-0405.