Lewandowski-Kurowicka-Joe distribution explained

Lewandowski-Kurowicka-Joe distribution
Type:mass
Notation:

\operatorname{LKJ}(η)

Parameters:

η\in(0,infty)

(shape)
Support:

R

is a positive-definite matrix with unit diagonal
Mean:the identity matrix

In probability theory and Bayesian statistics, the Lewandowski-Kurowicka-Joe distribution, often referred to as the LKJ distribution, is a probability distribution over positive definite symmetric matrices with unit diagonals.[1]

Introduction

The LKJ distribution was first introduced in 2009 in a more general context [2] by Daniel Lewandowski, Dorota Kurowicka, and Harry Joe. It is an example of the vine copula, an approach to constrained high-dimensional probability distributions.

The distribution has a single shape parameter

η

and the probability density function for a

d x d

matrix

R

is

p(R;η)=C x [\det(R)]η-1

with normalizing constant
d
\sum(-2+d-k)(d-k)
k=1
C=2
d-1
\prod
k=1

\left[B\left(η+(d-k-1)/2,η+(d-k-1)/2\right)\right]d-k

, a complicated expression including a product over Beta functions. For

η=1

, the distribution is uniform over the space of all correlation matrices; i.e. the space of positive definite matrices with unit diagonal.

Usage

The LKJ distribution is commonly used as a prior for correlation matrix in hierarchical Bayesian modeling. Hierarchical Bayesian modeling often tries to make an inference on the covariance structure of the data, which can be decomposed into a scale vector and correlation matrix.[3] Instead of the prior on the covariance matrix such as the inverse-Wishart distribution, LKJ distribution can serve as a prior on the correlation matrix along with some suitable prior distribution on the scale vector. It has been implemented as part of the Stan probabilistic programming language and as a library linked to the Turing.jl probabilistic programming library in Julia.

External links

Notes and References

  1. Book: Gelman . Andrew . Bayesian Data Analysis . Carlin . John B. . Stern . Hal S. . Dunson . David B. . Vehtari . Aki . Rubin . Donald B. . Chapman and Hall/CRC . 2013 . 978-1-4398-4095-5 . Third . Andrew Gelman . John Carlin (professor) . Donald Rubin.
  2. Lewandowski. Daniel. Kurowicka. Dorota. Joe. Harry. 2009. Generating Random Correlation Matrices Based on Vines and Extended Onion Method. Journal of Multivariate Analysis. 100. 9 . 1989–2001. 10.1016/j.jmva.2009.04.008 . free.
  3. Barnard . John . McCulloch . Robert . Meng . Xiao-Li . Modeling Covariance Matrices in Terms of Standard Deviations and Correlations, with Application to Shrinkage . 2000 . Statistica Sinica . 10 . 4 . 1281–1311 . 24306780 . 1017-0405.