Complex inverse Wishart distribution explained

The complex inverse Wishart distribution is a matrix probability distribution defined on complex-valued positive-definite matrices and is the complex analog of the real inverse Wishart distribution. The complex Wishart distribution was extensively investigated by Goodman^[1] while the derivation of the inverse is shown by Shaman^[2] and others. It has greatest application in least squares optimization theory applied to complex valued data samples in digital radio communications systems, often related to Fourier Domain complex filtering.

Letting

S _{p} = \sum ^{\nu} _{j =1} G _{j} G ^{H} _{j} be the sample covariance of independent complex p-vectors G _{j} whose Hermitian covariance has complex Wishart distribution S \sim l{CW}( \Sigma,\nu,p) with mean value \Sigma and \nu degrees of freedom, then the pdf of X = S ^{-1} follows the complex inverse Wishart distribution.

Density

If

S _{p} is a sample from the complex Wishart distribution l{CW}({ \Sigma},\nu,p) such that, in the simplest case, \nu \ge p and \left| S \right | > 0 then X = S ^{-1} is sampled from the inverse complex Wishart distribution l{CW} ^{-1} ({ \Psi},\nu,p) where \Psi = \Sigma ^{-1} .

The density function of

X is f _{x} ( x ) = (\left| \Psi\right| ^{\nu})/(l{C) \Gamma _{p(\nu)}} \left| x \right| ^{-(\nu+p)} e ^{-\operatorname{tr} ( \Psi x ^{-1} )} where l{C}\Gamma _{p(\nu)} is the complex multivariate Gamma functionl{C}\Gamma _{p(\nu)} = \pi ^{\tfrac{1} { 2 }p(p -1 )}\prod ^{p} _{j =1} \Gamma(\nu - j +1 )

Moments

The variances and covariances of the elements of the inverse complex Wishart distribution are shown in Shaman's paper above while Maiwald and Kraus^[3] determine the 1-st through 4-th moments.

Shaman finds the first moment to be

E [ l C W ^{-1} ] = (1)/(n - p) \Psi ^{-1} , n > p

and, in the simplest case

\Psi = I _{p} , given d = (1)/(n - p) , thenE \left [vec( l C W ^{-1} ^{3} ) \right ] = \begin{bmatrix} d & 0 & 0 & 0 & d & 0 & 0 & 0 & d \\ \end{bmatrix}

The vectorised covariance is

Cov \left [vec( l C W ^{-1} ^{p} ) \right ] = b \left( I _{p} ⊗ I _{p} \right ) + c vecI _{p} \left ( vecI _{p} \right ) ^{T +} (a - b - c) J where J is a p ^{2} x p ^{2} identity matrix with ones in diagonal positions 1 + (p + 1 )j, j = 0 , 1 , ... p -1 and a, b, c are real constants such that for n > p + 1 a = (1)/((n - p) ^{2} (n - p -1 )) , marginal diagonal variancesb = (1)/((n - p +1 )(n - p) (n - p -1 )) , off-diagonal variances.c = (1)/((n - p +1 )(n - p) ^{2} (n - p -1 )) , intra-diagonal covariancesFor \Psi = I _{3} , we get the sparse matrix:Cov \left [vec( l C W ^{-1} ^{3} ) \right ] = \begin{bmatrix} a & ⋅ & ⋅ & ⋅ & c & ⋅ & ⋅ & ⋅ & c \\ ⋅ & b & ⋅ & ⋅ & ⋅ & ⋅ & ⋅ & ⋅ & ⋅ \\ ⋅ & ⋅ & b & ⋅ & ⋅ & ⋅ & ⋅ & ⋅ & ⋅ \\ ⋅ & ⋅ & ⋅ & b & ⋅ & ⋅ & ⋅ & ⋅ & ⋅ \\ c & ⋅ & ⋅ & ⋅ & a & ⋅ & ⋅ & ⋅ & c \\ ⋅ & ⋅ & ⋅ & ⋅ & ⋅ & b & ⋅ & ⋅ & ⋅ \\ ⋅ & ⋅ & ⋅ & ⋅ & ⋅ & ⋅ & b & ⋅ & ⋅ \\ ⋅ & ⋅ & ⋅ & ⋅ & ⋅ & ⋅ & ⋅ & b & ⋅ \\ c & ⋅ & ⋅ & ⋅ & c & ⋅ & ⋅ & ⋅ & a \\ \end{bmatrix}

Eigenvalue distributions

The joint distribution of the real eigenvalues of the inverse complex (and real) Wishart are found in Edelman's paper^[4] who refers back to an earlier paper by James.^[5] In the non-singular case, the eigenvalues of the inverse Wishart are simply the inverted values for the Wishart.Edelman also characterises the marginal distributions of the smallest and largest eigenvalues of complex and real Wishart matrices.

Notes and References

1. Goodman. N R. 1963. Statistical Analysis Based on a Certain Multivariate Complex Gaussian Distribution: an Introduction. Ann. Math. Statist.. 34. 1. 152–177. 10.1214/aoms/1177704250 . free.
2. Shaman. Paul. 1980. The Inverted Complex Wishart Distribution and its Application to Spectral Estimation. Journal of Multivariate Analysis. 10. 51–59. 10.1016/0047-259X(80)90081-0 .
3. Book: Maiwald. Dirk. Kraus. Dieter. 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing . 1997. On Moments of Complex Wishart and Complex Inverse Wishart Distributed Matrices. IEEE Icassp 1997. 5. 3817–3820. 10.1109/ICASSP.1997.604712. 0-8186-7919-0 . 14918978 .
4. Edelman. Alan. October 1998. Eigenvalues and Condition Numbers of Random Matrices. SIAM J. Matrix Anal. Appl.. 9. 4. 543–560. 10.1137/0609045 . 1721.1/14322 . free.
5. James. A. T.. 1964. Distributions of Matrix Variates and Latent Roots Derived from Normal Samples.. Ann. Math. Statist.. 35. 2 . 475–501. 10.1214/aoms/1177703550 . free.