Matrix determinant lemma explained

In mathematics, in particular linear algebra, the matrix determinant lemma computes the determinant of the sum of an invertible matrix A and the dyadic product, uv^T, of a column vector u and a row vector v^T.^{[1] [2]}

Statement

Suppose A is an invertible square matrix and u, v are column vectors. Then the matrix determinant lemma states that

\det\left( A + uv ^{sf{T}\right)=} \left( 1 + v ^{sf{T}A} ^{-1} u \right)\det\left( A \right).

Here, uv^T is the outer product of two vectors u and v.

The theorem can also be stated in terms of the adjugate matrix of A:

\det\left( A + uv ^{sf{T}\right)=} \det\left( A \right) + v ^{sf{T}adj\left(A\right)u,}

in which case it applies whether or not the square matrix A is invertible.

Proof

First the proof of the special case A = I follows from the equality:^[3]

\begin{pmatrix} I & 0 \ v ^{sf{T}&} 1 \end{pmatrix} \begin{pmatrix} I + uv ^{sf{T}&} u \ 0 & 1 \end{pmatrix} \begin{pmatrix} I & 0 \ - v ^{sf{T}&} 1 \end{pmatrix} = \begin{pmatrix} I & u \ 0 & 1 + v ^{sf{T}u\end{pmatrix}.}

The determinant of the left hand side is the product of the determinants of the three matrices. Since the first and third matrix are triangular matrices with unit diagonal, their determinants are just 1. The determinant of the middle matrix is our desired value. The determinant of the right hand side is simply (1 + v^Tu). So we have the result:

\det\left( I + uv ^{sf{T}\right)=} \left( 1 + v ^{sf{T}u\right).}

Then the general case can be found as:

\begin{align} \det\left( A + uv ^{sf{T}\right)} & = \det\left( A \right) \det\left( I + \left( A ^{-1} u \right) v ^{sf{T}\right)\\} & = \det\left( A \right) \left( 1 + v ^{sf{T}\left(A} ^{-1} u \right)\right). \end{align}

Application

If the determinant and inverse of A are already known, the formula provides a numerically cheap way to compute the determinant of A corrected by the matrix uv^T. The computation is relatively cheap because the determinant of A + uv^T does not have to be computed from scratch (which in general is expensive). Using unit vectors for u and/or v, individual columns, rows or elements^[4] of A may be manipulated and a correspondingly updated determinant computed relatively cheaply in this way.

When the matrix determinant lemma is used in conjunction with the Sherman–Morrison formula, both the inverse and determinant may be conveniently updated together.

Generalization

Suppose A is an invertible n-by-n matrix and U, V are n-by-m matrices. Then

\det\left( A + UV ^{sf{T}\right)=} \det\left( I _{m} + V ^{sf{T}A} ^{-1} U \right)\det( A ).

In the special case

A = I _{n} this is the Weinstein–Aronszajn identity.

Given additionally an invertible m-by-m matrix W, the relationship can also be expressed as

\det\left( A + UWV ^{sf{T}\right)=} \det\left( W ^{-1} + V ^{sf{T}A} ^{-1} U \right)\det\left( W \right)\det\left( A \right).

See also

• The Sherman–Morrison formula, which shows how to update the inverse, A⁻¹, to obtain (A + uv^T)⁻¹.
• The Woodbury formula, which shows how to update the inverse, A⁻¹, to obtain (A + UCV^T)⁻¹.
• The binomial inverse theorem for (A + UCV^T)⁻¹.

Notes and References

1. Book: Harville, D. A. . 1997 . Matrix Algebra From a Statistician's Perspective . New York . Springer-Verlag . 0-387-94978-X .
2. Web site: Brookes, M. . The Matrix Reference Manual (online) . 2005.
3. Ding, J. . Zhou, A. . 2007 . Eigenvalues of rank-one updated matrices with some applications . Applied Mathematics Letters . 20 . 12 . 1223–1226 . 0893-9659 . 10.1016/j.aml.2006.11.016 . free .
4. Book: William H. Press . Brian P. Flannery . Saul A. Teukolsky . William T. Vetterling . Numerical Recipes in C: The Art of Scientific Computing . 73 . Cambridge University Press . 1992 . 0-521-43108-5 . Numerical Recipes .