Sylvester's criterion explained

In mathematics, Sylvester’s criterion is a necessary and sufficient criterion to determine whether a Hermitian matrix is positive-definite.

Sylvester's criterion states that a n × n Hermitian matrix M is positive-definite if and only if all the following matrices have a positive determinant:

• the upper left 1-by-1 corner of M,
• the upper left 2-by-2 corner of M,
• the upper left 3-by-3 corner of M,

{} \vdots

• M itself.

In other words, all of the leading principal minors must be positive. By using appropriate permutations of rows and columns of M, it can also be shown that the positivity of any nested sequence of n principal minors of M is equivalent to M being positive-definite.

An analogous theorem holds for characterizing positive-semidefinite Hermitian matrices, except that it is no longer sufficient to consider only the leading principal minors as illustrated by the Hermitian matrix

\begin{pmatrix} 0 & 0 & -1 \\ 0 & -1 & 0 \\ -1 & 0 & 0 \end{pmatrix} witheigenvectors \begin{pmatrix} 0 \\ 1 \\ 0 \end{pmatrix}, \begin{pmatrix} 1 \\ 0 \\ 1 \end{pmatrix} and \begin{pmatrix} 1 \\ 0 \\ -1 \end{pmatrix}.

A Hermitian matrix M is positive-semidefinite if and only if all principal minors of M are nonnegative.

Proof for the case of positive definite matrices

Suppose

M _{n} is n x n Hermitian matrix M ^{\dagger} _{n} = M _{n} . Let M _{k,k=1,\ldots} n be the principal minor matrices, i.e. the k x k upper left corner matrices. It will be shown that if M _{n} is positive definite, then the principal minors are positive; that is, \det M _{k>0} for all k .M _{k} is positive definite. Indeed, choosing x = \left(\begin{array}{c} x _{1\ \vdots\ x} _{k\ 0\ \vdots\\0\end{array} \right)} = \left(\begin{array}{c} \vec{x}\\ 0 \\ \vdots\\ 0 \end{array} \right)

we can notice that

0 <x ^{\dagger} M _{n} x = \vec{x} ^{\dagger} M _{k\vec{x}.} Equivalently, the eigenvalues of M _{k} are positive, and this implies that \det M _{k>0} since the determinant is the product of the eigenvalues.

To prove the reverse implication, we use induction. The general form of an

(n +1 ) x (n +1 ) Hermitian matrix isM _{n+1} = \left( \begin{array}{cc}M ^{\dagger} _{n&\vec{v}\ \vec{v}} &d\end{array}\right) (*) ,

where

M _{n} is an n x n Hermitian matrix, \vec{v} is a vector and d is a real constant.

Suppose the criterion holds for

M _{n} . Assuming that all the principal minors of M _{n+1} are positive implies that \det M _{n+1} > 0 , \det M _{n>0} , and that M _{n} is positive definite by the inductive hypothesis. Denotex = \left( \begin{array}{c}\vec{x}\ x _{n+1} \end{array} \right)

then

x ^{\dagger} M _{n+1} x = \vec{x} ^{\dagger} M _{n\vec{x}+x} _{n+1} \vec{x} ^{\dagger} \vec{v} + \bar{x} _{n+1} \vec{v} ^{\dagger} \vec{x} + d|x _{n+1} | ^{2} By completing the squares, this last expression is equal to(\vec{x} ^{\dagger} + \vec{v} ^{\dagger} M ^{-1} _{n} \bar{x} _{n+1} )M _{n(\vec{x}+x} _{n+1} M ^{-1} _{n} \vec{v}) - |x _{n+1} | ^{2\vec{v}} ^{\dagger} M ^{-1} _{n} \vec{v} + d|x _{n+1} | ^{2} = (\vec{x} + \vec{c}) ^{\dagger} M _{n(\vec{x}+\vec{c})+|x} _{n+1} | ^{2(d-\vec{v}} ^{\dagger} M ^{-1} _{n} \vec{v}) where \vec{c} = x _{n+1} M ^{-1} _{n} \vec{v} (note that M ^{-1} _{n} exists because the eigenvalues of M _{n} are all positive.) The first term is positive by the inductive hypothesis. We now examine the sign of the second term. By using the block matrix determinant formula\det \left(\begin{array}{cc}A&B\\C&D\end{array} \right) = \det A\det(D - CA ^{-1} B)

on

(*) we obtain\det M _{n+1} = \det M ^{\dagger} _{n(d - \vec{v}} M ^{-1} _{n} \vec{v})> 0 , which implies d - \vec{v} ^{\dagger} M ^{-1} _{n} \vec{v}> 0 . Consequently, x ^{\dagger} M _{n+1} x> 0 .

Proof for the case of positive semidefinite matrices

Let

M _{n} be an n x n Hermitian matrix. Suppose M _{n} is semidefinite. Essentially the same proof as for the case that M _{n} is strictly positive definite shows that all principal minors (not necessarily the leading principal minors) are non-negative.

For the reverse implication, it suffices to show that if

M _{n} has all non-negative principal minors, then for all t>0, all leading principal minors of the Hermitian matrix M _{n+tI} _{n} are strictly positive, where I _{n} is the nxn identity matrix. Indeed, from the positive definite case, we would know that the matrices M _{n+tI} _{n} are strictly positive definite. Since the limit of positive definite matrices is always positive semidefinite, we can take t \to 0 to conclude.

To show this, let

M _{k} be the kth leading principal submatrix of M _{n.} We know that q _{k(t)} = \det(M _{k} + tI _{k)} is a polynomial in t, related to the characteristic polynomial p _{M _{k}} via$$q\_k(t)\; =\; (-1)^kp\_(-t).$$ We use the identity in Characteristic polynomial#Properties to write$$q\_k(t)\; =\; \backslash sum\_^k\; t^\; \backslash operatorname\backslash left(\backslash textstyle\backslash bigwedge^j\; M\_k\backslash right),$$where $\backslash operatorname\backslash left(\backslash bigwedge^j\; M\_k\backslash right)$ is the trace of the jth exterior power of M _{k.}

From Minor_(linear_algebra)#Multilinear_algebra_approach, we know that the entries in the matrix expansion of

w edge ^{j} M _{k} (for j > 0) are just the minors of M _{k.} In particular, the diagonal entries are the principal minors of M _{k} , which of course are also principal minors of M _{n} , and are thus non-negative. Since the trace of a matrix is the sum of the diagonal entries, it follows that $$\backslash operatorname\backslash left(\backslash textstyle\backslash bigwedge^j\; M\_k\backslash right)\; \backslash geq\; 0.$$ Thus the coefficient of t ^{k-j} in q _{k(t)} is non-negative for all j > 0. For j = 0, it is clear that the coefficient is 1. In particular, q _{k(t)} > 0 for all t > 0, which is what was required to show.

References

• .
• . Theorem 7.2.5.
• .