Diagonalization


A square matrix is said to be diagonal if it only has nonzero entries on the diagonal. For example, the identity matrix is diagonal

I=(1000100001)\mathrm{I}=\begin{pmatrix} 1 & 0 & \ldots & 0 \\ 0 & 1 & \ldots & 0 \\ \vdots & \vdots & \ddots & \vdots \\ 0 & 0 & 0 & 1 \end{pmatrix}

An n×nn\times n square matrix is said to be diagonalizable if it is similar to an n×nn\times n diagonal matrix, that is, given a matrix A\mathrm{A} and a diagonal matrix D\mathrm{D}, A\mathrm{A} is diagonalizable if there exists some Invertible matrix S\mathrm{S} such that

D=S1AS\mathrm{D}=\mathrm{S}^{-1}\mathrm{A}\mathrm{S}

Diagonalization is the process of finding D\mathrm{D} and S\mathrm{S}, or equivalently finding a Basis of vectors in which A\mathrm{A} is diagonal. The vectors that make up this basis are the columns of S\mathrm{S} and are known as eigenvectors and the entries of the diagonalized A\mathrm{A} are known as its eigenvalues. Since eigenvalues are often very meaningful quantities, it is useful to reverse the previous form to express A\mathrm{A} in term of its diagonal (i.e. eigenvalue) matrix. In this context, D\mathrm{D} is usually written as Λ\Lambda instead and we get

A=SΛS1\mathrm{A}=\mathrm{S}\Lambda \mathrm{S}^{-1}

This is known as the eigendecomposition of A\mathrm{A}.

The value of diagonalization is that many calculation can be solved either trivially or with much greater ease when a matrix is in diagonal form as compared to its general form. One example is the determinant of a diagonal matrix, which is just the product of its diagonal entries.

Properties

  • If A\mathrm{A} is a symmetric matrix, then D\mathrm{D} is orthogonal, D1=D+\mathrm{D}^{-1}=\mathrm{D}^{+}.
  • detA=i=1nDii\det \mathrm{A}=\sum_{i=1}^{n}\mathrm{D}_{ii} where Dii\mathrm{D}_{ii} is the ii-th element on the diagonal of D\mathrm{D}.