Similarity and Diagonalisation

Similar Matrices

The Definition of Similar Matrices

Similar Matrices

For n-th order square matrices AA and BB, if there exists an invertible matrix PP such that B=P−1APB = P^{-1}AP, then the matrices AA and BB are called similar, written A∼BA \sim B.

Properties of Similar Matrices

Property 1: similarity is an equivalence relation (reflexive, symmetric and transitive).

Property 2: similar matrices have the same characteristic polynomial.

Property 3: similar matrices have the same eigenvalues.

Property 4: similar matrices have the same trace and determinant.

Property 5: similar matrices have the same rank.

The Proof for Similar Matrices

Proof of Property 2: Let B=P−1APB = P^{-1}AP. Then: ∣B−λI∣=∣P−1AP−λI∣=∣P−1AP−P−1λIP∣=∣P−1(A−λI)P∣=∣P−1∣∣A−λI∣∣P∣=∣A−λI∣|B - \lambda I| = |P^{-1}AP - \lambda I| = |P^{-1}AP - P^{-1}\lambda IP| = |P^{-1}(A - \lambda I)P| = |P^{-1}||A - \lambda I||P| = |A - \lambda I|

Diagonalisation

The Definition of Diagonalisation

Diagonalisable

If the matrix AA is similar to a diagonal matrix, that is, if there exist an invertible matrix PP and a diagonal matrix DD such that: A=PDP−1A = PDP^{-1}

then the matrix AA is called diagonalisable.

The Conditions for Diagonalisation

The Necessary and Sufficient Condition for Diagonalisability

An n-th order matrix AA is diagonalisable if and only if AA has nn linearly independent eigenvectors.

Proof

Proof:

  • Sufficiency: suppose AA has nn linearly independent eigenvectors x⃗1,x⃗2,…,x⃗n\vec{x}_1, \vec{x}_2, \dots, \vec{x}_n with corresponding eigenvalues λ1,λ2,…,λn\lambda_1, \lambda_2, \dots, \lambda_n. Let P=[x⃗1,x⃗2,…,x⃗n]P = [\vec{x}_1, \vec{x}_2, \dots, \vec{x}_n] and D=diag⁡(λ1,λ2,…,λn)D = \operatorname{diag}(\lambda_1, \lambda_2, \dots, \lambda_n). Then A=PDP−1A = PDP^{-1}.
  • Necessity: if A=PDP−1A = PDP^{-1}, then AP=PDAP = PD, that is, the columns of AA are linear combinations of the columns of PP, with coefficients given by the diagonal entries of DD.

The Steps of Diagonalisation

Steps:

  1. Find the eigenvalues: solve the characteristic equation ∣A−λI∣=0\lvert A - \lambda I\rvert = 0
  2. Find the eigenvectors: for each eigenvalue, find the corresponding linearly independent eigenvectors
  3. Construct the matrices: PP is formed from the eigenvectors and DD from the eigenvalues
  4. Verify: check that A=PDP−1A = PDP^{-1} holds

Example

Example 1: decide whether the matrix A=(2112)A = \begin{pmatrix} 2 & 1 \\ 1 & 2 \end{pmatrix} is diagonalisable, and if so find its diagonalisation.

Solution:

  1. The characteristic equation: ∣A−λI∣=λ2−4λ+3=0\lvert A - \lambda I\rvert = \lambda^2 - 4\lambda + 3 = 0
  2. The eigenvalues: λ1=1\lambda_1 = 1, λ2=3\lambda_2 = 3
  3. The eigenvectors:
    • λ1=1\lambda_1 = 1: x⃗1=(1,−1)\vec{x}_1 = (1, -1)
    • λ2=3\lambda_2 = 3: x⃗2=(1,1)\vec{x}_2 = (1, 1)
  4. Construct the matrices:
    • P=(11−11)P = \begin{pmatrix} 1 & 1 \\ -1 & 1 \end{pmatrix}
    • D=(1003)D = \begin{pmatrix} 1 & 0 \\ 0 & 3 \end{pmatrix}
  5. The diagonalisation: A=PDP−1A = PDP^{-1}

The Case Where Diagonalisation Fails

The Condition for Failure

The Condition for a Matrix Not to Be Diagonalisable

If the matrix AA has a repeated eigenvalue whose geometric multiplicity is smaller than its algebraic multiplicity, then AA is not diagonalisable.

Example

Example 2: decide whether the matrix A=(1101)A = \begin{pmatrix} 1 & 1 \\ 0 & 1 \end{pmatrix} is diagonalisable.

Solution:

  1. The characteristic equation: ∣A−λI∣=(1−λ)2=0\lvert A - \lambda I\rvert = (1-\lambda)^2 = 0
  2. The eigenvalue: λ=1\lambda = 1 (a double root)
  3. The geometric multiplicity: solving (A−I)x⃗=0⃗(A - I)\vec{x} = \vec{0} gives x⃗=(1,0)\vec{x} = (1, 0), so the geometric multiplicity is 1
  4. The algebraic multiplicity is 2 and the geometric multiplicity is 1, so the matrix is not diagonalisable

Applications of Diagonalisation

Computing Powers of a Matrix

Computing Powers of a Matrix

If A=PDP−1A = PDP^{-1}, then An=PDnP−1A^n = PD^nP^{-1}.

Proof

Proof: An=(PDP−1)n=PDP−1⋅PDP−1⋅⋯⋅PDP−1=PDnP−1A^n = (PDP^{-1})^n = PDP^{-1} \cdot PDP^{-1} \cdot \dots \cdot PDP^{-1} = PD^nP^{-1}

Computing Functions of a Matrix

Computing Functions of a Matrix

If A=PDP−1A = PDP^{-1}, then f(A)=Pf(D)P−1f(A) = Pf(D)P^{-1}, where f(D)=diag⁡(f(λ1),f(λ2),…,f(λn))f(D) = \operatorname{diag}(f(\lambda_1), f(\lambda_2), \dots, f(\lambda_n)).

The Jordan Canonical Form

The Definition of the Jordan Canonical Form

Jordan Canonical Form

For a real symmetric matrix AA, if there exists an orthogonal matrix PP such that PTAP=DP^TAP = D is a diagonal matrix, then AA is called diagonalisable, where DD is the diagonal matrix whose entries on the diagonal are the eigenvalues of AA.

Jordan Blocks

Jordan Block

A matrix of the form Ji=(λi10…00λi1…0⋮⋮⋮⋱⋮000…λi)J_i = \begin{pmatrix} \lambda_i & 1 & 0 & \dots & 0 \\ 0 & \lambda_i & 1 & \dots & 0 \\ \vdots & \vdots & \vdots & \ddots & \vdots \\ 0 & 0 & 0 & \dots & \lambda_i \end{pmatrix}

is called a Jordan block.

Exercises

Exercise 1

Decide whether the matrix A=(1101)A = \begin{pmatrix} 1 & 1 \\ 0 & 1 \end{pmatrix} is diagonalisable.

similar matricesdiagonalisationdiagonalisableeigenvector

Approach: Check whether there are enough linearly independent eigenvectors.

Steps:

  1. The characteristic equation: ∣A−λI∣=(1−λ)2=0\lvert A - \lambda I\rvert = (1-\lambda)^2 = 0
  2. The eigenvalue: λ=1\lambda = 1 (a double root)
  3. Find the eigenvectors: solve (A−I)x⃗=0⃗(A - I)\vec{x} = \vec{0}
  4. (0100)(xy)=(00)\begin{pmatrix} 0 & 1 \\ 0 & 0 \end{pmatrix}\begin{pmatrix} x \\ y \end{pmatrix} = \begin{pmatrix} 0 \\ 0 \end{pmatrix}
  5. This gives the eigenvector x⃗=(1,0)\vec{x} = (1, 0)
  6. There is only one linearly independent eigenvector, fewer than the order of the matrix, which is 2

Answer: it is not diagonalisable

Exercise 2

Find the diagonalisation of the matrix A=(3102)A = \begin{pmatrix} 3 & 1 \\ 0 & 2 \end{pmatrix}.

similar matricesdiagonalisationdiagonalisablecharacteristic equation

Approach: Follow the steps of diagonalisation.

Steps:

  1. The characteristic equation: ∣A−λI∣=(3−λ)(2−λ)=0\lvert A - \lambda I\rvert = (3-\lambda)(2-\lambda) = 0
  2. The eigenvalues: λ1=2\lambda_1 = 2, λ2=3\lambda_2 = 3
  3. The eigenvectors:
    • λ1=2\lambda_1 = 2: x⃗1=(1,−1)\vec{x}_1 = (1, -1)
    • λ2=3\lambda_2 = 3: x⃗2=(1,0)\vec{x}_2 = (1, 0)
  4. Construct the matrices:
    • P=(11−10)P = \begin{pmatrix} 1 & 1 \\ -1 & 0 \end{pmatrix}
    • D=(2003)D = \begin{pmatrix} 2 & 0 \\ 0 & 3 \end{pmatrix}
  5. The diagonalisation: A=PDP−1A = PDP^{-1}

Answer: A=PDP−1A = PDP^{-1}, where P=(11−10)P = \begin{pmatrix} 1 & 1 \\ -1 & 0 \end{pmatrix} and D=(2003)D = \begin{pmatrix} 2 & 0 \\ 0 & 3 \end{pmatrix}

Exercise 3

Prove that: similar matrices have the same eigenvalues.

similar matricesdiagonalisationdiagonalisablecharacteristic polynomial

Approach: Use the property that similar matrices have the same characteristic polynomial.

Steps:

  1. Let A∼BA \sim B, that is, B=P−1APB = P^{-1}AP
  2. Similar matrices have the same characteristic polynomial: ∣A−λI∣=∣B−λI∣\lvert A - \lambda I\rvert = \lvert B - \lambda I\rvert
  3. The eigenvalues are the roots of the characteristic polynomial
  4. Therefore AA and BB have the same eigenvalues

Answer: the proof is complete

Exercise 4

Let A=PDP−1A = PDP^{-1}. Find AnA^n.

similar matricesdiagonalisationdiagonalisablematrix

Approach: Use the property of powers of a diagonalised matrix.

Steps:

  1. A=PDP−1A = PDP^{-1}
  2. An=(PDP−1)n=PDnP−1A^n = (PDP^{-1})^n = PD^nP^{-1}
  3. Dn=diag⁡(λ1n,λ2n,…,λnn)D^n = \operatorname{diag}(\lambda_1^n, \lambda_2^n, \dots, \lambda_n^n)

Answer: An=PDnP−1A^n = PD^nP^{-1}, where Dn=diag⁡(λ1n,λ2n,…,λnn)D^n = \operatorname{diag}(\lambda_1^n, \lambda_2^n, \dots, \lambda_n^n)

Exercise 5

Decide whether the matrix A=(2112)A = \begin{pmatrix} 2 & 1 \\ 1 & 2 \end{pmatrix} is diagonalisable, and if so find its diagonalisation.

similar matricesdiagonalisationdiagonalisableeigenvector

Approach: Follow the steps of diagonalisation.

Steps:

  1. The characteristic equation: ∣A−λI∣=λ2−4λ+3=0\lvert A - \lambda I\rvert = \lambda^2 - 4\lambda + 3 = 0
  2. The eigenvalues: λ1=1\lambda_1 = 1, λ2=3\lambda_2 = 3
  3. The eigenvectors:
    • λ1=1\lambda_1 = 1: x⃗1=(1,−1)\vec{x}_1 = (1, -1)
    • λ2=3\lambda_2 = 3: x⃗2=(1,1)\vec{x}_2 = (1, 1)
  4. There are two linearly independent eigenvectors, equal to the order of the matrix
  5. Construct the matrices:
    • P=(11−11)P = \begin{pmatrix} 1 & 1 \\ -1 & 1 \end{pmatrix}
    • D=(1003)D = \begin{pmatrix} 1 & 0 \\ 0 & 3 \end{pmatrix}
  6. The diagonalisation: A=PDP−1A = PDP^{-1}

Answer: it is diagonalisable, A=PDP−1A = PDP^{-1}, where P=(11−11)P = \begin{pmatrix} 1 & 1 \\ -1 & 1 \end{pmatrix} and D=(1003)D = \begin{pmatrix} 1 & 0 \\ 0 & 3 \end{pmatrix}

Summary

Symbols Used in This Article

SymbolTypePronunciation / NoteMeaning in This Article
P−1APP^{-1}APMathematical symbolP inverse A PThe form of a similarity transformation: B=P−1APB = P^{-1}AP
A∼BA \sim BMathematical symbolA tilde BThe matrices AA and BB are similar
PPMathematical symbolinvertible matrix PThe invertible matrix formed from the linearly independent eigenvectors
A=PDP−1A = PDP^{-1}Mathematical symbolA equals P D P inverseThe diagonalisation decomposition
D=diag⁡(λ1,…,λn)D = \operatorname{diag}(\lambda_1, \dots, \lambda_n)Mathematical symboldiagonal matrix of lambdasThe diagonal matrix whose diagonal entries are the eigenvalues
λi\lambda_iGreek letterLambda sub iThe ii-th eigenvalue
∣A−λI∣\lvert A - \lambda I\rvertMathematical symboldeterminant of (A minus lambda I)The characteristic polynomial, which similar matrices share
An=PDnP−1A^n = PD^nP^{-1}Mathematical symbolA to the n equals P D to the n P inverseThe computation of powers of a matrix after diagonalisation
JiJ_iMathematical symbolJordan block J iA Jordan block, an upper triangular matrix with 1s on the superdiagonal

Found an issue with this content?

Tell us what could be improved.