The Structure of Solutions and Fundamental Systems of Solutions

The Structure of Solutions

The Solution Structure of a Homogeneous Linear System

The Solution Space of a Homogeneous Linear System

The solution space of the homogeneous linear system Ax⃗=0⃗A\vec{x} = \vec{0} is a vector space.

Proof

Proof:

  1. The zero solution 0⃗\vec{0} is a solution
  2. If x⃗1,x⃗2\vec{x}_1, \vec{x}_2 are solutions, then x⃗1+x⃗2\vec{x}_1 + \vec{x}_2 is also a solution
  3. If x⃗\vec{x} is a solution and kk is a constant, then kx⃗k\vec{x} is also a solution

The Solution Structure of a Non-Homogeneous Linear System

The Solution Structure of a Non-Homogeneous System

Let x⃗0\vec{x}_0 be a particular solution of the non-homogeneous linear system Ax⃗=b⃗A\vec{x} = \vec{b}, and let x⃗h\vec{x}_h be any solution of the corresponding homogeneous system Ax⃗=0⃗A\vec{x} = \vec{0}. Then x⃗0+x⃗h\vec{x}_0 + \vec{x}_h is a solution of the non-homogeneous system.

Proof

Proof: A(x⃗0+x⃗h)=Ax⃗0+Ax⃗h=b⃗+0⃗=b⃗A(\vec{x}_0 + \vec{x}_h) = A\vec{x}_0 + A\vec{x}_h = \vec{b} + \vec{0} = \vec{b}

The Structure Theorem for Solutions

The General Solution of a Non-Homogeneous System

The general solution of the non-homogeneous linear system Ax⃗=b⃗A\vec{x} = \vec{b} is: x⃗=x⃗0+x⃗h\vec{x} = \vec{x}_0 + \vec{x}_h

where:

  • x⃗0\vec{x}_0 is a particular solution of the non-homogeneous system
  • x⃗h\vec{x}_h is the general solution of the corresponding homogeneous system

Fundamental Systems of Solutions

The Definition of a Fundamental System of Solutions

Fundamental System of Solutions

The set of all solutions of the homogeneous linear system Ax⃗=0⃗A\vec{x} = \vec{0} is called a fundamental system of solutions.

Properties:

  1. Every solution can be expressed as a linear combination of the vectors in this system
  2. The fundamental system of solutions is not unique, but any two fundamental systems of solutions are equivalent

The Properties of a Fundamental System of Solutions

Properties:

  1. The vectors in a fundamental system of solutions are linearly independent
  2. Every solution of the homogeneous system can be expressed as a linear combination of a fundamental system of solutions
  3. The number of vectors in a fundamental system of solutions equals the number of free variables

How to Find a Fundamental System of Solutions

Steps:

  1. Use Gaussian elimination to reduce the coefficient matrix to row echelon form
  2. Identify the pivots and the free variables
  3. For each free variable in turn, set it equal to 1 and the other free variables equal to 0, solve for the pivot variables, and thereby obtain the fundamental system of solutions

Example

Example 1: find the fundamental system of solutions of the system {x+y+z=02x+2y+2z=0\begin{cases} x + y + z = 0 \\ 2x + 2y + 2z = 0 \end{cases}.

Solution:

  1. The augmented matrix: (111∣0222∣0)\begin{pmatrix} 1 & 1 & 1 & | & 0 \\ 2 & 2 & 2 & | & 0 \end{pmatrix}
  2. Reduce to row echelon form: (111∣0000∣0)\begin{pmatrix} 1 & 1 & 1 & | & 0 \\ 0 & 0 & 0 & | & 0 \end{pmatrix}
  3. Pivot: xx; free variables: y,zy, z
  4. Setting y=1,z=0y = 1, z = 0 gives v⃗1=(−1,1,0)\vec{v}_1 = (-1, 1, 0)
  5. Setting y=0,z=1y = 0, z = 1 gives v⃗2=(−1,0,1)\vec{v}_2 = (-1, 0, 1)
  6. The fundamental system of solutions: {(−1,1,0),(−1,0,1)}\{(-1, 1, 0), (-1, 0, 1)\}

The General Solution

The Definition of the General Solution

General Solution

The set of all solutions of the homogeneous linear system Ax⃗=0⃗A\vec{x} = \vec{0} is called the general solution.

Properties:

  1. The general solution is a vector space
  2. If x⃗1,x⃗2\vec{x}_1, \vec{x}_2 are two distinct solutions, then k1x⃗1+k2x⃗2k_1\vec{x}_1 + k_2\vec{x}_2 is also a solution
  3. The general solution can be expressed as a linear combination of a fundamental system of solutions

The General Solution of a Homogeneous System

Form: x⃗=k1v⃗1+k2v⃗2+⋯+krv⃗r\vec{x} = k_1\vec{v}_1 + k_2\vec{v}_2 + \dots + k_r\vec{v}_r

where:

  • {v⃗1,v⃗2,…,v⃗r}\{\vec{v}_1, \vec{v}_2, \dots, \vec{v}_r\} is a fundamental system of solutions
  • k1,k2,…,krk_1, k_2, \dots, k_r are arbitrary constants

The General Solution of a Non-Homogeneous System

Form: x⃗=x⃗0+k1v⃗1+k2v⃗2+⋯+krv⃗r\vec{x} = \vec{x}_0 + k_1\vec{v}_1 + k_2\vec{v}_2 + \dots + k_r\vec{v}_r

where:

  • x⃗0\vec{x}_0 is a particular solution
  • {v⃗1,v⃗2,…,v⃗r}\{\vec{v}_1, \vec{v}_2, \dots, \vec{v}_r\} is a fundamental system of solutions of the corresponding homogeneous system
  • k1,k2,…,krk_1, k_2, \dots, k_r are arbitrary constants

Analysis of the Structure of Solutions

The Unique Solution

Condition: the system has a unique solution when the rank of the coefficient matrix equals the number of unknowns.

Characteristics:

  • The homogeneous system has only the zero solution
  • The non-homogeneous system has a unique solution

Infinitely Many Solutions

Condition: the system has infinitely many solutions when the rank of the coefficient matrix is less than the number of unknowns.

Characteristics:

  • The homogeneous system has infinitely many solutions
  • The non-homogeneous system has infinitely many solutions
  • The number of free variables equals the number of unknowns minus the rank of the coefficient matrix

No Solution

Condition: the system has no solution when the rank of the coefficient matrix is less than the rank of the augmented matrix.

The Dimension of the Solution Space

Computing the Dimension of the Solution Space

The Dimension of the Solution Space

The dimension of the solution space of the homogeneous linear system Ax⃗=0⃗A\vec{x} = \vec{0} equals n−r(A)n - r(A), where nn is the number of unknowns and r(A)r(A) is the rank of the coefficient matrix.

Example

Example 2: analyse the dimension of the solution space of the system {x+y+z=02x+2y+2z=0\begin{cases} x + y + z = 0 \\ 2x + 2y + 2z = 0 \end{cases}.

Solution:

  1. The coefficient matrix: A=(111222)A = \begin{pmatrix} 1 & 1 & 1 \\ 2 & 2 & 2 \end{pmatrix}
  2. r(A)=1r(A) = 1, n=3n = 3
  3. The dimension of the solution space: 3−1=23 - 1 = 2

Parametric Solutions

The Definition of a Parametric Solution

Parametric Solution

A solution written in terms of parameters is called a parametric solution.

How to Find a Parametric Solution

Steps:

  1. Reduce to row echelon form by Gaussian elimination
  2. Identify the pivots and the free variables
  3. Express the remaining variables in terms of the free variables used as parameters

Example

Example 3: find the parametric solution of the system {x+y+z=02x+2y+2z=0\begin{cases} x + y + z = 0 \\ 2x + 2y + 2z = 0 \end{cases}.

Solution:

  1. Reduce to row echelon form: (111∣0000∣0)\begin{pmatrix} 1 & 1 & 1 & | & 0 \\ 0 & 0 & 0 & | & 0 \end{pmatrix}
  2. Pivot: xx; free variables: y,zy, z
  3. Let y=ty = t and z=sz = s, then x=−t−sx = -t - s
  4. The parametric solution: x=−t−sx = -t - s, y=ty = t, z=sz = s (where t,st, s are arbitrary constants)

Exercises

Exercise 1

Write down the fundamental system of solutions of {x+y+z=02x+2y+2z=0\begin{cases} x + y + z = 0 \\ 2x + 2y + 2z = 0 \end{cases}.

structure of solutionsfundamental system of solutionslinear dependenceaugmented matrix

Approach: Follow the steps for finding a fundamental system of solutions.

Steps:

  1. The augmented matrix: (111∣0222∣0)\begin{pmatrix} 1 & 1 & 1 & | & 0 \\ 2 & 2 & 2 & | & 0 \end{pmatrix}
  2. Reduce to row echelon form: (111∣0000∣0)\begin{pmatrix} 1 & 1 & 1 & | & 0 \\ 0 & 0 & 0 & | & 0 \end{pmatrix}
  3. Pivot: xx; free variables: y,zy, z
  4. Setting y=1,z=0y = 1, z = 0 gives v⃗1=(−1,1,0)\vec{v}_1 = (-1, 1, 0)
  5. Setting y=0,z=1y = 0, z = 1 gives v⃗2=(−1,0,1)\vec{v}_2 = (-1, 0, 1)

Answer: the fundamental system of solutions is {(−1,1,0),(−1,0,1)}\{(-1, 1, 0), (-1, 0, 1)\}

Exercise 2

Find the general solution of the system {x+y+z=62x+3y+z=13x−y+2z=4\begin{cases} x + y + z = 6 \\ 2x + 3y + z = 13 \\ x - y + 2z = 4 \end{cases}.

structure of solutionsfundamental system of solutionslinear dependenceGaussian elimination

Approach: First find a particular solution, then find the fundamental system of solutions of the corresponding homogeneous system.

Steps:

  1. Gaussian elimination gives the particular solution: x=5x = 5, y=1y = 1, z=0z = 0
  2. The corresponding homogeneous system: {x+y+z=02x+3y+z=0x−y+2z=0\begin{cases} x + y + z = 0 \\ 2x + 3y + z = 0 \\ x - y + 2z = 0 \end{cases}
  3. Gaussian elimination gives the fundamental system of solutions: the empty set (only the zero solution)
  4. The general solution: x=5x = 5, y=1y = 1, z=0z = 0

Answer: the unique solution x=5x = 5, y=1y = 1, z=0z = 0

Exercise 3

Find the parametric solution of the system {x+y+z=12x+2y+2z=2\begin{cases} x + y + z = 1 \\ 2x + 2y + 2z = 2 \end{cases}.

structure of solutionsfundamental system of solutionslinear dependenceGaussian elimination

Approach: Reduce to row echelon form by Gaussian elimination, then express the solution in terms of parameters.

Steps:

  1. The augmented matrix: (111∣1222∣2)\begin{pmatrix} 1 & 1 & 1 & | & 1 \\ 2 & 2 & 2 & | & 2 \end{pmatrix}
  2. Reduce to row echelon form: (111∣1000∣0)\begin{pmatrix} 1 & 1 & 1 & | & 1 \\ 0 & 0 & 0 & | & 0 \end{pmatrix}
  3. Pivot: xx; free variables: y,zy, z
  4. Let y=ty = t and z=sz = s, then x=1−t−sx = 1 - t - s

Answer: x=1−t−sx = 1 - t - s, y=ty = t, z=sz = s (where t,st, s are arbitrary constants)

Exercise 4

Analyse the structure of the solutions of the system {x+y=1x+y=2\begin{cases} x + y = 1 \\ x + y = 2 \end{cases}.

structure of solutionsfundamental system of solutionslinear dependencerank

Approach: Use Gaussian elimination to analyse the structure of the solutions.

Steps:

  1. The augmented matrix: (11∣111∣2)\begin{pmatrix} 1 & 1 & | & 1 \\ 1 & 1 & | & 2 \end{pmatrix}
  2. Reduce to row echelon form: (11∣100∣1)\begin{pmatrix} 1 & 1 & | & 1 \\ 0 & 0 & | & 1 \end{pmatrix}
  3. The rank of the coefficient matrix is 1, the rank of the augmented matrix is 2
  4. The rank of the coefficient matrix is less than the rank of the augmented matrix

Answer: there is no solution

Exercise 5

Prove that: the general solution of a non-homogeneous linear system equals a particular solution plus the general solution of the corresponding homogeneous system.

structure of solutionsfundamental system of solutionslinear dependence

Approach: Use the linearity properties to prove it.

Steps:

  1. Let x⃗0\vec{x}_0 be a particular solution of the non-homogeneous system
  2. Let x⃗h\vec{x}_h be any solution of the corresponding homogeneous system
  3. Verify that x⃗0+x⃗h\vec{x}_0 + \vec{x}_h is a solution of the non-homogeneous system: A(x⃗0+x⃗h)=Ax⃗0+Ax⃗h=b⃗+0⃗=b⃗A(\vec{x}_0 + \vec{x}_h) = A\vec{x}_0 + A\vec{x}_h = \vec{b} + \vec{0} = \vec{b}
  4. Verify that every solution can be written in this form

Answer: the proof is complete

Summary

Symbols Used in This Article

SymbolTypePronunciation / NoteMeaning in This Article
x⃗=x⃗0+x⃗h\vec{x} = \vec{x}_0 + \vec{x}_hMathematical symbolx equals x0 plus xhThe general solution of the non-homogeneous system = a particular solution + the general solution of the corresponding homogeneous system
x⃗0\vec{x}_0Mathematical symbolx noughtA particular solution of the non-homogeneous system
x⃗h\vec{x}_hMathematical symbolx hA solution of the corresponding homogeneous system Ax⃗=0⃗A\vec{x}=\vec{0}
x⃗=k1v⃗1+⋯+krv⃗r\vec{x} = k_1\vec{v}_1 + \dots + k_r\vec{v}_rMathematical symbollinear combinationThe general solution of the homogeneous system expressed as a linear combination of a fundamental system of solutions
{v⃗1,…,v⃗r}\{\vec{v}_1, \dots, \vec{v}_r\}Mathematical symbolv vectorsA fundamental system of solutions, that is, a basis of the homogeneous solution space
k1,…,krk_1, \dots, k_rMathematical symbolk constantsThe arbitrary constants that appear in the general solution
n−r(A)n - r(A)Mathematical symboln minus rank of AThe dimension of the homogeneous solution space (the number of free variables)

Found an issue with this content?

Tell us what could be improved.