Basic Concepts of Vectors
A vector (Vector) is understood differently in different disciplines. One of the keys to learning linear algebra is being able to switch freely between these three views.
1. The Physics View: a Vector Is an “Arrow”
In a physics class, a vector is an arrow in space:
- It has a direction and a length (magnitude)
- Examples: displacement, velocity, force
The essence of an arrow is determined by its direction and its length, not by where it happens to be drawn — after translating it, it is still the same vector.
2. The Computer Science View: a Vector Is an “Ordered Array”
To a programmer, a vector is an ordered list of numbers:
v = (3, 2) ← a 2D vector (2 numbers)
w = (1, 0, 5) ← a 3D vector (3 numbers)
Each number is a component of the vector on some coordinate axis.
3. The Mathematical View: a Vector Is an “Object You Can Operate On”
A mathematician abstracts a vector as an object satisfying certain rules of operation: it can be added, and it can be multiplied by a scalar (multiplied by a number). Whether it really is an “arrow” does not matter — what matters is how it is operated on.
The stance of this course
We mainly work with the geometric view — treating a vector as an arrow in space. That is the most intuitive way to understand why linear algebra is “designed the way it is”. When we abstract to higher dimensions, we switch back to the algebraic view.
On the two-dimensional plane we set up a coordinate system (two perpendicular axes):
- The horizontal axis (the x-axis): the horizontal direction
- The vertical axis (the y-axis): the vertical direction
A vector can be written as a pair of coordinates:
v = (vx, vy)
Meaning: start at the origin, move vx units in the x direction, then move vy units in the y direction, and you arrive at the tip of the arrow.
- The vector (2, 3): 2 units to the right, 3 units up
- The start of a vector is always the origin (a convention of the geometric view)
The coordinates (2, 3) and (3, 2) are different vectors — the order matters. That is why a vector is called an “ordered array”:
(2, 3) ≠ (3, 2) ← the first component lies on the x-axis, the second on the y-axis
In a higher-dimensional (n-dimensional) space, a vector is simply n ordered numbers:
v = (v₁, v₂, ..., vₙ) ← an n-dimensional vector
The length of a vector arrow is called its norm, written with two vertical bars:
This is a direct application of the Pythagorean theorem — the arrow is the hypotenuse of a right triangle.
Example: v = (3, 4)
‖v‖ = √(3² + 4²) = √25 = 5
| Special vector | Definition | Geometric meaning |
|---|---|---|
| Zero vector | (0, 0) | A “point” with no direction; adding any vector leaves it unchanged |
| Unit vector | Norm equal to 1 | Represents direction only, with the length fixed at 1 |
Common notation:
Zero vector: 0 = (0, 0, ..., 0)
Normalisation: v̂ = v / ‖v‖ (scale v to length 1, keeping its direction)
Key conclusion
A vector = an arrow in space = an ordered array. One and the same thing, two descriptions. The geometric view lets you “see” a problem, the algebraic view lets you “compute” it. Every concept that follows (transformations, determinants, eigenvalues) keeps switching back and forth between these two views.
Geometric Intuition
To add two vectors, use the parallelogram rule (or head-to-tail):
Move the start of v to the end of w (head to tail),
or draw v and w from the origin at the same time,
complete the parallelogram whose adjacent sides are the two of them,
and the diagonal arrow is v + w.
The Algebraic Rule
Coordinates are added component by component:
Example: v = (2, 1), w = (1, 3)
v + w = (2+1, 1+3) = (3, 4)
Add component by component: v+w = (v.x+w.x, v.y+w.y)
Drag the sliders to see for yourself that "a vector is an arrow" and "addition adds component by component".
What to watch:
- Drag the sliders to change the components of v and w
- The orange arrow v+w always satisfies “add the coordinates component by component”
- The geometric position of v+w is the diagonal of the parallelogram
Geometric Intuition
Scalar multiplication scales a vector by a scalar (a number):
2·v: stretch v to twice its length (direction unchanged)
0.5·v: shrink v to half its length (direction unchanged)
-1·v: reverse v (direction flipped, length unchanged)
-2·v: reverse it and stretch it to twice its length
v → 2v: longer
v → 0.5v: shorter
v → -v: opposite direction
The Algebraic Rule
Every component is multiplied by that number:
Example: v = (2, 1)
3v = (6, 3)
-2v = (-4, -2)
Taken together, vector addition and scalar multiplication are the two basic operations of a linear combination. They satisfy a series of properties, and it is precisely those properties that define what “linear” means:
| Property | Meaning |
|---|---|
| Commutativity | v + w = w + v |
| Associativity | (u + v) + w = u + (v + w) |
| Distributivity over scalar multiplication | λ(u + v) = λu + λv |
| Associativity of scalar multiplication | (λμ)v = λ(μv) |
| Zero element | v + 0 = v |
| Identity element | 1·v = v |
Why it is called linear
Because both operations preserve “straight line” structure: the image of a straight line is still a straight line, and the origin stays fixed. This is where the definition of a “linear transformation” comes from later on — vector addition and scalar multiplication are the only two operations linear algebra ever allows.
| Operation | Geometric action | Algebraic action |
|---|---|---|
| v + w | Translation / the diagonal of a parallelogram | Add the components one by one |
| λ·v | Stretch along v (reversed when λ is negative) | Multiply every component by λ |
Symbols Used in This Article
| Symbol | Type | Pronunciation / Note | Meaning in This Article |
|---|---|---|---|
| Mathematical symbol | vector v | An arrow in space, whose start is taken to be the origin | |
| Mathematical symbol | vectors v and w | Two vectors taking part in an addition | |
| Mathematical symbol | v sub x, v sub y | The components of the vector on the coordinate axes | |
| Mathematical symbol | v sub x, v sub y | The horizontal and vertical coordinate components of | |
| Mathematical symbol | norm of v | The length of the arrow, namely | |
| Mathematical symbol | v hat | The normalised vector , of length 1, representing direction only | |
| Mathematical symbol | v plus w | Vector addition, geometrically the diagonal of a parallelogram | |
| Greek letter | Lambda | The scalar (number) used in scalar multiplication | |
| Mathematical symbol | lambda times v | Scalar multiplication, multiplying every component by | |
| Greek letter | Mu | The second scalar appearing in the associativity of scalar multiplication |
