Vectors as objects with length and direction: adding and scaling them, the dot product and the norm it defines, orthogonality and independence, span and basis, and projection onto a line.
No account needed to read a lesson · 30-day money-back guarantee
See the full learning path9
lessons
82
practice questions
33
prerequisite lessons
2 of the 9 lessons here are free to preview - the whole explanation and worked example, with no account and no email.
Free preview
Dot product and vector norm
Learn how to compute the dot product of vectors using both magnitude and angle or components, understand its geometric meaning in terms of similarity and orientation, and use the dot product to define vector norms and create unit vectors for comparing directions irrespective of scale.
Free preview
Projecting vectors onto a line
Learn how to calculate the scalar and vector projection of one vector onto another in any dimension, interpret their geometric meaning, and understand their importance in measuring how much a vector aligns with a chosen direction, especially in machine learning contexts.
Live, not a screenshot
Lesson 04 · Dot product and vector norm
The arc shows the smaller angle
This is the diagram from the lesson itself, running here. Drag it - the lesson is built round the thing it shows, not round a picture of it.
The 9 lessons in this unit. Expand any one to see what it covers. Each unlocks when its own prerequisites are passed.
01
Introduction to vectors
9 questions
Understand how data can be represented as vectors, how to visualise and interpret vectors in two dimensions, calculate their magnitude, and convert them into unit vectors through normalisation.
Covers
Visualizing -dimensional vectors
The length of a vector
Unit vectors and normalisation
02
Addition, subtraction and scalar multiplication of dimensional vectors
12 questions
Understand how to add, subtract and scale two-dimensional vectors componentwise and use these operations to form linear combinations, which are fundamental to representing and manipulating data in machine learning.
Covers
Vector addition
Vector subtraction
Scalar multiplication
Linear combinations of vectors
03
Addition, subtraction and scalar multiplication of dimensional vectors
12 questions
Learn how to add, subtract and scale -dimensional real vectors entrywise, and construct linear combinations by applying these operations in any number of dimensions.
Covers
-dimensional real vectors
Addition and subtraction of -dimensional real vectors
Scalar multiplication of -dimensional real vectors
Linear combinations of -dimensional real vectors
04
Dot product and vector norm
9 questions
Learn how to compute the dot product of vectors using both magnitude and angle or components, understand its geometric meaning in terms of similarity and orientation, and use the dot product to define vector norms and create unit vectors for comparing directions irrespective of scale.
Covers
Dot product using magnitude and angle
Dot product using components
Vector norms and unit vectors
05
Orthogonal, dependent and independent vectors
9 questions
Learn how to test whether pairs or sets of vectors are orthogonal (dot product zero) or linearly dependent (one is a scalar multiple or linear combination of others), and understand the implications of these properties for redundancy and uniqueness in feature spaces such as those used in machine learning.
Covers
Orthogonality in dimensions and dimensions
Linear dependence / independence of two vectors
Linear dependence / independence of a set of vectors
06
Span of vectors in dimensional space
9 questions
Understand how the span of a set of vectors describes all the points reachable by their linear combinations, how to determine if a given vector lies within this span, and how to check if a set of vectors spans the entire space using row reduction.
Covers
Definition of span and geometric intuition
Is a vector in the span?
Does a set of vectors span all of ?
07
Projecting vectors onto a line
10 questions
Learn how to calculate the scalar and vector projection of one vector onto another in any dimension, interpret their geometric meaning, and understand their importance in measuring how much a vector aligns with a chosen direction, especially in machine learning contexts.
Covers
Geometric meaning of projection in dimensions
Scalar and vector projection in dimensions
Generalisation to dimensional vectors
08
Bases and orthonormal bases
6 questions
Understand how bases provide reference directions for vector spaces and see how orthonormal bases simplify the representation of vectors and calculations such as finding coordinates using dot products.
Covers
What is a basis?
Orthonormal basis
09
Changing basis
6 questions
Learn how to represent a vector in different bases by finding its coordinates relative to any basis and use the basis matrix and its inverse to convert between these coordinate systems and the standard basis.
Covers
Coordinates in a new basis
Matrix form of change of basis
This unit is part of our Essential Linear Algebra for ML learning path, which contains 61 lessons. Every one of them is drawn below.
The diagnostic test lets you skip any lesson you already know, including the ones in this unit.
Hover any dot to name its lesson.
9 lessons in this unit
33 prerequisite lessons across the unit, counting every step back to the start
19 other lessons in the learning path - after this unit, or alongside it
One subscription covers every learning path, and you can test out of anything you already know.
One subscription covers every learning path · 30-day money-back guarantee
More in Linear algebra: Matrices, Matrices and linear systems, Matrix transformations, Eigenvalues, eigenvectors and singular value decomposition