Mathematics · live now

Vectors in Euclidean space

Vectors as objects with length and direction: adding and scaling them, the dot product and the norm it defines, orthogonality and independence, span and basis, and projection onto a line.

No account needed to read a lesson · 30-day money-back guarantee

See the full learning path

9

lessons

82

practice questions

33

prerequisite lessons

See it taught

2 of the 9 lessons here are free to preview - the whole explanation and worked example, with no account and no email.

Live, not a screenshot

Lesson 04 · Dot product and vector norm

1234−1−2−3−41234−1−2−3−4
v=[2.001.00]
w=[2.001.00]
θ=53.1
|v|=2.24,|w|=2.24
vw=3.00

The arc shows the smaller angle θ between v and w. This is the angle used in the dot product formula: vw=|v||w|cosθ

This is the diagram from the lesson itself, running here. Drag it - the lesson is built round the thing it shows, not round a picture of it.

The 9 lessons

The 9 lessons in this unit. Expand any one to see what it covers. Each unlocks when its own prerequisites are passed.

01

Introduction to vectors

9 questions

Understand how data can be represented as vectors, how to visualise and interpret vectors in two dimensions, calculate their magnitude, and convert them into unit vectors through normalisation.

Covers

Visualizing 22-dimensional vectors

The length of a vector

Unit vectors and normalisation

02

Addition, subtraction and scalar multiplication of 22-dimensional vectors

12 questions

Understand how to add, subtract and scale two-dimensional vectors componentwise and use these operations to form linear combinations, which are fundamental to representing and manipulating data in machine learning.

Covers

Vector addition

Vector subtraction

Scalar multiplication

Linear combinations of vectors

03

Addition, subtraction and scalar multiplication of NN-dimensional vectors

12 questions

Learn how to add, subtract and scale nn-dimensional real vectors entrywise, and construct linear combinations by applying these operations in any number of dimensions.

Covers

nn-dimensional real vectors

Addition and subtraction of nn-dimensional real vectors

Scalar multiplication of nn-dimensional real vectors

Linear combinations of nn-dimensional real vectors

04

Dot product and vector norm

Preview

9 questions

Learn how to compute the dot product of vectors using both magnitude and angle or components, understand its geometric meaning in terms of similarity and orientation, and use the dot product to define vector norms and create unit vectors for comparing directions irrespective of scale.

Covers

Dot product using magnitude and angle

Dot product using components

Vector norms and unit vectors

Preview this lesson - no account needed

05

Orthogonal, dependent and independent vectors

9 questions

Learn how to test whether pairs or sets of vectors are orthogonal (dot product zero) or linearly dependent (one is a scalar multiple or linear combination of others), and understand the implications of these properties for redundancy and uniqueness in feature spaces such as those used in machine learning.

Covers

Orthogonality in 22 dimensions and nn dimensions

Linear dependence / independence of two vectors

Linear dependence / independence of a set of vectors

06

Span of vectors in NN-dimensional space

9 questions

Understand how the span of a set of vectors describes all the points reachable by their linear combinations, how to determine if a given vector lies within this span, and how to check if a set of vectors spans the entire space RN\mathbb{R}^N using row reduction.

Covers

Definition of span and geometric intuition

Is a vector in the span?

Does a set of vectors span all of RN\mathbb{R}^N?

07

Projecting vectors onto a line

Preview

10 questions

Learn how to calculate the scalar and vector projection of one vector onto another in any dimension, interpret their geometric meaning, and understand their importance in measuring how much a vector aligns with a chosen direction, especially in machine learning contexts.

Covers

Geometric meaning of projection in 22 dimensions

Scalar and vector projection in 22 dimensions

Generalisation to NN-dimensional vectors

Preview this lesson - no account needed

08

Bases and orthonormal bases

6 questions

Understand how bases provide reference directions for vector spaces and see how orthonormal bases simplify the representation of vectors and calculations such as finding coordinates using dot products.

Covers

What is a basis?

Orthonormal basis

09

Changing basis

6 questions

Learn how to represent a vector in different bases by finding its coordinates relative to any basis and use the basis matrix and its inverse to convert between these coordinate systems and the standard basis.

Covers

Coordinates in a new basis

Matrix form of change of basis

Where this unit sits in the curriculum

This unit is part of our Essential Linear Algebra for ML learning path, which contains 61 lessons. Every one of them is drawn below.

The diagnostic test lets you skip any lesson you already know, including the ones in this unit.

Every dot is a lesson and every line a prerequisite. The 9 red dots are the lessons in Vectors in Euclidean space; the 33 blue dots feeding into them are the lessons Vectors in Euclidean space depends on; the 19 pale dots are the rest of the learning path, which come after Vectors in Euclidean space or alongside it.Vectors in Euclidean spaceFirst lessons on the left61 lessons

Hover any dot to name its lesson.

9 lessons in this unit

33 prerequisite lessons across the unit, counting every step back to the start

19 other lessons in the learning path - after this unit, or alongside it

Every dot is a lesson, every line a prerequisite. You can only start a lesson once you have mastered all of its prerequisites, so you are always building on solid foundations.

Start Vectors in Euclidean space

One subscription covers every learning path, and you can test out of anything you already know.

One subscription covers every learning path · 30-day money-back guarantee

More in Linear algebra: Matrices, Matrices and linear systems, Matrix transformations, Eigenvalues, eigenvectors and singular value decomposition