Free preview
109 lessons
Essential Probability & Statistics for ML
Free preview
Essential Probability & Statistics for ML · 109 lessons
No surprise gaps
Actually remember it
Skip what you know
One subscription. All learning paths included.
Our content is best on a larger screen
Spread about the mean
The PMF of a random variable gives its distribution. Often we want to summarise a distribution in a single number. The mean, or expected value, is one such summary: it is what the random variable averages over many repetitions. But two different random variables can have the same mean and very different distributions. What single number measures how spread out a distribution is?
Since averages to its mean over many repetitions, a natural measure of spread is how far lies from its mean. We write , the Greek letter mu, for , and take the squared distance . As a function of , it is a random variable, so it has an expected value.
Definition
For a random variable with mean , the variance of is the expected value of its squared distance from ,
So over many repetitions, the average squared distance of from is close to .
Applying the definition of the expected value gives
The steps below show what this means for the distribution given by a PMF.
Details
Practice questions
4 questions
A random variable has . Which of these must be true?
Select the correct answer:
+ 3 more questions
Properties of variance
We've seen that variance measures how spread out a distribution is about its mean. What can we say about it without calculating it?
Its definition as an expected squared distance from the mean gives several useful properties:
| Property | Why |
|---|---|
| Squared distances are never negative. | |
| only when always takes one value | The squared distances are all only when always equals its mean. |
| Adding a number moves every value and the mean together, so the distances from the mean stay the same. | |
| Multiplying by a number multiplies each distance from the mean by the size of , so each squared distance is multiplied by . |
Combining the last two gives the variance of any scaled and shifted random variable:
Theorem
For a random variable and numbers and ,
Practice questions
4 questions
A random variable has . What is ?
Select the correct answer:
+ 3 more questions