Free preview
149 lessons
Essential Calculus for ML
Free preview
Essential Calculus for ML · 149 lessons
No surprise gaps
Actually remember it
Skip what you know
One subscription. All learning paths included.
Our content is best on a larger screen
The four second-order partials
For a function of one variable, differentiating again gives the second derivative . A function of two variables, , has two first partials, and . Each is itself a function of and , so each can be differentiated by or by . That gives four second-order partial derivatives, each defined only where both of its steps exist.
Definition
A second-order partial derivative of is a partial derivative of one of the first partials and . In subscript notation,
so is differentiated by , and the result is then differentiated by . The two that use both variables, and , are the mixed partial derivatives.
Each of the four has a subscript form and a form:
| Subscript form | form | Order of differentiation |
|---|---|---|
| by , then by | ||
| by , then by | ||
| by , then by | ||
| by , then by |
Key Point
Subscripts are read left to right, so in we differentiate by first. The denominator of the form is read right to left, so in we also differentiate by first.
The notation extends to more variables. A function of three variables has first partials , and , and is the partial of with respect to .
Practice questions
4 questions
For a function , which of these describes
Select the correct answer:
+ 3 more questions
What and measure
For a function of two variables, the graph is a surface. The two second-order partials that repeat a variable, and , each describe one cross-section of that surface.
Key Point
Holding fixed cuts the surface along the cross-section , which is a function of alone. is the ordinary second derivative of that cross-section at .
Similarly, is the ordinary second derivative of the cross-section at .
Each is the second derivative of a curve, so its sign gives the concavity of that cross-section.
Toggle the two views below to see the two cross-sections of one surface through the same point, first with held fixed and then with held fixed.
Nothing here is new. Each of and is the second derivative we already know, applied to a cross-section of the surface.
For , a calculation at the point gives
Using these values, and without differentiating:
Solution
Both subscripts of are , so we hold fixed at both steps. That leaves the cross-section , a function of alone, and is its ordinary second derivative at . That value is positive, so this cross-section is concave up at .
For we hold fixed instead, which leaves the cross-section , a function of alone, and is its ordinary second derivative at . That value is negative, so this cross-section is concave down at .
Practice questions
4 questions
A calculation for a function gives . Which statement follows?
Select the correct answer:
+ 3 more questions
What and measure
The two remaining second-order partials are the mixed partials, and . Neither is the second derivative of a single cross-section, because the two steps use different variables. Instead, each compares one cross-section with its neighbours.
Tip
Imagine the surface as a mountainside. You are standing on it at the point , facing north, the direction. The ground in front of you has some steepness, and that steepness is , the slope of the cross-section at .
Now take one step to your right, east, the direction, and face north again. The ground in front of you now belongs to a different cross-section, the one at a slightly larger value of , and its steepness can be different.
measures that change. Since , it differentiates the slope in the direction, , with respect to .
Key Point
is the rate at which , the slope in the direction, changes as increases. In the same way, is the rate at which , the slope in the direction, changes as increases.
Slide the cross-section below to watch the slope in the direction change with .
Move the slider to slide the red cross-section of the surface
Increase
The rate of that change is the mixed partial
Drag anywhere in the scene to rotate it.
As with any derivative, the sign tells us the direction of the change. A positive means the slope in the direction is increasing as increases, and a negative one means it is decreasing. A value of means that, at , moving in the direction is not changing the slope in the direction.
For a function , a calculation at the point gives
Using these values, and without differentiating:
Solution
Subscripts are read left to right, so : the first partial is , and it is differentiated by . So is the rate at which changes as increases, with held fixed at .
At the slope in the direction is , so the cross-section is rising at . The value is negative, so that slope is decreasing as increases. A small increase in brings us to a cross-section that is less steep in the direction at .
Practice questions
4 questions
For a function , a calculation gives . Which statement follows?
Select the correct answer:
+ 3 more questions