Gradient descent in one picture
Notes in progress.
This page will cover:
- downhill on the loss surface
- the learning rate
- why it can overshoot
study notes
An engineer's working notebook — built up one topic at a time. Pick a section, then a topic on the left.