How an AI learns, in 3 small steps · part 3 of 3 · Gradient descent and the learning rate
How does an AI get better?
Every setting of the weight and bias has a loss: together they make the loss landscape. The AI feels the gradient and steps downhill. Turn the learning rate and watch it crawl, diverge, or converge.
What you turn: Learning rate
The reel