What is the purpose of the learning rate in gradient descent?

Machine Learning Medium

Machine Learning — Medium

What is the purpose of the learning rate in gradient descent?

Key points

  • Learning rate affects how quickly the model parameters are updated
  • High learning rates can lead to divergence
  • Low learning rates can result in slow convergence

Ready to go further?

Related questions