09: Optimisation Algorithms#

  • gradient descent (recap)

  • stochastic/mini-batch gradient descent

  • momentum

  • adam