Optimizer.md (378B)
1 # Optimizer 2 3 ML P580 4 5 **Definition:** An optimizer is an algorithm to adjust the weights and biases of neural networks. 6 7 Here are a list of common optimizers: 8 9 [Momentum](Momentum.md) - Gradient is acceleration 10 [NAG](NAG.md) - Calculates momentum slightly ahead of current position 11 [AdaGrad](AdaGrad.md) - Good for simple quadratic problems 12 [Adam](Adam.md) - Generally the best