NAG.md (350B)
1 # NAG (Nesterov Accelerated Gradient (optimization)) 2 3 ML P582 4 5 **Definition:** NAG is an improvment upon the momentum optimization algorithm where instead of finding the gradient of the current position and adding this to the velocity, we instead find the gradient slightly ahead (in direction of momentum) and then add this factor to the velocity.