notes

Personal notes
git clone git://git.laack.co/notes.git
Log | Files | Refs

MaxNormRegularization.md (303B)


      1 # Max-Norm Regularization
      2 
      3 ML P612
      4 
      5 **Definition:** Max-norm regularization is a regularization technique for neural networks that limits the combination (euclidean norm) of all incoming weights to a predefined range. If a step goes beyond this the weights are scaled accordingly to ensure compliance.