notes

Personal notes
git clone git://git.laack.co/notes.git
Log | Files | Refs

RidgeRegression.md (549B)


      1 # Ridge Regression
      2 
      3 ML D3
      4 
      5 **Definition:** Ridge regression uses a different cost function than standard linear regression to limit the size of coefficients.
      6 
      7 There is a regularization portion to the cost function which increases loss when coefficients are large thus incentivizing smaller coefficient values. Along with this, there is a hyperparameter, lambda, that gives more or less weight to this portion of the equation so a value of 0 would be standard linear regression while a high number would move the coeficcients closer and closer to 0.