notes

Personal notes
git clone git://git.laack.co/notes.git
Log | Files | Refs

PretrainedModels.md (842B)


      1 # Pretrained Models
      2 
      3 ML P570
      4 
      5 **Definition:** Pretrained models are ML models that have been trained in the past and can be used for doing other things.
      6 
      7 Pretrained models often use [TransferLearning](TransferLearning.md) because the goal with pretrained models is to use the existing model that has already been trained to work well with a new set of data. This often involves changing the model's top layers (training new ones for the specific task) while keeping the lower layers in tact as they often do simple tasks like edge detection which are reusable.
      8 
      9 When doing this the layers that don't change are called the fixed weights while the ones that are changed are called the trainable weights.
     10 
     11 A good thing about pretrained models is that they generally require less training data to get a certain level of accuracy for predictions.