notes

Personal notes
git clone git://git.laack.co/notes.git
Log | Files | Refs

DeepLearning.md (1645B)

      1 # Deep Learning
      2 
      3 This index tracks deep learning-related content. While much of my deep learning (DL) material is interspersed throughout my machine learning (ML) notes, separating them seems appropriate given the volume of ML notes I've accumulated.
      4 
      5 ## Resources Studied
      6 
      7 1. **Deep Learning** - Goodfellow, Bengio, Courville
      8 
      9 ## Links by Resource
     10 
     11 ### Deep Learning - Goodfellow, Bengio, Courville
     12 
     13 Chapter 1
     14 
     15 - [Knowledge Base Approach](KnowledgeBaseApproach.md)
     16 - [Polar Coordinates](PolarCoordinates.md)
     17 - [Representation Learning](RepresentationLearning.md)
     18 - [Factors Of Variation](FactorsOfVariation.md)
     19 - [Computational Graph](ComputationalGraph.md)
     20 - [Probabilistic Graph](ProbabilisticGraph.md)
     21 - [Distributed Representation](DistributedRepresentation.md)
     22 
     23 Chapter 2
     24 
     25 - [Tensor](Tensor.md)
     26 - [Transpose](Transpose.md)
     27 - [Broadcasting](Broadcasting.md)
     28 - [Span](Span.md)
     29 - [Singular](Singular.md)
     30 - [Norm](Norm.md)
     31 - [L1Norm](L1Norm.md)
     32 - [L2Norm](L2Norm.md)
     33 - [Max Norm](MaxNorm.md)
     34 - [Frobenius Norm](FrobeniusNorm.md)
     35 - Orthonormal
     36 - OrthogonalMatrix
     37 - EigenDecomposition
     38 - EigenValue
     39 - EigenVector
     40 
     41 ### Personal Research
     42 
     43 - PEFT Approaches
     44     - [LoRA](LoRA.md)
     45         - https://arxiv.org/abs/2106.09685
     46     - PLoP
     47         - https://arxiv.org/abs/2506.20629
     48     - QLoRA
     49         - https://arxiv.org/abs/2305.14314
     50 - Prompt Optimization
     51     - APE
     52         - https://arxiv.org/abs/2211.01910
     53     - APO / ProTeGi
     54         - https://arxiv.org/abs/2305.03495
     55     - OPRO
     56         - https://arxiv.org/abs/2309.03409
     57 
     58 - Architectures
     59     - [Transformers](Transformers.md)
     60 
     61 - Training Approaches
     62     - [Constitutional AI](ConstitutionalAI.md)