|
Andrej Karpathy Course |
|
|
Andrej Karpathy Course |
Neural Networks: Zero to Hero
https://karpathy.ai/zero-to-hero.html
Youtube Video Playlist
https://www.youtube.com/playlist?list=PLAqhIrjkxbuWI23v9cThsA9GvCAUhRvKZ
| Name | Video | github | colab | jupyter | Date |
|---|---|---|---|---|---|
| The spelled-out intro to neural networks and backpropagation: building micrograd |
video |
Code |
colab |
notebook |
10-17-2023 |
| The spelled-out intro to language modeling: building makemore |
video |
Code |
|
notebook |
|
| Building makemore Part 2: MLP |
video |
Code |
colab |
notebook |
|
| Building makemore Part 3: Activations & Gradients, BatchNorm |
video |
Code |
colab
|
notebook
|
|
| Building makemore Part 4: Becoming a Backprop Ninja |
video |
Code |
colab
|
notebook
|
|
| Building makemore Part 5: Building a WaveNet |
video |
Code |
colab
|
notebook
|
|
| Let's build GPT: from scratch, in code, spelled out. |
video |
Lecture Code |
colab
|
|
|
Attention is All You Need paper:
https://arxiv.org/abs/1706.03762
Illustrated Guide to Transformers Neural Network: A step by step explanation
https://www.youtube.com/watch?v=4Bdc55j80l8
pyTorch
https://pytorch.org/
Softmax function
https://en.wikipedia.org/wiki/Softmax_function
