home scroll deno

AI learning blog October 2023

October 14, 2023

Andrej Karpathy

https://karpathy.ai/
https://karpathy.ai/zero-to-hero.html

Youtube Video Playlist
https://www.youtube.com/playlist?list=PLAqhIrjkxbuWI23v9cThsA9GvCAUhRvKZ

Nvidia CUDA Hardware

https://developer.nvidia.com/cuda-gpus
https://www.nvidia.com/en-us/geforce/graphics-cards/compare/
https://www.videocardbenchmark.net/

Where does pip install its packages? https://stackoverflow.com/questions/29980798/where-does-pip-install-its-packages
pip show numpy
Output:
Name: numpy Version: 1.26.1 Location: /home/user/.local/lib/python3.10/site-packages Requires: Required-by: scipy

October 17, 2023

Lesson 07: Error
ModuleNotFoundError: No module named 'torch'
Solution
sudo apt install python3-pip
pip install torch

October 18, 2023

What is Anaconda?

https://pytorch.org/get-started/locally/
To install the PyTorch binaries, you will need to use one of two supported package managers: Anaconda or pip. Anaconda is the recommended package manager as it will provide you all of the PyTorch dependencies in one, sandboxed install, including Python.

October 19, 2023

Lesson 01: Error
ModuleNotFoundError: No module named 'torch'
Solution
pip install pytorch
Error
error ModuleNotFoundError: No module named 'matplotlib'
Solution
pip install matplotlib
Error
ModuleNotFoundError: No module named 'graphviz'
Solution
pip install graphviz
Error
ModuleNotFoundError: No module named 'sklearn'
Solution
pip install -U scikit-learn scipy matplotlib

October 20, 2023

Video lesson 01
The spelled-out intro to neural networks and backpropagation: building micrograd
at 51:04
Back propagation is just a recursive application of chain rule backwards through the computation graph

October 23, 2023

The example in lesson_01, "The spelled-out intro to neural networks and backpropagation: building micrograd"
jupyter notebook:
micrograd_lecture_second_half_roughly.ipynb
creates a neuron, and a multi-layer perceptron (MLP)
The models are based on
https://cs231n.github.io/neural-networks-1/

neuron_model

neural_net2

In the implementation in the video (not in the code on github) Karpathy draws a network diagram

MLP_01


Date


Follow Me

discord