Neural Networks: Zero to Hero

Name: Neural Networks: Zero to Hero
Author: Andrej Karpathy

by Andrej Karpathy

Andrej Karpathy builds modern neural networks from scratch — starting with a tiny autograd engine and ending at GPT. These are the annotated notes: every concept, every line of code, every timestamp.

1 videos5 concepts2:28:59 of video

2:28:5915 conceptsBuilding micrograd: Backpropagation from ScratchKarpathy builds a tiny automatic-differentiation engine (micrograd) one line at a time, so backpropagation stops being magic and becomes something you can read.

Build your own Vault

These notes were generated with Clarion — the free Chrome extension that turns any YouTube video into structured, searchable Smart Notes.

Coming soon

Like these notes? Make your own from any video.

Coming soon