Modern Deep Learning & Transformers

Andrej Karpathy

Former Tesla AI director and OpenAI founding member known for building neural networks from scratch on video and coining the phrase "vibe coding."

Andrej Karpathy built his reputation on a mix of research and, unusually for the field, some of the clearest public teaching material available anywhere. As a PhD student under Fei-Fei Li at Stanford, he worked on connecting computer vision and natural language for image captioning. He was a founding member of OpenAI in 2015, then led Tesla's Autopilot computer vision team from 2017 to 2022, where "software 2.0" — his term for replacing hand-written logic with weights learned from data — became an internal design philosophy for the self-driving stack.

He's best known outside research circles for micrograd and nanoGPT: small, readable from-scratch implementations of backpropagation and a GPT-style transformer, built live in video lectures that walk through every line rather than starting from a library. That build-from-scratch approach — feel the mechanism before you abstract it away — is the same pedagogical bet this course makes.

Karpathy returned to OpenAI briefly in 2023–2024 before founding Eureka Labs, focused on AI-assisted education. He also popularized the term "vibe coding" for programming by describing intent to an LLM and iterating on its output rather than writing code by hand.

See also: Fei-Fei Li, Ilya Sutskever

Learn more: Neural Networks & Backprop · Attention & Transformers · Wikipedia: Andrej Karpathy