AIDevStart
HomeDirectoryModelsListsComparisonsBlogLearn AI Dev
Submit Tool
AIDevStart

Empowering developers with curated AI tools across the entire stack.

Some links on this site are affiliate links. We may earn a commission at no extra cost to you. Learn more.

PrivacyTermsCookiesDisclosure

© 2026 AIDevStart. All rights reserved.

Back to Learn AI Dev
Deep Learning

Let's Build GPT: From Scratch, in Code

2023-01-17Andrej Karpathy

About this Video

The definitive hands-on tutorial by Andrej Karpathy. Build a GPT language model from scratch using Python and PyTorch, implementing every component — tokenization, embeddings, multi-head attention, and training. 2 hours of pure deep learning.

Original Content

This content is embedded from YouTube. All credit goes to the original creator Andrej Karpathy. Please support them by subscribing to their channel.

Visit Channel

Recommended Courses

Udemy$16.99

PyTorch for Deep Learning Bootcamp

Learn PyTorch from zero to mastery. Build neural networks and train them using modern best practices.

View Course

* Links may include affiliate tracking.