Andrej Karpathy

63 Followers

community-curated profile

Director of AI at Tesla. Previously a research scientist at OpenAI and CS PhD student at Stanford. I like to train deep neural nets on large datasets 🧠🤖💥

Overview Posts Content Recommendations

Video Nov 23, 2023

Intro to Large Language Models

by Andrej Karpathy

Recommended by 3 people

5 mentions

Video Jan 17, 2023

Let's build GPT: from scratch, in code, spelled out.

by Andrej Karpathy

Recommended by 2 people

1 mention

Article Apr 25, 2019

A Recipe for Training Neural Networks

by Andrej Karpathy

Recommended by 2 people

2 mentions

Tweet Sep 28, 2023

With many 🧩 dropping recently, a more complete picture is emerging of LLMs not as a chatbot, but the kernel process of a new Operating System. E.g. today it orchestrates: - Input & Output across modalities (text, audio, vision) - Code interpreter, a

by Andrej Karpathy

Recommended by 1 person

1 mention

Video May 25, 2023

State of GPT | BRK216HFS

by Andrej Karpathy

Recommended by 1 person

1 mention

Tweet Jan 17, 2023

🔥 New (1h56m) video lecture: "Let's build GPT: from scratch, in code, spelled out."www.youtube.com/watch?v=kCc8FmEb1nY We build and train a Transformer following the "Attention Is All You Need" paper in the language modeling setting and end up with

by Andrej Karpathy

Recommended by 1 person

1 mention

Video Nov 21, 2022

Building makemore Part 5: Building a WaveNet

by Andrej Karpathy

Recommended by 1 person

1 mention

Tweet Oct 16, 2022

Movies that I've seen 5+ times but ready & willing to keep watching: Interstellar, Gladiator, Contact, Good Will Hunting, The Matrix, LotR 1/2/3, HP 1, Avatar, The Fifth Element, The Independence Day, Rush Hour, Armageddon, Stargate, Anchorman, Mean

by Andrej Karpathy

Recommended by 1 person

1 mention

Video Oct 11, 2022

Building makemore Part 4: Becoming a Backprop Ninja

by Andrej Karpathy

Recommended by 1 person

1 mention

Video Oct 4, 2022

Building makemore Part 3: Activations & Gradients, BatchNorm

by Andrej Karpathy

Recommended by 1 person

1 mention

Article

makemore/makemore.py at master · karpathy/makemore

by Andrej Karpathy

Recommended by 1 person

1 mention

Tweet Nov 7, 2023

@simonw @emollick And eventually finetunes will be a big one too, and the data generating process backing them, and how that interacts with RAG and custom instructions and the prompt. There is enough here to build a moat imo.

by Andrej Karpathy

Andrej Karpathy

Most Recommended