upcarta
  • Sign In
  • Sign Up
  • Explore
  • Search

Large Language Models from scratch

  • Video
  • Jul 17, 2022
  • #Naturallanguageprocessing
www.youtube.com
Watch on Youtube
5,811 8 min
1 Recommender
1 Mention
How do language models like chatGPT and Palm work? A short cartoon that explains transformers and the tech behind LLMs. Part 2: https://youtu.be/YDiSFS-yHwk 0:05 - autocomplete... Show More

How do language models like chatGPT and Palm work? A short cartoon that explains transformers and the tech behind LLMs.
Part 2: https://youtu.be/YDiSFS-yHwk

0:05 - autocomplete
0:44 - search query completion
1:03 - language modeling with probabilities
1:59 - time series and graphs
2:34 - text generation
3:43 - conditional probabilities
3:52 - trigrams
4:49 - universal function approximation
5:19 - neural networks
6:33 - gradient descent
7:03 - back propagation
7:24 - network capacity

(From Youtube)

Show Less
Recommend
Post
Save
Complete
Collect
Mentions
See All
Justin Mikolay @JustinMikolay ยท Apr 14, 2023
  • Post
  • From Twitter
This is the best explanation of how language models like ChatGPT work. It demonstrates how models translate language into math, and it shows how models are trained.
  • upcarta ©2025
  • Home
  • About
  • Terms
  • Privacy
  • Cookies
  • @upcarta