swyx.ai

This is still the best* introduction to GPTs I have ever read. [link] Fills in all the gaps between Attention is All You Need right up to coding every single line of a working GPT2 implementation yourself. Even ends with explanations of finetuning for…

read this paper in full. several important techniques demonstrated, together with good and thoughtful ablations. very great work by @DrJimFan and team! chatted a bit with autogpt team. think they would appreciate also seeing the reimplemented autogpt code, so they can study…