Wes Gurnee

wesg.me

No followers

community-curated profile

Optimizer @MIT @ORCenter
PhD student interested in Mechanistic Interpretability, Optimization, and Governance.

Overview Content

Paper

Finding Neurons in a Haystack: Case Studies with Sparse Probing

by Wes Gurnee and Neel Nanda (at ICLR)

Recommended by 1 person

1 mention

Tweet May 3, 2023

Neural nets are often thought of as feature extractors. But what features are neurons in LLMs actually extracting? In our new paper, we leverage sparse probing to find out arxiv.org/abs/2305.01610. A 🧵: twitter.com/wesg52/status/1653750337373880322/

by Wes Gurnee