PaulPauls/llama3_interpretability_sae

A complete end-to-end pipeline for LLM interpretability with sparse autoencoders (SAEs) using Llama 3.2, written in pure PyTorch and fully reproducible.

579 best points · 99 comments · 1 Hacker News post · 641 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: Llama 3.2 Interpretability with Sparse Autoencoders (579 points, 99 comments, by PaulPauls, 2024-11-21)