Machine learningML & AI Methods
Jumping Ahead: Improving Reconstruction Fidelity with JumpReLU Sparse Autoencoders
The paper presents JumpReLU Sparse Autoencoders (SAEs), which provide high-quality reconstruction of language model activations at a specific sparsity level, while maintaining interpretability.
Featured in No. 60 on 7 Aug 2024 · 19 days after release · 305 citations today
- Released
- 19 Jul 2024
- First featured
- No. 60 · 7 Aug 2024
- Citations (Semantic Scholar)
- 305
- Influential citations
- 21
- Published in
- Not yet, as far as Semantic Scholar knows
- Shares when featured
- 125
- Identifier
- arXiv:2407.14435
Citations and venue from Semantic Scholar (ODC-BY), refreshed weekly. Summary: Quant Letter (CC BY 4.0).