Machine learningML & AI Methods
Differential Transformer
The Diff Transformer is a new language model architecture that enhances attention to relevant context and reduces noise, outperforming the standard Transformer in long-context modeling and key information retrieval.
Featured in No. 69 on 9 Oct 2024 · 2 days after release · 1 citation today · published in International Conference on Learning Representations
- Released
- 7 Oct 2024
- First featured
- No. 69 · 9 Oct 2024
- Citations (Semantic Scholar)
- 1
- Influential citations
- 0
- Published in
- International Conference on Learning Representations
- Shares when featured
- 102
- Identifier
- arXiv:2410.05258
Citations and venue from Semantic Scholar (ODC-BY), refreshed weekly. Summary: Quant Letter (CC BY 4.0).