Machine learningLLMs & Text
Scalable MatMul-free Language Modeling
Scientists have developed a method to remove matrix multiplication from large language models, reducing memory usage by up to 61% during training and over 10x during inference, making these models more efficient.
Featured in No. 54 on 20 Jun 2024 · 16 days after release · 45 citations today
- Released
- 4 Jun 2024
- First featured
- No. 54 · 20 Jun 2024
- Citations (Semantic Scholar)
- 45
- Influential citations
- 4
- Published in
- Not yet, as far as Semantic Scholar knows
- Shares when featured
- 610
- Identifier
- arXiv:2406.02528
Citations and venue from Semantic Scholar (ODC-BY), refreshed weekly. Summary: Quant Letter (CC BY 4.0).