Machine learningLLMs & Text
Metadata Conditioning Accelerates Language Model Pre-training
The MeCo method speeds up language model pre-training by using additional learning cues, allowing the model to work without metadata and enhancing task performance.
Featured in No. 81 on 8 Jan 2025 · 5 days after release · 22 citations today · published in International Conference on Machine Learning
- Released
- 3 Jan 2025
- First featured
- No. 81 · 8 Jan 2025
- Citations (Semantic Scholar)
- 22
- Influential citations
- 3
- Published in
- International Conference on Machine Learning
- Shares when featured
- 114
- Identifier
- arXiv:2501.01956
Citations and venue from Semantic Scholar (ODC-BY), refreshed weekly. Summary: Quant Letter (CC BY 4.0).