Machine learningLLMs & Text
TinyLlama: An Open-Source Small Language Model
Small Open-Source Language Model: The article presents TinyLlama, a compact 1.1B language model that performs remarkably well in various tasks despite its small size, having been pretrained on around 1 trillion tokens.
Featured in No. 32 on 9 Jan 2024 · 5 days after release · 902 citations today
- Released
- 4 Jan 2024
- First featured
- No. 32 · 9 Jan 2024
- Citations (Semantic Scholar)
- 902
- Influential citations
- 96
- Published in
- Not yet, as far as Semantic Scholar knows
- Shares when featured
- 82
- Identifier
- arXiv:2401.02385
Citations and venue from Semantic Scholar (ODC-BY), refreshed weekly. Summary: Quant Letter (CC BY 4.0).