Machine learningLLMs & Text
How Do Large Language Models Acquire Factual Knowledge During Pretraining?
Large language models (LLMs) learn factual knowledge during pretraining, but this knowledge is often forgotten in subsequent steps.
Featured in No. 54 on 20 Jun 2024 · 3 days after release · 118 citations today · published in Neural Information Processing Systems
- Released
- 17 Jun 2024
- First featured
- No. 54 · 20 Jun 2024
- Citations (Semantic Scholar)
- 118
- Influential citations
- 8
- Published in
- Neural Information Processing Systems
- Shares when featured
- 124
- Identifier
- arXiv:2406.11813
Citations and venue from Semantic Scholar (ODC-BY), refreshed weekly. Summary: Quant Letter (CC BY 4.0).