Machine learningML & AI Methods
A Dynamical Model of Neural Scaling Laws
A study examines a random feature model trained with gradient descent, providing insights into neural scaling laws, including the correlation between performance, training time, model size, and the increasing gap between training and test loss due to repeated data use.
Featured in No. 45 on 17 Apr 2024 · · 112 citations today · published in International Conference on Machine Learning
- Released
- 2 Feb 2024
- First featured
- No. 45 · 17 Apr 2024
- Citations (Semantic Scholar)
- 112
- Influential citations
- 5
- Published in
- International Conference on Machine Learning
- Shares when featured
- 69
- Identifier
- arXiv:2402.01092
Citations and venue from Semantic Scholar (ODC-BY), refreshed weekly. Summary: Quant Letter (CC BY 4.0).