Machine learningML & AI Methods
Emergence in non-neural models: grokking modular arithmetic via average gradient outer product
The 'grokking' phenomenon, where a model's test accuracy improves after achieving 100% training accuracy, can also occur with Recursive Feature Machines, not just neural networks.
Featured in No. 59 on 31 Jul 2024 · 2 days after release · 28 citations today · published in International Conference on Machine Learning
- Released
- 29 Jul 2024
- First featured
- No. 59 · 31 Jul 2024
- Citations (Semantic Scholar)
- 28
- Influential citations
- 5
- Published in
- International Conference on Machine Learning
- Shares when featured
- 14
- Identifier
- arXiv:2407.20199
Citations and venue from Semantic Scholar (ODC-BY), refreshed weekly. Summary: Quant Letter (CC BY 4.0).