Machine learningLLMs & Text
No Train, all Gain: Self-Supervised Gradients Improve Deep Frozen Representations
The FUNGI method improves transformer encoders' features using self-supervised gradients, enhancing performance in vision, natural language processing, and audio tasks and datasets.
Featured in No. 74 on 13 Nov 2024 · · 6 citations today
- Released
- 15 Jul 2024
- First featured
- No. 74 · 13 Nov 2024
- Citations (Semantic Scholar)
- 6
- Influential citations
- 0
- Published in
- Not yet, as far as Semantic Scholar knows
- Shares when featured
- 78
- Identifier
- arXiv:2407.10964
Citations and venue from Semantic Scholar (ODC-BY), refreshed weekly. Summary: Quant Letter (CC BY 4.0).