Machine learningOther
Kangaroo: Lossless Self-Speculative Decoding via Double Early Exiting
The paper introduces Kangaroo, a self-speculative decoding framework that uses a small model to increase token acceptance rate and minimize drafting steps.
Featured in No. 47 on 1 May 2024 · 2 days after release · 61 citations today
- Released
- 29 Apr 2024
- First featured
- No. 47 · 1 May 2024
- Citations (Semantic Scholar)
- 61
- Influential citations
- 6
- Published in
- Not yet, as far as Semantic Scholar knows
- Shares when featured
- 9
- Identifier
- arXiv:2404.18911
Citations and venue from Semantic Scholar (ODC-BY), refreshed weekly. Summary: Quant Letter (CC BY 4.0).