Machine learningLLMs & Text
Found in the Middle: Calibrating Positional Attention Bias Improves Long Context Utilization
The found-in-the-middle calibration mechanism addresses the lost-in-the-middle problem in large language models, improving the model's ability to locate relevant information and enhancing performance.
Featured in No. 56 on 10 Jul 2024 · 17 days after release · 131 citations today · published in Annual Meeting of the Association for Computational Linguistics
- Released
- 23 Jun 2024
- First featured
- No. 56 · 10 Jul 2024
- Citations (Semantic Scholar)
- 131
- Influential citations
- 8
- Published in
- Annual Meeting of the Association for Computational Linguistics
- Shares when featured
- 184
- Identifier
- arXiv:2406.16008
Citations and venue from Semantic Scholar (ODC-BY), refreshed weekly. Summary: Quant Letter (CC BY 4.0).