---
title: ChatQA 2: Bridging the Gap to Proprietary LLMs in Long Context and RAG Capabilities
url: https://www.ml-quant.com/papers/arxiv/2407.14482/
site: ML-Quant (https://www.ml-quant.com)
updated: 2026-09-26
license: Summaries CC BY 4.0; links go to the original sources
index: https://www.ml-quant.com/llms.txt
identifier: arXiv:2407.14482
source_url: https://arxiv.org/abs/2407.14482
featured: 2024-07-24
citations: 57
topic: LLMs & Text
---


# ChatQA 2: Bridging the Gap to Proprietary LLMs in Long Context and RAG Capabilities

Bridging the Gap: ChatQA 2 is a model that improves long-context understanding and retrieval-augmented generation, matching the accuracy of top proprietary models.

- Source: https://arxiv.org/abs/2407.14482
- Identifier: arXiv:2407.14482
- Released: 2024-07-19
- First featured: Quant Letter No. 58 (2024-07-24): https://www.ml-quant.com/issues/2024-07-24/
- Citations (Semantic Scholar): 57
- Published in: International Conference on Learning Representations
- Topic: LLMs & Text

## Related

- [RAFT: Adapting Language Model to Domain Specific RAG](https://www.ml-quant.com/papers/arxiv/2403.10131/): Retrieval Augmented FineTuning (RAFT) is a new training method that enhances large language models' ability to answer domain-specific questions by training them to ignore irrelevant documents and cite relevant ones.
- [FACTS About Building Retrieval Augmented Generation-based Chatbots](https://www.ml-quant.com/papers/arxiv/2407.07858/): The article introduces the FACTS framework for developing Retrieval Augmented Generation (RAG)-based chatbots, and presents empirical results on the balance between accuracy and latency in large and small LLMs.
- [KnowPO: Knowledge-aware Preference Optimization for Controllable Knowledge Selection in Retrieval-Augmented Language Models](https://www.ml-quant.com/papers/arxiv/2408.03297/): The study introduces a Knowledge-aware Preference Optimization method to improve large language models' knowledge selection, showing enhanced performance in managing knowledge conflicts and robust generalization across different datasets.
- [RAG-IT: Retrieval-Augmented Instruction Tuning for Automated Financial Analysis - A Case Study for the Semiconductor Sector](https://www.ml-quant.com/papers/arxiv/2412.08179/): The study introduces a new method for automating earnings reports analysis using Large Language Models, with promising initial findings.
- [Retrieval Augmented Generation for Topic Modeling in Organizational Research: An Introduction with Empirical Demonstration](https://www.ml-quant.com/papers/arxiv/2502.20963/): The article presents Agentic RAG, a new method for topic modeling with large language models, offering a more efficient and reliable alternative for AI-based qualitative research.
- [Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters](https://www.ml-quant.com/papers/arxiv/2408.03314/): The research investigates enhancing Large Language Models' (LLMs) performance using more test-time computation, suggesting a compute-optimal scaling strategy based on prompt difficulty.