---
title: KnowPO: Knowledge-aware Preference Optimization for Controllable Knowledge Selection in Retrieval-Augmented Language Models
url: https://www.ml-quant.com/papers/arxiv/2408.03297/
site: ML-Quant (https://www.ml-quant.com)
updated: 2026-09-26
license: Summaries CC BY 4.0; links go to the original sources
index: https://www.ml-quant.com/llms.txt
identifier: arXiv:2408.03297
source_url: https://arxiv.org/abs/2408.03297
featured: 2024-08-07
citations: 22
topic: LLMs & Text
---


# KnowPO: Knowledge-aware Preference Optimization for Controllable Knowledge Selection in Retrieval-Augmented Language Models

The study introduces a Knowledge-aware Preference Optimization method to improve large language models' knowledge selection, showing enhanced performance in managing knowledge conflicts and robust generalization across different datasets.

- Source: https://arxiv.org/abs/2408.03297
- Identifier: arXiv:2408.03297
- Released: 2024-08-06
- First featured: Quant Letter No. 60 (2024-08-07): https://www.ml-quant.com/issues/2024-08-07/
- Citations (Semantic Scholar): 22
- Published in: AAAI Conference on Artificial Intelligence
- Topic: LLMs & Text

## Related

- [RAFT: Adapting Language Model to Domain Specific RAG](https://www.ml-quant.com/papers/arxiv/2403.10131/): Retrieval Augmented FineTuning (RAFT) is a new training method that enhances large language models' ability to answer domain-specific questions by training them to ignore irrelevant documents and cite relevant ones.
- [ChatQA 2: Bridging the Gap to Proprietary LLMs in Long Context and RAG Capabilities](https://www.ml-quant.com/papers/arxiv/2407.14482/): Bridging the Gap: ChatQA 2 is a model that improves long-context understanding and retrieval-augmented generation, matching the accuracy of top proprietary models.
- [FACTS About Building Retrieval Augmented Generation-based Chatbots](https://www.ml-quant.com/papers/arxiv/2407.07858/): The article introduces the FACTS framework for developing Retrieval Augmented Generation (RAG)-based chatbots, and presents empirical results on the balance between accuracy and latency in large and small LLMs.
- [RAG-IT: Retrieval-Augmented Instruction Tuning for Automated Financial Analysis - A Case Study for the Semiconductor Sector](https://www.ml-quant.com/papers/arxiv/2412.08179/): The study introduces a new method for automating earnings reports analysis using Large Language Models, with promising initial findings.
- [Retrieval Augmented Generation for Topic Modeling in Organizational Research: An Introduction with Empirical Demonstration](https://www.ml-quant.com/papers/arxiv/2502.20963/): The article presents Agentic RAG, a new method for topic modeling with large language models, offering a more efficient and reliable alternative for AI-based qualitative research.
- [Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters](https://www.ml-quant.com/papers/arxiv/2408.03314/): The research investigates enhancing Large Language Models' (LLMs) performance using more test-time computation, suggesting a compute-optimal scaling strategy based on prompt difficulty.