RaFe: Ranking Feedback Improves Query Rewriting for RAG

2024/05/23 by Shengyu Mao, Mao, Shengyu, Yong Jiang +17 · 13 citations
Computer Science · #Artificial Intelligence (cs.AI) #Bayesian Modeling and Causal Inference #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR)

paper · pdf · doi:10.48550/arxiv.2405.14431

openalex publication_date 2024/05/23 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

As Large Language Models (LLMs) and Retrieval Augmentation Generation (RAG) techniques have evolved, query rewriting has been widely incorporated into the RAG system for downstream tasks like open-domain QA. Many works have attempted to utilize small models with reinforcement learning rather than costly LLMs to improve query rewriting. However, current methods require annotations (e.g., labeled relevant documents or downstream answers) or predesigned rewards for feedback, which lack generalization, and fail to utilize signals tailored for query rewriting. In this paper, we propose ours, a framework for training query rewriting models free of annotations. By leveraging a publicly available reranker, ours~provides feedback aligned well with the rewriting objectives. Experimental results demonstrate that ours~can obtain better performance than baselines.

Cited by

• MuISQA: Multi-Intent Retrieval-Augmented Generation for Scientific Question Answering
• QueStER: Query Specification for Generative keyword-based Retrieval
• Adaptive Data Flywheel: Applying MAPE Control Loops to AI Agent Improvement
• Mitigating Hallucination in Large Language Models (LLMs): An Application-Oriented Survey on RAG, Reasoning, and Agentic Systems
• PICOs-RAG: PICO-supported Query Rewriting for Retrieval-Augmented Generation in Evidence-Based Medicine
• Foundation of Intelligence: Review of Math Word Problems from Human Cognition Perspective
• Sherlock Your Queries: Learning to Ask the Right Questions for Dialogue-Based Retrieval
• On Listwise Reranking for Corpus Feedback
• Can Synthetic Query Rewrites Capture User Intent Better than Humans in Retrieval-Augmented Generation?
• SEFRQO: A Self-Evolving Fine-Tuned RAG-Based Query Optimizer
• CORE-RAG: Lossless Compression for Retrieval-Augmented LLMs via Reinforcement Learning
• How Good are LLM-based Rerankers? An Empirical Analysis of State-of-the-Art Reranking Models
• KG-CQR: Leveraging Structured Relation Representations in Knowledge Graphs for Contextual Query Retrieval

Related

• MaFeRw: Query Rewriting with Multi-Aspect Feedbacks for Retrieval-Augmented Large Language Models
• DynamicRAG: Leveraging Outputs of Large Language Model as Feedback for Dynamic Reranking in Retrieval-Augmented Generation
• Annotation-Free Reinforcement Learning Query Rewriting via Verifiable Search Reward
• Query Rewriting for Retrieval-Augmented Large Language Models
• Enhancing Retrieval and Managing Retrieval: A Four-Module Synergy for Improved Quality and Efficiency in RAG Systems