A Survey on Multi-Turn Interaction Capabilities of Large Language Models

2025/01/17 by Chen Zhang, Zhang, Chen, Xinyi Dai +10 · 21 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling

paper · pdf · doi:10.48550/arxiv.2501.09959

openalex publication_date 2025/01/17 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Multi-turn interaction in the dialogue system research refers to a system's ability to maintain context across multiple dialogue turns, enabling it to generate coherent and contextually relevant responses. Recent advancements in large language models (LLMs) have significantly expanded the scope of multi-turn interaction, moving beyond chatbots to enable more dynamic agentic interactions with users or environments. In this paper, we provide a focused review of the multi-turn capabilities of LLMs, which are critical for a wide range of downstream applications, including conversational search and recommendation, consultation services, and interactive tutoring. This survey explores four key aspects: (1) the core model capabilities that contribute to effective multi-turn interaction, (2) how multi-turn interaction is evaluated in current practice, (3) the general algorithms used to enhance multi-turn interaction, and (4) potential future directions for research in this field.

Cited by

• KVNAND: Efficient On-Device Large Language Model Inference Using DRAM-Free In-Flash Computing
• Charts Are Not Images: On the Challenges of Scientific Chart Editing
• Online Adaptive Probabilistic Safety Certificate with Language Guidance
• Unlocking the Power of Multi-Agent LLM for Reasoning: From Lazy Agents to Deliberation
• Rethinking Text-to-SQL: Dynamic Multi-turn SQL Interaction for Real-world Database Exploration
• State-Dependent Safety Failures in Multi-Turn Language Model Interaction
• A Principle-based Framework for the Development and Evaluation of Large Language Models for Health and Wellness
• Beyond One-Way Influence: Bidirectional Opinion Dynamics in Multi-Turn Human-LLM Interactions
• Simulating Viva Voce Examinations to Evaluate Clinical Reasoning in Large Language Models
• Autoencoding-Free Context Compression for LLMs via Contextual Semantic Anchors
• Test-Time Policy Adaptation for Enhanced Multi-Turn Interactions with LLMs
• H2EAL: Hybrid-Bonding Architecture with Hybrid Sparse Attention for Efficient Long-Context LLM Inference
• Multi-Turn Puzzles: Evaluating Interactive Reasoning and Strategic Dialogue in LLMs
• HCAttention: Extreme KV Cache Compression via Heterogeneous Attention Computing for LLMs
• A Simple "Try Again" Can Elicit Multi-Turn LLM Reasoning
• StoryBench: A Dynamic Benchmark for Evaluating Long-Term Memory with Multi Turns
• Evaluating the Sensitivity of LLMs to Prior Context
• SoK: Intent-Oriented Systematization of Multi-Turn LLM Jailbreaks
• Useless but Safe? Benchmarking Utility Recovery with User Intent Clarification in Multi-Turn Conversations
• Feedback by Design: Understanding and Overcoming User Feedback Barriers in Conversational Agents
• From Human Memory to AI Memory: A Survey on Memory Mechanisms in the Era of LLMs
• A Desideratum for Conversational Agents: Capabilities, Challenges, and Future Directions

Related

• Beyond Single-Turn: A Survey on Multi-Turn Interactions with Large Language Models
• A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systems
• Evaluating LLM-based Agents for Multi-Turn Conversations: A Survey
• Can a Single Model Master Both Multi-turn Conversations and Tool Use? CoALM: A Unified Conversational Agentic Language Model
• Eliciting Behaviors in Multi-Turn Conversations