Reasoning with Language Model Prompting: A Survey

2022/12/19 by Qiao, Shuofei, Ou, Yixin, Zhang, Ningyu +6 · 25 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Machine Learning (cs.LG)

paper · doi:10.48550/arxiv.2212.09597

Abstract

Reasoning, as an essential ability for complex problem-solving, can provide back-end support for various real-world applications, such as medical diagnosis, negotiation, etc. This paper provides a comprehensive survey of cutting-edge research on reasoning with language model prompting. We introduce research works with comparisons and summaries and provide systematic resources to help beginners. We also discuss the potential reasons for emerging such reasoning abilities and highlight future research directions. Resources are available at https://github.com/zjunlp/Prompt4ReasoningPapers (updated periodically).

Cited by

• Beyond Correctness: Exposing LLM-generated Logical Flaws in Reasoning via Multi-step Automated Theorem Proving
• Collaborative Causal Sensemaking: Closing the Complementarity Gap in Human-AI Decision Support
• From Hypothesis to Premises: LLM-based Backward Logical Reasoning with Selective Symbolic Translation
• Cross-Lingual Prompt Steerability: Towards Accurate and Robust LLM Behavior across Languages
• DETAIL Matters: Measuring the Impact of Prompt Specificity on Reasoning in Large Language Models
• Structured Definitions and Segmentations for Legal Reasoning in LLMs: A Study on Indian Legal Data
• SPAN: Benchmarking and Improving Cross-Calendar Temporal Reasoning of Large Language Models
• Prompt-R1: Collaborative Automatic Prompting Framework via End-to-end Reinforcement Learning
• The Riddle of Reflection: Evaluating Reasoning and Self-Awareness in Multilingual LLMs using Indian Riddles
• SoK: Honeypots & LLMs, More Than the Sum of Their Parts?
• Rewarding the Scientific Process: Process-Level Reward Modeling for Agentic Data Analysis
• Reasoning About Reasoning: Towards Informed and Reflective Use of LLM Reasoning in HCI
• Select-Then-Decompose: From Empirical Analysis to Adaptive Selection Strategy for Task Decomposition in Large Language Models
• Merlin's Whisper: Enabling Efficient Reasoning in LLMs via Black-box Adversarial Prompting
• Test-Time Reasoners Are Strategic Multiple-Choice Test-Takers
• Mission Impossible: Feedback-Guided Dynamic Interactive Planning for Improving Reasoning on LLMs
• A Survey on Automatic Credibility Assessment Using Textual Credibility Signals in the Era of Large Language Models
• Scaling Generalist Data-Analytic Agents
• Transformer Tafsir at QIAS 2025 Shared Task: Hybrid Retrieval-Augmented Generation for Islamic Knowledge Question Answering
• PRIME: Planning and Retrieval-Integrated Memory for Enhanced Reasoning
• Inducing Faithfulness in Structured Reasoning via Counterfactual Sensitivity
• Memp: Exploring Agent Procedural Memory
• Streamlining Admission with LOR Insights: AI-Based Leadership Assessment in Online Master's Program
• Can Large Language Models Generate Effective Datasets for Emotion Recognition in Conversations?
• OS Agents: A Survey on MLLM-based Agents for General Computing Devices Use
• Reconsidering Overthinking: Penalizing Internal and External Redundancy in CoT Reasoning

Related

• Towards Reasoning in Large Language Models: A Survey
• Unlocking Structured Thinking in Language Models with Cognitive Prompting
• Prompting as Probing: Using Language Models for Knowledge Base Construction
• A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applications
• Reasoning Strategies in Large Language Models: Can They Follow, Prefer, and Optimize?