2025/02/13 by Zongyu Chang, Chang, Zongyu, Fu‐Hsing Lu +19 · 2 citations
Computer Science · Mathematics · #FOS: Computer and information sciences #Human-Computer Interaction (cs.HC) #Intelligent Tutoring Systems and Adaptive Learning #Statistics Education and Methodologies
paper · pdf · doi:10.48550/arxiv.2502.09101
openalex publication_date 2025/02/13 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/02
Large language models have demonstrated exceptional capabilities in understanding and generation. However, in real-world scenarios, users' natural language expressions are often inherently fuzzy, ambiguous, and uncertain, leading to challenges such as vagueness, polysemy, and contextual ambiguity. This paper focuses on three challenges in LLM-based text generation tasks: instruction understanding, intention reasoning, and reliable dialog generation. Regarding human complex instruction, LLMs have deficiencies in understanding long contexts and instructions in multi-round conversations. For intention reasoning, LLMs may have inconsistent command reasoning, difficulty reasoning about commands containing incorrect information, difficulty understanding user ambiguous language commands, and a weak understanding of user intention in commands. Besides, In terms of Reliable Dialog Generation, LLMs may have unstable generated content and unethical generation. To this end, we classify and analyze the performance of LLMs in challenging scenarios and conduct a comprehensive evaluation of existing solutions. Furthermore, we introduce benchmarks and categorize them based on the aforementioned three core challenges. Finally, we explore potential directions for future research to enhance the reliability and adaptability of LLMs in real-world applications.