Xiang Yue

1. Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization
   2024/05/23 by Boshi Wang, Wang, Boshi, Xiang Yue +5 · 3 voices · 32 citations
   Computer Science · Engineering · Mathematics · #Computer science #Electrical engineering #Engineering #Evolutionary Algorithms and Applications #Generalization #Mathematical analysis #Mathematics #Neural Networks and Applications #Semantic Web and Ontologies #Transformer
2. MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI
   2023/11/27 by Xiang Yue, Yuansheng Ni, Yue, Xiang +41 · 774 citations
   Computer Science · #Topic Modeling #Multimodal Machine Learning Applications #Natural Language Processing Techniques
3. Demystifying Long Chain-of-Thought Reasoning in LLMs
   2025/02/05 by Edward Yeo, Yeo, Edward, Yuxuan Tong +7 · 6 voices · 191 citations
   Business, Management and Accounting · Computer Science · #Business Process Modeling and Analysis #Multi-Agent Systems and Negotiation #Semantic Web and Ontologies #cs.CL #cs.LG
4. Can ChatGPT Defend its Belief in Truth? Evaluating LLM Reasoning via Debate
   2023/05/22 by Boshi Wang, Wang, Boshi, Xiang Yue +3 · 1 voice · 40 citations
   Computer Science · Engineering · #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Topic Modeling #cs.CL
5. MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmark
   2024/09/04 by Xiang Yue, Tianyu Zheng, Yue, Xiang +23 · 193 citations
   Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech and dialogue systems
6. MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuning
   2023/09/11 by Xiang Yue, Yue, Xiang, Xingwei Qu +13 · 109 citations
   Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Intelligent Tutoring Systems and Adaptive Learning #Online Learning and Analytics #Topic Modeling
7. SuperGPQA: Scaling LLM Evaluation across 285 Graduate Disciplines
   2025/02/20 by M-A-P Team, P Team, Xinrun Du +201 · 2 voices · 109 citations
   Computer Science · Social Sciences · #Artificial Intelligence in Law #Computation and Language (cs.CL) #FOS: Computer and information sciences #cs.CL
8. OpenCodeInterpreter: Integrating Code Generation with Execution and Refinement
   2024/02/22 by Tianyu Zheng, Ge Zhang, Zheng, Tianyu +14 · 2 voices · 70 citations
   Computer Science · #Logic, programming, and type systems #Model-Driven Software Engineering Techniques #Software Testing and Debugging Techniques #cs.AI #cs.CL #cs.SE
9. Long-context LLMs Struggle with Long In-context Learning
   2024/04/02 by Tianle Li, Li, Tianle, Ge Zhang +7 · 91 citations
   Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Library Science and Information Systems #Semantic Web and Ontologies
10. VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluation
    2023/12/22 by Max Ku, Ku, Max, Dongfu Jiang +7 · 1 voice · 63 citations
    Computer Science · #Explainable Artificial Intelligence (XAI) #Generative Adversarial Networks and Image Synthesis #Multimodal Machine Learning Applications #cs.AI #cs.CL #cs.CV #cs.MM
11. Overtrained Language Models Are Harder to Fine-Tune
    2025/03/24 by Jacob Mitchell Springer, Jacob M. Springer, Sachin Goyal +14 · 8 voices · 35 citations
    Computer Science · #Adaptability #Language model #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Overtraining #Security token #Sensitivity (control systems) #Term (time) #Topic Modeling #cs.AI #cs.CL
12. TableLlama: Towards Open Large Generalist Models for Tables
    2023/11/15 by Tianshu Zhang, Xiang Yue, Zhang, Tianshu +5 · 50 citations
    Computer Science · Decision Sciences · #Advanced Text Analysis Techniques #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Data Quality and Management #Databases (cs.DB) #FOS: Computer and information sciences #Topic Modeling
13. Trial and Error: Exploration-Based Trajectory Optimization for LLM Agents
    2024/03/04 by Yifan Song, Song, Yifan, Yin Da +9 · 54 citations
    Computer Science · Decision Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotic Path Planning Algorithms #Simulation Techniques and Applications
14. Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videos
    2025/01/23 by Kairui Hu, Hu, Kairui, Penghao Wu +13 · 94 citations
    Social Sciences · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Online and Blended Learning
15. MAmmoTH2: Scaling Instructions from the Web
    2024/05/06 by Xiang Yue, Tuney Zheng, Yue, Xiang +5 · 52 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Video Analysis and Summarization
16. Synthetic Text Generation with Differential Privacy: A Simple and Practical Recipe
    2022/10/25 by Xiang Yue, Huseyin A. Inan, Yue, Xiang +14 · 28 citations
    Computer Science · #Privacy-Preserving Technologies in Data #Digital and Cyber Forensics
17. MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale
    2024/12/06 by Jining Guo, Jarvis Guo, T. Zheng +21 · 1 voice · 58 citations
    Computer Science · #Intelligent Tutoring Systems and Adaptive Learning #cs.CL #cs.CV
18. VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?
    2024/04/09 by Junpeng Liu, Liu, Junpeng, Yifan Song +11 · 38 citations
    Arts and Humanities · Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Lexicography and Language Studies #Natural Language Processing Techniques #Semantic Web and Ontologies
19. Machine Unlearning of Pre-trained Large Language Models
    2024/02/23 by Yao Jin, Eli Chien, Yao, Jin +11 · 35 citations
    Computer Science · #Natural Language Processing Techniques #Topic Modeling
20. Data Engineering for Scaling Language Models to 128K Context
    2024/02/15 by Yao Fu, Fu, Yao, Rameswar Panda +11 · 34 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Network Packet Processing and Optimization #Parallel Computing and Optimization Techniques
21. Differential Privacy for Text Analytics via Natural Text Sanitization
    2021/06/02 by Xiang Yue, Minxin Du, Yue, Xiang +9 · 18 citations
    Computer Science · #Adversarial Robustness in Machine Learning #Computation and Language (cs.CL) #Cryptography and Data Security #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Privacy-Preserving Technologies in Data #cs.CL #cs.CR
22. Does Math Reasoning Improve General LLM Capabilities? Understanding Transferability of LLM Reasoning
    2025/07/01 by Maggie Huan, Y Li, Huan, Maggie +17 · 1 voice · 53 citations
    Computer Science · #Explainable Artificial Intelligence (XAI) #Multimodal Machine Learning Applications #Topic Modeling #cs.AI #cs.CL
23. Small Models Struggle to Learn from Strong Reasoners
    2025/02/17 by Yuetai Li, Xiang Yue, Yue Xiang +14 · 1 voice · 52 citations
    Computer Science · Decision Sciences · Engineering · Mathematics · #Complex Systems and Decision Making #Reservoir Engineering and Simulation Methods #Statistics Education and Methodologies #cs.AI
24. MixEval: Deriving Wisdom of the Crowd from LLM Benchmark Mixtures
    2024/06/03 by Jinjie Ni, Ni, Jinjie, Fuzhao Xue +13 · 24 citations
    Computer Science · Business, Management and Accounting · #Statistical and Computational Modeling #Business Process Modeling and Analysis #Digital Rights Management and Security
25. Automatic Evaluation of Attribution by Large Language Models
    2023/05/10 by Xiang Yue, Boshi Wang, Yue, Xiang +9 · 15 citations
    Computer Science · Social Sciences · #Computation and Language (cs.CL) #Computational and Text Analysis Methods #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
26. Pangea: A Fully Open Multilingual Multimodal LLM for 39 Languages
    2024/10/21 by Xiang Yue, Yueqi Song, Yue, Xiang +17 · 29 citations
    Arts and Humanities · Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling #Translation Studies and Practices
27. Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate
    2025/01/29 by Yübo Wang, Yubo Wang, Xiang Yue +5 · 1 voice · 28 citations
    Computer Science · Social Sciences · #Computation and Language (cs.CL) #Education and Critical Thinking Development #FOS: Computer and information sciences #cs.CL
28. MEGA-Bench: Scaling Multimodal Evaluation to over 500 Real-World Tasks
    2024/10/14 by Jiacheng Chen, Chen, Jiacheng, Sherman Siu +27 · 19 citations
    Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Speech and dialogue systems
29. MuPT: A Generative Symbolic Music Pretrained Transformer
    2024/04/09 by Xingwei Qu, Yuelin Bai, Qu, Xingwei +53 · 14 citations
    Computer Science · Neuroscience · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music Technology and Sound Studies #Music and Audio Processing #Neuroscience and Music Perception #Sound (cs.SD) #electronic engineering #information engineering
30. StructLM: Towards Building Generalist Models for Structured Knowledge Grounding
    2024/02/26 by Alex Zhuang, Zhuang, Alex, Ge Zhang +17 · 2 voices · 10 citations
    Computer Science · Engineering · #Computer science #Ecology #Electrical engineering #Engineering #Generalist and specialist species #Ground #Knowledge management #Natural Language Processing Techniques #Semantic Web and Ontologies #Topic Modeling
31. CodeEditorBench: Evaluating Code Editing Capability of Large Language Models
    2024/04/04 by Jiawei Guo, Ziming Li, Guo, Jiawei +29 · 11 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Code (set theory) #Computation and Language (cs.CL) #Computer science #FOS: Computer and information sciences #Machine Learning (cs.LG) #Model-Driven Software Engineering Techniques #Programming language #Software Engineering (cs.SE) #Software Engineering Research #Software System Performance and Reliability
32. Evaluating Language Models as Synthetic Data Generators
    2024/12/04 by Seungone Kim, Juyoung Suk, Kim, Seungone +17 · 16 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
33. On the Interplay of Pre-Training, Mid-Training, and RL on Reasoning Language Models
    2025/12/08 by Charlie Zhang, Zhang, Charlie, Graham Neubig +3 · 2 voices · 8 citations
    Computer Science · #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Topic Modeling #cs.CL
34. VisualPuzzles: Decoupling Multimodal Reasoning Evaluation from Domain Knowledge
    2025/04/14 by Yueqi Song, Song, Yueqi, Tianyue Ou +9 · 20 citations
    Computer Science · #Advanced Graph Neural Networks #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Topic Modeling
35. Harnessing Webpage UIs for Text-Rich Visual Understanding
    2024/10/17 by Junpeng Liu, Tianyue Ou, Liu, Junpeng +15 · 10 citations
    Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Video Analysis and Summarization
36. CliniQG4QA: Generating Diverse Questions for Domain Adaptation of Clinical Question Answering
    2020/10/30 by Xiang Yue, Yue, Xiang, Xinliang Frederick Zhang +7 · 3 citations
    Biochemistry, Genetics and Molecular Biology · Computer Science · #Biomedical Text Mining and Ontologies #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
37. PHICON: Improving Generalization of Clinical Text De-identification Models via Data Augmentation
    2020/10/11 by Xiang Yue, Shuang Zhou, Yue, Xiang +1 · 3 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning in Healthcare #Natural Language Processing Techniques #Topic Modeling #cs.CL
38. The Tool Decathlon: Benchmarking Language Agents for Diverse, Realistic, and Long-Horizon Task Execution
    2025/10/29 by Junlong Li, Li, Junlong, Wenshuo Zhao +39 · 1 voice · 10 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #cs.AI #cs.CL
39. JMMMU: A Japanese Massive Multi-discipline Multimodal Understanding Benchmark for Culture-aware Evaluation
    2024/10/22 by Shota Onohara, Atsuyuki Miyai, Onohara, Shota +13 · 8 citations
    Arts and Humanities · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #EFL/ESL Teaching and Learning #FOS: Computer and information sciences
40. Scaling Evaluation-time Compute with Reasoning Models as Evaluators
    2025/03/25 by Seungone Kim, Kim, Seungone, Ian Wu +19 · 11 citations
    Computer Science · #cs.CL
41. Teach Multimodal LLMs to Comprehend Electrocardiographic Images
    2024/10/21 by Ruoqi Liu, Yuelin Bai, Liu, Ruoqi +5 · 7 citations
    Computer Science · Engineering · Medicine · #Advanced Computational Techniques and Applications #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #ECG Monitoring and Analysis #FOS: Computer and information sciences #FOS: Electrical engineering #Image and Video Processing (eess.IV) #Oil and Gas Production Techniques #electronic engineering #information engineering
42. ScholarCopilot: Training Large Language Models for Academic Writing with Accurate Citations
    2025/04/01 by Yubo Wang, Wang, Yubo, Xueguang Ma +17 · 3 voices · 5 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #cs.CL
43. Unlearning Isn't Deletion: Investigating Reversibility of Machine Unlearning in LLMs
    2025/05/22 by Xiaoyu Xu, Xu, Xiaoyu, Xiang Yue +13 · 9 citations
    Computer Science · Social Sciences · Medicine · #Explainable Artificial Intelligence (XAI) #Ethics and Social Impacts of AI #Artificial Intelligence in Healthcare and Education
44. Long Context Alignment with Short Instructions and Synthesized Positions
    2024/05/07 by Wenhao Wu, Wu, Wenhao, Yi‐Zhong Wang +9 · 3 citations
    Computer Science · #Advanced Image and Video Retrieval Techniques #Computation and Language (cs.CL) #FOS: Computer and information sciences #Speech and Audio Processing #Video Analysis and Summarization
45. Agent Data Protocol: Unifying Datasets for Diverse, Effective Fine-tuning of LLM Agents
    2025/10/28 by Yueqi Song, Ketan Ramaneti, Song, Yueqi +39 · 1 voice · 5 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #cs.AI #cs.CL
46. OpusLM: A Family of Open Unified Speech Language Models
    2025/06/21 by Jinchuan Tian, William Chen, Tian, Jinchuan +21 · 7 citations
    Computer Science · #Speech Recognition and Synthesis #Topic Modeling #Natural Language Processing Techniques
47. ESPnet-SpeechLM: An Open Speech Language Model Toolkit
    2025/02/21 by Jinchuan Tian, Tian, Jinchuan, Jiatong Shi +29 · 8 citations
    Computer Science · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Natural Language Processing Techniques #Sound (cs.SD) #Speech and dialogue systems #electronic engineering #information engineering
48. Simulating Environments with Reasoning Models for Agent Training
    2025/11/03 by Yuetai Li, Huseyin A Inan, Li, Yuetai +15 · 7 citations
    Computer Science · #Multi-Agent Systems and Negotiation #Intelligent Tutoring Systems and Adaptive Learning #AI-based Problem Solving and Planning
49. Towards Making the Most of Context in Neural Machine Translation
    2020/02/19 by Zaixiang Zheng, Zheng, Zaixiang, Xiang Yue +7 · 2 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling #cs.CL
50. LLM-based Frameworks for Power Engineering from Routine to Novel Tasks
    2023/05/18 by Ran Li, Chuanqing Pu, Li, Ran +9 · 1 citation
    Computer Science · #Computational Physics and Python Applications #FOS: Computer and information sciences #FOS: Electrical engineering #Human-Computer Interaction (cs.HC) #Natural Language Processing Techniques #Software Engineering (cs.SE) #Systems and Control (eess.SY) #Topic Modeling #electronic engineering #information engineering
51. Efficient Informed Proposals for Discrete Distributions via Newton's Series Approximation
    2023/02/27 by Xiang Yue, Dongyao Zhu, Xiang, Yue +7 · 1 citation
    Computer Science · #Advanced Image and Video Retrieval Techniques #Bayesian Methods and Mixture Models #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Machine Learning (stat.ML)
52. Evaluating Vision-Language Models as Evaluators in Path Planning
    2024/11/27 by Mohamed Aghzal, Xiang Yue, Aghzal, Mohamed +5 · 2 citations
    Social Sciences · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Geographic Information Systems Studies #Religion and Sociopolitical Dynamics in Nigeria #Religious Tourism and Spaces
53. Underestimated Privacy Risks for Minority Populations in Large Language Model Unlearning
    2024/12/11 by Rongzhe Wei, Wei, Rongzhe, Mufei Li +19 · 1 voice · 2 citations
    Computer Science · #Privacy-Preserving Technologies in Data #cs.LG
54. VisCoder: Fine-Tuning LLMs for Executable Python Visualization Code Generation
    2025/06/04 by Yuansheng Ni, Ping Nie, Ni, Yuansheng +7 · 3 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computational Physics and Python Applications #Data Visualization and Analytics #FOS: Computer and information sciences #Software Engineering (cs.SE) #Software Engineering Research
55. On the limits and opportunities of AI reviewers: Reviewing the reviews of Nature-family papers with 45 expert scientists
    2026/05/20 by Seungone Kim, Dongkeun Yoon, Kiril Gashteovski +55 · 4 voices
    Computer Science · #cs.CL #cs.AI #cs.LG