Sun, Huan
- Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization
2024/05/23 by Boshi Wang, Wang, Boshi, Xiang Yue +5 · 3 voices · 21 citations
Computer Science · #Evolutionary Algorithms and Applications #Neural Networks and Applications #Semantic Web and Ontologies
- MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI
2023/11/27 by Xiang Yue, Yuansheng Ni, Yue, Xiang +41 · 457 citations
Computer Science · #Topic Modeling #Multimodal Machine Learning Applications #Natural Language Processing Techniques
- Mind2Web: Towards a Generalist Agent for the Web
2023/06/09 by Xiang Deng, Deng, Xiang, 裕二 池谷 +13 · 215 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #AI in Service Interactions
- Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systems
2025/03/31 by Bang Liu, Liu, Bang, Xinfeng Li +95 · 13 voices · 36 citations
Computer Science · #Reinforcement Learning in Robotics
- AgentBench: Evaluating LLMs as Agents
2023/08/07 by Xiao Liu, Liu, Xiao, Hao Yu +41 · 145 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques
- MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editing
2023/06/16 by Kai Zhang, Lingbo Mo, Zhang, Kai +7 · 129 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Multimodal Machine Learning Applications
- GPT-4V(ision) is a Generalist Web Agent, if Grounded
2024/01/03 by Boyuan Zheng, Zheng, Boyuan, Boyu Gou +7 · 1 voice · 89 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Multi-Agent Systems and Negotiation #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL #cs.CV #cs.IR
- MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmark
2024/09/04 by Yue, Xiang, Zheng, Tianyu, Ni, Yuansheng +10 · 123 citations
#Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Is Your LLM Secretly a World Model of the Internet? Model-Based Planning for Web Agents
2024/11/10 by Yu Gu, 裕二 池谷, Kai Zhang +23 · 3 voices · 30 citations
Computer Science · #Multi-Agent Systems and Negotiation #Digital Rights Management and Security #Mobile Agent-Based Network Management
- MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuning
2023/09/11 by Yue, Xiang, Qu, Xingwei, Zhang, Ge +5 · 63 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agents
2024/10/07 by Boyu Gou, Ruohan Wang, Gou, Boyu +13 · 102 citations
Computer Science · Psychology · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Social Robot Interaction and HRI #Speech and dialogue systems
- Evaluating Large Language Models in Scientific Discovery
2025/12/17 by Zhangde Song, Song, Zhangde, Jieyu Lu +109 · 18 voices · 2 citations
Materials Science · Medicine · Social Sciences · #Machine Learning in Materials Science #Artificial Intelligence in Healthcare and Education #Computational and Text Analysis Methods
- Holistic Agent Leaderboard: The Missing Infrastructure for AI Agent Evaluation
2025/10/13 by Sayash Kapoor, Kapoor, Sayash, Benedikt Stroebl +63 · 3 voices · 10 citations
Computer Science · #Multi-Agent Systems and Negotiation
- AutoDAN-Turbo: A Lifelong Agent for Strategy Self-Exploration to Jailbreak LLMs
2024/10/03 by Xiaogeng Liu, Peiran Li, Liu, Xiaogeng +17 · 44 citations
Computer Science · #Digital and Cyber Forensics #Cybercrime and Law Enforcement Studies #Advanced Malware Detection Techniques
- Towards Understanding Chain-of-Thought Prompting: An Empirical Study of What Matters
2022/12/20 by Wang, Boshi, Min, Sewon, Deng, Xiang +4 · 23 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- TableLlama: Towards Open Large Generalist Models for Tables
2023/11/15 by Tianshu Zhang, Zhang, Tianshu, Xiang Yue +5 · 28 citations
Computer Science · Decision Sciences · #Advanced Text Analysis Techniques #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Data Quality and Management #Databases (cs.DB) #FOS: Computer and information sciences #Topic Modeling
- Can ChatGPT Defend its Belief in Truth? Evaluating LLM Reasoning via Debate
2023/05/22 by Boshi Wang, Xiang Yue, Wang, Boshi +3 · 24 citations
Computer Science · Engineering · #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Topic Modeling
- AmpleGCG: Learning a Universal and Transferable Generative Model of Adversarial Suffixes for Jailbreaking Both Open and Closed LLMs
2024/04/11 by Zeyi Liao, Liao, Zeyi, Huan Sun +1 · 28 citations
Computer Science · #Adversarial Robustness in Machine Learning
- EIA: Environmental Injection Attack on Generalist Web Agents for Privacy Leakage
2024/09/17 by Zeyi Liao, Liao, Zeyi, Lingbo Mo +15 · 34 citations
Computer Science · Social Sciences · #Network Security and Intrusion Detection #Access Control and Trust #Spam and Phishing Detection
- ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery
2024/10/07 by Ziru Chen, Chen, Ziru, Shijie Chen +35 · 26 citations
Computer Science · Biochemistry, Genetics and Molecular Biology · #Topic Modeling #Natural Language Processing Techniques #Biomedical Text Mining and Ontologies
- Synthetic Text Generation with Differential Privacy: A Simple and Practical Recipe
2022/10/25 by Xiang Yue, Huseyin A. Inan, Yue, Xiang +14 · 14 citations
Computer Science · #Privacy-Preserving Technologies in Data #Digital and Cyber Forensics
- LlaSMol: Advancing Large Language Models for Chemistry with a Large-Scale, Comprehensive, High-Quality Instruction Tuning Dataset
2024/02/14 by YU Bo-tao, Frazier N. Baker, Yu, Botao +7 · 19 citations
Computer Science · #Topic Modeling
- Exploring Chain-of-Thought Style Prompting for Text-to-SQL
2023/05/23 by Tai, Chang-You, Chen, Ziru, Zhang, Tianshu +2 · 14 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Multitask Prompt Tuning Enables Parameter-Efficient Transfer Learning
2023/03/06 by Zhen Wang, Rameswar Panda, Wang, Zhen +9 · 13 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
- Differential Privacy for Text Analytics via Natural Text Sanitization
2021/06/02 by Yue, Xiang, Du, Minxin, Wang, Tianhao +3 · 10 citations
#Computation and Language (cs.CL) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences
- AdvAgent: Controllable Blackbox Red-teaming on Web Agents
2024/10/22 by Xu, Chejian, Kang, Mintong, Zhang, Jiawei +5 · 22 citations
#Computation and Language (cs.CL) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences
- eCeLLM: Generalizing Large Language Models for E-commerce from Large-scale, High-quality Instruction Data
2024/02/13 by Bo Peng, Peng, Bo, Xinyi Ling +6 · 15 citations
Computer Science · #Recommender Systems and Techniques #Mathematics, Computing, and Information Processing #Semantic Web and Ontologies
- An Illusion of Progress? Assessing the Current State of Web Agents
2025/04/02 by Xue, Tianci, Weijian Qi, Tingyan Shi +11 · 31 citations
Computer Science · #AI in Service Interactions #Web Data Mining and Analysis #Recommender Systems and Techniques
- Automatic Evaluation of Attribution by Large Language Models
2023/05/10 by Yue, Xiang, Wang, Boshi, Chen, Ziru +3 · 8 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Text-to-SQL Error Correction with Language Models of Code
2023/05/22 by Ziru Chen, Chen, Ziru, Shijie Chen +13 · 6 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Databases (cs.DB) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling #Web Data Mining and Analysis
- Mind2Web 2: Evaluating Agentic Search with Agent-as-a-Judge
2025/06/26 by Gou, Boyu, Huang, Zanming, Ning, Yuting +23 · 20 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- RedTeamCUA: Realistic Adversarial Testing of Computer-Use Agents in Hybrid Web-OS Environments
2025/05/28 by Zeyi Liao, Liao, Zeyi, Jaylen Jones +14 · 1 voice · 6 citations
Computer Science · #Advanced Malware Detection Techniques #Adversarial Robustness in Machine Learning #Software Testing and Debugging Techniques #cs.CL
- AGrail: A Lifelong Agent Guardrail with Effective and Adaptive Safety Detection
2025/02/17 by Shenghong Dai, Luo, Weidi, Xiaogeng Liu +9 · 12 citations
Engineering · #Advanced Measurement and Detection Methods #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Transportation Safety and Impact Analysis #Vehicular Ad Hoc Networks (VANETs)
- Iteratively Prompt Pre-trained Language Models for Chain of Thought
2022/03/16 by Boshi Wang, Wang, Boshi, Xiang Deng +3 · 4 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- CliniQG4QA: Generating Diverse Questions for Domain Adaptation of Clinical Question Answering
2020/10/30 by Yue, Xiang, Zhang, Xinliang Frederick, Yao, Ziyu +2 · 3 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- When is Tree Search Useful for LLM Planning? It Depends on the Discriminator
2024/02/16 by Ziru Chen, Chen, Ziru, Michael White +9 · 5 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Data Mining Algorithms and Applications #Digital Rights Management and Security #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques
- DOM-LM: Learning Generalizable Representations for HTML Documents
2022/01/25 by Deng, Xiang, Shiralkar, Prashant, Lockard, Colin +2 · 3 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Thinking about GPT-3 In-Context Learning for Biomedical IE? Think Again
2022/03/16 by Gutiérrez, Bernal Jiménez, McNeal, Nikolas, Washington, Clay +4 · 3 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR)
- How Trustworthy are Open-Source LLMs? An Assessment under Malicious Demonstrations Shows their Vulnerabilities
2023/11/15 by Lingbo Mo, Mo, Lingbo, Boshi Wang +5 · 4 citations
Computer Science · Social Sciences · #Access Control and Trust #Artificial Intelligence (cs.AI) #Cloud Data Security Solutions #Computation and Language (cs.CL) #FOS: Computer and information sciences
- Error Detection for Text-to-SQL Semantic Parsing
2023/05/23 by Chen, Shijie, Chen, Ziru, Sun, Huan +1 · 3 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- On the Trustworthiness of Generative Foundation Models: Guideline, Assessment, and Perspective
2025/02/20 by Huang, Yue, Gao, Chujie, Wu, Siyuan +63 · 8 citations
#Computers and Society (cs.CY) #FOS: Computer and information sciences
- Agent Learning via Early Experience
2025/10/09 by Kai Zhang, Zhang, Kai, Chen, Xiangchao +49 · 11 citations
Computer Science · Social Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Language and cultural evolution #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- AttributionBench: How Hard is Automatic Attribution Evaluation?
2024/02/23 by Li, Yifei, Yue, Xiang, Liao, Zeyi +1 · 3 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- WebGuard: Building a Generalizable Guardrail for Web Agents
2025/07/18 by Zheng, Boyuan, Liao, Zeyi, Salisbury, Scott +8 · 6 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- AmpleGCG-Plus: A Strong Generative Model of Adversarial Suffixes to Jailbreak LLMs with Higher Success Rates in Fewer Attempts
2024/10/29 by Kumar, Vishal, Liao, Zeyi, Jones, Jaylen +1 · 3 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Model-based Interactive Semantic Parsing: A Unified Framework and A Text-to-SQL Case Study
2019/10/11 by Ziyu Yao, Yao, Ziyu, Yu Su +5 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Large Language Models Achieve Gold Medal Performance at the International Olympiad on Astronomy & Astrophysics (IOAA)
2025/10/06 by Lucas Carrit Delgado Pinheiro, Pinheiro, Lucas Carrit Delgado, Ziru Chen +11 · 3 voices · 1 citation
Computer Science · Physics and Astronomy · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Physical sciences #Instrumentation and Methods for Astrophysics (astro-ph.IM) #astro-ph.IM #cs.AI #cs.CL
- ChemToolAgent: The Impact of Tools on Language Agents for Chemistry Problem Solving
2024/11/11 by Yu, Botao, Baker, Frazier N., Chen, Ziru +5 · 4 citations
#Artificial Intelligence (cs.AI) #Computational Engineering #FOS: Computer and information sciences #Finance #and Science (cs.CE)
- Learning Structural Edits via Incremental Tree Transformations
2021/01/28 by Yao, Ziyu, Xu, Frank F., Yin, Pengcheng +2 · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Software Engineering (cs.SE)
- ReasonBERT: Pre-trained to Reason with Distant Supervision
2021/09/10 by Deng, Xiang, Su, Yu, Lees, Alyssa +3 · 1 citation
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Federated Learning for Semantic Parsing: Task Formulation, Evaluation Setup, New Algorithms
2023/05/26 by Tianshu Zhang, Changchang Liu, Zhang, Tianshu +7 · 1 citation
Computer Science · #Topic Modeling #Domain Adaptation and Few-Shot Learning #Machine Learning in Healthcare
- Is the Reversal Curse a Binding Problem? Uncovering Limitations of Transformers from a Basic Generalization Failure
2025/04/02 by Wang, Boshi, Sun, Huan · 3 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- A Multi-Aspect Framework for Counter Narrative Evaluation using Large Language Models
2024/02/18 by Jones, Jaylen, Mo, Lingbo, Fosler-Lussier, Eric +1 · 1 citation
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- Agent Data Protocol: Unifying Datasets for Diverse, Effective Fine-tuning of LLM Agents
2025/10/28 by Song, Yueqi, Ramaneti, Ketan, Sheikh, Zaid +18 · 3 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- A Trembling House of Cards? Mapping Adversarial Attacks against Language Agents
2024/02/15 by Lingbo Mo, Mo, Lingbo, Zeyi Liao +9 · 1 citation
Arts and Humanities · Computer Science · Health Professions · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Interpreting and Communication in Healthcare #Natural Language Processing Techniques #Translation Studies and Practices
- GroundCocoa: A Benchmark for Evaluating Compositional & Conditional Reasoning in Language Models
2024/04/05 by Kohli, Harsh, Kumar, Sachin, Sun, Huan · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- AutoSDT: Scaling Data-Driven Discovery Tasks Toward Open Co-Scientists
2025/06/09 by Yifei Li, Hanane Nour Moussa, Li, Yifei +33 · 2 citations
Computer Science · Decision Sciences · Materials Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Machine Learning in Materials Science #Scientific Computing and Data Management
- GeoAnalystBench: A GeoAI benchmark for assessing large language models for spatial analysis workflow and code generation
2025/09/07 by Zhang, Qianheng, Gao, Song, Wei, Chen +6 · 1 citation
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #I.2 #Software Engineering (cs.SE)
- AI Safety vs. AI Security: Demystifying the Distinction and Boundaries
2025/06/21 by Zhiqiang Lin, Lin, Zhiqiang, Huan Sun +3 · 2 citations
Social Sciences · #Artificial Intelligence (cs.AI) #Computers and Society (cs.CY) #Cryptography and Security (cs.CR) #Ethics and Social Impacts of AI #FOS: Computer and information sciences
- ScholarEval: Research Idea Evaluation Grounded in Literature
2025/10/17 by Hanane Nour Moussa, Moussa, Hanane Nour, Paolo Silva +17 · 1 citation
Biochemistry, Genetics and Molecular Biology · Computer Science · Decision Sciences · #Advanced Graph Neural Networks #Artificial Intelligence (cs.AI) #Biomedical Text Mining and Ontologies #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Scientific Computing and Data Management