Lin, Bill Yuchen
- Faith and Fate: Limits of Transformers on Compositionality
2023/05/29 by Nouha Dziri, Ximing Lu, Dziri, Nouha +29 · 13 voices · 71 citations
Computer Science · Materials Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Materials Science #Natural Language Processing Techniques #Topic Modeling
- LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative Fusion
2023/06/05 by Dongfu Jiang, Jiang, Dongfu, Xiang Ren +3 · 94 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Text Readability and Simplification
- WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMs
2024/06/26 by Han, Seungju, Rao, Kavel, Ettinger, Allyson +5 · 88 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- RewardBench: Evaluating Reward Models for Language Modeling
2024/03/20 by Nathan Lambert, Valentina Pyatkin, Lambert, Nathan +21 · 65 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques
- LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition
2023/07/25 by Chengsong Huang, Qian Liu, Huang, Chengsong +9 · 51 citations
Computer Science · Engineering · #Context-Aware Activity Recognition Systems #Robotics and Automated Systems #Human Pose and Action Recognition
- Latent Action Pretraining from Videos
2024/10/15 by Seonghyeon Ye, Ye, Seonghyeon, Joel Jang +28 · 77 citations
Computer Science · Engineering · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Motion and Animation #Human Pose and Action Recognition #Machine Learning (cs.LG) #Robotics (cs.RO) #Video Analysis and Summarization
- Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Models
2024/05/02 by Kim, Seungone, Suk, Juyoung, Longpre, Shayne +7 · 60 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decoding
2024/02/14 by Zhangchen Xu, Xu, Zhangchen, Fengqing Jiang +9 · 53 citations
Computer Science · #Adversarial Robustness in Machine Learning #Digital and Cyber Forensics #Advanced Malware Detection Techniques
- OpenCodeInterpreter: Integrating Code Generation with Execution and Refinement
2024/02/22 by Tianyu Zheng, Zheng, Tianyu, Ge Zhang +14 · 2 voices · 38 citations
Computer Science · #Logic, programming, and type systems #Model-Driven Software Engineering Techniques #Software Testing and Debugging Techniques #cs.AI #cs.CL #cs.SE
- Magpie: Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing
2024/06/12 by Xu, Zhangchen, Jiang, Fengqing, Niu, Luyao +4 · 50 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter Merging
2023/10/17 by Jang, Joel, Kim, Seungone, Lin, Bill Yuchen +6 · 39 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- The Unlocking Spell on Base LLMs: Rethinking Alignment via In-Context Learning
2023/12/04 by Bill Yuchen Lin, Abhilasha Ravichander, Lin, Bill Yuchen +13 · 33 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Text Readability and Simplification
- ZebraLogic: On the Scaling Limits of LLMs for Logical Reasoning
2025/02/03 by Lin, Bill Yuchen, Bras, Ronan Le, Richardson, Kyle +4 · 57 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- WildBench: Benchmarking LLMs with Challenging Tasks from Real Users in the Wild
2024/06/07 by Lin, Bill Yuchen, Deng, Yuntian, Chandu, Khyathi +6 · 35 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism
2024/07/15 by Yifan Song, Song, Yifan, Guoyin Wang +5 · 31 citations
Business, Management and Accounting · Computer Science · Social Sciences · #Artificial Intelligence (cs.AI) #Business Law and Ethics #Computation and Language (cs.CL) #FOS: Computer and information sciences #Law, AI, and Intellectual Property #Legal Education and Practice Innovations
- Trial and Error: Exploration-Based Trajectory Optimization for LLM Agents
2024/03/04 by Song, Yifan, Yin, Da, Yue, Xiang +3 · 26 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?
2024/04/09 by Liu, Junpeng, Song, Yifan, Lin, Bill Yuchen +4 · 25 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- SwiftSage: A Generative Agent with Fast and Slow Thinking for Complex Interactive Tasks
2023/05/27 by Bill Yuchen Lin, Lin, Bill Yuchen, Yicheng Fu +15 · 18 citations
Computer Science · #Topic Modeling #AI-based Problem Solving and Planning #Natural Language Processing Techniques
- Common Sense Beyond English: Evaluating and Improving Multilingual Language Models for Commonsense Reasoning
2021/06/13 by Bill Yuchen Lin, Lin, Bill Yuchen, Seyeon Lee +5 · 12 citations
Computer Science · Biochemistry, Genetics and Molecular Biology · #Topic Modeling #Natural Language Processing Techniques #Biomedical Text Mining and Ontologies
- On Memorization of Large Language Models in Logical Reasoning
2024/10/30 by Chulin Xie, Yangsibo Huang, Xie, Chulin +15 · 27 citations
Computer Science · #Natural Language Processing Techniques #Semantic Web and Ontologies #Topic Modeling
- The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language Models
2024/06/09 by Seungone Kim, Juyoung Suk, Kim, Seungone +61 · 20 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- RiddleSense: Reasoning about Riddle Questions Featuring Linguistic Creativity and Commonsense Knowledge
2021/01/02 by Bill Yuchen Lin, Lin, Bill Yuchen, Ziyi Wu +7 · 9 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- VL-RewardBench: A Challenging Benchmark for Vision-Language Generative Reward Models
2024/11/26 by Li, Lei, Wei, Yuancheng, Xie, Zhihui +9 · 23 citations
#Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- WildVision: Evaluating Vision-Language Models in the Wild with Human Preferences
2024/06/16 by Yujie Lu, Dongfu Jiang, Lu, Yujie +9 · 18 citations
Computer Science · Social Sciences · #Multimodal Machine Learning Applications #Advanced Image and Video Retrieval Techniques #Geographic Information Systems Studies
- KagNet: Knowledge-Aware Graph Networks for Commonsense Reasoning
2019/09/04 by Lin, Bill Yuchen, Chen, Xinyue, Chen, Jamin +1 · 7 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- SafeChain: Safety of Language Models with Long Chain-of-Thought Reasoning Capabilities
2025/02/17 by Fengqing Jiang, Zhangchen Xu, Jiang, Fengqing +13 · 28 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- Agent Lumos: Unified and Modular Training for Open-Source Language Agents
2023/11/09 by Yin, Da, Brahman, Faeze, Ravichander, Abhilasha +4 · 12 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- CulturalBench: A Robust, Diverse, and Challenging Cultural Benchmark by Human-AI CulturalTeaming
2024/10/03 by Chiu, Yu Ying, Jiang, Liwei, Lin, Bill Yuchen +8 · 15 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- FedNLP: Benchmarking Federated Learning Methods for Natural Language Processing Tasks
2021/04/18 by Bill Lin, Chaoyang He, Lin, Bill Yuchen +17 · 6 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Privacy-Preserving Technologies in Data
- OfficeBench: Benchmarking Language Agents across Multiple Applications for Office Automation
2024/07/26 by Zilong Wang, Yuedong Cui, Wang, Zilong +11 · 12 citations
Computer Science · Engineering · #Multi-Agent Systems and Negotiation #Scheduling and Optimization Algorithms #Advanced Manufacturing and Logistics Optimization
- Small Models Struggle to Learn from Strong Reasoners
2025/02/17 by Yuetai Li, Li, Yuetai, Yue Xiang +13 · 19 citations
Decision Sciences · Mathematics · Engineering · #Complex Systems and Decision Making #Statistics Education and Methodologies #Reservoir Engineering and Simulation Methods
- CULTURE-GEN: Revealing Global Cultural Perception in Language Models through Natural Language Prompting
2024/04/16 by Li, Huihan, Jiang, Liwei, Hwang, Jena D. +7 · 10 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question Answering
2020/05/01 by Yanlin Feng, Xinyue Chen, Feng, Yanlin +9 · 4 citations
Computer Science · #Advanced Graph Neural Networks #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Topic Modeling
- HAICOSYSTEM: An Ecosystem for Sandboxing Safety Risks in Human-AI Interactions
2024/09/24 by Zhou, Xuhui, Kim, Hyunwoo, Brahman, Faeze +9 · 9 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences
- Inference-Time Policy Adapters (IPA): Tailoring Extreme-Scale LMs without Fine-tuning
2023/05/24 by Lu, Ximing, Brahman, Faeze, West, Peter +14 · 5 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- ChatBug: A Common Vulnerability of Aligned LLMs Induced by Chat Templates
2024/06/17 by Fengqing Jiang, Jiang, Fengqing, Zhangchen Xu +7 · 7 citations
Computer Science · #Advanced Malware Detection Techniques #Artificial Intelligence (cs.AI) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Spam and Phishing Detection #Web Application Security Vulnerabilities
- Birds have four legs?! NumerSense: Probing Numerical Commonsense Knowledge of Pre-trained Language Models
2020/05/02 by Lin, Bill Yuchen, Lee, Seyeon, Khanna, Rahul +1 · 3 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- Selective "Selective Prediction": Reducing Unnecessary Abstention in Vision-Language Reasoning
2024/02/23 by Tejas Srinivasan, Srinivasan, Tejas, Jack Hessel +11 · 5 citations
Computer Science · Decision Sciences · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multi-Criteria Decision Making #Semantic Web and Ontologies
- Suspicion-Agent: Playing Imperfect Information Games with Theory of Mind Aware GPT-4
2023/09/29 by Guo, Jiaxian, Yang, Bo, Yoo, Paul +3 · 4 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences
- TIGERScore: Towards Building Explainable Metric for All Text Generation Tasks
2023/10/01 by Jiang, Dongfu, Li, Yishan, Zhang, Ge +3 · 4 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- CrossFit: A Few-shot Learning Challenge for Cross-task Generalization in NLP
2021/04/18 by Qinyuan Ye, Ye, Qinyuan, Bill Yuchen Lin +3 · 2 citations
Computer Science · #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Topic Modeling
- TinyV: Reducing False Negatives in Verification Improves RL for LLM Reasoning
2025/05/20 by Xu, Zhangchen, Li, Yuetai, Jiang, Fengqing +4 · 6 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Pre-training Text-to-Text Transformers for Concept-centric Common Sense
2020/10/24 by Wangchunshu Zhou, Dong‐Ho Lee, Zhou, Wangchunshu +9 · 2 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- RICA: Evaluating Robust Inference Capabilities Based on Commonsense Axioms
2020/05/02 by Pei Zhou, Zhou, Pei, Rahul Khanna +11 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Logic in Computer Science (cs.LO) #Natural Language Processing Techniques #Topic Modeling
- Temporal Sampling for Forgotten Reasoning in LLMs
2025/05/26 by Li, Yuetai, Xu, Zhangchen, Jiang, Fengqing +5 · 5 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- VisualSphinx: Large-Scale Synthetic Vision Logic Puzzles for RL
2025/05/29 by Feng, Yichen, Xu, Zhangchen, Jiang, Fengqing +5 · 4 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Reflect, Not Reflex: Inference-Based Common Ground Improves Dialogue Response Quality
2022/11/16 by Pei Zhou, Hyundong Cho, Zhou, Pei +11 · 1 citation
Computer Science · #Topic Modeling #Speech and dialogue systems #AI in Service Interactions
- CrossWordBench: Evaluating the Reasoning Capabilities of LLMs and LVLMs with Controllable Puzzle Generation
2025/03/30 by Leng, Jixuan, Chengsong Huang, Langlin Huang +10 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Stronger Models are NOT Stronger Teachers for Instruction Tuning
2024/11/11 by Zhangchen Xu, Xu, Zhangchen, Fengqing Jiang +7 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Educational Methods and Technology #FOS: Computer and information sciences #Intelligent Tutoring Systems and Adaptive Learning
- NovaCOMET: Open Commonsense Foundation Models with Symbolic Knowledge Distillation
2023/12/10 by Peter West, West, Peter, Ronan Le Bras +19 · 1 citation
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- SimulBench: Evaluating Language Models with Creative Simulation Tasks
2024/09/11 by Qi Jia, Yue Xiang, Jia, Qi +7 · 1 citation
Computer Science · Engineering · Psychology · #Computation and Language (cs.CL) #Educational Games and Gamification #FOS: Computer and information sciences #Human Motion and Animation #Topic Modeling