Sainbayar Sukhbaatar
- Reasoning Beyond Words ? Exploring framework for hidden state reasoning
2024/12/09 by Shibo Hao, Sainbayar Sukhbaatar, Hao, Shibo +11 · 40 voices · 177 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling
- Self-Rewarding Language Models
2024/01/18 by Weizhe Yuan, Yuan, Weizhe, Richard Yuanzhe Pang +11 · 4 voices · 91 citations
#cs.CL #cs.AI
- Thinking LLMs: General Instruction Following with Thought Generation
2024/10/14 by Tianhao Wu, Wu, Tianhao, Janice Lan +9 · 9 voices · 9 citations
#cs.CL #cs.AI
- Iterative Reasoning Preference Optimization
2024/04/30 by Richard Yuanzhe Pang, Pang, Richard Yuanzhe, Weizhe Yuan +9 · 2 voices · 35 citations
#cs.CL #cs.AI
- Beyond A*: Better Planning with Transformers via Search Dynamics Bootstrapping
2024/02/21 by Lucas Lehnert, Sainbayar Sukhbaatar, Lehnert, Lucas +11 · 5 voices · 12 citations
Computer Science · #AI-based Problem Solving and Planning #Advanced Database Systems and Queries #Artificial Intelligence in Games #cs.AI
- Dualformer: Controllable Fast and Slow Thinking by Learning with Randomized Reasoning Traces
2024/10/13 by DiJia Su, D. Su, Sainbayar Sukhbaatar +8 · 3 voices · 13 citations
Computer Science · #Neural Networks and Applications #cs.AI #cs.LG #cs.LO
- System 2 Attention (is something you might need too)
2023/11/20 by Jason Weston, Weston, Jason, Sainbayar Sukhbaatar +1 · 5 voices · 9 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #cs.AI #cs.CL #cs.LG
- Multi-Token Attention
2025/04/01 by Olga Golovneva, Tianlu Wang, Golovneva, Olga +5 · 11 voices · 4 citations
#cs.CL
- Learning Multiagent Communication with Backpropagation
2016/05/25 by Sainbayar Sukhbaatar, Arthur Szlam, Sukhbaatar, Sainbayar +3 · 36 citations
Computer Science · #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural Networks and Applications #Reinforcement Learning in Robotics
- Learning to Reason and Memorize with Self-Notes
2023/05/01 by Jack Lanchantin, Shubham Toshniwal, Lanchantin, Jack +7 · 2 voices · 3 citations
Computer Science · #Advanced Text Analysis Techniques #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL #cs.LG
- Hash Layers For Large Sparse Models
2021/06/08 by Stephen Roller, Roller, Stephen, Sainbayar Sukhbaatar +5 · 1 voice · 21 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Multimodal Machine Learning Applications #Topic Modeling #cs.CL #cs.LG
- MazeBase: A Sandbox for Learning from Games
2015/11/23 by Sainbayar Sukhbaatar, Arthur Szlam, Sukhbaatar, Sainbayar +7 · 1 voice · 5 citations
Computer Science · Social Sciences · #Artificial Intelligence in Games #Digital Games and Media #Reinforcement Learning in Robotics #cs.AI #cs.LG #cs.NE
- Teaching Large Language Models to Reason with Reinforcement Learning
2024/03/07 by Alex Havrilla, Havrilla, Alex, Yuqing Du +15 · 26 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
- Meta-Rewarding Language Models: Self-Improving Alignment with LLM-as-a-Meta-Judge
2024/07/28 by Tianhao Wu, Wu, Tianhao, Weizhe Yuan +13 · 31 citations
Social Sciences · #Artificial Intelligence in Law
- Learning when to Communicate at Scale in Multiagent Cooperative and Competitive Tasks
2018/12/23 by Amanpreet Singh, Singh, Amanpreet, Tushar Jain +3 · 7 citations
Computer Science · #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #Artificial Intelligence in Games #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multiagent Systems (cs.MA) #Reinforcement Learning in Robotics
- SWEET-RL: Training Multi-Turn LLM Agents on Collaborative Reasoning Tasks
2025/03/19 by Yifei Zhou, Zhou, Yifei, Song Jiang +11 · 31 citations
Computer Science · Social Sciences · #Artificial Intelligence in Law #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multi-Agent Systems and Negotiation #Semantic Web and Ontologies
- Branch-Train-MiX: Mixing Expert LLMs into a Mixture-of-Experts LLM
2024/03/12 by Sainbayar Sukhbaatar, Olga Golovneva, Sukhbaatar, Sainbayar +19 · 11 citations
Computer Science · Biochemistry, Genetics and Molecular Biology · #Topic Modeling #Biomedical Text Mining and Ontologies #Natural Language Processing Techniques
- Simple Baseline for Visual Question Answering
2015/12/07 by Bolei Zhou, Yuandong Tian, Zhou, Bolei +7 · 12 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- Autodata: An agentic data scientist to create high quality synthetic data
2026/06/24 by Ilia Kulikov, Chenxi Whitehouse, Tianhao Wu +12 · 4 voices
#cs.AI #cs.CL #cs.LG
- Diverse Preference Optimization
2025/01/30 by Jack Lanchantin, Angelica Chen, Lanchantin, Jack +11 · 2 voices · 13 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #cs.CL
- Reverse Training to Nurse the Reversal Curse
2024/03/20 by Olga Golovneva, Golovneva, Olga, Zeyuan Allen-Zhu +5 · 7 citations
Psychology · #Aging and Gerontology Research #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- Self-Consistency Preference Optimization
2024/11/06 by Archiki Prasad, Weizhe Yuan, Prasad, Archiki +15 · 9 citations
Business, Management and Accounting · Computer Science · #Advanced Software Engineering Methodologies #Artificial Intelligence (cs.AI) #Collaboration in agile enterprises #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Service-Oriented Architecture and Web Services
- Self-Challenging Language Model Agents
2025/06/02 by Yifei Zhou, Sergey Levine, Zhou, Yifei +7 · 15 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- DIRECTOR: Generator-Classifiers For Supervised Language Modeling
2022/06/15 by Kushal Arora, Kurt Shuster, Arora, Kushal +5 · 3 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- Adaptive Decoding via Latent Preference Optimization
2024/11/14 by Shehzaad Dhuliawala, Dhuliawala, Shehzaad, Ilia Kulikov +12 · 3 voices · 2 citations
Computer Science · #Neural Networks and Applications #cs.CL
- Improving Open Language Models by Learning from Organic Interactions
2023/06/07 by Jing Xu, Xu, Jing, Da Young Ju +23 · 2 citations
Computer Science · #Advanced Malware Detection Techniques #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Hate Speech and Cyberbullying Detection #Software Engineering Research
- Step-KTO: Optimizing Mathematical Reasoning through Stepwise Binary Feedback
2025/01/18 by Yen-Ting Lin, Lin, Yen-Ting, Di Jin +24 · 4 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Intelligent Tutoring Systems and Adaptive Learning #Machine Learning (cs.LG) #Manufacturing Process and Optimization
- StepWiser: Stepwise Generative Judges for Wiser Reasoning
2025/08/26 by Wei Xiong, Wenting Zhao, Xiong, Wei +11 · 1 voice · 10 citations
#cs.AI #cs.CL
- Not All Memories are Created Equal: Learning to Forget by Expiring
2021/05/13 by Sainbayar Sukhbaatar, Sukhbaatar, Sainbayar, Da Young Ju +11 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Addressing Some Limitations of Transformers with Feedback Memory
2020/02/21 by Angela Fan, Thibaut Lavril, Fan, Angela +7 · 3 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- Some things are more CRINGE than others: Iterative Preference Optimization with the Pairwise Cringe Loss
2023/12/27 by Jing Xu, Andrew Lee, Xu, Jing +5 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
- Bridging Offline and Online Reinforcement Learning for LLMs
2025/06/26 by Jack Lanchantin, Lanchantin, Jack, Angelica Chen +21 · 7 citations
Business, Management and Accounting · Engineering · #Collaboration in agile enterprises #Computation and Language (cs.CL) #FOS: Computer and information sciences #Scheduling and Optimization Algorithms