Sukhbaatar, Sainbayar
- Reasoning Beyond Words ? Exploring framework for hidden state reasoning
2024/12/09 by Shibo Hao, Sainbayar Sukhbaatar, Hao, Shibo +11 · 40 voices · 266 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling
- Self-Rewarding Language Models
2024/01/18 by Weizhe Yuan, Yuan, Weizhe, Richard Yuanzhe Pang +11 · 4 voices · 132 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL
- Thinking LLMs: General Instruction Following with Thought Generation
2024/10/14 by Tianhao Wu, Janice Lan, Wu, Tianhao +9 · 9 voices · 18 citations
Social Sciences · #Artificial Intelligence in Law #Legal Education and Practice Innovations #cs.AI #cs.CL
- Iterative Reasoning Preference Optimization
2024/04/30 by Richard Yuanzhe Pang, Pang, Richard Yuanzhe, Weizhe Yuan +9 · 2 voices · 75 citations
#cs.CL #cs.AI
- Beyond A*: Better Planning with Transformers via Search Dynamics Bootstrapping
2024/02/21 by Lucas Lehnert, Lehnert, Lucas, Sainbayar Sukhbaatar +11 · 5 voices · 23 citations
Computer Science · #AI-based Problem Solving and Planning #Advanced Database Systems and Queries #Artificial Intelligence in Games #cs.AI
- Dualformer: Controllable Fast and Slow Thinking by Learning with Randomized Reasoning Traces
2024/10/13 by DiJia Su, D. Su, Sainbayar Sukhbaatar +8 · 3 voices · 29 citations
Computer Science · #Neural Networks and Applications #cs.AI #cs.LG #cs.LO
- System 2 Attention (is something you might need too)
2023/11/20 by Jason Weston, Sainbayar Sukhbaatar, Weston, Jason +1 · 5 voices · 17 citations
Computer Science · #Advanced Text Analysis Techniques #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL #cs.LG
- Multi-Token Attention
2025/04/01 by Olga Golovneva, Golovneva, Olga, Tianlu Wang +5 · 11 voices · 5 citations
#cs.CL
- Learning Multiagent Communication with Backpropagation
2016/05/25 by Sainbayar Sukhbaatar, Sukhbaatar, Sainbayar, Arthur Szlam +3 · 61 citations
Computer Science · #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural Networks and Applications #Reinforcement Learning in Robotics
- Meta-Rewarding Language Models: Self-Improving Alignment with LLM-as-a-Meta-Judge
2024/07/28 by Tianhao Wu, Wu, Tianhao, Weizhe Yuan +13 · 1 voice · 60 citations
Computer Science · Social Sciences · #Artificial Intelligence in Law #cs.AI #cs.CL
- Learning to Reason and Memorize with Self-Notes
2023/05/01 by Jack Lanchantin, Lanchantin, Jack, Shubham Toshniwal +7 · 2 voices · 5 citations
Computer Science · #Advanced Text Analysis Techniques #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL #cs.LG
- Contextual Position Encoding: Learning to Count What's Important
2024/05/29 by Olga Golovneva, Tianlu Wang, Golovneva, Olga +5 · 3 voices · 13 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Speech and dialogue systems #cs.AI #cs.CL
- Hash Layers For Large Sparse Models
2021/06/08 by Stephen Roller, Sainbayar Sukhbaatar, Roller, Stephen +5 · 1 voice · 33 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Multimodal Machine Learning Applications #Topic Modeling #cs.CL #cs.LG
- MazeBase: A Sandbox for Learning from Games
2015/11/23 by Sainbayar Sukhbaatar, Arthur Szlam, Sukhbaatar, Sainbayar +7 · 1 voice · 12 citations
Computer Science · Social Sciences · #Artificial Intelligence in Games #Digital Games and Media #Reinforcement Learning in Robotics #cs.AI #cs.LG #cs.NE
- Teaching Large Language Models to Reason with Reinforcement Learning
2024/03/07 by Alex Havrilla, Havrilla, Alex, Yuqing Du +15 · 60 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
- Intrinsic Motivation and Automatic Curricula via Asymmetric Self-Play
2017/03/15 by Sukhbaatar, Sainbayar, Lin, Zeming, Kostrikov, Ilya +3 · 22 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- Simple Baseline for Visual Question Answering
2015/12/07 by Bolei Zhou, Yuandong Tian, Zhou, Bolei +7 · 35 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- Training Convolutional Networks with Noisy Labels
2014/06/09 by Sainbayar Sukhbaatar, Joan Bruna, Sukhbaatar, Sainbayar +7 · 15 citations
Computer Science · #Advanced Neural Network Applications #Anomaly Detection Techniques and Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Neural and Evolutionary Computing (cs.NE)
- Adaptive Attention Span in Transformers
2019/05/19 by Sainbayar Sukhbaatar, Édouard Grave, Sukhbaatar, Sainbayar +5 · 13 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Learning when to Communicate at Scale in Multiagent Cooperative and Competitive Tasks
2018/12/23 by Amanpreet Singh, Tushar Jain, Singh, Amanpreet +3 · 12 citations
Computer Science · #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #Artificial Intelligence in Games #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multiagent Systems (cs.MA) #Reinforcement Learning in Robotics
- SWEET-RL: Training Multi-Turn LLM Agents on Collaborative Reasoning Tasks
2025/03/19 by Yifei Zhou, Song Jiang, Zhou, Yifei +11 · 49 citations
Computer Science · Social Sciences · #Artificial Intelligence in Law #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multi-Agent Systems and Negotiation #Semantic Web and Ontologies
- Branch-Train-MiX: Mixing Expert LLMs into a Mixture-of-Experts LLM
2024/03/12 by Sainbayar Sukhbaatar, Olga Golovneva, Sukhbaatar, Sainbayar +19 · 20 citations
Computer Science · Biochemistry, Genetics and Molecular Biology · #Topic Modeling #Biomedical Text Mining and Ontologies #Natural Language Processing Techniques
- Augmenting Self-attention with Persistent Memory
2019/07/02 by Sainbayar Sukhbaatar, Édouard Grave, Sukhbaatar, Sainbayar +7 · 9 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Diverse Preference Optimization
2025/01/30 by Jack Lanchantin, Angelica Chen, Lanchantin, Jack +11 · 2 voices · 18 citations
Computer Science · Decision Sciences · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multi-Criteria Decision Making #cs.CL
- Some things are more CRINGE than others: Iterative Preference Optimization with the Pairwise Cringe Loss
2023/12/27 by Jing Xu, Xu, Jing, Andrew Lee +5 · 13 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
- Reverse Training to Nurse the Reversal Curse
2024/03/20 by Olga Golovneva, Zeyuan Allen-Zhu, Golovneva, Olga +5 · 12 citations
Psychology · #Aging and Gerontology Research #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- Following Length Constraints in Instructions
2024/06/25 by Yuan, Weizhe, Kulikov, Ilia, Yu, Ping +4 · 11 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Self-Consistency Preference Optimization
2024/11/06 by Archiki Prasad, Prasad, Archiki, Weizhe Yuan +15 · 14 citations
Business, Management and Accounting · Computer Science · #Advanced Software Engineering Methodologies #Artificial Intelligence (cs.AI) #Collaboration in agile enterprises #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Service-Oriented Architecture and Web Services
- Self-Challenging Language Model Agents
2025/06/02 by Yifei Zhou, Zhou, Yifei, Sergey Levine +7 · 18 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- DIRECTOR: Generator-Classifiers For Supervised Language Modeling
2022/06/15 by Kushal Arora, Kurt Shuster, Arora, Kushal +5 · 3 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- Adaptive Decoding via Latent Preference Optimization
2024/11/14 by Shehzaad Dhuliawala, Dhuliawala, Shehzaad, Ilia Kulikov +12 · 3 voices · 3 citations
Computer Science · #Neural Networks and Applications #cs.CL
- The CRINGE Loss: Learning what language not to model
2022/11/10 by Adolphs, Leonard, Gao, Tianyu, Xu, Jing +3 · 3 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- Addressing Some Limitations of Transformers with Feedback Memory
2020/02/21 by Angela Fan, Fan, Angela, Thibaut Lavril +7 · 6 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- Not All Memories are Created Equal: Learning to Forget by Expiring
2021/05/13 by Sainbayar Sukhbaatar, Da Young Ju, Sukhbaatar, Sainbayar +11 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Improving Open Language Models by Learning from Organic Interactions
2023/06/07 by Jing Xu, Xu, Jing, Da Young Ju +23 · 3 citations
Computer Science · #Advanced Malware Detection Techniques #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Hate Speech and Cyberbullying Detection #Software Engineering Research
- Step-KTO: Optimizing Mathematical Reasoning through Stepwise Binary Feedback
2025/01/18 by Yen-Ting Lin, Lin, Yen-Ting, Di Jin +24 · 6 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Intelligent Tutoring Systems and Adaptive Learning #Machine Learning (cs.LG) #Manufacturing Process and Optimization
- CoT-Self-Instruct: Building high-quality synthetic prompts for reasoning and non-reasoning tasks
2025/07/31 by Ping Yu, Jack Lanchantin, Yu, Ping +15 · 12 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Intelligent Tutoring Systems and Adaptive Learning #Online Learning and Analytics
- R.I.P.: Better Models by Survival of the Fittest Prompts
2025/01/30 by Yu, Ping, Yuan, Weizhe, Golovneva, Olga +4 · 6 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Learning Goal Embeddings via Self-Play for Hierarchical Reinforcement\n Learning
2018/11/22 by Sainbayar Sukhbaatar, Sukhbaatar, Sainbayar, Emily Denton +5 · 1 citation
Computer Science · #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Mobile Crowdsensing and Crowdsourcing #Reinforcement Learning in Robotics
- SPICE: Self-Play In Corpus Environments Improves Reasoning
2025/10/28 by Liu, Bo, Jin, Chuanyang, Kim, Seungone +7 · 9 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Learning to Visually Navigate in Photorealistic Environments Without any\n Supervision
2020/04/10 by Lina Mezghani, Mezghani, Lina, Sainbayar Sukhbaatar +7 · 1 citation
Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Robotics (cs.RO)
- StepWiser: Stepwise Generative Judges for Wiser Reasoning
2025/08/26 by Wei Xiong, Xiong, Wei, Wenting Zhao +11 · 1 voice · 10 citations
#cs.AI #cs.CL
- Bridging Offline and Online Reinforcement Learning for LLMs
2025/06/26 by Jack Lanchantin, Angelica Chen, Lanchantin, Jack +21 · 9 citations
Business, Management and Accounting · Engineering · #Collaboration in agile enterprises #Computation and Language (cs.CL) #FOS: Computer and information sciences #Scheduling and Optimization Algorithms
- MINOTAUR: Multi-task Video Grounding From Multimodal Queries
2023/02/16 by Goyal, Raghav, Mavroudi, Effrosyni, Yang, Xitong +5 · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences