Alon Albalak
- RWKV: Reinventing RNNs for the Transformer Era
2023/05/22 by Bo Peng, Peng, Bo, Eric Alcaide +71 · 2 voices · 108 citations
Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #Topic Modeling #cs.AI #cs.CL
- The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text
2025/06/05 by Nikhil Kandpal, Brian Lester, Kandpal, Nikhil +51 · 20 voices · 8 citations
Computer Science · Medicine · #Topic Modeling #Hate Speech and Cyberbullying Detection #Artificial Intelligence in Healthcare and Education
- Towards System 2 Reasoning in LLMs: Learning How to Think With Meta Chain-of-Thought
2025/01/08 by Violet Xiang, Charlie Snell, Xiang, Violet +25 · 17 voices · 16 citations
#cs.AI #cs.CL
- DataComp-LM: In search of the next generation of training sets for language models
2024/06/17 by Jeffrey Li, Alex Fang, Alex Chengyu Fang +121 · 2 voices · 80 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #cs.CL #cs.LG
- Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoning
2023/05/20 by Liangming Pan, Alon Albalak, Pan, Liangming +5 · 77 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques
- Artificial Hivemind: The Open-Ended Homogeneity of Language Models (and Beyond)
2025/10/27 by Liwei Jiang, Jiang, Liwei, Yuanjun Chai +17 · 15 voices · 13 citations
#cs.CL
- OpenThoughts: Data Recipes for Reasoning Models
2025/06/04 by Etash Guha, Ryan Marten, Guha, Etash +102 · 2 voices · 61 citations
Computer Science · #Advanced Graph Neural Networks #Explainable Artificial Intelligence (XAI) #Mathematics, Computing, and Information Processing #cs.LG
- A Survey on Data Selection for Language Models
2024/02/26 by Alon Albalak, Albalak, Alon, Yanai Elazar +25 · 40 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- Generalization v.s. Memorization: Tracing Language Models' Capabilities Back to Pretraining Data
2024/07/20 by Xinyi Wang, Antonis Antoniades, Wang, Xinyi +11 · 30 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques
- Efficient Online Data Mixing For Language Model Pre-Training
2023/12/05 by Alon Albalak, Liangming Pan, Albalak, Alon +5 · 16 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Natural Language Processing Techniques #Topic Modeling
- Big-Math: A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models
2025/02/24 by Alon Albalak, Duy Phung, Albalak, Alon +18 · 28 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics
- NeuPSL: Neural Probabilistic Soft Logic
2022/05/27 by Connor Pryor, Charles Dickens, Pryor, Connor +9 · 4 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Neural Networks and Applications #Topic Modeling
- Surveying the Effects of Quality, Diversity, and Complexity in Synthetic Data From Large Language Models
2024/12/04 by Alex Havrilla, Andrew M. Dai, Havrilla, Alex +36 · 9 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- A Mathematical Framework, a Taxonomy of Modeling Paradigms, and a Suite of Learning Techniques for Neural-Symbolic Systems
2024/07/12 by Charles Dickens, Connor Pryor, Dickens, Charles +13 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural Networks and Applications
- MAGPIE: A dataset for Multi-AGent contextual PrIvacy Evaluation
2025/06/25 by Gurusha Juneja, Juneja, Gurusha, Alon Albalak +5 · 2 citations
Computer Science · Social Sciences · #Privacy-Preserving Technologies in Data #Privacy, Security, and Data Protection