Alexander M. Rush
- Text Embeddings Reveal (Almost) As Much As Text
2023/10/10 by John X. Morris, Morris, John X., Volodymyr Kuleshov +5 · 10 voices · 32 citations
Computer Science · #Privacy-Preserving Technologies in Data #Topic Modeling #cs.CL #cs.LG
- Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks
2015/02/19 by Jason Weston, Weston, Jason, Antoine Bordes +12 · 2 voices · 93 citations
Computer Science · #cs.AI #cs.CL #stat.ML
- Scaling Data-Constrained Language Models
2023/05/25 by Niklas Muennighoff, Alexander M. Rush, Muennighoff, Niklas +15 · 1 voice · 68 citations
Computer Science · #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling #cs.AI #cs.CL #cs.LG
- How much do language models memorize?
2025/05/30 by John X. Morris, Chawin Sitawarin, Morris, John X. +13 · 9 voices · 22 citations
Computer Science · #Natural Language Processing Techniques #cs.CL
- Datasets: A Community Library for Natural Language Processing
2021/09/07 by Quentin Lhoest, Lhoest, Quentin, Albert Villanova del Moral +61 · 1 voice · 39 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #cs.CL
- Simple and Effective Masked Diffusion Language Models
2024/06/11 by Subham Sekhar Sahoo, Sahoo, Subham Sekhar, Marianne Arriola +13 · 167 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques
- Multitask Prompted Training Enables Zero-Shot Task Generalization
2021/10/15 by Victor Sanh, Albert Webson, Sanh, Victor +79 · 65 citations
Computer Science · #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documents
2023/06/21 by Hugo Laurençon, Lucile Saulnier, Laurençon, Hugo +22 · 1 voice · 34 citations
Computer Science · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling #cs.CV #cs.IR
- Sequence-Level Knowledge Distillation
2016/06/25 by Yoon Kim, Kim, Yoon, Alexander M. Rush +1 · 46 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Neural and Evolutionary Computing (cs.NE) #Topic Modeling
- Transformers: State-of-the-Art Natural Language Processing
2020/01/01 by Thomas Wolf, Lysandre Debut, Victor Sanh +19 · 45 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques
- MambaByte: Token-free Selective State Space Model
2024/01/24 by Junxiong Wang, Tushaar Gangavarapu, Wang, Junxiong +5 · 4 voices · 4 citations
Computer Science · #Cellular Automata and Applications #cs.CL #cs.LG
- Parameter-Efficient Transfer Learning with Diff Pruning
2020/12/14 by Demi Guo, Guo, Demi, Alexander M. Rush +3 · 34 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Topic Modeling #Multimodal Machine Learning Applications
- Movement Pruning: Adaptive Sparsity by Fine-Tuning
2020/05/15 by Victor Sanh, Sanh, Victor, Thomas Wolf +3 · 32 citations
Computer Science · #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Speech Recognition and Synthesis #Topic Modeling
- M1: Towards Scalable Test-Time Compute with Mamba Reasoning Models
2025/04/14 by Junxiong Wang, Wang, Junxiong, Wen-Ding Li +11 · 3 voices · 8 citations
Computer Science · #Formal Methods in Verification #Logic, programming, and type systems #Logic, Reasoning, and Knowledge
- Zephyr: Direct Distillation of LM Alignment
2023/10/25 by Lewis Tunstall, Edward Beeching, Tunstall, Lewis +25 · 46 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Recommender Systems and Techniques #Speech and dialogue systems #Topic Modeling
- Challenges in Data-to-Document Generation
2017/07/25 by Sam Wiseman, Wiseman, Sam, Stuart M. Shieber +3 · 24 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Character-Aware Neural Language Models
2015/08/26 by Yoon Kim, Kim, Yoon, Yacine Jernite +5 · 21 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (stat.ML) #Natural Language Processing Techniques #Neural and Evolutionary Computing (cs.NE) #Speech Recognition and Synthesis #Topic Modeling
- PromptSource: An Integrated Development Environment and Repository for Natural Language Prompts
2022/02/02 by Stephen H. Bach, Bach, Stephen H., Victor Sanh +51 · 16 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Semantic Web and Ontologies
- Structured Attention Networks
2017/02/03 by Yoon Kim, Carl Denton, Kim, Yoon +5 · 13 citations
Computer Science · #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural and Evolutionary Computing (cs.NE) #Topic Modeling
- Image-to-Markup Generation with Coarse-to-Fine Attention
2016/09/16 by Yuntian Deng, Anssi Kanervisto, Deng, Yuntian +5 · 9 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Handwritten Text Recognition Techniques #Machine Learning (cs.LG) #Mathematics, Computing, and Information Processing #Natural Language Processing Techniques #Neural and Evolutionary Computing (cs.NE)
- Simple Guidance Mechanisms for Discrete Diffusion Models
2024/12/13 by Yair Schiff, Subham Sekhar Sahoo, Schiff, Yair +17 · 34 citations
Mathematics · #FOS: Computer and information sciences #Gas Dynamics and Kinetic Theory #Machine Learning (cs.LG)
- Sequence-to-Sequence Learning as Beam-Search Optimization
2016/06/09 by Sam Wiseman, Alexander M. Rush, Wiseman, Sam +1 · 14 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Neural and Evolutionary Computing (cs.NE) #Topic Modeling
- Semi-Amortized Variational Autoencoders
2018/02/07 by Yoon Kim, Sam Wiseman, Kim, Yoon +7 · 12 citations
Computer Science · Physics and Astronomy · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Gaussian Processes and Bayesian Inference #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Model Reduction and Neural Networks
- Bottom-Up Abstractive Summarization
2018/08/31 by Sebastian Gehrmann, Gehrmann, Sebastian, Yuntian Deng +3 · 7 citations
Computer Science · #Advanced Text Analysis Techniques #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- Interactive and Visual Prompt Engineering for Ad-hoc Task Adaptation with Large Language Models
2022/08/16 by Hendrik Strobelt, Albert Webson, Strobelt, Hendrik +11 · 8 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- Commonsense Knowledge Mining from Pretrained Models
2019/09/02 by Joshua Feldman, Joe Davison, Feldman, Joshua +3 · 6 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Semantic Web and Ontologies #Topic Modeling
- Teal: Learning-Accelerated Optimization of WAN Traffic Engineering
2022/10/25 by Zhiying Xu, Francis Y. Yan, Xu, Zhiying +9 · 7 citations
Computer Science · #Software-Defined Networks and 5G #Internet Traffic Analysis and Secure E-voting #Network Traffic and Congestion Control
- OpenNMT: Neural Machine Translation Toolkit
2018/05/28 by Guillaume Klein, Yoon Kim, Klein, Guillaume +9 · 4 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Semantic Web and Ontologies #Topic Modeling
- Commit0: Library Generation from Scratch
2024/12/02 by Wenting Zhao, Zhao, Wenting, Nan Jiang +11 · 9 citations
Computer Science · #Recommender Systems and Techniques
- Evaluate & Evaluation on the Hub: Better Best Practices for Data and Model Measurements
2022/09/30 by Leandro von Werra, von Werra, Leandro, Lewis Tunstall +35 · 4 citations
Computer Science · Materials Science · #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Machine Learning in Materials Science
- Adversarially Regularized Autoencoders
2017/06/13 by Zhao, Jake, Yoon Kim, Kim, Yoon +6 · 4 citations
Computer Science · Physics and Astronomy · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Model Reduction and Neural Networks #Music and Audio Processing #Neural and Evolutionary Computing (cs.NE)
- LSTMVis: A Tool for Visual Analysis of Hidden State Dynamics in\n Recurrent Neural Networks
2016/06/23 by Hendrik Strobelt, Strobelt, Hendrik, Sebastian Gehrmann +5 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Data Visualization and Analytics #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Neural and Evolutionary Computing (cs.NE) #Time Series Analysis and Forecasting
- Avoiding Latent Variable Collapse With Generative Skip Models
2018/07/12 by Adji Bousso Dieng, Dieng, Adji B., Yoon Kim +5 · 5 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning in Healthcare #Music and Audio Processing
- Unsupervised Recurrent Neural Network Grammars
2019/04/07 by Yoon Kim, Kim, Yoon, Alexander M. Rush +9 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (stat.ML) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Visual Interaction with Deep Learning Models through Collaborative\n Semantic Inference
2019/07/24 by Sebastian Gehrmann, Gehrmann, Sebastian, Hendrik Strobelt +7 · 2 citations
Computer Science · #Data Visualization and Analytics #Multimodal Machine Learning Applications #Semantic Web and Ontologies
- Model Criticism for Long-Form Text Generation
2022/10/16 by Yuntian Deng, Deng, Yuntian, Volodymyr Kuleshov +3 · 1 voice · 2 citations
Computer Science · Mathematics · Social Sciences · #Computation and Language (cs.CL) #Computational and Text Analysis Methods #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Natural Language Processing Techniques #Topic Modeling #cs.CL #cs.LG #stat.ML
- Encoder-Agnostic Adaptation for Conditional Language Generation
2019/08/19 by Zachary M. Ziegler, Ziegler, Zachary M., Luke Melas-Kyriazi +5 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Challenges in Trustworthy Human Evaluation of Chatbots
2024/12/05 by Wenting Zhao, Zhao, Wenting, Alexander M. Rush +3 · 4 citations
Computer Science · #AI in Service Interactions #FOS: Computer and information sciences #Human-Computer Interaction (cs.HC)
- Contextual Document Embeddings
2024/10/03 by John X. Morris, Morris, John X., Alexander M. Rush +1 · 3 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling
- Latent Normalizing Flows for Discrete Sequences
2019/01/29 by Zachary M. Ziegler, Alexander M. Rush, Ziegler, Zachary M. +1 · 1 citation
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Music and Audio Processing #Natural Language Processing Techniques #Topic Modeling
- Cascaded Text Generation with Markov Transformers
2020/06/01 by Yuntian Deng, Deng, Yuntian, Alexander M. Rush +1 · 1 citation
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Neural and Evolutionary Computing (cs.NE) #Topic Modeling
- Learning from others' mistakes: Avoiding dataset biases without modeling them
2020/12/02 by Victor Sanh, Sanh, Victor, Thomas Wolf +5 · 1 citation
Computer Science · Social Sciences · #Advanced Text Analysis Techniques #Computation and Language (cs.CL) #Computational and Text Analysis Methods #FOS: Computer and information sciences #Machine Learning (cs.LG) #Topic Modeling
- A Controlled Study on Long Context Extension and Generalization in LLMs
2024/09/18 by Yi Lü, Jing Nathan Yan, Lu, Yi +15 · 2 citations
Computer Science · #Computation and Language (cs.CL) #Data Mining Algorithms and Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Semantic Web and Ontologies
- Explaining Patterns in Data with Language Models via Interpretable Autoprompting
2022/10/04 by Chandan Singh, John X. Morris, Singh, Chandan +7 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Biological sciences #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning in Healthcare #Neurons and Cognition (q-bio.NC) #Topic Modeling
- Unsupervised Text Deidentification
2022/10/20 by John X. Morris, Justin Chiu, Morris, John X. +5 · 1 citation
Computer Science · Social Sciences · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling #Wikis in Education and Collaboration
- Pretraining Without Attention
2022/12/20 by Junxiong Wang, Wang, Junxiong, Jing Nathan Yan +5 · 1 citation
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Semantic Web and Ontologies #Topic Modeling
- Predicting Text Preference Via Structured Comparative Reasoning
2023/11/14 by Jing Nathan Yan, Yan, Jing Nathan, Tianqi Liu +21 · 1 citation
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Advanced Text Analysis Techniques
- Approximating Language Model Training Data from Weights
2025/06/18 by John X. Morris, Morris, John X., Yin, Junjie Oscar +6 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling