vix.ing · top · new · best · stats · spec

Luke Zettlemoyer

  1. Toolformer: Language Models Can Teach Themselves to Use Tools
    2023/02/09 by Timo Schick, Jane Dwivedi-Yu, Schick, Timo +15 · 7 voices · 712 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques
  2. s1: Simple test-time scaling
    2025/01/31 by Niklas Muennighoff, Zitong Yang, Muennighoff, Niklas +18 · 30 voices · 379 citations
    Engineering · Computer Science · #Fault Detection and Control Systems #Neural Networks and Applications
  3. QLoRA: Efficient Finetuning of Quantized LLMs
    2023/05/23 by Tim Dettmers, Dettmers, Tim, Artidoro Pagnoni +5 · 3 voices · 524 citations
    #cs.LG
  4. LIMA: Less Is More for Alignment
    2023/05/18 by Chunting Zhou, Zhou, Chunting, Pengfei Liu +27 · 6 voices · 120 citations
    Computer Science · #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling #cs.AI #cs.CL #cs.LG
  5. LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale
    2022/08/15 by Tim Dettmers, Mike Lewis, Dettmers, Tim +5 · 5 voices · 98 citations
    Computer Science · Engineering · #Ferroelectric and Negative Capacitance Devices #Parallel Computing and Optimization Techniques #Topic Modeling #cs.AI #cs.LG
  6. OPT: Open Pre-trained Transformer Language Models
    2022/05/02 by Susan Zhang, Stephen Roller, Zhang, Susan +35 · 2 voices · 269 citations
    #cs.CL #cs.LG
  7. Infini-gram: Scaling Unbounded n-gram Language Models to a Trillion Tokens
    2024/01/30 by Jiacheng Liu, Liu, Jiacheng, Sewon Min +7 · 10 voices · 42 citations
    Computer Science · #Natural Language Processing Techniques #Topic Modeling
  8. Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Model
    2024/08/20 by Chunting Zhou, Zhou, Chunting, Lili Yu +17 · 4 voices · 119 citations
    Neuroscience · #Brain Tumor Detection and Classification
  9. Byte Latent Transformer: Patches Scale Better Than Tokens
    2024/12/13 by Artidoro Pagnoni, Pagnoni, Artidoro, Ram Pasunuru +27 · 17 voices · 40 citations
    Computer Science · #Natural Language Processing Techniques #Semantic Web and Ontologies #Topic Modeling #cs.CL
  10. MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers
    2023/05/12 by Lili Yu, Yu, Lili, Dániel Simig +9 · 4 voices · 23 citations
    #cs.LG
  11. 2 OLMo 2 Furious
    2024/12/31 by Team OLMo, Pete Walsh, OLMo, Team +85 · 9 voices · 88 citations
    Computer Science · Medicine · #Topic Modeling #Artificial Intelligence in Healthcare and Education #Natural Language Processing Techniques
  12. Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length
    2024/04/12 by Xuezhe Ma, Xiaomeng Yang, Ma, Xuezhe +17 · 3 voices · 4 citations
    #cs.LG #cs.CL
  13. TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for\n Reading Comprehension
    2017/05/09 by Mandar Joshi, Eunsol Choi, Joshi, Mandar +5 · 412 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  14. BART: Denoising Sequence-to-Sequence Pre-training for Natural Language\n Generation, Translation, and Comprehension
    2019/10/29 by Yinhan Liu, Lewis, Mike, Liu, Yinhan +12 · 268 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
  15. One Embedder, Any Task: Instruction-Finetuned Text Embeddings
    2022/12/19 by Hongjin Su, Su, Hongjin, Weijia Shi +17 · 3 voices · 40 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #cs.CL
  16. REPLUG: Retrieval-Augmented Black-Box Language Models
    2023/01/30 by Weijia Shi, Sewon Min, Shi, Weijia +13 · 1 voice · 92 citations
    Computer Science · #Machine Learning in Healthcare #Natural Language Processing Techniques #Topic Modeling #cs.CL
  17. DataComp-LM: In search of the next generation of training sets for language models
    2024/06/17 by Jeffrey Li, Li, Jeffrey, Alex Chengyu Fang +121 · 2 voices · 82 citations
    Computer Science · #Natural Language Processing Techniques #Topic Modeling #cs.CL #cs.LG
  18. Efficient Large Scale Language Modeling with Mixtures of Experts
    2021/12/20 by Mikel Artetxe, Shruti Bhosale, Artetxe, Mikel +47 · 1 voice · 16 citations
    Computer Science · #Topic Modeling #Expert finding and Q&A systems #Machine Learning in Healthcare
  19. ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday\n Tasks
    2019/12/03 by M.H Shridhar, Jesse Thomason, Shridhar, Mohit +13 · 99 citations
    Arts and Humanities · Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Robotics (cs.RO) #Subtitles and Audiovisual Media
  20. FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation
    2023/05/23 by Sewon Min, Kalpesh Krishna, Min, Sewon +15 · 154 citations
    Computer Science · Social Sciences · #Topic Modeling #Natural Language Processing Techniques #Computational and Text Analysis Methods
  21. Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?
    2022/02/25 by Sewon Min, Xinxi Lyu, Min, Sewon +10 · 118 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
  22. Intrinsic Dimensionality Explains the Effectiveness of Language Model\n Fine-Tuning
    2020/12/22 by Armen Aghajanyan, Aghajanyan, Armen, Luke Zettlemoyer +3 · 70 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
  23. Contrastive Decoding: Open-ended Text Generation as Optimization
    2022/10/27 by Xiang Lisa Li, Li, Xiang Lisa, Ari Holtzman +12 · 83 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
  24. Generalization through Memorization: Nearest Neighbor Language Models
    2019/11/01 by Urvashi Khandelwal, Omer Levy, Khandelwal, Urvashi +7 · 63 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
  25. Whose Language Counts as High Quality? Measuring Language Ideologies in Text Data Selection
    2022/01/25 by Suchin Gururangan, Dallas Card, Gururangan, Suchin +14 · 2 voices · 5 citations
    Computer Science · #Hate Speech and Cyberbullying Detection #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL
  26. Multilingual Denoising Pre-training for Neural Machine Translation
    2020/01/22 by Yinhan Liu, Jiatao Gu, Liu, Yinhan +13 · 79 citations
    Computer Science · #Natural Language Processing Techniques #Topic Modeling #Speech Recognition and Synthesis
  27. Does Liking Yellow Imply Driving a School Bus? Semantic Leakage in Language Models
    2024/08/12 by Hila Gonen, Gonen, Hila, Terra Blevins +7 · 7 voices · 4 citations
    #cs.CL
  28. AmbigQA: Answering Ambiguous Open-domain Questions
    2020/04/22 by Sewon Min, Min, Sewon, Julian Michael +5 · 49 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
  29. DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation
    2022/11/18 by Yuhang Lai, Chengxi Li, Lai, Yuhang +17 · 63 citations
    Computer Science · Materials Science · #Software Engineering Research #Machine Learning and Data Classification #Machine Learning in Materials Science
  30. InCoder: A Generative Model for Code Infilling and Synthesis
    2022/04/12 by Daniel Fried, Armen Aghajanyan, Fried, Daniel +16 · 56 citations
    Computer Science · #Software Engineering Research #Software Testing and Debugging Techniques #Software Reliability and Analysis Research
  31. Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research
    2024/01/31 by Luca Soldaini, Rodney Kinney, Soldaini, Luca +69 · 82 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques
  32. VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understanding
    2021/09/28 by Hu Xu, Gargi Ghosh, Xu, Hu +13 · 51 citations
    Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications
  33. Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models
    2024/06/13 by Yushi Hu, Hu, Yushi, Weijia Shi +13 · 92 citations
    Health Professions · Computer Science · #Digital Storytelling and Education #Speech and dialogue systems
  34. 8-bit Optimizers via Block-wise Quantization
    2021/10/06 by Tim Dettmers, Mike Lewis, Dettmers, Tim +5 · 48 citations
    Computer Science · Mathematics · #Advanced Neural Network Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Stochastic Gradient Optimization Techniques #Tensor decomposition and applications
  35. OLMo: Accelerating the Science of Language Models
    2024/02/01 by Dirk Groeneveld, Groeneveld, Dirk, Iz Beltagy +83 · 78 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques
  36. NL2Bash: A Corpus and Semantic Parser for Natural Language Interface to the Linux Operating System
    2018/02/25 by Xi Victoria Lin, Chenglong Wang, Lin, Xi Victoria +5 · 1 voice · 9 citations
    #cs.CL #cs.SE
  37. MetaICL: Learning to Learn In Context
    2021/10/29 by Sewon Min, Mike Lewis, Min, Sewon +5 · 1 voice · 31 citations
    Computer Science · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL
  38. Detecting Pretraining Data from Large Language Models
    2023/10/25 by Weijia Shi, Anirudh Ajith, Shi, Weijia +13 · 57 citations
    Computer Science · #Computation and Language (cs.CL) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
  39. BASE Layers: Simplifying Training of Large, Sparse Models
    2021/03/30 by Mike Lewis, Lewis, Mike, Shruti Bhosale +7 · 36 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Machine Learning and Algorithms
  40. Latent Action Pretraining from Videos
    2024/10/15 by Seonghyeon Ye, Joel Jang, Ye, Seonghyeon +28 · 78 citations
    Computer Science · Engineering · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Motion and Animation #Human Pose and Action Recognition #Machine Learning (cs.LG) #Robotics (cs.RO) #Video Analysis and Summarization
  41. Demystifying CLIP Data
    2023/09/28 by Xu Hu, Saining Xie, Xu, Hu +17 · 42 citations
    Computer Science · Medicine · #COVID-19 diagnosis using AI #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Radiomics and Machine Learning in Medical Imaging
  42. ROSCOE: A Suite of Metrics for Scoring Step-by-Step Reasoning
    2022/12/15 by Olga Golovneva, Golovneva, Olga, Moya Chen +11 · 34 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Text Readability and Simplification
  43. Trusting Your Evidence: Hallucinate Less with Context-aware Decoding
    2023/05/24 by Weijia Shi, Xiaochuang Han, Shi, Weijia +9 · 36 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  44. QuAC : Question Answering in Context
    2018/08/21 by Eunsol Choi, Choi, Eunsol, He He +13 · 21 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  45. Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language Models
    2022/05/22 by Kushal Tirumala, Tirumala, Kushal, Aram Markosyan +5 · 29 citations
    Computer Science · #Topic Modeling #Speech Recognition and Synthesis #Natural Language Processing Techniques
  46. MUSE: Machine Unlearning Six-Way Evaluation for Language Models
    2024/07/08 by Weijia Shi, Shi, Weijia, Jaechan Lee +17 · 46 citations
    Computer Science · #Natural Language Processing Techniques #Topic Modeling
  47. Demystifying Prompts in Language Models via Perplexity Estimation
    2022/12/08 by Hila Gonen, Gonen, Hila, Srini Iyer +7 · 28 citations
    Computer Science · #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
  48. Binding Language Models in Symbolic Languages
    2022/10/06 by Zhoujun Cheng, Cheng, Zhoujun, Tianbao Xie +21 · 27 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Software Engineering Research
  49. The case for 4-bit precision: k-bit Inference Scaling Laws
    2022/12/19 by Tim Dettmers, Luke Zettlemoyer, Dettmers, Tim +1 · 26 citations
    Computer Science · Engineering · #Topic Modeling #Ferroelectric and Negative Capacitance Devices #Machine Learning and Algorithms
  50. Learning to Map Sentences to Logical Form: Structured Classification\n with Probabilistic Categorial Grammars
    2012/07/04 by Luke Zettlemoyer, Zettlemoyer, Luke S., Michael J. Collins +1 · 15 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Semantic Web and Ontologies #Topic Modeling
  51. Do Membership Inference Attacks Work on Large Language Models?
    2024/02/12 by Michael Duan, Anshuman Suri, Duan, Michael +17 · 33 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Topic Modeling
  52. Improving Passage Retrieval with Zero-Shot Question Generation
    2022/04/15 by Devendra Singh Sachan, Sachan, Devendra Singh, Mandar Joshi +10 · 21 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
  53. Memory Layers at Scale
    2024/12/12 by Vincent-Pierre Berges, Barlas Oğuz, Berges, Vincent-Pierre +9 · 1 voice · 12 citations
    Engineering · #cs.CL #cs.AI
  54. RA-DIT: Retrieval-Augmented Dual Instruction Tuning
    2023/10/02 by Xi Victoria Lin, Lin, Xi Victoria, Xilun Chen +20 · 26 citations
    Computer Science · #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications #Topic Modeling
  55. Surface Form Competition: Why the Highest Probability Answer Isn't\n Always Right
    2021/04/16 by Ari Holtzman, Peter West, Holtzman, Ari +7 · 16 citations
    Computer Science · #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning and Data Classification #Topic Modeling
  56. LMFusion: Adapting Pretrained Language Models for Multimodal Generation
    2024/12/19 by Weijia Shi, Shi, Weijia, Xiaochuang Han +11 · 40 citations
    Computer Science · #Natural Language Processing Techniques #Speech and dialogue systems #Multimodal Machine Learning Applications
  57. DEMix Layers: Disentangling Domains for Modular Language Modeling
    2021/08/11 by Suchin Gururangan, Gururangan, Suchin, Lewis, Mike +6 · 13 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
  58. Adversarial Example Generation with Syntactically Controlled Paraphrase\n Networks
    2018/04/17 by Mohit Iyyer, Iyyer, Mohit, John Wieting +5 · 10 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
  59. Scaling Laws for Generative Mixed-Modal Language Models
    2023/01/10 by Armen Aghajanyan, Aghajanyan, Armen, Lili Yu +17 · 14 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
  60. Branch-Train-Merge: Embarrassingly Parallel Training of Expert Language Models
    2022/08/05 by Margaret Li, Li, Margaret, Suchin Gururangan +11 · 2 voices · 10 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling #cs.CL
  61. DreamGen: Unlocking Generalization in Robot Learning through Video World Models
    2025/05/19 by Joel Jang, Seonghyeon Ye, Jang, Joel +52 · 44 citations
    Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Robotics (cs.RO)
  62. Stable and low-precision training for large-scale vision-language models
    2023/04/25 by Mitchell Wortsman, Wortsman, Mitchell, Tim Dettmers +9 · 15 citations
    Computer Science · #Multimodal Machine Learning Applications #Topic Modeling #Natural Language Processing Techniques
  63. Mega: Moving Average Equipped Gated Attention
    2022/09/21 by Xuezhe Ma, Ma, Xuezhe, Chunting Zhou +13 · 13 citations
    Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
  64. Selective Annotation Makes Language Models Better Few-Shot Learners
    2022/09/05 by Hongjin Su, Jungo Kasai, Su, Hongjin +19 · 13 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
  65. Retrieval-Augmented Multimodal Language Modeling
    2022/11/22 by Michihiro Yasunaga, Armen Aghajanyan, Yasunaga, Michihiro +14 · 13 citations
    Computer Science · #Multimodal Machine Learning Applications #Advanced Image and Video Retrieval Techniques #Topic Modeling
  66. In-context Pretraining: Language Modeling Beyond Document Boundaries
    2023/10/16 by Weijia Shi, Sewon Min, Shi, Weijia +17 · 16 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  67. ART: Automatic multi-step reasoning and tool-use for large language models
    2023/03/16 by Bhargavi Paranjape, Scott Lundberg, Paranjape, Bhargavi +9 · 14 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
  68. Spurious Rewards: Rethinking Training Signals in RLVR
    2025/06/12 by Rulin Shao, Shuyue Stella Li, Shao, Rulin +25 · 61 citations
    Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Natural Language Processing Techniques #Topic Modeling
  69. Few-shot Learning with Multilingual Language Models
    2021/12/20 by Xi Victoria Lin, Lin, Xi Victoria, Todor Mihaylov +39 · 11 citations
    Computer Science · #Topic Modeling #Hate Speech and Cyberbullying Detection #Natural Language Processing Techniques
  70. Natural Language to Code Translation with Execution
    2022/04/25 by Freda Shi, Daniel Fried, Shi, Freda +7 · 1 voice · 9 citations
    Computer Science · #Software Engineering Research #Topic Modeling #Software Testing and Debugging Techniques
  71. SILO Language Models: Isolating Legal Risk In a Nonparametric Datastore
    2023/08/08 by Sewon Min, Min, Sewon, Suchin Gururangan +11 · 1 voice · 10 citations
    Computer Science · #Topic Modeling #cs.AI #cs.CL #cs.LG
  72. Self-Alignment with Instruction Backtranslation
    2023/08/11 by Xian Li, Ping Yu, Li, Xian +12 · 13 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
  73. Multi-hop Reading Comprehension through Question Decomposition and Rescoring
    2019/06/07 by Sewon Min, Min, Sewon, Victor W. Zhong +5 · 7 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  74. Muppet: Massive Multi-task Representations with Pre-Finetuning
    2021/01/26 by Armen Aghajanyan, Anchit Gupta, Aghajanyan, Armen +9 · 8 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
  75. UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Models
    2022/01/16 by Tianbao Xie, Xie, Tianbao, Chen Wu +43 · 9 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
  76. Meta CLIP 2: A Worldwide Scaling Recipe
    2025/07/29 by Yung-Sung Chuang, Chuang, Yung-Sung, Li Yang +32 · 1 voice · 15 citations
    Computer Science · #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications #Topic Modeling #cs.CL #cs.CV
  77. Emerging Cross-lingual Structure in Pretrained Language Models
    2019/11/04 by Shijie Wu, Alexis Conneau, Wu, Shijie +7 · 7 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
  78. Nearest Neighbor Machine Translation
    2020/10/01 by Urvashi Khandelwal, Khandelwal, Urvashi, Angela Fan +7 · 9 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  79. In-context Examples Selection for Machine Translation
    2022/12/05 by Sweta Agrawal, Chunting Zhou, Agrawal, Sweta +6 · 10 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  80. OpenScholar: Synthesizing Scientific Literature with Retrieval-augmented LMs
    2024/11/21 by Akari Asai, Jacqueline He, Asai, Akari +50 · 2 voices · 15 citations
    Biochemistry, Genetics and Molecular Biology · Computer Science · #Biomedical Text Mining and Ontologies #Natural Language Processing Techniques #Semantic Web and Ontologies #cs.AI #cs.CL #cs.DL #cs.IR #cs.LG
  81. XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language Models
    2023/01/25 by Davis Liang, Liang, Davis, Hila Gonen +13 · 9 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  82. Nonparametric Masked Language Modeling
    2022/12/02 by Sewon Min, Weijia Shi, Min, Sewon +11 · 1 voice · 2 citations
    Computer Science · #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling #cs.AI #cs.CL #cs.LG
  83. Compositional Questions Do Not Necessitate Multi-hop Reasoning
    2019/06/07 by Sewon Min, Eric Wallace, Min, Sewon +9 · 6 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval and Search Behavior #Natural Language Processing Techniques #Topic Modeling
  84. Luna: Linear Unified Nested Attention
    2021/06/03 by Xuezhe Ma, Xiang Kong, Ma, Xuezhe +11 · 6 citations
    Computer Science · #Advanced Neural Network Applications #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel Computing and Optimization Techniques #Topic Modeling
  85. MoMa: Efficient Early-Fusion Pre-training with Mixture of Modality-Aware Experts
    2024/07/31 by Xi Lin, Lin, Xi Victoria, Akshat Shrivastava +11 · 12 citations
    Computer Science · Engineering · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robot Manipulation and Learning #Robotics and Automated Systems #Speech Recognition and Synthesis
  86. (Mis)Fitting: A Survey of Scaling Laws
    2025/02/26 by Margaret Li, Sneha Kudugunta, Li, Margaret +3 · 1 voice · 6 citations
    Computer Science · Mathematics · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Methodology (stat.ME) #Stochastic Gradient Optimization Techniques #cs.AI #cs.CL #cs.LG #stat.ME
  87. Pre-training via Paraphrasing
    2020/06/26 by Mike Lewis, Lewis, Mike, Marjan Ghazvininejad +9 · 13 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
  88. Grounded Adaptation for Zero-shot Executable Semantic Parsing
    2020/09/16 by Victor W. Zhong, Mike Lewis, Zhong, Victor +5 · 5 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Databases (cs.DB) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  89. Train for Truth, Keep the Skills: Binary Retrieval-Augmented Reward Mitigates Hallucinations
    2025/10/20 by Tong Chen, Chen, Tong, Akari Asai +7 · 4 voices
    Computer Science · #Topic Modeling #Multimodal Machine Learning Applications #Adversarial Robustness in Machine Learning
  90. Ultra-Fine Entity Typing
    2018/07/13 by Eunsol Choi, Choi, Eunsol, Omer Levy +5 · 4 citations
    Computer Science · Decision Sciences · #Advanced Data Storage Technologies #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #Machine Learning (cs.LG) #Scientific Computing and Data Management
  91. Revisiting Machine Translation for Cross-lingual Classification
    2023/05/23 by Mikel Artetxe, Artetxe, Mikel, Vedanuj Goswami +7 · 7 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  92. Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning
    2023/09/05 by Lili Yu, Bowen Shi, Yu, Lili +51 · 7 citations
    Computer Science · #Multimodal Machine Learning Applications #Topic Modeling #Natural Language Processing Techniques
  93. Noisy Channel Language Model Prompting for Few-Shot Text Classification
    2021/08/09 by Sewon Min, Min, Sewon, Lewis, Mike +4 · 5 citations
    Computer Science · #Natural Language Processing Techniques #Topic Modeling #Domain Adaptation and Few-Shot Learning
  94. A Discrete Hard EM Approach for Weakly Supervised Question Answering
    2019/09/11 by Sewon Min, Danqi Chen, Min, Sewon +5 · 7 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Expert finding and Q&A systems
  95. Shepherd: A Critic for Language Model Generation
    2023/08/08 by Tianlu Wang, Ping Yu, Wang, Tianlu +17 · 7 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
  96. Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass
    2024/11/08 by Tong Chen, Hao Fang, Chen, Tong +13 · 9 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Natural Language Processing Techniques
  97. Evaluating Copyright Takedown Methods for Language Models
    2024/06/26 by Boyi Wei, Weijia Shi, Wei, Boyi +13 · 8 citations
    Computer Science · #Computation and Language (cs.CL) #Digital Rights Management and Security #FOS: Computer and information sciences #Machine Learning (cs.LG)
  98. VLM: Task-agnostic Video-Language Model Pre-training for Video Understanding
    2021/05/20 by Hu Xu, Gargi Ghosh, Xu, Hu +13 · 4 citations
    Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Human Pose and Action Recognition
  99. RoMQA: A Benchmark for Robust, Multi-evidence, Multi-answer Question Answering
    2022/10/25 by Victor W. Zhong, Weijia Shi, Zhong, Victor +5 · 5 citations
    Computer Science · #Computation and Language (cs.CL) #Expert finding and Q&A systems #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
  100. Multimodal RewardBench: Holistic Evaluation of Reward Models for Vision Language Models
    2025/02/20 by Michihiro Yasunaga, Luke Zettlemoyer, Yasunaga, Michihiro +3 · 13 citations
    Psychology · #Language, Metaphor, and Cognition
  101. CREPE: Open-Domain Question Answering with False Presuppositions
    2022/11/30 by Xinyan Yu, Yu, Xinyan Velocity, Sewon Min +5 · 4 citations
    Computer Science · #Advanced Graph Neural Networks #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Expert finding and Q&A systems #FOS: Computer and information sciences #Topic Modeling
  102. Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Models
    2024/11/07 by Weixin Liang, Lili Yu, Liang Luo +8 · 6 voices · 1 citation
    Computer Science · #cs.CL
  103. Breaking the Curse of Multilinguality with Cross-lingual Expert Language Models
    2024/01/19 by Terra Blevins, Tomasz Limisiewicz, Blevins, Terra +11 · 5 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
  104. Reliable, Adaptable, and Attributable Language Models with Retrieval
    2024/03/05 by Akari Asai, Zexuan Zhong, Asai, Akari +11 · 5 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
  105. Analyzing the Mono- and Cross-Lingual Pretraining Dynamics of Multilingual Language Models
    2022/05/24 by Terra Blevins, Hila Gonen, Blevins, Terra +3 · 3 citations
    Computer Science · #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Topic Modeling
  106. CopyBench: Measuring Literal and Non-Literal Reproduction of Copyright-Protected Text in Language Model Generation
    2024/07/09 by Tong Chen, Chen, Tong, Akari Asai +15 · 6 citations
    Computer Science · #Computation and Language (cs.CL) #Digital Rights Management and Security #FOS: Computer and information sciences #Machine Learning (cs.LG)
  107. MoDE: CLIP Data Experts via Clustering
    2024/04/24 by Jiawei Ma, Po-Yao Huang, Ma, Jiawei +13 · 5 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Data Mining Algorithms and Applications #FOS: Computer and information sciences #Machine Learning (cs.LG)
  108. Altogether: Image Captioning via Re-aligning Alt-text
    2024/10/22 by Hu Xu, Po-Yao Huang, Xu, Hu +23 · 6 citations
    Computer Science · #Advanced Image and Video Retrieval Techniques #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Video Analysis and Summarization
  109. Z-ICL: Zero-Shot In-Context Learning with Pseudo-Demonstrations
    2022/12/19 by Xinxi Lyu, Lyu, Xinxi, Sewon Min +7 · 3 citations
    Computer Science · #Domain Adaptation and Few-Shot Learning #Machine Learning and Algorithms #Multimodal Machine Learning Applications
  110. Dictionary-based Phrase-level Prompting of Large Language Models for Machine Translation
    2023/02/15 by Marjan Ghazvininejad, Ghazvininejad, Marjan, Hila Gonen +3 · 3 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
  111. Heterogeneous Swarms: Jointly Optimizing Model Roles and Weights for Multi-LLM Systems
    2025/02/06 by Shangbin Feng, Feng, Shangbin, Zifeng Wang +20 · 2 voices · 5 citations
    Computer Science · Decision Sciences · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Simulation Techniques and Applications #cs.CL
  112. An Information Bottleneck Approach for Controlling Conciseness in\n Rationale Extraction
    2020/05/01 by Bhargavi Paranjape, Mandar Joshi, Paranjape, Bhargavi +7 · 2 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
  113. Moving Down the Long Tail of Word Sense Disambiguation with\n Gloss-Informed Biencoders
    2020/05/06 by Terra Blevins, Blevins, Terra, Luke Zettlemoyer +1 · 2 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
  114. Recycling the Web: A Method to Enhance Pre-training Data Quality and Quantity for Language Models
    2025/06/05 by Thao D. Nguyen, Nguyen, Thao, Li Yang +11 · 11 citations
    Computer Science · Decision Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Data Quality and Management #FOS: Computer and information sciences #Machine Learning (cs.LG) #Topic Modeling #Web Data Mining and Analysis
  115. Bilingual Lexicon Induction via Unsupervised Bitext Construction and Word Alignment
    2021/01/01 by Haoyue Shi, Shi, Haoyue, Luke Zettlemoyer +3 · 2 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
  116. Language Contamination Helps Explain the Cross-lingual Capabilities of English Pretrained Models
    2022/04/17 by Terra Blevins, Luke Zettlemoyer, Blevins, Terra +1 · 2 citations
    Computer Science · #Natural Language Processing Techniques #Topic Modeling #Multimodal Machine Learning Applications
  117. Computational Tradeoffs in Image Synthesis: Diffusion, Masked-Token, and Next-Token Prediction
    2024/05/21 by Maciej Kilian, Kilian, Maciej, Luke Zettlemoyer +2 · 3 citations
    Computer Science · #Computer Graphics and Visualization Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Image Retrieval and Classification Techniques
  118. FaVIQ: FAct Verification from Information-seeking Questions
    2021/07/05 by Jungsoo Park, Park, Jungsoo, Sewon Min +7 · 2 citations
    Computer Science · #Topic Modeling #Software Engineering Research #Natural Language Processing Techniques
  119. Representation Deficiency in Masked Language Modeling
    2023/02/04 by Meng Yu, Jitin Krishnan, Meng, Yu +14 · 2 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques
  120. Commonly Uncommon: Semantic Sparsity in Situation Recognition
    2016/12/03 by Mark Yatskar, Vicente Ordóñez, Yatskar, Mark +5 · 2 citations
    Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Human Pose and Action Recognition
  121. Jointly Predicting Predicates and Arguments in Neural Semantic Role Labeling
    2018/05/12 by Luheng He, He, Luheng, Kenton Lee +5 · 1 citation
    Biochemistry, Genetics and Molecular Biology · Computer Science · #Biomedical Text Mining and Ontologies #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
  122. Recurrent Additive Networks
    2017/05/21 by Kenton Lee, Omer Levy, Lee, Kenton +3 · 2 citations
    Computer Science · Engineering · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning and Algorithms #Topic Modeling
  123. JuICe: A Large Scale Distantly Supervised Dataset for Open Domain\n Context-based Code Generation
    2019/10/05 by Rajas Agashe, Agashe, Rajas, Srinivasan Iyer +3 · 1 citation
    Computer Science · #Advanced Malware Detection Techniques #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Software Engineering (cs.SE) #Software Engineering Research #Software Testing and Debugging Techniques #Topic Modeling
  124. When Worse is Better: Navigating the compression-generation tradeoff in visual tokenization
    2024/12/20 by Vivek Ramanujan, Kushal Tirumala, Ramanujan, Vivek +7 · 3 citations
    Computer Science · #Digital Media Forensic Detection #Advanced Steganography and Watermarking Techniques #Visual Attention and Saliency Detection
  125. Multilingual Autoregressive Entity Linking
    2021/03/23 by Nicola De Cao, De Cao, Nicola, Ledell Wu +17 · 1 citation
    Computer Science · Decision Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Data Quality and Management #FOS: Computer and information sciences #Machine Learning (stat.ML) #Natural Language Processing Techniques #Topic Modeling
  126. Language Grounding with 3D Objects
    2021/07/26 by Jesse Thomason, Thomason, Jesse, Mohit Shridhar +7 · 1 citation
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Robotics (cs.RO)
  127. SILG: The Multi-environment Symbolic Interactive Language Grounding Benchmark
    2021/10/20 by Victor W. Zhong, Austin W. Hanjie, Zhong, Victor +7 · 1 citation
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  128. Improving Policy Learning via Language Dynamics Distillation
    2022/09/30 by Victor W. Zhong, Zhong, Victor, Jesse Mu +7 · 1 citation
    Computer Science · #Topic Modeling
  129. Bolmo: Byteifying the Next Generation of Language Models
    2025/12/17 by Benjamin Minixhofer, Minixhofer, Benjamin, Tyler Murray +15 · 1 voice · 1 citation
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #cs.CL
  130. Prompting Language Models for Linguistic Structure
    2022/11/15 by Terra Blevins, Blevins, Terra, Hila Gonen +3 · 1 citation
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
  131. OMNIGUARD: An Efficient Approach for AI Safety Moderation Across Languages and Modalities
    2025/05/29 by Sahil Verma, Keegan Hines, Verma, Sahil +11 · 4 citations
    Computer Science · #Adversarial Robustness in Machine Learning
  132. Mixture-of-Mamba: Enhancing Multi-Modal State-Space Models with Modality-Aware Sparsity
    2025/01/27 by Weixin Liang, Jun-Hong Shen, Liang, Weixin +8 · 2 citations
    Computer Science · #Algorithms and Data Compression #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Speech Recognition and Synthesis #Speech and Audio Processing
  133. ALMA: Alignment with Minimal Annotation
    2024/12/05 by Michihiro Yasunaga, Leonid Shamis, Yasunaga, Michihiro +11 · 1 citation
    Computer Science · #Handwritten Text Recognition Techniques #Natural Language Processing Techniques #Semantic Web and Ontologies