91. SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot
    2023/01/02 by Elias Frantar, Frantar, Elias, Dan Alistarh +1 · 3 voices · 320 citations
    Computer Science · Engineering · #Advanced Data Storage Technologies #Algorithm #Artificial intelligence #Code (set theory) #Computer science #Ferroelectric and Negative Capacitance Devices #Generative grammar #Generative model #Inference #Language model #Machine learning #One shot #Perplexity #Programming language #Pruning #Quantization (signal processing) #Source code #Topic Modeling #Transformer #cs.LG
92. BLOOM+1: Adding Language Support to BLOOM for Zero-Shot Prompting
    2022/12/19 by Zheng-Xin Yong, Yong, Zheng-Xin, Hailey Schoelkopf +26 · 21 citations
    Computer Science · Psychology · #Adaptation (eye) #Adapter (computing) #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Artificial intelligence #Benchmark (surveying) #Bloom filter #Computation and Language (cs.CL) #Computer science #Constructed language #FOS: Computer and information sciences #Language model #Linguistics #Machine Learning (cs.LG) #Machine Learning and Data Classification #Natural language processing #Programming language #Psychology #Task (project management) #Topic Modeling #Zero (linguistics)
93. A Survey on Pretrained Language Models for Neural Code Intelligence
    2022/12/20 by Yichen Xu, Xu, Yichen, Yanqiao Zhu +1 · 1 citation
    Computer Science · #Artificial intelligence #Automatic summarization #Code (set theory) #Computation and Language (cs.CL) #Computer science #Data science #Deep learning #Domain (mathematical analysis) #FOS: Computer and information sciences #Field (mathematics) #Language model #Machine Learning (cs.LG) #Machine learning #Natural language #Natural language processing #Programming language #Software #Software Engineering (cs.SE) #Software Engineering Research #Software Testing and Debugging Techniques #Software engineering #Source code #Topic Modeling
94. Pre-trained Language Models Can be Fully Zero-Shot Learners
    2022/12/14 by Xuandong Zhao, Siqi Ouyang, Zhao, Xuandong +7 · 3 citations
    Computer Science · #Artificial intelligence #Benchmark (surveying) #Computation and Language (cs.CL) #Computer science #Construct (python library) #FOS: Computer and information sciences #Language model #Linguistics #Machine learning #Natural Language Processing Techniques #Natural language processing #Range (aeronautics) #Set (abstract data type) #Shot (pellet) #Text Readability and Simplification #Topic Modeling #Zero (linguistics)
95. Discovering Latent Knowledge in Language Models Without Supervision
    2022/12/07 by Collin Burns, Haotian Ye, Burns, Collin +5 · 5 voices · 216 citations
    Computer Science · #Artificial intelligence #Computer science #Consistency (knowledge bases) #Ground truth #Language model #Linguistics #Machine learning #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Natural language processing #Negation #Programming language #Question answering #Space (punctuation) #Statement (logic) #Topic Modeling
96. Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Tasks
    2022/11/22 by Wenhu Chen, Chen, Wenhu, Xueguang Ma +5 · 11 voices · 305 citations
    Computer Science · #Artificial intelligence #Code (set theory) #Computation #Computer science #Consistency (knowledge bases) #Explainable Artificial Intelligence (XAI) #Language model #Online Learning and Analytics #Process (computing) #Programming language #Source code #Theoretical computer science #Topic Modeling #cs.AI #cs.CL
97. Large Language Models Struggle to Learn Long-Tail Knowledge
    2022/11/15 by Nikhil Kandpal, Kandpal, Nikhil, Haikang Deng +7 · 2 voices · 118 citations
    Computer Science · #Artificial intelligence #Code (set theory) #Computer science #Expert finding and Q&A systems #Information retrieval #Language model #Natural Language Processing Techniques #Natural language processing #Question answering #Text corpus #The Internet #Topic Modeling #Training set #World Wide Web
98. Knowledge-in-Context: Towards Knowledgeable Semi-Parametric Language Models
    2022/10/28 by Xiaoman Pan, Pan, Xiaoman, Wenlin Yao +9 · 2 citations
    Computer Science · #Artificial intelligence #Computation and Language (cs.CL) #Computer science #Context (archaeology) #FOS: Computer and information sciences #Language model #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Natural language #Natural language processing #Natural language understanding #Parametric statistics #Topic Modeling
99. Correcting Diverse Factual Errors in Abstractive Summarization via Post-Editing and Language Model Infilling
    2022/10/22 by Vidhisha Balachandran, Balachandran, Vidhisha, Hannaneh Hajishirzi +5 · 4 citations
    Computer Science · #Artificial intelligence #Automatic summarization #Computation and Language (cs.CL) #Computer science #Consistency (knowledge bases) #FOS: Computer and information sciences #Focus (optics) #Heuristic #Heuristics #Information retrieval #Language model #Machine learning #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Natural language processing #Topic Modeling
100. DiffuSeq: Sequence to Sequence Text Generation with Diffusion Models
     2022/10/17 by Shansan Gong, Gong, Shansan, Mukai Li +7 · 112 citations
     Computer Science · Engineering · Mathematics · #Artificial intelligence #Autoregressive model #Code (set theory) #Computation and Language (cs.CL) #Computer science #Diffusion #Econometrics #Engineering #FOS: Computer and information sciences #Generative grammar #Generative model #Language model #Machine Learning (cs.LG) #Mathematics #Music and Audio Processing #Natural Language Processing Techniques #Natural language #Natural language generation #Natural language processing #Programming language #Property (philosophy) #Range (aeronautics) #Sequence (biology) #Topic Modeling
101. Re3: Generating Longer Stories With Recursive Reprompting and Revision
     2022/10/13 by Kevin Yang, Yang, Kevin, Yuandong Tian +5 · 35 citations
     Computer Science · Engineering · Mathematics · Social Sciences · #Artificial Intelligence (cs.AI) #Artificial intelligence #Coherence (philosophical gambling strategy) #Computation and Language (cs.CL) #Computational and Text Analysis Methods #Computer science #Consistency (knowledge bases) #Construct (python library) #Continuation #Engineering #FOS: Computer and information sciences #History #Language model #Linguistics #Mathematics #Narrative #Natural Language Processing Techniques #Natural language processing #Philosophy #Plan (archaeology) #Plot (graphics) #Political science #Premise #Programming language #Range (aeronautics) #Relevance (law) #Statistics #Topic Modeling
102. Learning to Decompose Visual Features with Latent Textual Prompts
     2022/10/09 by Feng Wang, Manling Li, Wang, Feng +9 · 5 citations
     Computer Science · #Artificial intelligence #Computer Vision and Pattern Recognition (cs.CV) #Computer science #Domain Adaptation and Few-Shot Learning #Encoder #FOS: Computer and information sciences #Feature (linguistics) #Feature learning #Inference #Language model #Machine learning #Margin (machine learning) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Natural language processing #Robustness (evolution) #Scalability #Visual language
103. AlphaTuning: Quantization-Aware Parameter-Efficient Adaptation of Large-Scale Pre-Trained Language Models
     2022/10/08 by Se Jung Kwon, Kwon, Se Jung, Jeonghoon Kim +17 · 3 citations
     Computer Science · Engineering · Mathematics · #Advanced Neural Network Applications #Algorithm #Arithmetic #Artificial intelligence #Binary number #Coding (social sciences) #Compression ratio #Computation #Computation and Language (cs.CL) #Computer science #Engineering #FOS: Computer and information sciences #Inference #Language model #Machine Learning (cs.LG) #Mathematics #Quantization (signal processing) #Scaling #Speech Recognition and Synthesis #Topic Modeling
104. Language Models (Mostly) Know What They Know
     2022/07/11 by Saurav Kadavath, Kadavath, Saurav, Tom Conerly +72 · 6 voices · 449 citations
     Computer Science · Mathematics · Psychology · #Artificial intelligence #Calibration #Computer science #Context (archaeology) #Heuristics #Honesty #Language model #Linguistics #Machine learning #Mathematics #Natural Language Processing Techniques #Natural language processing #Psychology #Social psychology #Statistics #Text Readability and Simplification #Topic Modeling #Word (group theory)
105. Exploring Length Generalization in Large Language Models
     2022/07/11 by Cem Anil, Yuhuai Wu, Anil, Cem +17 · 39 citations
     Computer Science · Mathematics · #Artificial intelligence #Computation and Language (cs.CL) #Computer science #FOS: Computer and information sciences #Generalization #Language model #Machine Learning (cs.LG) #Machine learning #Mathematics #Modalities #Natural Language Processing Techniques #Natural language processing #Text Readability and Simplification #Theoretical computer science #Topic Modeling #Transformer
106. Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone
     2022/06/15 by Zi-Yi Dou, Dou, Zi-Yi, Aishwarya Kamath +21 · 7 citations
     Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial intelligence #Closed captioning #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Computer science #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Image (mathematics) #Language model #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural language processing #Phrase #Question answering #Speech recognition #Transformer
107. FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
     2022/05/27 by Tri Dao, Dao, Tri, Daniel Y. Fu +7 · 8 voices · 1176 citations
     Computer Science · #Advanced Neural Network Applications #Algorithm #Artificial intelligence #Computer science #Domain Adaptation and Few-Shot Learning #FLOPS #Language model #Machine Learning and Data Classification #Memory bandwidth #Parallel computing #Perplexity #Speedup #cs.LG
108. Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding
     2022/05/23 by Chitwan Saharia, Saharia, Chitwan, William Chan +26 · 1 voice · 1100 citations
     Computer Science · Social Sciences · #Artificial intelligence #Benchmark (surveying) #Cartography #Computational and Text Analysis Methods #Computer Vision and Pattern Recognition (cs.CV) #Computer science #FOS: Computer and information sciences #Fidelity #Geography #Image (mathematics) #Language model #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural language processing #Topic Modeling #cs.CV #cs.LG
109. Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners
     2022/05/22 by Zhenhailong Wang, Wang, Zhenhailong, Manling Li +23 · 17 citations
     Computer Science · #Artificial Intelligence (cs.AI) #Artificial intelligence #Closed captioning #Computer Vision and Pattern Recognition (cs.CV) #Computer science #Context (archaeology) #Domain Adaptation and Few-Shot Learning #Encoder #Event (particle physics) #FOS: Computer and information sciences #Frame (networking) #Image (mathematics) #Language model #Multimodal Machine Learning Applications #Natural language processing #Object (grammar) #Shot (pellet) #Topic Modeling #Video tracking
110. Training Compute-Optimal Large Language Models
     2022/03/29 by Jordan Hoffmann, Hoffmann, Jordan, Sebastian Borgeaud +41 · 13 voices · 760 citations
     Computer Science · #Artificial intelligence #Computer science #Language model #Machine Learning and Algorithms #Natural Language Processing Techniques #Topic Modeling #Transformer
111. Text-To-Speech Data Augmentation for Low Resource Speech Recognition
     2022/04/01 by Rodolfo Zevallos, Zevallos, Rodolfo · 3 citations
     Computer Science · Engineering · #Agglutinative language #Artificial intelligence #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #Computer science #FOS: Computer and information sciences #FOS: Electrical engineering #Language model #Linguistics #Music and Audio Processing #Natural language processing #Resource (disambiguation) #Sequence (biology) #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #Speech recognition #Speech synthesis #Word (group theory) #Word error rate #cs.CL #cs.SD #eess.AS #electronic engineering #information engineering
112. Word Order Does Matter (And Shuffled Language Models Know It)
     2022/03/21 by Vinit Ravishankar, Mostafa Abdou, Ravishankar, Vinit +5 · 3 citations
     Computer Science · #Artificial intelligence #Computation and Language (cs.CL) #Computer science #ENCODE #FOS: Computer and information sciences #Language model #Linguistics #Natural Language Processing Techniques #Natural language processing #Order (exchange) #Position (finance) #Segmentation #Sentence #Shuffling #Speech Recognition and Synthesis #Text segmentation #Topic Modeling #Variety (cybernetics) #Word (group theory) #Word order #cs.CL
113. Memorizing Transformers
     2022/03/16 by Yuhuai Wu, Wu, Yuhuai, Markus N. Rabe +5 · 2 voices · 31 citations
     Computer Science · Mathematics · #Artificial intelligence #Code (set theory) #Computer science #Differentiable function #Inference #Key (lock) #Language model #Linguistics #Machine Learning and Data Classification #Mathematics #Memorization #Natural Language Processing Techniques #Natural language processing #Programming language #Theoretical computer science #Topic Modeling #Transformer #cs.AI #cs.CL #cs.LG
114. Training language models to follow instructions with human feedback
     2022/03/04 by Long Ouyang, Jeff Wu, Ouyang, Long +38 · 9 voices · 4330 citations
     Computer Science · #Artificial intelligence #Computer science #Explainable Artificial Intelligence (XAI) #Human–computer interaction #Language model #Machine learning #Natural Language Processing Techniques #Natural language processing #Programming language #Range (aeronautics) #Reinforcement learning #Set (abstract data type) #Simple (philosophy) #Topic Modeling #Training set #cs.AI #cs.CL #cs.LG
115. AugESC: Dialogue Augmentation with Large Language Models for Emotional Support Conversation
     2022/02/26 by Chujie Zheng, Sahand Sabour, Zheng, Chujie +5 · 26 citations
     Computer Science · Psychology · #Artificial intelligence #Computation and Language (cs.CL) #Computer science #Conversation #Crowdsourcing #Data science #Domain (mathematical analysis) #FOS: Computer and information sciences #Generalization #Heuristics #Language model #Leverage (statistics) #Linguistics #Mental Health via Writing #Natural language processing #Open domain #Question answering #Speech and dialogue systems #Task (project management) #Topic Modeling #World Wide Web
116. Interpreting Language Models with Contrastive Explanations
     2022/02/21 by Kayo Yin, Graham Neubig, Yin, Kayo +1 · 17 citations
     Computer Science · #Artificial Intelligence (cs.AI) #Artificial intelligence #Computation and Language (cs.CL) #Computer science #Conflation #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Feature (linguistics) #Focus (optics) #Interpretability #Language model #Linguistics #Machine Learning (cs.LG) #Natural Language Processing Techniques #Natural language processing #Salient #Security token #Semantics (computer science) #Syntax #Topic Modeling #cs.AI #cs.CL #cs.LG
117. Probing Linguistic Information For Logical Inference In Pre-trained Language Models
     2021/12/03 by Zeming Chen, Chen, Zeming, Qiyue Gao +1 · 3 citations
     Computer Science · #Artificial Intelligence (cs.AI) #Artificial intelligence #Computation and Language (cs.CL) #Computer science #Deep linguistic processing #ENCODE #FOS: Computer and information sciences #Inference #Language model #Linguistic description #Linguistics #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Natural language #Natural language processing #Natural language understanding #Topic Modeling #cs.AI #cs.CL #cs.LG
118. Hierarchical Transformers Are More Efficient Language Models
     2021/10/26 by Piotr Nawrot, Szymon Tworkowski, Nawrot, Piotr +11 · 4 voices · 31 citations
     Computer Science · Engineering · #Algorithm #Architecture #Artificial intelligence #Computation #Computer science #Electrical engineering #Engineering #Language model #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling #Transformer #Upsampling #Voltage #cs.CL #cs.LG
119. Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation
     2021/08/27 by Ofir Press, Noah A. Smith, Press, Ofir +3 · 3 voices · 265 citations
     Computer Science · Mathematics · #Algorithm #Alibi #Artificial intelligence #Benchmark (surveying) #Computer science #Encoder #Extrapolation #Inference #Language model #Machine Learning and Data Classification #Mathematics #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Pairwise comparison #Perplexity #Position (finance) #Speech recognition #Statistics #Topic Modeling #cs.CL
120. Program Synthesis with Large Language Models
     2021/08/16 by Jacob Austin, Austin, Jacob, Augustus Odena +21 · 1 voice · 1100 citations
     Computer Science · #Artificial intelligence #Benchmark (surveying) #Classifier (UML) #Computer science #Dialog box #Language model #Operating system #Programming language #Python (programming language) #Software Engineering Research #Software Testing and Debugging Techniques #Source code #Topic Modeling #cs.LG #cs.PL

prev more