61. Large Language Models are Few-Shot Health Learners
    2023/05/24 by Xin Liu, Liu, Xin, Daniel McDuff +21 · 1 voice · 28 citations
    Computer Science · Psychology · #Artificial intelligence #Cognitive psychology #Computer science #Data science #Domain (mathematical analysis) #Human–computer interaction #Language model #Machine Learning in Healthcare #Machine learning #Natural language processing #Psychology #Shot (pellet) #Topic Modeling #Wearable computer #Wearable technology #cs.CL #cs.LG
62. LIMA: Less Is More for Alignment
    2023/05/18 by Chunting Zhou, Zhou, Chunting, Pengfei Liu +27 · 6 voices · 219 citations
    Computer Science · Mathematics · Psychology · #Artificial intelligence #Computer science #Data mining #Language model #Machine learning #Mathematics #Measure (data warehouse) #Natural Language Processing Techniques #Natural language processing #Preference #Psychology #Quality (philosophy) #Range (aeronautics) #Raw data #Reinforcement #Reinforcement learning #Scale (ratio) #Social psychology #Speech Recognition and Synthesis #Statistic #Statistics #Topic Modeling #cs.AI #cs.CL #cs.LG
63. Tree of Thoughts: Deliberate Problem Solving with Large Language Models
    2023/05/17 by Shunyu Yao, Yao, Shunyu, Dian Yu +11 · 8 voices · 1168 citations
    Computer Science · Mathematics · Psychology · #Action (physics) #Artificial intelligence #Backtracking #Code (set theory) #Cognitive science #Computer science #Computer security #Inference #Language model #Mathematics #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Programming language #Psychology #Range (aeronautics) #Security token #Theoretical computer science #Topic Modeling #Tree (set theory)
64. Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes
    2023/05/03 by Cheng-Yu Hsieh, Chun-Liang Li, Chunliang Li +18 · 5 voices · 190 citations
    Computer Science · #Artificial intelligence #Benchmark (surveying) #Code (set theory) #Computer science #Distillation #Language model #Machine learning #Natural Language Processing Techniques #Programming language #Task (project management) #Text Readability and Simplification #Topic Modeling #Training set #cs.AI #cs.CL #cs.LG
65. BloombergGPT: A Large Language Model for Finance
    2023/03/30 by Shijie Wu, Ozan Irsoy, Ozan İrsoy +16 · 2 voices · 254 citations
    Computer Science · Decision Sciences · #Artificial intelligence #Business #Computer science #Computer security #Construct (python library) #Data science #Domain (mathematical analysis) #Finance #Financial modeling #Financial services #Language model #Machine learning #Natural Language Processing Techniques #Natural language processing #Process (computing) #Programming language #Realm #Security token #Stock Market Forecasting Methods #Topic Modeling #Variety (cybernetics)
66. Reflexion: Language Agents with Verbal Reinforcement Learning
    2023/03/20 by Noah Shinn, Federico Cassano, Shinn, Noah +9 · 7 voices · 1189 citations
    Computer Science · #Artificial intelligence #Benchmark (surveying) #Coding (social sciences) #Compiler #Computer science #Explainable Artificial Intelligence (XAI) #Language model #Programming language #Reinforcement Learning in Robotics #Reinforcement learning #Topic Modeling
67. Can AI-Generated Text be Reliably Detected?
    2023/03/17 by Vinu Sankar Sadasivan, Aounon Kumar, Sadasivan, Vinu Sankar +7 · 5 voices · 72 citations
    Computer Science · #Adversarial Robustness in Machine Learning #Artificial intelligence #Authorship Attribution and Profiling #Computer science #Detector #Digital watermarking #Image (mathematics) #Information retrieval #Language model #Machine learning #Natural language processing #Perplexity #Topic Modeling #cs.AI #cs.CL #cs.LG
68. Language Is Not All You Need: Aligning Perception with Language Models
    2023/02/27 by Shaohan Huang, Li Dong, Dong Li +35 · 1 voice · 82 citations
    Computer Science · #Artificial intelligence #Closed captioning #Computer science #Image (mathematics) #Language model #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Natural language processing #Perception #Topic Modeling
69. Toolformer: Language Models Can Teach Themselves to Use Tools
    2023/02/09 by Timo Schick, Jane Dwivedi-Yu, Schick, Timo +15 · 7 voices · 1137 citations
    Computer Science · #Artificial intelligence #Calculator #Computer science #Data mining #Language model #Natural Language Processing Techniques #Natural language processing #Programming language #Range (aeronautics) #Scale (ratio) #Security token #Simple (philosophy) #Table (database) #Topic Modeling #Variety (cybernetics)
70. Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers
    2023/01/05 by Chengyi Wang, Sanyuan Chen, Wang, Chengyi +23 · 1 voice · 265 citations
    Computer Science · Engineering · #Audio and Speech Processing (eess.AS) #Code-excited linear prediction #Codec #Codec2 #Computation and Language (cs.CL) #Computer science #Context (archaeology) #FOS: Computer and information sciences #FOS: Electrical engineering #Language model #Linear predictive coding #Natural language processing #Naturalness #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and dialogue systems #Speech coding #Speech recognition #Speech synthesis #Task (project management) #Topic Modeling #cs.CL #cs.SD #eess.AS #electronic engineering #information engineering
71. SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot
    2023/01/02 by Elias Frantar, Dan Alistarh, Frantar, Elias +1 · 3 voices · 314 citations
    Computer Science · Engineering · #Advanced Data Storage Technologies #Algorithm #Artificial intelligence #Code (set theory) #Computer science #Ferroelectric and Negative Capacitance Devices #Generative grammar #Generative model #Inference #Language model #Machine learning #One shot #Perplexity #Programming language #Pruning #Quantization (signal processing) #Source code #Topic Modeling #Transformer #cs.LG
72. Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Tasks
    2022/11/22 by Wenhu Chen, Chen, Wenhu, Xueguang Ma +5 · 11 voices · 300 citations
    Computer Science · #Artificial intelligence #Code (set theory) #Computation #Computer science #Consistency (knowledge bases) #Explainable Artificial Intelligence (XAI) #Language model #Online Learning and Analytics #Process (computing) #Programming language #Source code #Theoretical computer science #Topic Modeling #cs.AI #cs.CL
73. DiffuSeq: Sequence to Sequence Text Generation with Diffusion Models
    2022/10/17 by Shansan Gong, Mukai Li, Gong, Shansan +7 · 110 citations
    Computer Science · Engineering · Mathematics · #Artificial intelligence #Autoregressive model #Code (set theory) #Computation and Language (cs.CL) #Computer science #Diffusion #Econometrics #Engineering #FOS: Computer and information sciences #Generative grammar #Generative model #Language model #Machine Learning (cs.LG) #Mathematics #Music and Audio Processing #Natural Language Processing Techniques #Natural language #Natural language generation #Natural language processing #Programming language #Property (philosophy) #Range (aeronautics) #Sequence (biology) #Topic Modeling
74. Language Models (Mostly) Know What They Know
    2022/07/11 by Saurav Kadavath, Tom Conerly, Kadavath, Saurav +72 · 6 voices · 447 citations
    Computer Science · Mathematics · Psychology · #Artificial intelligence #Calibration #Computer science #Context (archaeology) #Heuristics #Honesty #Language model #Linguistics #Machine learning #Mathematics #Natural Language Processing Techniques #Natural language processing #Psychology #Social psychology #Statistics #Text Readability and Simplification #Topic Modeling #Word (group theory)
75. FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
    2022/05/27 by Tri Dao, Daniel Y. Fu, Dao, Tri +7 · 8 voices · 1164 citations
    Computer Science · #Advanced Neural Network Applications #Algorithm #Artificial intelligence #Computer science #Domain Adaptation and Few-Shot Learning #FLOPS #Language model #Machine Learning and Data Classification #Memory bandwidth #Parallel computing #Perplexity #Speedup #cs.LG
76. Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding
    2022/05/23 by Chitwan Saharia, William Chan, Saharia, Chitwan +26 · 1 voice · 1079 citations
    Computer Science · Social Sciences · #Artificial intelligence #Benchmark (surveying) #Cartography #Computational and Text Analysis Methods #Computer Vision and Pattern Recognition (cs.CV) #Computer science #FOS: Computer and information sciences #Fidelity #Geography #Image (mathematics) #Language model #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural language processing #Topic Modeling #cs.CV #cs.LG
77. Training Compute-Optimal Large Language Models
    2022/03/29 by Jordan Hoffmann, Sebastian Borgeaud, Hoffmann, Jordan +41 · 13 voices · 758 citations
    Computer Science · #Artificial intelligence #Computer science #Language model #Machine Learning and Algorithms #Natural Language Processing Techniques #Topic Modeling #Transformer
78. Memorizing Transformers
    2022/03/16 by Yuhuai Wu, Markus N. Rabe, Wu, Yuhuai +5 · 2 voices · 31 citations
    Computer Science · Mathematics · #Artificial intelligence #Code (set theory) #Computer science #Differentiable function #Inference #Key (lock) #Language model #Linguistics #Machine Learning and Data Classification #Mathematics #Memorization #Natural Language Processing Techniques #Natural language processing #Programming language #Theoretical computer science #Topic Modeling #Transformer #cs.AI #cs.CL #cs.LG
79. Compressing Sentence Representation for Semantic Retrieval via Homomorphic Projective Distillation
    2022/03/15 by Xuandong Zhao, Zhiguo Yu, Zhao, Xuandong +5 · 2 citations
    Computer Science · #Artificial intelligence #Computation and Language (cs.CL) #Computer science #Encoder #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Language model #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Natural language processing #Representation (politics) #Semantic role labeling #Semantic similarity #Sentence #Topic Modeling #Transformer #cs.CL #cs.IR
80. Training language models to follow instructions with human feedback
    2022/03/04 by Long Ouyang, Ouyang, Long, Jeff Wu +38 · 9 voices · 4281 citations
    Computer Science · #Artificial intelligence #Computer science #Explainable Artificial Intelligence (XAI) #Human–computer interaction #Language model #Machine learning #Natural Language Processing Techniques #Natural language processing #Programming language #Range (aeronautics) #Reinforcement learning #Set (abstract data type) #Simple (philosophy) #Topic Modeling #Training set #cs.AI #cs.CL #cs.LG
81. Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation
    2021/08/27 by Ofir Press, Press, Ofir, Noah A. Smith +3 · 3 voices · 263 citations
    Computer Science · Mathematics · #Algorithm #Alibi #Artificial intelligence #Benchmark (surveying) #Computer science #Encoder #Extrapolation #Inference #Language model #Machine Learning and Data Classification #Mathematics #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Pairwise comparison #Perplexity #Position (finance) #Speech recognition #Statistics #Topic Modeling
82. Program Synthesis with Large Language Models
    2021/08/16 by Jacob Austin, Augustus Odena, Austin, Jacob +21 · 1 voice · 1088 citations
    Computer Science · #Artificial intelligence #Benchmark (surveying) #Classifier (UML) #Computer science #Dialog box #Language model #Operating system #Programming language #Python (programming language) #Software Engineering Research #Software Testing and Debugging Techniques #Source code #Topic Modeling #cs.LG #cs.PL
83. ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Information
    2021/06/30 by Zijun Sun, Sun, Zijun, Xiaoya Li +14 · 7 citations
    Computer Science · #Artificial intelligence #Character (mathematics) #Chinese characters #Chinese speech synthesis #Computer science #Glyph (data visualization) #Language model #Linguistics #Natural Language Processing Techniques #Natural language processing #Pinyin #Pronunciation #Sentence #Speech recognition #Speech synthesis #Syntax #Text Readability and Simplification #Topic Modeling #Visualization #cs.CL
84. LoRA: Low-Rank Adaptation of Large Language Models
    2021/06/17 by J. Edward Hu, Edward J. Hu, Yelong Shen +14 · 10 voices · 3685 citations
    Computer Science · #Adaptation (eye) #Artificial intelligence #Computer science #Implementation #Inference #Language model #Latency (audio) #Natural Language Processing Techniques #Parallel computing #Programming language #Rank (graph theory) #Speech Recognition and Synthesis #Topic Modeling #Transformer #Voltage #cs.AI #cs.CL #cs.LG
85. On the Importance of Effectively Adapting Pretrained Language Models for Active Learning
    2021/04/16 by Katerina Margatina, Margatina, Katerina, Loïc Barrault +4 · 4 citations
    Computer Science · Engineering · #Active learning (machine learning) #Artificial intelligence #Computation and Language (cs.CL) #Computer science #Engineering #FOS: Computer and information sciences #Labeled data #Language model #Machine Learning and Algorithms #Machine learning #Natural Language Processing Techniques #Simple (philosophy) #Task (project management) #Topic Modeling #Training set #cs.CL
86. Kaleido-BERT: Vision-Language Pre-training on Fashion Domain
    2021/03/30 by Mingchen Zhuge, Zhuge, Mingchen, Dehong Gao +13 · 5 citations
    Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial intelligence #Camouflage #Closed captioning #Computer science #Focus (optics) #Generative Adversarial Networks and Image Synthesis #Image (mathematics) #Language model #Masking (illustration) #Multimodal Machine Learning Applications #Natural language processing #Transformer #cs.CV
87. TextGNN: Improving Text Encoder via Graph Neural Network in Sponsored Search
    2021/01/31 by Jason Yue Zhu, Jason Zhu, Yanling Cui +8 · 1 citation
    Computer Science · #Encoder #Graph #Interoperability #Language model #Latency (audio) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Natural language #Natural language understanding #Topic Modeling #Transformer #cs.CL #cs.LG
88. Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity
    2021/01/11 by William Fedus, Fedus, William, Barret Zoph +3 · 9 voices · 800 citations
    Computer Science · #Artificial intelligence #Computer engineering #Computer science #Domain Adaptation and Few-Shot Learning #Electrical engineering #Language model #Machine learning #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Parallel computing #Reuse #Scaling #Speedup #Topic Modeling #Transformer #cs.AI #cs.LG
89. Synthetic Data Augmentation for Zero-Shot Cross-Lingual Question\n Answering
    2020/10/23 by Arij Riabi, Thomas Scialom, Riabi, Arij +9 · 4 citations
    Computer Science · #Algorithm #Artificial intelligence #Computer science #Data collection #Deep learning #Information retrieval #Labeled data #Language model #Linguistics #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Natural language processing #One shot #Question answering #Shot (pellet) #State (computer science) #Task (project management) #Topic Modeling #Training set #Zero (linguistics) #cs.CL
90. Efficient Transformer-based Large Scale Language Representations using Hardware-friendly Block Structured Pruning
    2020/09/17 by Bingbing Li, Li, Bingbing, Zhenglun Kong +11 · 2 citations
    Computer Science · Mathematics · #Algorithm #Artificial Intelligence (cs.AI) #Artificial intelligence #Benchmark (surveying) #Block (permutation group theory) #Computation #Computation and Language (cs.CL) #Computer engineering #Computer science #Edge device #Enhanced Data Rates for GSM Evolution #FOS: Computer and information sciences #Language model #Machine Learning (cs.LG) #Machine learning #Mathematics #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Natural language processing #Parallel computing #Pruning #Topic Modeling #Transformer #Voltage #cs.AI #cs.CL #cs.LG

prev more