vix.ing · top · new · best · stats · spec

Quoc V. Le

  1. Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer
    Sparsely-Gated MoE layers increase model capacity by over 1000x with minimal compute loss, improving language modeling and translation.
    2017/01/23 by Noam Shazeer, Azalia Mirhoseini, Shazeer, Noam +13 · 11 voices · 903 citations
    Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #Topic Modeling #cs.CL #cs.LG #cs.NE #stat.ML
  2. Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
    2016/09/26 by Yonghui Wu, Mike Schuster, Wu, Yonghui +62 · 2 voices · 765 citations
    Computer Science · #Natural Language Processing Techniques #Topic Modeling #Multimodal Machine Learning Applications
  3. Distributed Representations of Sentences and Documents
    2014/05/16 by Quoc V. Le, Tomáš Mikolov, Le, Quoc V. +2 · 4 voices · 275 citations
    Computer Science · #Topic Modeling #Sentiment Analysis and Opinion Mining #Natural Language Processing Techniques
  4. BNAI, NO-TOKEN, and MIND-UNITY: Pillars of a Systemic Revolution in Artificial Intelligence
    2022/01/28 by Jason Wei, Xuezhi Wang, Wei, Jason +17 · 18 voices · 3617 citations
    Computer Science · #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling #cs.AI #cs.CL
  5. AutoML-Zero: Evolving Machine Learning Algorithms From Scratch
    2020/03/06 by Esteban Real, Real, Esteban, Chen Liang +6 · 8 voices · 20 citations
    Computer Science · #Data Stream Mining Techniques #Machine Learning and Algorithms #Machine Learning and Data Classification #cs.LG #cs.NE #stat.ML
  6. A Neural Conversational Model
    2015/06/19 by Oriol Vinyals, Quoc V. Le, Vinyals, Oriol +2 · 4 voices · 152 citations
    Computer Science · #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling #cs.CL
  7. EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
    2019/05/28 by Mingxing Tan, Quoc V. Le · 1 voice · 784 citations
    #cs.LG #cs.CV #stat.ML
  8. Neural Architecture Search with Reinforcement Learning
    2016/11/05 by Barret Zoph, Zoph, Barret, Quoc V. Le +1 · 1 voice · 512 citations
    Computer Science · #Machine Learning and Data Classification #Anomaly Detection Techniques and Applications #Neural Networks and Applications
  9. Program Synthesis with Large Language Models
    2021/08/16 by Jacob Austin, Augustus Odena, Austin, Jacob +21 · 1 voice · 926 citations
    Computer Science · #Software Engineering Research #Software Testing and Debugging Techniques #Topic Modeling #cs.LG #cs.PL
  10. XLNet: Generalized Autoregressive Pretraining for Language Understanding
    2019/06/19 by Zhilin Yang, Zihang Dai, Yang, Zhilin +9 · 1 voice · 316 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech Recognition and Synthesis
  11. Long-form factuality in large language models
    2024/03/27 by Jerry Wei, Chengrun Yang, Wei, Jerry +21 · 7 voices · 50 citations
    Computer Science · #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL #cs.LG
  12. Google's Multilingual Neural Machine Translation System: Enabling\n Zero-Shot Translation
    2016/11/14 by Melvin Johnson, Johnson, Melvin, Mike Schuster +23 · 4 voices · 53 citations
    Computer Science · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL
  13. Symbolic Discovery of Optimization Algorithms
    2023/02/13 by Xiangning Chen, Chen, Xiangning, Chen Liang +24 · 3 voices · 100 citations
    Computer Science · #Advanced Neural Network Applications #Machine Learning and Algorithms #Machine Learning and Data Classification #cs.AI #cs.CL #cs.CV #cs.LG #cs.NE
  14. Large Language Models as Optimizers
    2023/09/07 by Chengrun Yang, Xuezhi Wang, Yang, Chengrun +11 · 4 voices · 188 citations
    Computer Science · #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling #cs.AI #cs.CL #cs.LG
  15. Gold-medalist Performance in Solving Olympiad Geometry with AlphaGeometry2
    2025/02/05 by Yuri Chervonyi, Chervonyi, Yuri, Trieu H. Trinh +20 · 18 voices · 49 citations
    Computer Science · Mathematics · #Blockchain Technology in Education and Learning #Edcuational Technology Systems #Mathematics Education and Pedagogy #cs.AI #cs.LG
  16. Searching for Activation Functions
    2017/10/16 by Prajit Ramachandran, Ramachandran, Prajit, Barret Zoph +3 · 3 voices · 43 citations
    Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Domain Adaptation and Few-Shot Learning #cs.CV #cs.LG #cs.NE
  17. Large Language Monkeys: Scaling Inference Compute with Repeated Sampling
    2024/07/31 by Bradley Brown, Brown, Bradley, Jordan Juravsky +11 · 2 voices · 305 citations
    Computer Science · #cs.LG #cs.AI
  18. Efficient Neural Architecture Search via Parameter Sharing
    2018/02/09 by Hieu Pham, Melody Y. Guan, Pham, Hieu +7 · 2 voices · 191 citations
    Computer Science · Mathematics · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Domain Adaptation and Few-Shot Learning #cs.CL #cs.CV #cs.LG #cs.NE #stat.ML
  19. Sequence to Sequence Learning with Neural Networks
    2014/09/10 by Ilya Sutskever, Sutskever, Ilya, Oriol Vinyals +3 · 1226 citations
    Computer Science · #Natural Language Processing Techniques #Topic Modeling #Multimodal Machine Learning Applications
  20. Tacotron: Towards End-to-End Speech Synthesis
    2017/03/29 by Yuxuan Wang, RJ Skerry-Ryan, Wang, Yuxuan +26 · 2 voices · 102 citations
    Computer Science · #cs.CL #cs.LG #cs.SD
  21. Self-Consistency Improves Chain of Thought Reasoning in Language Models
    2022/03/21 by Xuezhi Wang, Wang, Xuezhi, Dale Schuurmans +9 · 1505 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Advanced Graph Neural Networks
  22. Chip Placement with Deep Reinforcement Learning
    2020/04/22 by Azalia Mirhoseini, Mirhoseini, Azalia, Anna Goldie +50 · 4 voices · 14 citations
    Engineering · #3D IC and TSV technologies #Modular Robots and Swarm Intelligence #VLSI and FPGA Design Techniques #cs.AI #cs.LG
  23. SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-training
    2025/01/28 by Tianzhe Chu, Chu, Tianzhe, Yuexiang Zhai +15 · 7 voices · 333 citations
    Computer Science · #Multimodal Machine Learning Applications #Topic Modeling #Domain Adaptation and Few-Shot Learning
  24. Scaling Instruction-Finetuned Language Models
    2022/10/20 by Hyung Won Chung, Le Hou, Chung, Hyung Won +72 · 1 voice · 399 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling #cs.CL #cs.LG
  25. Pay Attention to MLPs
    2021/05/17 by Hanxiao Liu, Liu, Hanxiao, Zihang Dai +5 · 3 voices · 40 citations
    Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Topic Modeling #cs.CL #cs.CV #cs.LG
  26. Exploiting Similarities among Languages for Machine Translation
    2013/09/17 by Tomáš Mikolov, Tomas Mikolov, Mikolov, Tomas +4 · 1 voice · 142 citations
    Computer Science · #cs.CL
  27. Towards a Human-like Open-Domain Chatbot
    2020/01/27 by Daniel Adiwardana, Minh-Thang Luong, Adiwardana, Daniel +19 · 3 voices · 38 citations
    Computer Science · Mathematics · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Neural and Evolutionary Computing (cs.NE) #Topic Modeling #cs.CL #cs.LG #cs.NE #stat.ML
  28. Finetuned Language Models Are Zero-Shot Learners
    2021/09/03 by Jason Wei, Wei, Jason, Maarten Bosma +15 · 559 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
  29. ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
    2020/03/23 by Kevin B. Clark, Kevin Clark, Minh-Thang Luong +6 · 3 voices · 40 citations
    Computer Science · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling #cs.CL
  30. Self-training with Noisy Student improves ImageNet classification
    2019/11/11 by Qizhe Xie, Minh-Thang Luong, Xie, Qizhe +5 · 1 voice · 98 citations
    Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Domain Adaptation and Few-Shot Learning #cs.CV #cs.LG #stat.ML
  31. LaMDA: Language Models for Dialog Applications
    2022/01/20 by Romal Thoppilan, Thoppilan, Romal, Daniel De Freitas +126 · 2 voices · 82 citations
    Computer Science · #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling #cs.AI #cs.CL
  32. Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them
    2022/10/17 by Mirac Süzgün, Nathan Scales, Suzgun, Mirac +18 · 417 citations
    Computer Science · Medicine · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Healthcare and Education #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Topic Modeling
  33. Self-Discover: Large Language Models Self-Compose Reasoning Structures
    2024/02/06 by Pei Zhou, Zhou, Pei, Jay Pujara +19 · 4 voices · 32 citations
    Computer Science · #Topic Modeling #cs.AI #cs.CL
  34. Least-to-Most Prompting Enables Complex Reasoning in Large Language Models
    2022/05/21 by Denny Zhou, Nathanael Schärli, Zhou, Denny +18 · 268 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
  35. RandAugment: Practical automated data augmentation with a reduced search\n space
    2019/09/30 by Ekin D. Cubuk, Cubuk, Ekin D., Barret Zoph +5 · 190 citations
    Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
  36. EfficientDet: Scalable and Efficient Object Detection
    2019/11/20 by Mingxing Tan, Ruoming Pang, Quoc V. Le · 1 voice · 57 citations
    Computer Science · Engineering · #cs.CV #cs.LG #eess.IV
  37. Towards Autonomous Mathematics Research
    2026/02/10 by Tony Feng, Trieu H. Trinh, Garrett Bingham +25 · 19 voices · 2 citations
    #cs.LG #cs.AI #cs.CL #cs.CY
  38. HyperNetworks
    2016/09/27 by David Ha, Andrew Dai, Ha, David +3 · 114 citations
    Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification
  39. GLaM: Efficient Scaling of Language Models with Mixture-of-Experts
    2021/12/13 by Nan Du, Du, Nan, Yanping Huang +51 · 166 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  40. Mixture-of-Experts with Expert Choice Routing
    2022/02/18 by Yanqi Zhou, Tao Lei, Zhou, Yanqi +17 · 137 citations
    Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Stochastic Gradient Optimization Techniques
  41. Neural Combinatorial Optimization with Reinforcement Learning
    2016/11/29 by Irwan Bello, Bello, Irwan, Hieu Pham +7 · 99 citations
    Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Metaheuristic Optimization Algorithms Research
  42. Building high-level features using large scale unsupervised learning
    2011/12/29 by Quoc V. Le, Le, Quoc V., Marc'Aurelio Ranzato +14 · 1 voice · 31 citations
    Computer Science · #Advanced Image and Video Retrieval Techniques #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Face recognition and analysis #Machine Learning (cs.LG) #cs.LG
  43. EfficientDet: Scalable and Efficient Object Detection
    2020/06/01 by Mingxing Tan, Ruoming Pang, Quoc V. Le · 164 citations
    Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning
  44. Evolving Reinforcement Learning Algorithms
    2021/01/08 by John D. Co-Reyes, Yingjie Miao, Co-Reyes, John D. +13 · 3 voices · 4 citations
    Computer Science · #Data Stream Mining Techniques #Evolutionary Algorithms and Applications #Reinforcement Learning in Robotics #cs.AI #cs.LG #cs.NE
  45. Unsupervised Data Augmentation for Consistency Training
    2019/04/29 by Qizhe Xie, Xie, Qizhe, Zihang Dai +7 · 141 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications #Topic Modeling
  46. Self-Training With Noisy Student Improves ImageNet Classification
    2020/06/01 by Qizhe Xie, Minh-Thang Luong, Eduard Hovy +1 · 191 citations
    Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #Machine Learning and Data Classification
  47. Transcending Scaling Laws with 0.1% Extra Compute
    2022/10/20 by Yi Tay, Tay, Yi, Jason Wei +31 · 2 voices · 4 citations
    Computer Science · #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling #cs.AI #cs.CL #cs.LG
  48. Semi-supervised Sequence Learning
    2015/11/04 by Andrew M. Dai, Dai, Andrew M., Quoc V. Le +1 · 103 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Text and Document Classification Technologies
  49. The Evolved Transformer
    2019/01/30 by David R. So, Chen Liang, So, David R. +4 · 1 voice · 46 citations
    Computer Science · Materials Science · Mathematics · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Magnetic Properties and Applications #Neural and Evolutionary Computing (cs.NE) #cs.CL #cs.LG #cs.NE #stat.ML
  50. The Flan Collection: Designing Data and Methods for Effective Instruction Tuning
    2023/01/31 by Shayne Longpre, Longpre, Shayne, Le Hou +18 · 120 citations
    Computer Science · Engineering · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Machine Learning and Data Classification
  51. Listen, Attend and Spell
    2015/08/05 by William Chan, Navdeep Jaitly, Chan, William +5 · 70 citations
    Computer Science · Psychology · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Humor Studies and Applications #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications #Neural and Evolutionary Computing (cs.NE) #Topic Modeling
  52. Don't Decay the Learning Rate, Increase the Batch Size
    2017/11/01 by Samuel Smith, Smith, Samuel L., Pieter-Jan Kindermans +5 · 90 citations
    Computer Science · #Advanced Neural Network Applications #Stochastic Gradient Optimization Techniques #Adversarial Robustness in Machine Learning
  53. MixConv: Mixed Depthwise Convolutional Kernels
    2019/07/22 by Mingxing Tan, Quoc V. Le · 1 voice · 8 citations
    #cs.CV #cs.LG
  54. DropBlock: A regularization method for convolutional networks
    2018/10/30 by Golnaz Ghiasi, Ghiasi, Golnaz, Tsung-Yi Lin +3 · 116 citations
    Computer Science · Medicine · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #Retinal Imaging and Analysis
  55. Large-Scale Evolution of Image Classifiers
    2017/03/03 by Esteban Real, Sherry Moore, Real, Esteban +13 · 76 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Distributed #Evolutionary Algorithms and Applications #FOS: Computer and information sciences #I.2.6 #I.5.1 #I.5.2 #Metaheuristic Optimization Algorithms Research #Neural and Evolutionary Computing (cs.NE) #Parallel #Reinforcement Learning in Robotics #and Cluster Computing (cs.DC)
  56. AutoAugment: Learning Augmentation Policies from Data
    2018/05/24 by Ekin D. Cubuk, Cubuk, Ekin D., Barret Zoph +7 · 75 citations
    Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification
  57. FreshLLMs: Refreshing Large Language Models with Search Engine Augmentation
    2023/10/05 by Tu Vu, Mohit Iyyer, Vu, Tu +20 · 3 voices · 63 citations
    Computer Science · #Expert finding and Q&A systems #Natural Language Processing Techniques #Topic Modeling #cs.CL
  58. DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretraining
    2023/05/17 by Sang Michael Xie, Xie, Sang Michael, Hieu Pham +17 · 88 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
  59. Simple Copy-Paste is a Strong Data Augmentation Method for Instance\n Segmentation
    2020/12/13 by Golnaz Ghiasi, Ghiasi, Golnaz, Yin Cui +13 · 53 citations
    Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Medical Image Segmentation Techniques
  60. Adding Gradient Noise Improves Learning for Very Deep Networks
    2015/11/21 by Arvind Neelakantan, Neelakantan, Arvind, Luke Vilnis +11 · 55 citations
    Computer Science · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications #Topic Modeling
  61. Rethinking Pre-training and Self-training
    2020/06/11 by Barret Zoph, Golnaz Ghiasi, Zoph, Barret +11 · 1 voice · 22 citations
    Computer Science · Mathematics · Psychology · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Resource Development and Performance Evaluation #Machine Learning (cs.LG) #Machine Learning (stat.ML) #cs.CV #cs.LG #stat.ML
  62. Simple synthetic data reduces sycophancy in large language models
    2023/08/07 by Jerry Wei, Da Huang, Wei, Jerry +7 · 1 voice · 25 citations
    Computer Science · #Hate Speech and Cyberbullying Detection #Multimodal Machine Learning Applications #Topic Modeling #cs.CL
  63. CoAtNet: Marrying Convolution and Attention for All Data Sizes
    2021/06/09 by Zihang Dai, Dai, Zihang, Hanxiao Liu +5 · 55 citations
    Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #Generative Adversarial Networks and Image Synthesis
  64. A Simple Method for Commonsense Reasoning
    2018/06/07 by Trieu H. Trinh, Quoc V. Le, Trinh, Trieu H. +1 · 61 citations
    Computer Science · #Natural Language Processing Techniques #Topic Modeling #Multimodal Machine Learning Applications
  65. The Carbon Footprint of Machine Learning Training Will Plateau, Then Shrink
    2022/04/11 by David A. Patterson, Joseph E. Gonzalez, Patterson, David +17 · 47 citations
    Engineering · Environmental Science · #Air Quality Monitoring and Forecasting #Artificial Intelligence (cs.AI) #Environmental Impact and Sustainability #FOS: Computer and information sciences #General Literature (cs.GL) #Green IT and Sustainability #Machine Learning (cs.LG)
  66. Take a Step Back: Evoking Reasoning via Abstraction in Large Language Models
    2023/10/09 by Huaixiu Zheng, Swaroop Mishra, Zheng, Huaixiu Steven +11 · 2 voices · 44 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques
  67. A Bayesian Perspective on Generalization and Stochastic Gradient Descent
    2017/10/17 by Samuel Smith, Smith, Samuel L., Quoc V. Le +1 · 29 citations
    Computer Science · #Stochastic Gradient Optimization Techniques #Machine Learning and Algorithms #Domain Adaptation and Few-Shot Learning
  68. Evolving Normalization-Activation Layers
    2020/04/06 by Hanxiao Liu, Liu, Hanxiao, Andrew Brock +5 · 2 voices · 7 citations
    Computer Science · Mathematics · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications #cs.CV #cs.LG #cs.NE #stat.ML
  69. NAS-FPN: Learning Scalable Feature Pyramid Architecture for Object\n Detection
    2019/04/15 by Golnaz Ghiasi, Tsung-Yi Lin, Ghiasi, Golnaz +5 · 19 citations
    Computer Science · Medicine · #Advanced Neural Network Applications #COVID-19 diagnosis using AI #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Video Surveillance and Tracking Methods
  70. Device Placement Optimization with Reinforcement Learning
    2017/06/13 by Azalia Mirhoseini, Hieu Pham, Mirhoseini, Azalia +17 · 24 citations
    Computer Science · Engineering · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Industrial Vision Systems and Defect Detection #Machine Learning (cs.LG) #Modular Robots and Swarm Intelligence #Reinforcement Learning in Robotics
  71. DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detection
    2022/03/15 by Yingwei Li, Li, Yingwei, Adams Wei Yu +23 · 24 citations
    Computer Science · Engineering · Physics and Astronomy · #Advanced Neural Network Applications #Advanced Optical Sensing Technologies #Autonomous Vehicle Technology and Safety #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
  72. Michelangelo: Long Context Evaluations Beyond Haystacks via Latent Structure Queries
    2024/09/19 by Kiran Vodrahalli, Santiago Ontanon, Santiago Ontañón +48 · 2 voices · 16 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Image Retrieval and Classification Techniques #Machine Learning (cs.LG) #Natural Language Processing Techniques #Semantic Web and Ontologies #cs.CL #cs.LG
  73. Neural Optimizer Search with Reinforcement Learning
    2017/09/21 by Irwan Bello, Bello, Irwan, Barret Zoph +5 · 28 citations
    Computer Science · #Advanced Neural Network Applications #Machine Learning and Algorithms #Adversarial Robustness in Machine Learning
  74. NATURAL PLAN: Benchmarking LLMs on Natural Language Planning
    2024/06/06 by Huaixiu Zheng, Zheng, Huaixiu Steven, Swaroop Mishra +19 · 42 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques
  75. Noise2Music: Text-conditioned Music Generation with Diffusion Models
    2023/02/08 by Qingqing Huang, Daniel Park, Huang, Qingqing +25 · 26 citations
    Computer Science · #Music and Audio Processing #Music Technology and Sound Studies #Speech Recognition and Synthesis
  76. Primer: Searching for Efficient Transformers for Language Modeling
    2021/09/17 by David R. So, Wojciech Mańke, So, David R. +9 · 20 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech Recognition and Synthesis
  77. Transformer Quality in Linear Time
    2022/02/21 by Weizhe Hua, Zihang Dai, Hua, Weizhe +5 · 18 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Neural and Evolutionary Computing (cs.NE) #Topic Modeling
  78. Funnel-Transformer: Filtering out Sequential Redundancy for Efficient Language Processing
    2020/06/05 by Zihang Dai, Dai, Zihang, Guokun Lai +5 · 14 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Text Readability and Simplification
  79. Adversarial Examples Improve Image Recognition
    2019/11/21 by Cihang Xie, Xie, Cihang, Mingxing Tan +9 · 14 citations
    Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
  80. Fastfood: Approximate Kernel Expansions in Loglinear Time
    2014/08/13 by Quoc V. Le, Tamás Sarlós, Le, Quoc Viet +3 · 9 citations
    Computer Science · Mathematics · #FOS: Computer and information sciences #Face and Expression Recognition #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification #Tensor decomposition and applications
  81. Combined Scaling for Zero-shot Transfer Learning
    2021/11/19 by Hieu Pham, Pham, Hieu, Zihang Dai +17 · 14 citations
    Computer Science · #Advanced Neural Network Applications #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG)
  82. Backprop Evolution
    2018/08/08 by Maximilian Alber, Irwan Bello, Alber, Maximilian +10 · 3 voices
    Computer Science · Mathematics · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Metaheuristic Optimization Algorithms Research #Neural and Evolutionary Computing (cs.NE) #cs.LG #cs.NE #stat.ML
  83. BIG-Bench Extra Hard
    2025/02/26 by Mehran Kazemi, Bahare Fatemi, Kazemi, Mehran +37 · 45 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  84. Selfie: Self-supervised Pretraining for Image Embedding
    2019/06/07 by Trieu H. Trinh, Trinh, Trieu H., Minh-Thang Luong +3 · 20 citations
    Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Advanced Neural Network Applications
  85. Symbol tuning improves in-context learning in language models
    2023/05/15 by Jerry Wei, Le Hou, Wei, Jerry +19 · 14 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
  86. High Fidelity Video Prediction with Large Stochastic Recurrent Neural Networks
    2019/11/05 by Ruben Villegas, Villegas, Ruben, Arkanath Pathak +9 · 12 citations
    Computer Science · #Advanced Image Processing Techniques #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Image and Signal Denoising Methods #Image and Video Quality Assessment #Video Surveillance and Tracking Methods
  87. Smooth Adversarial Training
    2020/06/25 by Cihang Xie, Mingxing Tan, Xie, Cihang +7 · 18 citations
    Biochemistry, Genetics and Molecular Biology · Computer Science · #Adversarial Robustness in Machine Learning #Anomaly Detection Techniques and Applications #Bacillus and Francisella bacterial research #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural and Evolutionary Computing (cs.NE)
  88. BigNAS: Scaling Up Neural Architecture Search with Big Single-Stage Models
    2020/03/24 by Jiahui Yu, Yu, Jiahui, Pengchong Jin +17 · 16 citations
    Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning and Data Classification
  89. Inverse scaling can become U-shaped
    2022/11/03 by Wei, Jason, Kim, Najoung, Yi Tay +3 · 11 citations
    Computer Science · #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Software Engineering Research #Topic Modeling
  90. SpecAugment on Large Scale Datasets
    2019/12/11 by Daniel Park, Park, Daniel S., Yu Zhang +13 · 9 citations
    Computer Science · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
  91. Multi-task Sequence to Sequence Learning
    2015/11/19 by Minh-Thang Luong, Luong, Minh-Thang, Quoc V. Le +7 · 8 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  92. The Carbon Footprint of Machine Learning Training Will Plateau, Then Shrink
    2022/06/28 by David Patterson, David S. Patterson, Joseph E. Gonzalez +13 · 15 citations
    Computer Science · #Explainable Artificial Intelligence (XAI)
  93. Learning Longer-term Dependencies in RNNs with Auxiliary Losses
    2018/03/01 by Trieu H. Trinh, Trinh, Trieu H., Andrew M. Dai +5 · 7 citations
    Computer Science · #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Topic Modeling
  94. HaloQuest: A Visual Hallucination Dataset for Advancing Multimodal Reasoning
    2024/07/22 by Zhecan Wang, Garrett Bingham, Wang, Zhecan +9 · 13 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Data Visualization and Analytics #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimedia (cs.MM)
  95. Neural Programmer: Inducing Latent Programs with Gradient Descent
    2015/11/16 by Arvind Neelakantan, Neelakantan, Arvind, Quoc V. Le +3 · 6 citations
    Computer Science · #Advanced Neural Network Applications #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Multimodal Machine Learning Applications
  96. Towards Domain-Agnostic Contrastive Learning
    2020/11/09 by Vikas Verma, Minh-Thang Luong, Verma, Vikas +7 · 6 citations
    Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Geophysical Methods and Applications #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications
  97. Aletheia tackles FirstProof autonomously
    2026/02/24 by Tony Feng, Junehyuk Jung, Sang-hyun Kim +14 · 5 voices · 1 citation
    #cs.AI #cs.CL #cs.LG
  98. EVOLvE: Evaluating and Optimizing LLMs For In-Context Exploration
    2024/10/08 by Allen Nie, Nie, Allen, Yi Su +13 · 1 voice · 11 citations
    Computer Science · Engineering · #Distributed and Parallel Computing Systems #Reservoir Engineering and Simulation Methods #cs.AI #cs.CL #cs.LG
  99. AutoDropout: Learning Dropout Patterns to Regularize Deep Networks
    2021/01/05 by Hieu Pham, Pham, Hieu, Quoc V. Le +1 · 1 voice · 1 citation
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #cs.AI #cs.CL #cs.CV #cs.LG
  100. Rationale-Augmented Ensembles in Language Models
    2022/07/02 by Xuezhi Wang, Wang, Xuezhi, Dale Schuurmans +8 · 5 citations
    Computer Science · #Topic Modeling #Explainable Artificial Intelligence (XAI) #Advanced Text Analysis Techniques
  101. Scalable Reinforcement Post-Training Beyond Static Human Prompts: Evolving Alignment via Asymmetric Self-Play
    2024/10/31 by Ziyu Ye, Ye, Ziyu, Tianqi Liu +11 · 10 citations
    Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Data Analysis #Evolutionary Algorithms and Applications #FOS: Computer and information sciences #FOS: Physical sciences #Machine Learning (stat.ML) #Modular Robots and Swarm Intelligence #Reinforcement Learning in Robotics #Statistics and Probability (physics.data-an)
  102. Brainformers: Trading Simplicity for Efficiency
    2023/05/29 by Yanqi Zhou, Nan Du, Zhou, Yanqi +26 · 5 citations
    Computer Science · #Advanced Neural Network Applications #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Topic Modeling
  103. Latent Sequence Decompositions
    2016/10/10 by William Chan, Yu Zhang, Chan, William +5 · 5 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Music and Audio Processing #Natural Language Processing Techniques #Speech Recognition and Synthesis
  104. Unsupervised Pretraining for Sequence to Sequence Learning
    2016/11/08 by Prajit Ramachandran, Peter J. Liu, Ramachandran, Prajit +3 · 4 citations
    Computer Science · Biochemistry, Genetics and Molecular Biology · #Natural Language Processing Techniques #Topic Modeling #Genomics and Phylogenetic Studies
  105. GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism
    2018/11/16 by Yanping Huang, Huang, Yanping, Youlong Cheng +19 · 4 citations
    Biochemistry, Genetics and Molecular Biology · Computer Science · #Advanced Neural Network Applications #Cell Image Analysis Techniques #Computer Vision and Pattern Recognition (cs.CV) #Digital Imaging for Blood Diseases #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
  106. Saccader: Improving Accuracy of Hard Attention Models for Vision
    2019/08/20 by Gamaleldin F. Elsayed, Simon Kornblith, Elsayed, Gamaleldin F. +3 · 2 citations
    Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications
  107. MnasFPN: Learning Latency-aware Pyramid Architecture for Object Detection on Mobile Devices
    2019/12/02 by Bo Chen, Chen, Bo, Golnaz Ghiasi +11 · 3 citations
    Computer Science · #Advanced Neural Network Applications #IoT and Edge/Fog Computing #Advanced Image and Video Retrieval Techniques
  108. Searching for Fast Model Families on Datacenter Accelerators
    2021/02/10 by Sheng Li, Mingxing Tan, Li, Sheng +11 · 2 citations
    Computer Science · Neuroscience · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Brain Tumor Detection and Classification #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Image and Video Processing (eess.IV) #electronic engineering #information engineering
  109. Pre-Training Transformers as Energy-Based Cloze Models
    2020/12/15 by Kevin B. Clark, Minh-Thang Luong, Clark, Kevin +5 · 2 citations
    Computer Science · #Topic Modeling #Speech Recognition and Synthesis #Natural Language Processing Techniques
  110. STraTA: Self-Training with Task Augmentation for Better Few-shot Learning
    2021/09/13 by Tu Vu, Minh-Thang Luong, Vu, Tu +7 · 2 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  111. Training EfficientNets at Supercomputer Scale: 83% ImageNet Top-1\n Accuracy in One Hour
    2020/10/30 by Arissa Wongpanich, Wongpanich, Arissa, Hieu Pham +12 · 1 voice
    Computer Science · Medicine · Neuroscience · #Advanced Neural Network Applications #Brain Tumor Detection and Classification #COVID-19 diagnosis using AI #cs.CV #cs.DC #cs.LG
  112. Using Videos to Evaluate Image Model Robustness
    2019/04/22 by Keren Gu, Gu, Keren, Brandon Yang +7 · 4 citations
    Biochemistry, Genetics and Molecular Biology · Computer Science · #Adversarial Robustness in Machine Learning #Cell Image Analysis Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG)
  113. Intriguing Properties of Adversarial Examples
    2017/11/08 by Ekin D. Cubuk, Cubuk, Ekin D., Barret Zoph +5 · 3 citations
    Computer Science · #Adversarial Robustness in Machine Learning #Anomaly Detection Techniques and Applications #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  114. Towards Robust Mathematical Reasoning
    2025/11/03 by Thang M. Luong, Luong, Thang, Hwang, Dawsen +35 · 11 citations
    Computer Science · Materials Science · Social Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning in Materials Science #Mathematics Education and Teaching Techniques #Mathematics, Computing, and Information Processing
  115. Go Wide, Then Narrow: Efficient Training of Deep Thin Networks
    2020/07/01 by Denny Zhou, Zhou, Denny, Mao Ye +15 · 2 citations
    Computer Science · Neuroscience · #Brain Tumor Detection and Classification #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and ELM #Stochastic Gradient Optimization Techniques
  116. QANet: Combining Local Convolution with Global Self-Attention for Reading Comprehension
    2018/04/23 by Adams Wei Yu, Yu, Adams Wei, D. Dohan +12 · 2 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
  117. SpineNet: Learning Scale-Permuted Backbone for Recognition and Localization
    2019/12/10 by Xianzhi Du, Tsung-Yi Lin, Du, Xianzhi +13 · 4 citations
    Computer Science · Medicine · #Advanced Neural Network Applications #COVID-19 diagnosis using AI #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #FOS: Electrical engineering #Image and Video Processing (eess.IV) #Machine Learning (cs.LG) #electronic engineering #information engineering
  118. Can Deep Reinforcement Learning Solve Erdos-Selfridge-Spencer Games?
    2017/11/07 by Maithra Raghu, Raghu, Maithra, Alex Irpan +9 · 2 citations
    Computer Science · Decision Sciences · Social Sciences · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Games #Digital Games and Media #FOS: Computer and information sciences #Game Theory and Applications #Machine Learning (stat.ML) #Neural and Evolutionary Computing (cs.NE)
  119. EfficientNetV2: Smaller Models and Faster Training
    2021/04/01 by Mingxing Tan, Quoc V. Le · 1 voice
    Computer Science · #cs.CV
  120. FLIQS: One-Shot Mixed-Precision Floating-Point and Integer Quantization Search
    2023/08/07 by Jordan Dotzel, Gang Wu, Dotzel, Jordan +21 · 1 citation
    Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG)