Joshua Ainslie
- Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
2025/07/07 by Gheorghe Comanici, Eric Bieber, Comanici, Gheorghe +6844 · 8 voices · 1362 citations
#cs.CL #cs.AI
- Big Bird: Transformers for Longer Sequences
2020/07/28 by Manzil Zaheer, Guru Guruganesh, Avinava Dubey +8 · 4 voices · 58 citations
Computer Science · Mathematics · #cs.LG #cs.CL #stat.ML
- FNet: Mixing Tokens with Fourier Transforms
2021/05/09 by James Lee-Thorp, Joshua Ainslie, Lee-Thorp, James +6 · 4 voices · 33 citations
Computer Science · Engineering · #Topic Modeling #Ferroelectric and Negative Capacitance Devices #Generative Adversarial Networks and Image Synthesis
- CoLT5: Faster Long-Range Transformers with Conditional Computation
2023/03/17 by Joshua Ainslie, Ainslie, Joshua, Tao Lei +21 · 3 voices · 9 citations
Computer Science · #Handwritten Text Recognition Techniques #Natural Language Processing Techniques #Topic Modeling #cs.CL #cs.LG
- GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints
2023/05/22 by Joshua Ainslie, Ainslie, Joshua, James Lee-Thorp +9 · 243 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Domain Adaptation and Few-Shot Learning
- Gemini Robotics: Bringing AI into the Physical World
2025/03/25 by Saminda Abeyruwan, Gemini Robotics Team, Abeyruwan, Saminda +212 · 134 citations
Engineering · Physics and Astronomy · #FOS: Computer and information sciences #Modular Robots and Swarm Intelligence #Robotics (cs.RO) #Space Science and Extraterrestrial Life
- Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints
2022/12/09 by Aran Komatsuzaki, Joan Puigcerver, Komatsuzaki, Aran +15 · 28 citations
Computer Science · #Advanced Neural Network Applications #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- LongT5: Efficient Text-To-Text Transformer for Long Sequences
2021/12/15 by Mandy Guo, Guo, Mandy, Joshua Ainslie +11 · 16 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- Gemini: A Family of Highly Capable Multimodal Models
2023/12/19 by Rohan Anil, Gemini Team, Anil, Rohan +2682 · 9 voices
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #cs.AI #cs.CL #cs.CV
- Conditional Adapters: Parameter-efficient Transfer Learning with Fast Inference
2023/04/11 by Tao Lei, Lei, Tao, Junwen Bai +21 · 8 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Speech Recognition and Synthesis #Multimodal Machine Learning Applications
- Functional Interpolation for Relative Positions Improves Long Context Transformers
2023/10/06 by Shanda Li, Chong You, Li, Shanda +17 · 7 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech Recognition and Synthesis
- FormNet: Structural Encoding beyond Sequential Modeling in Form Document\n Information Extraction
2022/03/16 by Chen-Yu Lee, Lee, Chen-Yu, Chunliang Li +17 · 4 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Handwritten Text Recognition Techniques #Image Processing and 3D Reconstruction #Machine Learning (cs.LG) #Natural Language Processing Techniques
- Learning the RoPEs: Better 2D and 3D Position Encodings with STRING
2025/02/04 by Connor Schenck, Schenck, Connor, Isaac Reid +41 · 8 citations
Computer Science · Engineering · #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Constraint Satisfaction and Optimization #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Robotics (cs.RO) #Robotics and Sensor-Based Localization
- A Suite of Generative Tasks for Multi-Level Multimodal Webpage Understanding
2023/05/05 by Andrea Burns, Burns, Andrea, Krishna Srinivasan +13 · 3 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Advanced Image and Video Retrieval Techniques #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Genomics and Phylogenetic Studies #Multimodal Machine Learning Applications
- GLIMMER: generalized late-interaction memory reranker
2023/06/17 by Michiel de Jong, de Jong, Michiel, Yury Zemlyanskiy +9 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- Gemini Robotics 1.5: Pushing the Frontier of Generalist Robots with Advanced Embodied Reasoning, Thinking, and Motion Transfer
2025/10/02 by Abbas Abdolmaleki, Gemini Robotics Team, Saminda Abeyruwan +267 · 14 citations
Computer Science · Engineering · #AI-based Problem Solving and Planning #Modular Robots and Swarm Intelligence #Robot Manipulation and Learning
- Iterative Decoding for Compositional Generalization in Transformers
2021/10/08 by Luana Ruiz, Ruiz, Luana, Joshua Ainslie +3 · 1 citation
Computer Science · #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- FiDO: Fusion-in-Decoder optimized for stronger performance and faster inference
2022/12/15 by Michiel de Jong, de Jong, Michiel, Yury Zemlyanskiy +11 · 1 citation
Biochemistry, Genetics and Molecular Biology · Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Bioinformatics #Natural Language Processing Techniques #Topic Modeling
- FormNetV2: Multimodal Graph Contrastive Learning for Form Document Information Extraction
2023/05/04 by Chen-Yu Lee, Chunliang Li, Lee, Chen-Yu +29 · 1 citation
Computer Science · #Handwritten Text Recognition Techniques #Multimodal Machine Learning Applications #Topic Modeling
- MEMORY-VQ: Compression for Tractable Internet-Scale Memory
2023/08/28 by Yury Zemlyanskiy, Zemlyanskiy, Yury, Michiel de Jong +11 · 1 citation
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- ClockRoPE: Random Fourier Rotations for Temporal Routine Modeling
2026/07/29 by Yiwen Chen, Joshua Ainslie, Krzysztof Choromanski +4
Computer Science · #cs.LG