Santiago Ontañón
- Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context
2024/03/08 by Gemini Robotics Team, Petko Georgiev, Gemini Team +2277 · 4 voices · 551 citations
Computer Science · #Semantic Web and Ontologies
- FNet: Mixing Tokens with Fourier Transforms
2021/05/09 by James Lee-Thorp, Lee-Thorp, James, Joshua Ainslie +6 · 4 voices · 33 citations
Computer Science · Engineering · #Topic Modeling #Ferroelectric and Negative Capacitance Devices #Generative Adversarial Networks and Image Synthesis
- CoLT5: Faster Long-Range Transformers with Conditional Computation
2023/03/17 by Joshua Ainslie, Ainslie, Joshua, Tao Lei +21 · 3 voices · 9 citations
Computer Science · #Handwritten Text Recognition Techniques #Natural Language Processing Techniques #Topic Modeling #cs.CL #cs.LG
- LongT5: Efficient Text-To-Text Transformer for Long Sequences
2021/12/15 by Mandy Guo, Joshua Ainslie, Guo, Mandy +11 · 16 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- Functional Interpolation for Relative Positions Improves Long Context Transformers
2023/10/06 by Shanda Li, Chong You, Li, Shanda +17 · 7 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech Recognition and Synthesis
- Michelangelo: Long Context Evaluations Beyond Haystacks via Latent Structure Queries
2024/09/19 by Kiran Vodrahalli, Vodrahalli, Kiran, Santiago Ontañón +45 · 7 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Image Retrieval and Classification Techniques #Machine Learning (cs.LG) #Natural Language Processing Techniques #Semantic Web and Ontologies
- A2C is a special case of PPO
2022/05/18 by Huang, Shengyi, Anssi Kanervisto, Kanervisto, Anssi +8 · 3 citations
Computer Science · Decision Sciences · #Reinforcement Learning in Robotics #Artificial Intelligence in Games #Advanced Bandit Algorithms Research
- Iterative Decoding for Compositional Generalization in Transformers
2021/10/08 by Luana Ruiz, Ruiz, Luana, Joshua Ainslie +3 · 1 citation
Computer Science · #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- MEMORY-VQ: Compression for Tractable Internet-Scale Memory
2023/08/28 by Yury Zemlyanskiy, Michiel de Jong, Zemlyanskiy, Yury +11 · 1 citation
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling