Dara Bahri
- Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
2025/07/07 by Gheorghe Comanici, Comanici, Gheorghe, Eric Bieber +6844 · 8 voices · 1398 citations
#cs.CL #cs.AI
- Transformer Memory as a Differentiable Search Index
2022/02/14 by Yi Tay, Vinh Q. Tran, Tay, Yi +24 · 1 voice · 53 citations
Computer Science · #Natural Language Processing Techniques #Text and Document Classification Technologies #Topic Modeling #cs.AI #cs.CL #cs.IR #cs.LG
- Confident Adaptive Language Modeling
2022/07/14 by Tal Schuster, Adam Fisch, Schuster, Tal +14 · 2 voices · 46 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #cs.CL #cs.LG
- Long Range Arena: A Benchmark for Efficient Transformers
2020/11/08 by Yi Tay, Mostafa Dehghani, Tay, Yi +17 · 85 citations
Computer Science · Engineering · #Advanced Neural Network Applications #Ferroelectric and Negative Capacitance Devices #Power Line Inspection Robots
- Efficient Transformers: A Survey
2020/09/14 by Yi Tay, Tay, Yi, Mostafa Dehghani +5 · 71 citations
Computer Science · #Anomaly Detection Techniques and Applications #Advanced Neural Network Applications #Speech Recognition and Synthesis
- Rethinking search
2021/05/05 by Donald Metzler, Yi Tay, Dara Bahri +1 · 1 voice · 5 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- Synthesizer: Rethinking Self-Attention in Transformer Models
2020/05/02 by Yi Tay, Dara Bahri, Tay, Yi +9 · 32 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Multimodal Machine Learning Applications
- Sparse Sinkhorn Attention
2020/02/26 by Yi Tay, Tay, Yi, Dara Bahri +7 · 19 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- SCARF: Self-Supervised Contrastive Learning using Random Feature Corruption
2021/06/29 by Dara Bahri, Heinrich Jiang, Bahri, Dara +5 · 17 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Artificial Intelligence (cs.AI) #Cancer-related molecular mechanisms research #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- Charformer: Fast Character Transformers via Gradient-based Subword Tokenization
2021/06/23 by Yi Tay, Vinh Q. Tran, Tay, Yi +17 · 16 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Speech Recognition and Synthesis
- Sharpness-Aware Minimization Improves Language Model Generalization
2021/10/16 by Dara Bahri, Bahri, Dara, Hossein Mobahi +3 · 12 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- Are Pre-trained Convolutions Better than Pre-trained Transformers?
2021/05/07 by Yi Tay, Mostafa Dehghani, Tay, Yi +12 · 1 voice · 3 citations
Computer Science · #Advanced Neural Network Applications #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling #cs.CL #cs.LG
- ExT5: Towards Extreme Multi-Task Scaling for Transfer Learning
2021/11/22 by Vamsi Aribandi, Yi Tay, Aribandi, Vamsi +25 · 4 citations
Computer Science · #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- StructFormer: Joint Unsupervised Induction of Dependency and Constituency Structure from Masked Language Modeling
2020/12/01 by Yikang Shen, Shen, Yikang, Yi Tay +9 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- A Universal Class of Sharpness-Aware Minimization Algorithms
2024/06/06 by Behrooz Tahmasebi, Ashkan Soleymani, Tahmasebi, Behrooz +7 · 6 citations
Computer Science · Engineering · #Medical Image Segmentation Techniques #Industrial Vision Systems and Defect Detection #Digital Image Processing Techniques
- Decoding-based Regression
2025/01/31 by Xingyou Song, Dara Bahri, Song, Xingyou +1 · 2 voices · 6 citations
Computer Science · #Neural Networks and Applications
- A Watermark for Black-Box Language Models
2024/10/02 by Dara Bahri, Bahri, Dara, John Wieting +1 · 7 citations
Computer Science · #Advanced Steganography and Watermarking Techniques #Cryptography and Data Security
- Generative Models are Unsupervised Predictors of Page Quality: A\n Colossal-Scale Study
2020/08/17 by Dara Bahri, Bahri, Dara, Yi Tay +9 · 2 citations
Computer Science · #Topic Modeling #Computational Physics and Python Applications #Natural Language Processing Techniques
- Reverse Engineering Configurations of Neural Text Generation Models
2020/04/13 by Yi Tay, Dara Bahri, Tay, Yi +9 · 1 citation
Computer Science · #Artificial Intelligence in Games #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling