Mustafa, Basil
- Sigmoid Loss for Language Image Pre-Training
2023/03/27 by Xiaohua Zhai, Basil Mustafa, Zhai, Xiaohua +6 · 3 voices · 738 citations
Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications #cs.AI #cs.CV
- Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
2025/07/07 by Gheorghe Comanici, Eric Bieber, Comanici, Gheorghe +6844 · 8 voices · 1374 citations
#cs.CL #cs.AI
- Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context
2024/03/08 by Gemini Robotics Team, Gemini Team, Petko Georgiev +2277 · 4 voices · 559 citations
Computer Science · #Semantic Web and Ontologies
- Towards Generalist Biomedical AI
2023/07/26 by Tao Tu, Shekoofeh Azizi, Tu, Tao +68 · 3 voices · 57 citations
Computer Science · Biochemistry, Genetics and Molecular Biology · #Topic Modeling #Biomedical Text Mining and Ontologies #Natural Language Processing Techniques
- PaLI-3 Vision Language Models: Smaller, Faster, Stronger
2023/10/13 by Xi Chen, Chen, Xi, Xiao Wang +35 · 1 voice · 19 citations
#cs.CV
- Gemma 3 Technical Report
2025/03/25 by Aishwarya Kamath, Gemma Team, Johan Ferret +418 · 3 voices · 471 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #cs.AI #cs.CL
- Scaling Vision with Sparse Mixture of Experts
2021/06/10 by Riquelme, Carlos, Puigcerver, Joan, Mustafa, Basil +5 · 112 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Features
2025/02/20 by Michael Tschannen, Alexey A. Gritsenko, Tschannen, Michael +25 · 265 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- PaLI: A Jointly-Scaled Multilingual Language-Image Model
2022/09/14 by Xi Chen, Chen, Xi, Xiao Wang +55 · 82 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Scaling Vision Transformers to 22 Billion Parameters
2023/02/10 by Mostafa Dehghani, Josip Djolonga, Dehghani, Mostafa +81 · 68 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Advanced Neural Network Applications
- LiT: Zero-Shot Transfer with Locked-image text Tuning
2021/11/15 by Xiaohua Zhai, Xiao Wang, Zhai, Xiaohua +11 · 54 citations
Computer Science · Engineering · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Image Processing Techniques and Applications
- Capabilities of Gemini Models in Medicine
2024/04/29 by Khaled Saab, Tao Tu, Saab, Khaled +138 · 3 voices · 27 citations
Computer Science · Decision Sciences · Mathematics · #Mathematical Biology Tumor Growth #Simulation Techniques and Applications #cs.AI #cs.CL #cs.CV #cs.LG
- Patch n' Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution
2023/07/12 by Mostafa Dehghani, Dehghani, Mostafa, Basil Mustafa +27 · 45 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints
2022/12/09 by Aran Komatsuzaki, Komatsuzaki, Aran, Joan Puigcerver +15 · 28 citations
Computer Science · #Advanced Neural Network Applications #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- Big Self-Supervised Models Advance Medical Image Classification
2021/01/13 by Shekoofeh Azizi, Azizi, Shekoofeh, Basil Mustafa +21 · 21 citations
Computer Science · Biochemistry, Genetics and Molecular Biology · Medicine · #AI in cancer detection #Cancer-related molecular mechanisms research #Mycobacterium research and diagnosis
- From Sparse to Soft Mixtures of Experts
2023/08/02 by Puigcerver, Joan, Riquelme, Carlos, Mustafa, Basil +1 · 31 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- PaLI-X: On Scaling up a Multilingual Vision and Language Model
2023/05/29 by Xi Chen, Chen, Xi, Josip Djolonga +83 · 30 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Natural Language Processing Techniques
- Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Experts
2022/06/06 by Mustafa, Basil, Riquelme, Carlos, Puigcerver, Joan +2 · 19 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- CLIPPO: Image-and-Language Understanding from Pixels Only
2022/12/15 by Michael Tschannen, Basil Mustafa, Tschannen, Michael +3 · 11 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Topic Modeling
- Gemini: A Family of Highly Capable Multimodal Models
2023/12/19 by Gemini Robotics Team, Rohan Anil, Gemini Team +2692 · 9 voices
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #cs.AI #cs.CL #cs.CV
- Learning to Merge Tokens in Vision Transformers
2022/02/24 by Renggli, Cedric, Pinto, André Susano, Houlsby, Neil +3 · 6 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Scalable Transfer Learning with Expert Models
2020/09/28 by Joan Puigcerver, Carlos Riquelme, Puigcerver, Joan +13 · 3 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications #Advanced Neural Network Applications
- Robust and Efficient Medical Imaging with Self-Supervision
2022/05/19 by Azizi, Shekoofeh, Culp, Laura, Freyberg, Jan +31 · 2 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Three Towers: Flexible Contrastive Learning with Pretrained Image Models
2023/05/26 by Kossen, Jannik, Collier, Mark, Mustafa, Basil +7 · 2 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Supervised Transfer Learning at Scale for Medical Imaging
2021/01/14 by Basil Mustafa, Aaron Loh, Mustafa, Basil +16 · 2 citations
Medicine · #COVID-19 diagnosis using AI #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Radiology practices and education #Radiomics and Machine Learning in Medical Imaging
- Correlated Input-Dependent Label Noise in Large-Scale Image\n Classification
2021/05/19 by Mark Collier, Basil Mustafa, Collier, Mark +7 · 1 citation
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Image and Object Detection Techniques #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification
- Massively Scaling Heteroscedastic Classifiers
2023/01/30 by Collier, Mark, Jenatton, Rodolphe, Mustafa, Basil +3 · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- A Simple Probabilistic Method for Deep Classification under Input-Dependent Label Noise
2020/03/15 by Mark Collier, Collier, Mark, Basil Mustafa +7 · 1 citation
Computer Science · #Machine Learning and Data Classification #Anomaly Detection Techniques and Applications #Adversarial Robustness in Machine Learning