Riquelme, Carlos
- Scaling Vision with Sparse Mixture of Experts
2021/06/10 by Riquelme, Carlos, Puigcerver, Joan, Mustafa, Basil +5 · 112 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- PaLI: A Jointly-Scaled Multilingual Language-Image Model
2022/09/14 by Xi Chen, Xiao Wang, Chen, Xi +55 · 82 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Scaling Vision Transformers to 22 Billion Parameters
2023/02/10 by Mostafa Dehghani, Josip Djolonga, Dehghani, Mostafa +81 · 68 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Advanced Neural Network Applications
- Google Research Football: A Novel Reinforcement Learning Environment
2019/07/25 by Kurach, Karol, Raichuk, Anton, Stańczyk, Piotr +8 · 27 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark
2019/10/01 by Zhai, Xiaohua, Puigcerver, Joan, Kolesnikov, Alexander +14 · 26 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- From Sparse to Soft Mixtures of Experts
2023/08/02 by Puigcerver, Joan, Riquelme, Carlos, Mustafa, Basil +1 · 31 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Experts
2022/06/06 by Mustafa, Basil, Riquelme, Carlos, Puigcerver, Joan +2 · 19 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Learning to Merge Tokens in Vision Transformers
2022/02/24 by Renggli, Cedric, Pinto, André Susano, Houlsby, Neil +3 · 6 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Human Interaction with Recommendation Systems
2017/03/01 by Sven Schmit, Carlos Riquelme, Schmit, Sven +1 · 5 citations
Decision Sciences · #Auction Theory and Applications #Game Theory and Applications #Advanced Bandit Algorithms Research
- Deep Bayesian Bandits Showdown: An Empirical Comparison of Bayesian Deep Networks for Thompson Sampling
2018/02/25 by Carlos Riquelme, Riquelme, Carlos, George Tucker +3 · 3 citations
Decision Sciences · Computer Science · #Advanced Bandit Algorithms Research #Data Stream Mining Techniques #Gaussian Processes and Bayesian Inference
- On the Adversarial Robustness of Mixture of Experts
2022/10/19 by Joan Puigcerver, Rodolphe Jenatton, Puigcerver, Joan +7 · 4 citations
Computer Science · #Adversarial Robustness in Machine Learning #Machine Learning and Algorithms #Domain Adaptation and Few-Shot Learning
- Scalable Transfer Learning with Expert Models
2020/09/28 by Joan Puigcerver, Carlos Riquelme, Puigcerver, Joan +13 · 3 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications #Advanced Neural Network Applications
- Stable LM 2 1.6B Technical Report
2024/02/27 by Marco Bellagente, Jonathan Tow, Bellagente, Marco +35 · 4 citations
Engineering · #Particle accelerators and beam dynamics #Induction Heating and Inverter Technology #Microwave Engineering and Waveguides
- Scaling Laws for Sparsely-Connected Foundation Models
2023/09/15 by Elias Frantar, Frantar, Elias, Carlos Riquelme +7 · 3 citations
Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- Routers in Vision Mixture of Experts: An Empirical Study
2024/01/29 by Liu, Tianlin, Blondel, Mathieu, Riquelme, Carlos +1 · 3 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Stable Code Technical Report
2024/04/01 by Pinnaparaju, Nikhil, Adithyan, Reshinth, Phung, Duy +8 · 3 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Rephrasing natural text data with different languages and quality levels for Large Language Model pre-training
2024/10/28 by Michael Pieler, Pieler, Michael, Marco Bellagente +21 · 3 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- On Last-Layer Algorithms for Classification: Decoupling Representation from Uncertainty Estimation
2020/01/22 by Nicolas Brosse, Carlos Riquelme, Brosse, Nicolas +7 · 1 citation
Computer Science · Engineering · #Adversarial Robustness in Machine Learning #Anomaly Detection Techniques and Applications #FOS: Computer and information sciences #Fault Detection and Control Systems #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Which Model to Transfer? Finding the Needle in the Growing Haystack
2020/10/13 by Cédric Renggli, André Susano Pinto, Renggli, Cedric +11 · 1 citation
Computer Science · #Domain Adaptation and Few-Shot Learning #Advanced Neural Network Applications #Multimodal Machine Learning Applications