Ilharco, Gabriel
- Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time
2022/03/10 by Mitchell Wortsman, Gabriel Ilharco, Wortsman, Mitchell +19 · 3 voices · 164 citations
Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #Machine Learning and Data Classification #cs.CL #cs.CV #cs.LG
- DataComp-LM: In search of the next generation of training sets for language models
2024/06/17 by Jeffrey Li, Alex Fang, Alex Chengyu Fang +121 · 2 voices · 80 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #cs.CL #cs.LG
- Editing Models with Task Arithmetic
2022/12/08 by Gabriel Ilharco, Ilharco, Gabriel, Marco Túlio Ribeiro +11 · 150 citations
Computer Science · #Adversarial Robustness in Machine Learning #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification
- Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpus
2021/04/18 by Dodge, Jesse, Sap, Maarten, Marasović, Ana +5 · 60 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- Robust fine-tuning of zero-shot models
2021/09/04 by Mitchell Wortsman, Gabriel Ilharco, Wortsman, Mitchell +19 · 62 citations
Computer Science · Medicine · #Domain Adaptation and Few-Shot Learning #COVID-19 diagnosis using AI #Advanced Neural Network Applications
- DataComp: In search of the next generation of multimodal datasets
2023/04/27 by Samir Yitzhak Gadre, Gabriel Ilharco, Gadre, Samir Yitzhak +65 · 80 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Machine Learning in Healthcare #Topic Modeling
- CoWs on Pasture: Baselines and Benchmarks for Language-Driven Zero-Shot Object Navigation
2022/03/20 by Samir Yitzhak Gadre, Mitchell Wortsman, Gadre, Samir Yitzhak +7 · 46 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications #Advanced Neural Network Applications
- OpenFlamingo: An Open-Source Framework for Training Large Autoregressive Vision-Language Models
2023/08/02 by Anas Awadalla, Awadalla, Anas, Irena Gao +29 · 49 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques
- Fine-Tuning Pretrained Language Models: Weight Initializations, Data Orders, and Early Stopping
2020/02/14 by Jesse Dodge, Gabriel Ilharco, Dodge, Jesse +9 · 27 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech Recognition and Synthesis
- MultiModalQA: Complex Question Answering over Text, Tables and Images
2021/04/13 by Talmor, Alon, Yoran, Ori, Catav, Amnon +6 · 26 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Patching open-vocabulary models by interpolating weights
2022/08/10 by Gabriel Ilharco, Ilharco, Gabriel, Mitchell Wortsman +13 · 16 citations
Computer Science · Medicine · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #COVID-19 diagnosis using AI
- Improving Multimodal Datasets with Image Captioning
2023/07/19 by Thao D. Nguyen, Samir Yitzhak Gadre, Nguyen, Thao +7 · 14 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques
- Finetuning Pretrained Transformers into RNNs
2021/03/24 by Kasai, Jungo, Peng, Hao, Zhang, Yizhe +6 · 7 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Language models scale reliably with over-training and on downstream tasks
2024/03/13 by Samir Yitzhak Gadre, Georgios Smyrnis, Gadre, Samir Yitzhak +45 · 12 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- Data Determines Distributional Robustness in Contrastive Language Image Pre-training (CLIP)
2022/05/03 by Alex Chengyu Fang, Gabriel Ilharco, Fang, Alex +11 · 7 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Topic Modeling
- Quality Not Quantity: On the Interaction between Dataset Design and Robustness of CLIP
2022/08/10 by Thao D. Nguyen, Gabriel Ilharco, Nguyen, Thao +7 · 6 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image Retrieval and Classification Techniques #Machine Learning (cs.LG) #Topic Modeling #Web Data Mining and Analysis
- Exploring The Landscape of Distributional Robustness for Question Answering Models
2022/10/22 by Anas Awadalla, Awadalla, Anas, Mitchell Wortsman +11 · 2 citations
Computer Science · #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #Expert finding and Q&A systems #FOS: Computer and information sciences #Machine Learning (cs.LG) #Topic Modeling
- Adaptive Testing of Computer Vision Models
2022/12/06 by Gao, Irena, Ilharco, Gabriel, Lundberg, Scott +1 · 2 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Evaluating Models' Local Decision Boundaries via Contrast Sets
2020/04/06 by Matt Gardner, Gardner, Matt, Yoav Artzi +49 · 1 citation
Computer Science · #Adversarial Robustness in Machine Learning #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Topic Modeling
- The Responsible Foundation Model Development Cheatsheet: A Review of Tools & Resources
2024/06/24 by Longpre, Shayne, Biderman, Stella, Albalak, Alon +20 · 1 citation
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)