Faghri, Fartash
- DataComp-LM: In search of the next generation of training sets for language models
2024/06/17 by Jeffrey Li, Alex Chengyu Fang, Li, Jeffrey +121 · 2 voices · 100 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #cs.CL #cs.LG
- CatLIP: CLIP-level Visual Recognition Accuracy with 2.7x Faster Pre-training on Web-scale Image-Text Data
2024/04/24 by Sachin Mehta, Mehta, Sachin, Maxwell Horton +13 · 1 voice · 2 citations
Computer Science · #Handwritten Text Recognition Techniques
- SAM-CLIP: Merging Vision Foundation Models towards Semantic and Spatial Understanding
2023/10/23 by Haoxiang Wang, Wang, Haoxiang, Pavan Kumar Anasosalu Vasu +15 · 23 citations
Computer Science · Engineering · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics and Sensor-Based Localization
- MobileCLIP: Fast Image-Text Models through Multi-Modal Reinforced Training
2023/11/28 by Pavan Kumar Anasosalu Vasu, Hadi Pouransari, Vasu, Pavan Kumar Anasosalu +7 · 18 citations
Computer Science · #Multimodal Machine Learning Applications #Advanced Image and Video Retrieval Techniques #Domain Adaptation and Few-Shot Learning
- Adversarial Manipulation of Deep Representations
2015/11/16 by Sara Sabour, Yanshuai Cao, Sabour, Sara +5 · 12 citations
Computer Science · #Adversarial Robustness in Machine Learning #Digital Media Forensic Detection #Generative Adversarial Networks and Image Synthesis
- Technical Report on the CleverHans v2.1.0 Adversarial Examples Library
2016/10/03 by Papernot, Nicolas, Faghri, Fartash, Carlini, Nicholas +23 · 7 citations
#Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- FastVLM: Efficient Vision Encoding for Vision Language Models
2024/12/17 by Pavan Kumar Anasosalu Vasu, Vasu, Pavan Kumar Anasosalu, Fartash Faghri +19 · 25 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- Adaptive Gradient Quantization for Data-Parallel SGD
2020/10/23 by Fartash Faghri, Iman Tabrizian, Faghri, Fartash +9 · 4 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Medical Image Segmentation Techniques
- A Study of Gradient Variance in Deep Learning
2020/07/09 by Fartash Faghri, David Duvenaud, Faghri, Fartash +5 · 5 citations
Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Stochastic Gradient Optimization Techniques
- TiC-CLIP: Continual Training of CLIP Models
2023/10/24 by Saurabh Garg, Mehrdad Farajtabar, Garg, Saurabh +13 · 5 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Topic Modeling
- Scaling Smart: Accelerating Large Language Model Pre-training with Small Model Initialization
2024/09/19 by Mohammad Samragh, Iman Mirzadeh, Samragh, Mohammad +13 · 7 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- FastFill: Efficient Compatible Model Update
2023/03/08 by Florian Jaeckle, Jaeckle, Florian, Fartash Faghri +7 · 3 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Advanced Image and Video Retrieval Techniques #Multimodal Machine Learning Applications
- Reinforce Data, Multiply Impact: Improved Model Accuracy and Robustness with Dataset Reinforcement
2023/03/15 by Faghri, Fartash, Pouransari, Hadi, Mehta, Sachin +4 · 3 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- APE: Aligning Pretrained Encoders to Quickly Learn Aligned Multimodal Representations
2022/10/08 by Elan Rosenfeld, Preetum Nakkiran, Rosenfeld, Elan +7 · 2 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- VSE++: Improving Visual-Semantic Embeddings with Hard Negatives
2017/07/18 by Faghri, Fartash, Fleet, David J., Kiros, Jamie Ryan +1 · 1 citation
#Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Weight subcloning: direct initialization of transformers using larger pretrained ones
2023/12/14 by Samragh, Mohammad, Farajtabar, Mehrdad, Mehta, Sachin +5 · 2 citations
#Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Knowledge Transfer from Vision Foundation Models for Efficient Training of Small Task-specific Models
2023/11/30 by Vemulapalli, Raviteja, Pouransari, Hadi, Faghri, Fartash +4 · 2 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- MUSCLE: A Model Update Strategy for Compatible LLM Evolution
2024/07/12 by Echterhoff, Jessica, Faghri, Fartash, Vemulapalli, Raviteja +4 · 2 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences
- RangeAugment: Efficient Online Augmentation with Range Learning
2022/12/20 by Sachin Mehta, Mehta, Sachin, Saeid Naderiparizi +13 · 1 citation
Computer Science · #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications #Advanced Neural Network Applications
- TiC-LM: A Web-Scale Benchmark for Time-Continual LLM Pretraining
2025/04/02 by Jeffrey Li, Mohammadreza Armandpour, Li, Jeffrey +19 · 2 citations
Engineering · #Metallurgy and Material Forming #Advanced Surface Polishing Techniques
- FocalLens: Instruction Tuning Enables Zero-Shot Conditional Image Representations
2025/04/11 by Cheng-Yu Hsieh, Hsieh, Cheng-Yu, Pavan Kumar Anasosalu Vasu +13 · 1 citation
Computer Science · #Advanced Image and Video Retrieval Techniques #Generative Adversarial Networks and Image Synthesis #Multimodal Machine Learning Applications
- MobileCLIP2: Improving Multi-Modal Reinforced Training
2025/08/28 by Fartash Faghri, Pavan Kumar Anasosalu Vasu, Faghri, Fartash +11 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Mobile Learning in Education
- CLIP with Quality Captions: A Strong Pretraining for Vision Tasks
2024/05/14 by Vasu, Pavan Kumar Anasosalu, Pouransari, Hadi, Faghri, Fartash +1 · 2 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Computational Bottlenecks of Training Small-scale Large Language Models
2024/10/25 by Saleh Ashkboos, Iman Mirzadeh, Ashkboos, Saleh +11 · 1 citation
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling