Mohammad Rastegari
- LLM in a flash: Efficient Large Language Model Inference with Limited Memory
2023/12/12 by Keivan Alizadeh, Alizadeh, Keivan, Iman Mirzadeh +14 · 13 voices · 29 citations
Computer Science · #Advanced Neural Network Applications #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL #cs.LG
- XNOR-Net: ImageNet Classification Using Binary Convolutional Neural\n Networks
2016/03/16 by Mohammad Rastegari, Vicente Ordóñez, Vicente Ordonez +6 · 1 voice · 62 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #cs.CV
- What's Hidden in a Randomly Weighted Neural Network?
2019/11/29 by Vivek Ramanujan, Mitchell Wortsman, Ramanujan, Vivek +7 · 3 voices · 11 citations
#cs.CV #cs.LG
- Bytes Are All You Need: Transformers Operating Directly On File Bytes
2023/05/31 by Maxwell Horton, Sachin Mehta, Ali Farhadi +1 · 4 voices · 1 citation
#cs.CV
- OpenELM: An Efficient Language Model Family with Open Training and Inference Framework
2024/04/22 by Sachin Mehta, Mohammad Hossein Sekhavat, Mehta, Sachin +19 · 5 voices · 9 citations
#cs.CL #cs.AI #cs.LG
- OK-VQA: A Visual Question Answering Benchmark Requiring External\n Knowledge
2019/05/31 by Kenneth Marino, Mohammad Rastegari, Marino, Kenneth +5 · 133 citations
Computer Science · #Multimodal Machine Learning Applications #Advanced Image and Video Retrieval Techniques #Domain Adaptation and Few-Shot Learning
- MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformer
2021/10/05 by Sachin Mehta, Mohammad Rastegari, Mehta, Sachin +1 · 73 citations
Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #Advanced Image and Video Retrieval Techniques
- Separable Self-attention for Mobile Vision Transformers
2022/06/06 by Sachin Mehta, Mehta, Sachin, Mohammad Rastegari +1 · 20 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Solar Radiation and Photovoltaics
- CatLIP: CLIP-level Visual Recognition Accuracy with 2.7x Faster Pre-training on Web-scale Image-Text Data
2024/04/24 by Sachin Mehta, Mehta, Sachin, Maxwell Horton +13 · 1 voice · 2 citations
Computer Science · #Handwritten Text Recognition Techniques
- SAM-CLIP: Merging Vision Foundation Models towards Semantic and Spatial Understanding
2023/10/23 by Haoxiang Wang, Wang, Haoxiang, Pavan Kumar Anasosalu Vasu +15 · 20 citations
Computer Science · Engineering · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics and Sensor-Based Localization
- Learning to Learn How to Learn: Self-Adaptive Visual Navigation Using\n Meta-Learning
2018/12/03 by Mitchell Wortsman, Kiana Ehsani, Wortsman, Mitchell +7 · 8 citations
Computer Science · #Advanced Vision and Imaging #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications
- LazyLLM: Dynamic Token Pruning for Efficient Long Context LLM Inference
2024/07/19 by Qichen Fu, Fu, Qichen, Minsik Cho +9 · 14 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis
- ReLU Strikes Back: Exploiting Activation Sparsity in Large Language Models
2023/10/06 by Iman Mirzadeh, Keivan Alizadeh, Mirzadeh, Iman +13 · 10 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Machine Learning and Data Classification
- ESPNetv2: A Light-weight, Power Efficient, and General Purpose\n Convolutional Neural Network
2018/11/28 by Sachin Mehta, Mehta, Sachin, Mohammad Rastegari +5 · 4 citations
Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- Learning Neural Network Subspaces
2021/02/20 by Mitchell Wortsman, Maxwell Horton, Wortsman, Mitchell +7 · 3 citations
Computer Science · #Machine Learning and Data Classification #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning
- Superposition Prompting: Improving and Accelerating Retrieval-Augmented Generation
2024/04/10 by Thomas Merth, Merth, Thomas, Qichen Fu +5 · 3 citations
Computer Science · #Speech and dialogue systems #Topic Modeling
- "What happens if..." Learning to Predict the Effect of Forces in Images
2016/03/17 by Roozbeh Mottaghi, Mottaghi, Roozbeh, Mohammad Rastegari +5 · 1 citation
Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications
- LCNN: Lookup-based Convolutional Neural Network
2016/11/20 by Hessam Bagherinezhad, Bagherinezhad, Hessam, Mohammad Rastegari +3 · 1 citation
Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences
- KV Prediction for Improved Time to First Token
2024/10/10 by Maxwell Horton, Qingqing Cao, Horton, Maxwell +11 · 3 citations
Engineering · Computer Science · #Tunneling and Rock Mechanics #Image and Object Detection Techniques
- ELASTIC: Improving CNNs with Dynamic Scaling Policies
2018/12/13 by Huiyu Wang, Wang, Huiyu, Aniruddha Kembhavi +7 · 1 citation
Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences
- Action Recognition with Image Based CNN Features
2015/12/13 by Mahdyar Ravanbakhsh, Hossein Mousavi, Ravanbakhsh, Mahdyar +7 · 1 citation
Computer Science · #Human Pose and Action Recognition #Anomaly Detection Techniques and Applications #Video Surveillance and Tracking Methods
- Speculative Streaming: Fast LLM Inference without Auxiliary Models
2024/02/16 by Nikhil Bhendawade, I. I. Belousova, Bhendawade, Nikhil +9 · 2 citations
Computer Science · #Advanced Database Systems and Queries #Algorithms and Data Compression #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Data Stream Mining Techniques #FOS: Computer and information sciences #Machine Learning (cs.LG)
- DKM: Differentiable K-Means Clustering Layer for Neural Network Compression
2021/08/28 by Minsik Cho, Keivan Alizadeh-Vahid, Cho, Minsik +5 · 1 citation
Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- RangeAugment: Efficient Online Augmentation with Range Learning
2022/12/20 by Sachin Mehta, Saeid Naderiparizi, Mehta, Sachin +13 · 1 citation
Computer Science · #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications #Advanced Neural Network Applications
- eDKM: An Efficient and Accurate Train-time Weight Clustering for Large Language Models
2023/09/02 by Minsik Cho, Cho, Minsik, Keivan Alizadeh Vahid +13 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- SeedLM: Compressing LLM Weights into Seeds of Pseudo-Random Generators
2024/10/14 by Rasoul Shafipour, David Harrison, Shafipour, Rasoul +15 · 1 citation
Computer Science · #Neural Networks and Applications