Shafi, Aamir
- Exploiting Inter-Layer Expert Affinity for Accelerating Mixture-of-Experts Model Inference
2024/01/16 by Jinghan Yao, Yao, Jinghan, Quentin Anthony +8 · 11 citations
Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- The Case for Co-Designing Model Architectures with Hardware
2024/01/25 by Anthony, Quentin, Hatef, Jacob, Narayanan, Deepak +6 · 3 citations
#Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
- Demystifying the Communication Characteristics for Distributed Transformer Models
2024/08/19 by Quentin Anthony, Anthony, Quentin, B Michałowicz +13 · 3 citations
Engineering · #Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Parallel #Power Systems and Technologies #and Cluster Computing (cs.DC)
- Performance Characterization of using Quantization for DNN Inference on Edge Devices: Extended Version
2023/03/09 by Hyunho Ahn, Ahn, Hyunho, Tian Chen +12 · 1 citation
Computer Science · #Advanced Neural Network Applications #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning and Data Classification #Performance (cs.PF) #Signal Processing (eess.SP) #electronic engineering #information engineering