Jin, Shuowei
- Eagle: Efficient Training-Free Router for Multi-LLM Inference
2024/09/23 by Shuowei Jin, Zhao, Zesen, Jin, Shuowei +2 · 8 citations
Computer Science · Engineering · #FOS: Computer and information sciences #Internet Traffic Analysis and Secure E-voting #Machine Learning (cs.LG) #Speech Recognition and Synthesis #Traffic Prediction and Management Techniques
- Compute Or Load KV Cache? Why Not Both?
2024/10/04 by Shuowei Jin, Xueshen Liu, Jin, Shuowei +5 · 7 citations
Computer Science · #Algorithms and Data Compression #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel Computing and Optimization Techniques
- On Data Fabrication in Collaborative Vehicular Perception: Attacks and Countermeasures
2023/09/22 by Qingzhao Zhang, Zhang, Qingzhao, Shuowei Jin +11 · 3 citations
Computer Science · Engineering · #Adversarial Robustness in Machine Learning #Computer Vision and Pattern Recognition (cs.CV) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Privacy-Preserving Technologies in Data #Vehicular Ad Hoc Networks (VANETs)
- AIBrix: Towards Scalable, Cost-Effective Large Language Model Inference Infrastructure
2025/02/22 by Jiaxin Shan, The AIBrix Team, Varun Gupta +48 · 6 citations
Computer Science · #Artificial Intelligence (cs.AI) #Cloud Computing and Resource Management #Distributed #FOS: Computer and information sciences #Parallel #Parallel Computing and Optimization Techniques #Software System Performance and Reliability #and Cluster Computing (cs.DC)
- Plato: Plan to Efficiently Decode for Large Language Model Inference
2024/02/19 by Shuowei Jin, Jin, Shuowei, Liu, Xueshen +15 · 1 citation
Biochemistry, Genetics and Molecular Biology · Computer Science · #Algorithms and Data Compression #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Gene expression and cancer classification #Graph Theory and Algorithms
- HeterMoE: Efficient Training of Mixture-of-Experts Models on Heterogeneous GPUs
2025/04/04 by Yang Wu, Wu, Yongji, Xueshen Liu +15 · 2 citations
Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #Big Data and Digital Economy