Shi, Xiaoxiang
- Autellix: An Efficient Serving Engine for LLM Agents as General Programs
2025/02/19 by Michael Luo, Luo, Michael, Shi, Xiaoxiang +17 · 11 citations
Computer Science · Engineering · #Mobile Agent-Based Network Management #Modular Robots and Swarm Intelligence #Advanced Manufacturing and Logistics Optimization
- SuperScaler: Supporting Flexible DNN Parallelization via a Unified Abstraction
2023/01/21 by Zhiqi Lin, Lin, Zhiqi, Youshan Miao +23 · 1 citation
Computer Science · Engineering · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Parallel #Parallel Computing and Optimization Techniques #and Cluster Computing (cs.DC)
- Nexus:Proactive Intra-GPU Disaggregation of Prefill and Decode in LLM Serving
2025/07/09 by Shi, Xiaoxiang, Cai, Colin, Du, Junjia +1 · 5 citations
#Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- TeleRAG: Efficient Retrieval-Augmented Generation Inference with Lookahead Retrieval
2025/02/28 by Lin, Chien-Yu, Kamahori, Keisuke, Liu, Yiyu +11 · 1 citation
#Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)