Shi, Haiyang
- AIBrix: Towards Scalable, Cost-Effective Large Language Model Inference Infrastructure
2025/02/22 by The AIBrix Team, Jiaxin Shan, Shan, Jiaxin +48 · 7 citations
Computer Science · #Artificial Intelligence (cs.AI) #Cloud Computing and Resource Management #Distributed #FOS: Computer and information sciences #Parallel #Parallel Computing and Optimization Techniques #Software System Performance and Reliability #and Cluster Computing (cs.DC)
- PolyServe: Efficient Multi-SLO Serving at Scale
2025/07/17 by Kan Zhu, Haiyang Shi, Zhu, Kan +11 · 2 citations
Computer Science · #Distributed #Energy Efficient Wireless Sensor Networks #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)