Liangsheng Yin
- SGLang: Efficient Execution of Structured Language Model Programs
2023/12/12 by Lianmin Zheng, Liangsheng Yin, Zheng, Lianmin +21 · 1 voice · 238 citations
Computer Science · #Natural Language Processing Techniques #Software Engineering Research #Topic Modeling #cs.AI #cs.PL
- Locality-aware Fair Scheduling in LLM Serving
2025/01/24 by Shiyi Cao, Cao, Shiyi, Yichuan Wang +22 · 4 citations
Computer Science · Engineering · #Advanced Manufacturing and Logistics Optimization #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Petri Nets in System Modeling #Scheduling and Optimization Algorithms #and Cluster Computing (cs.DC)