Ying Sheng
- Efficient Memory Management for Large Language Model Serving with PagedAttention
2023/09/12 by Woosuk Kwon, Zhuohan Li, Kwon, Woosuk +15 · 4 voices · 1498 citations
Computer Science · #Caching and Content Delivery #Software System Performance and Reliability #Topic Modeling #cs.DC #cs.LG
- Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena
2023/06/09 by Lianmin Zheng, Zheng, Lianmin, Wei-Lin Chiang +24 · 4 voices · 1386 citations
Computer Science · #AI in Service Interactions #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Speech and dialogue systems #Topic Modeling #cs.AI #cs.CL
- FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU
2023/03/13 by Ying Sheng, Sheng, Ying, Lianmin Zheng +25 · 2 voices · 96 citations
Computer Science · Engineering · Materials Science · #Ferroelectric and Negative Capacitance Devices #Machine Learning in Materials Science #Topic Modeling #cs.AI #cs.LG #cs.PF
- LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset
2023/09/21 by Lianmin Zheng, Wei-Lin Chiang, Zheng, Lianmin +24 · 6 voices · 93 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Text Readability and Simplification
- SGLang: Efficient Execution of Structured Language Model Programs
2023/12/12 by Lianmin Zheng, Zheng, Lianmin, Liangsheng Yin +21 · 1 voice · 260 citations
Computer Science · #Natural Language Processing Techniques #Software Engineering Research #Topic Modeling #cs.AI #cs.PL
- S-LoRA: Serving Thousands of Concurrent LoRA Adapters
2023/11/06 by Ying Sheng, Sheng, Ying, Shiyi Cao +21 · 2 voices · 22 citations
Computer Science · #Parallel Computing and Optimization Techniques #Topic Modeling #Advanced Neural Network Applications
- SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal
2024/06/20 by Tinghao Xie, Xiangyu Qi, Xie, Tinghao +29 · 44 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Natural Language Processing Techniques #Software Reliability and Analysis Research #Topic Modeling
- Clover: Closed-Loop Verifiable Code Generation
2023/10/26 by Chuyue Sun, Ying Sheng, Sun, Chuyue +5 · 15 citations
Computer Science · #Software Testing and Debugging Techniques #Software Engineering Research #Software Reliability and Analysis Research
- DafnyBench: A Benchmark for Formal Software Verification
2024/06/12 by Chloe Loughridge, Loughridge, Chloe, Qinyi Sun +17 · 17 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Formal Methods in Verification #Machine Learning (cs.LG) #Programming Languages (cs.PL) #Security and Verification in Computing #Software Engineering (cs.SE) #Software Testing and Debugging Techniques
- AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving
2023/02/22 by Zhuohan Li, Li, Zhuohan, Lianmin Zheng +19 · 11 citations
Computer Science · #Age of Information Optimization #Cloud Computing and Resource Management #Distributed #FOS: Computer and information sciences #IoT and Edge/Fog Computing #Machine Learning (cs.LG) #Networking and Internet Architecture (cs.NI) #Parallel #and Cluster Computing (cs.DC)
- MoE-Lightning: High-Throughput MoE Inference on Memory-constrained GPUs
2024/11/18 by Shiyi Cao, Cao, Shiyi, Shu Liu +15 · 18 citations
Computer Science · #Artificial Intelligence (cs.AI) #Cloud Computing and Resource Management #Distributed #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #and Cluster Computing (cs.DC)
- Fairness in Serving Large Language Models
2023/12/31 by Ying Sheng, Sheng, Ying, Shiyi Cao +13 · 7 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Parallel Computing and Optimization Techniques #Performance (cs.PF)
- Post-Training Sparse Attention with Double Sparsity
2024/08/11 by Shuo Yang, Ying Sheng, Yang, Shuo +7 · 10 citations
Neuroscience · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #EEG and Brain-Computer Interfaces #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Prism: Cost-Efficient Multi-LLM Serving via GPU Memory Ballooning
2025/05/06 by Shan Yu, Yifan Qiao, Yu, Shan +29 · 12 citations
Computer Science · #Parallel Computing and Optimization Techniques #Big Data and Digital Economy #Natural Language Processing Techniques
- Distribution-free Junta Testing
2018/02/13 by Xi Chen, Zhengyang Liu, Chen, Xi +7 · 2 citations
Computer Science · #Machine Learning and Algorithms #Complexity and Algorithms in Graphs #Optimization and Search Problems
- Locality-aware Fair Scheduling in LLM Serving
2025/01/24 by Shiyi Cao, Cao, Shiyi, Yichuan Wang +22 · 4 citations
Computer Science · Engineering · #Advanced Manufacturing and Logistics Optimization #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Petri Nets in System Modeling #Scheduling and Optimization Algorithms #and Cluster Computing (cs.DC)
- Reasoning About Vectors using an SMT Theory of Sequences
2022/05/17 by Ying Sheng, Sheng, Ying, Andres Nötzli +17 · 1 citation
Computer Science · #Advanced Software Engineering Methodologies #FOS: Computer and information sciences #Formal Methods in Verification #Logic in Computer Science (cs.LO) #Logic, programming, and type systems
- Inference-Friendly Models With MixAttention
2024/09/23 by Rajput, Shashank, Ying Sheng, Sean Owen +4 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning and Algorithms #Machine Learning and Data Classification #Text and Document Classification Technologies