Lianmin Zheng
- Efficient Memory Management for Large Language Model Serving with PagedAttention
2023/09/12 by Woosuk Kwon, Zhuohan Li, Kwon, Woosuk +15 · 4 voices · 1405 citations
Computer Science · #Caching and Content Delivery #Software System Performance and Reliability #Topic Modeling #cs.DC #cs.LG
- Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena
2023/06/09 by Lianmin Zheng, Wei-Lin Chiang, Zheng, Lianmin +24 · 4 voices · 1278 citations
Computer Science · #AI in Service Interactions #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Speech and dialogue systems #Topic Modeling #cs.AI #cs.CL
- FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU
2023/03/13 by Ying Sheng, Lianmin Zheng, Sheng, Ying +25 · 2 voices · 88 citations
Computer Science · Engineering · Materials Science · #Ferroelectric and Negative Capacitance Devices #Machine Learning in Materials Science #Topic Modeling #cs.AI #cs.LG #cs.PF
- LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset
2023/09/21 by Lianmin Zheng, Wei-Lin Chiang, Zheng, Lianmin +24 · 6 voices · 86 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Text Readability and Simplification
- Learning to Optimize Tensor Programs
2018/05/21 by Tianqi Chen, Chen, Tianqi, Lianmin Zheng +14 · 1 voice · 25 citations
Computer Science · Physics and Astronomy · #Parallel Computing and Optimization Techniques #Computational Physics and Python Applications #Model Reduction and Neural Networks
- SGLang: Efficient Execution of Structured Language Model Programs
2023/12/12 by Lianmin Zheng, Liangsheng Yin, Zheng, Lianmin +21 · 1 voice · 248 citations
Computer Science · #Natural Language Processing Techniques #Software Engineering Research #Topic Modeling #cs.AI #cs.PL
- S-LoRA: Serving Thousands of Concurrent LoRA Adapters
2023/11/06 by Ying Sheng, Shiyi Cao, Sheng, Ying +21 · 2 voices · 20 citations
Computer Science · #Parallel Computing and Optimization Techniques #Topic Modeling #Advanced Neural Network Applications
- TVM: An Automated End-to-End Optimizing Compiler for Deep Learning
2018/02/12 by Tianqi Chen, Chen, Tianqi, Thierry Moreau +22 · 1 voice · 16 citations
Computer Science · #Parallel Computing and Optimization Techniques #Advanced Neural Network Applications #Advanced Data Storage Technologies
- Ansor: Generating High-Performance Tensor Programs for Deep Learning
2020/06/11 by Lianmin Zheng, Zheng, Lianmin, Chengfan Jia +21 · 39 citations
Computer Science · Mathematics · #Parallel Computing and Optimization Techniques #Advanced Neural Network Applications #Tensor decomposition and applications
- Rethinking Benchmark and Contamination for Language Models with Rephrased Samples
2023/11/08 by Shuo Yang, Yang, Shuo, Wei-Lin Chiang +7 · 21 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Adversarial Robustness in Machine Learning
- Alpa: Automating Inter- and Intra-Operator Parallelism for Distributed Deep Learning
2022/01/28 by Lianmin Zheng, Zhuohan Li, Zheng, Lianmin +20 · 8 citations
Computer Science · Engineering · #Advanced Neural Network Applications #Distributed #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #Programming Languages (cs.PL) #and Cluster Computing (cs.DC)
- AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving
2023/02/22 by Zhuohan Li, Li, Zhuohan, Lianmin Zheng +19 · 8 citations
Computer Science · #Age of Information Optimization #Cloud Computing and Resource Management #Distributed #FOS: Computer and information sciences #IoT and Edge/Fog Computing #Machine Learning (cs.LG) #Networking and Internet Architecture (cs.NI) #Parallel #and Cluster Computing (cs.DC)
- ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training
2021/04/29 by Jianfei Chen, Lianmin Zheng, Chen, Jianfei +11 · 5 citations
Computer Science · Engineering · #Advanced Memory and Neural Computing #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Post-Training Sparse Attention with Double Sparsity
2024/08/11 by Shuo Yang, Yang, Shuo, Ying Sheng +7 · 10 citations
Neuroscience · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #EEG and Brain-Computer Interfaces #FOS: Computer and information sciences #Machine Learning (cs.LG)
- BlendServe: Optimizing Offline Inference for Auto-regressive Large Models with Resource-aware Batching
2024/11/25 by Yilong Zhao, Zhao, Yilong, Shuo Yang +13 · 6 citations
Computer Science · #AI in cancer detection #FOS: Computer and information sciences #Gaussian Processes and Bayesian Inference #Machine Learning (cs.LG) #Machine Learning and Data Classification
- A Hardware-Software Blueprint for Flexible Deep Learning Specialization
2018/07/11 by Thierry Moreau, Tianqi Chen, Moreau, Thierry +19 · 1 voice
Computer Science · Mathematics · #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Parallel #and Cluster Computing (cs.DC) #cs.DC #cs.LG #stat.ML