vix.ing · top · new · best · stats · spec

Zheng, Lianmin

  1. Efficient Memory Management for Large Language Model Serving with PagedAttention
    2023/09/12 by Woosuk Kwon, Kwon, Woosuk, Zhuohan Li +15 · 4 voices · 1374 citations
    Computer Science · #Caching and Content Delivery #Software System Performance and Reliability #Topic Modeling #cs.DC #cs.LG
  2. Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena
    2023/06/09 by Lianmin Zheng, Zheng, Lianmin, Wei-Lin Chiang +24 · 4 voices · 1257 citations
    Computer Science · #AI in Service Interactions #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Speech and dialogue systems #Topic Modeling #cs.AI #cs.CL
  3. FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU
    2023/03/13 by Ying Sheng, Sheng, Ying, Lianmin Zheng +25 · 2 voices · 88 citations
    Computer Science · Engineering · Materials Science · #Ferroelectric and Negative Capacitance Devices #Machine Learning in Materials Science #Topic Modeling #cs.AI #cs.LG #cs.PF
  4. LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset
    2023/09/21 by Lianmin Zheng, Wei-Lin Chiang, Zheng, Lianmin +24 · 6 voices · 83 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Text Readability and Simplification
  5. Learning to Optimize Tensor Programs
    2018/05/21 by Tianqi Chen, Chen, Tianqi, Lianmin Zheng +14 · 1 voice · 25 citations
    Computer Science · Physics and Astronomy · #Parallel Computing and Optimization Techniques #Computational Physics and Python Applications #Model Reduction and Neural Networks
  6. SGLang: Efficient Execution of Structured Language Model Programs
    2023/12/12 by Lianmin Zheng, Zheng, Lianmin, Liangsheng Yin +21 · 1 voice · 238 citations
    Computer Science · #Natural Language Processing Techniques #Software Engineering Research #Topic Modeling #cs.AI #cs.PL
  7. S-LoRA: Serving Thousands of Concurrent LoRA Adapters
    2023/11/06 by Ying Sheng, Sheng, Ying, Shiyi Cao +21 · 2 voices · 20 citations
    Computer Science · #Parallel Computing and Optimization Techniques #Topic Modeling #Advanced Neural Network Applications
  8. Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference
    2024/03/07 by Chiang, Wei-Lin, Zheng, Lianmin, Sheng, Ying +8 · 228 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
  9. H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models
    2023/06/24 by Zhang, Zhenyu, Sheng, Ying, Zhou, Tianyi +9 · 114 citations
    #FOS: Computer and information sciences #Machine Learning (cs.LG)
  10. TVM: An Automated End-to-End Optimizing Compiler for Deep Learning
    2018/02/12 by Tianqi Chen, Chen, Tianqi, Thierry Moreau +22 · 1 voice · 14 citations
    Computer Science · #Parallel Computing and Optimization Techniques #Advanced Neural Network Applications #Advanced Data Storage Technologies
  11. Ansor: Generating High-Performance Tensor Programs for Deep Learning
    2020/06/11 by Lianmin Zheng, Chengfan Jia, Zheng, Lianmin +21 · 37 citations
    Computer Science · Mathematics · #Parallel Computing and Optimization Techniques #Advanced Neural Network Applications #Tensor decomposition and applications
  12. Rethinking Benchmark and Contamination for Language Models with Rephrased Samples
    2023/11/08 by Shuo Yang, Wei-Lin Chiang, Yang, Shuo +7 · 20 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Adversarial Robustness in Machine Learning
  13. TensorIR: An Abstraction for Automatic Tensorized Program Optimization
    2022/07/09 by Feng, Siyuan, Hou, Bohan, Jin, Hongyi +8 · 11 citations
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Programming Languages (cs.PL)
  14. Alpa: Automating Inter- and Intra-Operator Parallelism for Distributed Deep Learning
    2022/01/28 by Zheng, Lianmin, Li, Zhuohan, Zhang, Hao +9 · 7 citations
    #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Programming Languages (cs.PL) #and Cluster Computing (cs.DC)
  15. AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving
    2023/02/22 by Zhuohan Li, Li, Zhuohan, Lianmin Zheng +19 · 8 citations
    Computer Science · #Age of Information Optimization #Cloud Computing and Resource Management #Distributed #FOS: Computer and information sciences #IoT and Edge/Fog Computing #Machine Learning (cs.LG) #Networking and Internet Architecture (cs.NI) #Parallel #and Cluster Computing (cs.DC)
  16. MAgent: A Many-Agent Reinforcement Learning Platform for Artificial Collective Intelligence
    2017/12/02 by Zheng, Lianmin, Yang, Jiacheng, Cai, Han +3 · 4 citations
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multiagent Systems (cs.MA)
  17. ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training
    2021/04/29 by Jianfei Chen, Chen, Jianfei, Lianmin Zheng +11 · 5 citations
    Computer Science · Engineering · #Advanced Memory and Neural Computing #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  18. Post-Training Sparse Attention with Double Sparsity
    2024/08/11 by Shuo Yang, Ying Sheng, Yang, Shuo +7 · 10 citations
    Neuroscience · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #EEG and Brain-Computer Interfaces #FOS: Computer and information sciences #Machine Learning (cs.LG)
  19. On Optimal Caching and Model Multiplexing for Large Model Inference
    2023/06/03 by Zhu, Banghua, Sheng, Ying, Zheng, Lianmin +3 · 4 citations
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Performance (cs.PF) #Systems and Control (eess.SY) #electronic engineering #information engineering
  20. A Unified Optimization Approach for CNN Model Inference on Integrated GPUs
    2019/07/03 by Wang, Leyuan, Chen, Zhi, Liu, Yizhi +4 · 2 citations
    #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
  21. BlendServe: Optimizing Offline Inference for Auto-regressive Large Models with Resource-aware Batching
    2024/11/25 by Yilong Zhao, Zhao, Yilong, Shuo Yang +13 · 6 citations
    Computer Science · #AI in cancer detection #FOS: Computer and information sciences #Gaussian Processes and Bayesian Inference #Machine Learning (cs.LG) #Machine Learning and Data Classification
  22. GACT: Activation Compressed Training for Generic Network Architectures
    2022/06/22 by Liu, Xiaoxuan, Zheng, Lianmin, Wang, Dequan +9 · 2 citations
    #FOS: Computer and information sciences #Machine Learning (cs.LG)
  23. On Optimizing the Communication of Model Parallelism
    2022/11/10 by Zhuang, Yonghao, Zhao, Hexu, Zheng, Lianmin +6 · 2 citations
    #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
  24. A Hardware-Software Blueprint for Flexible Deep Learning Specialization
    2018/07/11 by Thierry Moreau, Moreau, Thierry, Tianqi Chen +19 · 1 voice
    Computer Science · Mathematics · #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Parallel #and Cluster Computing (cs.DC) #cs.DC #cs.LG #stat.ML