vix.ing · top · new · best · stats · spec

Sheng, Ying

  1. Efficient Memory Management for Large Language Model Serving with PagedAttention
    2023/09/12 by Woosuk Kwon, Kwon, Woosuk, Zhuohan Li +15 · 4 voices · 1350 citations
    Computer Science · #Caching and Content Delivery #Software System Performance and Reliability #Topic Modeling #cs.DC #cs.LG
  2. Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena
    2023/06/09 by Lianmin Zheng, Zheng, Lianmin, Wei-Lin Chiang +24 · 4 voices · 1225 citations
    Computer Science · #AI in Service Interactions #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Speech and dialogue systems #Topic Modeling #cs.AI #cs.CL
  3. FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU
    2023/03/13 by Ying Sheng, Lianmin Zheng, Sheng, Ying +25 · 2 voices · 86 citations
    Computer Science · Engineering · Materials Science · #Ferroelectric and Negative Capacitance Devices #Machine Learning in Materials Science #Topic Modeling #cs.AI #cs.LG #cs.PF
  4. LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset
    2023/09/21 by Lianmin Zheng, Zheng, Lianmin, Wei-Lin Chiang +24 · 6 voices · 82 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Text Readability and Simplification
  5. SGLang: Efficient Execution of Structured Language Model Programs
    2023/12/12 by Lianmin Zheng, Zheng, Lianmin, Liangsheng Yin +21 · 1 voice · 233 citations
    Computer Science · #Natural Language Processing Techniques #Software Engineering Research #Topic Modeling #cs.AI #cs.PL
  6. S-LoRA: Serving Thousands of Concurrent LoRA Adapters
    2023/11/06 by Ying Sheng, Shiyi Cao, Sheng, Ying +21 · 2 voices · 20 citations
    Computer Science · #Parallel Computing and Optimization Techniques #Topic Modeling #Advanced Neural Network Applications
  7. Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference
    2024/03/07 by Chiang, Wei-Lin, Zheng, Lianmin, Sheng, Ying +8 · 225 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
  8. H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models
    2023/06/24 by Zhang, Zhenyu, Sheng, Ying, Zhou, Tianyi +9 · 110 citations
    #FOS: Computer and information sciences #Machine Learning (cs.LG)
  9. SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal
    2024/06/20 by Tinghao Xie, Xiangyu Qi, Xie, Tinghao +29 · 39 citations
    Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Natural Language Processing Techniques #Software Reliability and Analysis Research #Topic Modeling
  10. DafnyBench: A Benchmark for Formal Software Verification
    2024/06/12 by Chloe Loughridge, Loughridge, Chloe, Qinyi Sun +17 · 16 citations
    Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Formal Methods in Verification #Machine Learning (cs.LG) #Programming Languages (cs.PL) #Security and Verification in Computing #Software Engineering (cs.SE) #Software Testing and Debugging Techniques
  11. Clover: Closed-Loop Verifiable Code Generation
    2023/10/26 by Chuyue Sun, Ying Sheng, Sun, Chuyue +5 · 12 citations
    Computer Science · #Software Testing and Debugging Techniques #Software Engineering Research #Software Reliability and Analysis Research
  12. MoE-Lightning: High-Throughput MoE Inference on Memory-constrained GPUs
    2024/11/18 by Shiyi Cao, Cao, Shiyi, Shu Liu +15 · 17 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Cloud Computing and Resource Management #Distributed #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #and Cluster Computing (cs.DC)
  13. AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving
    2023/02/22 by Zhuohan Li, Lianmin Zheng, Li, Zhuohan +19 · 7 citations
    Computer Science · #Age of Information Optimization #Cloud Computing and Resource Management #Distributed #FOS: Computer and information sciences #IoT and Edge/Fog Computing #Machine Learning (cs.LG) #Networking and Internet Architecture (cs.NI) #Parallel #and Cluster Computing (cs.DC)
  14. Fairness in Serving Large Language Models
    2023/12/31 by Ying Sheng, Sheng, Ying, Shiyi Cao +13 · 6 citations
    Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Parallel Computing and Optimization Techniques #Performance (cs.PF)
  15. Post-Training Sparse Attention with Double Sparsity
    2024/08/11 by Shuo Yang, Yang, Shuo, Ying Sheng +7 · 9 citations
    Neuroscience · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #EEG and Brain-Computer Interfaces #FOS: Computer and information sciences #Machine Learning (cs.LG)
  16. On Optimal Caching and Model Multiplexing for Large Model Inference
    2023/06/03 by Zhu, Banghua, Sheng, Ying, Zheng, Lianmin +3 · 4 citations
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Performance (cs.PF) #Systems and Control (eess.SY) #electronic engineering #information engineering
  17. Prism: Cost-Efficient Multi-LLM Serving via GPU Memory Ballooning
    2025/05/06 by Shan Yu, Yu, Shan, Yifan Qiao +29 · 12 citations
    Computer Science · #Parallel Computing and Optimization Techniques #Big Data and Digital Economy #Natural Language Processing Techniques
  18. Simplified DOM Trees for Transferable Attribute Extraction from the Web
    2021/01/07 by Zhou, Yichao, Sheng, Ying, Vo, Nguyen +2 · 2 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  19. Locality-aware Fair Scheduling in LLM Serving
    2025/01/24 by Shiyi Cao, Cao, Shiyi, Yichuan Wang +22 · 4 citations
    Computer Science · Engineering · #Advanced Manufacturing and Logistics Optimization #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Petri Nets in System Modeling #Scheduling and Optimization Algorithms #and Cluster Computing (cs.DC)
  20. Subspace Embedding and Linear Regression with Orlicz Norm
    2018/06/17 by Andoni, Alexandr, Lin, Chengyu, Sheng, Ying +2 · 1 citation
    #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  21. AI Metropolis: Scaling Large Language Model-based Multi-Agent Simulation with Out-of-order Execution
    2024/11/05 by Xie, Zhiqiang, Kang, Hao, Sheng, Ying +3 · 3 citations
    #Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multiagent Systems (cs.MA) #Parallel #and Cluster Computing (cs.DC)
  22. Reasoning About Vectors using an SMT Theory of Sequences
    2022/05/17 by Ying Sheng, Andres Nötzli, Sheng, Ying +17 · 1 citation
    Computer Science · #Advanced Software Engineering Methodologies #FOS: Computer and information sciences #Formal Methods in Verification #Logic in Computer Science (cs.LO) #Logic, programming, and type systems
  23. Distribution-free Junta Testing
    2018/02/13 by Xi Chen, Zhengyang Liu, Chen, Xi +7 · 1 citation
    Computer Science · #Machine Learning and Algorithms #Complexity and Algorithms in Graphs #Optimization and Search Problems
  24. Inference-Friendly Models With MixAttention
    2024/09/23 by Ying Sheng, Rajput, Shashank, Sean Owen +4 · 1 citation
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning and Algorithms #Machine Learning and Data Classification #Text and Document Classification Technologies