Xuanzhe Liu

1. DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving
   2024/01/18 by Yinmin Zhong, Shengyu Liu, Zhong, Yinmin +13 · 136 citations
   Computer Science · #Advanced Neural Network Applications #Distributed #FOS: Computer and information sciences #Natural Language Processing Techniques #Parallel #Topic Modeling #and Cluster Computing (cs.DC)
2. LoongServe: Efficiently Serving Long-Context Large Language Models with Elastic Sequence Parallelism
   2024/04/15 by Bingyang Wu, Wu, Bingyang, Shengyu Liu +9 · 27 citations
   Computer Science · #Advanced Neural Network Applications #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #Topic Modeling #and Cluster Computing (cs.DC)
3. RAGCache: Efficient Knowledge Caching for Retrieval-Augmented Generation
   2024/04/18 by Chao Jin, Zili Zhang, Jin, Chao +11 · 1 voice · 20 citations
   #cs.DC #cs.CL #cs.LG
4. Fast On-device LLM Inference with NPUs
   2024/07/08 by Daliang Xu, Hao Zhang, Xu, Daliang +11 · 16 citations
   Computer Science · Engineering · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Power Line Communications and Noise #VLSI and Analog Circuit Testing
5. A Survey of Resource-efficient LLM and Multimodal Foundation Models
   2024/01/16 by Mengwei Xu, Wangsong Yin, Xu, Mengwei +33 · 10 citations
   Computer Science · #Topic Modeling
6. Rise of the Planet of Serverless Computing: A Systematic Review
   2022/06/24 by Jinfeng Wen, Zhenpeng Chen, Wen, Jinfeng +5 · 6 citations
   Computer Science · #Cloud Computing and Resource Management #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #IoT and Edge/Fog Computing #Software Engineering (cs.SE)
7. Mandheling: Mixed-Precision On-Device DNN Training with DSP Offloading
   2022/06/15 by Daliang Xu, Xu, Daliang, Mengwei Xu +15 · 4 citations
   Computer Science · Engineering · #Parallel Computing and Optimization Techniques #Advanced Neural Network Applications #Ferroelectric and Negative Capacitance Devices
8. MegaScale-Infer: Serving Mixture-of-Experts at Scale with Disaggregated Expert Parallelism
   2025/04/03 by Ruidong Zhu, Zhu, Ruidong, Ziheng Jiang +35 · 14 citations
   Computer Science · #Advanced Neural Network Applications #Big Data and Digital Economy #Domain Adaptation and Few-Shot Learning
9. An Empirical Study on Deployment Faults of Deep Learning Based Mobile Applications
   2021/01/13 by Zhenpeng Chen, Huihan Yao, Chen, Zhenpeng +11 · 3 citations
   Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Software Engineering (cs.SE) #Software Engineering Research #Software System Performance and Reliability #Software Testing and Debugging Techniques
10. Research on WebAssembly Runtimes: A Survey
    2024/04/19 by Yixuan Zhang, Zhang, Yixuan, Mugeng Liu +9 · 5 citations
    Computer Science · Engineering · #Digital Rights Management and Security #Manufacturing Process and Optimization
11. LoongTrain: Efficient Training of Long-Sequence LLMs with Head-Context Parallelism
    2024/06/26 by Diandian Gu, Peng Sun, Gu, Diandian +25 · 5 citations
    Computer Science · #Natural Language Processing Techniques #Handwritten Text Recognition Techniques #Speech Recognition and Synthesis
12. Promptware Engineering: Software Engineering for Prompt-Enabled Systems
    2025/03/04 by Zhenpeng Chen, Chen, Zhenpeng, Chong Wang +10 · 8 citations
    Computer Science · #Software Testing and Debugging Techniques #Software Reliability and Analysis Research #Software System Performance and Reliability
13. FinMME: Benchmark Dataset for Financial Multi-Modal Reasoning Evaluation
    2025/05/30 by Junyu Luo, Luo, Junyu, Zhizhuo Kou +23 · 10 citations
    Decision Sciences · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Stock Market Forecasting Methods
14. SCOPE: Performance Testing for Serverless Computing
    2023/06/02 by Jinfeng Wen, Zhenpeng Chen, Wen, Jinfeng +9 · 3 citations
    Computer Science · #Cloud Computing and Resource Management #Cloud Data Security Solutions #FOS: Computer and information sciences #IoT and Edge/Fog Computing #Software Engineering (cs.SE)
15. FaaSLight : General Application-level Cold-start Latency Optimization for Function-as-a-Service in Serverless Computing
    2023/07/22 by Xuanzhe Liu, Jinfeng Wen, Zhenpeng Chen +5 · 2 citations
16. LLM as a System Service on Mobile Devices
    2024/03/18 by Wangsong Yin, Mengwei Xu, Yin, Wangsong +5 · 3 citations
    Business, Management and Accounting · Computer Science · #Advanced Computational Techniques and Applications #Business Process Modeling and Analysis #FOS: Computer and information sciences #Operating Systems (cs.OS) #Wireless Sensor Networks for Data Analysis
17. HydraServe: Minimizing Cold Start Latency for Serverless LLM Serving in Public Clouds
    2025/02/21 by Chiheng Lou, Lou, Chiheng, Sheng Qi +13 · 4 citations
    Computer Science · #Caching and Content Delivery #Distributed #FOS: Computer and information sciences #IoT and Edge/Fog Computing #Parallel #Software-Defined Networks and 5G #and Cluster Computing (cs.DC)
18. VM Matters: A Comparison of WASM VMs and EVMs in the Performance of Blockchain Smart Contracts
    2020/12/02 by Shuyu Zheng, Haoyu Wang, Zheng, Shuyu +7 · 1 citation
    Computer Science · #Blockchain Technology Applications and Security #Cloud Computing and Resource Management #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Security and Verification in Computing #Software Engineering (cs.SE)
19. Rise of Distributed Deep Learning Training in the Big Model Era: From a Software Engineering Perspective
    2021/12/12 by Xuanzhe Liu, Diandian Gu, Liu, Xuanzhe +13 · 1 citation
    Computer Science · Decision Sciences · #FOS: Computer and information sciences #Scientific Computing and Data Management #Software Engineering (cs.SE) #Software Engineering Research #Software System Performance and Reliability
20. Benchmarking of DL Libraries and Models on Mobile Devices
    2022/02/14 by Qiyang Zhang, Xiang Li, Zhang, Qiyang +15 · 1 citation
    Computer Science · Engineering · #Age of Information Optimization #FOS: Computer and information sciences #Green IT and Sustainability #IoT and Edge/Fog Computing #Machine Learning (cs.LG) #Networking and Internet Architecture (cs.NI)
21. MuxFlow: Efficient and Safe GPU Sharing in Large-Scale Production Deep Learning Clusters
    2023/03/24 by Yihao Zhao, Xin Liu, Zhao, Yihao +13 · 1 citation
    Neuroscience · Computer Science · #Brain Tumor Detection and Classification #Cloud Computing and Resource Management #IoT and Edge/Fog Computing
22. DeepWear: Adaptive Local Offloading for On-Wearable Deep Learning
    2017/12/01 by Mengwei Xu, Xu, Mengwei, Feng Qian +9 · 1 citation
    Computer Science · Engineering · #Computers and Society (cs.CY) #Context-Aware Activity Recognition Systems #FOS: Computer and information sciences #Green IT and Sustainability #IoT and Edge/Fog Computing #Machine Learning (cs.LG)
23. A First Look at Bugs in LLM Inference Engines
    2025/06/11 by Mugeng Liu, Liu, Mugeng, Siqi Zhong +13 · 1 citation
    Computer Science · #Adversarial Robustness in Machine Learning #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning and Data Classification #Software Engineering (cs.SE)
24. BAMAS: Structuring Budget-Aware Multi-Agent Systems
    2025/11/26 by Liming Yang, Junyu Luo, Yang, Liming +7 · 2 citations
    Computer Science · #Multimodal Machine Learning Applications #Big Data and Digital Economy #Reinforcement Learning in Robotics