Liu, Xuanzhe
- DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving
2024/01/18 by Yinmin Zhong, Shengyu Liu, Zhong, Yinmin +13 · 155 citations
Computer Science · #Advanced Neural Network Applications #Distributed #FOS: Computer and information sciences #Natural Language Processing Techniques #Parallel #Topic Modeling #and Cluster Computing (cs.DC)
- A Survey of Resource-efficient LLM and Multimodal Foundation Models
2024/01/16 by Mengwei Xu, Xu, Mengwei, Wangsong Yin +34 · 1 voice · 12 citations
Computer Science · #Topic Modeling #cs.AI #cs.DC #cs.LG
- Fast Distributed Inference Serving for Large Language Models
2023/05/10 by Bingyang Wu, Yinmin Zhong, Wu, Bingyang +9 · 25 citations
Computer Science · Engineering · #Advanced Graph Neural Networks #Distributed #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Parallel #Topic Modeling #and Cluster Computing (cs.DC)
- LoongServe: Efficiently Serving Long-Context Large Language Models with Elastic Sequence Parallelism
2024/04/15 by Bingyang Wu, Shengyu Liu, Wu, Bingyang +9 · 32 citations
Computer Science · #Advanced Neural Network Applications #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #Topic Modeling #and Cluster Computing (cs.DC)
- RAGCache: Efficient Knowledge Caching for Retrieval-Augmented Generation
2024/04/18 by Chao Jin, Zili Zhang, Jin, Chao +11 · 1 voice · 22 citations
Computer Science · #Caching and Content Delivery #Recommender Systems and Techniques #Topic Modeling #cs.CL #cs.DC #cs.LG
- Fast On-device LLM Inference with NPUs
2024/07/08 by Daliang Xu, Hao Zhang, Xu, Daliang +11 · 18 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Power Line Communications and Noise #VLSI and Analog Circuit Testing
- Listening to Chaotic Whispers: A Deep Learning Framework for News-oriented Stock Trend Prediction
2017/12/06 by Ziniu Hu, Hu, Ziniu, Weiqing Liu +7 · 6 citations
Computer Science · Decision Sciences · Economics, Econometrics and Finance · #Data Stream Mining Techniques #FOS: Computer and information sciences #FOS: Economics and business #Financial Markets and Investment Strategies #Machine Learning (cs.LG) #Social and Information Networks (cs.SI) #Statistical Finance (q-fin.ST) #Stock Market Forecasting Methods #Time Series Analysis and Forecasting
- Rise of the Planet of Serverless Computing: A Systematic Review
2022/06/24 by Jinfeng Wen, Wen, Jinfeng, Zhenpeng Chen +5 · 6 citations
Computer Science · #Cloud Computing and Resource Management #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #IoT and Edge/Fog Computing #Software Engineering (cs.SE)
- LLMCad: Fast and Scalable On-device Large Language Model Inference
2023/09/08 by Xu, Daliang, Yin, Wangsong, Jin, Xin +4 · 6 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Networking and Internet Architecture (cs.NI)
- FaaSLight: General Application-Level Cold-Start Latency Optimization for Function-as-a-Service in Serverless Computing
2022/07/17 by Liu, Xuanzhe, Wen, Jinfeng, Chen, Zhenpeng +5 · 5 citations
#Distributed #FOS: Computer and information sciences #Parallel #Software Engineering (cs.SE) #and Cluster Computing (cs.DC)
- A First Look at Deep Learning Apps on Smartphones
2018/11/08 by Mengwei Xu, Jiawei Liu, Xu, Mengwei +9 · 3 citations
Computer Science · Engineering · #Advanced Malware Detection Techniques #Computers and Society (cs.CY) #FOS: Computer and information sciences #Green IT and Sustainability #IoT and Edge/Fog Computing #Machine Learning (cs.LG)
- Mandheling: Mixed-Precision On-Device DNN Training with DSP Offloading
2022/06/15 by Daliang Xu, Xu, Daliang, Mengwei Xu +15 · 4 citations
Computer Science · Engineering · #Parallel Computing and Optimization Techniques #Advanced Neural Network Applications #Ferroelectric and Negative Capacitance Devices
- Research on WebAssembly Runtimes: A Survey
2024/04/19 by Yixuan Zhang, Mugeng Liu, Zhang, Yixuan +9 · 6 citations
Computer Science · Engineering · #Digital Rights Management and Security #Manufacturing Process and Optimization
- MegaScale-Infer: Serving Mixture-of-Experts at Scale with Disaggregated Expert Parallelism
2025/04/03 by Ruidong Zhu, Zhu, Ruidong, Ziheng Jiang +35 · 14 citations
Computer Science · #Advanced Neural Network Applications #Big Data and Digital Economy #Domain Adaptation and Few-Shot Learning
- LoongTrain: Efficient Training of Long-Sequence LLMs with Head-Context Parallelism
2024/06/26 by Diandian Gu, Gu, Diandian, Peng Sun +25 · 6 citations
Computer Science · #Natural Language Processing Techniques #Handwritten Text Recognition Techniques #Speech Recognition and Synthesis
- An Empirical Study on Deployment Faults of Deep Learning Based Mobile Applications
2021/01/13 by Zhenpeng Chen, Huihan Yao, Chen, Zhenpeng +11 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Software Engineering (cs.SE) #Software Engineering Research #Software System Performance and Reliability #Software Testing and Debugging Techniques
- Promptware Engineering: Software Engineering for Prompt-Enabled Systems
2025/03/04 by Zhenpeng Chen, Chong Wang, Chen, Zhenpeng +10 · 8 citations
Computer Science · #Software Testing and Debugging Techniques #Software Reliability and Analysis Research #Software System Performance and Reliability
- LLM as a System Service on Mobile Devices
2024/03/18 by Wangsong Yin, Yin, Wangsong, Mengwei Xu +5 · 5 citations
Business, Management and Accounting · Computer Science · #Advanced Computational Techniques and Applications #Business Process Modeling and Analysis #FOS: Computer and information sciences #Operating Systems (cs.OS) #Wireless Sensor Networks for Data Analysis
- FinMME: Benchmark Dataset for Financial Multi-Modal Reasoning Evaluation
2025/05/30 by Junyu Luo, Zhizhuo Kou, Luo, Junyu +23 · 11 citations
Decision Sciences · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Stock Market Forecasting Methods
- MegaScale-MoE: Large-Scale Communication-Efficient Training of Mixture-of-Experts Models in Production
2025/05/16 by Jin, Chao, Jiang, Ziheng, Bai, Zhihao +16 · 8 citations
#Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- SCOPE: Performance Testing for Serverless Computing
2023/06/02 by Jinfeng Wen, Wen, Jinfeng, Zhenpeng Chen +9 · 3 citations
Computer Science · #Cloud Computing and Resource Management #Cloud Data Security Solutions #FOS: Computer and information sciences #IoT and Edge/Fog Computing #Software Engineering (cs.SE)
- Characterizing and Detecting WebAssembly Runtime Bugs
2023/01/28 by Yixuan Zhang, Zhang, Yixuan, Shangtong Cao +15 · 2 citations
Computer Science · #FOS: Computer and information sciences #Software Engineering (cs.SE) #Software Engineering Research #Software Engineering Techniques and Practices #Software Testing and Debugging Techniques
- HydraServe: Minimizing Cold Start Latency for Serverless LLM Serving in Public Clouds
2025/02/21 by Chiheng Lou, Sheng Qi, Lou, Chiheng +13 · 5 citations
Computer Science · #Caching and Content Delivery #Distributed #FOS: Computer and information sciences #IoT and Edge/Fog Computing #Parallel #Software-Defined Networks and 5G #and Cluster Computing (cs.DC)
- Bias Behind the Wheel: Fairness Testing of Autonomous Driving Systems
2023/08/05 by Xinyue Li, Li, Xinyue, Zhenpeng Chen +9 · 2 citations
Engineering · Environmental Science · Psychology · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Computers and Society (cs.CY) #FOS: Computer and information sciences #Human-Automation Interaction and Safety #Impact of Light on Environment and Health #Software Engineering (cs.SE) #Traffic and Road Safety
- Benchmarking Bias in Large Language Models during Role-Playing
2024/11/01 by Li, Xinyue, Chen, Zhenpeng, Zhang, Jie M. +5 · 3 citations
#Artificial Intelligence (cs.AI) #Computers and Society (cs.CY) #FOS: Computer and information sciences
- A First Look at Blockchain-based Decentralized Applications
2019/09/03 by Wu, Kaidong, Ma, Yun, Huang, Gang +1 · 1 citation
#FOS: Computer and information sciences #Software Engineering (cs.SE)
- Characterizing Impacts of Heterogeneity in Federated Learning upon Large-Scale Smartphone Data
2020/06/12 by Yang, Chengxu, Wang, Qipeng, Xu, Mengwei +4 · 1 citation
#Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Parallel #and Cluster Computing (cs.DC)
- Don't Fish in Troubled Waters! Characterizing Coronavirus-themed Cryptocurrency Scams
2020/07/27 by Xia, Pengcheng, Wang, Haoyu, Luo, Xiapu +6 · 1 citation
#Cryptography and Security (cs.CR) #FOS: Computer and information sciences
- VM Matters: A Comparison of WASM VMs and EVMs in the Performance of Blockchain Smart Contracts
2020/12/02 by Shuyu Zheng, Haoyu Wang, Zheng, Shuyu +7 · 1 citation
Computer Science · #Blockchain Technology Applications and Security #Cloud Computing and Resource Management #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Security and Verification in Computing #Software Engineering (cs.SE)
- Rise of Distributed Deep Learning Training in the Big Model Era: From a Software Engineering Perspective
2021/12/12 by Xuanzhe Liu, Diandian Gu, Liu, Xuanzhe +13 · 1 citation
Computer Science · Decision Sciences · #FOS: Computer and information sciences #Scientific Computing and Data Management #Software Engineering (cs.SE) #Software Engineering Research #Software System Performance and Reliability
- Benchmarking of DL Libraries and Models on Mobile Devices
2022/02/14 by Qiyang Zhang, Xiang Li, Zhang, Qiyang +15 · 1 citation
Computer Science · Engineering · #Age of Information Optimization #FOS: Computer and information sciences #Green IT and Sustainability #IoT and Edge/Fog Computing #Machine Learning (cs.LG) #Networking and Internet Architecture (cs.NI)
- MuxFlow: Efficient and Safe GPU Sharing in Large-Scale Production Deep Learning Clusters
2023/03/24 by Yihao Zhao, Zhao, Yihao, Xin Liu +13 · 1 citation
Neuroscience · Computer Science · #Brain Tumor Detection and Classification #Cloud Computing and Resource Management #IoT and Edge/Fog Computing
- DeepWear: Adaptive Local Offloading for On-Wearable Deep Learning
2017/12/01 by Mengwei Xu, Feng Qian, Xu, Mengwei +9 · 1 citation
Computer Science · Engineering · #Computers and Society (cs.CY) #Context-Aware Activity Recognition Systems #FOS: Computer and information sciences #Green IT and Sustainability #IoT and Edge/Fog Computing #Machine Learning (cs.LG)
- Federated Neural Architecture Search
2020/02/15 by Yuan, Jinliang, Mengwei Xu, Yuxin Zhao +9 · 2 citations
Computer Science · #Advanced Neural Network Applications #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- A First Look at Bugs in LLM Inference Engines
2025/06/11 by Mugeng Liu, Siqi Zhong, Liu, Mugeng +13 · 1 citation
Computer Science · #Adversarial Robustness in Machine Learning #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning and Data Classification #Software Engineering (cs.SE)
- TokenLake: A Unified Segment-level Prefix Cache Pool for Fine-grained Elastic Long-Context LLM Serving
2025/08/24 by Wu, Bingyang, Zhang, Zili, Zhong, Yinmin +4 · 2 citations
#Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- BAMAS: Structuring Budget-Aware Multi-Agent Systems
2025/11/26 by Liming Yang, Junyu Luo, Yang, Liming +7 · 2 citations
Computer Science · #Multimodal Machine Learning Applications #Big Data and Digital Economy #Reinforcement Learning in Robotics