Wang, Sa
- Inference without Interference: Disaggregate LLM Inference for Mixed Downstream Workloads
2024/01/20 by Cunchen Hu, Hu, Cunchen, Heyang Huang +21 · 43 citations
Computer Science · Engineering · #Cloud Computing and Resource Management #Distributed #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Parallel #Topic Modeling #and Cluster Computing (cs.DC)
- MemServe: Context Caching for Disaggregated LLM Serving with Elastic Memory Pool
2024/06/25 by Cunchen Hu, Heyang Huang, Hu, Cunchen +19 · 29 citations
Computer Science · #Energy Efficient Wireless Sensor Networks #Caching and Content Delivery #Context-Aware Activity Recognition Systems
- Medium modifications of heavy-flavor jet angularities in high-energy nuclear collisions
2024/09/19 by Yao Li, Li, Yao, Shiyong Chen +7 · 1 citation
Physics and Astronomy · #High-Energy Particle Collisions Research #Gamma-ray bursts and supernovae #Particle physics theoretical and experimental studies
- DDiT: Dynamic Resource Allocation for Diffusion Transformer Model Serving
2025/06/16 by C.-C. Hu, Huang, Heyang, Hu, Cunchen +14 · 2 citations
Computer Science · #Distributed #FOS: Computer and information sciences #Neural Networks and Applications #Parallel #and Cluster Computing (cs.DC)