Huang, Heyang

1. Inference without Interference: Disaggregate LLM Inference for Mixed Downstream Workloads
   2024/01/20 by Cunchen Hu, Heyang Huang, Hu, Cunchen +21 · 43 citations
   Computer Science · Engineering · #Cloud Computing and Resource Management #Distributed #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Parallel #Topic Modeling #and Cluster Computing (cs.DC)
2. MemServe: Context Caching for Disaggregated LLM Serving with Elastic Memory Pool
   2024/06/25 by Cunchen Hu, Heyang Huang, Hu, Cunchen +19 · 29 citations
   Computer Science · #Energy Efficient Wireless Sensor Networks #Caching and Content Delivery #Context-Aware Activity Recognition Systems
3. DDiT: Dynamic Resource Allocation for Diffusion Transformer Model Serving
   2025/06/16 by C.-C. Hu, Huang, Heyang, Hu, Cunchen +14 · 2 citations
   Computer Science · #Distributed #FOS: Computer and information sciences #Neural Networks and Applications #Parallel #and Cluster Computing (cs.DC)