Heyang Huang
- Inference without Interference: Disaggregate LLM Inference for Mixed Downstream Workloads
2024/01/20 by Cunchen Hu, Heyang Huang, Hu, Cunchen +21 · 31 citations
Computer Science · Engineering · #Cloud Computing and Resource Management #Distributed #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Parallel #Topic Modeling #and Cluster Computing (cs.DC)
- MemServe: Context Caching for Disaggregated LLM Serving with Elastic Memory Pool
2024/06/25 by Cunchen Hu, Hu, Cunchen, Heyang Huang +19 · 18 citations
Computer Science · #Energy Efficient Wireless Sensor Networks #Caching and Content Delivery #Context-Aware Activity Recognition Systems
- Environment Design for Reliable Shared Autonomy with Probabilistic Guarantees
2026/07/16 by Yi-Shiuan Tung, Himanshu Gupta, Gyanig Kumar +3
#cs.RO