Bao, Yungang
- Inference without Interference: Disaggregate LLM Inference for Mixed Downstream Workloads
2024/01/20 by Cunchen Hu, Hu, Cunchen, Heyang Huang +21 · 31 citations
Computer Science · Engineering · #Cloud Computing and Resource Management #Distributed #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Parallel #Topic Modeling #and Cluster Computing (cs.DC)
- MemServe: Context Caching for Disaggregated LLM Serving with Elastic Memory Pool
2024/06/25 by Cunchen Hu, Heyang Huang, Hu, Cunchen +19 · 18 citations
Computer Science · #Energy Efficient Wireless Sensor Networks #Caching and Content Delivery #Context-Aware Activity Recognition Systems
- HMTT: A Hybrid Hardware/Software Tracing System for Bridging Memory Trace's Semantic Gap
2011/06/13 by Yungang Bao, Jinyong Zhang, Bao, Yungang +11 · 1 citation
Computer Science · #Advanced Data Storage Technologies #FOS: Computer and information sciences #Hardware Architecture (cs.AR) #Parallel Computing and Optimization Techniques #Performance (cs.PF) #Security and Verification in Computing
- iEDA: An Open-Source Intelligent Physical Implementation Toolkit and Library
2023/08/03 by Li, Xingquan, Tao, Simin, Huang, Zengrong +53 · 3 citations
#FOS: Computer and information sciences #Hardware Architecture (cs.AR)
- DDiT: Dynamic Resource Allocation for Diffusion Transformer Model Serving
2025/06/16 by C.-C. Hu, Huang, Heyang, Hu, Cunchen +14 · 2 citations
Computer Science · #Distributed #FOS: Computer and information sciences #Neural Networks and Applications #Parallel #and Cluster Computing (cs.DC)