Junhao Hu
- MemServe: Context Caching for Disaggregated LLM Serving with Elastic Memory Pool
2024/06/25 by Cunchen Hu, Hu, Cunchen, Heyang Huang +19 · 20 citations
Computer Science · #Energy Efficient Wireless Sensor Networks #Caching and Content Delivery #Context-Aware Activity Recognition Systems
- EPIC: Efficient Position-Independent Caching for Serving Large Language Models
2024/10/20 by Junhao Hu, Wenrui Huang, Hu, Junhao +15 · 8 citations
Computer Science · #Computation and Language (cs.CL) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Performance (cs.PF) #Recommender Systems and Techniques #Speech and dialogue systems #Topic Modeling #and Cluster Computing (cs.DC)
- DeepServe: Serverless Large Language Model Serving at Scale
2025/01/24 by Junhao Hu, Hu, Junhao, Jiang Xu +36 · 7 citations
Computer Science · #Distributed #FOS: Computer and information sciences #Parallel #Topic Modeling #and Cluster Computing (cs.DC)
- The Strong Convergence and Stability of Explicit Approximations for Nonlinear Stochastic Delay Differential Equations
2020/08/19 by Guoting Song, Junhao Hu, Song, Guoting +5 · 3 citations
Economics, Econometrics and Finance · Mathematics · Social Sciences · #Stochastic processes and financial applications #Differential Equations and Numerical Methods #Insurance, Mortality, Demography, Risk Management
- Practitioners' Expectations on Code Completion
2023/01/10 by Chaozheng Wang, Wang, Chaozheng, Junhao Hu +13 · 2 citations
Computer Science · #Cloud Computing and Resource Management #FOS: Computer and information sciences #Software Engineering (cs.SE) #Software Engineering Research #Software System Performance and Reliability
- RLinf: Flexible and Efficient Large-scale Reinforcement Learning via Macro-to-Micro Flow Transformation
2025/09/19 by Chao Yu, Yuanqing Wang, Yu, Chao +52 · 7 citations
Computer Science · #Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Reinforcement Learning in Robotics #and Cluster Computing (cs.DC)
- MPIC: Position-Independent Multimodal Context Caching System for Efficient MLLM Serving
2025/02/04 by Shiju Zhao, Zhao, Shiju, Junhao Hu +6 · 2 citations
Computer Science · Engineering · #Context-Aware Activity Recognition Systems #Robotics and Automated Systems #IPv6, Mobility, Handover, Networks, Security
- When Does Recurrence Become an Algorithm? Convergence Selection in Weight-Tied Looped Transformers
2026/07/22 by Tong Zhang, Junhao Hu, Yun Peng +1
#cs.LG #cs.AI #stat.ML