Junchen Jiang

1. DroidSpeak: KV Cache Sharing for Cross-LLM Communication and Multi-LLM Serving
   2024/11/05 by Yuhan Liu, Yuyang Huang, Liu, Yuhan +21 · 7 voices · 11 citations
   Computer Science · #Service-Oriented Architecture and Web Services #Network Security and Intrusion Detection
2. CacheBlend: Fast Large Language Model Serving for RAG with Cached Knowledge Fusion
   2024/05/26 by Jiayi Yao, Hanchen Li, Yao, Jiayi +15 · 69 citations
   Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
3. Ekya: Continuous Learning of Video Analytics Models on Edge Compute\n Servers
   2020/12/18 by Romil Bhardwaj, Zhengxu Xia, Bhardwaj, Romil +15 · 12 citations
   Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Data Stream Mining Techniques #Distributed #FOS: Computer and information sciences #Image Enhancement Techniques #Parallel #and Cluster Computing (cs.DC)
4. LMCache: An Efficient KV Cache Layer for Enterprise-Scale LLM Inference
   2025/10/08 by Yuhan Liu, Liu, Yuhan, Yihua Cheng +20 · 2 voices · 24 citations
   Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Parallel Computing and Optimization Techniques #Topic Modeling #cs.LG
5. SENSEI: Aligning Video Streaming Quality with Dynamic User Sensitivity
   2020/08/11 by Xu Zhang, Yiyang Ou, Zhang, Xu +5 · 4 citations
   Computer Science · #FOS: Computer and information sciences #Image and Video Quality Assessment #Multimedia (cs.MM) #Networking and Internet Architecture (cs.NI) #Video Coding and Compression Technologies #Visual Attention and Saliency Detection
6. GRACE: Loss-Resilient Real-Time Video through Neural Codecs
   2023/05/21 by Yihua Cheng, Cheng, Yihua, Ziyi Zhang +16 · 5 citations
   Computer Science · Engineering · #Artificial Intelligence (cs.AI) #CCD and CMOS Imaging Sensors #FOS: Computer and information sciences #Image and Video Quality Assessment #Multimedia (cs.MM) #Networking and Internet Architecture (cs.NI) #Video Coding and Compression Technologies
7. PrefillOnly: An Inference Engine for Prefill-only Workloads in Large Language Model Applications
   2025/05/12 by Kuntai Du, Du, Kuntai, Bowen Wang +19 · 13 citations
   Computer Science · Materials Science · #Big Data and Digital Economy #Distributed #FOS: Computer and information sciences #Machine Learning in Materials Science #Natural Language Processing Techniques #Parallel #and Cluster Computing (cs.DC)
8. Earth+: On-Board Satellite Imagery Compression Leveraging Historical Earth Observations
   2024/03/18 by Kuntai Du, Yihua Cheng, Du, Kuntai +8 · 5 citations
   Computer Science · Environmental Science · #Advanced Computational Techniques and Applications #Distributed #FOS: Computer and information sciences #Methane Hydrates and Related Phenomena #Networking and Internet Architecture (cs.NI) #Parallel #and Cluster Computing (cs.DC)
9. Do Large Language Models Need a Content Delivery Network?
   2024/09/16 by Yihua Cheng, Kuntai Du, Cheng, Yihua +5 · 7 citations
   Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Topic Modeling
10. Pano: Optimizing 360° Video Streaming with a Better Understanding of Quality Perception
    2019/11/11 by Yu Guan, Chengyuan Zheng, Guan, Yu +7 · 2 citations
    Computer Science · #FOS: Computer and information sciences #Image and Video Quality Assessment #Multimedia (cs.MM) #Visual Attention and Saliency Detection
11. Scaling Video Analytics Systems to Large Camera Deployments
    2018/09/07 by Samvit Jain, Ganesh Ananthanarayanan, Jain, Samvit +7 · 2 citations
    Computer Science · #Anomaly Detection Techniques and Applications #Computer Vision and Pattern Recognition (cs.CV) #Distributed #FOS: Computer and information sciences #Image and Video Quality Assessment #Parallel #Video Surveillance and Tracking Methods #and Cluster Computing (cs.DC)
12. HyperRAG: Enhancing Quality-Efficiency Tradeoffs in Retrieval-Augmented Generation with Reranker KV-Cache Reuse
    2025/04/03 by Yuwei An, Yihua Cheng, An, Yuwei +5 · 4 citations
    Computer Science · #Natural Language Processing Techniques #Topic Modeling #Speech Recognition and Synthesis
13. AccMPEG: Optimizing Video Encoding for Video Analytics
    2022/04/26 by Kuntai Du, Qizheng Zhang, Du, Kuntai +9 · 1 citation
    Computer Science · Engineering · #Advanced Neural Network Applications #CCD and CMOS Imaging Sensors #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimedia (cs.MM) #Networking and Internet Architecture (cs.NI) #Visual Attention and Saliency Detection
14. Bandwidth-Efficient Multi-video Prefetching for Short Video Streaming
    2022/06/20 by Xutong Zuo, Yishu Li, Zuo, Xutong +15 · 1 citation
    Computer Science · #Caching and Content Delivery #FOS: Computer and information sciences #Image and Video Quality Assessment #Multimedia (cs.MM) #Networking and Internet Architecture (cs.NI) #Peer-to-Peer Network Technologies
15. LLMSteer: Improving Long-Context LLM Inference by Steering Attention on Reused Contexts
    2024/11/20 by Zhaoquan Gu, Gu, Zhuohan, Jiayi Yao +5 · 2 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques
16. VeriCache: Turning Lossy KV Cache into Lossless LLM Inference
    2026/05/17 by Jiayi Yao, Samuel Shen, Kuntai Du +7 · 1 voice
    Computer Science · #cs.AR #cs.LG
17. AdaptCache: KV Cache Native Storage Hierarchy for Low-Delay and High-Quality Language Model Serving
    2025/08/28 by Shaoting Feng, Hanchen Li, Feng, Shaoting +19 · 2 citations
    Computer Science · #Advanced Data Storage Technologies #Artificial Intelligence (cs.AI) #Big Data and Digital Economy #FOS: Computer and information sciences #Machine Learning (cs.LG) #Operating Systems (cs.OS) #Parallel Computing and Optimization Techniques
18. ShadowServe: Interference-Free KV Cache Fetching for Distributed Prefix Caching
    2025/09/21 by Xingyu Xiang, Raj Joshi, Xiang, Xingyu +15 · 1 citation
    Computer Science · #Algorithms and Data Compression #Artificial Intelligence (cs.AI) #Caching and Content Delivery #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Network Packet Processing and Optimization #Parallel #and Cluster Computing (cs.DC)
19. An Internet for the KV Cache: Rethinking Classical Infrastructure Boundaries in the LLM Inference Age
    2026/08/02 by Siddhant Ray, Nick Feamster, Junchen Jiang
    Computer Science · #cs.NI