Minchen Yu
- Torpor: GPU-Enabled Serverless Computing for Low-Latency, Resource-Efficient Inference
2023/06/06 by Minchen Yu, Ao Wang, Yu, Minchen +18 · 5 citations
Computer Science · #Network Security and Intrusion Detection #Software System Performance and Reliability #IoT and Edge/Fog Computing
- CaraServe: CPU-Assisted and Rank-Aware LoRA Serving for Generative LLM Inference
2024/01/20 by Suyi Li, Hanfeng Lu, Li, Suyi +15 · 4 citations
Computer Science · #Distributed #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Natural Language Processing Techniques #Parallel #Topic Modeling #and Cluster Computing (cs.DC)