Andrei-Octavian Brabete
- ServerlessLLM: Low-Latency Serverless Inference for Large Language Models
2024/01/25 by Yao Fu, Leyang Xue, Fu, Yao +11 · 1 voice · 33 citations
Computer Science · Engineering · #Distributed #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Parallel #Privacy-Preserving Technologies in Data #Topic Modeling #and Cluster Computing (cs.DC) #cs.DC #cs.LG