vix.ing · top · new · best · stats · spec

1. S-LoRA: Serving Thousands of Concurrent LoRA Adapters
   2023/11/06 by Ying Sheng, Shiyi Cao, Sheng, Ying +21 · 2 voices · 45 citations
   Computer Science · #Adapter (computing) #Advanced Neural Network Applications #CUDA #Cache #Computer network #Computer science #Operating system #Overhead (engineering) #Paging #Parallel Computing and Optimization Techniques #Parallel computing #Scalability #Topic Modeling
2. Efficient Memory Management for Large Language Model Serving with PagedAttention
   2023/09/12 by Woosuk Kwon, Kwon, Woosuk, Zhuohan Li +15 · 4 voices · 2447 citations
   Computer Science · #CPU cache #Cache #Cache algorithms #Cache coloring #Cache pollution #Caching and Content Delivery #Computer network #Computer science #Demand paging #Latency (audio) #Memory management #Operating system #Overlay #Page cache #Paging #Parallel computing #Software System Performance and Reliability #Topic Modeling #Virtual memory #cs.DC #cs.LG