- Efficient Memory Management for Large Language Model Serving with PagedAttention
2023/09/12 by Woosuk Kwon, Zhuohan Li, Kwon, Woosuk +15 · 4 voices · 2485 citations
Computer Science · #CPU cache #Cache #Cache algorithms #Cache coloring #Cache pollution #Caching and Content Delivery #Computer network #Computer science #Demand paging #Latency (audio) #Memory management #Operating system #Overlay #Page cache #Paging #Parallel computing #Software System Performance and Reliability #Topic Modeling #Virtual memory #cs.DC #cs.LG