vix.ing · top · new · best · stats · spec

Xie, Xike

  1. Ada-KV: Optimizing KV Cache Eviction by Adaptive Budget Allocation for Efficient LLM Inference
    2024/07/16 by Yuan Feng, Feng, Yuan, Junlin Lv +7 · 63 citations
    Computer Science · #Advanced Data Storage Technologies #Distributed and Parallel Computing Systems #Advanced Data Compression Techniques