Zhang, Chenqi
- ClusterKV: Manipulating LLM KV Cache in Semantic Space for Recallable Compression
2024/12/04 by Liu, Guangda, Li, Chengwei, Zhao, Jieru +2 · 19 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Performance (cs.PF)