vix.ing · top · new · best · stats · spec

Xing, Zeyu

  1. KVTuner: Sensitivity-Aware Layer-Wise Mixed-Precision KV Cache Quantization for Efficient and Nearly Lossless LLM Inference
    2025/02/06 by Li, Xing, Xing, Zeyu, Li, Yiming +6 · 5 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)