Jinwei Yao
- DeFT: Decoding with Flash Tree-attention for Efficient Tree-structured LLM Inference
2024/03/30 by Jinwei Yao, Kaiqi Chen, Yao, Jinwei +11 · 4 citations
Computer Science · #Advanced Data Storage Technologies #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Mathematics, Computing, and Information Processing #Web Data Mining and Analysis