Ruihang Lai

1. FlashInfer: Efficient and Customizable Attention Engine for LLM Inference Serving
   2025/01/02 by Zihao Ye, Ye, Zihao, Lequn Chen +19 · 68 citations
   Computer Science · Decision Sciences · #Artificial Intelligence (cs.AI) #Data Quality and Management #Digital and Cyber Forensics #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Scientific Computing and Data Management #and Cluster Computing (cs.DC)
2. Event Tensor: A Unified Abstraction for Compiling Dynamic Megakernel
   2026/04/14 by Hongyi Jin, Bohan Hou, Guanjie Wang +18 · 4 voices
   #cs.DC #cs.LG #cs.PL
3. Tensor Program Optimization with Probabilistic Programs
   2022/05/26 by Junru Shao, Shao, Junru, Xiyou Zhou +17 · 11 citations
   Computer Science · Mathematics · #Parallel Computing and Optimization Techniques #Computational Physics and Python Applications #Tensor decomposition and applications
4. XGrammar: Flexible and Efficient Structured Generation Engine for Large Language Models
   2024/11/22 by Yixin Dong, Charlie F. Ruan, Dong, Yixin +11 · 14 citations
   Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Programming Languages (cs.PL) #Topic Modeling
5. SparseTIR: Composable Abstractions for Sparse Compilation in Deep Learning
   2022/07/11 by Zihao Ye, Ye, Zihao, Ruihang Lai +7 · 6 citations
   Computer Science · Mathematics · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel Computing and Optimization Techniques #Programming Languages (cs.PL) #Tensor decomposition and applications
6. MPK: A Compiler and Runtime for Mega-Kernelizing Tensor Programs
   2025/12/22 by Xinhao Cheng, Zhihao Zhang, Cheng, Xinhao +37 · 2 citations
   Computer Science · #Advanced Neural Network Applications #Parallel Computing and Optimization Techniques #Graph Theory and Algorithms