Pengle Zhang

1. InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context Memory
   2024/02/07 by Chaojun Xiao, Xiao, Chaojun, Pengle Zhang +13 · 43 citations
   Computer Science · #Neural Networks and Applications
2. SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference Acceleration
   2024/10/03 by Jintao Zhang, Zhang, Jintao, Wei Jia +8 · 34 citations
   Computer Science · #Anomaly Detection Techniques and Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Seismology and Earthquake Studies
3. SageAttention2: Efficient Attention with Thorough Outlier Smoothing and Per-thread INT4 Quantization
   2024/11/17 by Jintao Zhang, Haofeng Huang, Zhang, Jintao +9 · 25 citations
   Computer Science · Medicine · #Anomaly Detection Techniques and Applications #COVID-19 diagnosis using AI #Seismology and Earthquake Studies
4. SageAttention3: Microscaling FP4 Attention for Inference and An Exploration of 8-Bit Training
   2025/05/16 by Jintao Zhang, Wei Jia, Zhang, Jintao +15 · 14 citations
   Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Big Data and Digital Economy #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Hardware Architecture (cs.AR) #Machine Learning (cs.LG) #Performance (cs.PF)
5. SageAttention2++: A More Efficient Implementation of SageAttention2
   2025/05/27 by Jintao Zhang, Xiaoming Xu, Zhang, Jintao +13 · 7 citations
   Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Hardware Architecture (cs.AR) #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
6. Accurate INT8 Training Through Dynamic Block-Level Fallback
   2025/03/11 by Pengle Zhang, Zhang, Pengle, Jia Wei +7 · 3 citations
   Computer Science · #Advanced Neural Network Applications #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Parallel Computing and Optimization Techniques