Yuan, Zhihang
- Post-training Quantization on Diffusion Models
2022/11/28 by Yuzhang Shang, Zhihang Yuan, Shang, Yuzhang +7 · 44 citations
Computer Science · Medicine · Physics and Astronomy · #Advanced Neuroimaging Techniques and Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Model Reduction and Neural Networks
- PTQ4ViT: Post-training quantization for vision transformers with twin uniform quantization
2021/11/24 by Zhihang Yuan, Yuan, Zhihang, Chenhao Xue +7 · 25 citations
Computer Science · Engineering · #Advanced Image and Video Retrieval Techniques #Infrared Target Detection Methodologies #Image Processing Techniques and Applications
- A Survey on Efficient Inference for Large Language Models
2024/04/22 by Zixuan Zhou, Xuefei Ning, Zhou, Zixuan +27 · 36 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech Recognition and Synthesis
- ASVD: Activation-aware Singular Value Decomposition for Compressing Large Language Models
2023/12/10 by Zhihang Yuan, Yuan, Zhihang, Yuzhang Shang +10 · 27 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech Recognition and Synthesis
- LLM Inference Unveiled: Survey and Roofline Model Insights
2024/02/26 by Zhihang Yuan, Yuan, Zhihang, Yuzhang Shang +24 · 28 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Mathematics, Computing, and Information Processing
- DiTFastAttn: Attention Compression for Diffusion Transformer Models
2024/06/12 by Zhihang Yuan, Hanling Zhang, Yuan, Zhihang +15 · 29 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Neural Networks and Applications
- PB-LLM: Partially Binarized Large Language Models
2023/09/29 by Yuzhang Shang, Shang, Yuzhang, Zhihang Yuan +5 · 12 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- PD-Quant: Post-Training Quantization based on Prediction Difference Metric
2022/12/14 by Jiawei Liu, Lin Niu, Liu, Jiawei +9 · 10 citations
Computer Science · #Advanced Neural Network Applications #Advanced Image and Video Retrieval Techniques #Machine Learning and Data Classification
- OstQuant: Refining Large Language Model Quantization with Orthogonal and Scaling Transformations for Better Distribution Fitting
2025/01/23 by Hu, Xing, Cheng, Yuan, Yang, Dawei +6 · 20 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- RPTQ: Reorder-based Post-training Quantization for Large Language Models
2023/04/03 by Zhihang Yuan, Lin Niu, Yuan, Zhihang +17 · 7 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- QuEST: Low-bit Diffusion Model Quantization via Efficient Selective Finetuning
2024/02/06 by Wang, Haoxuan, Shang, Yuzhang, Yuan, Zhihang +3 · 9 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- WKVQuant: Quantizing Weight and Key/Value Cache for Large Language Models Gains More
2024/02/19 by Yue, Yuxuan, Yuan, Zhihang, Duanmu, Haojie +3 · 8 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Information Entropy Guided Height-aware Histogram for Quantization-friendly Pillar Feature Encoder
2024/05/29 by Sifan Zhou, Zhihang Yuan, Zhou, Sifan +12 · 6 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image Retrieval and Classification Techniques #Robotics (cs.RO) #Video Analysis and Summarization
- I-LLM: Efficient Integer-Only Inference for Fully-Quantized Low-Bit Large Language Models
2024/05/28 by Hu, Xing, Cheng, Yuan, Yang, Dawei +4 · 1 voice · 4 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- MQuant: Unleashing the Inference Potential of Multimodal Large Language Models via Full Static Quantization
2025/02/01 by Yu, JiangYong, Zhou, Sifan, Yang, Dawei +7 · 8 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- SKVQ: Sliding-window Key and Value Cache Quantization for Large Language Models
2024/05/10 by Duanmu, Haojie, Yuan, Zhihang, Li, Xiuhong +3 · 4 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- MxMoE: Mixed-precision Quantization for MoE with Accuracy and Performance Co-Design
2025/05/09 by Haojie Duanmu, Xiuhong Li, Duanmu, Haojie +11 · 9 citations
Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Mobile Crowdsensing and Crowdsourcing #Stochastic Gradient Optimization Techniques
- LiteVAR: Compressing Visual Autoregressive Modelling with Efficient Attention and Quantization
2024/11/26 by Rui Xie, Xie, Rui, Tianchen Zhao +13 · 5 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image Retrieval and Classification Techniques
- A Closer Look at Time Steps is Worthy of Triple Speed-Up for Diffusion Model Training
2024/05/27 by Kai Wang, Wang, Kai, Mingjia Shi +14 · 4 citations
Physics and Astronomy · #Model Reduction and Neural Networks
- GSQ-Tuning: Group-Shared Exponents Integer in Fully Quantized Training for LLMs On-Device Fine-tuning
2025/02/18 by Sifan Zhou, Shuo Wang, Zhou, Sifan +8 · 7 citations
Engineering · #Advancements in Photolithography Techniques #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- MIM4DD: Mutual Information Maximization for Dataset Distillation
2023/12/27 by Shang, Yuzhang, Yuan, Zhihang, Yan, Yan · 4 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- DiTFastAttnV2: Head-wise Attention Compression for Multi-Modality Diffusion Transformers
2025/03/28 by Zhang, Hanling, Su, Rundong, Yuan, Zhihang +5 · 6 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- MambaQuant: Quantizing the Mamba Family with Variance Aligned Rotation Methods
2025/01/23 by Xu, Zukang, Yue, Yuxuan, Hu, Xing +7 · 6 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- MVCTrack: Boosting 3D Point Cloud Tracking via Multimodal-Guided Virtual Cues
2024/12/03 by Hu, Zhaofeng, Zhou, Sifan, Yuan, Zhihang +3 · 4 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Robotics (cs.RO)
- Latency-aware Unified Dynamic Networks for Efficient Image Recognition
2023/08/30 by Han, Yizeng, Liu, Zeyu, Yuan, Zhihang +4 · 2 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- MoEQuant: Enhancing Quantization for Mixture-of-Experts Large Language Models via Expert-Balanced Sampling and Affinity Guidance
2025/05/02 by Hu, Xing, Chen, Zhixuan, Yang, Dawei +5 · 7 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- ENAS4D: Efficient Multi-stage CNN Architecture Search for Dynamic Inference
2020/09/19 by Yuan, Zhihang, Liu, Xin, Wu, Bingzhe +1 · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Post-Training Quantization for Re-parameterization via Coarse & Fine Weight Splitting
2023/12/17 by Yang, Dawei, He, Ning, Hu, Xing +4 · 3 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #I.2.0
- Learning High-Frequency Functions Made Easy with Sinusoidal Positional Encoding
2024/07/12 by Chuanhao Sun, Zhihang Yuan, Sun, Chuanhao +10 · 2 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Speech and Audio Processing
- R2R: Efficiently Navigating Divergent Reasoning Paths with Small-Large Model Token Routing
2025/05/27 by Tianyu Fu, Fu, Tianyu, Yi Ge +14 · 6 citations
Computer Science · Materials Science · #Topic Modeling #Natural Language Processing Techniques #Machine Learning in Materials Science
- Spec-VLA: Speculative Decoding for Vision-Language-Action Models with Relaxed Acceptance
2025/07/30 by Wang, Songsheng, Yu, Rucheng, Yuan, Zhihang +4 · 6 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- PillarTrack:Boosting Pillar Representation for Transformer-based 3D Single Object Tracking on Point Clouds
2024/04/11 by Weisheng Xu, Xu, Weisheng, Sifan Zhou +4 · 2 citations
Computer Science · #Video Surveillance and Tracking Methods #Human Pose and Action Recognition #Advanced Neural Network Applications
- SplitMeanFlow: Interval Splitting Consistency in Few-Step Generative Modeling
2025/07/22 by Guo, Yi, Wang, Wei, Yuan, Zhihang +8 · 5 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Benchmarking the Reliability of Post-training Quantization: a Particular Focus on Worst-case Performance
2023/03/23 by Yuan, Zhihang, Liu, Jiawei, Wu, Jiaxiang +6 · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- VGDFR: Diffusion-based Video Generation with Dynamic Latent Frame Rate
2025/04/16 by Zhihang Yuan, Rui Xie, Yuan, Zhihang +12 · 2 citations
Computer Science · #Generative Adversarial Networks and Image Synthesis #Advanced Vision and Imaging #Video Analysis and Summarization
- Latency-aware Spatial-wise Dynamic Networks
2022/10/12 by Han, Yizeng, Yuan, Zhihang, Pu, Yifan +4 · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- DLFR-VAE: Dynamic Latent Frame Rate VAE for Video Generation
2025/02/17 by Yuan, Zhihang, Wang, Siyuan, Xie, Rui +6 · 1 citation
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- SAFEx: Analyzing Vulnerabilities of MoE-Based LLMs via Stable Safety-critical Expert Identification
2025/06/20 by Lai, Zhenglin, Liao, Mengyao, Wu, Bingzhe +5 · 2 citations
#Artificial Intelligence (cs.AI) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- E-CAR: Efficient Continuous Autoregressive Image Generation via Multistage Modeling
2024/12/18 by Yuan, Zhihang, Shang, Yuzhang, Zhang, Hanling +7 · 1 citation
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- INT v.s. FP: A Comprehensive Study of Fine-Grained Low-bit Quantization Formats
2025/10/29 by Chen, Mengzhao, Wu, Meng, Jin, Hui +10 · 3 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG)