Ruihao Gong
- Differentiable Soft Quantization: Bridging Full-Precision and Low-Bit Neural Networks
2019/08/14 by Ruihao Gong, Xianglong Liu, Gong, Ruihao +13 · 16 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #FOS: Electrical engineering #Image and Video Processing (eess.IV) #Machine Learning (cs.LG) #electronic engineering #information engineering
- Outlier Suppression+: Accurate quantization of large language models by equivalent and optimal shifting and scaling
2023/04/18 by Xiuying Wei, Yuncheng Zhang, Wei, Xiuying +11 · 16 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- Outlier Suppression: Pushing the Limit of Low-bit Transformer Language Models
2022/09/27 by Xiuying Wei, Wei, Xiuying, Yuncheng Zhang +13 · 14 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- TFMQ-DM: Temporal Feature Maintenance Quantization for Diffusion Models
2023/11/27 by Yushi Huang, Ruihao Gong, Huang, Yushi +7 · 15 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Medical Image Segmentation Techniques
- A Free Lunch From ANN: Towards Efficient, Accurate Spiking Neural Networks Calibration
2021/06/13 by Yuhang Li, Li, Yuhang, Shikuang Deng +7 · 8 citations
Computer Science · Engineering · Neuroscience · #Advanced Memory and Neural Computing #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Neural Networks and Reservoir Computing #Neural dynamics and brain function
- MQBench: Towards Reproducible and Deployable Model Quantization Benchmark
2021/11/05 by Yuhang Li, Mingzhu Shen, Li, Yuhang +15 · 8 citations
Computer Science · Engineering · #Advanced Neural Network Applications #CCD and CMOS Imaging Sensors #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel Computing and Optimization Techniques
- Exploring the Relationship between Architecture and Adversarially Robust Generalization
2022/09/28 by Aishan Liu, Shiyu Tang, Liu, Aishan +10 · 8 citations
Computer Science · Engineering · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #FOS: Computer and information sciences #Integrated Circuits and Semiconductor Failure Analysis #Machine Learning (cs.LG)
- A Survey of Low-bit Large Language Models: Basics, Systems, and Algorithms
2024/09/25 by Ruihao Gong, Yifu Ding, Gong, Ruihao +17 · 6 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural Networks and Applications #Speech Recognition and Synthesis #Topic Modeling
- HarmoniCa: Harmonizing Training and Inference for Better Feature Caching in Diffusion Transformer Acceleration
2024/10/02 by Yushi Huang, Huang, Yushi, Zining Wang +10 · 5 citations
Engineering · Materials Science · #Advancements in Photolithography Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Magnetic Properties and Applications #Non-Destructive Testing Techniques
- ProPD: Dynamic Token Tree Pruning and Generation for LLM Parallel Decoding
2024/02/21 by Shuzhang Zhong, Zhong, Shuzhang, Zebin Yang +9 · 3 citations
Computer Science · #Advanced Data Storage Technologies #Computation and Language (cs.CL) #Digital Rights Management and Security #FOS: Computer and information sciences #Machine Learning (cs.LG) #VLSI and Analog Circuit Testing
- Temporal Feature Matters: A Framework for Diffusion Model Quantization
2024/07/28 by Yushi Huang, Huang, Yushi, Ruihao Gong +11 · 2 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Neural Networks and Applications
- 2023 Low-Power Computer Vision Challenge (LPCVC) Summary
2024/03/11 by Yi Chen, Chen, Leo, Ping Hu +55 · 1 citation
Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Industrial Vision Systems and Defect Detection
- QVGen: Pushing the Limit of Quantized Video Generative Models
2025/05/16 by Yushi Huang, Huang, Yushi, Ruihao Gong +11 · 6 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis
- PTSBench: A Comprehensive Post-Training Sparsity Benchmark Towards Algorithms and Models
2024/12/10 by Zining Wnag, Jinyang Guo, Wnag, Zining +13 · 2 citations
Engineering · Materials Science · #Reservoir Engineering and Simulation Methods #Advanced Data Processing Techniques #Graphite, nuclear technology, radiation studies
- TokenSim: Enabling Hardware and Software Exploration for Large Language Model Inference Systems
2025/03/11 by Feiyang Wu, Wu, Feiyang, Bian, Zhuohang +13 · 1 citation
Computer Science · #Distributed #FOS: Computer and information sciences #Natural Language Processing Techniques #Parallel #Topic Modeling #and Cluster Computing (cs.DC)
- Hierarchical Balance Packing: Towards Efficient Supervised Fine-tuning for Long-Context LLM
2025/03/10 by Yongqiang Yao, Jingru Tan, Yao, Yongqiang +16 · 1 citation
Computer Science · Engineering · #Digital Rights Management and Security #Natural Language Processing Techniques #Vehicle License Plate Recognition