Shi, Huihong
- ViTCoD: Vision Transformer Acceleration via Dedicated Algorithm and Accelerator Co-Design
2022/10/18 by Haoran You, Zhanyi Sun, You, Haoran +15 · 11 citations
Computer Science · Engineering · #Advanced Neural Network Applications #CCD and CMOS Imaging Sensors #Visual Attention and Saliency Detection
- Instant-3D: Instant Neural Radiance Field Training Towards On-Device AR/VR 3D Reconstruction
2023/04/24 by Sixu Li, Chaojian Li, Li, Sixu +13 · 12 citations
Computer Science · Engineering · #3D Shape Modeling and Analysis #Advanced Neural Network Applications #Advanced Vision and Imaging #FOS: Computer and information sciences #Hardware Architecture (cs.AR)
- Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibration
2024/06/22 by Zhongzhi Yu, Zheng Wang, Yu, Zhongzhi +9 · 17 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization
2024/06/10 by Haoran You, Yipin Guo, You, Haoran +15 · 11 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Handwritten Text Recognition Techniques #Machine Learning (cs.LG) #Mathematics, Computing, and Information Processing #Natural Language Processing Techniques
- ViTALiTy: Unifying Low-rank and Sparse Approximation for Vision Transformer Acceleration with a Linear Taylor Attention
2022/11/09 by Jyotikrishna Dass, Shang Wu, Dass, Jyotikrishna +11 · 5 citations
Engineering · #CCD and CMOS Imaging Sensors #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Hardware Architecture (cs.AR) #Infrared Target Detection Methodologies #Machine Learning (cs.LG) #Sparse and Compressive Sensing Techniques
- ShiftAddViT: Mixture of Multiplication Primitives Towards Efficient Vision Transformer
2023/06/10 by Haoran You, Huihong Shi, You, Haoran +5 · 1 citation
Computer Science · Engineering · #Advanced Neural Network Applications #Advanced Memory and Neural Computing #Advanced Image and Video Retrieval Techniques
- An FPGA-Based Reconfigurable Accelerator for Convolution-Transformer Hybrid EfficientViT
2024/03/29 by Haikuo Shao, Huihong Shi, Shao, Haikuo +5 · 1 citation
Engineering · #Analog and Mixed-Signal Circuit Design #FOS: Computer and information sciences #Hardware Architecture (cs.AR) #Machine Learning (cs.LG)
- P2-ViT: Power-of-Two Post-Training Quantization and Acceleration for Fully Quantized Vision Transformer
2024/05/30 by Huihong Shi, Shi, Huihong, Cheng Xin +5 · 1 citation
Computer Science · Engineering · #Advanced Vision and Imaging #Artificial Intelligence (cs.AI) #CCD and CMOS Imaging Sensors #FOS: Computer and information sciences #Image Processing Techniques and Applications
- NASH: Neural Architecture and Accelerator Search for Multiplication-Reduced Hybrid Models
2024/09/07 by Yang Xu, Huihong Shi, Xu, Yang +3 · 1 citation
Computer Science · Physics and Astronomy · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Model Reduction and Neural Networks #Neural Networks and Applications
- AccLLM: Accelerating Long-Context LLM Inference Via Algorithm-Hardware Co-Design
2025/04/07 by Yujie Liang, Huihong Shi, Liang, Yanbiao +5 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Big Data and Digital Economy #FOS: Computer and information sciences #Hardware Architecture (cs.AR) #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling