Steve Dai
- VS-Quant: Per-vector Scaled Quantization for Accurate Low-Precision Neural Network Inference
2021/02/08 by Steve Dai, Rangharajan Venkatesan, Dai, Steve +9 · 8 citations
Computer Science · #Advanced Image Processing Techniques #Advanced Neural Network Applications #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Hardware Architecture (cs.AR) #Machine Learning (cs.LG)
- Softermax: Hardware/Software Co-Design of an Efficient Softmax for\n Transformers
2021/03/16 by Jacob R. Stevens, Stevens, Jacob R., Rangharajan Venkatesan +7 · 6 citations
Computer Science · Engineering · #Advanced Memory and Neural Computing #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Hardware Architecture (cs.AR) #Parallel Computing and Optimization Techniques
- LNS-Madam: Low-Precision Training in Logarithmic Number System using Multiplicative Weight Update
2021/06/26 by Jiawei Zhao, Zhao, Jiawei, Steve Dai +15 · 2 citations
Computer Science · #Cryptography and Residue Arithmetic #FOS: Computer and information sciences #Hardware Architecture (cs.AR) #Machine Learning (cs.LG) #Numerical Methods and Algorithms #Parallel Computing and Optimization Techniques
- Optimal Clipping and Magnitude-aware Differentiation for Improved Quantization-aware Training
2022/06/13 by Charbel Sakr, Sakr, Charbel, Steve Dai +9 · 2 citations
Computer Science · Engineering · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Sparse and Compressive Sensing Techniques
- SQ-DM: Accelerating Diffusion Models with Aggressive Quantization and Temporal Sparsity
2025/01/26 by Zichen Fan, Steve Dai, Fan, Zichen +7 · 1 citation
Physics and Astronomy · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Hardware Architecture (cs.AR) #Machine Learning (cs.LG) #Opinion Dynamics and Social Influence