Shaohuai Shi
- Highly Scalable Deep Learning Training System with Mixed-Precision: Training ImageNet in Four Minutes
2018/07/30 by Xianyan Jia, Jia, Xianyan, Shutao Song +26 · 1 voice · 33 citations
Computer Science · Medicine · #cs.LG #cs.DC #stat.ML
- Benchmarking State-of-the-Art Deep Learning Software Tools
2016/08/25 by Shaohuai Shi, Qiang Wang, Shi, Shaohuai +5 · 1 voice · 6 citations
Computer Science · Engineering · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Ferroelectric and Negative Capacitance Devices
- Performance Modeling and Evaluation of Distributed Deep Learning Frameworks on GPUs
2017/11/16 by Shaohuai Shi, Qiang Wang, Shi, Shaohuai +3 · 1 voice · 1 citation
Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #Stochastic Gradient Optimization Techniques #cs.DC
- FADNet: A Fast and Accurate Network for Disparity Estimation
2020/03/24 by Qiang Wang, Shaohuai Shi, Wang, Qiang +7 · 4 citations
Computer Science · #Advanced Image Processing Techniques #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image Enhancement Techniques #Machine Learning (cs.LG)
- GossipFL: A Decentralized Federated Learning Framework With Sparsified and Adaptive Communication
2023/03/01 by Zhenheng Tang, Shaohuai Shi, Bo Li +1 · 2 citations
- Virtual Homogeneity Learning: Defending against Data Heterogeneity in Federated Learning
2022/06/06 by Zhenheng Tang, Yonggang Zhang, Tang, Zhenheng +9 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Data Stream Mining Techniques #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- Communication-Efficient Distributed Deep Learning: A Comprehensive Survey
2020/03/10 by Zhenheng Tang, Tang, Zhenheng, Shaohuai Shi +7 · 1 citation
Computer Science · #Advanced Neural Network Applications #Distributed #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Parallel #Privacy-Preserving Technologies in Data #Signal Processing (eess.SP) #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC) #electronic engineering #information engineering
- Supervised Learning Based Algorithm Selection for Deep Neural Networks
2017/02/10 by Shaohuai Shi, Shi, Shaohuai, Pengfei Xu +3 · 1 voice
Computer Science · #Advanced Neural Network Applications #Machine Learning and Data Classification #Machine Learning and ELM #cs.DC #cs.LG
- DreamDDP: Accelerating Data Parallel Distributed LLM Training with Layer-wise Scheduled Partial Synchronization
2025/02/16 by Zhenheng Tang, Zichen Tang, Tang, Zhenheng +17 · 3 citations
Computer Science · Engineering · Neuroscience · #Brain Tumor Detection and Classification #Cloud Computing and Resource Management #Distributed #FOS: Computer and information sciences #Parallel #Robotics and Automated Systems #and Cluster Computing (cs.DC)
- FADNet++: Real-Time and Accurate Disparity Estimation with Configurable Networks
2021/10/06 by Qiang Wang, Shaohuai Shi, Wang, Qiang +7 · 1 citation
Computer Science · #Advanced Neural Network Applications #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG)
- EASNet: Searching Elastic and Accurate Network Architecture for Stereo Matching
2022/07/20 by Qiang Wang, Shaohuai Shi, Wang, Qiang +5 · 1 citation
Computer Science · #Advanced Vision and Imaging #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications
- DeAR: Accelerating Distributed Deep Learning with Fine-Grained All-Reduce Pipelining
2023/02/24 by Zhang Li, Zhang, Lin, Shaohuai Shi +9 · 1 citation
Computer Science · Engineering · Neuroscience · #Advanced Neural Network Applications #Brain Tumor Detection and Classification #Distributed #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- Evaluation and Optimization of Gradient Compression for Distributed Deep Learning
2023/06/15 by Lin Zhang, Longteng Zhang, Zhang, Lin +7 · 1 citation
Computer Science · Engineering · #Distributed #FOS: Computer and information sciences #Face and Expression Recognition #Machine Learning (cs.LG) #Parallel #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- Parm: Efficient Training of Large Sparsely-Activated Models with Dedicated Schedules
2024/06/30 by Pan, Xinglin, Shaohuai Shi, Lin, Wenxiang +7 · 2 citations
Computer Science · #Machine Learning and Algorithms #Advanced Neural Network Applications #Parallel Computing and Optimization Techniques
- Dissecting the Runtime Performance of the Training, Fine-tuning, and Inference of Large Language Models
2023/11/07 by Longteng Zhang, Zhang, Longteng, Xiang Liu +19 · 1 citation
Computer Science · Engineering · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Natural Language Processing Techniques #Performance (cs.PF) #Topic Modeling