Wencong Xiao
- Analysis of Large-Scale Multi-Tenant GPU Clusters for DNN Training Workloads
2019/01/17 by Myeongjae Jeon, Shivaram Venkataraman, Jeon, Myeongjae +9 · 28 citations
Computer Science · #Cloud Computing and Resource Management #Distributed #FOS: Computer and information sciences #IoT and Edge/Fog Computing #Parallel #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- FusionAD: Multi-modality Fusion for Prediction and Planning Tasks of Autonomous Driving
2023/08/02 by Tengju Ye, Ye, Tengju, Jing Wei +25 · 15 citations
Computer Science · Engineering · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Autonomous Vehicle Technology and Safety #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Robotics (cs.RO) #Video Surveillance and Tracking Methods
- Infinite-LLM: Efficient LLM Service for Long Context with DistAttention and Distributed KVCache
2024/01/05 by Bin Lin, Lin, Bin, Chen Zhang +24 · 16 citations
Computer Science · #Distributed #FOS: Computer and information sciences #Hardware Architecture (cs.AR) #Natural Language Processing Techniques #Parallel #Topic Modeling #and Cluster Computing (cs.DC)
- EasyScale: Accuracy-consistent Elastic Training for Deep Learning
2022/08/30 by Mingzhen Li, Li, Mingzhen, Wencong Xiao +21 · 2 citations
Computer Science · Engineering · #Advanced Neural Network Applications #Distributed #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Parallel #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- Rubick: Exploiting Job Reconfigurability for Deep Learning Cluster Scheduling
2024/08/16 by Xinyi Zhang, Hanyu Zhao, Zhang, Xinyi +13 · 3 citations
Computer Science · #Cloud Computing and Resource Management #Distributed #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
- MIGPerf: A Comprehensive Benchmark for Deep Learning Training and Inference Workloads on Multi-Instance GPUs
2023/01/01 by Huaizheng Zhang, Zhang, Huaizheng, Yuanming Li +17 · 1 citation
Computer Science · #Advanced Neural Network Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and ELM #Performance (cs.PF) #Stochastic Gradient Optimization Techniques
- Enhancing Large-Scale AI Training Efficiency: The C4 Solution for Real-Time Anomaly Detection and Communication Optimization
2024/06/07 by Jianbo Dong, Dong, Jianbo, Bin Luo +46 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Distributed #Distributed and Parallel Computing Systems #Embedded Systems Design Techniques #FOS: Computer and information sciences #Interconnection Networks and Systems #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- Mycroft: Tracing Dependencies in Collective Communication Towards Reliable LLM Training
2025/09/03 by Yangtao Deng, Lei Zhang, Deng, Yangtao +29 · 4 citations
Computer Science · #Software System Performance and Reliability #Software Testing and Debugging Techniques #Distributed systems and fault tolerance