vix.ing · top · new · best · stats · spec

Yao, Zhewei

  1. A Survey of Quantization Methods for Efficient Neural Network Inference
    2021/03/25 by Amir Gholami, Gholami, Amir, Sehoon Kim +9 · 88 citations
    Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Medical Image Segmentation Techniques #Neural Networks and Applications #Stochastic Gradient Optimization Techniques
  2. DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scale
    2022/01/14 by Rajbhandari, Samyam, Li, Conglong, Yao, Zhewei +5 · 72 citations
    #Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
  3. ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformers
    2022/06/04 by Yao, Zhewei, Aminabadi, Reza Yazdani, Zhang, Minjia +3 · 57 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  4. ZeroQ: A Novel Zero Shot Quantization Framework
    2020/01/01 by Cai, Yaohui, Yao, Zhewei, Dong, Zhen +3 · 23 citations
    #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
  5. How Much Can CLIP Benefit Vision-and-Language Tasks?
    2021/07/13 by Sheng Shen, Liunian Harold Li, Shen, Sheng +13 · 17 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Speech and dialogue systems
  6. AI and Memory Wall
    2024/03/21 by Amir Gholami, Zhewei Yao, Gholami, Amir +9 · 26 citations
    Engineering · #Distributed #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Hardware Architecture (cs.AR) #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
  7. DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-like Models at All Scales
    2023/08/02 by Zhewei Yao, Yao, Zhewei, Reza Yazdani Aminabadi +35 · 15 citations
    Computer Science · #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification
  8. Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding
    2024/03/05 by Zhenyu Zhang, Zhang, Zhenyu, Runjin Chen +13 · 18 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Speech and dialogue systems
  9. RenAIssance: A Survey into AI Text-to-Image Generation in the Era of Large Model
    2023/09/02 by Fengxiang Bie, Bie, Fengxiang, Yibo Yang +23 · 14 citations
    Computer Science · #Generative Adversarial Networks and Image Synthesis #Multimodal Machine Learning Applications #Video Analysis and Summarization
  10. Scaling Vision-Language Models with Sparse Mixture of Experts
    2023/03/13 by Sheng Shen, Shen, Sheng, Zhewei Yao +9 · 11 citations
    Computer Science · #Multimodal Machine Learning Applications #Topic Modeling #Domain Adaptation and Few-Shot Learning
  11. Hessian-Aware Pruning and Optimal Neural Implant
    2021/01/22 by Shixing Yu, Zhewei Yao, Yu, Shixing +10 · 6 citations
    Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences
  12. ZeroQuant-V2: Exploring Post-training Quantization in LLMs from Comprehensive Study to Low Rank Compensation
    2023/03/15 by Zhewei Yao, Xiaoxia Wu, Yao, Zhewei +7 · 8 citations
    Computer Science · Engineering · #Topic Modeling #Ferroelectric and Negative Capacitance Devices #Natural Language Processing Techniques
  13. ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training
    2021/04/29 by Jianfei Chen, Chen, Jianfei, Lianmin Zheng +11 · 6 citations
    Computer Science · Engineering · #Advanced Memory and Neural Computing #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  14. On the Computational Inefficiency of Large Batch Sizes for Stochastic Gradient Descent
    2018/11/30 by Noah Golmant, Golmant, Noah, Nikita Vemuri +13 · 5 citations
    Computer Science · #Advanced Neural Network Applications #Distributed #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Parallel #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
  15. ReFoRCE: A Text-to-SQL Agent with Self-Refinement, Consensus Enforcement, and Column Exploration
    2025/02/02 by Ashwin Ramachandran, Deng, Minghang, Canwen Xu +10 · 15 citations
    Computer Science · #Semantic Web and Ontologies #Service-Oriented Architecture and Web Services #Distributed and Parallel Computing Systems
  16. FP6-LLM: Efficiently Serving Large Language Models Through FP6-Centric Algorithm-System Co-Design
    2024/01/25 by Haojun Xia, Zhen Zheng, Zheng Zhen +25 · 1 voice · 1 citation
    Computer Science · #cs.LG #cs.AI #cs.AR
  17. JumpReLU: A Retrofit Defense Strategy for Adversarial Attacks
    2019/04/07 by Erichson, N. Benjamin, Yao, Zhewei, Mahoney, Michael W. · 3 citations
    #Computer Vision and Pattern Recognition (cs.CV) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences
  18. Inexact Non-Convex Newton-Type Methods
    2018/02/20 by Zhewei Yao, Yao, Zhewei, Peng Xu +5 · 4 citations
    Computer Science · Engineering · #FOS: Mathematics #Machine Learning and Algorithms #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  19. Inexact Newton-CG Algorithms With Complexity Guarantees
    2021/09/28 by Yao, Zhewei, Xu, Peng, Roosta, Fred +2 · 3 citations
    #FOS: Mathematics #Optimization and Control (math.OC)
  20. Large batch size training of neural networks with adversarial training and second-order information
    2018/10/02 by Zhewei Yao, Amir Gholami, Yao, Zhewei +11 · 2 citations
    Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Stochastic Gradient Optimization Techniques
  21. DeepSpeed Data Efficiency: Improving Deep Learning Model Quality and Training Efficiency via Efficient Data Sampling and Routing
    2022/12/07 by Conglong Li, Li, Conglong, Zhewei Yao +8 · 3 citations
    Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Topic Modeling
  22. Arctic-Text2SQL-R1: Simple Rewards, Strong Reasoning in Text-to-SQL
    2025/05/22 by Yao, Zhewei, Sun, Guoheng, Borchmann, Lukasz +6 · 11 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
  23. ZeroQuant(4+2): Redefining LLMs Quantization with a New FP6-Centric Strategy for Diverse Generative Tasks
    2023/12/14 by Xiaoxia Wu, Haojun Xia, Wu, Xiaoxia +19 · 4 citations
    Computer Science · Engineering · #Topic Modeling #Ferroelectric and Negative Capacitance Devices #Advanced Neural Network Applications
  24. A Statistical Framework for Low-bitwidth Training of Deep Neural Networks
    2020/10/27 by Jianfei Chen, Chen, Jianfei, Yu Gai +7 · 2 citations
    Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  25. ExCoT: Optimizing Reasoning for Text-to-SQL with Execution Feedback
    2025/03/25 by Bohan Zhai, Zhai, Bohan, Canwen Xu +5 · 7 citations
    Computer Science · #Advanced Database Systems and Queries #Artificial Intelligence (cs.AI) #Databases (cs.DB) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Semantic Web and Ontologies #Service-Oriented Architecture and Web Services
  26. STUN: Structured-Then-Unstructured Pruning for Scalable MoE Pruning
    2024/09/10 by Jaeseong Lee, Lee, Jaeseong, Aurick Qiao +8 · 4 citations
    Computer Science · Engineering · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Robotics and Automated Systems #Semantic Web and Ontologies
  27. SwiftKV: Fast Prefill-Optimized Inference with Knowledge-Preserving Model Transformation
    2024/10/04 by Qiao, Aurick, Yao, Zhewei, Rajbhandari, Samyam +1 · 5 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  28. ZeroQuant-FP: A Leap Forward in LLMs Post-Training W4A8 Quantization Using Floating-Point Formats
    2023/07/19 by Xiaoxia Wu, Wu, Xiaoxia, Zhewei Yao +3 · 2 citations
    Computer Science · Engineering · #Parallel Computing and Optimization Techniques #Ferroelectric and Negative Capacitance Devices #Advanced Neural Network Applications
  29. LEAP: Learnable Pruning for Transformer-based Models
    2021/05/30 by Zhewei Yao, Xiaoxia Wu, Yao, Zhewei +11 · 1 citation
    Computer Science · #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
  30. ComposeRAG: A Modular and Composable RAG for Corpus-Grounded Multi-Hop Question Answering
    2025/05/30 by Ruofan Wu, Youngwon Lee, Wu, Ruofan +13 · 4 citations
    Computer Science · #Computation and Language (cs.CL) #Expert finding and Q&A systems #FOS: Computer and information sciences #Topic Modeling
  31. What's Hidden in a One-layer Randomly Weighted Transformer?
    2021/09/08 by Shen, Sheng, Yao, Zhewei, Kiela, Douwe +2 · 1 citation
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
  32. Selective Guidance: Are All the Denoising Steps of Guided Diffusion Important?
    2023/05/16 by Golnari, Pareesa Ameneh, Yao, Zhewei, He, Yuxiong · 1 citation
    #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  33. MedOrch: Medical Diagnosis with Tool-Augmented Reasoning Agents for Flexible Extensibility
    2025/05/30 by Yexiao He, A. Li, He, Yexiao +7 · 3 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Intelligent Tutoring Systems and Adaptive Learning
  34. Improving Semi-supervised Federated Learning by Reducing the Gradient Diversity of Models
    2020/08/26 by Zhengming Zhang, Yaoqing Yang, Zhang, Zhengming +9 · 1 citation
    Computer Science · #FOS: Computer and information sciences #Internet Traffic Analysis and Secure E-voting #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Mobile Crowdsensing and Crowdsourcing #Privacy-Preserving Technologies in Data
  35. Inference Scaling for Bridging Retrieval and Augmented Generation
    2024/12/14 by Youngwon Lee, Lee, Youngwon, Seung-won Hwang +9 · 1 citation
    Computer Science · #Topic Modeling #Speech Recognition and Synthesis #Domain Adaptation and Few-Shot Learning