Zhang, Jingzhao
- Why gradient clipping accelerates training: A theoretical justification for adaptivity
2019/05/28 by Jingzhao Zhang, Tianxing He, Zhang, Jingzhao +5 · 41 citations
Computer Science · Engineering · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
- On Finding Small Hyper-Gradients in Bilevel Optimization: Hardness Results and Improved Analysis
2023/01/02 by Lesi Chen, Chen, Lesi, Jing Xu +3 · 13 citations
Computer Science · Decision Sciences · Economics, Econometrics and Finance · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Optimization and Variational Analysis #Risk and Portfolio Optimization #Stochastic processes and financial applications
- Fast Federated Learning in the Presence of Arbitrary Device Unavailability
2021/06/08 by Gu, Xinran, Huang, Kaixuan, Zhang, Jingzhao +1 · 7 citations
#FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
- Complexity Lower Bounds for Nonconvex-Strongly-Concave Min-Max Optimization
2021/04/18 by Haochuan Li, Li, Haochuan, Yi Tian +5 · 6 citations
Computer Science · Engineering · #Complexity and Algorithms in Graphs #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
- Near-Optimal Nonconvex-Strongly-Convex Bilevel Optimization with Fully First-Order Oracles
2023/06/26 by Lesi Chen, Chen, Lesi, Yaohua Ma +3 · 8 citations
Computer Science · Engineering · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
- Understanding the unstable convergence of gradient descent
2022/04/03 by Kwangjun Ahn, Jingzhao Zhang, Ahn, Kwangjun +3 · 5 citations
Computer Science · Engineering · #FOS: Computer and information sciences #FOS: Mathematics #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Machine Learning and Algorithms #Optimization and Control (math.OC) #Stochastic Gradient Optimization Techniques
- On the Overlooked Pitfalls of Weight Decay and How to Mitigate Them: A Gradient-Norm Perspective
2020/11/23 by Xie, Zeke, Xu, Zhiqiang, Zhang, Jingzhao +2 · 4 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Direct Runge-Kutta Discretization Achieves Acceleration
2018/05/01 by Jingzhao Zhang, Zhang, Jingzhao, Aryan Mokhtari +5 · 6 citations
Computer Science · Mathematics · Decision Sciences · #Stochastic Gradient Optimization Techniques #Advanced Optimization Algorithms Research #Advanced Bandit Algorithms Research
- Provably Efficient Algorithms for Multi-Objective Competitive RL
2021/02/05 by Tiancheng Yu, Yu, Tiancheng, Yi Tian +5 · 3 citations
Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #FOS: Computer and information sciences #Game Theory and Applications #Machine Learning (cs.LG) #Reinforcement Learning in Robotics
- From Sparse Dependence to Sparse Attention: Unveiling How Chain-of-Thought Enhances Transformer Sample Efficiency
2024/10/07 by Wen, Kaiyue, Zhang, Huaqing, Lin, Hongzhou +1 · 6 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- QuestA: Expanding Reasoning Capacity in LLMs via Question Augmentation
2025/07/17 by Li, Jiazheng, Lin, Hongzhou, Lu, Hong +5 · 14 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- Coping with Label Shift via Distributionally Robust Optimisation
2020/10/23 by Zhang, Jingzhao, Menon, Aditya, Veit, Andreas +3 · 2 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
- A Quadratic Synchronization Rule for Distributed Deep Learning
2023/10/22 by Xinran Gu, Kaifeng Lyu, Gu, Xinran +7 · 3 citations
Computer Science · Neuroscience · #Advanced Neural Network Applications #Brain Tumor Detection and Classification #FOS: Computer and information sciences #Machine Learning (cs.LG) #Stochastic Gradient Optimization Techniques
- EVBattery: A Large-Scale Electric Vehicle Dataset for Battery Health and Capacity Estimation
2022/01/28 by He, Haowei, Zhang, Jingzhao, Wang, Yanan +9 · 2 citations
#FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Systems and Control (eess.SY) #electronic engineering #information engineering
- Sion's Minimax Theorem in Geodesic Metric Spaces and a Riemannian Extragradient Algorithm
2022/02/13 by Peiyuan Zhang, Jingzhao Zhang, Zhang, Peiyuan +3 · 2 citations
Computer Science · Mathematics · #Optimization and Variational Analysis #Advanced Optimization Algorithms Research #Point processes and geometric inequalities
- Efficient Sampling on Riemannian Manifolds via Langevin MCMC
2024/02/15 by Cheng, Xiang, Zhang, Jingzhao, Sra, Suvrit · 3 citations
#Computation (stat.CO) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Probability (math.PR) #Statistics Theory (math.ST)
- Online Policy Optimization for Robust MDP
2022/09/28 by Jing Dong, Jingwei Li, Dong, Jing +5 · 2 citations
Computer Science · #Reinforcement Learning in Robotics #Advanced Malware Detection Techniques #Artificial Intelligence in Games
- Random Masking Finds Winning Tickets for Parameter Efficient Fine-tuning
2024/05/04 by Jing Xu, Jingzhao Zhang, Xu, Jing +1 · 3 citations
Computer Science · #Neural Networks and Applications
- Data Mixing Can Induce Phase Transitions in Knowledge Acquisition
2025/05/23 by Gu, Xinran, Lyu, Kaifeng, Li, Jiazheng +1 · 3 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- R-SPIDER: A Fast Riemannian Stochastic Optimization Algorithm with Curvature Independent Rate
2018/11/10 by Zhang, Jingzhao, Zhang, Hongyi, Sra, Suvrit · 1 citation
#FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
- Scalable Model Merging with Progressive Layer-wise Distillation
2025/02/18 by Jing Xu, Xu, Jing, Jiazheng Li +3 · 4 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Metaheuristic Optimization Algorithms Research
- Towards Black-Box Membership Inference Attack for Diffusion Models
2024/05/25 by Jingwei Li, Dong Jing, Li, Jingwei +5 · 2 citations
Computer Science · #Adversarial Robustness in Machine Learning
- Task Generalization With AutoRegressive Compositional Structure: Can Learning From D Tasks Generalize to DT Tasks?
2025/02/13 by Abedsoltan, Amirhesam, Zhang, Huaqing, Wen, Kaiyue +3 · 2 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Iteratively Learn Diverse Strategies with State Distance Information
2023/10/23 by Wei Fu, Fu, Wei, Weihua Du +9 · 1 citation
Computer Science · Decision Sciences · #Reinforcement Learning in Robotics #Auction Theory and Applications
- Functionally Constrained Algorithm Solves Convex Simple Bilevel Problems
2024/09/10 by Huaqing Zhang, Zhang, Huaqing, Lesi Chen +5 · 1 citation
Computer Science · Decision Sciences · Mathematics · #Advanced Optimization Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Optimization and Variational Analysis #Risk and Portfolio Optimization