Pethick, Thomas
- Training Deep Learning Models with Norm-Constrained LMOs
2025/02/11 by Thomas Pethick, Wanyun Xie, Pethick, Thomas +9 · 3 voices · 39 citations
Computer Science · #Advanced Neural Network Applications #Neural Networks and Applications #Stochastic Gradient Optimization Techniques #cs.LG #math.OC
- Escaping limit cycles: Global convergence for constrained\n nonconvex-nonconcave minimax problems
2023/02/20 by Thomas Pethick, Puya Latafat, Pethick, Thomas +7 · 5 citations
Computer Science · Mathematics · Engineering · #Optimization and Variational Analysis #Advanced Optimization Algorithms Research #Sparse and Compressive Sensing Techniques
- Federated Learning under Covariate Shifts with Generalization Guarantees
2023/06/08 by Ramezani-Kebrya, Ali, Liu, Fanghui, Pethick, Thomas +2 · 3 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- Generalized Gradient Norm Clipping & Non-Euclidean (L0,L1)-Smoothness
2025/06/02 by Thomas Pethick, Pethick, Thomas, Wanyun Xie +10 · 1 voice · 7 citations
Mathematics · Engineering · Computer Science · #Numerical methods in inverse problems #Advanced Numerical Analysis Techniques #Optimization and Variational Analysis
- SAMPa: Sharpness-aware Minimization Parallelized
2024/10/14 by Xie, Wanyun, Pethick, Thomas, Cevher, Volkan · 3 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Solving stochastic weak Minty variational inequalities without increasing batch size
2023/02/17 by Thomas Pethick, Olivier Fercoq, Pethick, Thomas +7 · 1 citation
Computer Science · Engineering · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Optimization and Variational Analysis #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
- Stable Nonconvex-Nonconcave Training via Linear Interpolation
2023/10/20 by Thomas Pethick, Wanyun Xie, Pethick, Thomas +3 · 1 citation
Computer Science · Mathematics · #Advanced Optimization Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning and Algorithms #Optimization and Control (math.OC) #Stochastic Gradient Optimization Techniques
- Improving SAM Requires Rethinking its Optimization Formulation
2024/07/17 by Xie, Wanyun, Latorre, Fabian, Antonakopoulos, Kimon +2 · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)