Xie, Wanyun

1. Training Deep Learning Models with Norm-Constrained LMOs
   2025/02/11 by Thomas Pethick, Wanyun Xie, Pethick, Thomas +9 · 3 voices · 39 citations
   Computer Science · #Advanced Neural Network Applications #Neural Networks and Applications #Stochastic Gradient Optimization Techniques #cs.LG #math.OC
2. Generalized Gradient Norm Clipping & Non-Euclidean (L₀,L₁)-Smoothness
   2025/06/02 by Thomas Pethick, Wanyun Xie, Pethick, Thomas +10 · 1 voice · 7 citations
   Mathematics · Engineering · Computer Science · #Numerical methods in inverse problems #Advanced Numerical Analysis Techniques #Optimization and Variational Analysis
3. SAMPa: Sharpness-aware Minimization Parallelized
   2024/10/14 by Xie, Wanyun, Pethick, Thomas, Cevher, Volkan · 3 citations
   #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
4. Chameleon: A Flexible Data-mixing Framework for Language Model Pretraining and Finetuning
   2025/05/30 by Wanyun Xie, Francesco Tonin, Xie, Wanyun +3 · 2 citations
   Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques
5. Stable Nonconvex-Nonconcave Training via Linear Interpolation
   2023/10/20 by Thomas Pethick, Pethick, Thomas, Wanyun Xie +3 · 1 citation
   Computer Science · Mathematics · #Advanced Optimization Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning and Algorithms #Optimization and Control (math.OC) #Stochastic Gradient Optimization Techniques
6. Improving SAM Requires Rethinking its Optimization Formulation
   2024/07/17 by Xie, Wanyun, Latorre, Fabian, Antonakopoulos, Kimon +2 · 1 citation
   #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)