1. Variationally correct operator learning: Reduced basis neural operator with a posteriori error estimation
   2025/12/24 by Yuan Qiu, Qiu, Yuan, Wolfgang Dahmen +3 · 1 citation
   Physics and Astronomy · Engineering · Computer Science · #Model Reduction and Neural Networks #Ferroelectric and Negative Capacitance Devices #Stochastic Gradient Optimization Techniques
2. Saddle-to-Saddle Dynamics Explains A Simplicity Bias Across Neural Network Architectures
   2025/12/23 by Yedi Zhang, Andrew Saxe, Zhang, Yedi +3 · 2 voices · 2 citations
   Computer Science · #Stochastic Gradient Optimization Techniques #Generative Adversarial Networks and Image Synthesis #Domain Adaptation and Few-Shot Learning
3. From Points to Coalitions: Hierarchical Contrastive Shapley Values for Prioritizing Data Samples
   2025/12/22 by Canran Xiao, Xiao, Canran, Jiabao Dou +7 · 1 citation
   Computer Science · #Explainable Artificial Intelligence (XAI) #Stochastic Gradient Optimization Techniques #Mobile Crowdsensing and Crowdsourcing
4. Tight Lower Bounds and Optimal Algorithms for Stochastic Nonconvex Optimization with Heavy-Tailed Noise
   2025/12/21 by Adrien Fradin, Fradin, Adrien, Abdurakhmon Sadiev +5 · 1 citation
   Computer Science · Decision Sciences · Engineering · #Advanced Bandit Algorithms Research #FOS: Mathematics #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
5. A Mathematical Theory of Top-k Sparse Attention via Total Variation Distance
   2025/12/08 by Tzachristas, Georgios, Deng, Lei, Tzachristas, Ioannis +2 · 1 citation
   Computer Science · Mathematics · #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Markov Chains and Monte Carlo Methods #Stochastic Gradient Optimization Techniques
6. When do spectral gradient updates help in deep learning?
   2025/12/03 by Damek Davis, Davis, Damek, Dmitriy Drusvyatskiy +1 · 3 citations
   Computer Science · Engineering · Physics and Astronomy · #Stochastic Gradient Optimization Techniques #Muon and positron interactions and applications #Particle physics theoretical and experimental studies
7. Gated KalmaNet: A Fading Memory Layer Through Test-Time Ridge Regression
   2025/11/26 by Liangzu Peng, Peng, Liangzu, Chattopadhyay, Aditya +8 · 1 citation
   Computer Science · #Stochastic Gradient Optimization Techniques #Advanced Neural Network Applications #Parallel Computing and Optimization Techniques
8. PixelDiT: Pixel Diffusion Transformers for Image Generation
   2025/11/25 by Yu, Yongsheng, Xiong, Wei, Nie, Weili +3 · 8 citations
   Computer Science · #Generative Adversarial Networks and Image Synthesis #Domain Adaptation and Few-Shot Learning #Stochastic Gradient Optimization Techniques
9. Evolution Strategies at the Hyperscale
   2025/11/20 by Bidipta Sarkar, Mattie Fellows, Sarkar, Bidipta +38 · 4 voices · 1 citation
   Computer Science · Mathematics · #Metaheuristic Optimization Algorithms Research #Stochastic Gradient Optimization Techniques #Tensor decomposition and applications #cs.AI #cs.LG
10. Back to Basics: Let Denoising Generative Models Denoise
    2025/11/17 by Tianhong Li, Kaiming He, Li, Tianhong +1 · 4 voices
    Computer Science · Medicine · #Generative Adversarial Networks and Image Synthesis #Advanced Neuroimaging Techniques and Applications #Stochastic Gradient Optimization Techniques
11. On the Gradient Complexity of Private Optimization with Private Oracles
    2025/11/17 by Menart, Michael, Nikolov, Aleksandar · 1 citation
    Computer Science · #Stochastic Gradient Optimization Techniques #Privacy-Preserving Technologies in Data #Cryptography and Data Security
12. Virtual Width Networks
    2025/11/14 by Baisheng Li, Seed, Li, Baisheng +250 · 2 voices
    Computer Science · #Advanced Neural Network Applications #Generative Adversarial Networks and Image Synthesis #Stochastic Gradient Optimization Techniques #cs.AI #cs.LG
13. New perturbation bounds for low rank approximation of matrices: Beyond Eckart-Young-Mirsky
    2025/11/12 by Phuc Tran, Van Khu Vu, Tran, Phuc +1 · 1 citation
    Computer Science · Mathematics · Engineering · #Stochastic Gradient Optimization Techniques #Tensor decomposition and applications #Sparse and Compressive Sensing Techniques
14. A Generalized Bias-Variance Decomposition for Bregman Divergences
    2025/11/11 by David Pfau, Pfau, David · 1 voice · 2 citations
    Physics and Astronomy · Computer Science · #Statistical Mechanics and Entropy #Stochastic Gradient Optimization Techniques #Gaussian Processes and Bayesian Inference
15. Isotropic Curvature Model for Understanding Deep Learning Optimization: Is Gradient Orthogonalization Optimal?
    2025/11/01 by Weijie Su, Su, Weijie · 3 citations
    Computer Science · Materials Science · #Stochastic Gradient Optimization Techniques #Machine Learning in Materials Science #Machine Learning and Data Classification
16. Learning-Augmented Online Bidding in Stochastic Settings
    2025/10/29 by Spyros Angelopoulos, Bertrand Simon, Angelopoulos, Spyros +1 · 1 citation
    Decision Sciences · Computer Science · #Advanced Bandit Algorithms Research #Optimization and Search Problems #Stochastic Gradient Optimization Techniques
17. Statistical Physics of Deep Learning: Optimal Learning of a Multilayer Perceptron near Interpolation
    2025/10/28 by Jean Barbier, Barbier, Jean, Francesco Camilli +7 · 2 citations
    Computer Science · #Neural Networks and Applications #Stochastic Gradient Optimization Techniques #Machine Learning and ELM
18. CudaForge: An Agent Framework with Hardware Feedback for CUDA Kernel Optimization
    2025/10/23 by Zijian Zhang, Zhang, Zijian, Rong Wang +8 · 3 citations
    Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
19. Interpolatory Dynamical Low-Rank Approximation: Theoretical Foundations and Algorithms
    2025/10/22 by Benjamin Carrel, Daniel Kreßner, Carrel, Benjamin +5 · 2 citations
    Mathematics · Physics and Astronomy · Computer Science · #Tensor decomposition and applications #Model Reduction and Neural Networks #Stochastic Gradient Optimization Techniques
20. Approximation Rates of Shallow Neural Networks: Barron Spaces, Activation Functions and Optimality Analysis
    2025/10/21 by Jian Lü, Lu, Jian, Xiaohuang Huang +1 · 1 citation
    Computer Science · Physics and Astronomy · #41A46 #FOS: Computer and information sciences #Machine Learning (cs.LG) #Model Reduction and Neural Networks #Neural Networks and Applications #Stochastic Gradient Optimization Techniques
21. A Geometric Approach to Steerable Convolutions
    2025/10/21 by Soumyabrata Kundu, Risi Kondor, Kundu, Soumyabrata +1 · 1 citation
    Computer Science · #Stochastic Gradient Optimization Techniques #Advanced Graph Neural Networks #Neural Networks and Applications
22. Frank-Wolfe Algorithms for (L0, L1)-smooth functions
    2025/10/18 by A. A. Vyguzov, Vyguzov, A. A., F. S. Stonyakin +2 · 1 voice · 1 citation
    Computer Science · Engineering · Mathematics · #Advanced Optimization Algorithms Research #FOS: Mathematics #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques #math.OC
23. Quantum Alternating Direction Method of Multipliers for Semidefinite Programming
    2025/10/11 by Hantao Nie, Nie, Hantao, Dong An +3 · 3 voices · 2 citations
    Computer Science · Mathematics · #Quantum Computing Algorithms and Architecture #Stochastic Gradient Optimization Techniques #Advanced Optimization Algorithms Research
24. Random-Shift Revisited: Tight Approximations for Tree Embeddings and L1-Oblivious Routings
    2025/10/10 by Rasmus Kyng, Kyng, Rasmus, Maximilian Probst Gutenberg +3 · 1 citation
    Computer Science · #Advanced Graph Theory Research #Complexity and Algorithms in Graphs #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #Stochastic Gradient Optimization Techniques
25. LiMuon: Light and Fast Muon Optimizer for Large Models
    2025/09/18 by Feihu Huang, F. Huang, Yuning Luo +4 · 4 citations
    Engineering · Computer Science · #Muon and positron interactions and applications #Stochastic Gradient Optimization Techniques #Computational Physics and Python Applications
26. Replicable Reinforcement Learning with Linear Function Approximation
    2025/09/10 by Eric Eaton, Eaton, Eric, Marcel Hussing +9 · 2 voices · 1 citation
    Computer Science · #Generative Adversarial Networks and Image Synthesis #Reinforcement Learning in Robotics #Stochastic Gradient Optimization Techniques #cs.LG
27. Model-Driven Subspaces for Large-Scale Optimization with Local Approximation Strategy
    2025/09/10 by Yitong He, Pengcheng Xie, He, Yitong +1 · 2 citations
    Mathematics · Computer Science · #Advanced Optimization Algorithms Research #Stochastic Gradient Optimization Techniques #Metaheuristic Optimization Algorithms Research
28. Improved Hamiltonian learning and sparsity testing through Bell sampling
    2025/09/09 by Tong Yu, Sinha, Savar D., Tong, Yu · 5 citations
    Computer Science · Engineering · #Complexity and Algorithms in Graphs #FOS: Physical sciences #Quantum Physics (quant-ph) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
29. Mathematical research with GPT-5: a Malliavin-Stein experiment
    2025/09/03 by Charles-Philippe Diez, Diez, Charles-Philippe, Luis da Maia +3 · 4 voices · 4 citations
    Computer Science · Decision Sciences · #Stochastic Gradient Optimization Techniques #Risk and Portfolio Optimization #Optimization and Variational Analysis
30. AdaGrad Meets Muon: Adaptive Stepsizes for Orthogonal Updates
    2025/09/03 by Minxin Zhang, Yuxuan Liu, Zhang, Minxin +3 · 6 citations
    Engineering · Materials Science · Computer Science · #Muon and positron interactions and applications #Machine Learning in Materials Science #Stochastic Gradient Optimization Techniques

more