Şimşekli, Umut
- Sliced-Wasserstein Flows: Nonparametric Generative Modeling via Optimal Transport and Diffusions
2018/06/21 by Antoine Liutkus, Umut Ş Imşekli, Liutkus, Antoine +8 · 16 citations
Computer Science · Mathematics · #Generative Adversarial Networks and Image Synthesis #Stochastic Gradient Optimization Techniques #Markov Chains and Monte Carlo Methods
- Intrinsic Dimension, Persistent Homology and Generalization in Neural Networks
2021/11/25 by Birdal, Tolga, Lou, Aaron, Guibas, Leonidas +1 · 10 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Mathematics #General Topology (math.GN) #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Statistical and Topological Properties of Sliced Probability Divergences
2020/03/12 by Nadjahi, Kimia, Durmus, Alain, Chizat, Lénaïc +3 · 8 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- On the Heavy-Tailed Theory of Stochastic Gradient Descent for Deep Neural Networks
2019/11/29 by Umut Şimşekli, Mert Gürbüzbalaban, Şimşekli, Umut +7 · 9 citations
Computer Science · Engineering · #Stochastic Gradient Optimization Techniques #Sparse and Compressive Sensing Techniques #Adversarial Robustness in Machine Learning
- Heavy Tails in SGD and Compressibility of Overparametrized Neural Networks
2021/06/07 by Melih Barsbey, Milad Sefidgaran, Barsbey, Melih +7 · 6 citations
Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Stochastic Gradient Optimization Techniques
- Fast Approximation of the Sliced-Wasserstein Distance Using\n Concentration of Random Projections
2021/06/29 by Kimia Nadjahi, Alain Durmus, Nadjahi, Kimia +7 · 5 citations
Mathematics · #Geometric Analysis and Curvature Flows
- Bayesian Pose Graph Optimization via Bingham Distributions and Tempered Geodesic MCMC
2018/05/31 by Tolga Birdal, Umut Şimşekli, Birdal, Tolga +5 · 5 citations
Computer Science · Engineering · #3D Shape Modeling and Analysis #Advanced Vision and Imaging #Artificial Intelligence (cs.AI) #Computational Geometry (cs.CG) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (stat.ML) #Robotics (cs.RO) #Robotics and Sensor-Based Localization
- Convergence Rates of Stochastic Gradient Descent under Infinite Noise Variance
2021/02/20 by Hongjian Wang, Mert Gürbüzbalaban, Wang, Hongjian +7 · 3 citations
Computer Science · Engineering · Mathematics · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Random Matrices and Applications #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
- First Exit Time Analysis of Stochastic Gradient Descent Under Heavy-Tailed Gradient Noise
2019/06/21 by Nguyen, Thanh Huy, Şimşekli, Umut, Gürbüzbalaban, Mert +1 · 2 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Relative Positional Encoding for Transformers with Linear Complexity
2021/05/18 by Liutkus, Antoine, Cífka, Ondřej, Wu, Shih-Lun +3 · 2 citations
#Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Sound (cs.SD) #electronic engineering #information engineering
- Algorithmic Stability of Heavy-Tailed SGD with General Loss Functions
2023/01/27 by Anant Raj, Lingjiong Zhu, Raj, Anant +5 · 3 citations
Computer Science · Mathematics · #FOS: Computer and information sciences #Geometric Analysis and Curvature Flows #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Markov Chains and Monte Carlo Methods #Stochastic Gradient Optimization Techniques
- Non-Asymptotic Analysis of Fractional Langevin Monte Carlo for\n Non-Convex Optimization
2019/01/22 by Thanh Huy Nguyen, Nguyen, Thanh Huy, Umut Şimşekli +3 · 2 citations
Mathematics · Engineering · Computer Science · #Mathematical Approximation and Integration #Control Systems and Identification #Image and Signal Denoising Methods
- Learning via Wasserstein-Based High Probability Generalisation Bounds
2023/06/07 by Paul Viallard, Maxime Haddouche, Viallard, Paul +5 · 2 citations
Computer Science · #Adversarial Robustness in Machine Learning #Anomaly Detection Techniques and Applications #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Asymptotic Guarantees for Learning Generative Models with the Sliced-Wasserstein Distance
2019/06/11 by Nadjahi, Kimia, Durmus, Alain, Şimşekli, Umut +1 · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Approximate Bayesian Computation with the Sliced-Wasserstein Distance
2019/10/28 by Nadjahi, Kimia, De Bortoli, Valentin, Durmus, Alain +2 · 1 citation
#Computation (stat.CO) #FOS: Computer and information sciences #Machine Learning (stat.ML) #Methodology (stat.ME)
- Privacy of SGD under Gaussian or Heavy-Tailed Noise: Guarantees without Gradient Clipping
2024/03/04 by Umut Şimşekli, Şimşekli, Umut, Mert Gürbüzbalaban +5 · 2 citations
Computer Science · #Cryptography and Data Security #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #FOS: Mathematics #Internet Traffic Analysis and Secure E-voting #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Privacy-Preserving Technologies in Data #Statistics Theory (math.ST)
- Efficient Sampling of Stochastic Differential Equations with Positive Semi-Definite Models
2023/03/30 by Raj, Anant, Şimşekli, Umut, Rudi, Alessandro · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Probabilistic Permutation Synchronization using the Riemannian Structure\n of the Birkhoff Polytope
2019/04/11 by Tolga Birdal, Umut Şimşekli, Birdal, Tolga +1 · 1 citation
Computer Science · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Mathematics #Graph Theory and Algorithms #Graphics (cs.GR) #Machine Learning (cs.LG) #Numerical Analysis (math.NA) #Robotics (cs.RO) #Topological and Geometric Data Analysis
- Chaotic Regularization and Heavy-Tailed Limits for Deterministic Gradient Descent
2022/05/23 by Soon Hoe Lim, Yijun Wan, Lim, Soon Hoe +3 · 1 citation
Computer Science · Mathematics · Physics and Astronomy · #Advanced Thermodynamics and Statistical Mechanics #Dynamical Systems (math.DS) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Markov Chains and Monte Carlo Methods #Probability (math.PR) #Stochastic Gradient Optimization Techniques
- Topological Generalization Bounds for Discrete-Time Stochastic Optimization Algorithms
2024/07/11 by Rayna Andreeva, Andreeva, Rayna, Benjamin Dupuis +7 · 1 citation
Computer Science · #Advanced Image and Video Retrieval Techniques #Algebraic Topology (math.AT) #FOS: Computer and information sciences #FOS: Mathematics #Image Retrieval and Classification Techniques #Machine Learning (cs.LG) #Topological and Geometric Data Analysis
- Algorithmic Stability of Heavy-Tailed Stochastic Gradient Descent on Least Squares
2022/06/02 by Raj, Anant, Barsbey, Melih, Gürbüzbalaban, Mert +2 · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)