Gatmiry, Khashayar
- Can Looped Transformers Learn to Implement Multi-step Gradient Descent for In-context Learning?
2024/10/10 by Khashayar Gatmiry, Gatmiry, Khashayar, Nikunj Saunshi +7 · 13 citations
Computer Science · Engineering · Psychology · #Artificial Intelligence (cs.AI) #Experimental Learning in Engineering #FOS: Computer and information sciences #Intelligent Tutoring Systems and Adaptive Learning #Learning Styles and Cognitive Differences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- What does guidance do? A fine-grained analysis in a simple setting
2024/09/19 by M. Chidambaram, Khashayar Gatmiry, Chidambaram, Muthu +7 · 13 citations
Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Spatial Cognition and Navigation
- Learning Mixtures of Gaussians Using Diffusion Models
2024/04/29 by Gatmiry, Khashayar, Kelner, Jonathan, Lee, Holden · 8 citations
#Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Probability (math.PR) #Statistics Theory (math.ST)
- Bandit Algorithms for Prophet Inequality and Pandora's Box
2022/11/16 by Khashayar Gatmiry, Gatmiry, Khashayar, Thomas Keßelheim +5 · 5 citations
Decision Sciences · Computer Science · #Advanced Bandit Algorithms Research #Optimization and Search Problems #Stochastic Gradient Optimization Techniques
- When does Metropolized Hamiltonian Monte Carlo provably outperform Metropolis-adjusted Langevin algorithm?
2023/04/10 by Chen, Yuansi, Gatmiry, Khashayar · 4 citations
#Computation (stat.CO) #Computational Complexity (cs.CC) #FOS: Computer and information sciences #Machine Learning (stat.ML)
- Convergence of the Riemannian Langevin Algorithm
2022/04/22 by Khashayar Gatmiry, Santosh Vempala, Gatmiry, Khashayar +1 · 2 citations
Physics and Astronomy · #stochastic dynamics and bifurcation #Statistical Mechanics and Entropy #Advanced Thermodynamics and Statistical Mechanics
- Near-Optimal Algorithms for Group Distributionally Robust Optimization and Beyond
2022/12/28 by Tasuku Soma, Khashayar Gatmiry, Soma, Tasuku +3 · 2 citations
Decision Sciences · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Risk and Portfolio Optimization
- Non-submodular Function Maximization subject to a Matroid Constraint, with Applications
2018/11/19 by Khashayar Gatmiry, Gatmiry, Khashayar, Manuel Gomez-Rodriguez +1 · 3 citations
Computer Science · Engineering · Mathematics · #Complexity and Algorithms in Graphs #Sparse and Compressive Sensing Techniques #Markov Chains and Monte Carlo Methods
- Quasi-Newton Steps for Efficient Online Exp-Concave Optimization
2022/11/02 by Zakaria Mhammedi, Mhammedi, Zakaria, Khashayar Gatmiry +1 · 1 citation
Computer Science · Decision Sciences · Engineering · #Advanced Bandit Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
- On the generalization of learning algorithms that do not converge
2022/08/16 by Nisha Chandramoorthy, Chandramoorthy, Nisha, Andreas Loukas +5 · 1 citation
Computer Science · #Stochastic Gradient Optimization Techniques #Neural Networks and Applications #Machine Learning and ELM
- Sampling with Barriers: Faster Mixing via Lewis Weights
2023/03/01 by Khashayar Gatmiry, Jonathan A. Kelner, Gatmiry, Khashayar +3 · 1 citation
Computer Science · Mathematics · #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #FOS: Mathematics #Functional Analysis (math.FA) #Logic in Computer Science (cs.LO) #Machine Learning (stat.ML) #Markov Chains and Monte Carlo Methods #Numerical Analysis (math.NA) #Statistical Methods and Inference #Topological and Geometric Data Analysis
- Computing Optimal Regularizers for Online Linear Optimization
2024/10/22 by Khashayar Gatmiry, Gatmiry, Khashayar, Jonathan Schneider +3 · 2 citations
Decision Sciences · Engineering · Mathematics · #Advanced Bandit Algorithms Research #Advanced Optimization Algorithms Research #Advanced Wireless Network Optimization #Computer Science and Game Theory (cs.GT) #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Statistics Theory (math.ST)
- The Inductive Bias of Flatness Regularization for Deep Matrix Factorization
2023/06/22 by Gatmiry, Khashayar, Li, Zhiyuan, Chuang, Ching-Yao +3 · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- A Simple Proof of the Mixing of Metropolis-Adjusted Langevin Algorithm under Smoothness and Isoperimetry
2023/04/08 by Chen, Yuansi, Gatmiry, Khashayar · 1 citation
#Computation (stat.CO) #Computational Complexity (cs.CC) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- A Unified Approach to Controlling Implicit Regularization via Mirror Descent
2023/06/24 by Haoyuan Sun, Sun, Haoyuan, Khashayar Gatmiry +5 · 1 citation
Mathematics · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Numerical methods in inverse problems
- Rethinking Invariance in In-context Learning
2025/05/08 by Fang, Lizhe, Yifei Wang, Khashayar Gatmiry +6 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning in Healthcare #Topic Modeling
- Simplicity Bias via Global Convergence of Sharpness Minimization
2024/10/21 by Khashayar Gatmiry, Zhiyuan Li, Gatmiry, Khashayar +5 · 1 citation
Computer Science · Decision Sciences · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multi-Criteria Decision Making #Optimization and Variational Analysis #Risk and Portfolio Optimization #Statistics Theory (math.ST)
- Adversarial Online Learning with Temporal Feedback Graphs
2024/06/30 by Gatmiry, Khashayar, Schneider, Jon · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- On the Role of Depth and Looping for In-Context Learning with Task Diversity
2024/10/29 by Khashayar Gatmiry, Nikunj Saunshi, Gatmiry, Khashayar +7 · 1 citation
Social Sciences · Mathematics · Engineering · #Education Methods and Practices #Cognitive and developmental aspects of mathematical skills #Spatial Cognition and Navigation