Khashayar Gatmiry

1. Can Looped Transformers Learn to Implement Multi-step Gradient Descent for In-context Learning?
   2024/10/10 by Khashayar Gatmiry, Gatmiry, Khashayar, Nikunj Saunshi +7 · 13 citations
   Computer Science · Engineering · Psychology · #Artificial Intelligence (cs.AI) #Experimental Learning in Engineering #FOS: Computer and information sciences #Intelligent Tutoring Systems and Adaptive Learning #Learning Styles and Cognitive Differences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
2. What does guidance do? A fine-grained analysis in a simple setting
   2024/09/19 by M. Chidambaram, Khashayar Gatmiry, Chidambaram, Muthu +7 · 10 citations
   Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Spatial Cognition and Navigation
3. Bandit Algorithms for Prophet Inequality and Pandora's Box
   2022/11/16 by Khashayar Gatmiry, Thomas Keßelheim, Gatmiry, Khashayar +5 · 5 citations
   Decision Sciences · Computer Science · #Advanced Bandit Algorithms Research #Optimization and Search Problems #Stochastic Gradient Optimization Techniques
4. Convergence of the Riemannian Langevin Algorithm
   2022/04/22 by Khashayar Gatmiry, Santosh Vempala, Gatmiry, Khashayar +1 · 2 citations
   Physics and Astronomy · #stochastic dynamics and bifurcation #Statistical Mechanics and Entropy #Advanced Thermodynamics and Statistical Mechanics
5. Near-Optimal Algorithms for Group Distributionally Robust Optimization and Beyond
   2022/12/28 by Tasuku Soma, Soma, Tasuku, Khashayar Gatmiry +3 · 2 citations
   Decision Sciences · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Risk and Portfolio Optimization
6. Non-submodular Function Maximization subject to a Matroid Constraint, with Applications
   2018/11/19 by Khashayar Gatmiry, Gatmiry, Khashayar, Manuel Gomez-Rodriguez +1 · 3 citations
   Computer Science · Engineering · Mathematics · #Complexity and Algorithms in Graphs #Sparse and Compressive Sensing Techniques #Markov Chains and Monte Carlo Methods
7. Quasi-Newton Steps for Efficient Online Exp-Concave Optimization
   2022/11/02 by Zakaria Mhammedi, Khashayar Gatmiry, Mhammedi, Zakaria +1 · 1 citation
   Computer Science · Decision Sciences · Engineering · #Advanced Bandit Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
8. On the generalization of learning algorithms that do not converge
   2022/08/16 by Nisha Chandramoorthy, Chandramoorthy, Nisha, Andreas Loukas +5 · 1 citation
   Computer Science · #Stochastic Gradient Optimization Techniques #Neural Networks and Applications #Machine Learning and ELM
9. Sampling with Barriers: Faster Mixing via Lewis Weights
   2023/03/01 by Khashayar Gatmiry, Gatmiry, Khashayar, Jonathan A. Kelner +3 · 1 citation
   Computer Science · Mathematics · #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #FOS: Mathematics #Functional Analysis (math.FA) #Logic in Computer Science (cs.LO) #Machine Learning (stat.ML) #Markov Chains and Monte Carlo Methods #Numerical Analysis (math.NA) #Statistical Methods and Inference #Topological and Geometric Data Analysis
10. Computing Optimal Regularizers for Online Linear Optimization
    2024/10/22 by Khashayar Gatmiry, Gatmiry, Khashayar, Jonathan Schneider +3 · 2 citations
    Decision Sciences · Engineering · Mathematics · #Advanced Bandit Algorithms Research #Advanced Optimization Algorithms Research #Advanced Wireless Network Optimization #Computer Science and Game Theory (cs.GT) #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Statistics Theory (math.ST)
11. Simplicity Bias via Global Convergence of Sharpness Minimization
    2024/10/21 by Khashayar Gatmiry, Zhiyuan Li, Gatmiry, Khashayar +5 · 1 citation
    Computer Science · Decision Sciences · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multi-Criteria Decision Making #Optimization and Variational Analysis #Risk and Portfolio Optimization #Statistics Theory (math.ST)
12. On the Role of Depth and Looping for In-Context Learning with Task Diversity
    2024/10/29 by Khashayar Gatmiry, Nikunj Saunshi, Gatmiry, Khashayar +7 · 1 citation
    Social Sciences · Mathematics · Engineering · #Education Methods and Practices #Cognitive and developmental aspects of mathematical skills #Spatial Cognition and Navigation
13. Rethinking Invariance in In-context Learning
    2025/05/08 by Fang, Lizhe, Yifei Wang, Khashayar Gatmiry +6 · 2 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning in Healthcare #Topic Modeling