vix.ing · top · new · best · stats · spec

Mokhtari, Aryan

  1. Exploiting Shared Representations for Personalized Federated Learning
    2021/02/14 by Liam Collins, Collins, Liam, Hamed Hassani +5 · 33 citations
    Computer Science · #Domain Adaptation and Few-Shot Learning #Privacy-Preserving Technologies in Data #Advanced Neural Network Applications
  2. Personalized Federated Learning: A Meta-Learning Approach
    2020/02/19 by Alireza Fallah, Aryan Mokhtari, Fallah, Alireza +3 · 40 citations
    Computer Science · #Privacy-Preserving Technologies in Data #Domain Adaptation and Few-Shot Learning #Machine Learning and Data Classification
  3. FedPAQ: A Communication-Efficient Federated Learning Method with Periodic Averaging and Quantization
    2019/09/28 by Reisizadeh, Amirhossein, Mokhtari, Aryan, Hassani, Hamed +2 · 21 citations
    #Distributed #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Parallel #and Cluster Computing (cs.DC)
  4. A Unified Analysis of Extra-gradient and Optimistic Gradient Methods for Saddle Point Problems: Proximal Point Approach
    2019/01/24 by Mokhtari, Aryan, Ozdaglar, Asuman, Pattathil, Sarath · 16 citations
    #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
  5. Conditional Gradient Methods
    2022/11/25 by Gábor Braun, Alejandro Carderera, Braun, Gábor +11 · 16 citations
    Computer Science · Engineering · #Stochastic Gradient Optimization Techniques #Sparse and Compressive Sensing Techniques #Machine Learning and ELM
  6. On the Convergence Theory of Gradient-Based Model-Agnostic Meta-Learning Algorithms
    2019/08/27 by Alireza Fallah, Aryan Mokhtari, Fallah, Alireza +3 · 10 citations
    Computer Science · #Domain Adaptation and Few-Shot Learning #Machine Learning and ELM #Machine Learning and Data Classification
  7. Federated Learning with Compression: Unified Analysis and Sharp Guarantees
    2020/07/02 by Haddadpour, Farzin, Kamani, Mohammad Mahdi, Mokhtari, Aryan +1 · 8 citations
    #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Parallel #and Cluster Computing (cs.DC)
  8. InfoNCE Loss Provably Learns Cluster-Preserving Representations
    2023/02/15 by Advait Parulekar, Parulekar, Advait, Liam Collins +6 · 10 citations
    Computer Science · #AI in cancer detection #Bayesian Methods and Mixture Models #FOS: Computer and information sciences #Image Retrieval and Classification Techniques #Machine Learning (cs.LG)
  9. DSA: Decentralized Double Stochastic Averaging Gradient Algorithm
    2015/06/13 by Aryan Mokhtari, Alejandro Ribeiro, Mokhtari, Aryan +1 · 7 citations
    Computer Science · Engineering · #Stochastic Gradient Optimization Techniques #Distributed Control Multi-Agent Systems #Sparse and Compressive Sensing Techniques
  10. Straggler-Resilient Federated Learning: Leveraging the Interplay Between Statistical Accuracy and System Heterogeneity
    2020/12/28 by Reisizadeh, Amirhossein, Tziotis, Isidoros, Hassani, Hamed +2 · 6 citations
    #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Parallel #and Cluster Computing (cs.DC)
  11. Non-asymptotic Superlinear Convergence of Standard Quasi-Newton Methods
    2020/03/30 by Qiujiang Jin, Jin, Qiujiang, Aryan Mokhtari +1 · 5 citations
    Computer Science · Mathematics · #Advanced Optimization Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #Iterative Methods for Nonlinear Equations #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Stochastic Gradient Optimization Techniques
  12. The Power of Adaptivity in SGD: Self-Tuning Step Sizes with Unbounded Gradients and Affine Variance
    2022/02/11 by Matthew Faw, Faw, Matthew, Isidoros Tziotis +9 · 6 citations
    Computer Science · Engineering · #Stochastic Gradient Optimization Techniques #Sparse and Compressive Sensing Techniques
  13. On the Convergence Theory of Debiased Model-Agnostic Meta-Reinforcement Learning
    2020/02/12 by Fallah, Alireza, Georgiev, Kristian, Mokhtari, Aryan +1 · 4 citations
    #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
  14. FedAvg with Fine Tuning: Local Updates Lead to Representation Learning
    2022/05/27 by Collins, Liam, Hassani, Hamed, Mokhtari, Aryan +1 · 5 citations
    #FOS: Computer and information sciences #Machine Learning (cs.LG)
  15. In-Context Learning with Transformers: Softmax Attention Adapts to Function Lipschitzness
    2024/02/18 by Liam Collins, Collins, Liam, Advait Parulekar +7 · 7 citations
    Computer Science · Neuroscience · #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural Networks and Applications #Neural dynamics and brain function
  16. Generalized Optimistic Methods for Convex-Concave Saddle Point Problems
    2022/02/19 by Jiang, Ruichen, Mokhtari, Aryan · 4 citations
    #90C25 #90C33 #90C47 #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
  17. Sharpened Quasi-Newton Methods: Faster Superlinear Rate and Larger Local Convergence Neighborhood
    2022/02/21 by Qiujiang Jin, Alec Koppel, Jin, Qiujiang +5 · 4 citations
    Computer Science · Mathematics · #Advanced Optimization Algorithms Research #FOS: Mathematics #Iterative Methods for Nonlinear Equations #Matrix Theory and Algorithms #Optimization and Control (math.OC)
  18. Generalization of Model-Agnostic Meta-Learning Algorithms: Recurring and Unseen Tasks
    2021/02/07 by Fallah, Alireza, Mokhtari, Aryan, Ozdaglar, Asuman · 3 citations
    #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
  19. A Decentralized Second-Order Method with Exact Linear Convergence Rate for Consensus Optimization
    2016/02/01 by Mokhtari, Aryan, Shi, Wei, Ling, Qing +1 · 2 citations
    #Distributed #FOS: Computer and information sciences #FOS: Mathematics #Optimization and Control (math.OC) #Parallel #and Cluster Computing (cs.DC)
  20. Decentralized Prediction-Correction Methods for Networked Time-Varying Convex Optimization
    2016/02/04 by Simonetto, Andrea, Koppel, Alec, Mokhtari, Aryan +2 · 2 citations
    #FOS: Computer and information sciences #FOS: Mathematics #Information Theory (cs.IT) #Optimization and Control (math.OC)
  21. A Conditional Gradient-based Method for Simple Bilevel Optimization with Convex Lower-level Problem
    2022/06/17 by Jiang, Ruichen, Abolfazli, Nazanin, Mokhtari, Aryan +1 · 4 citations
    #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
  22. Non-asymptotic Global Convergence Rates of BFGS with Exact Line Search
    2024/04/01 by Jin, Qiujiang, Jiang, Ruichen, Mokhtari, Aryan · 5 citations
    #FOS: Mathematics #Optimization and Control (math.OC)
  23. Surpassing Gradient Descent Provably: A Cyclic Incremental Method with Linear Convergence Rate
    2016/11/01 by Mokhtari, Aryan, Gürbüzbalaban, Mert, Ribeiro, Alejandro · 2 citations
    #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
  24. Non-asymptotic Global Convergence Analysis of BFGS with the Armijo-Wolfe Line Search
    2024/04/25 by Qiujiang Jin, Ruichen Jiang, Jin, Qiujiang +3 · 5 citations
    Computer Science · Mathematics · #Advanced Optimization Algorithms Research #FOS: Mathematics #Matrix Theory and Algorithms #Numerical methods for differential equations #Optimization and Control (math.OC)
  25. Direct Runge-Kutta Discretization Achieves Acceleration
    2018/05/01 by Jingzhao Zhang, Aryan Mokhtari, Zhang, Jingzhao +5 · 5 citations
    Computer Science · Mathematics · Decision Sciences · #Stochastic Gradient Optimization Techniques #Advanced Optimization Algorithms Research #Advanced Bandit Algorithms Research
  26. Accelerated Quasi-Newton Proximal Extragradient: Faster Rate for Smooth Convex Optimization
    2023/06/03 by Ruichen Jiang, Jiang, Ruichen, Aryan Mokhtari +1 · 3 citations
    Engineering · Computer Science · Decision Sciences · #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques #Advanced Bandit Algorithms Research
  27. A Decentralized Proximal Point-type Method for Saddle Point Problems
    2019/10/31 by Liu, Weijie, Mokhtari, Aryan, Ozdaglar, Asuman +3 · 2 citations
    #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
  28. Improved Complexity for Smooth Nonconvex Optimization: A Two-Level Online Learning Approach with Quasi-Newton Methods
    2024/12/03 by Ruichen Jiang, Aryan Mokhtari, Jiang, Ruichen +3 · 6 citations
    Engineering · Computer Science · Mathematics · #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques #Advanced Optimization Algorithms Research
  29. Online Learning Guided Curvature Approximation: A Quasi-Newton Method with Global Non-Asymptotic Superlinear Convergence
    2023/02/16 by Ruichen Jiang, Jiang, Ruichen, Qiujiang Jin +3 · 2 citations
    Mathematics · Engineering · #Advanced Optimization Algorithms Research #Sparse and Compressive Sensing Techniques #Iterative Methods for Nonlinear Equations
  30. Global Convergence of Online Limited Memory BFGS
    2014/09/06 by Mokhtari, Aryan, Ribeiro, Alejandro · 1 citation
    #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
  31. Provable Multi-Task Representation Learning by Two-Layer ReLU Neural Networks
    2023/07/13 by Liam Collins, Hamed Hassani, Collins, Liam +7 · 2 citations
    Computer Science · #Domain Adaptation and Few-Shot Learning #Stochastic Gradient Optimization Techniques #Adversarial Robustness in Machine Learning
  32. Adaptive Newton Method for Empirical Risk Minimization to Statistical Accuracy
    2016/05/24 by Mokhtari, Aryan, Ribeiro, Alejandro · 1 citation
    #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
  33. Krylov Cubic Regularized Newton: A Subspace Second-Order Method with Dimension-Free Convergence Rate
    2024/01/05 by Ruichen Jiang, Jiang, Ruichen, Parameswaran Raman +9 · 2 citations
    Computer Science · Engineering · Mathematics · #Advanced Optimization Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  34. A Newton-Based Method for Nonconvex Optimization with Fast Evasion of Saddle Points
    2017/07/25 by Paternain, Santiago, Mokhtari, Aryan, Ribeiro, Alejandro · 1 citation
    #FOS: Mathematics #Optimization and Control (math.OC)
  35. Decentralized Submodular Maximization: Bridging Discrete and Continuous Settings
    2018/02/11 by Mokhtari, Aryan, Hassani, Hamed, Karbasi, Amin · 1 citation
    #FOS: Mathematics #Optimization and Control (math.OC)
  36. Conditional Gradient Method for Stochastic Submodular Maximization: Closing the Gap
    2017/11/05 by Mokhtari, Aryan, Hassani, Hamed, Karbasi, Amin · 1 citation
    #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
  37. Stochastic Conditional Gradient Methods: From Convex Minimization to Submodular Maximization
    2018/04/24 by Mokhtari, Aryan, Hassani, Hamed, Karbasi, Amin · 1 citation
    #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
  38. Escaping Saddle Points in Constrained Optimization
    2018/09/06 by Mokhtari, Aryan, Ozdaglar, Asuman, Jadbabaie, Ali · 1 citation
    #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
  39. Robust and Communication-Efficient Collaborative Learning
    2019/07/24 by Reisizadeh, Amirhossein, Taheri, Hossein, Mokhtari, Aryan +2 · 1 citation
    #Distributed #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Parallel #and Cluster Computing (cs.DC)
  40. An Accelerated Gradient Method for Convex Smooth Simple Bilevel Optimization
    2024/02/12 by Jincheng Cao, Cao, Jincheng, Ruichen Jiang +5 · 3 citations
    Computer Science · Decision Sciences · Mathematics · #Advanced Optimization Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Optimization and Variational Analysis #Risk and Portfolio Optimization
  41. Quantized Decentralized Stochastic Learning over Directed Graphs
    2020/02/23 by Hossein Taheri, Aryan Mokhtari, Taheri, Hossein +5 · 1 citation
    Computer Science · #Cooperative Communication and Network Coding #Distributed #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Multiagent Systems (cs.MA) #Parallel #Privacy-Preserving Technologies in Data #Signal Processing (eess.SP) #Stochastic Gradient Optimization Techniques #Systems and Control (eess.SY) #and Cluster Computing (cs.DC) #electronic engineering #information engineering
  42. Minimax Optimization: The Case of Convex-Submodular
    2021/11/01 by Arman Adibi, Adibi, Arman, Aryan Mokhtari +3 · 1 citation
    Computer Science · Engineering · #Complexity and Algorithms in Graphs #Stochastic Gradient Optimization Techniques #Sparse and Compressive Sensing Techniques
  43. A Class of Parallel Doubly Stochastic Algorithms for Large-Scale Learning
    2016/06/15 by Mokhtari, Aryan, Koppel, Alec, Ribeiro, Alejandro · 1 citation
    #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
  44. MAML and ANIL Provably Learn Representations
    2022/02/07 by Liam Collins, Aryan Mokhtari, Collins, Liam +5 · 1 citation
    Computer Science · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Machine Learning and Data Classification
  45. Provably Private Distributed Averaging Consensus: An Information-Theoretic Approach
    2022/02/18 by Mohammad Fereydounian, Aryan Mokhtari, Fereydounian, Mohammad +5 · 1 citation
    Computer Science · Mathematics · #Privacy-Preserving Technologies in Data #Random Matrices and Applications #Distributed Sensor Networks and Detection Algorithms
  46. Statistical and Computational Complexities of BFGS Quasi-Newton Method for Generalized Linear Models
    2022/06/01 by Jin, Qiujiang, Ren, Tongzheng, Ho, Nhat +1 · 1 citation
    #FOS: Mathematics #Optimization and Control (math.OC)
  47. Future Gradient Descent for Adapting the Temporal Shifting Data Distribution in Online Recommendation Systems
    2022/09/02 by Ye, Mao, Jiang, Ruichen, Wang, Haoxiang +6 · 1 citation
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  48. Network Newton-Part II: Convergence Rate and Implementation
    2015/04/23 by Aryan Mokhtari, Mokhtari, Aryan, Qing Ling +3 · 1 citation
    Computer Science · Engineering · #Distributed Control Multi-Agent Systems #FOS: Mathematics #Neural Networks Stability and Synchronization #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques
  49. Stochastic Conditional Gradient++
    2019/02/19 by Hamed Hassani, Amin Karbasi, Hassani, Hamed +5 · 1 citation
    Computer Science · Engineering · #Stochastic Gradient Optimization Techniques #Sparse and Compressive Sensing Techniques #Complexity and Algorithms in Graphs
  50. Projection-Free Methods for Stochastic Simple Bilevel Optimization with Convex Lower-level Problem
    2023/08/15 by Cao, Jincheng, Jiang, Ruichen, Abolfazli, Nazanin +2 · 2 citations
    #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
  51. Provable Complexity Improvement of AdaGrad over SGD: Upper and Lower Bounds in Stochastic Non-Convex Optimization
    2024/06/07 by Jiang, Ruichen, Maladkar, Devyani, Mokhtari, Aryan · 1 citation
    #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
  52. Adaptive and Optimal Second-order Optimistic Methods for Minimax Optimization
    2024/06/04 by Jiang, Ruichen, Kavis, Ali, Jin, Qiujiang +2 · 1 citation
    #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
  53. Quantized Frank-Wolfe: Faster Optimization, Lower Communication, and Projection Free
    2019/02/17 by Mingrui Zhang, Lin Chen, Zhang, Mingrui +7 · 1 citation
    Computer Science · #Data Structures and Algorithms (cs.DS) #Distributed #Error Correcting Code Techniques #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Parallel #Quantum Computing Algorithms and Architecture #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
  54. Affine-Invariant Global Non-Asymptotic Convergence Analysis of BFGS under Self-Concordance
    2025/07/01 by Jin, Qiujiang, Mokhtari, Aryan · 2 citations
    #FOS: Mathematics #Numerical Analysis (math.NA) #Optimization and Control (math.OC)