vix.ing · top · new · best · stats · spec

Ohad Shamir

  1. Proving the Lottery Ticket Hypothesis: Pruning is All You Need
    2020/02/03 by Eran Malach, Malach, Eran, Gilad Yehudai +5 · 2 voices · 18 citations
    #cs.LG #stat.ML
  2. Failures of Gradient-Based Deep Learning
    2017/03/23 by Shai Shalev-Shwartz, Ohad Shamir, Shalev-Shwartz, Shai +3 · 1 voice · 8 citations
    #cs.LG #cs.NE #stat.ML
  3. Stochastic Gradient Descent for Non-smooth Optimization: Convergence\n Results and Optimal Averaging Schemes
    2012/12/08 by Ohad Shamir, Tong Zhang, Shamir, Ohad +1 · 57 citations
    Computer Science · Engineering · Mathematics · #Stochastic Gradient Optimization Techniques #Sparse and Compressive Sensing Techniques #Statistical Methods and Inference
  4. The Power of Depth for Feedforward Neural Networks
    2015/12/12 by Ronen Eldan, Ohad Shamir, Eldan, Ronen +1 · 25 citations
    Computer Science · #Machine Learning and Algorithms #Neural Networks and Applications #Stochastic Gradient Optimization Techniques
  5. Efficient Learning of Generalized Linear and Single Index Models with\n Isotonic Regression
    2011/04/11 by Sham M. Kakade, Adam Tauman Kalai, Kakade, Sham +5 · 16 citations
    Mathematics · Computer Science · #Statistical Methods and Inference #Bayesian Modeling and Causal Inference #Bayesian Methods and Mixture Models
  6. From Bandits to Experts: On the Value of Side-Observations
    2011/06/13 by Shie Mannor, Mannor, Shie, Ohad Shamir +1 · 14 citations
    Decision Sciences · Computer Science · #Advanced Bandit Algorithms Research #Machine Learning and Algorithms #Optimization and Search Problems
  7. An Optimal Algorithm for Bandit and Zero-Order Convex Optimization with Two-Point Feedback
    2015/07/31 by Ohad Shamir, Shamir, Ohad · 13 citations
    Computer Science · Decision Sciences · Engineering · #Advanced Bandit Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  8. Reconstructing Training Data from Trained Neural Networks
    2022/06/15 by Niv Haim, Gal Vardi, Haim, Niv +7 · 3 voices · 7 citations
    Computer Science · Mathematics · #Computer Vision and Pattern Recognition (cs.CV) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural and Evolutionary Computing (cs.NE) #cs.CR #cs.CV #cs.LG #cs.NE #stat.ML
  9. Depth-Width Tradeoffs in Approximating Natural Functions with Neural Networks
    2016/10/31 by Itay Safran, Ohad Shamir, Safran, Itay +1 · 15 citations
    Engineering · Physics and Astronomy · #Advanced Numerical Analysis Techniques #Model Reduction and Neural Networks
  10. Spurious Local Minima are Common in Two-Layer ReLU Neural Networks
    2017/12/24 by Itay Safran, Ohad Shamir, Safran, Itay +1 · 16 citations
    Computer Science · #Advanced Neural Network Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and ELM #Neural Networks and Applications
  11. Learning with the Weighted Trace-norm under Arbitrary Sampling Distributions
    2011/06/21 by Rina Foygel, Ruslan Salakhutdinov, Foygel, Rina +4 · 7 citations
    Computer Science · Engineering · #Machine Learning and Algorithms #Domain Adaptation and Few-Shot Learning #Sparse and Compressive Sensing Techniques
  12. Large-Scale Convex Minimization with a Low-Rank Constraint
    2011/06/08 by Shai Shalev‐Shwartz, Shalev-Shwartz, Shai, Alon Gonen +3 · 7 citations
    Engineering · #Sparse and Compressive Sensing Techniques #Indoor and Outdoor Localization Technologies #Advanced Adaptive Filtering Techniques
  13. Fundamental Limits of Online and Distributed Algorithms for Statistical Learning and Estimation
    2013/11/14 by Ohad Shamir, Shamir, Ohad · 5 citations
    Decision Sciences · Computer Science · #Advanced Bandit Algorithms Research #Machine Learning and Algorithms #Data Stream Mining Techniques
  14. The Complexity of Making the Gradient Small in Stochastic Convex\n Optimization
    2019/02/12 by Dylan J. Foster, Foster, Dylan J., Ayush Sekhari +9 · 5 citations
    Computer Science · Decision Sciences · Engineering · #Advanced Bandit Algorithms Research #Complexity and Algorithms in Graphs #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  15. How Good is SGD with Random Shuffling?
    2019/07/31 by Itay Safran, Safran, Itay, Ohad Shamir +1 · 5 citations
    Computer Science · Engineering · Mathematics · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Markov Chains and Monte Carlo Methods #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  16. An Algorithm with Optimal Dimension-Dependence for Zero-Order Nonsmooth Nonconvex Stochastic Optimization
    2023/07/10 by Guy Kornowski, Kornowski, Guy, Ohad Shamir +1 · 8 citations
    Computer Science · Decision Sciences · Engineering · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Risk and Portfolio Optimization #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  17. On the Complexity of Bandit and Derivative-Free Stochastic Convex\n Optimization
    2012/09/11 by Ohad Shamir, Shamir, Ohad · 3 citations
    Computer Science · Decision Sciences · Engineering · #Advanced Bandit Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  18. On the Optimal Memorization Power of ReLU Neural Networks
    2021/10/07 by Gal Vardi, Gilad Yehudai, Vardi, Gal +3 · 5 citations
    Computer Science · #Neural Networks and Applications #Stochastic Gradient Optimization Techniques #Machine Learning and ELM
  19. Deterministic Nonsmooth Nonconvex Optimization
    2023/02/16 by Michael I. Jordan, Jordan, Michael I., Guy Kornowski +7 · 5 citations
    Computer Science · #Stochastic Gradient Optimization Techniques #Advanced Neural Network Applications #Machine Learning and ELM
  20. Generalization in Kernel Regression Under Realistic Assumptions
    2023/12/26 by Daniel Barzilai, Barzilai, Daniel, Ohad Shamir +1 · 5 citations
    Computer Science · Engineering · #Stochastic Gradient Optimization Techniques #Machine Learning and ELM #Sparse and Compressive Sensing Techniques
  21. The Effects of Mild Over-parameterization on the Optimization Landscape\n of Shallow ReLU Neural Networks
    2020/06/01 by Itay Safran, Safran, Itay, Gilad Yehudai +3 · 3 citations
    Computer Science · #Advanced Neural Network Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and ELM #Neural Networks and Applications #Stochastic Gradient Optimization Techniques
  22. Relax and Localize: From Value to Algorithms
    2012/04/04 by Alexander Rakhlin, Rakhlin, Alexander, Ohad Shamir +3 · 2 citations
    Decision Sciences · Computer Science · #Advanced Bandit Algorithms Research #Machine Learning and Algorithms #Reinforcement Learning in Robotics
  23. Convergence of Stochastic Gradient Descent for PCA
    2015/09/30 by Ohad Shamir, Shamir, Ohad · 2 citations
    Computer Science · Engineering · Mathematics · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Markov Chains and Monte Carlo Methods #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  24. A Stochastic PCA and SVD Algorithm with an Exponential Convergence Rate
    2014/09/09 by Ohad Shamir, Shamir, Ohad · 1 citation
    Computer Science · Engineering · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and ELM #Numerical Analysis (math.NA) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  25. Online Learning with Local Permutations and Delayed Feedback
    2017/03/13 by Ohad Shamir, Liran Szlak, Shamir, Ohad +1 · 1 citation
    Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Optimization and Search Problems
  26. Space lower bounds for linear prediction in the streaming model
    2019/02/09 by Yuval Dagan, Dagan, Yuval, Gil Kur +3 · 1 citation
    Computer Science · Mathematics · #FOS: Computer and information sciences #Gaussian Processes and Bayesian Inference #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Markov Chains and Monte Carlo Methods #Stochastic Gradient Optimization Techniques
  27. Gradient Methods Never Overfit On Separable Data
    2020/06/30 by Ohad Shamir, Shamir, Ohad · 1 citation
    Computer Science · Engineering · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  28. Random Shuffling Beats SGD Only After Many Epochs on Ill-Conditioned\n Problems
    2021/06/12 by Itay Safran, Ohad Shamir, Safran, Itay +1 · 1 citation
    Computer Science · #Complexity and Algorithms in Graphs #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Machine Learning and Data Classification #Stochastic Gradient Optimization Techniques
  29. Learning a Single Neuron with Bias Using Gradient Descent
    2021/06/02 by Gal Vardi, Gilad Yehudai, Vardi, Gal +3 · 1 citation
    Computer Science · Engineering · #Advanced Memory and Neural Computing #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and ELM #Neural and Evolutionary Computing (cs.NE) #Stochastic Gradient Optimization Techniques
  30. From Tempered to Benign Overfitting in ReLU Neural Networks
    2023/05/24 by Guy Kornowski, Kornowski, Guy, Gilad Yehudai +3 · 1 citation
    Computer Science · Materials Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification #Machine Learning in Materials Science #Neural Networks and Applications #Neural and Evolutionary Computing (cs.NE)
  31. On the Hardness of Meaningful Local Guarantees in Nonsmooth Nonconvex Optimization
    2024/09/16 by Guy Kornowski, Swati Padmanabhan, Kornowski, Guy +3 · 1 citation
    Computer Science · Mathematics · #Advanced Optimization Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Optimization and Variational Analysis
  32. Simple Relative Deviation Bounds for Covariance and Gram Matrices
    2024/10/08 by Daniel Barzilai, Ohad Shamir, Barzilai, Daniel +1 · 1 citation
    Computer Science · #Blind Source Separation Techniques #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Matrix Theory and Algorithms #Neural Networks and Applications #Probability (math.PR) #Statistics Theory (math.ST)
  33. The Oracle Complexity of Simplex-based Matrix Games
    2024/12/09 by Guy Kornowski, Ohad Shamir, Kornowski, Guy +1 · 1 citation
    Decision Sciences · Economics, Econometrics and Finance · #Game Theory and Applications #Economic theories and models #Auction Theory and Applications
  34. Stronger Memory-Query Tradeoffs for Convex Optimization: The Limitations of Subquadratic Memory
    2026/07/21 by Michael Menart, Aleksandar Nikolov, Ohad Shamir
    #cs.DS #cs.CC #cs.LG #math.OC