Smith, Leslie N.

1. Cyclical Learning Rates for Training Neural Networks
   2015/06/03 by Smith, Leslie N. · 75 citations
   #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural and Evolutionary Computing (cs.NE)
2. A disciplined approach to neural network hyper-parameters: Part 1 -- learning rate, batch size, momentum, and weight decay
   2018/03/26 by Leslie N. Smith, Smith, Leslie N. · 25 citations
   Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural and Evolutionary Computing (cs.NE)
3. Super-Convergence: Very Fast Training of Neural Networks Using Large\n Learning Rates
   2017/08/23 by Leslie N. Smith, Nicholay Topin, Smith, Leslie N. +1 · 10 citations
   Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and ELM #Neural and Evolutionary Computing (cs.NE) #Stochastic Gradient Optimization Techniques
4. Best Practices for Applying Deep Learning to Novel Applications
   2017/04/05 by Leslie N. Smith, Smith, Leslie N. · 1 voice
   Computer Science · Social Sciences · #Anomaly Detection Techniques and Applications #Software Engineering and Design Patterns #Time Series Analysis and Forecasting #cs.AI #cs.NE #cs.SE
5. Exploring loss function topology with cyclical learning rates
   2017/02/14 by Smith, Leslie N., Topin, Nicholay · 3 citations
   #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural and Evolutionary Computing (cs.NE)
6. Gradual DropIn of Layers to Train Very Deep Neural Networks
   2015/11/22 by Leslie N. Smith, Smith, Leslie N., Emily M. Hand +3 · 1 citation
   Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural and Evolutionary Computing (cs.NE) #cs.CV #cs.LG #cs.NE