Atli Kosson

1. Rotational Equilibrium: How Weight Decay Balances Learning Across Neural Networks
   2023/05/26 by Atli Kosson, Bettina Messmer, Kosson, Atli +3 · 2 voices · 11 citations
   Physics and Astronomy · #Advanced Thermodynamics and Statistical Mechanics
2. Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations
   2024/05/28 by Alexander Hägele, Elie Bakouch, Hägele, Alexander +9 · 38 citations
   Decision Sciences · #Scheduling and Timetabling Solutions #Simulation Techniques and Applications
3. Online Normalization for Training Neural Networks
   2019/05/15 by Vitaliy Chiley, Ilya Sharapov, Chiley, Vitaliy +13 · 2 citations
   Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural Networks and Applications
4. Multiplication-Free Transformer Training via Piecewise Affine Operations
   2023/05/26 by Atli Kosson, Martin Jaggi, Kosson, Atli +1 · 1 citation
   Computer Science · Physics and Astronomy · #Advanced Neural Network Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Model Reduction and Neural Networks #Neural Networks and Applications