Tim Roith
- Analysis of mean-field models arising from self-attention dynamics in transformer architectures with layer normalization
2025/01/06 by Martin Burger, Samira Kabri, Burger, Martin +7 · 10 citations
Computer Science · #43A35 #49Q20 #68Q32 #Analysis of PDEs (math.AP) #FOS: Mathematics #Neural Networks and Applications
- Polarized consensus-based dynamics for optimization and sampling
2024/05/31 by Leon Bungert, Tim Roith, Philipp Wacker · 3 citations
Computer Science · Physics and Astronomy · #Distributed Control Multi-Agent Systems #Opinion Dynamics and Social Influence #Advanced Thermodynamics and Statistical Mechanics
- Neural Architecture Search via Bregman Iterations
2021/06/04 by Leon Bungert, Tim Roith, Bungert, Leon +5 · 1 citation
Computer Science · Physics and Astronomy · #65K10 #68T05 #90C26 #F.2.1 #FOS: Computer and information sciences #FOS: Mathematics #G.1.6 #Gaussian Processes and Bayesian Inference #I.2.6 #Image and Signal Denoising Methods #Machine Learning (cs.LG) #Model Reduction and Neural Networks #Neural and Evolutionary Computing (cs.NE) #Optimization and Control (math.OC)