2025/04/29 by Borjan Geshkovski, Cyril Letrouit, Yury Polyanskiy +1 · 1 voice
Engineering · #Induction Heating and Inverter Technology
paper · pdf · doi:10.1090/bull/1863
openalex publication_date 2025/04/29 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/01
Transformers play a central role in the inner workings of large language models.We develop a mathematical framework for analyzing transformers based on their interpretation as interacting particle systems, with a particular emphasis on long-time clustering behavior.Our study explores the underlying theory and offers new perspectives for mathematicians as well as computer scientists.