Cabannes, Vivien

1. Birth of a Transformer: A Memory Viewpoint
   2023/06/01 by Alberto Bietti, Bietti, Alberto, Vivien Cabannes +7 · 32 citations
   Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
2. Iteration Head: A Mechanistic Study of Chain-of-Thought
   2024/06/04 by Cabannes, Vivien, Arnal, Charles, Bouaziz, Wassim +3 · 13 citations
   #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
3. Learning Associative Memories with Gradient Descent
   2024/02/28 by Vivien Cabannes, Berfin Şimşek, Cabannes, Vivien +3 · 4 citations
   Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Intelligent Tutoring Systems and Adaptive Learning #Machine Learning (cs.LG) #Machine Learning (stat.ML)
4. Asymmetric REINFORCE for off-Policy Reinforcement Learning: Balancing positive and negative rewards
   2025/06/25 by Charles Arnal, Arnal, Charles, Gaëtan Narozniak +9 · 13 citations
   Computer Science · Psychology · #Behavioral and Psychological Studies #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics
5. \mathbbX-Sample Contrastive Loss: Improving Contrastive Learning with Sample Similarity Graphs
   2024/07/25 by Vlad Sobal, Sobal, Vlad, Mark Ibrahim +13 · 1 voice · 3 citations
   Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Machine Learning and Data Classification #cs.CV #cs.LG
6. Scaling Laws for Associative Memories
   2023/10/04 by Vivien Cabannes, Elvis Dohmatob, Cabannes, Vivien +3 · 3 citations
   Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Error Correcting Code Techniques #FOS: Computer and information sciences #G.1.6 #I.2.6 #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Neural Networks and Applications #Neural and Evolutionary Computing (cs.NE)
7. Unveiling Simplicities of Attention: Adaptive Long-Context Head Identification
   2025/02/11 by Donhauser, Konstantin, Arnal, Charles, Pezeshki, Mohammad +3 · 2 citations
   #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
8. A Mechanistic Study of Transformers Training Dynamics
   2024/10/31 by Ambroise Odonnat, Wassim Bouaziz, Odonnat, Ambroise +3 · 1 citation
   Computer Science · #Neural Networks and Applications