Kobayashi, Seijin
- Uncovering mesa-optimization algorithms in Transformers
2023/09/11 by Johannes von Oswald, Maximilian Schlegel, von Oswald, Johannes +24 · 2 voices · 13 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.LG
- Weight decay induces low-rank attention layers
2024/10/31 by Seijin Kobayashi, Kobayashi, Seijin, Yassir Akram +4 · 1 voice · 8 citations
Computer Science · Neuroscience · #FOS: Computer and information sciences #Functional Brain Connectivity Studies #Machine Learning (cs.LG) #Neural dynamics and brain function #Visual Attention and Saliency Detection #cs.LG
- Emergent temporal abstractions in autoregressive models enable hierarchical reinforcement learning
2025/12/23 by Seijin Kobayashi, Kobayashi, Seijin, Yanick Schimpf +29 · 5 voices · 1 citation
Computer Science · #Reinforcement Learning in Robotics #Adversarial Robustness in Machine Learning #Neural Networks and Reservoir Computing
- Discovering modular solutions that generalize compositionally
2023/12/22 by Simon Schug, Seijin Kobayashi, Schug, Simon +15 · 4 citations
Computer Science · #Topic Modeling #Explainable Artificial Intelligence (XAI)
- MesaNet: Sequence Modeling by Locally Optimal Test-Time Training
2025/06/05 by Johannes von Oswald, von Oswald, Johannes, Nino Scherrer +30 · 11 citations
Computer Science · #Topic Modeling #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning
- Learning where to learn: Gradient sparsity in meta and continual\n learning
2021/01/01 by Johannes von Oswald, Dominic Zhao, von Oswald, Johannes +11 · 2 citations
Computer Science · Physics and Astronomy · #Domain Adaptation and Few-Shot Learning #Human Pose and Action Recognition #Model Reduction and Neural Networks
- Posterior Meta-Replay for Continual Learning
2021/03/01 by Henning, Christian, Cervera, Maria R., D'Angelo, Francesco +6 · 2 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Attention as a Hypernetwork
2024/06/09 by Schug, Simon, Kobayashi, Seijin, Akram, Yassir +2 · 3 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- Meta-Learning via Classifier(-free) Diffusion Guidance
2022/10/17 by Nava, Elvis, Kobayashi, Seijin, Yin, Yifei +2 · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- Embedded Universal Predictive Intelligence: a coherent framework for multi-agent learning
2025/11/27 by Alexander Meulemans, Meulemans, Alexander, Rajai Nasser +23 · 5 voices · 1 citation
#cs.AI
- Would I have gotten that reward? Long-term credit assignment by counterfactual contribution analysis
2023/06/29 by Meulemans, Alexander, Schug, Simon, Kobayashi, Seijin +2 · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- The least-control principle for local learning at equilibrium
2022/07/04 by Meulemans, Alexander, Zucchet, Nicolas, Kobayashi, Seijin +2 · 1 citation
#68T07 #FOS: Computer and information sciences #I.2.6 #Machine Learning (cs.LG) #Neural and Evolutionary Computing (cs.NE)
- Multi-agent cooperation through learning-aware policy gradients
2024/10/24 by Meulemans, Alexander, Kobayashi, Seijin, von Oswald, Johannes +6 · 1 citation
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences
- When can transformers compositionally generalize in-context?
2024/07/17 by Kobayashi, Seijin, Schug, Simon, Akram, Yassir +5 · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural and Evolutionary Computing (cs.NE)