Kazuki Irie
- A Modern Self-Referential Weight Matrix That Learns to Modify Itself
2022/02/11 by Kazuki Irie, Imanol Schlag, Irie, Kazuki +5 · 2 voices · 10 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Machine Learning and ELM #Neural Networks and Applications #cs.LG
- Mindstorms in Natural Language-Based Societies of Mind
2023/05/26 by Mingchen Zhuge, Haozhe Liu, Zhuge, Mingchen +49 · 5 voices · 9 citations
Computer Science · Social Sciences · #Language and cultural evolution #Multimodal Machine Learning Applications #Topic Modeling #cs.AI #cs.CL #cs.CV #cs.LG #cs.MA
- Key-value memory in the brain
2025/01/06 by Samuel J. Gershman, Gershman, Samuel J., Ila Fiete +3 · 5 voices · 8 citations
Computer Science · #Cognitive Science and Mapping #cs.AI #cs.LG #q-bio.NC
- Going Beyond Linear Transformers with Recurrent Fast Weight Programmers
2021/06/11 by Kazuki Irie, Irie, Kazuki, Imanol Schlag +5 · 8 citations
Computer Science · #Artificial Intelligence in Games #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics
- MoEUT: Mixture-of-Experts Universal Transformers
2024/05/25 by Róbert Csordás, Kazuki Irie, Csordás, Róbert +7 · 13 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural and Evolutionary Computing (cs.NE) #Semantic Web and Ontologies
- Lingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling
2019/02/21 by Jonathan Shen, Patrick Nguyen, Shen, Jonathan +179 · 1 voice · 1 citation
Computer Science · Mathematics · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #cs.LG #stat.ML
- SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention
2023/12/13 by Róbert Csordás, Piotr Piękos, Csordás, Róbert +5 · 5 citations
Engineering · Computer Science · #Ferroelectric and Negative Capacitance Devices #Parallel Computing and Optimization Techniques #Topic Modeling
- The Devil is in the Detail: Simple Tricks Improve Systematic\n Generalization of Transformers
2021/08/26 by Róbert Csordás, Kazuki Irie, Csordás, Róbert +3 · 4 citations
Computer Science · Physics and Astronomy · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Model Reduction and Neural Networks #Neural Networks and Applications #Neural and Evolutionary Computing (cs.NE) #Topic Modeling
- Blending Complementary Memory Systems in Hybrid Quadratic-Linear Transformers
2025/05/31 by Kazuki Irie, Irie, Kazuki, Morris Yau +3 · 1 voice · 7 citations
Engineering · Computer Science · #Advanced Memory and Neural Computing #Parallel Computing and Optimization Techniques #Advanced Data Storage Technologies
- Metalearning Continual Learning Algorithms
2023/12/01 by Kazuki Irie, Róbert Csordás, Irie, Kazuki +3 · 1 voice
#cs.LG
- Practical Computational Power of Linear Transformers and Their Recurrent and Self-Referential Extensions
2023/10/24 by Kazuki Irie, Irie, Kazuki, Róbert Csordás +3 · 2 citations
Computer Science · Engineering · #Advanced Neural Network Applications #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Neural Networks and Applications
- Overcoming classic challenges for artificial neural networks by providing incentives and practice
2024/10/14 by Kazuki Irie, Brenden M. Lake, Irie, Kazuki +1 · 3 voices · 3 citations
Computer Science · Psychology · #Child and Animal Learning Development #Domain Adaptation and Few-Shot Learning #Neural Networks and Applications #cs.AI #cs.LG #q-bio.NC
- Fast weight programming and linear transformers: from machine learning to neurobiology
2025/08/11 by Kazuki Irie, Samuel J. Gershman · 4 voices · 1 citation
#cs.LG #cs.AI #q-bio.NC
- Accelerating Neural Self-Improvement via Bootstrapping
2023/05/02 by Kazuki Irie, Irie, Kazuki, Jürgen Schmidhuber +1 · 1 voice
Computer Science · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling #cs.LG
- Why Are Positional Encodings Nonessential for Deep Autoregressive Transformers? Revisiting a Petroglyph
2024/12/31 by Kazuki Irie, Irie, Kazuki · 2 citations
Arts and Humanities · Computer Science · Earth and Planetary Sciences · #3D Surveying and Cultural Heritage #Archaeological and Geological Studies #Computation and Language (cs.CL) #FOS: Computer and information sciences #Image Processing and 3D Reconstruction #Machine Learning (cs.LG)
- Learning Abstractions for Hierarchical Planning in Program-Synthesis Agents
2026/01/31 by Zergham Ahmed, Kazuki Irie, Joshua B. Tenenbaum +2 · 2 voices
#cs.AI