- Why Can't Transformers Learn Multiplication? Reverse-Engineering Reveals Long-Range Dependency Pitfalls
2025/09/30 by Xiaoyan Bai, Bai, Xiaoyan, Itamar Pres +15 · 8 voices · 1 citation
Computer Science · Engineering · #Advanced Data Storage Technologies #Construct (python library) #Dependency (UML) #Directed acyclic graph #Inductive bias #Linear model #Low-power high-performance VLSI design #Multi-task learning #Pairwise comparison #Parallel Computing and Optimization Techniques #Statistical model #Task (project management) #cs.AI #cs.LG
- Teasing Apart Architecture and Initial Weights as Sources of Inductive Bias in Neural Networks
2025/02/27 by Gianluca Bencomo, Max Gupta, Bencomo, Gianluca +7 · 1 voice · 3 citations
Computer Science · #Architecture #Artificial neural network #Cognition #Domain Adaptation and Few-Shot Learning #Explainable Artificial Intelligence (XAI) #Focus (optics) #Inductive bias #Limiting #Machine Learning and Data Classification #Multi-task learning #Transformer
- Energy-based learning algorithms for analog computing: a comparative study
2023/12/22 by Benjamin Scellier, Maxence Ernoult, Scellier, Benjamin +5 · 14 citations
Computer Science · Engineering · #Advanced Memory and Neural Computing #Algorithm #Artificial intelligence #Asynchronous communication #Computer Vision and Pattern Recognition (cs.CV) #Computer science #Convolutional neural network #Deep learning #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #MNIST database #Machine Learning (cs.LG) #Machine Learning and ELM #Machine learning #Multi-task learning #Scalability #Task (project management)
- Machine Learning Paradigms for Speech Recognition: An Overview
2013/01/30 by Li Deng, Xiao Li · 1 citation
Computer Science · #Speech Recognition and Synthesis #Speech and Audio Processing #Music and Audio Processing #Computer science #Artificial intelligence #Discriminative model #Machine learning #Context (archaeology) #Hidden Markov model #Unsupervised learning #Deep learning #Task (project management) #Multi-task learning #Sequence learning
- Grammatical acquisition: Inductive bias and coevolution of language and the language acquisition device
2000/06/01 by Ted Briscoe · 1 citation
Social Sciences · Computer Science · Psychology · #Language and cultural evolution #Natural Language Processing Techniques #Language Development and Disorders #Generality #Inductive bias #Computer science #Set (abstract data type) #Inheritance (genetic algorithm) #Language acquisition #Grammar #Categorial grammar #Inductive reasoning #Abstraction #Natural language processing #Artificial intelligence #Linguistics #Programming language #Multi-task learning #Psychology #Task (project management) #Mildly context-sensitive grammar formalism