2023/03/26 by Pache, Aaron, van Rossum, Mark CW
#Artificial Intelligence (cs.AI) #FOS: Biological sciences #FOS: Computer and information sciences #I.2.6 #Machine Learning (cs.LG) #Neural and Evolutionary Computing (cs.NE) #Neurons and Cognition (q-bio.NC)
paper · doi:10.48550/arxiv.2303.16067
When training neural networks for classification tasks with backpropagation, parameters are updated on every trial, even if the sample is classified correctly. In contrast, humans concentrate their learning effort on errors. Inspired by human learning, we introduce lazy learning, which only learns on incorrect samples. Lazy learning can be implemented in a few lines of code and requires no hyperparameter tuning. Lazy learning achieves state-of-the-art performance and is particularly suited when datasets are large. For instance, it reaches 99.2% test accuracy on Extended MNIST using a single-layer MLP, and does so 7.6x faster than a matched backprop network