vix.ing · top · new · best · stats · spec

Towards deep learning with spiking neurons in energy based models with contrastive Hebbian plasticity

2016/12/09 by Thomas Mésnard, Wulfram Gerstner, Mesnard, Thomas +3
Computer Science · Engineering · Neuroscience · #Advanced Memory and Neural Computing #FOS: Biological sciences #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural Networks and Applications #Neural and Evolutionary Computing (cs.NE) #Neural dynamics and brain function #Neurons and Cognition (q-bio.NC)

paper · pdf · doi:10.48550/arxiv.1612.03214

openalex publication_date 2016/12/09 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

In machine learning, error back-propagation in multi-layer neural networks (deep learning) has been impressively successful in supervised and reinforcement learning tasks. As a model for learning in the brain, however, deep learning has long been regarded as implausible, since it relies in its basic form on a non-local plasticity rule. To overcome this problem, energy-based models with local contrastive Hebbian learning were proposed and tested on a classification task with networks of rate neurons. We extended this work by implementing and testing such a model with networks of leaky integrate-and-fire neurons. Preliminary results indicate that it is possible to learn a non-linear regression task with hidden layers, spiking neurons and a local synaptic plasticity rule.

Citations

Related