vix.ing · top · new · best · stats · spec

Democratic Reinforcement: Learning via Self-Organization

1996/01/23 by Dimitris Stassinopoulos, Per Bak, Stassinopoulos, Dimitris +1
Biochemistry, Genetics and Molecular Biology · Engineering · Neuroscience · Physics and Astronomy · #Advanced Memory and Neural Computing #Condensed Matter (cond-mat) #FOS: Biological sciences #FOS: Physical sciences #Neural dynamics and brain function #Quantitative Biology (q-bio) #cond-mat #q-bio #stochastic dynamics and bifurcation

paper · pdf · doi:10.48550/arxiv.cond-mat/9601113

9 pages (TeX), 3 figures supllied on request

arxiv created 1996/01/23 · openalex publication_date 1996/01/23 · arxiv updated 2009/11/30 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/01

Abstract

The problem of learning in the absence of external intelligence is discussed in the context of a simple model. The model consists of a set of randomly connected, or layered integrate-and fire neurons. Inputs to and outputs from the environment are connected randomly to subsets of neurons. The connections between firing neurons are strengthened or weakened according to whether the action is successful or not. The model departs from the traditional gradient-descent based approaches to learning by operating at a highly susceptible ``critical'' state, with low activity and sparse connections between firing neurons. Quantitative studies on the performance of our model in a simple association task show that by tuning our system close to this critical state we can obtain dramatic gains in performance.

Related