2003/01/31 by R. J. C. Bosman, Bosman, R. J. C., W. A. van Leeuwen +3
Biochemistry, Genetics and Molecular Biology · Physics and Astronomy · #Disordered Systems and Neural Networks (cond-mat.dis-nn) #FOS: Biological sciences #FOS: Physical sciences #Quantitative Biology (q-bio) #cond-mat.dis-nn #q-bio
paper · pdf · doi:10.48550/arxiv.cond-mat/0301627
arxiv created 2003/01/31 · arxiv updated 2009/11/30
A toy model of a neural network in which both Hebbian learning and reinforcement learning occur is studied. The problem of `path interference', which makes that the neural net quickly forgets previously learned input-output relations is tackled by adding a Hebbian term (proportional to the learning rate η) to the reinforcement term (proportional to ρ) in the learning rule. It is shown that the number of learning steps is reduced considerably if 1/4 < η/ρ< 1/2, i.e., if the Hebbian term is neither too small nor too large compared to the reinforcement term.