2012/12/22 by Wolfram Schultz · 3 citations
Neuroscience · Biochemistry, Genetics and Molecular Biology · Psychology · #Neurotransmitter Receptor Influence on Behavior #Receptor Mechanisms and Signaling #Neural and Behavioral Psychology Studies #Salience (neuroscience) #Psychology #Dopamine #Stimulus (psychology) #Mean squared prediction error #Temporal difference learning #Reinforcement learning #Cognitive psychology #Perception #Neuroscience #Reward system #Discounting #Computer science #Machine learning
paper · doi:10.1016/j.conb.2012.11.012
openalex publication_date 2012/12/22 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/25
Recent work has advanced our knowledge of phasic dopamine reward prediction error signals. The error signal is bidirectional, reflects well the higher order prediction error described by temporal difference learning models, is compatible with model-free and model-based reinforcement learning, reports the subjective rather than physical reward value during temporal discounting and reflects subjective stimulus perception rather than physical stimulus aspects. Dopamine activations are primarily driven by reward, and to some extent risk, whereas punishment and salience have only limited activating effects when appropriate controls are respected. The signal is homogeneous in terms of time course but heterogeneous in many other aspects. It is essential for synaptic plasticity and a range of behavioural learning situations.