Dopamine, reward learning, and active inference

FitzGerald, Thomas H B ORCID: https://orcid.org/0000-0002-3855-1591, Dolan, Raymond J and Friston, Karl (2015) Dopamine, reward learning, and active inference. Frontiers in Computational Neuroscience, 9. ISSN 1662-5188

Preview

PDF (fncom-09-00136) - Published Version Available under License Creative Commons Attribution. Download (3MB) | Preview

Abstract

Temporal difference learning models propose phasic dopamine signaling encodes reward prediction errors that drive learning. This is supported by studies where optogenetic stimulation of dopamine neurons can stand in lieu of actual reward. Nevertheless, a large body of data also shows that dopamine is not necessary for learning, and that dopamine depletion primarily affects task performance. We offer a resolution to this paradox based on an hypothesis that dopamine encodes the precision of beliefs about alternative actions, and thus controls the outcome-sensitivity of behavior. We extend an active inference scheme for solving Markov decision processes to include learning, and show that simulated dopamine dynamics strongly resemble those actually observed during instrumental conditioning. Furthermore, simulated dopamine depletion impairs performance but spares learning, while simulated excitation of dopamine neurons drives reward learning, through aberrant inference about outcome states. Our formal approach provides a novel and parsimonious reconciliation of apparently divergent experimental findings.

Item Type:	Article
Uncontrolled Keywords:	reward,reward learning,variational inference,dopamine,active interference,instrumental conditioning,incentive salience,learning
Faculty \ School:	Faculty of Social Sciences > School of Psychology
Depositing User:	Pure Connector
Date Deposited:	15 Apr 2016 15:00
Last Modified:	06 Mar 2024 07:32
URI:	https://ueaeprints.uea.ac.uk/id/eprint/58286
DOI:	10.3389/fncom.2015.00136

Downloads

Actions (login required)

View Item