Model based control can give rise to devaluation insensitive choice

Garrett, Neil ORCID: https://orcid.org/0000-0003-1440-472X, Allan, Sean and Daw, Nathaniel D. (2023) Model based control can give rise to devaluation insensitive choice. Addiction Neuroscience, 6. ISSN 2772-3925

Preview

PDF (Garrett_etal_2023_AddictionNeuroscience) - Published Version Available under License Creative Commons Attribution. Download (2MB) | Preview

Abstract

Influential recent work aims to ground psychiatric dysfunction in the brain's basic computational mechanisms. For instance, the compulsive symptoms that feature prominently in drug abuse and addiction have been argued to arise from over reliance on a habitual “model-free” system in contrast to a more laborious “model-based” system. Support for this account comes in part from failures to appropriately change behavior in light of new events. Notably, instrumental responding can, in some circumstances, persist despite reinforcer devaluation, perhaps reflecting control by model-free mechanisms that are driven by past reinforcement rather than knowledge of the (now devalued) outcome. However, another line of theory posits a different mechanism – latent causal inference – that can modulate behavioral change. It concerns how animals identify different contingencies that apply in different circumstances, by covertly clustering experiences into distinct groups. Here we combine both lines of theory to investigate the consequences of latent cause inference on instrumental sensitivity to reinforcer devaluation. We show that instrumental insensitivity to reinforcer devaluation can arise in this theory even using only model-based planning, and does not require or imply any habitual, model-free component. These ersatz habits (like laboratory ones) emerge after overtraining, interact with contextual cues, and show preserved sensitivity to reinforcer devaluation on a separate consumption test, a standard control. Together, this work highlights the need for caution in using reinforcer devaluation procedures to rule in (or out) the contribution of different learning mechanisms and offers a new perspective on the neurocomputational substrates of drug abuse.

Item Type:	Article
Additional Information:	Funding information: This research was supported by a US Army Research Office grant (W911NF-16-1-0474) to N.D.D. and a Sir Henry Wellcome Postdoctoral Fellowship (209108/Z/17/Z) to N.G. Rights Retention Statement: For the purpose of open access, N.G. has applied a CC BY public copyright licence to any Author Accepted Manuscript version arising from this submission.
Uncontrolled Keywords:	addiction,devaluation,habits,latent causal inference,model based planning,genetics,neuroscience (miscellaneous),sdg 3 - good health and well-being ,/dk/atira/pure/subjectarea/asjc/1300/1311
Faculty \ School:	Faculty of Social Sciences > School of Psychology
UEA Research Groups:	Faculty of Social Sciences > Research Groups > Cognition, Action and Perception Faculty of Social Sciences > Research Groups > Social Cognition Research Group
Related URLs:	http://www.scopus.com/inward/record.url?...
Depositing User:	LivePure Connector
Date Deposited:	15 Feb 2023 16:30
Last Modified:	24 Oct 2024 00:01
URI:	https://ueaeprints.uea.ac.uk/id/eprint/91142
DOI:	10.1016/j.addicn.2023.100070

Downloads

Actions (login required)

View Item