Valence precedes value in neural encoding of prediction error

Stewardson, Harry and Sambrook, Tom (2023) Valence precedes value in neural encoding of prediction error. Psychophysiology. ISSN 0048-5772

[thumbnail of Stewardson_Sambrook_2023_Psychophysiology]
PDF (Stewardson_Sambrook_2023_Psychophysiology) - Published Version
Available under License Creative Commons Attribution.

Download (2MB) | Preview


Event-related potentials that follow feedback in reinforcement learning tasks have been proposed to reflect neural encoding of prediction errors. Prior research has shown that in the interval of 240–340 ms multiple different prediction error encodings appear to co-occur, including a value signal carrying signed quantitative prediction error and a valence signal merely carrying sign. The effects used to identify these two encoders, respectively a sign main effect and a sign × size interaction, do not reliably discriminate them. A full discrimination is made possible by comparing tasks in which the reinforcer available on a given trial is set to be either appetitive or aversive against tasks where a trial allows the possibility of either. This study presents a meta-analysis of reinforcement learning experiments, the majority of which presented the possibility of winning or losing money. Value and valence encodings were identified by conventional difference wave methodology but additionally by an analysis of their predicted behavior using a Bayesian analysis that incorporated nulls into the evidence for each encoder. The results suggest that a valence encoding, sensitive only to the available outcomes on the trial at hand precedes a later value encoding sensitive to the outcomes available in the wider experimental context. The implications of this for modeling computational processes of reinforcement learning in humans are discussed.

Item Type: Article
Faculty \ School: Faculty of Social Sciences > School of Psychology
Depositing User: LivePure Connector
Date Deposited: 26 Jan 2023 11:30
Last Modified: 17 Feb 2023 12:30
DOI: 10.1111/psyp.14266

Actions (login required)

View Item View Item