Principal components analysis of reward prediction errors in a reinforcement learning task

Sambrook, Thomas D. and Goslin, Jeremy (2016) Principal components analysis of reward prediction errors in a reinforcement learning task. NeuroImage, 124 (Part A). pp. 276-286. ISSN 1053-8119

Preview

PDF (Accepted manuscript) - Accepted Version Available under License Creative Commons Attribution Non-commercial No Derivatives. Download (358kB) | Preview

Abstract

Models of reinforcement learning represent reward and punishment in terms of reward prediction errors (RPEs), quantitative signed terms describing the degree to which outcomes are better than expected (positive RPEs) or worse (negative RPEs). An electrophysiological component known as feedback related negativity (FRN) occurs at frontocentral sites 240-340 ms after feedback on whether a reward or punishment is obtained, and has been claimed to neurally encode an RPE. An outstanding question however, is whether the FRN is sensitive to the size of both positive RPEs and negative RPEs. Previous attempts to answer this question have examined the simple effects of RPE size for positive RPEs and negative RPEs separately. However, this methodology can be compromised by overlap from components coding for unsigned prediction error size, or "salience", which are sensitive to the absolute size of a prediction error but not its valence. In our study, positive and negative RPEs were parametrically modulated using both reward likelihood and magnitude, with principal components analysis used to separate out overlying components. This revealed a single RPE encoding component responsive to the size of positive RPEs, peaking at similar to 330ms, and occupying the delta frequency band. Other components responsive to unsigned prediction error size were shown, but no component sensitive to negative RPE size was found. (C) 2015 Elsevier Inc. All rights reserved.

Item Type:	Article
Faculty \ School:	Faculty of Social Sciences > School of Psychology
UEA Research Groups:	Faculty of Social Sciences > Research Groups > Cognition, Action and Perception
Depositing User:	Pure Connector
Date Deposited:	30 Nov 2017 06:05
Last Modified:	22 Oct 2022 03:12
URI:	https://ueaeprints.uea.ac.uk/id/eprint/65628
DOI:	10.1016/j.neuroimage.2015.07.032

Downloads

Actions (login required)

View Item