Retrospective inference as a form of bounded rationality, and its beneficial influence on learning

FitzGerald, Thomas ORCID: https://orcid.org/0000-0002-3855-1591, Penny, Will D. ORCID: https://orcid.org/0000-0001-9064-1191, Bonnici, Heidi and Adams, Rick (2020) Retrospective inference as a form of bounded rationality, and its beneficial influence on learning. Frontiers in Artificial Intelligence, 3. ISSN 2624-8212

Preview

PDF (frai-03-00002) - Published Version Available under License Creative Commons Attribution. Download (1MB) | Preview

Abstract

Probabilistic models of cognition typically assume that agents make inferences about current states by combining new sensory information with fixed beliefs about the past, an approach known as Bayesian filtering. This is computationally parsimonious, but, in general, leads to suboptimal beliefs about past states, since it ignores the fact that new observations typically contain information about the past as well as the present. This is disadvantageous both because knowledge of past states may be intrinsically valuable, and because it impairs learning about fixed or slowly changing parameters of the environment. For these reasons, in offline data analysis it is usual to infer on every set of states using the entire time series of observations, an approach known as (fixed-interval) Bayesian smoothing. Unfortunately, however, this is impractical for real agents, since it requires the maintenance and updating of beliefs about an ever-growing set of states. We propose an intermediate approach, finite retrospective inference (FRI), in which agents perform update beliefs about a limited number of past states (Formally, this represents online fixed-lag smoothing with a sliding window). This can be seen as a form of bounded rationality in which agents seek to optimize the accuracy of their beliefs subject to computational and other resource costs. We show through simulation that this approach has the capacity to significantly increase the accuracy of both inference and learning, using a simple variational scheme applied to both randomly generated Hidden Markov models (HMMs), and a specific application of the HMM, in the form of the widely used probabilistic reversal task. Our proposal thus constitutes a theoretical contribution to normative accounts of bounded rationality, which makes testable empirical predictions that can be explored in future work.

Item Type:	Article
Faculty \ School:	Faculty of Social Sciences > School of Psychology
UEA Research Groups:	Faculty of Social Sciences > Research Groups > Cognition, Action and Perception Faculty of Social Sciences > Research Centres > Centre for Behavioural and Experimental Social Sciences
Depositing User:	LivePure Connector
Date Deposited:	25 Feb 2020 08:30
Last Modified:	07 Mar 2024 22:30
URI:	https://ueaeprints.uea.ac.uk/id/eprint/74305
DOI:	10.3389/frai.2020.00002

Downloads

Actions (login required)

View Item