Cross-modal effects of value on perceptual acuity and stimulus encoding

Pooresmaeili, Arezoo, FitzGerald, Thomas H B ORCID:, Bach, Dominik R, Toelch, Ulf, Ostendorf, Florian and Dolan, Raymond J (2014) Cross-modal effects of value on perceptual acuity and stimulus encoding. Proceedings of the National Academy of Sciences of the United States of America (PNAS), 111 (42). pp. 15244-15249. ISSN 1091-6490

Full text not available from this repository. (Request a copy)


Cross-modal interactions are very common in perception. An important feature of many perceptual stimuli is their reward-predicting properties, the utilization of which is essential for adaptive behavior. What is unknown is whether reward associations in one sensory modality influence perception of stimuli in another modality. Here we show that auditory stimuli with high-reward associations increase the sensitivity of visual perception, even when sounds and reward associations are both irrelevant for the visual task. This increased sensitivity correlates with a change in stimulus representation in the visual cortex, indexed by increased multivariate decoding accuracy in simultaneously acquired functional MRI data. Univariate analysis showed that reward associations modulated responses in regions associated with multisensory processing in which the strength of modulation was a better predictor of the magnitude of the behavioral effect than the modulation in classical reward regions. Our findings demonstrate a value-driven cross-modal interaction that affects perception and stimulus encoding, with a resemblance to well-described modulatory effects of attention. We suggest that multisensory processing areas may mediate the transfer of value signals across senses.

Item Type: Article
Uncontrolled Keywords: acoustic stimulation,adult,attention,auditory perception,behavior,female,humans,magnetic resonance imaging,male,multivariate analysis,perception,photic stimulation,reproducibility of results,reward,temporal lobe,vision, ocular,visual cortex,visual perception,young adult
Faculty \ School: Faculty of Social Sciences > School of Psychology
Depositing User: Pure Connector
Date Deposited: 15 Apr 2016 10:01
Last Modified: 22 Oct 2022 01:01
DOI: 10.1073/pnas.1408873111

Actions (login required)

View Item View Item