Decoding sounds depicting hand-object interactions in primary somatosensory cortex

Bailey, Kerri M., Giordano, Bruno L., Kaas, Amanda L. and Smith, Fraser W. ORCID: https://orcid.org/0000-0002-8016-5109 (2023) Decoding sounds depicting hand-object interactions in primary somatosensory cortex. Cerebral Cortex, 33 (7). 3621–3635. ISSN 1047-3211

Preview

PDF (Manuscript_CC_Revision_FINAL_wFiguresForPure) - Accepted Version Download (985kB) | Preview

Abstract

Neurons, even in the earliest sensory regions of cortex, are subject to a great deal of contextual influences from both within and across modality connections. Recent work has shown that primary sensory areas can respond to and, in some cases, discriminate stimuli that are not of their target modality: for example, primary somatosensory cortex (SI) discriminates visual images of graspable objects. In the present work, we investigated whether SI would discriminate sounds depicting hand–object interactions (e.g. bouncing a ball). In a rapid event-related functional magnetic resonance imaging experiment, participants listened attentively to sounds from 3 categories: hand–object interactions, and control categories of pure tones and animal vocalizations, while performing a one-back repetition detection task. Multivoxel pattern analysis revealed significant decoding of hand–object interaction sounds within SI, but not for either control category. Crucially, in the hand-sensitive voxels defined from an independent tactile localizer, decoding accuracies were significantly higher for hand–object interactions compared to pure tones in left SI. Our findings indicate that simply hearing sounds depicting familiar hand–object interactions elicit different patterns of activity in SI, despite the complete absence of tactile stimulation. These results highlight the rich contextual information that can be transmitted across sensory modalities even to primary sensory areas.

Item Type:	Article
Additional Information:	Funding: BLG was supported by the French National Research Agency (ANR‐21‐CE37‐0027‐01 to BLG; ANR-16-CONV-0002 -- ILCB; ANR11-LABX-0036 -- BLRI).
Uncontrolled Keywords:	4* ,/dk/atira/pure/researchoutput/REFrank/4_
Faculty \ School:	Faculty of Social Sciences > School of Psychology
UEA Research Groups:	Faculty of Social Sciences > Research Groups > Cognition, Action and Perception
Depositing User:	LivePure Connector
Date Deposited:	14 Jul 2022 15:30
Last Modified:	31 Oct 2024 12:30
URI:	https://ueaeprints.uea.ac.uk/id/eprint/86110
DOI:	10.1093/cercor/bhac296

Downloads

Actions (login required)

View Item