Tools
ToolsBülthoff, Isabelle, Manno, Laura and Zhao, Mintao (2023) Varying sex and identity of faces affects face categorization differently in humans and computational models. Scientific Reports, 13. ISSN 2045-2322
Preview |
PDF (s41598-023-43169-9)
- Published Version
Available under License Creative Commons Attribution. Download (1MB) | Preview |
Abstract
Our faces display socially important sex and identity information. How perceptually independent are these facial characteristics? Here, we used a sex categorization task to investigate how changing faces in terms of either their sex or identity affects sex categorization of those faces, whether these manipulations affect sex categorization similarly when the original faces were personally familiar or unknown, and, whether computational models trained for sex classification respond similarly to human observers. Our results show that varying faces along either sex or identity dimension affects their sex categorization. When the sex was swapped (e.g., female faces became male looking, Experiment 1), sex categorization performance was different from that with the original unchanged faces, and significantly more so for people who were familiar with the original faces than those who were not. When the identity of the faces was manipulated by caricaturing or anti-caricaturing them (these manipulations either augment or diminish idiosyncratic facial information, Experiment 2), sex categorization performance to caricatured, original, and anti-caricatured faces increased in that order, independently of face familiarity. Moreover, our face manipulations showed different effects upon computational models trained for sex classification and elicited different patterns of responses in humans and computational models. These results not only support the notion that the sex and identity of faces are processed integratively by human observers but also demonstrate that computational models of face categorization may not capture key characteristics of human face categorization.
| Item Type: | Article |
|---|---|
| Faculty \ School: | Faculty of Social Sciences > School of Psychology |
| Related URLs: | |
| Depositing User: | LivePure Connector |
| Date Deposited: | 28 Sep 2023 09:30 |
| Last Modified: | 12 Oct 2023 00:42 |
| URI: | https://ueaeprints.uea.ac.uk/id/eprint/93121 |
| DOI: | 10.1038/s41598-023-43169-9 |
Downloads
Downloads per month over past year
Actions (login required)
 |
View Item |