Beyond Likert ratings: Improving the robustness of developmental research measurement using best-worst scaling

Burton, Nichola, Burton, Michael, Fisher, Carmen, Gonzalez Pena, Patricia, Rhodes, Gillian and Ewing, Louise ORCID: https://orcid.org/0000-0001-5263-1267 (2021) Beyond Likert ratings: Improving the robustness of developmental research measurement using best-worst scaling. Behavior Research Methods, 53 (5). 2273–2279. ISSN 1554-351X

[thumbnail of Accepted_Manuscript]
Preview
PDF (Accepted_Manuscript) - Accepted Version
Available under License Creative Commons Attribution.

Download (226kB) | Preview

Abstract

Some of the ‘best practice’ approaches to ensuring reproducibility of research can be difficult to implement in the developmental and clinical domains, where sample sizes and session lengths are constrained by the practicalities of recruitment and testing. For this reason, an important area of improvement to target is the reliability of measurement. Here we demonstrate that best–worst scaling (BWS) provides a superior alternative to Likert ratings for measuring children’s subjective impressions. Seventy-three children aged 5–6 years rated the trustworthiness of faces using either Likert ratings or BWS over two sessions. Individual children’s ratings in the BWS condition were significantly more consistent from session 1 to session 2 than those in the Likert condition, a finding we also replicate with a large adult sample (N = 72). BWS also produced more reliable ratings at the group level than Likert ratings in the child sample. These findings indicate that BWS is a developmentally appropriate response format that can deliver substantial improvements in reliability of measurement, which can increase our confidence in the robustness of findings with children.

Item Type: Article
Uncontrolled Keywords: best-worst scaling,children,development,face perception,measurement,trust,experimental and cognitive psychology,developmental and educational psychology,arts and humanities (miscellaneous),psychology (miscellaneous),psychology(all) ,/dk/atira/pure/subjectarea/asjc/3200/3205
Faculty \ School: Faculty of Social Sciences > School of Psychology
UEA Research Groups: Faculty of Social Sciences > Research Groups > Developmental Science
Related URLs:
Depositing User: LivePure Connector
Date Deposited: 13 Feb 2021 01:04
Last Modified: 23 Oct 2022 02:13
URI: https://ueaeprints.uea.ac.uk/id/eprint/79248
DOI: 10.3758/s13428-021-01566-w

Downloads

Downloads per month over past year

Actions (login required)

View Item View Item