Reliability in assessment centres depends on general and exercise performance, but not on dimensions

Tools

Jackson, Duncan J. R., Michaelides, George ORCID: https://orcid.org/0000-0002-4224-7728, Dewberry, Chris, Nelson, Jo and Stephens, Catherine (2022) Reliability in assessment centres depends on general and exercise performance, but not on dimensions. Journal of Occupational and Organizational Psychology, 95 (4). pp. 739-757. ISSN 0963-1798

[thumbnail of J Occupat Organ Psyc - 2022 - Jackson - Reliability in assessment centres depends on general and exercise performance]
Preview
 PDF (J Occupat Organ Psyc - 2022 - Jackson - Reliability in assessment centres depends on general and exercise performance) - Published Version
Available under License Creative Commons Attribution Non-commercial No Derivatives.
Download (492kB) | Preview

Abstract

This study contributes to the literature on assessment centre (AC) measurement structure by evaluating whether dimension, exercise or mixed-model theoretical perspectives are supported by reliability outcomes. In a large-scale study (Ncandidates = 2917) utilizing Bayesian generalizability theory, we tested reliability estimates configured to conform to dimension, exercise or mixed-model perspectives. Our findings reveal that reliability outcomes for AC ratings greatly depend on the measurement intentions of the researcher. When this intent aligned with the traditional dimension perspective, we found evidence that reliability was unacceptably low (mean reliability = .38, SD = .15). However, when the intent aligned with the exercise perspective, we found evidence that reliability exceeded acceptable criteria (mean reliability = .91, SD = .09). The addition of dimension- to exercise-related effects to reflect a mixed-model perspective did not make an appreciable difference to reliability.

Item Type: Article
Uncontrolled Keywords: assessment centers,reliability,generalizability theory,situational bandwidth,multitrait-multimethod,assessment centres,applied psychology,organizational behavior and human resource management ,/dk/atira/pure/subjectarea/asjc/3200/3202
Faculty \ School: Faculty of Social Sciences > Norwich Business School
UEA Research Groups: Faculty of Social Sciences > Research Groups > Employment Systems and Institutions
Related URLs:
Depositing User: LivePure Connector
Date Deposited: 25 May 2022 08:30
Last Modified: 14 Nov 2022 13:30
URI: https://ueaeprints.uea.ac.uk/id/eprint/85138
DOI: 10.1111/joop.12398

Downloads

Downloads per month over past year

Actions (login required)

View Item View Item