Tools
Tools
Jackson, Duncan, Michaelides, George 
ORCID: https://orcid.org/0000-0002-4224-7728, Dewberry, Chris, Jones, Amanda, Toms, Simon, Schwenke, Benjamin and Yang, Wei-Ning
(2022)
Uncertainty about rater variance and small dimension effects impact reliability in supervisor ratings.
Human Performance, 35 (3-4).
pp. 278-301.
ISSN 0895-9285
Preview |
PDF (MSS Supervisor Performance Ratings Accepted)
- Accepted Version
Available under License Creative Commons Attribution. Download (510kB) | Preview |
Abstract
We modeled the effects commonly described as defining the measurement structure of supervisor performance ratings. In doing so, we contribute to different theoretical perspectives, including components of the multifactor and mediated models of performance ratings. Across two reanalyzed samples (Sample 1, N ratees = 392, N raters = 244; Sample 2, N ratees = 342, N raters = 397), we found a structure primarily reflective of general (>27% of variance explained) and rater-related (>49%) effects, with relatively small performance dimension effects (between 1% and 11%). We drew on findings from the assessment center literature to approximate the proportion of rater variance that might theoretically contribute to reliability in performance ratings. We found that even moderate contributions of rater-related variance to reliability resulted in a sizable impact on reliability estimates, drawing them closer to accepted criteria.
| Item Type: | Article |
|---|---|
| Uncontrolled Keywords: | applied psychology,psychology(all),organizational behavior and human resource management ,/dk/atira/pure/subjectarea/asjc/3200/3202 |
| Faculty \ School: | Faculty of Social Sciences > Norwich Business School |
| UEA Research Groups: | Faculty of Social Sciences > Research Groups > Employment Systems and Institutions |
| Related URLs: | |
| Depositing User: | LivePure Connector |
| Date Deposited: | 04 Aug 2022 10:30 |
| Last Modified: | 21 Oct 2022 01:34 |
| URI: | https://ueaeprints.uea.ac.uk/id/eprint/87080 |
| DOI: | 10.1080/08959285.2022.2111433 |
Actions (login required)
 |
View Item |