Clarifying the scope of generalizability theory for multifaceted assessment

Jackson, Duncan J. R., Michaelides, George ORCID: https://orcid.org/0000-0002-4224-7728, Dewberry, Chris and Englert, Paul (2023) Clarifying the scope of generalizability theory for multifaceted assessment. New Zealand Journal of Psychology, 51 (2). pp. 53-64. ISSN 0112-109X

[thumbnail of Scope_of_G_Theory_Full_Paper_Unmasked_NZJP_accepted]
Preview
PDF (Scope_of_G_Theory_Full_Paper_Unmasked_NZJP_accepted) - Accepted Version
Download (440kB) | Preview

Abstract

Generalizability theory (G theory) continues to be underutilized in applied psychological research, both in New Zealand and internationally, possibly due to uncertainties about the types of questions that it can be used to address. G theory and its associated random effects model basis is often positioned as an approach limited to the study of reliability. In contrast, latent variable theory, and its confirmatory factor analytic (CFA) basis, is used more widely to address issues of validity whilst controlling for reliability. This study clarifies the types of questions to which G theory can be applied by testing whether there is any justification for the difference in interpretation between results based on G theory and latent variable theory. We reanalyzed data from an operational assessment center (N = 214 managerial assessees) and found comparable aggregated effects, generalizability coefficients, and latent scores across the G theory and latent variable theory approaches, suggesting that both can be applied to problems related to reliability and structural validity.

Item Type: Article
Uncontrolled Keywords: psychological assessment,multifaceted assessment,generalizability theory
Faculty \ School: Faculty of Social Sciences > Norwich Business School
UEA Research Groups: Faculty of Social Sciences > Research Groups > Employment Systems and Institutions
Related URLs:
Depositing User: LivePure Connector
Date Deposited: 06 May 2022 12:30
Last Modified: 18 Aug 2023 12:31
URI: https://ueaeprints.uea.ac.uk/id/eprint/84936
DOI:

Downloads

Downloads per month over past year

Actions (login required)

View Item View Item