Process and product in computer-based assessments: Clearing the ground for a holistic validity framework

Zumbo, Bruno D., Maddox, Bryan and Care, Naomi M. (2023) Process and product in computer-based assessments: Clearing the ground for a holistic validity framework. European Journal of Psychological Assessment, 39 (4). pp. 252-262. ISSN 1015-5759

[thumbnail of Process_and_Product_in_Computer_Based_Assessments]
Preview
PDF (Process_and_Product_in_Computer_Based_Assessments) - Accepted Version
Available under License Creative Commons Attribution.

Download (576kB) | Preview

Abstract

There is no consensus among assessment researchers about many of the central problems of response process data, including what is it and what is it comprised of. The Standards for Educational and Psychological Testing (American Educational Research Association et al., 2014) locate process data within their five sources of validity evidence. However, we rarely see a conceptualization of response processes; rather, the focus is on the techniques and methods of assembling response process indices or statistical models. The method often overrides clear definitions, and, as a field, we may therefore conflate method and methodology – much like we have conflated validity and validation (Zumbo, 2007). In this paper, we aim to clear the conceptual ground to explore the scope of a holistic framework for the validation of process and product. We review prominent conceptualizations of response processes and their sources and explore some fundamental questions: Should we make a theoretical and practical distinction between response processes and response data? To what extent do the uses of process data reflect the principles of deliberate, educational, and psychological measurement? To answer these questions, we consider the case of item response times and the potential for variation associated with disability and neurodiversity.

Item Type: Article
Uncontrolled Keywords: process data,educational assessment,validity,digital assessment,applied psychology ,/dk/atira/pure/subjectarea/asjc/3200/3202
Faculty \ School: Faculty of Social Sciences > School of Education and Lifelong Learning
UEA Research Groups: Faculty of Social Sciences > Research Groups > Language in Education
Related URLs:
Depositing User: LivePure Connector
Date Deposited: 21 Apr 2023 12:30
Last Modified: 30 Jan 2024 03:36
URI: https://ueaeprints.uea.ac.uk/id/eprint/91855
DOI: 10.1027/1015-5759/a000748

Downloads

Downloads per month over past year

Actions (login required)

View Item View Item