Tools
ToolsZumbo, Bruno D., Maddox, Bryan and Care, Naomi M. (2023) Process and product in computer-based assessments: Clearing the ground for a holistic validity framework. European Journal of Psychological Assessment, 39 (4). pp. 252-262. ISSN 1015-5759
Preview |
PDF (Process_and_Product_in_Computer_Based_Assessments)
- Accepted Version
Available under License Creative Commons Attribution. Download (576kB) | Preview |
Abstract
There is no consensus among assessment researchers about many of the central problems of response process data, including what is it and what is it comprised of. The Standards for Educational and Psychological Testing (American Educational Research Association et al., 2014) locate process data within their five sources of validity evidence. However, we rarely see a conceptualization of response processes; rather, the focus is on the techniques and methods of assembling response process indices or statistical models. The method often overrides clear definitions, and, as a field, we may therefore conflate method and methodology – much like we have conflated validity and validation (Zumbo, 2007). In this paper, we aim to clear the conceptual ground to explore the scope of a holistic framework for the validation of process and product. We review prominent conceptualizations of response processes and their sources and explore some fundamental questions: Should we make a theoretical and practical distinction between response processes and response data? To what extent do the uses of process data reflect the principles of deliberate, educational, and psychological measurement? To answer these questions, we consider the case of item response times and the potential for variation associated with disability and neurodiversity.
| Item Type: | Article |
|---|---|
| Uncontrolled Keywords: | process data,educational assessment,validity,digital assessment,applied psychology ,/dk/atira/pure/subjectarea/asjc/3200/3202 |
| Faculty \ School: | Faculty of Social Sciences > School of Education and Lifelong Learning |
| UEA Research Groups: | Faculty of Social Sciences > Research Groups > Language in Education |
| Related URLs: | |
| Depositing User: | LivePure Connector |
| Date Deposited: | 21 Apr 2023 12:30 |
| Last Modified: | 30 Jan 2024 03:36 |
| URI: | https://ueaeprints.uea.ac.uk/id/eprint/91855 |
| DOI: | 10.1027/1015-5759/a000748 |
Downloads
Downloads per month over past year
Actions (login required)
 |
View Item |