Tools
Tools
Wong, Wai Yee Amy 
ORCID: https://orcid.org/0000-0002-3053-0729, Thistlethwaite, Jill, Moni, Karen and Roberts, Chris
(2023)
Using cultural historical activity theory to reflect on the sociocultural complexities in OSCE examiners’ judgements.
Advances in Health Sciences Education, 28.
pp. 27-46.
ISSN 1382-4996
Preview |
PDF (s10459-022-10139-1)
- Published Version
Available under License Creative Commons Attribution. Download (1MB) | Preview |
Abstract
Examiners’ judgements play a critical role in competency-based assessments such as objective structured clinical examinations (OSCEs). The standardised nature of OSCEs and their alignment with regulatory accountability assure their wide use as high-stakes assessment in medical education. Research into examiner behaviours has predominantly explored the desirable psychometric characteristics of OSCEs, or investigated examiners’ judgements from a cognitive rather than a sociocultural perspective. This study applies cultural historical activity theory (CHAT) to address this gap in exploring examiners’ judgements in a high-stakes OSCE. Based on the idea that OSCE examiners’ judgements are socially constructed and mediated by their clinical roles, the objective was to explore the sociocultural factors that influenced examiners’ judgements of student competence and use the findings to inform examiner training to enhance assessment practice. Seventeen semi-structured interviews were conducted with examiners who assessed medical student competence in progressing to the next stage of training in a large-scale OSCE at one Australian university. The initial thematic analysis provided a basis for applying CHAT iteratively to explore the sociocultural factors and, specifically, the contradictions created by interactions between different elements such as examiners and rules, thus highlighting the factors influencing examiners’ judgements. The findings indicated four key factors that influenced examiners’ judgements: examiners’ contrasting beliefs about the purpose of the OSCE; their varying perceptions of the marking criteria; divergent expectations of student competence; and idiosyncratic judgement practices. These factors were interrelated with the activity systems of the medical school’s assessment practices and the examiners’ clinical work contexts. Contradictions were identified through the guiding principles of multi-voicedness and historicity. The exploration of the sociocultural factors that may influence the consistency of examiners’ judgements was facilitated by applying CHAT as an analytical framework. Reflecting upon these factors at organisational and system levels generated insights for creating fit-for-purpose examiner training to enhance assessment practice.
| Item Type: | Article |
|---|---|
| Uncontrolled Keywords: | cultural historical activity theory,assessment,faculty development,feedback,judgement,osce,education ,/dk/atira/pure/subjectarea/asjc/3300/3304 |
| Related URLs: | |
| Depositing User: | LivePure Connector |
| Date Deposited: | 16 Mar 2023 09:30 |
| Last Modified: | 22 Mar 2023 09:30 |
| URI: | https://ueaeprints.uea.ac.uk/id/eprint/91552 |
| DOI: | 10.1007/s10459-022-10139-1 |
Downloads
Downloads per month over past year
Actions (login required)
 |
View Item |