A think aloud study comparing the validity and acceptability of discrete choice and best worst scaling methods

Whitty, Jennifer A. ORCID: https://orcid.org/0000-0002-5886-1933, Walker, Ruth, Golenko, Xanthe and Ratcliffe, Julie (2014) A think aloud study comparing the validity and acceptability of discrete choice and best worst scaling methods. PLoS One, 9 (4). ISSN 1932-6203

Preview

PDF (Manuscript) - Published Version Available under License Creative Commons Attribution. Download (999kB) | Preview

Abstract

Objectives: This study provides insights into the validity and acceptability of Discrete Choice Experiment (DCE) and profile-case Best Worst Scaling (BWS) methods for eliciting preferences for health care in a priority-setting context. Methods: An adult sample (N = 24) undertook a traditional DCE and a BWS choice task as part of a wider survey on Health Technology Assessment decision criteria. A ‘think aloud’ protocol was applied, whereby participants verbalized their thinking while making choices. Internal validity and acceptability were assessed through a thematic analysis of the decision-making process emerging from the qualitative data and a repeated choice task. Results: A thematic analysis of the decision-making process demonstrated clear evidence of ‘trading’ between multiple attribute/levels for the DCE, and to a lesser extent for the BWS task. Limited evidence consistent with a sequential decision-making model was observed for the BWS task. For the BWS task, some participants found choosing the worst attribute/level conceptually challenging. A desire to provide a complete ranking from best to worst was observed. The majority (18,75%) of participants indicated a preference for DCE, as they felt this enabled comparison of alternative full profiles. Those preferring BWS were averse to choosing an undesirable characteristic that was part of a ‘package’, or perceived BWS to be less ethically conflicting or burdensome. In a repeated choice task, more participants were consistent for the DCE (22,92%) than BWS (10,42%) (p = 0.002). Conclusions: This study supports the validity and acceptability of the traditional DCE format. Findings relating to the application of BWS profile methods are less definitive. Research avenues to further clarify the comparative merits of these preference elicitation methods are identified.

Item Type:	Article
Faculty \ School:	Faculty of Medicine and Health Sciences > Norwich Medical School
UEA Research Groups:	Faculty of Medicine and Health Sciences > Research Groups > Health Economics Faculty of Medicine and Health Sciences > Research Groups > Respiratory and Airways Group Faculty of Medicine and Health Sciences > Research Groups > Health Services and Primary Care Faculty of Medicine and Health Sciences > Research Groups > Public Health and Health Services Research (former - to 2023)
Depositing User:	Pure Connector
Date Deposited:	27 Apr 2016 11:00
Last Modified:	28 Oct 2023 00:50
URI:	https://ueaeprints.uea.ac.uk/id/eprint/58410
DOI:	10.1371/journal.pone.0090635

Downloads

Actions (login required)

View Item