Barriers and facilitators to model replication within health economics

McManus, Emma ORCID: https://orcid.org/0000-0002-3442-8721, Turner, David ORCID: https://orcid.org/0000-0002-1689-4147, Gray, Ewan, Khawar, Haseeb, Okoli, Toochukwu and Sach, Tracey ORCID: https://orcid.org/0000-0002-8098-9220 (2019) Barriers and facilitators to model replication within health economics. Value in Health, 22 (9). pp. 1018-1025. ISSN 1098-3015

Preview	PDF (Proof_Version) Available under License Creative Commons Attribution Non-commercial No Derivatives. Download (464kB) | Preview
Preview	PDF (Accepted_Manuscript) - Accepted Version Available under License Creative Commons Attribution Non-commercial No Derivatives. Download (1MB) | Preview

Abstract

Objective: Model replication is important as it enables researchers to check research integrity, transparency and, potentially, to inform the model conceptualisation process when developing a new or updated model. The aim of this study was to evaluate the replicability of published decision analytic models, and to identify the barriers and facilitators to replication. Methods: Replication attempts of five published economic modelling studies were made. The replications were conducted using only publicly available information within the manuscripts and supplementary materials. The replicator attempted to reproduce the key results detailed in the paper, for example the total cost, total outcomes and if applicable, the incremental cost effectiveness ratio reported. Whilst a replication attempt was not explicitly defined as a success or failure, the replicated results were compared in terms of percentage difference to the original results. Results: In conducting the replication attempts, common barriers and facilitators emerged. For the majority of the case studies, the replicator needed to make additional assumptions when recreating the model. This was often exacerbated by conflicting information being presented in the text and the tables. Across the case studies, the variation between original and replicated results ranged from -4.54% to 108.00% for costs and -3.81% to 0.40% for outcomes. Conclusion: This study demonstrates that whilst models may appear to be comprehensively reported, it is often not enough to facilitate a precise replication. Further work is needed to understand how to improve model transparency and in turn to increase the chances of replication, thus ensuring future usability.

Item Type:	Article
Uncontrolled Keywords:	replication,economic models,health economics
Faculty \ School:	Faculty of Medicine and Health Sciences > Norwich Medical School
UEA Research Groups:	Faculty of Medicine and Health Sciences > Research Groups > Public Health and Health Services Research (former - to 2023) Faculty of Medicine and Health Sciences > Research Groups > Norwich Clinical Trials Unit Faculty of Medicine and Health Sciences > Research Groups > Health Economics Faculty of Medicine and Health Sciences > Research Groups > Health Services and Primary Care Faculty of Medicine and Health Sciences > Research Centres > Population Health
Depositing User:	LivePure Connector
Date Deposited:	19 Sep 2019 11:30
Last Modified:	29 Mar 2024 02:51
URI:	https://ueaeprints.uea.ac.uk/id/eprint/72295
DOI:	10.1016/j.jval.2019.04.1928

Downloads

Actions (login required)

View Item