Simulation evaluation of statistical properties of methods for indirect and mixed treatment comparisons

Song, Fujian, Clark, Allan ORCID: https://orcid.org/0000-0003-2965-8941, Bachmann, Max O. ORCID: https://orcid.org/0000-0003-1770-3506 and Maas, Jim (2012) Simulation evaluation of statistical properties of methods for indirect and mixed treatment comparisons. BMC Medical Research Methodology, 12.

Full text not available from this repository. (Request a copy)

Abstract

Background: Indirect treatment comparison (ITC) and mixed treatment comparisons (MTC) have been increasingly used in network meta-analyses. This simulation study comprehensively investigated statistical properties and performances of commonly used ITC and MTC methods, including simple ITC (the Bucher method), frequentist and Bayesian MTC methods. Methods: A simple network of three sets of two-arm trials with a closed loop was simulated. Different simulation scenarios were based on different number of trials, assumed treatment effects, extent of heterogeneity, bias and inconsistency. The performance of the ITC and MTC methods was measured by the type I error, statistical power, observed bias and mean squared error (MSE). Results: When there are no biases in primary studies, all ITC and MTC methods investigated are on average unbiased. Depending on the extent and direction of biases in different sets of studies, ITC and MTC methods may be more or less biased than direct treatment comparisons (DTC). Of the methods investigated, the simple ITC method has the largest mean squared error (MSE). The DTC is superior to the ITC in terms of statistical power and MSE. Under the simulated circumstances in which there are no systematic biases and inconsistencies, the performances of MTC methods are generally better than the performance of the corresponding DTC methods. For inconsistency detection in network meta-analysis, the methods evaluated are on average unbiased. The statistical power of commonly used methods for detecting inconsistency is very low. Conclusions: The available methods for indirect and mixed treatment comparisons have different advantages and limitations, depending on whether data analysed satisfies underlying assumptions. To choose the most valid statistical methods for research synthesis, an appropriate assessment of primary studies included in evidence network is required.

Item Type: Article
Faculty \ School: Faculty of Medicine and Health Sciences > Norwich Medical School
UEA Research Groups: Faculty of Medicine and Health Sciences > Research Groups > Epidemiology and Public Health
Faculty of Medicine and Health Sciences > Research Groups > Public Health and Health Services Research (former - to 2023)
Faculty of Medicine and Health Sciences > Research Groups > Health Services and Primary Care
Faculty of Medicine and Health Sciences > Research Groups > Norwich Clinical Trials Unit
Faculty of Science > Research Groups > Norwich Epidemiology Centre
Faculty of Medicine and Health Sciences > Research Groups > Norwich Epidemiology Centre
Faculty of Medicine and Health Sciences > Research Centres > Population Health
Depositing User: Pure Connector
Date Deposited: 26 Jun 2013 10:55
Last Modified: 04 Apr 2024 23:54
URI: https://ueaeprints.uea.ac.uk/id/eprint/42504
DOI: 10.1186/1471-2288-12-138

Actions (login required)

View Item View Item