Exploring consequences of simulation design for apparent performance of methods of meta-analysis

Kulinskaya, Elena, Hoaglin, David C. and Bakbergenuly, Ilyas (2021) Exploring consequences of simulation design for apparent performance of methods of meta-analysis. Statistical Methods in Medical Research, 30 (7). pp. 1667-1690. ISSN 0962-2802

[thumbnail of simulate_01March21]
Preview
PDF (simulate_01March21) - Accepted Version
Download (707kB) | Preview

Abstract

Contemporary statistical publications rely on simulation to evaluate performance of new methods and compare them with established methods. In the context of random-effects meta-analysis of log-odds-ratios, we investigate how choices in generating data affect such conclusions. The choices we study include the overall log-odds-ratio, the distribution of probabilities in the control arm, and the distribution of study-level sample sizes. We retain the customary normal distribution of study-level effects. To examine the impact of the components of simulations, we assess the performance of the best available inverse–variance–weighted two-stage method, a two-stage method with constant sample-size-based weights, and two generalized linear mixed models. The results show no important differences between fixed and random sample sizes. In contrast, we found differences among data-generation models in estimation of heterogeneity variance and overall log-odds-ratio. This sensitivity to design poses challenges for use of simulation in choosing methods of meta-analysis.

Item Type: Article
Faculty \ School: Faculty of Science > School of Computing Sciences
UEA Research Groups: Faculty of Science > Research Groups > Data Science and Statistics
Faculty of Medicine and Health Sciences > Research Centres > Business and Local Government Data Research Centre (former - to 2023)
Faculty of Science > Research Groups > Norwich Epidemiology Centre
Faculty of Medicine and Health Sciences > Research Groups > Norwich Epidemiology Centre
Depositing User: LivePure Connector
Date Deposited: 28 May 2021 00:34
Last Modified: 21 Apr 2023 01:03
URI: https://ueaeprints.uea.ac.uk/id/eprint/80152
DOI: 10.1177/09622802211013065

Downloads

Downloads per month over past year

Actions (login required)

View Item View Item