Dynamic meta-analysis: a method of using global evidence for local decision making

Shackelford, Gorm E., Martin, Philip A., Hood, Amelia S. C., Christie, Alec P., Kulinskaya, Elena and Sutherland, William J. (2021) Dynamic meta-analysis: a method of using global evidence for local decision making. BMC Biology, 19 (1). ISSN 1741-7007

[thumbnail of Published_Version]
Preview
PDF (Published_Version) - Published Version
Available under License Creative Commons Attribution.

Download (2MB) | Preview

Abstract

Background Meta-analysis is often used to make generalisations across all available evidence at the global scale. But how can these global generalisations be used for evidence-based decision making at the local scale, if the global evidence is not perceived to be relevant to local decisions? We show how an interactive method of meta-analysis—dynamic meta-analysis—can be used to assess the local relevance of global evidence. Results We developed Metadataset (www.metadataset.com) as a proof-of-concept for dynamic meta-analysis. Using Metadataset, we show how evidence can be filtered and weighted, and results can be recalculated, using dynamic methods of subgroup analysis, meta-regression, and recalibration. With an example from agroecology, we show how dynamic meta-analysis could lead to different conclusions for different subsets of the global evidence. Dynamic meta-analysis could also lead to a rebalancing of power and responsibility in evidence synthesis, since evidence users would be able to make decisions that are typically made by systematic reviewers—decisions about which studies to include (e.g. critical appraisal) and how to handle missing or poorly reported data (e.g. sensitivity analysis). Conclusions In this study, we show how dynamic meta-analysis can meet an important challenge in evidence-based decision making—the challenge of using global evidence for local decisions. We suggest that dynamic meta-analysis can be used for subject-wide evidence synthesis in several scientific disciplines, including agroecology and conservation biology. Future studies should develop standardised classification systems for the metadata that are used to filter and weight the evidence. Future studies should also develop standardised software packages, so that researchers can efficiently publish dynamic versions of their meta-analyses and keep them up-to-date as living systematic reviews. Metadataset is a proof-of-concept for this type of software, and it is open source. Future studies should improve the user experience, scale the software architecture, agree on standards for data and metadata storage and processing, and develop protocols for responsible evidence use.

Item Type: Article
Uncontrolled Keywords: applicability,conservation evidence,dynamic meta-analysis,external validity,generalisability,knowledge transfer,recalibration,subject-wide evidence synthesis,systematic reviews,transferability,biotechnology,structural biology,ecology, evolution, behavior and systematics,physiology,biochemistry, genetics and molecular biology(all),agricultural and biological sciences(all),plant science,developmental biology,cell biology ,/dk/atira/pure/subjectarea/asjc/1300/1305
Faculty \ School: Faculty of Science > School of Computing Sciences
Faculty of Science > School of Biological Sciences
UEA Research Groups: Faculty of Medicine and Health Sciences > Research Centres > Business and Local Government Data Research Centre (former - to 2023)
Faculty of Science > Research Groups > Data Science and Statistics
Faculty of Science > Research Groups > Norwich Epidemiology Centre
Faculty of Medicine and Health Sciences > Research Groups > Norwich Epidemiology Centre
Related URLs:
Depositing User: LivePure Connector
Date Deposited: 05 Mar 2021 00:44
Last Modified: 20 Apr 2023 20:32
URI: https://ueaeprints.uea.ac.uk/id/eprint/79374
DOI: 10.1186/s12915-021-00974-w

Downloads

Downloads per month over past year

Actions (login required)

View Item View Item