Implementation outcome instruments for use in physical healthcare settings: a systematic review

Khadjesari, Zarnie ORCID:, Boufkhed, Sabah, Vitoratou, Silia, Schatte, Laura, Ziemann, Alexandra, Daskalopoulou, Christina, Uglik-Marucha, Eleonora, Sevdalis, Nick and Hull, Louise (2020) Implementation outcome instruments for use in physical healthcare settings: a systematic review. Implementation Science, 15 (1). ISSN 1748-5908

[thumbnail of Published_Version]
PDF (Published_Version) - Published Version
Available under License Creative Commons Attribution.

Download (1MB) | Preview


BACKGROUND: Implementation research aims to facilitate the timely and routine implementation and sustainment of evidence-based interventions and services. A glaring gap in this endeavour is the capability of researchers, healthcare practitioners and managers to quantitatively evaluate implementation efforts using psychometrically sound instruments. To encourage and support the use of precise and accurate implementation outcome measures, this systematic review aimed to identify and appraise studies that assess the measurement properties of quantitative implementation outcome instruments used in physical healthcare settings. METHOD: The following data sources were searched from inception to March 2019, with no language restrictions: MEDLINE, EMBASE, PsycINFO, HMIC, CINAHL and the Cochrane library. Studies that evaluated the measurement properties of implementation outcome instruments in physical healthcare settings were eligible for inclusion. Proctor et al.'s taxonomy of implementation outcomes was used to guide the inclusion of implementation outcomes: acceptability, appropriateness, feasibility, adoption, penetration, implementation cost and sustainability. Methodological quality of the included studies was assessed using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Psychometric quality of the included instruments was assessed using the Contemporary Psychometrics checklist (ConPsy). Usability was determined by number of items per instrument. RESULTS: Fifty-eight publications reporting on the measurement properties of 55 implementation outcome instruments (65 scales) were identified. The majority of instruments assessed acceptability (n = 33), followed by appropriateness (n = 7), adoption (n = 4), feasibility (n = 4), penetration (n = 4) and sustainability (n = 3) of evidence-based practice. The methodological quality of individual scales was low, with few studies rated as 'excellent' for reliability (6/62) and validity (7/63), and both studies that assessed responsiveness rated as 'poor' (2/2). The psychometric quality of the scales was also low, with 12/65 scales scoring 7 or more out of 22, indicating greater psychometric strength. Six scales (6/65) rated as 'excellent' for usability. CONCLUSION: Investigators assessing implementation outcomes quantitatively should select instruments based on their methodological and psychometric quality to promote consistent and comparable implementation evaluations. Rather than developing ad hoc instruments, we encourage further psychometric testing of instruments with promising methodological and psychometric evidence. SYSTEMATIC REVIEW REGISTRATION: PROSPERO 2017 CRD42017065348.

Item Type: Article
Uncontrolled Keywords: implementation outcomes,implementation science,measurement properties,psychometric properties,systematic review,health policy,health informatics,public health, environmental and occupational health,sdg 3 - good health and well-being ,/dk/atira/pure/subjectarea/asjc/2700/2719
Faculty \ School: Faculty of Medicine and Health Sciences > School of Health Sciences
UEA Research Groups: Faculty of Medicine and Health Sciences > Research Groups > Health Promotion
Faculty of Medicine and Health Sciences > Research Groups > Behavioural and Implementation Science
Faculty of Medicine and Health Sciences > Research Centres > Norwich Institute for Healthy Aging
Faculty of Medicine and Health Sciences > Research Centres > Lifespan Health
Related URLs:
Depositing User: LivePure Connector
Date Deposited: 20 Aug 2020 01:11
Last Modified: 19 Oct 2023 02:45
DOI: 10.1186/s13012-020-01027-6

Actions (login required)

View Item View Item