Making the most of evaluation: a mixed methods study in the English NHS

Salisbury, Chris, Stewart, Kate ORCID: https://orcid.org/0000-0003-2529-954X, Purdy, Sarah, Thorp, Helen, Cameron, Ailsa, Lart, Rachel, Peckham, Stephen and Calnan, Michael (2011) Making the most of evaluation: a mixed methods study in the English NHS. Journal of Health Services Research and Policy, 16 (4). pp. 218-225. ISSN 1355-8196

Full text not available from this repository. (Request a copy)

Abstract

Objectives: To increase understanding about how evaluations of health policy initiatives are commissioned, conducted and used. Methods: A mapping exercise was conducted to identify evaluation of initiatives promoted by the White Paper ‘Our health, our care, our say’ in the English NHS. All evaluations were subjected to critical appraisal and 21 were purposively selected as case studies, involving documentary analysis and 60 interviews with those commissioning, conducting and affected by the evaluation. Results: Variation in the types of evaluation being undertaken did not reflect the importance of the initiatives being evaluated. Most evaluations collected evidence about uptake, processes of care and users’ perceptions. While some provided useful information about how initiatives could be improved, few provided robust evidence about the benefits or costs of the initiatives. Those who commissioned evaluations had similar concerns to those who conducted them. There was a commitment to the concept of evaluation but little clarity about how findings would be used. Evaluation was often commissioned too late to influence decisions about implementation. Compromises over research design and difficulties collecting data limited the potential to provide robust evidence about benefits. There were tensions between the desire of evaluators for methodological rigour and the needs of service providers for swift, contextually relevant findings. There were concerns about the transparency of methods and results. Conclusions: Considerable public resources are committed to evaluation, but this investment is less productive than it could be. This article specifies several ways in which the use of evaluation of initiatives in health and social care could be improved.

Item Type:	Article
Uncontrolled Keywords:	sdg 3 - good health and well-being ,/dk/atira/pure/sustainabledevelopmentgoals/good_health_and_well_being
Faculty \ School:	Faculty of Social Sciences > School of Sociology
Depositing User:	LivePure Connector
Date Deposited:	28 Feb 2022 13:30
Last Modified:	23 Oct 2022 03:35
URI:	https://ueaeprints.uea.ac.uk/id/eprint/83760
DOI:	10.1258/jhsrp.2011.010137

Actions (login required)

View Item