BMJ Open Why is reporting quality improvement so hard? A qualitative study in perioperative care

Emma Leanne Jones, 1,2 Mary Dixon-Woods,3 Graham P Martin3,4

To cite: Jones EL, Dixon- Woods Μ, Martin GP. Why is reporting quality improvement so hard? A qualitative study in perioperative care. BMJ Open 2019;9:e030269. doi:10.1136/ bmjopen-2019-030269
► Prepublication history for this paper are available online. To view these files, please visit the journal online (http://dx.doi. org/10.1136/bmjopen-2019- 030269).

Received 6 March 2019
Revised 3 June 2019
Accepted 20 June 2019

© Author(s) (or their employer(s)) 2019. Re-use permitted under CC BY. Published by BMJ.
1Clinical Trials Unit, University of Warwick, Coventry, UK 2Orthopaedic Directorate, University Hospitals Coventry and Warwickshire NHS Trust, Coventry, UK
3THIS Institute (The Healthcare Improvement Studies Institute), University of Cambridge Primary Care Unit, Cambridge, UK 4Health Sciences, University of Leicester, Leicester, UK

Correspondence to
Dr Emma Leanne Jones;
e.jones.11@warwick.ac.uk,
embosymes@yahoo.co.uk

"0 3 Φ Ο Φ ο.

►		This is among the first studies to examine the influences on reporting of quality improvement in healthcare.
►		An international and multidisciplinary study, it offers specific insights in the area of perioperative care.
►		Participants offered suggestions for improving reporting of quality improvement (QI) in perioperative care specifically, which may have relevance for other clinical fields.
►		This study does not include patients as a QI stakeholder group.
►		This study recruited only stakeholders who were actively interested in QI.

BMJ Open: first published as 10.1136/bmjopen-2019-030269 on 24 July 2019. Downloaded from http://bmjopen.bmj.com/ on January 27, 2026 at University of East Anglia Library

ABSTRACT
Objectives Quality improvement (QI) may help to avert or mitigate the risks of suboptimal care, but it is often poorly reported in the healthcare literature. We aimed to identify the influences on reporting QI in the area of perioperative care, with a view to informing improvements in reporting QI across healthcare.
Design Qualitative interview study.
Setting Healthcare and academic organisations in Australia, Europe and North America.
Participants Stakeholders involved in or influencing the publication, writing or consumption of reports of QI studies in perioperative care.
Results Forty-two participants from six countries took part in the study. Participants included 15 authors (those who write QI reports), 12 consumers of QI reports (practitioners who apply QI research in practice), 11 journal editors and 4 authors of reporting guidelines. Participants identified three principal challenges in achieving high-quality QI reporting. First, the broad scope of QI reporting—ranging from small local projects to multisite research across different disciplines—causes uncertainty about where QI work should be published. Second, context is fundamental to the success of a QI intervention but is difficult to report in ways that support replication and development. Third, reporting is adversely affected by both proximal influences (such as lack of time to write up QI) and more distal, structural influences (such as norms about the format and content of biomedical research reporting), leading to incomplete reporting of QI findings. Conclusions Divergent terminology and understandings of QI, along with existing reporting norms and the challenges of capturing context adequately yet succinctly, make for challenges in reporting QI. We offer suggestions for improvement.
INTRODUCTION
Quality improvement (QI) seeks to improve the functioning of healthcare organisations by making systematic improvements to healthcare systems and processes.12 We previously, in the context of a systematic review,3 defined QI as involving both QI methods, including approaches such as Plan-Do-Study-Act cycles, Lean and Six Sigma,1 4 and QI interventions, which are specific activities, actions or instruments targeting defined areas of practice (eg,
Strengths and limitations of this study (S' f+ 5' ο E ο. 3 Q J* Φ ω Φ ο.
Ο checklists).5 Despite the growing use and φ popularity of QI and its potential to benefit 5 patient care, the academic literature on QI 3 is itself problematic. One major problem 3 relates to quality of reporting of QI in the 6 academic literarure.6 This is a problem that, a. as in other fields, limits the inferences that- can be drawn, impairs confidence in the find-? ings and thwarts the ability to replicate and — scale.78-
Some possible reasons for the poor quality - of reporting of QI in the academic literature? likely relate to the distinctive nature of the § interventions and methods used in QI, which 2 often evade straightforward description, not 5 least because of their adaptive and iterative 2 character.9-12 Similarly, the mechanisms 6 through which interventions work, often soci-3 otechnical in nature, may not be easily visible O 7	14 O and may be difficult to account for. The Q variability of QI adds to the complexities: o QI may be conducted in a variety of forms, from improvement projects led by local clinicians in a single setting through to multisite research using experimental designs.15-17
Efforts to improve reporting of QI include the Standards for QUality Improvement Reporting Excellence (SQUIRE) 2.010 guidelines, but problems nonetheless remain. A systematic review of QI reporting

BMJ Open: first published as 10.1136/bmjopen-2019-030269 on 24 July 2019. Downloaded from http://bmjopen.bmj.com/ on January 27, 2026 at University of East Anglia Library

in perioperative care, for example, sliowed tliat 74% of publications fail to adequately describe implementation fidelity, 73% do not describe how interventions were modified, and 62% omit details of the materials needed to replicate the intervention. Moreover, reporting guidelines are not a panacea: they can codify what should be included, but may be less useful in influencing how well these things are reported. For example, checklists may prioritise mechanistic compliance over rich and detailed reportage18 and authors may not have adequate training on how to use reporting guidelines19 and may not know which one is most appropriate for their study.20 The question of what and how to report is also influenced bv communication difficulties between journal editors, peer reviewers and authors.1921 For progress to be made, better understanding of the challenges to high-quality reporting of QI is needed.
It is useful, for purposes of understanding these challenges, to bound the scope of inquiry to enable focus and deptli. We selected perioperative care as an instructive area in which to examine the challenges of reporting in more depth. The volume of surgical intervention globally is huge—of the order of 313 million procedures per per annum22 and is highly variable in quality, 4.2 million people die every year within 30 days of surgery23 suggesting considerable room for improvement. While perioperative care has seen a huge increase in volume of literature,24 25 it is also an area in which a systematic review that we previously conducted revealed pervasive problems of poor reporting in relation to QI.3 With the aim of informing ways of improving QI reporting, we sought to understand the experiences, views and priorities of those involved in or influencing the publication, writing or consumption of reports of QI studies in perioperative care.
METHODS
We used the Standards for Reporting Qualitative Research (SRQR) reporting guidelines to write this manuscript.26
Study design
We undertook semistructured interviews to explore why reporting QI in perioperative care is difficult. Building on the distinction between QI interventions and methods that we had previously made,3 we asked why reporting of QI interventions (such as checklists or care pathways) and QI methods (such as Lean or Plan-Do-Study-Act cycles) might pose challenges.
A standard set of questions was used as a basis for open discussion. The interview schedule was informed by data generated from our systematic review.3 For example, our data showed that reporting is poor, and we included several prompts about possible explanations for this. Each interview lasted for around 45 min; most were done by telephone, with three face-to-face.
Interviews were recorded and transcribed with informed consent from participants. All data were collected between September 2015 and Marcir 2016. This study was approved.
Participants
We recruited an international sample of QI stakeholders working in organisations such as hospitals, universities and healthcare funding bodies. Participants were eligible for inclusion if they were willing and able to give informed consent, aged 18 years or older and had a role in QI reporting by virtue of being involved in or being an• influencer of the publication, writing or consumption of 8 reports of QI studies.	8
For the purposes of the study, QI authors were a defined as individuals who had been an author on a X paper reporting QI in perioperative care, published in o a PubMed-indexed journal between 2000 and 2016. QI- consumers were defined as healthcare managers and clin-9 ical staff who had read reports of QI in perioperative care and used them to inform changes in delivery of surgical o care in the 24 months prior to interview. QI custodians o were those who set, or sought to uphold, expectations & with regard to QI reporting, and were defined as authors o’ of reporting guidelines or journal editors who had made c decisions about publishing perioperative QI papers in the 1 24 months prior to interview.	7
We used purposive non-probability sampling methods: A participants were deliberately chosen with the expecta-2 tion that their experience would provide relevant insights, o These participants were recruited via an emailed invitation. We also advertised to recruit individuals not known w to the study team using web-based publicity. Sample size 2 was estimated based on previous studies showing that » 30-40 participants was sufficient to reach theoretical satu- § . 2728	B ration.5
5 o Data analysis	>
Analysis was based on the constant comparative 3 method.2930 One author (EJ) initially undertook a process 5 of open coding, supported by NVivo software, whereby she 3 coded phrases used by interviewees in a subset of inter- w views that pertained to a specific idea. These codes were 2 compared and combined into more refined thematic 5 categories, which were then used to code the full set of - interview transcripts.3031 A second author (GPM) read a- random selection of transcripts to enhance the analysis 9 process, by ensuring the lead author’s interpretations 8 were plausible and identifying alternative possible inter-8 pretations. This informed discussion among the autho-o rial team to enrich the analysis and develop the insights' presented in tlie section below.
Patient and public involvement
Gill Penny, a patient who had experienced a complication of cardiac surgery, was engaged throughout the project to advise on the appropriateness of the interview schedule and to read a selection of transcripts, helping EJ to thema- tise the findings.

Table 1 Professional groups of quality improvement (QI) authors, consumers and custodians	
	QI author (n=15)	QI consumer (n=12)	QI custodian (n=15)	Total (n=42)	
Clinical staff	Physicians:
anaesthetists, internal medicine doctors, physicians, radiologists, cardiologists, surgeons	10	9	6	25	
	Other clinicians:
Nurses and allied health professionals	1	2	0	3	
Non-clinical staff	Academic	4	0	9	13	
	Healthcare manager	0	1	0	1	

Findings
We invited 73 individuals to participate, of whom 42 agreed (table 1): 15 QI authors, 12 QI consumers and 15 QI custodians (11 journal editors, 4 developers of reporting guidelines). The majority of participants were from the UK (24 participants): 14 were from North America; the remainder were from Australia and mainland Europe.
Our analysis identified three major influences on reporting QI in perioperative care, and corresponding possible solutions: the broad scope of QI, challenges of reporting context and proximal and distal influences within organisations that influence QI reporting.
The broad scope of QI as an influence on reporting
Thirty participants identified the broad scope of QI as an important influence on quality of reporting. The variety of terms used to describe QI11 32 and the fluidity and inconsistency with which they were used were seen to interfere witli clarity and precision. Some participants saw QI as defined by a strong association with specific approaches taken from manufacturing industries (eg, Lean, Six Sigma, PDSA, Statistical Process Control, and Total/Continuous Quality Management). But others felt that QI was much broader, noting the overlaps between QI and other fields, including audit, change management, human factors, implementation science, behavioural sciences, social science and engineering.
The term ‘Lean’ is widely misused and used in different ways, by lots of different people, so the word doesn’t necessarily have specific meanings to the reader. (QI author, anaesthetist 1)
QI means different things to different people. (QI author, academic 1)
This plethora of terms and concepts was further complicated by ambiguity about the purpose of reports of QI. Most participants (40) distinguished between QI projects and QI research. They defined QI projects as local activities to improve the quality of care. In contrast, they defined QI researcli as work that uses evaluative inethods, seeks generalisability or transferability, manages bias and requires ethical approval. Some participants, however.
ο ο said the distinction between QI projects and QI research 3 can be blurred, witli more of a continuum than a sharp 6 line.	F
QI is more real-world and it is not research. It will 2 inherently have all the biases. It’ll have clinical bias-2 es, selection biases, reporting bias, buy-in from staff, 6 it’ll have all the biases one can think of (QI Author, ο Surgeon 1).5
•
The wide range of approaches and academic disciplines = involved in QI provoked uncertainty about where QI work © should be published. Journal editors noted, for example, & that QI authors may use a ‘scattershot approach’ (QI 6 custodian, academic 1), perhaps submitting articles for @ publication to a wide variety of journal types.	2
To overcome the challenges caused by the broad scope a of QI, solutions proposed by participants included: 3 having journals dedicated to QI (11 participants); encour-6 aging all QI stakeholders to use the SQUIRE10 guidelines a including journal editors and peer reviewers (10); having 5 a central database of QI work in surgery (7); and a Qie section in surgical journals (2).—
•
Challenges of reporting active ingredients and contexts in QI5 Participants identified various purposes of QI reporting, a which went beyond providing straightforward blueprints“ that could be ‘dragged and dropped’ to other settings. 2 Most participants (38) recognised that not all QI work 3 is intended to be exactly replicable, often describing o features of QI that were ‘transferable’ from one setting to 6 another rather necessarily 'generalisability ‛33 in a broader - sense. Some, especially those classically trained in experi- O mental methods, tended to emphasise the need for gener-a alisability, but others did not. Thus, three journal editors 09 expected researcli to demonstrate generalisability to be publishable, but eight editors were happy for QI authors to explain wliy an intervention could be ‘portable’ to another setting where not all ingredients were directly reproduced.

BMJ Open: first published as 10.1136/bmjopen-2019-030269 on 24 July 2019. Downloaded from http://bmjopen.bmj.com/ on January 27, 2026 at University of East Anglia Library

Causal attribution was recognised by participants as a major challenge for QI. Good descriptions of interventions and methods, including their ‘active ingredients', were seen as important, since most QI interventions likely
require some element of retesting in a new healthcare setting. Thus, rather than being able to ‘get it off the shelf and pull it in’ (QI author, academic 2), QI consumers ‘use the QI publication to know what was going on and be able to adapt it (the intervention) for other settings’ (QI custodian, academic 2). However, reporting the intervention was rarely seen as enough: an account of context was also required. Contextual features might include leadership, buy-in, culture, teamwork, resources and environment and many aspects of organisation and structure.34 Participants (22) said that when the contexts of QI studies are fully reported, a greater understanding of the scope and limits of transferability to other settings can be achieved. However, it was not clear to stakeholders how features of context should be defined, or which ones should be reported. The MUSIQ tool34 (a framework which identifies 25 contextual factors likely to influence QI) which can aid description of context already exists, but the elements of MUSIQ were discussed by only three people (two authors and one editor).
Part of the active ingredient might have been inadvertently the culture or the attitudes of the people in the organisation which you may or may not have somewhere else. (QI custodian, academic 3)
If you have the detail at least you can see that it is something we could do in our location...Knowing the detail can allow for assessment. (QI author, cardiologist)
The emphasis on the importance of context was accompanied by recognition among all 42 participants of the difficulties of reporting it. Many participants (28) reported the basic problem that it is difficult to characterise what is meant by context and to distinguish it precisely from intervention. Sometimes context was described as amorphous and ethereal, akin to a black box. For example, corridor conversations, chance meetings of charismatic personalities, a changed team member, simultaneous work in other departments or board-level decisions can critically affect the outcome of a QI project for better or worse, but these occurrences may evade capture.
Many participants (17) were ambivalent about drawing a hard line between context and intervention given that botli might be implicated in change, yet how to describe this was not clear. Some noted that some ingredients may be more active in one place than another, and it can be hard to work out ‘winch are the most important ingredients with the greatest weight' (QI author, surgeon 1). Thus, not only was it difficult to identify contextual features, it was reported that it is also hard to determine which ones are important (10 participants).
Despite the emphasis given to context, some participants reported that contextual features were at risk of being seen, particularly by more epidemiologically trained editors and reviewers, as ‘noise’ that should be ‘controlled out’. These participants characterised contextual features as confounders, sources of bias (which systematically influence the direction a QI study takes) or natural variation (factors that are happening anyway, over which the researcher has no control). Four journal editors were concerned that when authors seek to explain contextual features that are specific to individual localities, peer reviewers might then suggest that further evaluation in new settings was needed, making it harder to publish QI work.
The reality is that how this project will play out in a different hospital is different because of a whole o bunch of idiosyncratic workflow issues. And so even- if it worked in this one hospital, it's almost like, any- o one else wanting to do it is going to have to redo it. o There’s so many different ways in which even some- 6 thing as basic as a checklist can be done, they're going 8 to essentially have to do the same thing the authors c did (QI custodian, doctor).2
A particular challenge in reporting context was that 9 some members of the scientific community may fail 2 to value qualitative methods, even though they may be a especially well suited to describing context. Participants o’ reported that some authors might ‘roll their eyes’ (QI 5 author, surgeon 2) when asked to report context because- they do not have the skill to report it, cannot specify it J or cannot fit it into conventional models of reportage: it “ feels like ‘fitting a square peg in a round hole’ (QI author, a surgeon 3). Further, negative contextual features (such asθ bullying or seeking to sabotage interventions) were seen X as difficult to describe candidly (13 participants).“
a.
All under the carpet...people don't want to say the a chief of surgery was an idiot and we had to get the of hospital president to sit, make him agree to this [QI 3 research], (QI custodian, surgeon)- a

BMJ Open: first published as 10.1136/bmjopen-2019-030269 on 24 July 2019. Downloaded from http://bmjopen.bmj.com/ on January 27, 2026 at University of East Anglia Library

To improve understanding of how to report context, 2 participants suggested: wider use of the MUSIQ tool34 S (12 participants); extending the MUSIQ tool to high- E light contextual features known to affect QI in surgery o (3); including the study of context in medical school g curricula on QI (6); and using terms such as ‘portable’2 and ‘reproduce’ in lieu of ‘generalisable’ and ‘replicate’g to encourage understanding that not all mechanisms © contributing to an intervention’s success or failure can be y replicated exactly, and some interventions (and contex- 9 tual features) may need to be adapted to other settings ο (14). Participants suggested that collection of contextual° data may be eased by use of: objective scales (8) ; QI diaries 0 kept by the researchers, which participants likened to lab books (6); external independent evaluation (3); and ethnography (2). As some participants found it hard to report context in the conventional journal format, eight participants suggested adding a heading of ‘What really happened’. Eight, however, did not want the traditional introduction, methods, results and discussion (IMRAD) structure of academic papers to be altered to better suit QI reporting.

The traditional journal format is established, it has a tremendous amount of weight and is respected and successful, and I think if quality improvement can sit in that model it should. (QI author, radiologist)
Proximal and distal influences leading to incomplete reporting of QI Participants described how certain features of the organisational and institutional fields in whicli they worked might influence the quality of reporting. Many participants (10 QI authors, 5 QI consumers and 8 QI custodians, all in mixed clinical and academic roles) noted how personal or organisational self-interest might prompt QI authors to seek to publish their work, given its potential implications for allocation of research funding3’,6 and in performance management and reputation.’5
Personal credit, ambition, glory... (QI author, anaesthetist 2)
Thirty-four participants referred to the potential benefit for patients as a principal motivation for reporting QI work, and 17 sought to reduce wasteful duplication across healthcare sites. But many participants also reported barriers and disincentives to reporting. We conceptualise these barriers as proximal (close to the writing-up activities of QI authors) and distal (related to higher-level organisational and institutional influences).
A third of participants (14) discussed proximal barriers—for example, the challenge of doing QI work and writing it up, while simultaneously looking after patients. This might be particularly challenging for authors who conduct QI alongside everyday patient care, perhaps in contrast to those on clinical academic pathways who may have allocated time for QI research. Participants used phrases like ‘feeling battered' (QI consumer, anaesthetist 1), ‘on a hamster wheel’ and ‘wading through treacle’ (QI consumer, anaesthetist 2). Even if they could find time to produce complete QI reports, six participants felt that what they report (selecting the QI topic and deciding whicli contextual features should be included) was influenced by tlieir immediate hospital management. Twenty-two participants reported mundane, practical challenges—for example, how writing can be hampered by restrictive word counts. Similarly, some suggested that reporting guidelines might have only a limited role in improving the quality of reporting, especially if QI stakeholders do not realise they exist (10 participants).
One of the reviewers said we hadn’t used any guidelines, even though we’d used SQUIRE, but he had never come across it before. (QI author, physiotherapist)
These proximal barriers were often profoundly structured by distal influences—for example, the norms surrounding article format that are widely accepted within the field of biomedical research, and whicli also inform expectations for publishing studies of QI. Publishing in high-impact journals was seen as challenging of a perceived preference for quantitative data over qualitative explanations of contextual features (8), and/or focus on novel therapeutic approaches (13)— neither of which favour QI. Nineteen participants also reported that explaining failure may be so difficult that negative or null QI studies may never be written up or published. When asked what authors find most difficult to write about in QI, one participant responded:
Stuff that didn’t work! [laughs]...! think publishing null studies is always hard and a lot of people don’t do it. (QI author, surgeon 4)	J
Participants proposed several solutions to these chal- 2 lenges. Heavy clinical workloads that perpetuate poor & reporting could be alleviated by: allowing protected time 2 for QI work (3); convening multidisciplinary writing 8 teams (14); embedding local or regional QI research units X that could operate in the same way as clinical trials units © (6); providing structured programmes of QI education or a mentorship (13); and involving patients, who could also 7 be part of a QI multidisciplinary team (7).5
If you're thinking of sort of blue sky, I can imagine » that you know, in the very same way as we have clini- o cal trials [units] we should have quality improvement 5 units. (QI custodian, academic 3)0b
Participants generally felt that word counts should not D be increased, because brevity is valued in scientific writing, 2 but the constraints they impose could be alleviated by: 6 uploading supplementary material and podcasts (18);Ϊ encouraging multiple publications for a single QI study 2 (4); using web-enabled formats that allow the reader to 3 explore topics in more depth depending on what they are 3 most interested in (15); and sections dedicated to nega-b five studies in journals (2). Any solutions proposed would a. need, however, to be implemented through agreement - among journal editors (13).A
2
The editors should be the ones who need to really = drive this to make sure enough detail is included in s the papers. (QI author, cardiologist)	3
5 Q. on DISCUSSION	a
This study of stakeholders’ views on what influences QI o reporting in perioperative care suggests that its fit with « traditional forms of scientific research is imperfect, and - the rules and norms that govern QI authors’ and QI ο custodians’ understanding of what is worth publishing c are not always aligned.	09
Some reasons why reporting QI is so hard are potentially tractable, but will require both maturing of the field and convergence between the views of different stake- 376	··

BMJ Open: first published as 10.1136/bmjopen-2019-030269 on 24 July 2019. Downloaded from http://bmjopen.bmj.com/ on January 27, 2026 at University of East Anglia Library

holders. One challenge for QI reporting is that the contextual features which are important in mitigating failure or facilitating success are critical to the fabric of the QI work,38-42 but we found little consensus on how best to report context. In a field of study that remains young, this is perhaps not surprising, and there is a need for further
Domain	Potential actions for QI authors	Potential actions for healthcare organisations delivering QI work	Potential actions for journal editors publishing QI work	
Article format	Use existing reporting guidelines and taxonomies to guide the structure of your QI report.		Ensure familiarity of editorial staff and peer reviewers with QI reporting tools.	
	Know your audience. Do you want your reader to use the report to generate ideas for a new intervention, to replicate your intervention in another setting, or as a starting point for modification?		Provide a clear statement about whether qualitative approaches to data collection and writing are acceptable.	
	Use supplementary materials, and embed URLs (web links) into the article where possible.		Provide a clear statement of which additional resources are available to authors (eg, online supplements).	
	Be available to speak to your readers		Support the open access movement to encourage connection between authors and consumers.	
Organisational infrastructure		Build internal support and capacity for QI, such as protected time to conduct QI and more formal relationships between clinical QI teams and research nurses.	Sustain open communication channels with QI authors and consumers about what QI is and how it should be reported.	
Table 2 Improving the reporting of QI in surgery: approaches suggested by interview participants
Consider using a multidisciplinary writing team, how to support patient involvement, and seeking external evaluation.
Work with hospital management to
Build networks with external academic organisations (such as universities) and patients.
Work with QI teams to identify
identify problems that are most relevant problems that are most relevant to to patients (enable a breadth of topics), patients (enable a breadth of topics).
Consider enrolling in an education programme to enhance your QI reporting.
Scientific outputs	Demonstrate why your intervention was thought to work (eg, consider using theory, process evaluation, or a QI diary).	Enable structured conversations with QI stakeholders to consider how QI can be reported and what good reporting in QI looks like.	
	Provide your reader with a realistic view of what is needed and what is feasible.			
	Consider submitting for publication a QI project that did not go well.	Support a culture where negative experiences that create learning are shared.	Give specific advice on how to write a negative study well.	
Embed specific training about QI in library training programmes, online training programmes or mentorship schemes.
’Taxonomy and Reporting guideline examples.10345153 QI, quality improvement.
Consider providing some educational material for editors and peer reviewers about QI.
consideration of this issue within the QI community. Our findings indicate that the range of QI interventions and contexts, as well as the diversity of reasons for publishing QI and associated intended audiences, means that what should and should not be reported is not readily reducible to universal criteria.
The proximal pressures we have outlined (such as QI authors not having enough time to treat patients
and write up QI work, and the mismatch between the norms of biomedical publication and the expectations of QI authors) could potentially be relieved by practical support. Emergent models of research and practice in improvement may help to bring researchers and practitioners together, carving out time for reporting and ensuring the relevance of researcli for QI practitioners. Recent developments such as researcher-in-residence
BMJ Open: first published as 10.1136/bmjopen-2019-030269 on 24 July 2019. Downloaded from http://bmjopen.bmj.com/ on January 27, 2026 at University of East Anglia Library

BMJ Open: first published as 10.1136/bmjopen-2019-030269 on 24 July 2019. Downloaded from http://bmjopen.bmj.com/ on January 27, 2026 at University of East Anglia Library

models,43 boundary-spanning roles44 and tire like have some promise in generating important insights for busy clinicians that may otherwise remain uncovered, while also yielding publications of greater relevance and usefulness.45
The more distal influences on reporting that we have identified point towards the issues that underlie some of the symptoms of the challenges of QI reporting, and which may be harder to shift. The forms of knowledge that are valued within clinical-academic circles, for example, are underpinned by enduring assumptions about the validity of knowledge, as well as incentive systems that view some forms of researcli and some forms of reporting as more worthwhile than others. Similarly, making more time available for QI activity and QI researcli niay require significant shifts in the priorities of the funders of botli healthcare provision and healthcare research.
Nevertheless, participants offered a range of suggestions about how these issues might be addressed, which we summarise in table 2. Some may already be in use—for example, many authors already use the SQUIRE guidelines.10 Others are more aspirational, and may be challenging to enact. For example, QI authors in surgery may experience conflicting demands on their time, and face competing demands for brevity in scientific writing and for a full description of a social process. As such, some of them are less solutions, and more areas where coordinated attention might benefit the field. Attempts to retain what is valued about QI while continuing to satisfy a deeply ingrained way of working will require concerted and perhaps entrepreneurial efforts.46
The field of perioperative care was chosen as a focus of this study in part because of the evidence that it is a highly active site of QI, but demonstrates poor quality reporting.3 It is increasingly clear that high quality science will be needed to support improvement,47 and better reporting will be an essential element of this. Given the continued interest in developing the field of perioperative care, it is possible that targeted efforts to support improvement in reporting could yield significant benefits.
This is among the first studies to examine the challenges of reporting QI in the perioperative literature and how QI reporting might be improved. We opted not to include all types of stakeholders in QI reporting—in particular, patients. This is because public and patient involvement in QI reporting is early in its development.4 'Researchers may need to improve the reporting standards of QI itself3 and allow time for the SQUIRE guidelines to become optimally implemented50 before attempts are made to add public and patient involvement to reporting requirements. A further limitation is that we recruited only stakeholders who were actively interested in QI. However, a semistructured interview schedule and many open-ended probes allowed us to obtain a range of views.
CONCLUSION
The fit between QI reporting and reporting of more traditional medical research poses problems for those seeking to report on QI activity, and QI custodians need to work with QI authors and QI consumers to develop more appropriate approaches. Participants had numerous suggestions about how to address such challenges (table 2), but many of these will require coordinated effort within the QI community, and should be taken forward with caution given their potential downsides and unintended conse- v quences. Perioperative care may be a useful area in which 9 to test some approaches.	2
o
O.
Acknowledgements The authorship team would like to thank Katrina Brown, Communications Manager, THIS Institute for her help in editing and proof reading this document and Gill Penny, our patient advisor.
Contributors EJ initiated the idea for the interview study and led the development of the protocol, study administration, data collection, analysis and writing of this manuscript. GPM and MDW contributed to protocol development, supervised the study and contributed to data analysis and writing of the manuscript.
Funding This work was completed as part of a PhD studentship funded by the Health Foundation. Writing up of this paper was supported in part by MDW’s Wellcome Trust Senior Investigator award WT097899. GPM acknowledges the support of the National Institute for Health Research (NIHR) Collaboration for Leadership in Applied Health Research and Care East Midlands (CLAHRC EM). MDW and GPM are supported by the Health Foundation's grant to the University of Cambridge for The Healthcare Improvement Studies (THIS) Institute. THIS Institute is supported by the Health Foundation-an independent charity committed to bringing about better health and health care for people in the UK. MDW is a National Institute for Health Research (NIHR) Senior Investigator (NF-SI-0617-10026). The views expressed in this article are those of the authors and not necessarily those of the NHS, the NIHR, or the Department of Health and Social Care.
Disclaimer The views expressed in this article are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health and Social Care.
Competing interests None declared.
Patient consent for publication Not required.
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement All data relevant to the study are included in the article - All authors had access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. No additional data are available. No unpublished data are available outside of the study team.
Open access This is an open access article distributed in accordance with the Creative Commons Attribution 4.0 Unported (CC BY 4.0) license, which permits others to copy, redistribute, remix, transform and build upon this work for any purpose, provided the original work is properly cited, a link to the licence is given, and indication of whether changes were made. See: https://creativecommons.org/ licenses/by/4.0/.
REFERENCES
1		Nicolay CR, Purkayastha S, Greenhalgh A, et al. Systematic review of the application of quality improvement methodologies from the manufacturing industry to surgical healthcare. Br J Surg 2012;99:324-35.
2		Powell ΑΕ, Rushmer RK, Davies HT. A systematic narrative review of quality improvement models in health care. NHS Quality Improvement Scotland 2009.
3		Jones EL, Lees Ν, Martin G, et al. How well is quality improvement described in the perioperative care literature? a systematic review. Jt Comm J Qual Patient Saf 2016;42:196-AP10.
4		Batalden PB, Davidoff F. What is "quality improvement" and how can it transform healthcare? Qual Saf Health Care 2007;16:2-3.
5 Shojania Κ, McDonald K, Watcher R, et al. Closing the quality gap: a critical analysis of quality improvement strategies - (vol 1— series overview and methodology -technical review 9). agency for healthcare research and quality. Rockville, MD, US 2004.

6 Dutta S, Jaffer ΑΚ. Reporting quality improvement interventions: a call to action. Jt Comm J Qual Patient Saf 2016;42:195.
7 loannidis JP. How to make more published research true. PLoS Med 2014;11:e1001747.
8 Greenhalgh Τ, Howick J, Maskrey Ν. Evidence Based Medicine Renaissance Group. Evidence based medicine: a movement in crisis? BMJ 2014;348(jun13 4):g3725-7.
9 Reed JE, Card AJ. The problem with Plan-Do-Study-Act cycles. BMJ Qual Saf 2016;25:147-52.
10 Ogrinc G, Davies L, Goodman D, et al. SQUIRE 2.0 (Standards for QUality Improvement Reporting Excellence): revised publication guidelines from a detailed consensus process. BMJ Qual Saf 2016;25:986-92.
11 Hempel S, Rubenstein LV, Shanman RM, et al. Identifying quality improvement intervention publications - A comparison of electronic search strategies. Implement Sci 2011;6:1-10.
12 Dixon-Woods M, Bosk CL, Aveling EL, et al. Explaining Michigan: developing an ex post theory of a quality improvement program. Milbank Q 2011;89:167-205.
13 Davidoff F. Improvement interventions are social treatments, not pills. Ann Intern Med 2014;161:526-7.
14 Treadwell JR, Lucas S, Tsou AY. Surgical checklists: a systematic review of impacts and implementation. BMJ Qual Saf 2014;23:299-318.
15 M J, Thorlby R. High Quality Care For All: Briefing on NHS next stage review final report. The Kings Fund 2008:1-8.
16 Ovretveit J. Producing useful research about quality improvement. Int J Health Care Qual Assur Inc Leadersh Health Serv 2002;15:294-302.
17 Margolis Ρ, Provost LP, Schoettker PJ, et al. Quality improvement, clinical research, and quality improvement research—opportunities for integration. Pediatr Clin North Am 2009;56:831-41.
18 Buus Ν, Agdal R. Can the use of reporting guidelines in peer-review damage the quality and contribution of qualitative health care research? Int J Nurs Stud 2013;50:1289-91.
19 Smyth RM, Jacoby Α, Altman DG, et al. The natural history of conducting and reporting clinical trials: interviews with trialists. Trials 2015;16:1-12.
20 Dijkers MP. Reporting on interventions: issues and guidelines for rehabilitation researchers. Arch Phys Med Rehabil 2015;96:1170-80.
21 Scherer RW, Ugarte-Gil C, Schmucker C, et al. Authors report lack of time as main reason for unpublished research presented at biomedical conferences: a systematic review. J Clin Epidemiol 2015;68:803-10.
22 Meara JG, Leather AJ, Hagander L, et al. Global Surgery 2030: evidence and solutions for achieving health, welfare, and economic development. Lancet 2015;386:569-624.
23 Nepogodiev D, Martin J, Biccard Β, et al. Global burden of postoperative death. Lancet 2019;393:401.
24 Wells Cl, Robertson JP, O'Grady G, et al. Trends in publication of general surgical research in New Zealand, 1996-2015. ANZ J Surg 2017;87:76-9.
25 Donovan AJ, Tompkins RK, Angeles L. Surgical research publication in a selection of research and surgical specialty journals. Surgery 2010;147:5-12.
26 O'Brien BC, Harris IB, Beckman TJ, et al. Standards for reporting qualitative research: a synthesis of recommendations. Acad Med 2014;89:1245-51.
27 Davies L, Batalden Ρ, Davidoff F, et al. The SQUIRE Guidelines: an evaluation from the field, 5 years post release. BMJ Qual Saf 2015;24:769-75.
28 Rycroft-Malone J, Harvey G, Seers Κ, et al. An exploration of the factors that influence the implementation of evidence into practice. J Clin Nurs 2004;13:913-24.
29 Glaser BG, Strauss A. The discovery of grounded theory: strategies for qualitative research. New York: Aldine Publishing Co, 1967.
30 Charmaz K. Constructing grounded theory: a practical guide through qualitative analysis. London: SAGE Publication Ltd, 2006.

32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53

31 Ritchie J, Lewis J. Qualitative Research Practice: A Guide for Social Science Students and Researchers. Qualitative Research Practice: A
Guide for Social Science Students and Researchers. London: SAGE publications Ltd, 2003.
Grimshaw J, McAuley LM, Bero LA, et al. Systematic reviews of the effectiveness of quality improvement strategies and programmes. Qual Saf Health Care 2003;12:298-303.
Leung L. Validity, reliability, and generalizability in qualitative research. J Family Med Prim Care 2015;4:324.
Kaplan HC, Provost LP, Froehle CM, et al. The Model for Understanding Success in Quality (MUSIQ): building a theory of context in healthcare quality improvement. BMJ Qual Saf 2012;21:13-20.
Cucchetti A, Mazzotti F, Pellegrini S, et al. The use of the Hirsch index in benchmarking hepatic surgery research. Am J Surg 2013;206:560-6.
Frenken Κ, Heimeriks GJ, Hoekman J. What drives university research performance? An analysis using the CWTS Leiden Ranking data. J Informetr 2017;11:859-72.
Greenhalgh Τ, Annandale E, Ashcroft R, et al. An open letter to The BMJ editors on qualitative research. BMJ 2016;352:i563.
Kringos DS, Sunol R, Wagner C, et al. The influence of context on the effectiveness of hospital quality improvement strategies: a review of systematic reviews. BMC Health Serv Res 2015;15:277.
Mosher Η, Ogrinc G. Between the guidelines: SQUIRE 2.0 and advances in healthcare improvement practice and reporting. BMJ Qual Saf 2016;25:559-61.
Zwarenstein M, Treweek S, Gagnier JJ, et al. Improving the reporting of pragmatic trials: an extension of the CONSORT statement. BMJ 2008;337:a2390.
Ovretveit J, Dolan-branton L, Marx M, et al. Adapting improvements to context: when, why and how? Int J Qual Heal Care 2018;30:20-3.
Parry G, Coly A, Goldmann D, et al. Practical recommendations for the evaluation of improvement initiatives. Int J Qual Health Care 2018;30:29-36.
Marshall M, Pagel C, French C, et al. Moving improvement research closer to practice: the Researcher-in-Residence model. BMJ Qual Saf 2014;23:801-5.
Chew S, Armstrong Ν, Martin G. Institutionalising knowledge brokering as a sustainable knowledge translation solution in healthcare: how can it work in practice? Evid Policy 2013;9:335-51.
Alexander JA, Hearld LR. What can we learn from quality improvement research? A critical review of research methods. Med Care Res Rev 2009;66:235-71.
Martin G, Currie G, Weaver S, et al. and Individual Responses: Delineating the Boundaries of Partial Autonomy. Organ Stud 2016;23:1-25.
Memtsoudis SG, Poeran J, Kehlet Η. Enhanced Recovery After Surgery in the United States: From Evidence-Based Practice to Uncertain Science? JAMA 2019;321:1049-50.
Ocloo J, Matthews R. From tokenism to empowerment: progressing patient and public involvement in healthcare improvement. BMJ Qual Saf 2016;25:626-32.
O'Hara JK, Lawton RJ. At a crossroads? Key challenges and future opportunities for patient involvement in patient safety. BMJ Qual Saf 2016;25:565-8.
Howell V, Schwartz ΑΕ, O'Leary JD, et al. The effect of the SQUIRE (Standards of QUality Improvement Reporting Excellence) guidelines on reporting standards in the quality improvement literature: a before-and-after study. BMJ Qual Saf 2015;24:400-6.
Pinnock Η, Barwick M, Carpenter CR, et al. StaRI Group. Standards for Reporting Implementation Studies (StaRI) Statement. BMJ 2017;356:i6795.
Schulz R, Czaja SJ, McKay JR, et al. Intervention taxonomy (ITAX): describing essential features of interventions. Am J Health Behav 2010;34:811-21.

BMJ Open: first published as 10.1136/bmjopen-2019-030269 on 24 July 2019. Downloaded from http://bmjopen.bmj.com/ on January 27, 2026 at University of East Anglia Library

Hoffmann TC, Glasziou ΡΡ, Boutron I, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ 2014;348:g1687.