REVIEW
Ann R Coll Surg Engl 2014; 96: 89–94
doi 10.1308/003588414X13824511649571
A systematic review of patient reported outcomes and patient experience in enhanced recovery after orthopaedic surgery
EL Jones1, TW Wainwright2, JD Foster1, JRA Smith3, RG Middleton2, NK Francis1
1Yeovil District Hospital NHS Foundation Trust, UK
2Royal Bournemouth and Christchurch Hospitals NHS Foundation Trust, UK 3North Bristol NHS Trust, UK
ABSTRACT
INTRODUCTION Orthopaedic enhanced recovery after surgery (ERAS) providers are encouraged to estimate the actual benefi t of ERAS according to the patient’s opinion by using patient generated data alongside traditional measures such as length of stay. The aim of this paper was to systemically review the literature on the use of patient generated information in orthopaedic ERAS across the whole perioperative pathway.
METHODS Publications were identifi ed using Embase™, MEDLINE®, AMED, CINAHL® (Cumulative Index to Nursing and Allied Health Literature), the Cochrane Library and the British Nursing Index. Search terms related to experiences, acceptance, satisfaction or perception of ERAS and quality of life (QoL).
FINDINGS Of the 596 abstracts found, 8 papers were identifi ed that met the inclusion criteria. A total of 2,208 patients undergoing elective hip and knee arthroplasty were included. Patient satisfaction was reported in 6 papers. Scores were high in all patients and not adversely affected by length of stay. QoL was reported in 2 papers and showed that QoL scores continued to increase up to 12 months following ERAS. Qualitative methods were used in one study, which highlighted problems with support following discharge. There is a paucity of data reporting on patient experience in orthopaedic ERAS. However, ERAS does not compromise patient satisfaction or QoL after elective hip or knee surgery. The measurement of patient experience should be standardised with further research.
KEYWORDS
Enhanced recovery after surgery – Fast track – Patient experience – Orthopaedic
Accepted 4 June 2013
CORRESPONDENCE TO
Nader Francis, Consultant Colorectal Surgeon, Yeovil District Hospital, Higher Kingston, Yeovil, Somerset BA21 4AT, UK
E: nader.francis@ydh.nhs.uk

Enhanced recovery after surgery (ERAS) seeks to optimise perioperative wellbeing by reducing the surgical stress re- sponse.1 To date, the outcome of ERAS pathways has been measured using length of hospital stay (LOS), readmission and complication rates. However, there is now a drive to capture the patient’s perspective and patient reported outcome measures (PROMs) have been used to do this. PROMs are validated measures of any aspect of health that come from the patients themselves.2 They include satisfaction and quality of life (QoL) scores. Their collection for elective total hip and total knee arthroplasty patients has been mandatory in the National Health Service (NHS) since 2009.3 Patient experience is another aspect of the patient’s perspective, and is considered to have equal standing alongside clinical effectiveness and patient safety as an indicator of quality.4
In the UK, patient experience data are collected using the NHS patient survey programme, the NHS friends and family test,5 non-validated questionnaires, interviews and focus groups.6 The aim of this paper was to systemically review the literature on the use of patient generated information in orthopaedic ERAS across the whole perioperative pathway.
Methods
Guidelines for the preferred reporting items for systematic reviews and meta-analysis were followed.7 Embase™, MEDLINE®, AMED, CINAHL® (Cumulative Index to Nursing and Allied Health Literature), the Cochrane Library and the British Nursing Index were searched. The search strategy is summarised in Table 1. The most recent search was performed on 8 February 2013.
Eligibility criteria
Studies published between 1 January 2000 and 8 February 2013 were included to promote capture of all papers pub-

Set 1:	enhanced recovery OR eras OR rapid recovery OR (fast AND track) OR fast-track OR mul-
Enhanced recovery after surgery search terms timodal OR multi-modal OR accelerated discharge OR early discharge OR early rehabilita- tion.ti,ab [Limit to: Publication Year 2000-Current]
Set 2:	quality of life OR qol OR hrql OR hrqol OR patient-reported OR patient reported OR PRO
Patient reported outcome search terms	OR PROM OR outcome measure OR outcome assessment OR health status OR well being
OR well-being OR wellbeing OR health survey OR Euroqol OR EQ-5D OR EQ-3D OR SF- 36 OR stress OR anxiety OR depression OR psychosocial OR psycho-social OR self-concept OR expectation* OR satisf* OR dissatisf* OR perspective OR patient* experience* OR experience* of patient*.ti,ab [Limit to: Publication Year 2000-Current]
Set 3:	musculo* OR orthopaedic* OR orthopedic* OR hip* OR knee* OR arthroplast* OR re-
Orthopaedic search terms	placement OR replace*.ti,ab [Limit to: Publication Year 2000-Current]
NOT: humerus OR humeral OR shoulder* OR colorectal OR colo-rectal OR bowel OR colon* OR rectum

ERAS = enhanced recovery after surgery
Figure 1 Study selection
lished since ERAS was implemented in clinical practice. Studies were eligible if they assessed QoL and satisfaction in orthopaedic ERAS, if they had 10 participants or more and if they reported outcomes within 12 months of surgical intervention. Studies with functional outcomes such as the Oxford knee score were excluded as they report on physical operative outcome and we aimed to report on the patient’s perspective of care.
Study selection
Two reviewers (EJ and TW) independently assessed titles and abstracts. Search results were supplemented with hand searching (EJ). Methodological quality was assessed using the Newcastle–Ottawa scale8 (non-randomised studies) and the hierarchy of evidence-for-practice9 (qualitative studies). This involved scrutinising sampling theory and generalisability. The quality of PROM reporting was evaluated using standards developed by the Task Force of the International Society for Quality of Life Research (Table 5).10
Results
The search strategy identifi ed 596 abstracts. Of these, 588 were excluded by review of the title and/or abstract (Fig 1). Two additional articles were added following hand searching. A total of 8 articles were therefore included describing 2,208 orthopaedic ERAS patients.
Study characteristics
Of the eight articles included, five were non-randomised comparative studies, one was a national survey, one a case series and one a qualitative study. Studies were conducted in Denmark and the UK.
Our review revealed three patient generated outcome measures: patient satisfaction questionnaires (PSQs), QoL PROMs and qualitative interview data. The results are summarised in Tables 2–4.
Patient satisfaction
Six studies used PSQs: four comparative studies, one national survey and one case series (Table 2). PSQs were implemented during hospitalisation as well as up to 12 months postoperatively for patients with cemented, uncemented and hybrid procedures included. Uniformly high satisfaction scores were found across the dataset.
Only one study compared ERAS with traditional care: Barker et al studied 41 patients undergoing unicompartmental knee replacement (UKR) who were allocated to a 24-hour versus a 5-day postoperative stay.11 Disease specifi c questionnaires (adapted from Mahomed et al)12 completed at six months related to analgesia, ability to perform home and recreational activities, LOS and overall surgical result. There was no statistically signifi cant difference between the two groups and Barker et al suggested that through enrolment in the study, greater patient education improved scores across both groups. However, 14 of the 20 patients managed conventionally reported that they would prefer a shorter LOS.
Husted et al (in 200813 and 201114) used PSQs before discharge. They evaluated LOS, the entire stay, patient information, operating room stay, recovery ward stay, nursing, doctors’ ward rounds, pain management, physiotherapy, environment and information. From a cohort of 712 ERAS patients, there was no statistically signifi cant difference in patient satisfaction or LOS between total knee replacement (TKR) and total hip replacement (THR) patients.13 High satisfaction was associated with a shorter LOS, increasing age, being married, reduced need for analgesia and reduced co-

Table 2 Articles reporting on patient satisfaction in orthopaedic enhanced recovery after surgery
Paper	Methodology	Groups compared	Results	Sample size	
Barker, 200611	Comparative	Unicompartmental knee replacement:
ERAS (n=21) vs standard care (n=20)	ERAS and standard care groups highly satisfi ed	41	
Husted, 200813	Comparative	THR (n=370) compared with TKR (n=342). ERAS only.	Positive correlation between reduced LOS and overall satisfaction. High satisfaction scores during all parts of hospital stay. No signifi cant difference between TKR and THR.	712	
Husted, 201114	Comparative	Bilateral TKR (n=150) compared with unilateral TKR (n=271) matched for sex but not age. ERAS only.	Patient satisfaction uniformly high with no signifi cant difference across unilateral and bilateral TKR patients	421	
Larsen, 201215	Comparative	TKR and UKR compared with normative population data. ERAS only.	Sex, age, implant type or preoperative QoL did not signifi cantly predict patient satisfaction at 12 months.	157	
Husted, 201016	National survey	THR and TKR: outcomes data compared between hospitals with shorter and longer LOS	Significantly higher patient satisfaction with doctors’ communication in hospitals with shorter LOS	563	
Husted, 201117	Case series	Revision knee replacement. ERAS only.	High patient satisfaction regarding LOS and entire stay	29	

ERAS = enhanced recovery after surgery; THR = total hip replacement; TKR = total knee replacement; LOS = length of stay; UKR = unicompartmental knee replacement; QoL = quality of life
Table 3 Articles reporting on quality of life in orthopaedic enhanced recovery after surgery
Paper	Methodology	Groups compared	Results	Sample size	
Larsen, 201215	Comparative	TKR and UKR compared with normative population data. ERAS only.	TKR and UKR ERAS patients with low preoperative QoL scores have additional need for postoperative rehabilitation.	211	
Larsen, 201018	Comparative	THR compared with normative population data. ERAS only.	EQ-5D™ score continues to rise up to 12 months following surgery, reaching higher than the population norm. Some SF-36® parameters did not reach population norm at 3 months but matched it at 12 months.	196	

TKR = total knee replacement; UKR = unicompartmental knee replacement; ERAS = enhanced recovery after surgery; QoL = quality of life; THR = total hip replacement

morbidities. In a comparative study of simultaneous bilateral (n=150) versus unilateral TKR (n=271) with a two-year follow-up period, satisfaction scores were uniformly high despite a higher LOS in the bilateral group.14
In 2012 Larsen et al examined the association between satisfaction, QoL and function in 157 consecutive ERAS primary elective TKR and UKR patients, compared with an age matched normative population.15 No satisfaction parameters were given so conclusions cannot be drawn regarding spe- cifi c aspects of the ERAS pathway. Overall satisfaction at 12 months was predicted by functional ability but not by sex, age, implant type or preoperative QoL.
Husted et al’s 2010 national survey reported on 563 patients undergoing cemented, hybrid and uncemented THR (n=312) and TKR (n=251), comparing short and long LOS.16 All patients were sent PSQs that focused on hospital stay and LOS. The study found equal or better satisfaction with all parts of stay for shorter LOS patients, especially with the continuity of doctors’ rounds and preoperative information.
Husted et al’s prospective case series from 2011 reports on 29 patients undergoing revision knee arthroplasty (one bilateral).17 A PSQ was issued relating to their hospital stay and results revealed that revision TKR patients receiving ERAS can achieve satisfaction outcomes similar to those reported after primary TKR.
The cohort studies reviewed represent relatively high technical methodological quality; Husted et al (2011)14 score 7/9, and Barker et al,11 Husted et al (2008)13 and Larsen et al15 score 5/9 on the Newcastle–Ottawa scale. PSQ reporting standards were generally high (Table 5). However, rationale for the use of a satisfaction measure and its limitations were poorly reported.
Quality of life
Two comparative studies used QoL questionnaires as their primary outcome (Table 3). Larsen et al measured QoL variables before and after surgery in 211 TKR/UKR patients15 and in 196 THR patients.18 Follow-up was undertaken at 4

Table 4 Articles reporting on qualitative data in orthopaedic enhanced recovery after surgery
Paper	Methodology	Groups compared	Results	Sample size	
Hunt, 200919	Qualitative: interviews	Primary THR ERAS vs standard care	Patients’ acceptance of early discharge masks doubts and concerns.	35	

THR = total hip replacement; ERAS = enhanced recovery after surgery
Table 5 Quality of patient reported outcome (PRO) information (adapted from the International Society for Quality of Life Research suite of reporting standards for health related quality of life outcomes of randomised clinical trials)10
PRO identifi ed as an outcome in the abstract
PRO hypothesis stated
Mode of applying PRO stated
Rationale for choice of PRO stated
Evidence of validity and reliability provided
Intended data collection schedule provided
Status as primary or secondary outcome reported
Evidence of statistical testing for each PRO
Missing data reported explicitly (reasons why and statistics)
Baseline PROs stated with patient characteristics
Limitations of PROs discussed explicitly, including generalisability
Clinical relevance of PRO fi ndings discussed
PRO results discussed in context of other trial outcomes

and 3 months following surgery respectively as well as at 12 months in both groups. Generic (SF-36®) and utility (Eu- roQol EQ-5D™) instruments were chosen with a clear rationale. Both studies used a sample that was age and sex matched to the general population. The knee replacement and hip replacement studies scored 5/9 and 6/9 respectively on the Newcastle–Ottawa scale.
The EQ-5D™ scores of the THR cohort (at or above 55 years old) had reached the normative population level at 3 months after surgery and continued to rise to above the population norm at 12 months.18 There was a 77% follow-up rate at 12 months after surgery.
Some knee arthroplasty patients with low preoperative QoL did not regain QoL outcomes compared with the normative group at 12 months postoperatively.15 Those scoring highly before surgery reached the population norm at four months. QoL data continued to change up to 12 months across 6 parameters: mental health, social functioning, general health, vitality, bodily pain and role limitation due to emotional problems.
Qualitative studies
One paper reported on patient experience of ERAS using qualitative methods: Hunt et al recruited 15 ERAS patients and 20 traditional care patients across two hospitals.19 The study was classifi ed as level III (descriptive)9 as the sample was not diversifi ed to analyse exactly why differences occurred despite using a good range of illustrative quotations. The semistructured interviews were conducted in the clinic or at home, 2–5 days postoperatively. Only 2 of the 31 patients directly addressed their LOS and when prompted, they did not question or criticise their LOS. ERAS patients found it diffi cult to believe a shorter recovery time would be possible but accepted the concept of early discharge. The authors suggested that the ‘true views’ of the participants regarding LOS were hidden, implying that their ‘acceptance’ masked underlying concerns.
Discussion
Enhanced recovery after orthopaedic surgery demands a multimodal service, which is influenced by the many overlapping factors of recovery. The integration of patient generated data is required in order to provide a high quality, patient centred service.
Our review has revealed that a variety of patient generated data measurement tools are used in orthopaedic ERAS. These include PSQs, QoL PROMs and interviews. Owing to methodological shortcomings in study design and heterogeneity, it was not possible to conduct a meta-analysis and caution should be observed in the generalisation of these data.
The review has shown, however, that ERAS did not compromise patient satisfaction and that patients prefer a shorter LOS. Reasons reported included favouring being at home with relatives and not wanting to ‘clog up a hospital bed’. Furthermore, patient satisfaction was not influenced by the type of surgery (hip vs knee surgery, implant type, or unilateral or bilateral procedures). Factors underpinning high patient satisfaction with ERAS pathways included patient education,11,13 continuity of doctors’ rounds and reduced need for analgesia.13 Conversely, poor satisfaction was associated with higher levels of postoperative pain.11
These patient satisfaction data provide an indication of which elements of the ERAS pathway are most important to patients. Nevertheless, although the UK paper describes the provision of extra information due to participation in a trial, the level of patient information provided or the manner in which it was delivered in UK or Danish units was not described, making it diffi cult to translate these findings directly into improving ERAS delivery.
The problem of overly positive results in patient satisfaction reporting is well known20 and Hunt et al also point this out, suggesting that acceptance of early discharge masks patients’ real concerns.19 Patient experience data may resolve some of these tensions by providing more detail about what circumstances surrounded those key ERAS components to make them satisfactory (or not) and why it was important to the patient.21 This may achieve a greater impact on how care is delivered by enabling accurate identifi cation of challenges, making data more useful to the service provider.
This review also revealed that QoL data continued to change up to 12 months postoperatively and may be used as a predictor of outcome as patients with low preoperative QoL scores could be targeted for more intensive postoperative rehabilitation. However, high QoL scores were also reported alongside lower functional ones.18 PROMs analysis may not allow the clinician to understand what circumstances may have caused this conflicting relationship because PROMs are not able to capture all issues that are relevant to patients, including community life and partici- pation.22
Qualitative methods are used widely across healthcare and recent progress in developing strategies to establish rigour have enabled qualitative methods to impact signifi - cantly on health outcomes research.23,24 The qualitative data highlighted that recovery is a multidimensional phenomenon and that patient generated data are affected by perception. This subjectivity can create methodological problems including reporting bias25 although mixed methods approaches have been suggested as a mechanism to overcome these challenges.
Clinicians may use these results to stimulate discussion about the importance of fully understanding how all the parts of the ERAS pathway contribute towards their patient’s experiences. This may then act as a stepping stone to promote further research into the validation of a measure of patient experience. Accurate comparison and benchmarking of orthopaedic ERAS pathways against the outcome patient experience may enable faster identifi cation of challenges, which will lead to improved service delivery and, ultimately, improved patient care. Finally, the successful integration of patient experience data into orthopaedic service delivery will depend on the readiness of clinical staff, hospital managers and commissioners to use these data.
Conclusions
There is a variety of tools that are capable of capturing the patient’s perspective. ERAS does not compromise patient satisfaction or quality of life after elective hip or knee replacement surgery. However, there are no bespoke or validated measures that are able to capture and measure how patients experience interactions in the ERAS setting. The measurement of patient experience should be standardised with further research.
References
1.		Wilmore DW, Kehlet H. Management of patients in fast track surgery. BMJ 2001; 322: 473–476.
2.		Department of Health and Human Services. Guidance for Industry – Patient- Reported Outcome Measures: Use in Medical Product Development to Support Labeling Claims. Washington DC: Department of Health and Human Services; 2009.
3.		Department of Health. Guidance on the Routine Collection of Patient Reported Outcome Measures (PROMs). London: DH; 2008.
4.		Department of Health. The NHS Outcomes Framework 2013/14. London: DH; 2012.
5.		Department of Health. The NHS Friends and Family Test. Leeds: DH; 2012.
6.		Coulter A, Fitzpatrick R, Cornwell J. The Point of Care – Measures of Patients’ Experience in Hospital : Purpose, Methods and Uses. London: Kings Fund; 2009.
7.		Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Int J Surg 2010; 8: 336–341.
8.		The Newcastle–Ottawa Scale (NOS) for Assessing the Quality of Nonrandomised Studies in Meta-analyses. Ottawa Hospital Research Institute. http://www.ohri. ca/programs/clinical_epidemiology/oxford.asp (cited September 2013).
9.		Daly J, Willis K, Small R et al. A hierarchy of evidence for assessing qualitative health research. J Clin Epidemiol 2007; 60: 43–49.
10.		Brundage M, Blazeby J, Revicki D et al. Patient-reported outcomes in randomized clinical trials : development of ISOQOL reporting standards. Qual Life Res 2013; 22: 1,161–1,175.
11.		Barker KL, Reilly KA, Minns Lowe C, Beard DJ. Patient satisfaction with accelerated discharge following unilateral knee replacement. Int J Ther Rehabil 2006; 13: 247–253.
12.		Mahomed N, Gandhi R, Daltroy L, Katz JN. The self-administered patient satisfaction scale for primary hip and knee arthroplasty. Arthritis 2011;
591253.
13.		Husted H, Holm G, Jacobsen S. Predictors of length of stay and patient satisfaction after hip and knee replacement surgery. Acta Orthop 2008; 79: 168–173.
14.		Husted H, Troelsen A, Otte KS et al. Fast-track surgery for bilateral total knee replacement. J Bone Joint Surg Br 2011; 93: 351–356.
15.		Larsen K, Hansen TB, Søballe K, Kehlet H. Patient-reported outcome after fast-track knee arthroplasty. Knee Surg Sports Traumatol Arthrosc 2012; 20: 1,128–1,135.
16.		Husted H, Hansen HC, Holm G et al. What determines length of stay after total hip and knee arthroplasty ? A nationwide study in Denmark. Arch Orthop Trauma Surg 2010; 130: 263–268.
17.		Husted H, Otte KS, Kristensen BB, Kehlet H. Fast-track revision knee arthroplasty. Acta Orthop 2011; 82: 438–440.
18.		Larsen K, Hansen TB, Søballe K, Kehlet H. Patient-reported outcome after fasttrack hip arthroplasty: a prospective cohort study. Health Qual Life Outcomes 2010; 30: 144.
19.		Hunt GR, Hall GM, Murthy BV et al. Early discharge following hip arthroplasty: patients’ acceptance masks doubts and concerns. Health Expect 2009; 12: 130–137.
20.		Hyrkäs K, Paunonen M, Laippala P. Patient satisfaction and research-related problems (part 1). Problems while using a questionnaire and the possibility to solve them by using different methods of analysis. J Nurs Manag 2000; 8: 227–236.
21.		Foot C, Fitzsimons B. The policy and practice of measuring patient experience. Nurs Manag 2011; 18: 18–19.
22.		Alviar MJ, Olver J, Brand C et al. Do patient-reported outcome measures used in assessing outcomes in rehabilitation after hip and knee arthroplasty capture issues relevant to patients? Results of a systematic review and ICF linking process. J Rehabil Med 2011; 43: 374–381
23.		Patrick DL, Burke LB, Gwaltney CJ et al. Content validity – establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: part 1 – eliciting concepts for a new PRO instrument. Value Health 2011; 14: 967–977.
24.		Prior ME, Hamzah JC, Francis JJ et al. Pre-validation methods for developing a patient reported outcome instrument. BMC Med Res Methodol 2011; 9: 112.
25.		Cano SJ, Hobart JC. The problem with health measurement. Patient Prefer Adherence 2011; 5: 279–290.

Retraction of unreliable publication
The Annals has taken the unusual and serious step of retraction of a paper published in May 20131 because serious doubt has been cast on the reliability of the report. After publication we were informed by the Hospital Director of a hospital in Dubai named as the research site that the first author had worked there for a short time but that his employment ceased before the stated end of recruitment to the study. The paper had five authors, all based in Italy, yet the Methods section described patient recruitment only in the City Hospital, Dubai.
The hospital pointed out several discrepancies between the report that we published and their records. These included that:
•		the author performed only 27 haemorrhoid operations at the hospital, yet the paper deals with a sample of 143 patients;
•		the paper states that approval was granted by the Ethics Committee before research began but the records show that no approval was granted by the Ethics Committee or by the hospital management to conduct any study at the hospital;
•		the report described telephone follow-up interviews with patients in 2012 although it was not standard practice to perform telephone follow-ups 40 months after operating. Furthermore, the authors did not have access to patient records from the City Hospital in 2012.
The Annals asked the authors to comment on all of these points. It transpired that approval from an Ethics Committee in Italy was obtained only after recruitment had ended. The authors have failed to provide a convincing description of how recruitment, randomisation and data collection continued after the departure of the first author and how the follow-up data were collected.
In view of the continued uncertainty about the origin and reliability of the data in this report we have withdrawn it and we have informed the relevant regulatory authorities
ColinJohnson, Editor-in-Chief
NeilMortensen, Chair of the Editorial Board
MikeParker, Immediate Past Chair of the Editorial Board and Editor of the Bulletin
Reference
1. Lucarelli P, Picchio M, Caporossi M et al. Transanal haemorrhoidal dearterialisation with mucopexy versus stapler haemorrhoidopexy: a randomised trial with longterm follow-up. Ann R Coll Surg Engl 2013; 95: 246–251.