Large scale organisational intervention to improve patient safety in four UK hospitals: mixed method evaluation

Article English OPEN
Benning, A. ; Ghaleb, M. ; Suokas, A. ; Dixon-Woods, M. ; Dawson, J. ; Barber, N. ; Franklin, B. D. ; Girling, A. ; Hemming, K. ; Carmalt, M. ; Rudge, G. ; Naicker, T. ; Nwulu, U. ; Choudhury, S. ; Lilford, R. (2011)
  • Publisher: BMJ Publishing Group Ltd.
  • Journal: The BMJ, volume 342 (issn: 0959-8138, eissn: 1756-1833)
  • Related identifiers: doi: 10.1136/bmj.d195, pmc: PMC3033440
  • Subject: Medicines Regulation | Adverse events; health-care; quality improvement; end-points; framework; epistemology; design; management; performance; excellence | Medical Error/ Patient Safety | RT | RA0421 | Patients | Epidemiologic Studies | Pneumonia (Respiratory Medicine) | Research

Objectives To conduct an independent evaluation of the first phase of the Health Foundation’s Safer Patients Initiative (SPI), and to identify the net additional effect of SPI and any differences in changes in participating and non-participating NHS hospitals.\ud \ud Design Mixed method evaluation involving five substudies, before and after design.\ud \ud Setting NHS hospitals in the United Kingdom.\ud \ud Participants Four hospitals (one in each country in the UK) participating in the first phase of the SPI (SPI1); 18 control hospitals.\ud \ud Intervention The SPI1 was a compound (multi-component) organisational intervention delivered over 18 months that focused on improving the reliability of specific frontline care processes in designated clinical specialties and promoting organisational and cultural change.\ud \ud Results Senior staff members were knowledgeable and enthusiastic about SPI1. There was a small (0.08 points on a 5 point scale) but significant (P<0.01) effect in favour of the SPI1 hospitals in one of 11 dimensions of the staff questionnaire (organisational climate). Qualitative evidence showed only modest penetration of SPI1 at medical ward level. Although SPI1 was designed to engage staff from the bottom up, it did not usually feel like this to those working on the wards, and questions about legitimacy of some aspects of SPI1 were raised. Of the five components to identify patients at risk of deterioration—monitoring of vital signs (14 items); routine tests (three items); evidence based standards specific to certain diseases (three items); prescribing errors (multiple items from the British National Formulary); and medical history taking (11 items)—there was little net difference between control and SPI1 hospitals, except in relation to quality of monitoring of acute medical patients, which improved on average over time across all hospitals. Recording of respiratory rate increased to a greater degree in SPI1 than in control hospitals; in the second six hours after admission recording increased from 40% (93) to 69% (165) in control hospitals and from 37% (141) to 78% (296) in SPI1 hospitals (odds ratio for “difference in difference” 2.1, 99% confidence interval 1.0 to 4.3; P=0.008). Use of a formal scoring system for patients with pneumonia also increased over time (from 2% (102) to 23% (111) in control hospitals and from 2% (170) to 9% (189) in SPI1 hospitals), which favoured controls and was not significant (0.3, 0.02 to 3.4; P=0.173). There were no improvements in the proportion of prescription errors and no effects that could be attributed to SPI1 in non-targeted generic areas (such as enhanced safety culture). On some measures, the lack of effect could be because compliance was already high at baseline (such as use of steroids in over 85% of cases where indicated), but even when there was more room for improvement (such as in quality of medical history taking), there was no significant additional net effect of SPI1. There were no changes over time or between control and SPI1 hospitals in errors or rates of adverse events in patients in medical wards. Mortality increased from 11% (27) to 16% (39) among controls and decreased from 17% (63) to 13% (49) among SPI1 hospitals, but the risk adjusted difference was not significant (0.5, 0.2 to 1.4; P=0.085). Poor care was a contributing factor in four of the 178 deaths identified by review of case notes. The survey of patients showed no significant differences apart from an increase in perception of cleanliness in favour of SPI1 hospitals.\ud \ud Conclusions The introduction of SPI1 was associated with improvements in one of the types of clinical process studied (monitoring of vital signs) and one measure of staff perceptions of organisational climate. There was no additional effect of SPI1 on other targeted issues nor on other measures of generic organisational strengthening.
  • References (52)
    52 references, page 1 of 6

    a sa co fo rg d o no re is d v n a r a l le a ro g b f in fe tx s il e o - t t rk n ” o co s w e ye f “ o m d ty so re li w au ive e q g sn ( a s to o re y . hw cso rveu n itco tsn ive ts e e f rs s nd se if s 4 r 2 o in s rr ilirtssaahw2223 trtceeaudm lllfryeahum itsoonuhm iirvsenoup iirvsenoup itt/seanpm tsonh12m ‡itrvsyeeuunoq lltrtrcseeauuppd itrvsseonouh12m iillrtrskgeonnuw iitttsseeeannodp iirrvssseeeanpm ljirrtrykeeaonud tsonh2m lrrtrtssskeeeaod tsonh2m ililfrycvcseeaoon iiitrvvsseeanoup 52iltttveeeanono S W p W W n W 1 W 1 Ph lre In

    1 Department of Health Expert Group. An organisation with a memory. Stationery Office, 2000.

    2 Kohn L, Corrigan J, Donaldson M. To err is human: building a safer health system. National Academies Press, 2000.

    3 Leape LL, Berwick DM. Five years after to err is human: what have we learned? JAMA 2005;293:2384-90.

    4 Hutter B. Regulation and risk: occupational health and safety on the railways. Oxford University Press, 2001.

    5 Macrae C. Learning from patient safety incidents: creating participative risk regulation in healthcare. Health Risk Soc 2008;10:53-67.

    6 Benning A, Ghaleb M, Suokas A, Dixon-Woods M, Dawson JF, Barber N, et al. Mixed-method evaluation of a large-scale organisational intervention to improve patient safety in four UK hospitals. 2010. EvalSPI.shtml.

    7 Deming WE. Out of the crisis. MIT Press, 2000.

    8 Dixon-Woods M, Tarrant C, Willars J, Suokas A. How will it work? A qualitative study of strategic stakeholders' accounts of a patient safety initiative. Qual Saf Health Care 2010;19:74-8.

    9 Varkey P, Reller MK, Resar RK. Basics of quality improvement in health care. Mayo Clin Proc 2007;82:735-9.

  • Metrics
    No metrics available
Share - Bookmark