New approaches to evaluating complex health and care systems

BMJ (Online)

Volumn 352, Issue , 2016, Pages

  Lamont, Tara ^a   Barber, Nicholas ^b   De Pury, John ^c   Fulop, Naomi ^d   Garfield Birkbeck, Stephanie ^a   Lilford, Richard ^e   Mear, Liz ^f   Raine, Rosalind ^d   Fitzpatrick, Ray ^g  

^a UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

^b Health Foundation   (United Kingdom)

^c Universities UK   (United Kingdom)

^d UNIVERSITY COLLEGE LONDON   (United Kingdom)

^e UNIVERSITY OF WARWICK   (United Kingdom)

^f University of Warwick ^*  (United Kingdom)

^g UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; AWARENESS; CLINICAL DECISION MAKING; CLINICAL EVALUATION; COST EFFECTIVENESS ANALYSIS; HEALTH CARE COST; HEALTH CARE SYSTEM; HUMAN; MEDICAL RESEARCH; NATIONAL HEALTH SERVICE; OUTCOME ASSESSMENT; PATIENT SATISFACTION; PRIORITY JOURNAL; TOTAL QUALITY MANAGEMENT; GREAT BRITAIN; HEALTH CARE DELIVERY; INTERDISCIPLINARY COMMUNICATION; METHODOLOGY; ORGANIZATION AND MANAGEMENT; PUBLIC HEALTH; STANDARDS;

BIOMEDICAL RESEARCH; DELIVERY OF HEALTH CARE; GREAT BRITAIN; HUMANS; INTERDISCIPLINARY COMMUNICATION; NATIONAL HEALTH PROGRAMS; RESEARCH DESIGN;

EID: 84960192188     PISSN: 09598146     EISSN: 17561833     Source Type: Journal    
DOI: 10.1136/bmj.i154     Document Type: Article

References (50)

1. Health and Social Care Information Centre. National diabetes audit 2012-13.Report 1: Care processes and treatment targets. 2014. www.hscic.gov.uk/catalogue/PUB14970/nati-diab-audi-12-13-care-proc-rep.pdf.
2. Ahmed J, Khan S, Lim M, Chandrasekaran TV, MacFie J. Enhanced recovery after surgery protocols-compliance and variations in practice during routine colorectal surgery. Colorectal Dis 2012;14:1045-51.
3. Roland M, Abel G. Reducing emergency admissions: Are we on the right track? BMJ 2012;345:e6017.
4. Raine R, Fitzpatrick R, eds. Challenges, solutions, and future directions in the evaluation of service innovations in health care and public health. Health Serv Deliv Res (forthcoming).
5. NHS. Five year forward view. Oct 2014. www.england.nhs.uk/wp-content/uploads/2014/10/5yfv-web.pdf.
6. Campbell M, Fitzpatrick R, Haines A, et al. Framework for the design and evaluation of complex interventions to improve health. BMJ 2000;321:694-6.
7. Craig P, Dieppe P, Macintyre S, et al. Developing and evaluating complex interventions: The new Medical Research Council guidance. BMJ 2008;337:a1655.
8. Moore G, Audrey S, Barker M et al. Process evaluation of complex interventions: Medical Research Council guidance. MRC Population Health Science Research Network, 2014. www.ioe.ac.uk/MRC-PHSRN-Process-evaluation-guidance-final(2).pdf.
9. Fulop N, Lamont T. Why the NHS must evaluate complex service changes. Health Serv J 2015 Sep 2. www.hsj.co.uk/comment/why-the-nhs-must-evaluate-complex-servicechanges/5089761.article?blocktitle=Comment&contentID=8791.
10. Bardsley M, Steventon A, Smith J, Dixon J. Evaluating integrated and community-based care. Jun 2013. www.nuffieldtrust.org.uk/sites/files/nuffield/publication/evaluation- summary-final.pdf.
11. Nolte E, Pitchforth E. What is the evidence on the economic impacts of integrated care. 2014. www.euro.who.int/-data/assets/pdf-file/0019/251434/What-is-the-evidence-onthe-economic-impacts-of-integrated-care.pdf.
12. Craig P, Cooper C, Gunnell D, et al. Using natural experiments to evaluate population health interventions: New Medical Research Council guidance. J Epidemiol Community Health 2012;66:1182-6.
13. Peckham S, Sanderson M, Entwistle V, et al. A comparative study of the construction and implementation of patient choice policies in the UK. Aug 2011. www.netscc.ac.uk/hsdr/files/project/SDO-FR-08-1718-147-V01.pdf.
14. O'Cathain A, Murphy E, Nicholl J. Three techniques for integrating data in mixed methods studies. BMJ 2010;341:c4587.
15. Pawson R, Tilley N. Realistic evaluation. Sage, 1997.
16. Greenhalgh T, Wong G, Jagosh J, et al. Protocol-the RAMESES II study: Developing guidance and reporting standards for realist evaluation. BMJ Open 2015;5:e008567.
17. McDaniel RR, Lanham HJ, Anderson RA. Implications of complex adaptive systems theory for the design of research on health care organizations. Health Care Manage Rev 2009;34:191-9.
18. Brown CA, Lilford RJ. The stepped wedge trial design: A systematic review. BMC Med Res Methodol 2006;6:54.
19. Thorpe KE, Zwarenstein M, Oxman AD, et al. A pragmatic-explanatory continuum indicator summary (PRECIS): A tool to help trial designers. J Clin Epidemiol 2009;62;464-75.
20. Davies A, Ariti C, Georghiou T, Bardsley M. Evaluation of complex health and care interventions using retrospective matched control methods. Nuffield Trust, 2015. http://www.nuffieldtrust.org.uk/sites/files/nuffield/publication/evaluation-report-final-0.pdf.
21. Austin PC. An introduction to propensity score methods for reducing the effects of confounding in observational studies. Multivariate Behav Res 2011;46:399-424.
22. May C. A rational model for assessing and evaluating complex interventions in health care. BMC Health Serv Res 2006;6:86.
23. Fitzpatrick R, Boulton M. Qualitative methods for assessing health care. Qual Health Care 1994;3:107-13.
24. Fulop N, Protopsaltis G, King A, Allen P, Hutchings A, Normand C. Changing organisations: A study of the context and processes of mergers of health care providers in England. Soc Sci Med 2005;60:119-30.
25. Baxter SK, Blank L, Woods HB, Payne N, Rimmer M, Goyder E. Using logic model methods in systematic review synthesis: Describing complex pathways in referral management interventions. BMC Med Res Methodol 2014;14:62.
26. Lewis G, Vaithianathan R, Wright L, et al. Integrating care for high-risk patients in England using the virtual ward model: Lessons in the process of care integration from three case sites. Int J Integr Care 2013;13:e046.
27. The Health Foundation. Context for successful quality improvement. Oct 2015. www. health.org.uk/sites/default/files/ContextForSuccessfulQualityImprovement.pdf.
28. Brocklehurst P, Hardy P, Hollowell J, et al. Perinatal and maternal outcomes by planned place of birth for healthy women with low risk pregnancies: The Birthplace in England national prospective cohort study. BMJ 2011;343:d7400.
29. National Institute for Health and Care Excellence. Intrapartum care: Care for healthy women and their babies. Dec 2014. www.nice.org.uk/guidance/cg190.
30. Hutchings HA, Evans BA, Fitzsimmons D, et al. Predictive risk stratification model: A progressive cluster-randomised trial in chronic conditions management (PRISMATIC) research protocol. Trials 2013;14;301.
31. Marshall T, Caley M, Hemming K, Gill P, Gale N, Kolly K. Mixed methods evaluation of targeted case finding for cardiovascular disease prevention using a stepped wedge cluster RCT. BMC Public Health 2012:;12:908.
32. Beard E, Lewis JJ, Copas A, et al. Stepped wedge randomised controlled trials: Systematic review of studies published between 2010 and 2014. Trials 2015;16:353.
33. Wardle J, Von Wagner C, Kralj Hans I, et al. Effects of evidence-based strategies to reduce the socioeconomic gradient of uptake in the English NHS Bowel Cancer Screening Programme (ASCEND): Four cluster-randomised controlled trials. Lancet 2015 Dec 8. [Epub ahead of print.] doi:10.1016/S0140-6736(15)01154-X.
34. Lilford RJ, Chilton PJ, Hemming K, Girling AJ, Taylor CA, Barach P. Evaluating policy and service interventions: A framework to guide selection and interpretation of study end points. BMJ 2010,341:c4413.
35. Benning A, Dixon-Woods M, Nwulu U, et al. Multiple component patient safety intervention in English hospitals: Controlled evaluation of second phase. BMJ 2011;342:d199.
36. Sheringham JR, Georghiou T, Chitnis XA, Bardsley M. Comparing primary and secondary health-care use between diagnostic routes before a colorectal cancer diagnosis: Cohort study using linked data. Br J Cancer 2014;111:1490-9.
37. Steventon A, Tunkel S, Blunt I, Bardsley M. Effect of telephone health coaching (Birmingham OwnHealth) on hospital use and associated costs: Cohort study with matched controls BMJ 2013;347:f4585.
38. Steventon A, Bardsley M, Billings J, Georghiou T, Lewis GH. The role of matched controls in building an evidence base for hospital?avoidance schemes: A retrospective evaluation. Health Serv Res 2012;47:1679-98.
39. Buxton MJ. Problems in the appraisal of new health technology: The evaluation of heart transplants in the UK. In: Drummond MF, ed. Economic appraisal of health technology in the European Community. Oxford Medical Publications, 1987.
40. Greenhalgh T, Humphrey C, Hughes J, Macfarlane F, Butler C, Pawson R. How do you modernize a health service? A realist evaluation of whole-scale transformation in London. Milbank Q 2009;87:391-416.
41. Kristensen SR, Meacock R, Turner AJ, et al. Long-term effect of hospital pay for performance on mortality in England. N Engl J Med 2014;371:540-8.
42. Jagosh J, Macaulay AC, Pluye P, et al. Uncovering the benefits of participatory research: Implications of a realist review for health research and practice. Milbank Q 2012;90:311-46.
43. National Institute for Health Research. Collaborations for leadership in applied health research and care (CLAHRCs). www.nihr.ac.uk/about/collaborations-for-leadership-inapplied-health-research-and-care.htm.
44. NHS England. Academic health science networks. www.england.nhs.uk/ourwork/part-rel/ahsn/.
45. Lilford RJ, Foster J, Pringle M. Evaluating eHealth: How to make evaluation more methodologically robust. PLoS Med 2009;6:e1000186.
46. Morris S, Hunter RM, Ramsay AI, et al. Impact of centralising acute stroke services in English metropolitan areas on mortality and length of hospital stay: Difference-in-differences analysis. BMJ 2014;349:g4757.
47. Girling A, Young T, Brown C, Lilford R. Early-stage valuation of medical devices: The role of developmental uncertainty. Value Health 2010;13:585-91.
48. Dopson S, Fitzgerald L. Knowledge to action? Evidence-based health care in context. Oxford University Press, 2005.
49. Drew S, Judge A, May C, et al. Implementation of secondary fracture prevention services after hip fracture: A qualitative study using extended Normalization Process Theory. Implementat Sci 2015;10:57.
50. Grimshaw JM, Shirran L, Thomas R, et al. Changing provider behavior: An overview of systematic reviews of interventions. Med Care 2001;39(suppl 2):II2-45.