Realist complex intervention science: Applying realist principles across all phases of the Medical Research Council framework for developing and evaluating complex interventions

Evaluation

Volumn 22, Issue 3, 2016, Pages 286-303

  Fletcher, Adam ^a   Jamal, Farah ^b   Moore, Graham ^a   Evans, Rhiannon E ^a   Murphy, Simon ^a   Bonell, Chris ^c  

^a CARDIFF UNIVERSITY   (United Kingdom)

^b UNIVERSITY OF LONDON   (United Kingdom)

^c LONDON SCHOOL OF HYGIENE AND TROPICAL MEDICINE   (United Kingdom)

Author keywords

Complex interventions; complex systems; evaluation; pilot trials; public health; randomised controlled trials; realism

Indexed keywords

EID: 84978498960     PISSN: 13563890     EISSN: 14617153     Source Type: Journal    
DOI: 10.1177/1356389016652743     Document Type: Article

References (74)

1. R.Anderson (2008) New MRC guidance on evaluating complex interventions. BMJ337(7676): 944–945.
2. M.ArainM.J.CampbellC.L.Cooper. (2010) What is a pilot or feasibility study? A review of current practice and editorial policy. BMC Medical Research Methodology10: 67.
3. A.AventinM.LohanP.O’Halloran. (2015) Design and development of a film-based intervention about teenage men and unintended pregnancy: Applying the Medical Research Council framework in practice. Evaluation and Program Planning49: 19–30.
4. L.K.BartholomewG.S.ParcelG.Kok. (2011) Planning Health Promotion Programs: An Intervention Mapping Approach. 3rd ed.San Francisco, CA: Jossey-Bass.
5. R.A.Bhaskar (2008) A Realist Theory of Science. London: Verso.
6. C.BonellL.AllenD.Christie. (2014) Initiating change locally in bullying and aggression through the school environment (INCLUSIVE): Study protocol for cluster randomised controlled trial. Trials15: 381.
7. C.BonellA.FletcherM.Morton. (2012) Realist randomised controlled trials: A new approach to evaluating complex public-health interventions. Social Science & Medicine75(12): 2299–2306.
8. C.BonellA.FletcherM.Morton. (2013a) Methods don’t make assumptions, researchers do: A response to Marchal et al. Social Science & Medicine94(1): 81–82.
9. C.BonellK.HindsK.Dickson. (2016) What is Positive Youth Development and how might it reduce substance use and violence? A systematic review and synthesis of theoretical literature. BMC Public Health16(1): 135.
10. C.BonellF.JamalA.Harden. (2013b) Systematic review of the effects of schools and school environment interventions on health: evidence mapping and synthesis. Public Health Research1(1).
11. C.BonellF.JamalG.J.Melendez-Torress. (2015) ‘Dark logic’: theorising the harmful consequences of public health interventions. Journal of Epidemiology and Community Health69(1): 95–98.
12. D.Byrne (2013) Evaluating complex social interventions in a complex world. Evaluation19(3): 217–228.
13. M.CampbellR.FitzpatrickA.Haines. (2000) Framework for design and evaluation of complex interventions to improve health. BMJ321: 694–696.
14. N.CartwrightJ.Hardie (2012) Evidence-Based Policy: A Practical Guide to Doing It Better. New York: Open University Press.
15. C.ChandlerD.DiLibertoN.S.Taaka. (2013) The PROCESS study: A protocol to evaluate the implementation, mechanisms of effect and context of an intervention to enhance public health centres in Tororo, Uganda. Implementation Science8: 113.
16. P.CraigM.Petticrew (2013) Developing and evaluating complex interventions: Reflections on the 2008 guidance. International Journal of Nursing Studies50(5): 585–587.
17. P.CraigP.DieppeS.Macintyre. (2008a) Developing and evaluating complex interventions: The new Medical Research Council guidance. BMJ337: a1655.
18. P.CraigP.DieppeS.Macintyre. (2008b) Developing and Evaluating Complex Interventions: New Guidance. London: MRC.
19. G.Davey SmithS.Ebrahim (2002) Data dredging, bias, or confounding. BMJ325(7378): 1437–1438.
20. M.De BruinW.ViechtbauerH.P.Schaalma. (2010) Standard care impact on effects of highly active antiretroviral therapy adherence interventions: A meta-analysis of randomized controlled trials. Archives of Internal Medicine170(3): 240–250.
21. M.De SilvaE.BreuerL.Lee. (2014) Theory of Change: A theory-driven approach to enhance the Medical Research Council’s framework for complex interventions. Trials15: 267.
22. R.EvansS.MurphyJ.Scourfield (2015b) Implementation of a school-based social and emotional learning intervention: understanding diffusion processes within complex systems. Prevention Science16(5): 754–764.
23. R.EvansJ.ScourfieldS.Murphy (2014) The unintended consequences of targeted interventions: Young people’s lived experiences of targeted social and emotional learning interventions. British Educational Research Journal41(3): 381–397.
24. R.EvansJ.ScourfieldS.Murphy (2015a) Pragmatic, formative process evaluations of complex interventions and why we need more of them. Journal of Epidemiology and Community Health69(10): 925–926.
25. A.FletcherN.Fitzgerald-YauM.Wiggins. (2015) Involving young people in changing their school environment to make it safer: Findings from a process evaluation in English secondary schools. Health Education115(3/4): 322–338.
26. R.GlasgowE.LichtensteinA.C.Marcus (2003) Why don’t we see more translation of health promotion research into practice? Rethinking the efficacy-to effectiveness transition. American Journal of Public Health93: 1261–1267.
27. F.GriffithsA.WildJ.Harvey. (2000) The productivity of primary care research networks. British Journal of General Practice50: 913–915.
28. J.HargreavesA.HatcherV.Strange. (2010) Group-microfinance and health promotion among the poor: Six-year process evaluation of the Intervention with Microfinance for AIDS and Gender Equity (IMAGE) in rural South Africa. Health Education Research25(1): 27–40.
29. P.Hawe (2015a) Lessons from complex interventions to improve health. Annual Review of Public Health36: 307–323.
30. P.Hawe (2015b) Minimal, negligible and negligent interventions. Social Science & Medicine138: 265–268.
31. P.HaweA.ShiellT.Riley (2004) Complex interventions: How “out of control” can a randomised controlled trial be?BMJ328: 1561–1563.
32. P.HaweA.ShiellT.Riley (2009) Theorising interventions as events in systems. American Journal of Community Psychology43(3–4): 267–276.
33. A.Hawkins (2014) The case for experimental design in realist evaluation. Learning Communities: International Journal of Learning in Social Contexts14: 46–59.
34. J.P.T.HigginsD.G.AltmanP.C.Gøtzsche. (2011) The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ343: d5928.
35. D.K.HumphreysM.P.Eisner (2014) Do flexible alcohol trading hours reduce violence? A theory-based natural experiment in alcohol policy. Social Science & Medicine102: 1–9.
36. F.JamalA.FletcherN.Shakleton. (2015) The three stages of building and testing mid-level theories in a Realist RCT: A theoretical and methodological case-example. Trials16: 466.
37. D.Kirby (2004) BDI Logic Models: A Useful Tool for Designing, Strengthening and Evaluating Programs to Reduce Adolescent Sexual Risk-Taking, Pregnancy, HIV and Other STDs. Scotts Valley, CA: ETR Associates.
38. G.A.Lancaster (2015) Pilot and feasibility studies come of age!Pilot and Feasibility Studies1: 1.
39. M.W.Lipsey (2009) The primary factors that characterize effective interventions with juvenile offenders: A meta-analytic overview. Victims and Offenders4: 124–147.
40. H.J.LittlecottG.MooreL.Moore. (2014) Psychosocial mediators of change in physical activity in the Welsh national exercise referral scheme: Secondary analysis of a randomised controlled trial. International Journal of Behavioral Nutrition and Physical Activity11: 109.
41. S.MacintyreM.Petticrew (2000) Good intentions and received wisdom are not enough. Journal of Epidemiology & Community Health54: 802–803.
42. B.MarchalG.WesthorpG.Wong. (2013) Realist RCTs of complex interventions - an oxymoron. Social Science & Medicine94: 124–128.
43. E.Mayo-WilsonS.GrantS.Hopewell. (2013) Developing a reporting guideline for social and psychological intervention trials. Trials14: 242.
44. R.K.Merton (1968) Social Theory and Social Structure. New York: Free Press.
45. S.MichieM.S.Van StralenR.West (2011) The behaviour change wheel: A new method for characterising and designing behaviour change interventions. Implementation Science6: 42.
46. G.MooreS.AudreyM.Barker. (2014) Process Evaluation of Complex Interventions: Medical Research Council guidance. MRC Population Health Science Research Network, London.
47. G.MooreS.AudreyM.Barker. (2015) Process evaluation of complex interventions: Medical Research Council guidance. BMJ350: h1258.
48. G.MooreL.MooreA.Russell. (2012) Integration of motivational interviewing into practice in the National Exercise Referral Scheme in Wales: A mixed methods study. Behavioural and Cognitive Psychotherapy40(3): 313–330.
49. G.MooreL.RaisanenL.Moore. (2013) Mixed-method process evaluation of the Welsh National Exercise Referral Scheme. Health Education113(6): 476–501.
50. S.MurphyR.Tudor EdwardsN.Williams. (2012) An evaluation of the effectiveness and cost effectiveness of the National Exercise Referral Scheme in Wales, UK: A randomised controlled trial of a public health policy initiative. Journal of Epidemiology and Community Health66: 1082.
51. D.Newbury-BirchS.ScottA.O’Donnell. (2014) A pilot feasibility cluster randomised controlled trial of screening and brief alcohol intervention to prevent hazardous drinking in young people aged 14 15 years in a high school setting (SIPS JR-HIGH). Public Health Research2(6).
52. D.Olds (2016) Building evidence to improve maternal and child health. The Lancet387 (10014): 105–107.
53. R.Pawson (2013) The Science of Evaluation: A Realist Manifesto. London: SAGE Publications.
54. R.PawsonN.Tilley (1997) Realistic Evaluation. London: SAGE Publications.
55. R.PawsonT.GreenhalghG.Harvey. (2005) Realist review – a new method of systematic review designed for complex policy interventions. Journal of Health Services Research and Policy10(suppl 1): 21–34.
56. M.PearsonS.L.BrandC.Quinn. (2015a) Using realist review to inform intervention development: Methodological illustration and conceptual platform for collaborative care in offender health. Implementation Science10: 134.
57. M.PearsonR.ChiltonK.Wyatt. (2015b) Implementing health promotion programmes in schools: A realist systematic review of research and experience in the United Kingdom. Implementation Science10: 149.
58. M.Petticrew (2015) Time to rethink the systematic review catechism? Moving from ‘what works’ to ‘what happens’. Systematic Reviews4(1): 36.
59. M.PetticrewE.RehfuessJ.Noyes. (2013) Synthesizing evidence on complex interventions: How meta-analytical, qualitative, and mixed-method approaches can contribute. Journal of Clinical Epidemiology66: 1230–1243.
60. M.PetticrewP.TugwellE.Kristjannsson. (2012) Damned if you do, damned if you don’t: Subgroup analysis and equity. Journal of Epidemiology and Community Health66: 95–98.
61. P.PronykJ.HargreavesJ.C.Kim. (2006) Effect of a structural intervention for the prevention of intimate-partner violence and HIV in rural South Africa: A cluster randomised trial. The Lancet368 (9551): 1973–1983.
62. C.C.RaginK.A.DrassS.Davey (2006) Fuzzy-Set/Qualitative Comparative Analysis 2.0. Tucson AZ: Department of Sociology, University of Arizona.
63. M.RoblingM.-J.BekkersK.Bell. (2016) Effectiveness of a nurse-led intensive home-visitation programme for first-time teenage mothers (Building Blocks): A pragmatic randomised controlled trial. The Lancet387(10014): 146–155.
64. A.ShiellP.HaweL.Gold (2008) Complex interventions or complex systems? Implications for health economic evaluation. BMJ336: 1281–1283.
65. K.E.SmithJ.CollinB.Hawkins. (2016) The pursuit of ignorance. BMJ352: i1446.
66. D.Stokols (2006) Toward a science of transdisciplinary action research. American Journal of Community Psychology38(1): 63–77.
67. J.ThomasA.O’Mara-EvesG.Brunton (2014) Using qualitative comparative analysis (QCA) in systematic reviews of complex interventions: A worked example. Systematic Reviews3: 67.
68. P.ThomasA.White (2001) Increasing research capacity and changing the culture of primary care towards reflective inquiring practice: The experience of the West London Research Network (WeLReN). Journal of Interprofessional Care15(2): 133–139.
69. C.H.Weiss (1995). Nothing as practical as good theory: Exploring theory-based evaluation for comprehensive community initiatives for children and families. In: (eds) New Approaches to Evaluating Community Initiatives: Concepts, Methods, and Contexts. Washington DC: Aspen Institute, pp. 65–92.
70. G.Westhorp (2012) Using complexity-consistent theory for evaluating complex systems. Evaluation18(4): 405–420.
71. G.Westhorp (2013) Developing complexity consistent theory in a realist investigation. Evaluation19(4): 364–382.
72. J.WhiteL.MooreR.Campbell. (2014) ASSIST+Frank protocol. Available at: http://www.nets.nihr.ac.uk/__data/assets/pdf_file/0017/116027/PRO-12–3060–03.pdf (accessed 24 May 2016).
73. M.Whitehead (2007) A typology of actions to tackle social inequalities in health. Journal of Epidemiology and Community Health61(6): 473–478.
74. G.WongT.GreenhalghG.Westhorp. (2013) RAMESES publication standards: Realist syntheses. BMC Medicine11: 21.