Realist randomised controlled trials: A new approach to evaluating complex public health interventions

Social Science and Medicine

Volumn 75, Issue 12, 2012, Pages 2299-2306

  Bonell, Chris ^a   Fletcher, Adam ^b   Morton, Matthew ^a   Lorenc, Theo ^b   Moore, Laurence ^c  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b LONDON SCHOOL OF HYGIENE AND TROPICAL MEDICINE   (United Kingdom)

^c CARDIFF UNIVERSITY   (United Kingdom)

Author keywords

Complex interventions; Evaluation; Generalizability; Public health; Randomized controlled trials; Realism; Social epidemiology; Social experiments

Indexed keywords

COMPLEXITY; EPIDEMIOLOGY; HEALTH CARE; PUBLIC HEALTH;

CLINICAL EFFECTIVENESS; CLINICAL EVALUATION; CLINICAL PRACTICE; EVIDENCE BASED MEDICINE; HEALTH CARE PLANNING; HEALTH CARE POLICY; HEALTH EDUCATION; HEALTH PROGRAM; PROGRAM DEVELOPMENT; PUBLIC HEALTH PROBLEM; PUBLIC HEALTH SERVICE; QUALITATIVE RESEARCH; QUANTITATIVE STUDY; RANDOMIZED CONTROLLED TRIAL (TOPIC); REVIEW;

HEALTH PROMOTION; HUMANS; PROGRAM EVALUATION; PUBLIC HEALTH; RANDOMIZED CONTROLLED TRIALS AS TOPIC;

EID: 84869499236     PISSN: 02779536     EISSN: 18735347     Source Type: Journal    
DOI: 10.1016/j.socscimed.2012.08.032     Document Type: Review

References (72)

1. Armstrong R., Waters E., et al. Improving the reporting of public health intervention research: advancing TREND and CONSORT. Journal of Public Health 2008, 30(1):103-109.
2. Barber J.P., Gallop R., et al. The role of therapist adherence, therapist competence and allowance in predicting outcome of individual drug counselling: results from the national institute drug abuse collaborative cocaine treatment study. Psychotherapy Research 2006, 16:229-240.
3. Baron R.M., Kenny D.A. The moderator-mediator variable distinction in social psychological research: conceptual, strategic and statistical considerations. Journal of Personality and Social Psychology 1986, 51:1173-1182.
4. Berrueta-Clement J., Schweinhart L., et al. Changed lives: The effects of the Perry Preschool Program on youths through age 19 1984, The High/Scope Press, Ypsilanti.
5. Bhaskar R.A. A realist theory of science 1975, Verso, London.
6. Blackwood B., O'Halloran P., et al. On the problems of mixing RCTs with qualitative research: the case of the MRC framework for the evaluation of complex healthcare interventions. Journal of Research in Nursing 2010, 15(6):511-521.
7. Blakely C., Mayer J.P., et al. The fidelity-adaptation debate: implications for the implementation of public sector social programs. American Community Psychology 1987, 15:253-268.
8. Bonell C., Bennett R., Oakley A. Sexual health interventions should be subject to experimental evaluation. Effective sexual health interventions: Issues in experimental evaluation 2003, Oxford University Press, Oxford. J. Stephenson, J. Imrie, C. Bonell (Eds.).
9. Bonell C., Hargreaves J., et al. Alternatives to randomisation in the evaluation of public-health interventions: design challenges and solutions. Journal of Epidemiology and Community Health 2011, 65(7):582-587.
10. Bonell C., Oakley A., et al. Trials of health interventions and empirical assessment of generalizability: suggested framework and systematic review. British Medical Journal 2006, 333:346-349.
11. Bonell C., Sorhaindo A., et al. Pilot multi-method trial of a school-ethos intervention to reduce substance use: building hypotheses about upstream pathways to prevention. Journal of Adolescent Health 2010, 47(6):555-563.
12. Botvin G.J., Baker E., et al. Long-term follow-up results of a randomized drug abuse prevention trial in a white middle-class population. Journal of the American Medical Association 1995, 273(14):1106-1112.
13. Box G.E.P. Evolutionary operation: a method for increasing industrial productivity. Applied Statistics 1958, 6:81-101.
14. Breitenstein S.M., Gross D., et al. Implementation fidelity in community-based interventions. Research in Nursing & Health 2010, 33:164-173.
15. Campbell R., Starkey F., et al. An informal school-based peer-led intervention for smoking prevention in adolescence (ASSIST): a cluster randomised trial. The Lancet 2008, 371:1595-1602.
16. Catalano R.F., Berglund L.M., et al. Positive youth development in the United States: research findings on evaluations of positive youth development programs. Prevention & Treatment 2002, 5(1):1-166.
17. Center for the Study and Prevention of Violence Retrieved 20.12.11, from. http://www.colorado.edu/cspv/blueprints/.
18. Connell J.P., Kubisch A.C. Applying a theory of change approach to the evaluation of comprehensive community initiatives: Progress, prospects, and problems 1998, The Aspen Institute, Washington DC.
19. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth U, Petticrew M. Developing and evaluating complex interventions: new guidance. London: Medical Research Council, 2008.
20. Craig P., Dieppe P., et al. Developing and evaluating complex interventions: the new Medical Research Council guidance. British Medical Journal 2008, 337:a1655.
21. Dane U.A., Schneider B.H. Program integrity in primary and early secondary prevention: are implementation effects out of control?. Clinical Psychology Review 1998, 18(1):23-45.
22. Dangour A., Albala C., et al. A factorial-design cluster randomised controlled trial investigating the cost-effectiveness of a nutrition supplement and an exercise programme on pneumonia incidence, walking capacity and body mass index in older people living in Santiago, Chile: the CENEX study protocol. Nutrition Journal 2007, 6:14.
23. Dishion T.J., McCord J., et al. When interventions harm. American Psychologist 1999, 54(9):755-764.
24. Durlack J.A. Why intervention implementation is important. Journal of Prevention and Intervention in the Community 1998, 17(2):5-18.
25. Durlak J.A., Dupre E.P. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology 2008, 41:327-350.
26. Eccles J.S., Templeton J. Community based programs for youth: lessons learned from general development research and from experimental and quasi-experimental evaluations. Urban health initiative seminar series 2001, Harvard University, Cambridge.
27. Fagan A., Hanson K., et al. Bridging science to practice: achieving prevention program implementation fidelity in the community youth development study. American Journal of Community Psychology 2008, 41(3):235-249.
28. Farrington D.P., Ttofi M.M. School-based programs to reduce bullying and victimization. Campbell Systematic Reviews 2010, 6:1-147.
29. Flay B.R., Graumlich S., et al. Effects of 2 prevention programs on high-risk behaviors among African American youth: a randomized trial. Archives of Pediatric and Adolescent Medicine 2004, 158(4):377-384.
30. Fletcher A., Bonell C., et al. School effects on young people's drug use: a systematic review of intervention and observational studies. Journal of Adolescent Health 2008, 42(3):209-220.
31. Gardner F., Burton J., et al. Randomised controlled trial of a parenting intervention in the voluntary sector for reducing child conduct problems: outcomes and mechanisms of change. Journal of Child Psychology and Psychiatry 2006, 47(11):1123-1132.
32. Glasgow R.E., Klesges L.M., et al. Evaluating the overall impact of health promotion programs: using the RE-AIM framework for decision making and to consider complex issues. Health Education Research 2006, 21(3):688-694.
33. Green J., Tones K. Towards a secure evidence base for health promotion. Journal of Public Health Medicine 1999, 21:133-139.
34. Harden A., Brunton G., et al. Teenage pregnancy and social disadvantage: a systematic review integrating trials and qualitative studies. British Medical Journal 2009, 339:b4254.
35. Hargreaves J.R., Bonell C.P., et al. Systematic review exploring time-trends in the association between educational attainment and risk of HIV infection in sub-Saharan Africa. AIDS 2008, 22(3):403-414.
36. Hargreaves J., Hatcher A., et al. Process evaluation of the Intervention with Microfinance for AIDS and Gender Equity (IMAGE) in rural South Africa. Health Education Research 2009, 25(1):27-40.
37. Hawe P., Shiell A., et al. Complex interventions: how " out of control" can a randomised controlled trial be?. British Medical Journal 2004, 328:1561-1563.
38. Hawe P., Shiell A., et al. Methods for exploring implementation variation and local context within a cluster randomised community intervention trial. Journal of Epidemiology and Community Health 2004, 58(9):788-793.
39. Heaven B., Murtagh M., et al. Patients or research subjects? A qualitative study of participation in a randomised controlled trial of a complex intervention. Patient Education and Counseling 2006, 62(2):260-270.
40. Hill L., Maucione K., et al. A focused approach to assessing program fidelity. Prevention Science 2007, 8(1):25-34.
41. Kazi M. Realist evaluation for practice. British Journal of Social Work 2003, 33(6):803-818.
42. Kemple J., Willner C.J. Career academies: Long-term impacts on labor market outcomes, educational attainment, and transitions to adulthood 2008, MDRC, New York.
43. Kessler R., Glasgow R.E. A proposal to speed translation of healthcare research into practice: dramatic change is needed. American Journal of Preventive Medicine 2011, 40(6):637-644.
44. Kirby D. Emerging answers 2007: Research findings on programs to reduce teen pregnancy and sexually transmitted diseases 2007, The National Campaign to Prevent Teen and Unplanned Pregnancy, Washington DC.
45. Kirby D.B., Rhodes T., et al. Implementation of multi-component youth programs to prevent teen pregnancy modelled after the Children's AID Society-Carrera Program 2005, ETR Associates, Scotts Valley.
46. Lipsey M.W. The primary factors that characterize effective interventions with juvenile offenders: a meta-analytic overview. Victims and Offenders 2009, 4:124-147.
47. MacKinon D.P., Lockwood C.M., et al. A comparison of methods to test mediation and other intervening variable effects. Psychological Methods 2002, 7:83-104.
48. Main C., Thomas S., et al. Population tobacco control interventions and their effects on socialinequalities in smoking: placing an equity lens on existing systematic reviews. BMC Public Health 2008, 8:178.
49. McLaughlin M. Community counts: How youth organizations matter for youth 2000, Public Education Network, Washington DC.
50. Medical Research Council A framework for the development and evaluation of randomised controlled trials for complex interventions to improve health 2000, Medical Research Council, London.
51. Montgomery A.A., Peters T.J., et al. Design, analysis and presentation of factorial randomised controlled trials. BMC Medical Research Methodology 2003, 3:26.
52. Moore L., Tapper K. The impact of school fruit tuck shops and school food policies on children's fruit consumption: a cluster randomised trial of schools in deprived areas. Journal of Epidemiology and Community Health 2008, 62(10):926-931.
53. Morton M.H., Montgomery P. Empowerment-based non-formal education for Arab youth: a pilot randomized trial. Children and Youth Services Review 2012, 34(2):417-425.
54. Murphy S., Moore G.F., et al. Free healthy breakfasts in primary schools: a cluster randomised controlled trial of a policy intervention in Wales. Public Health Nutrition 2011, 19(4):362-374.
55. National Institute for Health and Clinical Excellence School-based interventions to prevent smoking (quick reference guide) 2010, NICE, London.
56. Oakley A. Experiments in knowing: Gender and method in the social sciences 2000, Polity, Cambridge.
57. Oakley A., Strange V., et al. Integrating process evaluation in the design of randomised controlled trials of complex interventions: the example of the RIPPLE Study. British Medical Journal 2006, 332:413-416.
58. Palinkas L.A., Aarons G., et al. Mixed method designs in implementation research. Administration and Policy in Mental Health 2010, 38:44-53.
59. Patton M.Q. Qualitative research & evaluation methods 2002, Sage, Thousand Oaks. 3 ed.
60. Pawson R., Tilley N. Realistic evaluation 1997, Sage, London.
61. Philliber S., Kaye J.W., Herrling S. The National Evaluation of the Children's Aid Society Carrera Model Program to Prevent Teen Pregnancy 2001, Philliber Research Associations, New York.
62. Philliber S., Kaye J.W., et al. Preventing pregnancy and improving health care access among teenagers: an evaluation of the Children's Aid Society-Carrera Program. Perspectives on Sexual and Reproductive Health 2002, 34(5):244-251.
63. Pronyk P.M., Hargreaves J.R., et al. Effect of a structural intervention for the prevention of intimate-partner violence and HIV in rural South Africa: a cluster randomised trial. The Lancet 2006, 368(9551):1973-1983.
64. Rogers E.M. Diffusion of innovations 1962, The Free Press, New York.
65. Schaeffer C.M., Borduin C.M. Long-term follow-up to a randomized clinical trial of multisystemic therapy with serious and violent juvenile offenders. Journal of Consulting and Clinical Psychology 2005, 73(3):445-453.
66. Sherman L. Policing domestic violence 1992, Free Press, New York.
67. Starkey F., Audrey S., et al. Identifying influential young people to undertake effective peer-led health promotion: the example of A Stop Smoking In Schools Trial (ASSIST). Health Education Research 2009, 24(6):977-988.
68. Strange V., Forrest S., et al. What influences peer-led sex education in the classroom? A view from the peer educators. Health Education Research 2002, 17(3):339-349.
69. Tilley N. Understanding car parks, crime and CCTV: Evaluation lessons from safer cities, crime prevention unit series paper 42 1993, Home Office, London.
70. Weiss C.H. Nothing as practical as good theory: exploring theory-based evaluation for comprehensive community initiatives for children and families. New approaches to evaluating community initiatives: Concepts, methods, and contexts 1995, Aspen Institute, Washington DC. J.P. Connell, A.C. Kubisch, L.B. S., C.H. Weiss (Eds.).
71. Wiggins M., Bonell C., et al. Health outcomes of youth development programme in England: prospective matched comparison study. British Medical Journal 2009, 339:b2534.
72. Winkleby M.A., Feighery E., et al. Effects of an advocacy intervention to reduce smoking among teenagers. Archives of Pediatric and Adolescent Medicine 2004, 158(3):269-275.