Lessons from complex interventions to improve health

Annual Review of Public Health

Volumn 36, Issue , 2015, Pages 307-323

  Hawe, Penelope ^a,b  

^a UNIVERSITY OF SYDNEY   (Australia)

^b Australian Prevention Partnership Center   (Australia)

Author keywords

Complexity; Evaluation; Implementation; Improvement science; Intervention research; Intervention theory; Metaphor

Indexed keywords

ARTICLE; BEHAVIOR CHANGE; COMPLEX INTERVENTION; ECONOMIC EVALUATION; EVIDENCE BASED PRACTICE; HEALTH PROMOTION; HISTORY OF MEDICINE; HUMAN; INTERVENTION THEORY; LOGIC; LOGIC MODEL; MEDICAL DECISION MAKING; MODEL; PRACTICE GUIDELINE; PRIORITY JOURNAL; PROBLEM SOLVING; PROPHYLAXIS; PUBLIC HEALTH; STANDARDIZATION; THEORY; TOTAL QUALITY MANAGEMENT; COST BENEFIT ANALYSIS; ORGANIZATION AND MANAGEMENT; PREVENTIVE MEDICINE; PROCEDURES; PROGRAM EVALUATION; RISK REDUCTION; STANDARDS;

COST-BENEFIT ANALYSIS; HEALTH PROMOTION; HUMANS; PREVENTIVE MEDICINE; PROGRAM EVALUATION; RISK REDUCTION BEHAVIOR;

EID: 84925232959     PISSN: 01637525     EISSN: 15452093     Source Type: Book Series    
DOI: 10.1146/annurev-publhealth-031912-114421     Document Type: Article

References (132)

1. Abraham C, Michie S. 2008. A taxonomy of behavior change techniques used in interventions. Health Psychol. 27:379-87
2. Adamic L. 2011. Complex systems: unzipping Zipf 's law. Nature 474(7350):164-65
3. Albrecht L, Archibald M, Arseneau D, Scott SD. 2013. Development of a checklist to assess the quality of porting of knowledge translation interventions using the Work Group for Intervention Development and Evaluation Research (WIDER) recommendations. Implement. Sci. 8:52
4. Anderson LM, Petticrew M, Rehfuess E, Armstrong R, Ueffing E, et al. 2011. Using logic models to capture complexity in systematic reviews. Res. Synth. Methods 2:33-42
5. Anderson R. 2008. New MRC guidelines on evaluating complex interventions. BMJ 337:a1937
6. Arai L, Roen K, Roberts H, Popay J. 2005. It might work in Oklahoma but will it work in Oakhampton?Context and implementation in the effectiveness literature on domestic smoke detectors. Inj. Prev. 11:148-51
7. Ashley SR. 2009. Innovation diffusion: implications for evaluation. New Dir. Eval. 124:35-45
8. Axelrod R, Cohen MD. 2000. Harnessing Complexity. New York: Basic Books
9. Barnes M, Matka E, Sullivan H. 2003. Evidence, understanding and complexity: evaluation in non-linear systems. Evaluation 9:265-84
10. Batalden P, Bate P, Webb D, McLoughlin V. 2011. Planning and leading amultidisciplinary colloquium to explore the epistemology of improvement. BMJ Qual. Saf. 20(Suppl. 1):i1-4
11. Bartholomew LK, Parcel GS, Kok G. 1998. Intervention mapping: a process for developing theory- and evidence-based health education programs. Health Educ. Behav. 25:545-63
12. Bauman LJ, Stein REK, Ireys HT. 1991. Reinventing fidelity: the transfer of social technology among settings. Am. J. Community Psychol. 19:619-39
13. Berkman LF, Breslow L. 1983. Health andWays of Living: The Alameda County Study. New York: Oxford Univ. Press
14. Birkeland S, Murphy-Graham E, Weiss CH. 2005. Good reasons for ignoring good evaluation: the case of the drug abuse resistance education (DARE) program. Eval. Progr. Plan. 28(3):247-56
15. Bisset S, Potvin L, Daniel M. 2013. The adaptive nature of implementation practice: case study of a school based nutrition education intervention. Eval. Progr. Plan. 39:10-18
16. Blake SC, Ottoson JM. 2009. Knowledge utilization: implications for evaluation. New Dir. Eval. 124:21-34
17. Bonell C, Fletcher A, Jamal F, Wells H, Harden A, et al. 2013. Theories of how the school environment impacts on student health: systematic review and synthesis. Health Place 24:242-49
18. Bonell C, Fletcher A, Morton M, Lorenc T, Moore L. 2012. Realist randomised controlled trials: a new approach to evaluating complex public health interventions. Soc. Sci. Med. 75:2299-306
19. Bonell C, Fletcher A, Morton M, Lorenc T, Moore L. 2013. Methods don't make assumptions, people do: a response to Marchal et al. Soc. Sci. Med. 94:81-82
20. Bourdieu P. 1991. The peculiar history of scientific reason. Sociol. Forum 6:3-25
21. Burton C. 2012. Heavy tailed distributions of effect sizes in systematic reviews of complex interventions. PLOS ONE 7(3):e34222
22. Byng R, Norman I, Redfern S, Jones R. 2008. Exposing the key functions of a complex intervention for shared care in mental health: a case study of a process evaluation. BMC Health Serv. Res. 8:274
23. CallonM. 1986. Some elements of a sociology of translation: domestication of the scallops and fishermen ofSt. BrieucBay. In Power, Action and Belief: A New Sociology of Knowledge, ed. JLaw, pp. 196-233. London: Routledge
24. Campbell C, Nair Y, Maimane S. 2007. Building contexts that support effective community responses to HIV/AIDS: a South African case study. Am. J. Community Psychol. 39:347-63
25. Chalabi Z, Lorenc T. 2013. Reducing agent-based models to inform evaluation of complex interventions. Examples from the built environment. Prev. Med. 57:434-35
26. Christens BD, Hanlin CE, Speer PW. 2007. Getting the social organism thinking: strategy for systems change. Am. J. Community Psychol. 39:229-38
27. CIHR (Can. Inst. Health Res.) IRSC (Inst. Popul. Public Health). 2010. Stimulating Methodological and Theoretical Innovation in Population Health Intervention Research. Workshop Summary Report. Toronto: CIHR. http://www.cihr-irsc.gc.ca/e/documents/ipph-workshop-sum-report-2010-e.pdf
28. COMMIT Res. Group. 1995. Community intervention trial for smoking cessation (COMMIT): I. Cohort results from a four-year community intervention. Am. J. Public Health 85:183-92
29. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. 2008. Developing and evaluating complex interventions: the new Medical Research Council Guidance. BMJ 337:979-83
30. Cronbach LJ. 1982. Toward Reform of Program Evaluation. San Francisco: Jossey-Bass
31. Datta J, Petticrew M. 2013. Challenges to evaluating complex interventions: a content analysis of published papers. BMC Public Health 13:568
32. Davies R. 2004. Scale, complexity and the representation of theories of change. Part 1. Evaluation 10:101-21
33. Davies R. 2005. Scale, complexity and the representation of theories of change. Part 2. Evaluation 11:133-39
34. Davison CM. 2009. Knowledge translation: implications for evaluation. New Dir. Eval. 124:75-87
35. Dawber TR. 1980. The Framingham Study. Cambridge, MA: Harvard Univ. Press
36. DeGroff A, Cargo M. 2009. Policy implementation implications for evaluation. New Dir. Eval. 124:47-60
37. Dep. Clin. Epidemiol. Biostat., McMaster Univ. 1981. How to read the clinical journals: IV. To determine the etiology or causation. Can. Med. Assoc. J. 124:985-90
38. Dignan MB, Carr PA. 1987. Program Planning for Health Education and Health Promotion. Philadelphia: Lea & Febiger
39. Di Ruggerio E, Rose A, Gaudreau K. 2009. Canadian Institutes of HealthResearch support for population health intervention research in Canada. Can. J. Public Health 100:i15-19
40. Douthwaite B, Delve R, Ekboir J, Twomlow S. 2003. Contending with complexity: the role of evaluation in implementing sustainable natural resource management. Int. J. Agric. Sustain. 1:51-66
41. Egolf B, Lasker J, Wolf S, Potvin L. 1992. The Roseto effect: a 50 year comparison of mortality rates. Am. J. Public Health 82:1089-92
42. Fisher EB. 1995. Editorial: the results of the COMMIT trial. Am. J. Public Health 85:159-60
43. Flay BR. 1986. Efficacy and effectiveness trials (and other phases of research) in the development of health promotion programs. Prev. Med. 15:451-74
44. Ford JK. 2007. Building capability throughout change effort: leading the transformation of a police agency to community policing. Am. J. Community Psychol. 39:321-34
45. Foster-Fishman PG, Behrens TR. 2007. Systems change reborn: rethinking our theories, methods and efforts in human services reform and community based change. Am. J. Community Psychol. 39:191-96
46. Foster-Fishman PG, Nowell B, Yang H. 2007. Putting the system back into systems change: a framework for understanding and changing organisational and community systems. Am. J. Community Psychol. 39:197-215
47. Fullan M. 1993. Change Forces: Probing the Depths of Educational Reform. London: Farmer Press
48. Fuller S. 1997. Obituary; Thomas S. Kuhn 18 July 1922-17 June 1996. Confessions of a recovering Kuhnian. Soc. Stud. Sci. 27:492-94
49. Funnell SC, Rogers PJ. 2011. Purposeful Program Theory. Effective Use of Theories of Change and Logic Models. San Francisco: Jossey-Bass/Wiley
50. Gal I, Prigat A. 2005. Why organizations continue to create patient information leaflets with readability and usability problems: an exploratory study. Health Educ. Res. 20:485-93
51. Glasgow RE, Vogt TM, Boles SM. 1999. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am. J. Public Health 89:1322-27
52. Goodman RM, Speers MA, McLeroy K, Fawcett S, Kegler M, et al. 1998. Identifying and defining the dimensions of community capacity to provide a basis for measurement. Health Educ. Behav. 25:258-78
53. Green LW. 2001. From research to "best practices" in other settings and populations. Am. J. Health Behav. 25(3):165-78
54. Green LW. 2006. Public health asks of systems science: To advance our evidence-based practice, can you help us get more practice-based evidence? Am. J. Public Health 96:406-9
55. Green LW, Glasgow RE. 2007. A focus on external validity. Eval. Health Prof. 30:115-17
56. Green LW, Kreuter MW, Deeds SG, Partridge KB. 1980. Health Education Planning: A Diagnostic Approach. Palo Alto, CA: Mayfield
57. Green LW, Wilson AL, Lovato CY. 1986. What changes can health promotion achieve and how long do these changes last? The trade-offs between expediency and durability. Prev. Med. 15:508-21
58. Greenhalgh T, Hinder S, Stamer K, Bratan T, Russell J. 2010. Adoption, non-adoption, and abandonment of a personal electronic health record: case study of HealthSpace. BMJ 341:c5814
59. Greenhalgh T, Robert G, MacFarlane F, Bate P, Kyriakidou O. 2004. Diffusion of innovation in service organization: systematic review and recommendations. Milbank Q. 82:581-629
60. Greenhalgh T, Russell J, Ashcroft RE, Parsons W. 2011. Why national eHealth programs need dead philosophers: Wittgensteinian reflections on policymakers' reluctance to learn from history. Millbank Q. 89:533-63
61. Greenhalgh T, Stones R. 2010. Theorising big IT programs in health care: strong structuration theory meets actor network theory. Soc. Sci. Med. 70:1285-94
62. Haines V, Godley J, Hawe P. 2011 Understanding interdisciplinary collaborations as social networks. Am. J. Community Psychol. 47(1):1-11
63. Hancock L, Sanson-Fisher R, Perkins J, Girgis A, Howley P, Schofield M. 2001. The effect of a community action intervention on adolescent smoking rates in rule Australian towns: the CART project. Prev. Med. 32:332-40
64. Hawe P. 1994. Capturing the meaning of 'community' in community intervention evaluation: some contributions from community psychology. Health Promot. Int. 9:199-210
65. Hawe P, Bond L, Butler H. 2009. Knowledge theories can inform evaluation practice. What can a complexity lens add? New Dir. Eval. 124:89-100
66. Hawe P, Riley T. 2005. Ecological theory in practice: illustrations from a community-based intervention to promote the health of recent mothers. Prev. Sci. 6:227-36
67. Hawe P, Shiell A, Riley T. 2004. Complex interventions: how far 'out of control' should a randomised controlled trial be? BMJ 328:1561-63
68. Hawe P, Shiell A, RileyT. 2009. Theorising interventions as events in systems. Am. J. Community Psychol. 43:267-76
69. Homer J, Milstein B. 2004. Optimal decision-making in dynamic model of community health. Proc. 37th Annu. Hawaii Int. Conf. Syst. Sci., Waikoloa, Hawaii. http://www.computer.org/csdl/proceedings/hicss/2004/2056/03/205630085a.pdf
70. Iversen DC. 1986. Forum: the health promotion sciences and chronic disease prevention. The scientific base of health promotion. Prev. Med. 15:439-41
71. Jan S, Ferrari G, Watts C, Hargreaves J, Kim J, et al. 2011. Economic evaluation of a combined microfinance and gender training intervention for the prevention of intimate partner violence rural South Africa. Health Policy Plan. 26:366-72
72. Khoury MJ, Gwinn M, Ioannidis JPA. 2010.The emergence of translational epidemiology: from scientific discovery to population health impact. Am. J. Epidemiol. 172:517-24
73. Lalonde M. 1974. A New Perspective on the Health of Canadians: A Working Document. Ottawa: Health &Welf.
74. Lanham HJ, Leykum LK, Taylor BS, McCannon JC, Lindberg C, Lester RT. 2013. How complexity science can inform scale up and spread in health care: understanding the role of self organisation variation across local context. Soc. Sci. Med. 93:194-202
75. Leventhal H, Safer MA, Cleary PD, Gutmann M. 1980. Cardiovascular risk reduction for lifestyle change: comments on the Stanford study. J. Consult. Clin. Psychol. 48:150-58
76. Leykum LK, Pugh J, Lawrence V, Parchman M, Noel PH, et al. 2007. Organizational interventions employing principles of complexity science have improved outcomes for patients with Type II diabetes. Implement. Sci. 2:28
77. Lindberg C, Clancy TR. 2010. Managing organisational complexity. Positive deviance: an elegant solution to a complex problem. J. Nurs. Adm. 40:150-53
78. Ling T. 2012. Evaluating complex and unfolding interventions in real time. Evaluation 18:79-91
79. Lynch JJ. 1977. The Broken Heart. The Medical Consequences of Loneliness. New York: Basic Books
80. Macintyre S. 2010. Good intentions and received wisdom are not good enough: the need for controlled trials in public health. J. Epidemiol. Community Health 65:564-67
81. Marchal B, Westhorp G, Wong G, Van Belle S, Greenhalgh T, et al. 2013. Realist RCTs of complex interventions: an oxymoron. Soc. Sci. Med. 94:124-28
82. May C. 2006. A rational model for assessing and evaluating complex interventions in health care. BMC Health Serv. Res. 6:86
83. May C. 2013. Agency and implementation: understanding the embedding of healthcare innovations in practice. Soc. Sci. Med. 78:26-33
84. May C. 2013. Towards a general theory of implementation. Implement. Sci. 8:18
85. May C, Murray E, Finch T, Mair F, Treweek S, et al. 2010. Normalization process theory on-line users' manual and toolkit. Access. Sept. 1, 2014. http://www.normalizationprocess.org
86. McLeroy K. 2006. Thinking of systems. Am. J. Public Health 96(3):402
87. Miller RL, Shinn M. 2005. Learning from communities: overcoming difficulties in dissemination of prevention and promotion efforts. Am. J. Community Psychol. 35(3/4):169-83
88. Mold M, Berridge V. 2013. The history of health promotion. In Health Promotion Theory, ed. L Cragg, M Davies, W Macdowall, pp. 3-19. Berkshire, UK: Oxford Univ. Press. 2nd ed.
89. Moore G, Audrey A, Barker M, Bond L, Bonell C, et al. 2014. Process evaluation in complex public health intervention studies: the need for guidance. J. Epidemiol. Community Health 68:101-2
90. Mrazek PJ, Haggerty RJ, eds. 1994. Reducing Risks For Mental Disorders: Frontiers For Preventive Intervention Research.Washington, DC: Natl. Acad. Press
91. MRC (Med. Res. Counc.). 2000. A Framework for the Development and Evaluation of RCTs for Complex Interventions to Improve Health. London: MRC
92. Nelson EC, Batalden PB, Godfrey MM, Lazar JS, eds. 2011. Value by Design: Developing Clinical Microsystems to Achieve Organizational Excellence. San Francisco: Jossey-Bass
93. Nutbeam D, Bauman A. 2006. Evaluation in a Nutshell: A Practical Guide to the Evaluation of Health Promotion Programs. Sydney: McGraw-Hill
94. Oliver ML. 2009. The transfer process: implications for evaluation. New Dir. Eval. 124:61-73
95. Osenga K. 2013. The Internet is not a super highway: using metaphors to communicate information and communications policy. J. Inf. Policy 3:30-54
96. Ottoson JM. 2009. Knowledge for action theories in evaluation: knowledge utilization, diffusion, implementation, transfer, and translation. New Dir. Eval. 124:7-20
97. Ottoson JM, Green LW. 1987. Reconciling concept and context: theory of implementation. Adv. Health Educ. Promot. 2:353-82
98. Ottoson JM, Hawe P. 2009. Editors' notes. Knowledge utilization, diffusion, implementation, transfer, and translation: implications for evaluation. New Dir. Eval. 124:1-108
99. Øvretveit J, Leviton L, Parry G. 2011. Increasing the generalisability of improvement research with an improvement replication program. BMJ Qual. Saf. 20(Suppl. 1):i87-91
100. Paina L, Peters DH. 2011. Understanding pathways for scaling up health services through the lens of complex adaptive systems. Health Policy Plan. 1:1-9
101. Patton GC, Bond L, Carlin JB, Thomas L, Butler H, et al. 2006. Promoting social inclusion in schools: a group randomized trial of effects on student risk behaviors. Am. J. Public Health 96:1582-88
102. Patton MQ. 1994. Developmental evaluation. Am. J. Eval. 15:311-19
103. Pawson R. 2006. Simple principles for the evaluation of complex programs. In Public Health Evidence: Tackling Health Inequalities, ed. A Killoran, C Swann, M Kelly, pp. 223-38. New York: Oxford Univ. Press
104. Pawson R. 2013. The Science of Evaluation: A Realist Manifesto. New York: Sage
105. Peterson AV Jr, Kealey KA, Mann SL, Marek PM, Sarason IG. 2000. Hutchinson Smoking Prevention Project: long-term randomized trial in school-based tobacco use prevention - results on smoking. J. Natl. Cancer Inst. 92:1979-91
106. Petticrew M. 2011. When are complex interventions complex? When are simple interventions simple?Eur. J. Public Health 21:397-99
107. Pluye P, Potvin L, Denis J-L. 2004. Making public health programs last: conceptualizing sustainability. Eval. Progr. Plan. 27:121-33
108. Pluye P, Potvin L, Denis J-L, Pelletier J, Mannoni C. 2005. Program sustainability begins with the first events. Eval. Progr. Plan. 28:123-37
109. Pronyk PM, Hargreaves JR, Kim JC, Morison LA, Phetla G, et al. 2006. Effect of a structural intervention for the prevention of intimate-partner violence andHIV in rural South Africa: a cluster randomised trial. Lancet 368:1973-83
110. Rickles D, Shiell A, Hawe P. 2007. A simple guide to chaos and complexity. J. Epidemiol. Community Health 61:933-37
111. Riley T, Hawe P. 2005. Researching practice: the methodological case for narrative inquiry. Health Educ. Res. 20:226-36
112. Riley T, Hawe P. 2009. A typology of practice narratives within a preventive, community intervention trial. Implement. Sci. 4:80
113. Riley T, Hawe P, Shiell A. 2005. Contested ground: How should qualitative evidence inform the conduct of a community intervention trial? J. Health Serv. Res. Policy 10:103-10
114. Rogers PJ. 2000. Causal models in program theory evaluation. New Dir. Eval. 87:47-55
115. Rogers PJ. 2008. Using programme theory to evaluate complicated and complex aspects of interventions. Evaluation 14:29-48
116. Rosenstock IM. 1974. The historical origins of the health belief model. Health Educ. Monogr. 2:328
117. Sanson-Fisher RW, D'Este CA, Carey ML, Noble N, Paul CL. 2014. Evaluation of systems oriented public health interventions: alternative research designs. Annu. Rev. Public Health 35:9-27
118. Sfard A. 1998. On two metaphors for learning and the danger of choosing just one. Educ. Res. 27:4-13
119. Shiell A, Hawe P. 1996. Health promotion, community development and the tyranny of individualism. Health Econ. 5:241-47
120. Shiell A, Hawe P, Gold L. 2008. Complex interventions or complex systems? Implications for health economic evaluation. BMJ 336:1281-83
121. Shiell A, Hawe P, Riley T, Gold L. 2005. Ecological evaluation of complex community interventions: theory, method and controversy. Proc. 18th World Conf. Int. Union Health Promot. Educ., April 2004, Melbourne, Aust.
122. Stame N. 2004. Theory-based evaluation and types of complexity. Evaluation 10:58-76
123. Suarez-Balcazar Y, Redmond L, Kouba J, Hellwig M, Davis R, et al. 2007. Introducing systems change in the schools: the case of school luncheons and vending machines. Am. J. Community Psychol. 39:335-45
124. Susser M. 1995. The tribulations of trials. Am. J. Public Health 85:156-58
125. Syme SL. 1986. Strategies for health promotion. Prev. Med. 15:492-507
126. Thompson B, Coronado G, Snipes SA, Pueschel K. 2003. Methodological advances and ongoing challenges in the design of community-based health promotion programs. Annu. Rev. Public Health 24:315-40
127. Trickett EJ. 1984. Towards a distinctive community psychology: an ecological metaphor for the conduct of community research and training. Am. J. Community Psychol. 12:261-79
128. Trickett EJ, Beehler S, Deutsch C, Green LW, Hawe P, et al. 2011. Advancing the science of community level interventions. Am. J. Public Health 101:1410-19
129. Trickett EJ, Ryerson Espino S, Hawe P. 2011. How are community interventions conceptualized and conducted? An analysis of published accounts. J. Community Psychol. 39(5):576-91
130. Trickett EJ, Watts RJ, Birman D, eds. 1994. Human Diversity: Perspectives on People in Context. San Francisco: Jossey-Bass
131. U.S. Dep. Health, Educ. Welf. 1979. Healthy People: The Surgeon General's Report on Health Promotion and Disease Prevention. Washington, DC: U.S. GPO
132. Wandersman A. 2003. Community science: bridging the gap between science and practice with community centered models. Am. J. Community Psychol. 31:227-42