Applying systems thinking to knowledge mobilisation in public health

Health Research Policy and Systems

Volumn 18, Issue 1, 2020, Pages

  Haynes, Abby ^a,b,c   Rychetnik, Lucie ^a,c,d   Finegood, Diane ^e   Irving, Michelle ^a,b   Freebairn, Louise ^a,f   Hawe, Penelope ^a,b,g  

^a The Australian Prevention Partnership Centre   (Australia)

^b University of Sydney   (Australia)

^c UNIVERSITY OF SYDNEY   (Australia)

^d UNIVERSITY OF NOTRE DAME   (Australia)

^e SIMON FRASER UNIVERSITY   (Canada)

^f ACT Government Health Directorate   (Australia)

^g UNIVERSITY OF CALGARY   (Canada)

Author keywords

Knowledge mobilisation; Policy making; Public health; Systems thinking

Indexed keywords

EMPIRICISM; HUMAN; HUMAN EXPERIMENT; LEARNING; MANAGEMENT; NOTE; PUBLIC HEALTH; THINKING; HEALTH CARE DELIVERY; KNOWLEDGE; SYSTEM ANALYSIS;

DELIVERY OF HEALTH CARE; HUMANS; KNOWLEDGE; LEARNING; PUBLIC HEALTH; SYSTEMS ANALYSIS;

EID: 85096101985     PISSN: None     EISSN: 14784505     Source Type: Journal    
DOI: 10.1186/s12961-020-00600-1     Document Type: Note

References (211)

1. Social Sciences and Humanities Research Council, Framing our direction 2010-2012. Strategic plan., 2008, Government of Canada: Ottowa. Available from: http://www.sshrc-crsh.gc.ca/about-au_sujet/publications/FramingOurDirection_2010-12_final_e.pdf.
2. Ward V. Why, whose, what and how? A framework for knowledge mobilisers. Evid Policy. 2016;13:477–97. DOI: 10.1332/174426416X14634763278725
3. Davies HT, Powell AE, Nutley SM. Mobilising knowledge to improve UK health care: learning from other countries and other sectors–a multimethod mapping study. Health Serv Deliv Res. 2015;3.
4. Nutley S, Davies H. Knowledge mobilisation: creating, sharing and using knowledge. In: Orr K, Nutley S, Russell S, Bain R, Hacking B, Moran C, editors. Knowledge and Practice in Business and Organisations. London: Routledge; 2016.
5. Head B, Alford J: Wicked problems: the implications for public management. In Presentation to panel on public management in practice, International Research Society for Public Management 12th Annual Conference; 26-28 March; Brisbane 2008: 26-28.
6. Lindblom CE. The science of "muddling through". Public Adm Rev. 1959:79–88.
7. Jones H. Taking responsibility for complexity: How implementation can achieve results in the face of complex problems. In: Working Paper 330. London: Overseas Development Insititute; 2011.
8. Begun JW, Zimmerman B, Dooley K. In: Mick S, Wyttenbach M, editors. Health care organizations as complex adaptive systems. In Advances in health care organization theory, vol. 253. San Francisco: Jossey-Bass; 2003. p. 253–88.
9. Sweeney K, Griffiths F. Complexity and healthcare: an introduction. Oxford: Radcliffe; 2002.
10. Sterman JD. Learning from evidence in a complex world. Am J Public Health. 2006;96:505–14. DOI: 10.2105/AJPH.2005.066043
11. Lanham HJ, Leykum LK, Taylor BS, McCannon CJ, Lindberg C, Lester RT. How complexity science can inform scale-up and spread in health care: understanding the role of self-organization in variation across local contexts. Soc Sci Med. 2013;93:194–202. DOI: 10.1016/j.socscimed.2012.05.040
12. Garside R, Pearson M, Hunt H, Moxham T, Anderson R: Preventing obesity using a ‘whole system’ approach at local and community level: PDG1. A report commissioned by NICE Centre for Public Health Excellence. Peninsula Technology Assessment Group (PenTAG), Peninsula Medical School, Universities of Exeter and Plymouth NICE Centre for Public Health Excellence 2010.
13. Plsek PE, Greenhalgh T. The challenge of complexity in health care. BMJ. 2001;323:625. DOI: 10.1136/bmj.323.7313.625
14. de Savigny D, Taghreed A. Systems thinking for health systems strengthening. Alliance for Health Policy and Systems Research: World Health Organization; 2009.
15. Kickbusch I, Gleicher D. Governance for health in the 21st century: World Health Organization; 2012.
16. Best A, Holmes B. Systems thinking, knowledge and action: towards better models and methods. Evid Policy. 2010;6:145–59. DOI: 10.1332/174426410X502284
17. Cherney A, Head B. Supporting the knowledge-to-action process: a systems-thinking approach. Evid Policy. 2011;7:471–88. DOI: 10.1332/174426411X603461
18. OECD, Applications of Complexity Science for Public Policy: New tools for finding unanticipated consequences and unrealized opportunities, Global Science Forum Workshop 5-7 Oct 2008, 2009: Ettore Majorana International Centre for Scientific Culture, Erice, Sicily Available from: http://www.oecd.org/science/sci-tech/43891980.pdf.
19. Sanderson I. Complexity, 'practical rationality' and evidence-based policy making. Policy Polit. 2006;34:115–32. DOI: 10.1332/030557306775212188
20. Holmes BJ, Best A, Davies H, Hunter D, Kelly MP, Marshall M, Rycroft-Malone J. Mobilising knowledge in complex health systems: a call to action. Evid Policy. 2017;13:539–60. DOI: 10.1332/174426416X14712553750311
21. Finegood D, Holmes B. Practical strategies to mobilise knowledge in complex systems. Sydney: The Australian Prevention Partnership Centre; 2017. Available from: https://www.youtube.com/watch?v=klkZBkw7eiA&feature=youtu.be. Accessed: 5 Jun 2019.
22. Smith KE, Joyce KE. Capturing complex realities: understanding efforts to achieve evidence-based policy and practice in public health. Evid Policy. 2012;8:57–78. DOI: 10.1332/174426412X6201371
23. Luke DA, Stamatakis KA. Systems science methods in public health: dynamics, networks, and agents. Annu Rev Public Health. 2012;33:357–76. DOI: 10.1146/annurev-publhealth-031210-101222
24. Leischow SJ, Best A, Trochim WM, Clark PI, Gallagher RS, Marcus SE, Matthews E. Systems thinking to improve the public’s health. Am J Prev Med. 2008;35:S196–203. DOI: 10.1016/j.amepre.2008.05.014
25. Willis CD, Mitton C, Gordon J, Best A. System tools for system change. BMJ Qual Saf. 2012;21:250–62. DOI: 10.1136/bmjqs-2011-000482
26. Mabry PL, Olster DH, Morgan GD, Abrams DB. Interdisciplinarity and systems science to improve population health: a view from the NIH Office of Behavioral and Social Sciences Research. Am J Prev Med. 2008;35:S211–24. DOI: 10.1016/j.amepre.2008.05.018
27. Weber EP, Khademian AM. Wicked Problems, Knowledge Challenges, and Collaborative Capacity Builders in Network Settings. Public Adm Rev. 2008;68:334–49. DOI: 10.1111/j.1540-6210.2007.00866.x
28. Beckett K, Farr M, Kothari A, Wye L, le May A. Embracing complexity and uncertainty to create impact: exploring the processes and transformative potential of co-produced research through development of a social impact model. Health Res Policy Syst. 2018;16:118. DOI: 10.1186/s12961-018-0375-0
29. Hawe P. Lessons from complex interventions to improve health. Annu Rev Public Health. 2015;36:307–23. DOI: 10.1146/annurev-publhealth-031912-114421
30. Green LW, Ottoson JM, Garcia C, Hiatt RA. Diffusion Theory and Knowledge Dissemination, Utilization, and Integration in Public Health. Annu Rev Public Health. 2009;30:151–74. DOI: 10.1146/annurev.publhealth.031308.100049
31. Murphy K, Wolfus B, Lofters A. From complex problems to complex problem-solving: transdisciplinary practice as knowledge translation. In: Kirst M, Schaefer-McDaniel N, Hwang S, O'Campo P, editors. Converging disciplines: a transdisciplinary research approach to urban health problems: Springer; 2011. p. 111–29.
32. Meadows D. Thinking in systems: a primer. London: Chelsea Green; 2008.
33. Swinburn BA, Kraak VI, Allender S, Atkins VJ, Baker PI, Bogard JR, Brinsden H, Calvillo A, De Schutter O, Devarajan R, et al. The Global Syndemic of Obesity, Undernutrition, and Climate Change: The Lancet Commission report. Lancet. 2019; Available from.
34. Sawin E. The magic of 'multisolving': six principles and practices to unlock cross-sectoral collaboration. In: Stanford Social Innovation Review; 2018.
35. Sawin E, McCauley S, Edberg S, Mwaura G, Gutierrez MJ, Multisolving at the intersection of health and climate: lessons from success stories, 2018, Climate Interactive. Available from: https://img.climateinteractive.org/wp-content/uploads/2018/02/Multisolving-at-the-Intersection-of-Health-and-Climate-1.pdf.
36. Markides C. Crossing the Chasm: How to Convert Relevant Research Into Managerially Useful Research. J Appl Behav Sci. 2010;47:121–34. DOI: 10.1177/0021886310388162
37. Cairney P, Oliver K. If scientists want to influence policymaking, they need to understand it: The Guardian Guardian Media Group; 2016.
38. Bowen SJ, Graham ID. From Knowledge Translation to Engaged Scholarship: Promoting Research Relevance and Utilization. Arch Phys Med Rehabil. 2013;94:S3–8. DOI: 10.1016/j.apmr.2012.04.037
39. Norman CD, Charnaw-Burger J, Yip AL, Saad S, Lombardo C. Designing health innovation networks using complexity science and systems thinking: the CoNEKTR model. J Eval Clin Pract. 2010;16:1016–23. DOI: 10.1111/j.1365-2753.2010.01534.x
40. Wilson A, Wutzke S, Overs M. The Australian Prevention Partnership Centre: systems thinking to prevent lifestyle-related chronic illness. Public Health Res Pract. 2014;25:e2511401. DOI: 10.17061/phrp2511401
41. Bammer G. Key issues in co-creation with stakeholders when research problems are complex. Evid Policy. 2019.
42. Fitzgerald L, Harvey G. Translational networks in healthcare? Evidence on the design and initiation of organizational networks for knowledge mobilization. Soc Sci Med. 2015;138:192–200. DOI: 10.1016/j.socscimed.2015.06.015
43. Equal Measure | Harder+Company, Cultivating systems leadership in cross-sector partnerships: lessons from the linked learning regional hubs of excellence, 2017, James Irvine Foundation. Available from: http://www.equalmeasure.org/wp-content/uploads/2017/08/Systems-Leadership-Issue-Brief-081017-FINAL.pdf.
44. Davidson Knight A, Lowe T, Brossard M, Wilson J. A whole new world: funding in complexity: Collaborate, Newcastle University; 2017. Available from: https://marcusjenal.wordpress.com/2017/05/17/a-whole-new-world-funding-in-complexity/.
45. Kania J, Kramer M, Senge P, The water of systems change, 2018, FSG. Available from: www.fsg.org/publications/water_of_systems_change?utm_source=newsletter&utm_medium=email&utm_content=Read%20the%20article&utm_campaign=20180604waterofsystemschangeall.
46. Walton M. Expert views on applying complexity theory in evaluation: opportunities and barriers. Evaluation. 2016;22:410–23. DOI: 10.1177/1356389016667890
47. Malhi L, Karanfil Ö, Merth T, Acheson M, Palmer A, Finegood DT. Places to intervene to make complex food systems more healthy, green, fair, and affordable. J Hunger Environ Nutr. 2009;4:466–76. DOI: 10.1080/19320240903346448
48. Johnston LM, Matteson CL, Finegood DT. Systems science and obesity policy: a novel framework for analyzing and rethinking population-level planning. Am J Public Health. 2014;104:1270–8. DOI: 10.2105/AJPH.2014.301884
49. Reynolds M, Holwell S: Introducing systems approaches. In Systems approaches to managing change: a practical guide. Edited by Reynolds M, Holwell S. Milton Keynes: Springer; 2010: 1-23.
50. Midgley G. Systemic intervention for public health. Am J Public Health. 2006;96:466–72. DOI: 10.2105/AJPH.2005.067660
51. Armitage D, Berkes F, Dale A, Kocho-Schellenberg E, Patton E. Co-management and the co-production of knowledge: Learning to adapt in Canada's Arctic. Glob Environ Chang. 2011;21:995–1004. DOI: 10.1016/j.gloenvcha.2011.04.006
52. Sherriff SL, Miller H, Williamson A, Tong A, Muthayya S, Redman S, Bailey S, Eades S, Haynes A. Building trust and sharing power for co-creation in Aboriginal health research: a stakeholder interview study. Evid Policy. 2019.
53. Hernandez A, Ruano AL, Marchal B, San Sebastian M, Flores W. Engaging with complexity to improve the health of indigenous people: a call for the use of systems thinking to tackle health inequity. Int J Equity Health. 2017;16.
54. Abercrombie R, Boswell K, Thomasoo R. Thinking big: how to use theory of change for systems change. UK: Lankelly Chase Foundation; 2018.
55. Holmes BJ, Noel K. Time to shift from systems thinking-talking to systems thinking-action: Comment on" Constraints to applying systems thinking concepts in health systems: A regional perspective from surveying stakeholders in Eastern Mediterranean countries". Int J Health Policy Manag. 2015;4:245. DOI: 10.15171/ijhpm.2015.38
56. Best A, Terpstra JL, Moor G, Riley B, Norman CD, Glasgow RE. Building knowledge integration systems for evidence-informed decisions. J Health Organ Manag. 2009;23:627–41. DOI: 10.1108/14777260911001644
57. Datta A, Shaxson L, Pellini A. Capacity, complexity and consulting. In: Lessons from managing capacity development projects. London: Overseas Development Institute; 2012.
58. Zurcher KA, Jensen J, Mansfield A. Using a Systems Approach to Achieve Impact and Sustain Results. Health Promot Pract. 2018;19:15S–23S. DOI: 10.1177/1524839918784299
59. Gates EF. Making sense of the emerging conversation in evaluation about systems thinking and complexity science. Eval Program Plann. 2016;59:62–73. DOI: 10.1016/j.evalprogplan.2016.08.004
60. Egan M, McGill E, Penney T, de Cuevas RA, Er V, Orton L, White M, Lock K, Cummins S, Savona N. What to consider when planning a systems evaluation. Guidance on Systems Approaches to Local Public Health Evaluation. Part 2: National Institute for Health Research School for Public Health Research; 2019. Available from.
61. Sturgiss E, Luig T, Campbell-Scherer DL, Lewanczuk R, Green LA. Using Concept Maps to compare obesity knowledge between policy makers and primary care researchers in Canada. BMC Res Notes. 2019;12:23. DOI: 10.1186/s13104-018-4042-x
62. Freebairn L, Rychetnik L, Atkinson J-A, Kelly P, McDonnell G, Roberts N, Whittall C, Redman S. Knowledge mobilisation for policy development: implementing systems approaches through participatory dynamic simulation modelling. Health Res Policy Syst. 2017;15:83. DOI: 10.1186/s12961-017-0245-1
63. Freebairn L, Atkinson J-A, Osgood ND, Kelly PM, McDonnell G, Rychetnik L. Turning conceptual systems maps into dynamic simulation models: An Australian case study for diabetes in pregnancy. PLoS One. 2019;14:e0218875. DOI: 10.1371/journal.pone.0218875
64. Hawe P, Shiell A, Riley T. Theorising interventions as events in systems. Am J Community Psychol. 2009;43:267–76. DOI: 10.1007/s10464-009-9229-9
65. Langeveld K, Stronks K, Harting J. Use of a knowledge broker to establish healthy public policies in a city district: a developmental evaluation. BMC Public Health. 2016;16:271. DOI: 10.1186/s12889-016-2832-4
66. Langlois EV, Becerril Montekio V, Young T, Song K, Alcalde-Rabanal J, Tran N. Enhancing evidence informed policymaking in complex health systems: lessons from multi-site collaborative approaches. Health Res Policy Syst. 2016;14:20. DOI: 10.1186/s12961-016-0089-0
67. Harvey G. The many meanings of evidence: implications for the translational science agenda in healthcare. Int J Health Policy Manag. 2013;1:187–8. DOI: 10.15171/ijhpm.2013.34
68. McCormack B, Rycroft-Malone J, DeCorby K, Hutchinson AM, Bucknall T, Kent B, Schultz A, Snelgrove-Clarke E, Stetler C, Titler M, et al. A realist review of interventions and strategies to promote evidence-informed healthcare: a focus on change agency. Implement Sci. 2013;8:107. DOI: 10.1186/1748-5908-8-107
69. Evans S, Scarbrough H. Supporting knowledge translation through collaborative translational research initiatives: ‘Bridging’ versus ‘blurring’ boundary-spanning approaches in the UK CLAHRC initiative. Soc Sci Med. 2014;106:119–27. DOI: 10.1016/j.socscimed.2014.01.025
70. Bruce A, O'Callaghan K. Inside out: knowledge brokering by short-term policy placements. Evid Policy. 2016;12:363–80. DOI: 10.1332/174426416X14688669171927
71. Kitson AL. The need for systems change: reflections on knowledge translation and organizational change. J Adv Nurs. 2009;65:217–28. DOI: 10.1111/j.1365-2648.2008.04864.x
72. Cassidy CE, Burgess S, Graham ID. It’s All About the IKT Approach: Three Perspectives on an Embedded Research Fellowship; Comment on “CIHR Health System Impact Fellows: Reflections on ‘Driving Change’ Within the Health System”. Int J Health Policy Manag. 2019;8:455–8. DOI: 10.15171/ijhpm.2019.31
73. Kislov R, Hodgson D, Boaden R. Professionals as knowledge brokers: The limits of authority in healthcare collaboration. Public Adm. 2016;94:472–89. DOI: 10.1111/padm.12227
74. Lockett A, El Enany N, Currie G, Oborn E, Barrett M, Racko G, Bishop S, Waring J. A formative evaluation of Collaboration for Leadership in Applied Health Research and Care (CLAHRC): institutional entrepreneurship for service innovation. Health Serv Deliv Res. 2014;2.
75. Frost H, Geddes R, Haw S, Jackson CA, Jepson R, Mooney JD, Frank J. Experiences of knowledge brokering for evidence-informed public health policy and practice: three years of the Scottish Collaboration for Public Health Research and Policy. Evid Policy. 2012;8:347–59. DOI: 10.1332/174426412X654068
76. Senge PM: The fifth discipline: The art and practice of the learning organization. Broadway Business; 2006.
77. Bornbaum CC, Kornas K, Peirson L, Rosella LC. Exploring the function and effectiveness of knowledge brokers as facilitators of knowledge translation in health-related settings: a systematic review and thematic analysis. Implement Sci. 2015;10:162. DOI: 10.1186/s13012-015-0351-9
78. Best A, Hiatt RA, Norman CD. Knowledge integration: conceptualizing communications in cancer control systems. Patient Educ Couns. 2008;71:319–27. DOI: 10.1016/j.pec.2008.02.013
79. Northridge ME, Metcalf SS. Enhancing implementation science by applying best principles of systems science. Health Res Policy Syst. 2016;14:74. DOI: 10.1186/s12961-016-0146-8
80. Farrer L, Marinetti C, Cavaco YK, Costongs C. Advocacy for Health Equity: A Synthesis Review. Milbank Q. 2015;93:392–437. DOI: 10.1111/1468-0009.12112
81. Sabatier PA, Weible CM. In: Sabatier PA, editor. The advocacy coalition framework. In Theories of the Policy Process, vol. 2: Westview Press; 2007. p. 189–220.
82. Kingdon JW. Agendas, alternatives, and public policies (2nd Edition). New York: Longman; 2003.
83. Cairney P, Kwiatkowski R. How to communicate effectively with policymakers: combine insights from psychology and policy studies. Palgrave Commun. 2017;3:37. DOI: 10.1057/s41599-017-0046-8
84. Herbert C, Best A. It's a matter of values: partnership for innovative change. HealthcarePapers. 2011;11:31–7. DOI: 10.12927/hcpap.2011.22436
85. Murphy K, Fafard P. Taking Power, Politics, and Policy Problems Seriously. J Urban Health. 2012;89:723–32. DOI: 10.1007/s11524-012-9694-6
86. Weyrauch V, Echt L, Suliman S. Knowledge into policy: going beyond ‘context matters’: International Network for the Availability of Scientific Publications; 2016. Available from: http://www.politicsandideas.org/wp-content/uploads/2016/07/Going-beyond-context-matters-Framework_PI.compressed.pdf.
87. Mayne R, Green D, Guijt I, Walsh M, English R, Cairney P. Using evidence to influence policy: Oxfam’s experience. Palgrave Commun. 2018;4:122. DOI: 10.1057/s41599-018-0176-7
88. Lavis JN, Robertson D, Woodside JM, McLeod CB, Abelson J. Knowledge Transfer Study G: How can research organizations more effectively transfer research knowledge to decision makers? Milbank Q. 2003;81:221–172. DOI: 10.1111/1468-0009.t01-1-00052
89. Hummelbrunner R. Learning, systems concepts and values in evaluation: proposal for an exploratory framework to improve coherence. Inst Dev Stud (IDS) Bull. 2015;46:17–29. DOI: 10.1111/1759-5436.12118
90. Chapman S. Advocacy for public health: a primer. J Epidemiol Community Health. 2004;58:361–5. DOI: 10.1136/jech.2003.018051
91. Boswell C, Smith K. Rethinking policy ‘impact’: four models of research-policy relations. Palgrave Commun. 2017;3:44. DOI: 10.1057/s41599-017-0042-z
92. Snowden DJ, Boone ME. A leader's framework for decision making. Harv Bus Rev. 2007;85:68.
93. Riley BL, Robinson KL, Gamble J, Finegood DT, Sheppard D, Penney TL, Best A. Knowledge to action for solving complex problems: insights from a review of nine international cases. Health Promot Chronic Dis Prev Can. 2015;35:47–53. DOI: 10.24095/hpcdp.35.3.01
94. Zimmerman B, Reason P, Rykert L, Gitterman L, Christian J, Gardam M. Front-line ownership: generating a cure mindset for patient safety. HealthcarePapers. 2013;13:6. DOI: 10.12927/hcpap.2013.23299
95. Head BW, Alford J. Wicked Problems: Implications for Public Policy and Management. Adm Soc. 2015;47:711–39. DOI: 10.1177/0095399713481601
96. Malakellis M, Hoare E, Sanigorski A, Crooks N, Allender S, Nichols M, Swinburn B, Chikwendu C, Kelly PM, Petersen S. School-based systems change for obesity prevention in adolescents: outcomes of the Australian Capital Territory ‘It's Your Move!’. Aust N Z J Public Health. 2017;41:490–6. DOI: 10.1111/1753-6405.12696
97. Peters DH. The application of systems thinking in health: why use systems thinking? Health Res Policy Syst. 2014;12:51. DOI: 10.1186/1478-4505-12-51
98. Willis CD, Best A, Riley B, Herbert CP, Millar J, Howland D. Systems thinking for transformational change in health. Evid Policy. 2014;10:113–26. DOI: 10.1332/174426413X662815
99. Plsek PE, Wilson T. Complexity, leadership, and management in healthcare organisations. BMJ. 2001;323:746. DOI: 10.1136/bmj.323.7315.746
100. Pieper S. Good to great in healthcare. Healthc Exec. 2004;19:21–6.
101. Joyce A, Ollis D, Kearney S, Leung L, Foenander E. The influence of contextual factors on implementation fidelity in a whole school approach to prevention of violence against women. Health Promot J Aust. 2019;30:238–45. DOI: 10.1002/hpja.198
102. Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82:581–629. DOI: 10.1111/j.0887-378X.2004.00325.x
103. Jenal M. An alternative to a Theory of Change approach. In: Rumination on systemic economic and social change, vol. 2019; 2016.
104. Paina L, Peters DH. Understanding pathways for scaling up health services through the lens of complex adaptive systems. Health Policy Plan. 2011;27:365–73. DOI: 10.1093/heapol/czr054
105. Best A, Greenhalgh T, Lewis S, Saul JE, Carroll S, Bitz J. Large-System Transformation in Health Care: A Realist Review. Milbank Q. 2012;90:421–56. DOI: 10.1111/j.1468-0009.2012.00670.x
106. Rycroft-Malone J, Burton RC, Wilkinson J, Harvey G, McCormack B, Baker R, Dopson S, Graham ID, Staniszewska S, Thompson C, et al. Collective action for implementation: a realist evaluation of organisational collaboration in healthcare. Implement Sci. 2016;11:1–17.
107. Holmes B. Co-producing health research: saying what we mean, meaning what we say, and learning as we go. Michael Smith Foundation for Health Research: Michael Smith Foundation for Health Research; 2017. Available from: http://www.msfhr.org/news/blog-posts/co-producing-health-research?platform=hootsuite. Accessed: 27 Jul 2017.
108. Laihonen H. A managerial view of the knowledge flows of a health-care system. Knowl Manag Res Pract. 2015;13:475–85. DOI: 10.1057/kmrp.2014.3
109. Patton MQ. Developmental evaluation: applying complexity concepts to enhance innovation and use. New York: Guilford Press; 2011.
110. Marshall M, Pagel C, French C, Utley M, Allwood D, Fulop N, Pope C, Banks V, Goldmann A. Moving improvement research closer to practice: the Researcher-in-Residence model. BMJ Qual Saf. 2014;23:801–5. DOI: 10.1136/bmjqs-2013-002779
111. Joyce A, Green C, Kearney S, Leung L, Ollis D. Alignment and political will: upscaling an Australian respectful relationships program. Health Promot Int. 2018;34:892–901. DOI: 10.1093/heapro/day034
112. Foster-Fishman PG, Nowell B, Yang H. Putting the system back into systems change: a framework for understanding and changing organizational and community systems. Am J Community Psychol. 2007;39:197–215. DOI: 10.1007/s10464-007-9109-0
113. Snowden D, Cynefin framework introduction. CognitiveEdge, 2010, CognitiveEdge. Available from: https://cognitive-edge.com/videos/cynefin-framework-introduction/. Accessed: 18 Jun 2019.
114. Ramalingam B, Laric M, Primrose J. From best practice to best fit: understanding and navigating wicked problems in international development. London: Overseas Development Institute; 2014. p. 1–44.
115. Fraser SW, Greenhalgh T. Coping with complexity: educating for capability. BMJ. 2001;323:799–803. DOI: 10.1136/bmj.323.7316.799
116. Alford C. How systems mapping can help you build a better theory of change. In: In too deep: tools for tackling tough problems, vol. 2019; 2017.
117. Funnell SC, Rogers PJ. Purposeful program theory: effective use of theories of change and logic models: Wiley; 2011.
118. Sniehotta FF, Araújo-Soares V, Brown J, Kelly MP, Michie S, West R. Complex systems and individual-level approaches to population health: a false dichotomy? Lancet Public Health. 2017;2:e396–7. DOI: 10.1016/S2468-2667(17)30167-6
119. Riley B, Willis C, Holmes B, Finegood D, Best A, McIsaac J. Systems thinking and dissemination and implementation research. In: Brownson R, Coldiitz A, Protor E, editors. Dissemination and Implementation Research in Health: Translating Science to Practice. New York: Oxford University Press; 2018.
120. Brandes U, Robins G, McCranie ANN, Wasserman S. What is network science? Netw Sci. 2013;1:1–15. DOI: 10.1017/nws.2013.2
121. Bailie R, Matthews V, Brands J, Schierhout G. A systems-based partnership learning model for strengthening primary healthcare. Implement Sci. 2013;8:143. DOI: 10.1186/1748-5908-8-143
122. Bryson JM, Crosby BC, Stone MM. Designing and Implementing Cross-Sector Collaborations: Needed and Challenging. Public Adm Rev. 2015;75:647–63. DOI: 10.1111/puar.12432
123. Wutzke S, Rowbotham S, Haynes A, Hawe P, Kelly P, Redman S, Davidson S, Stephenson J, Overs M, Wilson A. Knowledge mobilisation for chronic disease prevention: the case of the Australian Prevention Partnership Centre. Health Res Policy Syst. 2018;16:109. DOI: 10.1186/s12961-018-0379-9
124. Boaz A, Locock L, Ward V. Whose evidence is it anyway? Evid Policy. 2015;11:145–8. DOI: 10.1332/174426515X14313738355534
125. Nowotny H, Scott P, Gibbons M. Introduction: 'Mode 2' revisited: the new production of knowledge. Minerva. 2003;xli:179–94. DOI: 10.1023/A:1025505528250
126. Rycroft-Malone J. It's more complicated than that: Comment on "Translating evidence into healthcare policy and practice: single versus multi-faceted implementation strategies - is there a simple answer to a complex question?". Int J Health Policy Manag. 2015;4:481–2. DOI: 10.15171/ijhpm.2015.67
127. Graham ID, Kothari A, McCutcheon C. Moving knowledge into action for more effective practice, programmes and policy: protocol for a research programme on integrated knowledge translation. Implement Sci. 2018;13.
128. McKibbon KA, Lokker C, Wilczynski NL, Ciliska D, Dobbins M, Davis DA, Haynes RB, Straus SE. A cross-sectional study of the number and frequency of terms used to refer to knowledge translation in a body of health literature in 2006: a Tower of Babel? Implement Sci. 2010;5:16. DOI: 10.1186/1748-5908-5-16
129. Greenhalgh T, Wieringa S. Is it time to drop the ‘knowledge translation’ metaphor? A critical literature review. J R Soc Med. 2011;104:501–9. DOI: 10.1258/jrsm.2011.110285
130. Nutley S, Powell A, Davies H. What counts as good evidence? Provocation paper for the Alliance for Useful Evidence: Alliance for Useful Evidence; 2013.
131. Rusoja E, Haynie D, Sievers J, Mustafee N, Nelson F, Reynolds M, Sarriot E, Swanson RC, Williams B. Thinking about complexity in health: A systematic review of the key systems thinking and complexity ideas in health. J Eval Clin Pract. 2018;24:600–6. DOI: 10.1111/jep.12856
132. Meadows D. Leverage points: places to intervene in a system: The Sustainability Institute, Vermont; 1999. Available from: http://drbalcom.pbworks.com/w/file/fetch/35173014/Leverage_Points.pdf.
133. Lich KH, Ginexi EM, Osgood ND, Mabry PL. A call to address complexity in prevention science research. Prev Sci. 2013;14:279–89. DOI: 10.1007/s11121-012-0285-2
134. Riley B, Norman CD, Best A. Knowledge integration in public health: a rapid review using systems thinking. Evid Policy. 2012;8:417–31. DOI: 10.1332/174426412X660089
135. Eppel E, Matheson A, Walton M. Applying Complexity theory to New Zealand public policy: Principles for Practice. Policy Q. 2011;7:48–55. DOI: 10.26686/pq.v7i1.4369
136. Khan S, Vandermorris A, Shepherd J, Begun JW, Lanham HJ, Uhl-Bien M, Berta W. Embracing uncertainty, managing complexity: applying complexity thinking principles to transformation efforts in healthcare systems. BMC Health Serv Res. 2018;18.
137. Lissack MR. Complexity: the science, its vocabulary, and its relation to organizations. Emergence. 1999;1:110–26. DOI: 10.1207/s15327000em0101_7
138. Cairney P. Complexity Theory in Political Science and Public Policy. Polit Stud Rev. 2012;10:346–58. DOI: 10.1111/j.1478-9302.2012.00270.x
139. DeCoste S, Puri J. Complexity, climate change and evaluation: IEU Working Paper No. 02. Songdo: Green Climate Fund; 2019. Available from: https://ieu.greenclimate.fund/documents/977793/985626/Working_paper_-_Complexity__climate_change_and_evaluation.pdf/62551804-67f0-0f38-862e-4b185a8c1165.
140. Trochim WM, Cabrera DA, Milstein B, Gallagher RS, Leischow SJ. Practical challenges of systems thinking and modeling in public health. Am J Public Health. 2006;96.
141. Penney LS, Nahid M, Leykum LK, Lanham HJ, Noël PH, Finley EP, Pugh J. Interventions to reduce readmissions: can complex adaptive system theory explain the heterogeneity in effectiveness? A systematic review. BMC Health Serv Res. 2018;18:894. DOI: 10.1186/s12913-018-3712-7
142. Kitson A, Brook A, Harvey G, Jordan Z, Marshall R, O’Shea R, Wilson D. Using complexity and network concepts to inform healthcare knowledge translation. Int J Health Policy Manag. 2018;7:231. DOI: 10.15171/ijhpm.2017.79
143. Reed JE, Howe C, Doyle C, Bell D. Simple rules for evidence translation in complex systems: a qualitative study. BMC Med. 2018;16.
144. Braithwaite J, Churruca K, Long JC, Ellis LA, Herkes J. When complexity science meets implementation science: a theoretical and empirical analysis of systems change. BMC Med. 2018;16.
145. Chughtai S, Blanchet K. Systems thinking in public health: a bibliographic contribution to a meta-narrative review. Health Policy Plan. 2017;32:585–94.
146. OECD. Systems approaches to public sector challenges: working with change: OECD Observatory of Public Sector Innovation; 2017. Available from: http://www.oecd.org/gov/systems-approaches-to-public-sector-challenges-9789264279865-en.htm.
147. Allender S, Brown AD, Bolton KA, Fraser P, Lowe J, Hovmand P. Translating systems thinking into practice for community action on childhood obesity. Obes Rev. 2019:1–6.
148. Holmes B, Finegood D, Riley B, Best A. Systems thinking in dissemination and implementation research. In: Brownson R, Colditz G, Proctor E, editors. Dissemination and Implementation Research in Health: Translating Science To Practice. Oxford: Oxford University Press; 2012.
149. Carey G, Malbon E, Carey N, Joyce A, Crammond B, Carey A. Systems science and systems thinking for public health: a systematic review of the field. BMJ Open. 2015;5:e009002. DOI: 10.1136/bmjopen-2015-009002
150. Burnes B. Complexity theories and organizational change. Int J Manag Rev. 2005;7:73–90. DOI: 10.1111/j.1468-2370.2005.00107.x
151. Martin CM, Félix-Bortolotti M. W(h)ither complexity? The emperor's new toolkit? Or elucidating the evolution of health systems knowledge? J Eval Clin Pract. 2010;16:415–20. DOI: 10.1111/j.1365-2753.2010.01461.x
152. Shankardass K, O'Campo P, Muntaner C, Bayoumi AM, Kokkinen L. Ideas for Extending the Approach to Evaluating Health in All Policies in South Australia Comment on "Developing a Framework for a Program Theory-Based Approach to Evaluating Policy Processes and Outcomes: Health in All Policies in South Australia". Int J Health Policy Manag. 2018;7:755–7. DOI: 10.15171/ijhpm.2018.25
153. Powell A, Davies H, Nutley S. Missing in action? The role of the knowledge mobilisation literature in developing knowledge mobilisation practices. Evid Policy. 2017;13:201–23. DOI: 10.1332/174426416X14534671325644
154. Leykum LK, Parchman M, Pugh J, Lawrence V, Noël PH, McDaniel RR. The importance of organizational characteristics for improving outcomes in patients with chronic disease: a systematic review of congestive heart failure. Implement Sci. 2010;5:66. DOI: 10.1186/1748-5908-5-66
155. Leykum LK, Pugh J, Lawrence V, Parchman M, Noël PH, Cornell J, McDaniel RR. Organizational interventions employing principles of complexity science have improved outcomes for patients with Type II diabetes. Implement Sci. 2007;2:28. DOI: 10.1186/1748-5908-2-28
156. Weiss CH. The circuitry of enlightenment: Diffusion of social science research to policymakers. Knowledge. 1986;8:274–81. DOI: 10.1177/107554708600800211
157. Bond L, Glover S, Godfrey C, Butler H, Patton GC. Building capacity for system-level change in schools: lessons from the Gatehouse Project. Health Educ Behav. 2001;28:368–83. DOI: 10.1177/109019810102800310
158. Patton GC, Bond L, Carlin JB, Thomas L, Butler H, Glover S, Catalano R, Bowes G. Promoting social inclusion in schools: a group-randomized trial of effects on student health risk behavior and well-being. Am J Public Health. 2006;96:1582–7. DOI: 10.2105/AJPH.2004.047399
159. Skarzauskiene A. Managing complexity: systems thinking as a catalyst of the organization performance. Meas Bus Excell. 2010;14:49–64. DOI: 10.1108/13683041011093758
160. Kerzner H. Project management: a systems approach to planning, scheduling, and controlling: Wiley; 2017.
161. Goldberg KI. Crisis decision-making: Understanding the decision-making process during emergencies. CRISIS. 2013;25.
162. Chandler J, Rycroft-Malone J, Hawkes C, Noyes J. Application of simplified Complexity Theory concepts for healthcare social systems to explain the implementation of evidence into practice. J Adv Nurs. 2016;72:461–80. DOI: 10.1111/jan.12815
163. Reed JE, Green S, Howe C. Translating evidence in complex systems: a comparative review of implementation and improvement frameworks. Int J Qual Health Care. 2018.
164. Nowotny H. Re-thinking science: from reliable knowledge to socially robust knowledge. In: Lepenies W, editor. In Entangled Histories and Negotiated Universals. Frankfurt: Campus; 2003. p. 14–31.
165. Nutley SM, Walter I, Davies HT. Using evidence: How research can inform public services: Policy press; 2007.
166. Bristow D, Carter L, Martin S. Using evidence to improve policy and practice: the UK What Works Centres. Contemp Soc Sci. 2015;10:126–37. DOI: 10.1080/21582041.2015.1061688
167. Nutley S, Boaz A, Davies H, Fraser A. What works now? Continuity and change in the use of evidence to improve public policy and service delivery. Public Money Manag. 2019;39:310–6. DOI: 10.1080/09540962.2019.1598202
168. Mullett J. Issues of equity and empowerment in knowledge democracy: Three community based research examples. Action Res. 2015;13:248–61. DOI: 10.1177/1476750315573590
169. Lomas J. The in-between world of knowledge brokering. BMJ. 2007;334:129–32. DOI: 10.1136/bmj.39038.593380.AE
170. Ward V, House A, Hamer S. Knowledge brokering: the missing link in the evidence to action chain? Evid Policy. 2009;5:267. DOI: 10.1332/174426409X463811
171. King L, Hawe P, Wise M. Making dissemination a two-way process. Health Promot Int. 1998;13:237–44. DOI: 10.1093/heapro/13.3.237
172. Chapman S. Public health advocacy and tobacco control: making smoking history: Wiley-Blackwell; 2008.
173. Glasziou P, Haynes B. The paths from research to improved health outcomes. BMJ Evid Based Med. 2005;10:4–7.
174. Landry R, Amara N, Lamari M. Climbing the ladder of research utilization: Evidence from social science research. Sci Commun. 2001;22:396–422. DOI: 10.1177/1075547001022004003
175. Brown C. The policy agora: how the epistemological and ideological preferences of policy-makers affect the development of government policy. Human Welfare. 2012;1:57–70.
176. Liverani M, Hawkins B, Parkhurst JO. Political and institutional influences on the use of evidence in public health policy. A systematic review. PLoS One. 2013;8:e77404. DOI: 10.1371/journal.pone.0077404
177. Miller RL, Shinn M. Learning from communities: overcoming difficulties in dissemination of prevention and promotion efforts. Am J Community Psychol. 2005;35:169–83. DOI: 10.1007/s10464-005-3395-1
178. Castro FG, Yasui M. Advances in EBI development for diverse populations: towards a science of intervention adaptation. Prev Sci. 2017;18:623–9. DOI: 10.1007/s11121-017-0809-x
179. Haynes A, Brennan S, Redman S, Williamson A, Gallego G, Butow P. Figuring out fidelity: a worked example of the methods used to identify, critique and revise the essential elements of a contextualised intervention in health policy agencies. Implement Sci. 2016;11:1–18.
180. 3-Approach”. Prev Sci. 2018;19:337–46. DOI: 10.1007/s11121-016-0638-3
181. Caplan N. 2-Communities theory and knowledge utilization. Am Behav Sci. 1979;22:459–70. DOI: 10.1177/000276427902200308
182. Choi BCK, Pang T, Lin V, Puska P, Sherman G, Goddard M, Ackland MJ, Sainsbury P, Stachenko S, Morrison H, Clottey C. Can scientists and policy makers work together? J Epidemiol Community Health. 2005;59:632. DOI: 10.1136/jech.2004.031765
183. Wandersman A, Duffy J, Flaspohler P, Noonan R, Lubell K, Stillman L, Blachman M, Dunville R, Saul J. Bridging the gap between prevention research and practice: The interactive systems framework for dissemination and implementation. Am J Community Psychol. 2008;41:171–81. DOI: 10.1007/s10464-008-9174-z
184. Butler D. Translational research: crossing the valley of death. Nature. 2008;453:840–2. DOI: 10.1038/453840a
185. Shiell A, Hawe P, Kavanagh S. Evidence suggests a need to rethink social capital and social capital interventions. Soc Sci Med. 2018; Available online 8 September 2018.
186. Oliver K, Lorenc T, Innvær S. New directions in evidence-based policy research: a critical analysis of the literature. Health Res Policy Syst. 2014;12:34. DOI: 10.1186/1478-4505-12-34
187. Hawe P, Bond L, Butler H. Knowledge theories can inform evaluation practice: What can a complexity lens add? N Dir Eval. 2009;2009:89–100. DOI: 10.1002/ev.316
188. Ferlie E, Crilly T, Jashapara A, Peckham A. Knowledge mobilisation in healthcare: A critical review of health sector and generic management literature. Soc Sci Med. 2012;74:1297–304. DOI: 10.1016/j.socscimed.2011.11.042
189. Black LJ. When visuals are boundary objects in system dynamics work. Syst Dyn Rev. 2013;29:70–86. DOI: 10.1002/sdr.1496
190. Oliver K, Kothari A, Mays N. The dark side of coproduction: do the costs outweigh the benefits for health research? Health Res Policy Syst. 2019;17:33. DOI: 10.1186/s12961-019-0432-3
191. Williamson A, Tait H, El Jardali F, Wolfenden L, Thackway S, Stewart J, O’Leary L, Dixon J: How are evidence generation partnerships between researchers and policy-makers enacted in practice? A qualitative interview study. Health Research Policy and Systems 2019, 17:41.
192. McCabe KE, Wallace A, Crosland A. A model for collaborative working to facilitate knowledge mobilisation in public health. Evid Policy. 2015;11:559–76. DOI: 10.1332/174426415X14298767491657
193. Gollust SE, Seymour JW, Pany MJ, Goss A, Meisel ZF, Grande D. Mutual Distrust: Perspectives From Researchers and Policy Makers on the Research to Policy Gap in 2013 and Recommendations for the Future. INQUIRY: J Health Care Org Provision Financ. 2017;54:0046958017705465.
194. Kislov R, Wilson PM, Knowles S, Boaden R. Learning from the emergence of NIHR Collaborations for Leadership in Applied Health Research and Care (CLAHRCs): a systematic review of evaluations. Implement Sci. 2018;13:111. DOI: 10.1186/s13012-018-0805-y
195. Filipe A, Renedo A, Marston C. The co-production of what? Knowledge, values, and social relations in health care. PLoS Biol. 2017;15:e2001403. DOI: 10.1371/journal.pbio.2001403
196. Heaton J, Day J, Britten N. Collaborative research and the co-production of knowledge for practice: an illustrative case study. Implement Sci. 2016;11:1.
197. Rutter H, Savona N, Glonti K, Bibby J, Cummins S, Finegood DT, Greaves F, Harper L, Hawe P, Moore L, et al. The need for a complex systems model of evidence for public health. Lancet. 2017;390:2602–4. DOI: 10.1016/S0140-6736(17)31267-9
198. March JG, Olsen JP. The uncertainty of the past: organizational learning under ambiguity. Eur J Polit Res. 1975;3:147–71. DOI: 10.1111/j.1475-6765.1975.tb00521.x
199. Israel BA, Schulz AJ, Parker EA, Becker AB. Critical issues in developing and following community-based participatory research principles. In: Community-based participatory research for health: Jossey-Bass; 2008. p. 47–62.
200. Brown JS, Duguid P. Organizational learning and communities-of-practice: toward a unified view of working, learning, and innovation. Organ Sci. 1991;2:40–57. DOI: 10.1287/orsc.2.1.40
201. Hawe P, Shiell A, Riley T. Complex interventions: how "out of control" can a randomised controlled trial be? BMJ. 2004;328:1561–3. DOI: 10.1136/bmj.328.7455.1561
202. Hawe P. Minimal, negligible and negligent interventions. Soc Sci Med. 2015;138:265–8. DOI: 10.1016/j.socscimed.2015.05.025
203. Haynes A, Garvey K, Davidson S, Milat A: What can policymakers get out of systems thinking? Policy partners' experiences of a systems-focused research collaboration in preventive health International Journal of Health Policy and Management In Press.
204. Wutzke S, Morrice E, Benton M, Wilson A. Systems approaches for chronic disease prevention: sound logic and empirical evidence, but is this view shared outside of academia? Public Health Res Pract. 2016;26:e2631632. DOI: 10.17061/phrp2631632
205. Sautkina E, Goodwin D, Jones A, Ogilvie D, Petticrew M, White M, Cummins S. Lost in translation? Theory, policy and practice in systems-based environmental approaches to obesity prevention in the Healthy Towns programme in England. Health Place. 2014;29:60–6. DOI: 10.1016/j.healthplace.2014.05.006
206. El-Sayed AM, Galea S. Systems science and population health: Oxford University Press; 2017.
207. Hanlon P, Carlisle S, Hannah M, Reilly D, Lyon A. Making the case for a ‘fifth wave’ in public health. Public Health. 2011;125:30–6. DOI: 10.1016/j.puhe.2010.09.004
208. Agyepong IA. “Wood already touched by fire is not hard to set alight”; comment on “Constraints to applying systems thinking concepts in health systems: a regional perspective from surveying stakeholders in Eastern Mediterranean countries”. Int J Health Policy Manag. 2015;4:191–3. DOI: 10.15171/ijhpm.2015.34
209. Ottoson JM. Knowledge-for-action theories in evaluation: Knowledge utilization, diffusion, implementation, transfer, and translation. N Dir Eval. 2009;2009:7–20. DOI: 10.1002/ev.310
210. Hawe P, Bond L, Ghali LM, Perry R, Davison CM, Casey DM, Butler H, Webster CM, Scholz B. Replication of a whole school ethos-changing intervention: different context, similar effects, additional insights. BMC Public Health. 2015;15:265. DOI: 10.1186/s12889-015-1538-3
211. Martin GP, Ward V, Hendy J, Rowley E, Nancarrow S, Heaton J, Britten N, Fielden S, Ariss S. The challenges of evaluating large-scale, multi-partner programmes: the case of NIHR CLAHRCs. Evid Policy. 2011;7:489–509. DOI: 10.1332/174426411X603470