Increasing the capacity of policy agencies to use research findings: A stepped-wedge trial

Health Research Policy and Systems

Volumn 17, Issue 1, 2019, Pages

  Williamson, Anna ^a,b,c   Barker, Daniel ^d   Green, Sally ^e,f   D'Este, Catherine ^d,g   Davies, Huw T O ^h   Jorm, Louisa ^c   Shakeshaft, Anthony ^c   Rudge, Sian ^a   Redman, Sally ^a  

^a SAX INSTITUTE   (Australia)

^b UNIVERSITY OF SYDNEY   (Australia)

^c UNIVERSITY OF NEW SOUTH WALES   (Australia)

^d UNIVERSITY OF NEWCASTLE   (Australia)

^e Australasian Cochrane Centre   (Australia)

^f MONASH UNIVERSITY   (Australia)

^g AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

^h UNIVERSITY OF ST ANDREWS   (United Kingdom)

Author keywords

evidence; intervention; knowledge mobilisation; knowledge translation; Policy

Indexed keywords

ADULT; ARTICLE; AUSTRALIA; CONTROLLED STUDY; FEASIBILITY STUDY; FEMALE; HEALTH CARE POLICY; HUMAN; INTERVENTION STUDY; LEADERSHIP; MALE; ORGANIZATIONAL STRUCTURE; OUTCOME ASSESSMENT; PROGRAM IMPACT; RANDOMIZED CONTROLLED TRIAL; SCIENTIST; SELF REPORT; SKILL; STAFF TRAINING; CAPACITY BUILDING; EVIDENCE BASED PRACTICE; MANAGEMENT; ORGANIZATION; RESEARCH;

AUSTRALIA; CAPACITY BUILDING; EVIDENCE-BASED PRACTICE; HEALTH POLICY; HUMANS; ORGANIZATIONS; POLICY MAKING; RESEARCH;

EID: 85061084278     PISSN: None     EISSN: 14784505     Source Type: Journal    
DOI: 10.1186/s12961-018-0408-8     Document Type: Article

References (66)

1. Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, et al. Lost in knowledge translation: time for a map? J Contin Educ Heal Prof. 2006;26:13-24.
2. Carden F. Knowledge to Policy: Making the Most of Development Research. New Dehli: International Development Research Centre: Sage; 2009.
3. Hanney S, Boaz A, Jones T, Soper B. Engagement in Research: An Innovative Three-Stage Review of the Benefits for Health-Care Performance. Health Services and Delivery Research. Southampton: NIHR Journals Library; 2013.
4. Cabinet Office. Modernising Government, White paper. London: Cabinet Office; 1999.
5. HM Government. What Works: Evidence Centres for Social Policy. London: HM Government; 2013.
6. Rudd K. Address to Heads of Agencies and Members of Senior Executive Service. Canberra: Australian Public Service Commission; 2008.
7. World Health Organization. World Report on Knowledge for Better Health: Strengthening Health Systems. Geneva: WHO; 2004.
8. Bogenschneider K, Corbett TJ. Evidence-based Policymaking: Insights from Policy-minded Researchers and Research-Minded Policymakers. New York: Routledge; 2011.
9. Chalmers I. If evidence-informed policy works in practice, does it matter if it doesn't work in theory? Evid Policy J Res Debate Pract. 2005;1(2):227-42.
10. Clancy CM, Glied SA, Lurie N. From research to health policy impact. Health Serv Res. 2012;47(1 Pt 2):337-43.
11. Nutley SM, Walter IC, Davies HTO. Using Evidence: How Research Can Inform Public Services. Bristol: The Policy Press; 2007.
12. Liverani M, Hawkins B, Parkhurst JO. Political and institutional influences on the use of evidence in public health policy. A systematic review. PLoS One. 2013;8(10):e77404.
13. de Leeuw E, Clavier C, Breton E. Health policy - why research it and how: health political science. Health Res Policy Syst. 2014;12:55.
14. Russell J, Greenhalgh T, Byrne E, McDonnell J. Recognizing rhetoric in health care policy analysis. J Health Serv Res Policy. 2008;13(1):40-6.
15. Head B, Alford J, editors. Wicked Problems: The Implications for Public Management. Presentation to Panel on Public Management in Practice, International Research Society for Public Management 12th Annual Conference. Brisbane; 2008.
16. Sterman JD. Learning from evidence in a complex world. Am J Public Health. 2006;96(3):505-14.
17. Canadian Foundation for Health Care Improvement. Executive Training for Healthcare Improvement (EXTRA). https://www.cfhi-fcass.ca/WhatWeDo/extra. Accessed 15 Jan 2019.
18. Canadian Institute of Health Research. Best Brains Exchanges, Accessed 15 Jan 2019 http://www.cihr-irsc.gc.ca/e/43978.html
19. Green A, Bennett S. Sound Choices: Enhancing Capacity for Evidence-Informed Health Policy. Geneva: World Health Organization; 2007.
20. Ellen ME, Léon G, Bouchard G, Lavis JN, Ouimet M, Grimshaw JM. What supports do health system organizations have in place to facilitate evidence-informed decision-making? A qualitative study. Implement Sci. 2013;8:84.
21. Jewell CJ, Bero LA. "Developing good taste in evidence": facilitators of and hindrances to evidence-informed health policymaking in state government. Milbank Q. 2008;86(2):177-208.
22. Choi BCK, Pang T, Lin V, Puska P, Sherman G, Goddard M, et al. Can scientists and policy makers work together? J Epidemiol Community Health. 2005;59(8):632.
23. Hawkes S, Aulakh BK, Jadeja N, et al. Strengthening capacity to apply health research evidence in policy making: experience from four countries. Health Policy Plan. 2016;31(2):161-70.
24. Haynes A, Rowbotham SJ, Redman S, Brennan S, Williamson A, Moore G. What can we learn from interventions that aim to increase policymakers' use of research? A realist scoping review. Health Res Policy Syst. 2018;16:31.
25. Dobbins M, Cockerill R, Barnsley J, Ciliska D. Factors of the innovation, organization, environment, and individual that predict the influence five systematic reviews had on public health decisions. Int J Technol Assess Health Care. 2001;17(4):467-78.
26. Uneke CJ, Ezeoha AE, Ndukwe CD, Oyibo PG, Onwe F. Promotion of evidence-informed health policy making in Nigeria: bridging the gap between researchers and policymakers. Glob Public Health. 2012;7(7):750-65.
27. Pappaioanou M, Malison M, et al. Strengthening capacity in developing countries for evidence-based public health: the data for decision-making project. Soc Sci Med. 2003;57(10):1925-37.
28. Kothari A, Sibbald SL, Wathen CN. Evaluation of partnerships in a transnational family violence prevention network using an integrated knowledge translation and exchange model: a mixed methods study. Health Res Policy Syst. 2014;12:25.
29. Hoeijmakersa M, Harting J, Jansena M. Academic Collaborative Centre Limburg: a platform for knowledge transfer and exchange in public health policy, research and practice? Health Policy. 2013;11(1):175-83.
30. Peirson L, Ciliska D, Dobbins M, Mowat D. Building capacity for evidence informed decision making in public health: a case study of organizational change. BMC Public Health. 2012;12:137.
31. Waqa G, Mavoa H, Snowdon W, Moodie M, Schultz J, McCabe M, et al. Knowledge brokering between researchers and policymakers in Fiji to develop policies to reduce obesity: a process evaluation. Implement Sci. 2013;8:74.
32. Brownson RC, Dodson EA, Stamatakis KA, et al. Communicating evidence-based information on cancer prevention to state-level policy makers. J Natl Cancer Inst. 2011;103(4):306-16.
33. Dobbins M, Hanna SE, Ciliska D, Manske S, Cameron R, Mercer SL, et al. A randomized controlled trial evaluating the impact of knowledge translation and exchange strategies. Implement Sci. 2009;4:61.
34. Davies H, Powell A, Ward V, Smith S. Supporting NHS Scotland in Developing a New Knowledge-to-action Model (Report). Scotland: National Health Service, Scotland; 2011.
35. Redman S, Turner T, Davies H, Haynes A, Williamson A, Milat A, et al. The SPIRIT Action Framework: a structured approach to selecting and testing strategies to increase the use of research in policy. Soc Sci Med. 2015;136-137:147-55.
36. Lavis JN, Oxman AD, Lewin S, Fretheim A. SUPPORT Tools for evidence-informed health Policymaking (STP). Health Res Policy Syst. 2009;7(Suppl 1):I1.
37. Kothari A, Edwards N, Hamel N, Judd M. Is research working for you? Validating a tool to examine the capacity of health organizations to use research. Implement Sci. 2009;4:46.
38. Boyko J, Lavis J, Dobbins M, Souza N. Reliability of a tool for measuring theory of planned behaviour constructs for use in evaluating research use in policymaking. Health Res Policy Syst. 2011;9:29.
39. Brennan SE, McKenzie JE, Turner T, Redman S, Makkar S, Williamson A, et al. Development and validation of SEER (Seeking, Engaging with and Evaluating Research): a measure of policymakers' capacity to engage with and use research. Health Res Policy Syst. 2017;15:1.
40. Makkar S, Williamson A, Turner T, Louviere J, Redman S, Green S, et al. ORACLe: a measure of an organisation's capacity to engage in evidence-informed health policy. Health Res Policy Syst. 2016;14:4.
41. Makkar S, Williamson A, Turner T, Redman S, Louviere J. Using conjoint analysis to develop a system to score policymakers' engagement with research in policy and program development. Health Res Policy Syst. 2015;13:22.
42. Makkar S, Williamson A, Turner T, Redman S, Louviere J. Using conjoint analysis to develop a system to score policymakers' engagement with research in policy and program development. Health Res Policy Syst. 2015;13:35.
43. Makkar SR, Brennan S, Williamson A, Turner T, Redman S, Green S. The development of SAGE: a tool to evaluate how policymakers' engage with and use research in health policymaking. Res Eval. 2015;1:14.
44. Medical Research Council. Developing and Evaluating Complex Interventions: New Guidance. UK Medical Research Council 2008. https://mrc.ukri.org/documents/pdf/complex-interventions-guidance/. Accessed 15 Jan 2019.
45. Barker D, D'Este C, Campbell M, McElduff P. Minimum number of clusters and comparison of analysis methods for cross sectional stepped wedge cluster randomised trials with binary outcomes: A simulation study. Trials. 2017;18:119.
46. Barker D, McElduff P, D'Este C, Campbell M. Stepped wedge cluster randomised trials: a review of the statistical methodology used and available. BMC Med Res Methodol. 2016;16:69.
47. Haynes A. Policymakers' experience of a research utilisation intervention: a realist process evaluation. Health Res Policy Syst. 2017;15:99.
48. The CIPHER Investigators. Supporting Policy In health with Research: an Intervention Trial (SPIRIT) - protocol for a stepped wedge trial. BMJ Open. 2014;4(7):e005293.
49. Bandura A. Principles of Behavior Modification. Englewood Cliffs: Prentice-Hall. Health Res Policy Syst. 2017;15:99.
50. Bandura A. Health promotion from the perspective of social cognitive theory. Psychol Health. 1998;13(4):623-49.
51. Shiell A, Hawe P, Gold L. Complex interventions or complex systems? Implications for health economic evaluation. Br Med J. 2008;336(7656):1281-3.
52. Hawe P, Shiell A, Riley T. Complex interventions: how "out of control" can a randomised controlled trial be? BMJ. 2004;328(7455):1561.
53. Nutley SM, Davies HTO. Developing organizational learning in the NHS. Med Educ. 2001;35(1):35-42.
54. Rashman L, Withers E, Hartley J. Organizational learning and knowledge in public service organizations: a systematic review of the literature. Int J Manag Rev. 2009;11(4):463-94.
55. Senge PM. The Leaders New Work - Building Learning Organizations. Sloan Manag Rev. 1990;32(1):7-23.
56. Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: Systematic review and recommendations. Milbank Q. 2004;82(4):581-629.
57. Brookfield SD. Understanding and facilitating adult learning. Sch Libr Media Q. 1988;16(2):99-105.
58. Bryan RL, Kreuter MW, Brownson RC. Integrating adult learning principles into training for public health practice. Health Promot Pract. 2009;10(4):557-63.
59. Langer L, Tripney J, Gough D. The Science of Using Science: Researching the Use of Research Evidence in Decision-Making. London: EPPI-Centre, Social Science Research Unit, UCL Institute of Education, University College London; 2016.
60. Huckel Schneider C, Campbell D, Milat AJ, Haynes A, Quinn E. What are the key organisational capabilities that facilitate research use in public health policy? Public Health Res Pract. 2014;25:1 pii: e2511406.
61. Haynes A, Butow PN, Brennan S, Williamson A, Redman S, Carter S, et al. The pivotal position of 'liaison people': facilitating a research utilisation intervention in policy agencies. Evid Policy. 2018;14(1):7-34.
62. Haynes A, Brennan S, Redman S, Williamson A, Gallego G, Butow P. Figuring out fidelity: a worked example of the methods used to identify, critique and revise the essential elements of a contextualised intervention in health policy agencies. Implement Sci. 2016;11:23.
63. Hooper R, Teerenstra S, de Hoop E, Eldridge S. Sample size calculation for stepped wedge and other longitudinal cluster randomised trials. Stat Med. 2016;35:4718-28.
64. Jansen MW, Hoeijmakers M. A masterclass to teach public health professionals to conduct practice-based research to promote evidence-based practice: a case study from The Netherlands. J Public Health Manag Pract. 2013;19(1):83-92.
65. Yost J, Ciliska D, Dobbins M. Evaluating the impact of an intensive education workshop on evidence-informed decision making knowledge, skills and hehaviours: a mixed methods study. BMC Med Educ. 2014;14:13.
66. Taylor RS, Reeves BC, Ewings PE, Taylor RJ. Critical appraisal skills training for health care professionals: a randomized controlled trial [ISRCTN46272378]. BMC Med Educ. 2004;4(1):30.