Designing and undertaking randomised implementation trials: Guide for researchers

The BMJ

Volumn 372, Issue , 2021, Pages

  Wolfenden, Luke ^a,b   Foy, Robbie ^c   Presseau, Justin ^d,e   Grimshaw, Jeremy M ^d,e   Ivers, Noah M ^f,g,h,i   Powell, Byron J ^j   Taljaard, Monica ^d,e   Wiggers, John ^a,b   Sutherland, Rachel ^a,b   Nathan, Nicole ^b   Williams, Christopher M ^a,b,k   Kingsland, Melanie ^a,b   Milat, Andrew ^k   Hodder, Rebecca K ^a,b   Yoong, Sze Lin ^l  

^a UNIVERSITY OF NEWCASTLE   (Australia)

^b HUNTER NEW ENGLAND POPULATION HEALTH   (Australia)

^c UNIVERSITY OF LEEDS   (United Kingdom)

^d OTTAWA HOSPITAL RESEARCH INSTITUTE   (Canada)

^e UNIVERSITY OF OTTAWA   (Canada)

^f WOMEN S COLLEGE HOSPITAL   (Canada)

^g WOMEN S COLLEGE HOSPITAL   (Canada)

^h UNIVERSITY OF TORONTO   (Canada)

ⁱ UNIVERSITY OF TORONTO   (Canada)

^j BROWN UNIVERSITY   (United States)

^k UNIVERSITY OF SYDNEY   (Australia)

^l SWINBURNE UNIVERSITY OF TECHNOLOGY   (Australia)

more..

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CALCULATION; CONTROLLED STUDY; EDITOR; ETHICS; HEALTH CARE POLICY; HUMAN; IMPLEMENTATION SCIENCE; MALE; PHYSICIAN; PUBLIC HEALTH; RANDOMIZED CONTROLLED TRIAL; SAMPLE SIZE; THEORETICAL STUDY; METHODOLOGY; PRACTICE GUIDELINE; RANDOMIZED CONTROLLED TRIAL (TOPIC);

HUMANS; IMPLEMENTATION SCIENCE; PRACTICE GUIDELINES AS TOPIC; RANDOMIZED CONTROLLED TRIALS AS TOPIC; RESEARCH DESIGN;

EID: 85099816459     PISSN: 09598146     EISSN: 17561833     Source Type: Journal    
DOI: 10.1136/bmj.m3721     Document Type: Article

References (141)

1. Lenfant C. Shattuck lecture-clinical research to clinical practice-lost in translation?N Engl J Med 2003;349:868-74. doi:10.1056/NEJMsa035507
2. Wolfenden L, Ziersch A, Robinson P, Lowe J, Wiggers J. Reducing research waste and improving research impact. Aust N Z J Public Health 2015;39:303-4. doi:10.1111/1753-6405.12467
3. National Academies of Sciences, Engineering, and Medicine. Crossing the global quality chasm: improving health care worldwide. National Academies Press2018.
4. Eccles MP, Mittman BS. Welcome to implementation science. BioMed Central, 2006:1.
5. Bauer MS, Damschroder L, Hagedorn H, Smith J, Kilbourne AM. An introduction to implementation science for the non-specialist. BMC Psychol 2015;3:32. doi:10.1186/s40359-015-0089-9
6. Sackett DL, Rosenberg WM, Gray JA, Haynes RB, Richardson WS. Evidence based medicine: what it is and what it isn't. BMJ 1996;312:71-2. doi:10.1136/bmj.312.7023.71
7. Wolfenden L, Reilly K, Kingsland M, et al. Identifying opportunities to develop the science of implementation for community-based non-communicable disease prevention: a review of implementation trials. Prev Med 2019;118:279-85. doi:10.1016/j.ypmed.2018.11.014
8. Powell BJ, McMillen JC, Proctor EK, et al. A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev 2012;69:123-57. doi:10.1177/1077558711430690
9. Powell BJ, Waltz TJ, Chinman MJ, et al. A refned compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci 2015;10:21. doi:10.1186/s13012-015-0209-1
10. McKibbon KA, Lokker C, Wilczynski NL, et al. A cross-sectional study of the number and frequency of terms used to refer to knowledge translation in a body of health literature in 2006: a Tower of Babel?Implement Sci 2010;5:16. doi:10.1186/1748-5908-5-16
11. Hodder RK, Wolfenden L, Kamper SJ, et al. Developing implementation science to improve the translation of research to address low back pain: a critical review. Best Pract Res Clin Rheumatol 2016;30:1050-73. doi:10.1016/j.berh.2017.05.002
12. Pinnock H, Barwick M, Carpenter CR, et al, StaRI Group. Standards for reporting implementation studies (StaRI) statement. BMJ 2017;356:i6795. doi:10.1136/bmj.i6795
13. Lewis CC, Stanick CF, Martinez RG, et al. The Society For Implementation Research Collaboration Instrument Review Project: a methodology to promote rigorous evaluation [correction: Implement Sci 2020;15:3]. Implement Sci 2015;10:2. doi:10.1186/s13012-014-0193-x
14. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research fndings into practice: a consolidated framework for advancing implementation science. Implement Sci 2009;4:50. doi:10.1186/1748-5908-4-50
15. Proctor EK, Powell BJ, McMillen JC. Implementation strategies: recommendations for specifying and reporting. Implement Sci 2013;8:139. doi:10.1186/1748-5908-8-139
16. Upvall MJ, Bourgault AM. De-implementation: a concept analysis. Nurs Forum 2018. doi:10.1111/nuf.12256
17. US Department of Health & Human Services. Implementation science at a glance: a guide for cancer control practitioners. National Cancer Institute, 2019:43-4.
18. World Health Organisation. Clinical trials. 2018. https://www.who.int/health-topics/clinical-trials/#tab=tab-1
19. Wolfenden L, Kingsland M, Yoong SL, et al. Improving the impact of public health service delivery and research: a decision tree to aid evidence-based public health practice and research. ANZJPH 2020. doi:10.1111/1753-6405.13023.
20. Lane-Fall MB, Curran GM, Beidas RS. Scoping implementation science for the beginner: locating yourself on the "subway line" of translational research. BMC Med Res Methodol 2019;19:133. doi:10.1186/s12874-019-0783-z
21. Forsythe L P, Ellis LE, Edmundson L, et al. Patient and stakeholder engagement in the PCORI pilot projects: description and lessons learned. J Gen Intern Med 2016;31:13-21. doi:10.1007/s11606-015-3450-z
22. Forsythe L, Heckert A, Margolis MK, Schrandt S, Frank L. Methods and impact of engagement in research, from theory to practice and back again: early fndings from the Patient-Centered Outcomes Research Institute. Qual Life Res 2018;27:17-31. doi:10.1007/s11136-017-1581-x
23. Gray-Burrows KA, Willis TA, Foy R, et al. Role of patient and public involvement in implementation research: a consensus study. BMJ Qual Saf 2018;27:858-64. doi:10.1136/bmjqs-2017-006954
24. Slattery P, Saeri AK, Bragge P. Research co-design in health: a rapid overview of reviews. Health Res Policy Syst 2020;18:17. doi:10.1186/s12961-020-0528-9
25. Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Efectiveness-implementation hybrid designs: combining elements of clinical efectiveness and implementation research to enhance public health impact. Med Care 2012;50:217-26. doi:10.1097/MLR.0b013e3182408812
26. Presseau J, Mackintosh J, Hawthorne G, et al. Cluster randomised controlled trial of a theory-based multiple behaviour change intervention aimed at healthcare professionals to improve their management of type 2 diabetes in primary care. Implement Sci 2018;13:65. doi:10.1186/s13012-018-0754-5
27. Mc Cord KA, Al-Shahi Salman R, Treweek S, et al. Routinely collected data for randomized trials: promises, barriers, and implications. Trials 2018;19:29. doi:10.1186/s13063-017-2394-5
28. Willis TA, Collinson M, Glidewell L, et al, ASPIRE programme team. An adaptable implementation package targeting evidence-based indicators in primary care: a pragmatic cluster-randomised evaluation. PLoS Med 2020;17:e1003045. doi:10.1371/journal. pmed.1003045
29. Lord PA, Willis TA, Carder P, West RM, Foy R. Optimizing primary care research participation: a comparison of three recruitment methods in data-sharing studies. Fam Pract 2016;33:200-4. doi:10.1093/fampra/cmw003
30. Treweek S, Lockhart P, Pitkethly M, et al. Methods to improve recruitment to randomised controlled trials: Cochrane systematic review and meta-Analysis. BMJ Open 2013;3:e002360. doi:10.1136/bmjopen-2012-002360
31. Treweek S, Pitkethly M, Cook J, et al. Strategies to improve recruitment to randomised trials. Cochrane Database Syst Rev 2018;2:MR000013. doi:10.1002/14651858.MR000013.pub6
32. Ivers NM, Schwalm J-D, Bouck Z, et al. Interventions supporting long term adherence and decreasing cardiovascular events afer myocardial infarction (ISLAND): pragmatic randomised controlled trial. BMJ 2020;369:m1731. doi:10.1136/bmj.m1731
33. Foy R, Penney GC, Grimshaw JM, et al. A randomised controlled trial of a tailored multifaceted strategy to promote implementation of a clinical guideline on induced abortion care. BJOG 2004;111:726-33. doi:10.1111/j.1471-0528.2004.00168.x
34. Eccles M, Steen N, Grimshaw J, et al. Efect of audit and feedback, and reminder messages on primary-care radiology referrals: a randomised trial. Lancet 2001;357:1406-9. doi:10.1016/S0140-6736(00)04564-5
35. Sackett DL. Explanatory and pragmatic clinical trials: a primer and application to a recent asthma trial. Pol Arch Med Wewn 2011;121:259-63. doi:10.20452/pamw.1071
36. Yoong SL, Wolfenden L, Clinton-McHarg T, et al. Exploring the pragmatic and explanatory study design on outcomes of systematic reviews of public health interventions: a case study on obesity prevention trials. J Public Health (Oxf) 2014;36:170-6. doi:10.1093/pubmed/fdu006
37. Finch M, Jones J, Yoong S, Wiggers J, Wolfenden L. Efectiveness of centre-based childcare interventions in increasing child physical activity: a systematic review and meta-Analysis for policymakers and practitioners. Obes Rev 2016;17:412-28. doi:10.1111/obr.12392
38. Loudon K, Treweek S, Sullivan F, Donnan P, Thorpe KE, Zwarenstein M. The PRECIS-2 tool: designing trials that are ft for purpose. BMJ 2015;350:h2147. doi:10.1136/bmj.h2147
39. Simon GE, Shortreed SM, Rossom RC, Penfold RB, Sperl-Hillen JAM, O'Connor P. Principles and procedures for data and safety monitoring in pragmatic clinical trials. Trials 2019;20:690. doi:10.1186/s13063-019-3869-3
40. Deeks JJ, Dinnes J, D'Amico R, et al, International Stroke Trial Collaborative Group, European Carotid Surgery Trial Collaborative Group. Evaluating non-randomised intervention studies. Health Technol Assess 2003;7:iii-x, 1-173. doi:10.3310/hta7270
41. Gerstein HC, McMurray J, Holman RR. Real-world studies no substitute for RCTs in establishing efcacy. Lancet 2019;393:210-1. doi:10.1016/S0140-6736(18)32840-X
42. Wensing M, Grol R, Grimshaw J, eds. Improving patient care. the implementation of change in health care. 3rd ed. Wiley Blackwell, 2020:352. doi:10.1002/9781119488620
43. Brainard J, Hunter PR. Do complexity-informed health interventions work? A scoping review. Implement Sci 2016;11:127. doi:10.1186/s13012-016-0492-5
44. Simpson KM, Porter K, McConnell ES, et al. Tool for evaluating research implementation challenges: a sense-making protocol for addressing implementation challenges in complex research settings. Implement Sci 2013;8:2. doi:10.1186/1748-5908-8-2
45. Greenhalgh T, Papoutsi C. Studying complexity in health services research: desperately seeking an overdue paradigm shif. BMC Med 2018;16:95. doi:10.1186/s12916-018-1089-4
46. Bonell C, Fletcher A, Morton M, Lorenc T, Moore L. Realist randomised controlled trials: a new approach to evaluating complex public health interventions. Soc Sci Med 2012;75:2299-306. doi:10.1016/j. socscimed.2012.08.032
47. Braithwaite J, Churruca K, Long JC, Ellis LA, Herkes J. When complexity science meets implementation science: a theoretical and empirical analysis of systems change. BMC Med 2018;16:63. doi:10.1186/s12916-018-1057-z
48. Kabisch M, Ruckes C, Seibert-Grafe M, Blettner M. Randomized controlled trials: part 17 of a series on evaluation of scientifc publications. Dtsch Arztebl Int 2011;108:663-8.
49. Juszczak E, Altman DG, Hopewell S, Schulz K. Reporting of multi-Arm parallel-group randomized trials: extension of the CONSORT 2010 statement. JAMA 2019;321:1610-20. doi:10.1001/jama.2019.3087
50. Hartley S, Foy R, Walwyn REA, et al, AFFINITIE programme. The evaluation of enhanced feedback interventions to reduce unnecessary blood transfusions (AFFINITIE): protocol for two linked cluster randomised factorial controlled trials. Implement Sci 2017;12:84. doi:10.1186/s13012-017-0614-8
51. Brown CA, Lilford RJ. The stepped wedge trial design: a systematic review. BMC Med Res Methodol 2006;6:54. doi:10.1186/1471-2288-6-54
52. Liddy C, Hogg W, Singh J, et al. A real-world stepped wedge cluster randomized trial of practice facilitation to improve cardiovascular care. Implement Sci 2015;10:150. doi:10.1186/s13012-015-0341-y
53. Lei H, Nahum-Shani I, Lynch K, Oslin D, Murphy SA. A "SMART" design for building individualized treatment sequences. Annu Rev Clin Psychol 2012;8:21-48. doi:10.1146/annurev-clinpsy-032511-143152
54. Johnson JE, Wiltsey-Stirman S, Sikorskii A, et al. Protocol for the ROSE sustainment (ROSES) study, a sequential multiple assignment randomized trial to determine the minimum necessary intervention to maintain a postpartum depression prevention program in prenatal clinics serving low-income women. Implement Sci 2018;13:115. doi:10.1186/s13012-018-0807-9
55. Cook TD, Campbell DT, Shadish W. Experimental and quasi-experimental designs for generalized causal inference. Houghton Miflin, 2002.
56. Sterne JAC, Savovic J, Page MJ, et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ 2019;366:l4898. doi:10.1136/bmj.l4898
57. NSW Ministy of Health. Study design for evaluating population health and health service interventions: a guide. Evidence and Evaluation Guidance Series, Population and Public Health Division, 2019.
58. Campbell MK, Mollison J, Grimshaw JM. Cluster trials in implementation research: estimation of intracluster correlation coefcients and sample size. Stat Med 2001;20:391-9. doi:10.1002/1097-0258(20010215)20:33.0.CO;2-Z
59. Hewitt CE, Torgerson DJ, Miles JN. Individual allocation had an advantage over cluster randomization in statistical efciency in some circumstances. J Clin Epidemiol 2008;61:1004-8. doi:10.1016/j. jclinepi.2007.12.002
60. Wolfenden L, Nathan NK, Sutherland R, et al. Strategies for enhancing the implementation of school-based policies or practices targeting risk factors for chronic disease. Cochrane Database Syst Rev 2017;11:CD011677. doi:10.1002/14651858.CD011677. pub2
61. Wolfenden L, Barnes C, Jones J, et al. Strategies to improve the implementation of healthy eating, physical activity and obesity prevention policies, practices or programmes within childcare services. Cochrane Database Syst Rev 2020;2:CD011779. doi:10.1002/14651858.CD011779.pub3
62. Brown CH, Curran G, Palinkas LA, et al. An overview of research and evaluation designs for dissemination and implementation. Annu Rev Public Health 2017;38:1-22. doi:10.1146/annurev-publhealth-031816-044215
63. Chakraborty B, Collins LM, Strecher VJ, Murphy SA. Developing multicomponent interventions using fractional factorial designs. Stat Med 2009;28:2687-708. doi:10.1002/sim.3643
64. Hooper R, Eldridge SM. Cutting edge or blunt instrument: how to decide if a stepped wedge design is right for you. BMJ Qual Saf 2020. doi:10.1136/bmjqs-2020-011620
65. Hemming K, Haines TP, Chilton PJ, Girling AJ, Lilford RJ. The stepped wedge cluster randomised trial: rationale, design, analysis, and reporting. BMJ 2015;350:h391. doi:10.1136/bmj.h391
66. Hemming K, Taljaard M, McKenzie JE, et al. Reporting of stepped wedge cluster randomised trials: extension of the CONSORT 2010 statement with explanation and elaboration. BMJ 2018;363:k1614. doi:10.1136/bmj.k1614
67. Hemming K, Taljaard M. Reflection on modern methods: when is a stepped-wedge cluster randomized trial a good study design choice?Int J Epidemiol 2020;49:1043-52. doi:10.1093/ije/dyaa077
68. Almirall D, Nahum-Shani I, Sherwood NE, Murphy SA. Introduction to SMART designs for the development of adaptive interventions: with application to weight loss research. Transl Behav Med 2014;4:260-74. doi:10.1007/s13142-014-0265-0
69. Taljaard M, Teerenstra S, Ivers NM, Fergusson DA. Substantial risks associated with few clusters in cluster randomized and stepped wedge designs. Clin Trials 2016;13:459-63. doi:10.1177/1740774516634316
70. Miller CJ, Smith SN, Pugatch M. Experimental and quasi-experimental designs in implementation research. Psychiatry Res 2020;283:112452. doi:10.1016/j.psychres.2019.06.027
71. Eldridge S, Kerry S, Torgerson DJ. Bias in identifying and recruiting participants in cluster randomised trials: what can be done?BMJ 2009;339:b4006. doi:10.1136/bmj.b4006
72. Eldridge S, Ashby D, Bennett C, Wakelin M, Feder G. Internal and external validity of cluster randomised trials: systematic review of recent trials. BMJ 2008;336:876-80. doi:10.1136/bmj.39517.495764.25
73. Farrin A, Russell I, Torgerson D, Underwood M, UK BEAM Trial Team. Diferential recruitment in a cluster randomized trial in primary care: the experience of the UK back pain, exercise, active management and manipulation (UK BEAM) feasibility study. Clin Trials 2005;2:119-24. doi:10.1191/1740774505cn073oa
74. Giraudeau B, Ravaud P. Preventing bias in cluster randomised trials. PLoS Med 2009;6:e1000065. doi:10.1371/journal.pmed.1000065
75. Robinson K, Allen F, Darby J, et al. Contamination in complex healthcare trials: the falls in care homes (FinCH) study experience. BMC Med Res Methodol 2020;20:46. doi:10.1186/s12874-020-00925-z
76. Magill N, Knight R, McCrone P, Ismail K, Landau S. A scoping review of the problems and solutions associated with contamination in trials of complex interventions in mental health. BMC Med Res Methodol 2019;19:4. doi:10.1186/s12874-018-0646-z
77. Cuzick J, Edwards R, Segnan N. Adjusting for non-compliance and contamination in randomized clinical trials. Stat Med 1997;16:1017-29. doi:10.1002/(SICI)1097-0258(19970515)16:93.0.CO;2-V
78. Sussman JB, Hayward RA. An IV for the RCT: using instrumental variables to adjust for treatment contamination in randomised controlled trials. BMJ 2010;340:c2073. doi:10.1136/bmj.c2073
79. Keogh-Brown MR, Bachmann MO, Shepstone L, et al. Contamination in trials of educational interventions. Health Technol Assess 2007;11:iii, ix-107. doi:10.3310/hta11430
80. Birken SA, Powell BJ, Shea CM, et al. Criteria for selecting implementation science theories and frameworks: results from an international survey. Implement Sci 2017;12:124. doi:10.1186/s13012-017-0656-y
81. Davidof F, Dixon-Woods M, Leviton L, Michie S. Demystifying theory and its use in improvement. BMJ Qual Saf 2015;24:228-38. doi:10.1136/bmjqs-2014-003627
82. Renger R, Titcomb A. A three-step approach to teaching logic models. Am J Eval 2002;23:493-503. doi:10.1177/109821400202300409
83. Eccles M. The Improved Clinical Efectiveness through Behavioural Research Group (ICEBeRG). Designing theoretically-informed implementation interventions. Implement Sci 2006;1:4. doi:10.1186/1748-5908-1-4
84. NSW Ministry of Health. Centre for Epidemiology and Evidence. Developing and Using Program Logic: A Guide. Evidence and Evaluation Guidance Series. Ministry of Health, Population and Public Health Division, 2017: 4-16.
85. Nilsen P. Making sense of implementation theories, models and frameworks. Implement Sci 2015;10:53. doi:10.1186/s13012-015-0242-0
86. Ajzen I. Attitudes, personality, and behaviour. McGraw-Hill Education (UK), 2005;1-144.
87. Orlikowski WJ. Improvising organizational transformation over time: A situated change perspective. Inf Syst Res 1996;7:63-92. doi:10.1287/isre.7.1.63
88. Bandura A. Social foundations of thought and action. Prentice Hall, 1986.
89. Klein KJ, Sorra JS. The challenge of innovation implementation. Acad Manage Rev 1996;21:1055-80. doi:10.5465/amr.1996.9704071863
90. Weiner BJ. A theory of organizational readiness for change. Implement Sci 2009;4:67. doi:10.1186/1748-5908-4-67
91. May C, Finch T. Implementing, embedding, and integrating practices: an outline of normalization process theory. Sociol 2009;43:535-54. doi:10.1177/0038038509103208
92. Cane J, O'Connor D, Michie S. Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci 2012;7:37. doi:10.1186/1748-5908-7-37
93. Tabak RG, Khoong EC, Chambers DA, Brownson RC. Bridging research and practice: models for dissemination and implementation research. Am J Prev Med 2012;43:337-50. doi:10.1016/j. amepre.2012.05.024
94. Sniehotta FF, Presseau J, Araújo-Soares V. Time to retire the theory of planned behaviour. Health Psych Rev, 2014:1-7.
95. Birken SA, Rohweder CL, Powell BJ, et al. T-CaST: an implementation theory comparison and selection tool. Implement Sci 2018;13:143. doi:10.1186/s13012-018-0836-4
96. Moullin JC, Dickson KS, Stadnick NA, et al. Ten recommendations for using implementation frameworks in research and practice. Implement Sci Commun 2020;1:42. doi:10.1186/s43058-020-00023-7
97. French SD, Green SE, O'Connor DA, et al. Developing theory-informed behaviour change interventions to implement evidence into practice: a systematic approach using the Theoretical Domains Framework. Implement Sci 2012;7:38. doi:10.1186/1748-5908-7-38
98. Presseau J, McCleary N, Lorencatto F, Patey AM, Grimshaw JM, Francis JJ. Action, actor, context, target, time (AACTT): a framework for specifying behaviour. Implement Sci 2019;14:102. doi:10.1186/s13012-019-0951-x
99. Colquhoun HL, Squires JE, Kolehmainen N, Fraser C, Grimshaw JM. Methods for designing interventions to change healthcare professionals' behaviour: a systematic review. Implement Sci 2017;12:30. doi:10.1186/s13012-017-0560-5
100. Powell BJ, Beidas RS, Lewis CC, et al. Methods to improve the selection and tailoring of implementation strategies. J Behav Health Serv Res 2017;44:177-94. doi:10.1007/s11414-015-9475-6
101. Proctor E, Silmere H, Raghavan R, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health 2011;38:65-76. doi:10.1007/s10488-010-0319-7
102. McKay H, Naylor P-J, Lau E, et al. Implementation and scale-up of physical activity and behavioural nutrition interventions: an evaluation roadmap. Int J Behav Nutr Phys Act 2019;16:102. doi:10.1186/s12966-019-0868-4
103. Smith JD, Hasan M. Quantitative approaches for the evaluation of implementation research studies. Psychiatry Res 2020;283:112521. doi:10.1016/j.psychres.2019.112521
104. Brown C, Hofer T, Johal A, et al. An epistemology of patient safety research: a framework for study design and interpretation. Part 3. End points and measurement. Qual Saf Health Care 2008;17:170-7. doi:10.1136/qshc.2007.023655
105. Mant J, Hicks N. Detecting diferences in quality of care: the sensitivity of measures of process and outcome in treating acute myocardial infarction. BMJ 1995;311:793-6. doi:10.1136/bmj.311. 7008.793
106. Hamilton AB, Finley E P. Qualitative methods in implementation research: an introduction. Psychiatry Res 2019;280:112516. doi:10.1016/j.psychres.2019.112516
107. US Department of Health and Human Services. Qualitative methods in implementation science. National Institutes of Health Bethesda. National Cancer Institute, 2018:1-20.
108. Grant A, Treweek S, Dreischulte T, Foy R, Guthrie B. Process evaluations for cluster-randomised trials of complex interventions: a proposed framework for design and reporting. Trials 2013;14:15. doi:10.1186/1745-6215-14-15
109. Hawe P, Shiell A, Riley T, Gold L. Methods for exploring implementation variation and local context within a cluster randomised community intervention trial. J Epidemiol Community Health 2004;58:788-93. doi:10.1136/jech.2003.014415
110. Murtagh MJ, Thomson RG, May CR, et al. Qualitative methods in a randomised controlled trial: the role of an integrated qualitative process evaluation in providing evidence to discontinue the intervention in one arm of a trial of a decision support tool. Qual Saf Health Care 2007;16:224-9. doi:10.1136/qshc.2006.018499
111. Byng R, Norman I, Redfern S, Jones R. Exposing the key functions of a complex intervention for shared care in mental health: case study of a process evaluation. BMC Health Serv Res 2008;8:274. doi:10.1186/1472-6963-8-274
112. Moore GF, Audrey S, Barker M, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ 2015;350:h1258. doi:10.1136/bmj.h1258
113. Lewis CC, Mettert KD, Dorsey CN, et al. An updated protocol for a systematic review of implementation-related measures. Syst Rev 2018;7:66. doi:10.1186/s13643-018-0728-3
114. Weiner BJ, Lewis CC, Stanick C, et al. Psychometric assessment of three newly developed implementation outcome measures. Implement Sci 2017;12:108. doi:10.1186/s13012-017-0635-3
115. Stirman SW, Miller CJ, Toder K, Calloway A. Development of a framework and coding system for modifcations and adaptations of evidence-based interventions. Implement Sci 2013;8:65. doi:10.1186/1748-5908-8-65
116. Grimshaw JM, Zwarenstein M, Tetroe JM, et al. Looking inside the black box: a theory-based process evaluation alongside a randomised controlled trial of printed educational materials (the Ontario printed educational message, OPEM) to improve referral and prescribing practices in primary care in Ontario, Canada. Implement Sci 2007;2:38. doi:10.1186/1748-5908-2-38
117. Presseau J, Grimshaw JM, Tetroe JM, et al. A theory-based process evaluation alongside a randomised controlled trial of printed educational messages to increase primary care physicians' prescription of thiazide diuretics for hypertension [ISRCTN72772651]. Implement Sci 2016;11:121. doi:10.1186/s13012-016-0485-4
118. Grimshaw JM, Presseau J, Tetroe J, et al. Looking inside the black box: results of a theory-based process evaluation exploring the results of a randomized controlled trial of printed educational messages to increase primary care physicians' diabetic retinopathy referrals [Trial registration number ISRCTN72772651]. Implement Sci 2014;9:86. doi:10.1186/1748-5908-9-86
119. Lewis CC, Klasnja P, Powell BJ, et al. From classifcation to causality: Advancing Understanding of Mechanisms of change in implementation science. Front Public Health 2018;6:136. doi:10.3389/fpubh.2018.00136
120. Clinton-McHarg T, Yoong SL, Tzelepis F, et al. Psychometric properties of implementation measures for public health and community settings and mapping of constructs against the Consolidated Framework for Implementation Research: a systematic review. Implement Sci 2016;11:148. doi:10.1186/s13012-016-0512-5
121. McIntyre SA, Francis JJ, Gould NJ, Lorencatto F. The use of theory in process evaluations conducted alongside randomized trials of implementation interventions: a systematic review. Transl Behav Med 2020;10:168-78.
122. Lewis CC, Boyd MR, Walsh-Bailey C, et al. A systematic review of empirical studies examining mechanisms of implementation in health. Implement Sci 2020;15:21. doi:10.1186/s13012-020-00983-3
123. Lapointe-Shaw L, Bouck Z, Howell NA, et al. Mediation analysis with a time-to-event outcome: a review of use and reporting in healthcare research. BMC Med Res Methodol 2018;18:118. doi:10.1186/s12874-018-0578-7
124. Whitaker RG, Sperber N, Baumgartner M, et al. Coincidence Analysis: A New Method for Causal Inference in Implementation Science. Research Sqaure, 2020: 1-18.
125. Squires JE, Aloisio LD, Grimshaw JM, et al. Attributes of context relevant to healthcare professionals' use of research evidence in clinical practice: a multi-study analysis. Implement Sci 2019;14:52. doi:10.1186/s13012-019-0900-8
126. Jones J, Wyse R, Finch M, et al. Efectiveness of an intervention to facilitate the implementation of healthy eating and physical activity policies and practices in childcare services: a randomised controlled trial. Implement Sci 2015;10:147. doi:10.1186/s13012-015-0340-z
127. Hamilton AB, Mittman BS, Campbell D, et al. Understanding the impact of external context on community-based implementation of an evidence-based HIV risk reduction intervention. BMC Health Serv Res 2018;18:11. doi:10.1186/s12913-017-2791-1
128. Hickey GL, Grant SW, Dunning J, Siepe M. Statistical primer: sample size and power calculations-why, when and how?Eur J Cardiothorac Surg 2018;54:4-9. doi:10.1093/ejcts/ezy169
129. Moher D, Hopewell S, Schulz KF, et al, CONSORT. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. Int J Surg 2012;10:28-55. doi:10.1016/j.ijsu.2011.10.001
130. Rutterford C, Copas A, Eldridge S. Methods for sample size determination in cluster randomized trials. Int J Epidemiol 2015;44:1051-67. doi:10.1093/ije/dyv113
131. Goldstein CE, Weijer C, Brehaut JC, et al. Accommodating quality and service improvement research within existing ethical principles. Trials 2018;19:334. doi:10.1186/s13063-018-2724-2
132. DuBois JM, Prusaczyk B. Chapter 4: Ethical issues in dissemination and implementation research. Brownson RC, Colditz GA, Proctor EK, eds. In: Dissemination and implementation research in health: translating science to practice (2nd ed). Oxford University Press, 2018;1:63.
133. Hutton JL, Eccles M P, Grimshaw JM. Ethical issues in implementation research: a discussion of the problems in achieving informed consent. Implement Sci 2008;3:52. doi:10.1186/1748-5908-3-52
134. Taljaard M, Weijer C, Grimshaw JM, Eccles MP, Ottawa Ethics of Cluster Randomised Trials Consensus Group. The Ottawa Statement on the ethical design and conduct of cluster randomised trials: precis for researchers and research ethics committees. BMJ 2013;346:f2838. doi:10.1136/bmj.f2838
135. Straus S, Tetroe J, Graham ID. Knowledge translation in health care: moving from evidence to practice. John Wiley & Sons, 2013. doi:10.1002/9781118413555
136. McRae AD, Weijer C, Binik A, et al. Who is the research subject in cluster randomized trials in health research?Trials 2011;12:183. doi:10.1186/1745-6215-12-183
137. McRae AD, Weijer C, Binik A, et al. When is informed consent required in cluster randomized trials in health research?Trials 2011;12:202. doi:10.1186/1745-6215-12-202
138. Hofmann TC, Glasziou PP, Boutron I, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ 2014;348:g1687. doi:10.1136/bmj.g1687
139. Efective Practice and Organisation of Care. EPOC taxonomy 2015. epoc.cochrane.org/epoc-taxonomy.
140. Michie S, Richardson M, Johnston M, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med 2013;46:81-95. doi:10.1007/s12160-013-9486-6
141. Plint AC, Moher D, Morrison A, et al. Does the CONSORT checklist improve the quality of reports of randomised controlled trials? A systematic review. Med J Aust 2006;185:263-7. doi:10.5694/j.1326-5377.2006.tb00557.x