Measurement issues in dissemination and implementation research

Dissemination and Implementation Research in Health: Translating Science to Practice, Second Edition

Volumn , Issue , 2017, Pages 229-244

  Lewis, Cara C ^a,b,c   Proctor, Enola K ^d   Brownson, Ross C ^e  

^a KAISER PERMANENTE   (United States)

^b UNIVERSITY OF WASHINGTON SCHOOL OF MEDICINE   (United States)

^c INDIANA UNIVERSITY   (United States)

^d WASHINGTON UNIVERSITY   (United States)

^e WASHINGTON UNIVERSITY IN ST LOUIS   (United States)

Author keywords

Implementation outcomes; Measurement; Reliability; Stakeholder perspectives; Validity

Indexed keywords

EID: 85049542068     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1093/oso/9780190683214.003.0014     Document Type: Chapter

References (72)

1. Sallis JF, Owen N, Fotheringham MJ. Behavioral epidemiology: a systematic framework to classify phases of research on health promotion and disease prevention. Ann Behav Med. 2000;22(4):294-298.
2. Rabin BA, Lewis CC, Norton WE, et al. Measurement resources for dissemination and implementation research in health. Implement Sci. 2016;11:42.
3. Neta G, Glasgow RE, Carpenter CR, et al. A framework for enhancing the value of research for dissemination and implementation. Am J Public Health. 2015;105(1):49-57.
4. McKibbon KA, Lokker C, Wilczynski NL, et al. A cross-sectional study of the number and frequency of terms used to refer to knowledge translation in a body of health literature in 2006: a Tower of Babel? Implement Sci. 2010;5:16.
5. Rabin BA, Brownson RC. Developing the terminology for dissemination and implementation research in health In: Brownson RC, Colditz GA, Proctor EK, eds. Dissemination and implementation research in health: Translating science to practice. 2nd ed. New York: Oxford University Press; 2017.
6. Grimshaw J, Eccles M, Thomas R, et al. Toward evidence-based quality improvement: evidence (and its limitations) of the effectiveness of guideline dissemination and implementation strategies 1966-1998. J Gen Intern Med. 2006;21 Suppl 2:S14-S20.
7. Proctor E, Landsverk J, Aarons G, Chambers D, Glisson C, Mittman B. Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Adm Policy Ment Health. 2009;36(1):24-34.
8. Institute of Medicine Committee on Quality of Health Care in America. Crossing the quality chasm: A new health system for the 21st century. Washington, DC: Institute of Medicine, National Academy Press; 2001.
9. Institute of Medicine Committee on Crossing the Quality Chasm. Adaptation to mental health and addictive disorder: Improving the quality of health care for mental and substance-use conditions. Washington, DC: Institute of Medicine, National Academies Press; 2006.
10. Brownson RC, Chriqui JF, Stamatakis KA. Understanding evidence-based public health policy. Am J Public Health. 2009;99: 1576-1583.
11. Proctor E, Silmere H, Raghavan R, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011;38(2):65-76.
12. Tabak RG, Khoong EC, Chambers DA, Brownson RC. Bridging research and practice: models for dissemination and implementation research. Am J Prev Med. 2012;43(3):337-350.
13. Gerring J. Social science methodology: A criterial framework. New York: Cambridge University Press; 2001.
14. Hrisos S, Eccles MP, Francis JJ, et al. Are there valid proxy measures of clinical behaviour? a systematic review. Implement Sci. 2009;4:37.
15. Ibrahim S, Sidani S. Fidelity of intervention implementation: a review of instruments. Health. 2015;7(12):1687-1695.
16. Weiner BJ, Amick H, Lee SY. Conceptualization and measurement of organizational readiness for change: a review of the literature in health services research and other fields. Med Care Res Rev. 2008;65(4):379-436.
17. Emmons KM, Weiner B, Fernandez ME, Tu SP. Systems antecedents for dissemination and implementation: a review and analysis of measures. Health Educ Behav. 2012;39(1):87-105.
18. Chaudoir SR, Dugan AG, Barr CH. Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level measures. Implement Sci. 2013;8:22.
19. Lewis CC, Stanick CF, Martinez RG, et al. The Society for Implementation Research Collaboration Instrument Review Project: a methodology to promote rigorous evaluation. Implement Sci. 2015;10(2).
20. Chor KH, Wisdom JP, Olin SC, Hoagwood KE, Horwitz SM. Measures for predictors of innovation adoption. Adm Policy Ment Health. 2015;42(5):545-573.
21. Burnes B. Emergent change and planned change- competitors or allies?: the case of XYZ construction. Int J Oper Prod Man. 2004;24(9):886-902.
22. Waldorff FB, Steenstrup AP, Nielsen B, Rubak J, Bro F. Diffusion of an e-learning programme among Danish General Practitioners: a nationwide prospective survey. BMC Fam Pract. 2008;9:24.
23. Adily A, Westbrook J, Coiera E, Ward J. Use of on-l ine evidence databases by Australian public health practitioners. Med Inform Internet Med. 2004;29(2):127-136.
24. Fischer MA, Vogeli C, Stedman MR, Ferris TG, Weissman JS. Uptake of electronic prescribing in community-based practices. J Gen Intern Med. 2008;23(4):358-363.
25. Cooke M, Mattick RP, Walsh RA. Implementation of the "Fresh Start" smoking cessation programme to 23 antenatal clinics: a randomized controlled trial investigating two methods of dissemination. Drug and Alcohol Review. 2001;20(1):19-28.
26. Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health. 2011;38(1):4-23.
27. Rabin BA, Glasgow RE, Kerner JF, Klump MP, Brownson RC. Dissemination and implementation research on community-based cancer prevention: a systematic review. Am J Prev Med. 2010;38(4):443-456.
28. Rabin BA, Brownson RC, Kerner JF, Glasgow RE. Methodologic challenges in disseminating evidence-based interventions to promote physical activity. Am J Prev Med. 2006;31(4 Suppl):S24-S34.
29. Dingfelder HE, Mandell DS. Bridging the research-to-practice gap in autism intervention: an application of diffusion of innovation theory. J Autism Dev Disord. 2011;41(5):597-609.
30. Cane J, O'Connor D, Michie S. Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci. 2012;7:37.
31. Rabin BA, Brownson RC, Haire-Joshu D, Kreuter MW, Weaver NL. A glossary for dissemination and implementation research in health. J Public Health Manag Pract. 2008;14(2):117-123.
32. Lewis CC. Advancing the Pragmatic Measures Construct and Three New Measures of Implementation Outcomes. 9th Annual Conference on the Science of Dissemination and Implementation in Health; 2016; Washington, DC.
33. Karsh BT. Beyond usability: designing effective technology implementation systems to promote patient safety. Qual Saf Health Care. 2004;13(5):388-394.
34. Lewis CC, Weiner BJ, Stanick C, Fischer SM. Advancing implementation science through measure development and evaluation: a study protocol. Implement Sci. 2015;10:102.
35. Rye CB, Kimberly JR. The adoption of innovations by provider organizations in health care. Med Care Res Rev. 2007;64(3):235-278.
36. Dusenbury L, Brannigan R, Falco M, Hansen WB. A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. Health Educ Res. 2003;18(2):237-256.
37. Mihalic S. The importance of implementation fidelity. 2002;http://incredibleyears.com/wp- content/uploads/fidelity-importance.pdf.
38. Dane AV, Schneider BH. Program integrity in primary and early secondary prevention: are implementation effects out of control? Clin Psychol Rev. 1998;18(1):23-45.
39. Schoenwald SK, Garland AF, Chapman JE, Frazier SL, Sheidow AJ, Southam-Gerow MA. Toward the effective and efficient measurement of implementation fidelity. Adm Policy Ment Health. 2011;38(1):32-43.
40. Stiles PG, Boothroyd RA, Snyder K, Zong X. Service penetration by persons with severe mental illness: how should it be measured? J Behav Health Serv Res. 2002;29(2):198-207.
41. Glasgow RE. The RE-AIM model for planning, evaluation and reporting on implementation and dissemination research. NIH Conference on Building the Science of D & I in the Service of Public Health; 2007; Bethesda, MD.
42. Johnson K, Hays C, Center H, Daley C. Building capacity and sustainable prevention innovations: a sustainability planning model. Eval Prog Plan. 2004;27(2):135-149.
43. Turner KMT, Sanders MR. Dissemination of evidence-based parenting and family support strategies: learning from the Triple P-Positive Parenting Program system approach. Aggress ViolentBeh. 2006;11(2): 176-193.
44. Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89(9):1322-1327.
45. Goodman RM, McLeroy KR, Steckler AB, Hoyle RH. Development of level of institutionalization scales for health promotion programs. Health Educ Q. 1993;20(2):161-178.
46. Lewis CC, Fischer S, Weiner BJ, Stanick C, Kim M, Martinez RG. Outcomes for implementation science: an enhanced systematic review of instruments using evidence-based rating criteria. Implement Sci. 2015;10:155.
47. Woolf SH. The meaning of translational research and why it matters. JAMA. 2008;299(2):211-213.
48. Repenning NP. A simulation-based approach to understanding the dynamics of innovation implementation. Organi Sci. 2002;13(2):109-127.
49. Hovmand PS, Gillespie DF. Implementation of evidence-based practice and organizational performance. J Behav Health Serv Res. 2010;37(1):79-94.
50. Klein KJ, Knight AP. Innovation implementation. Curr Direct Psychol Sci. 2005;14(5):243-246.
51. Rogers EM. Diffusion of innovations. 4th ed. New York: The Free Press; 1995.
52. Chambers DA. Advancing the science of implementation: a workshop summary. Adm Policy Ment Health. 2008;35(1-2):3-10.
53. Kimberly J, Cook JM. Organizational measurement and the implementation of innovations in mental health services. Adm Policy Ment Health. 2008;35(1-2):11-20.
54. Council NAMH. The road ahead: Research partnerships to transform services. Bethesda, MD: National Institutes of Health, National Institute of Mental Health; 2006.
55. Coyne I, McNamara N, Healy M, Gower C, Sarkar M, McNicholas F. Adolescents' and parents' views of Child and Adolescent Mental Health Services (CAMHS) in Ireland. J Psychiatr Ment Health Nurs. 2015;22(8):561-569.
56. Kerner J, Rimer B, Emmons K. Introduction to the special section on dissemination: dissemination research and research dissemination: how can we close the gap? Health Psychol. 2005;24(5):443-446.
57. Lambooij MS, Hummel MJ. Differentiating innovation priorities among stakeholder in hospital care. BMC Med Inform Decis Mak. 2013;13:91.
58. Wahlster P, Goetghebeur M, Kriza C, Niederlander C, Kolominsky-Rabas P; National Leading-Edge Cluster Medical Technologies 'Medical Valley EMN. Balancing costs and benefits at different stages of medical innovation: a systematic review of Multi-criteria decision analysis (MCDA). BMC Health Serv Res. 2015;15:262.
59. Preston CC, Colman AM. Optimal number of response categories in rating scales: reliability, validity, discriminating power, and respondent preferences. Acta Psychol (Amst). 2000;104(1):1-15.
60. Sandor Z, Wedel M. Heterogeneous conjoint choice designs. J Marketing Res. 2005;42(2):210-218.
61. Wierenga SJ, Kamsteeg FH, Simons RJ, Veenswijk M. Teachers making sense of result-oriented teams: a cognitive anthropological approach to educational change. JEduc Change. 2015;16(1):53-78.
62. Shumway M, Sentell T, Chouljian T, Tellier J, Rozewicz F, Okun M. Assessing preferences for schizophrenia outcomes: comprehension and decision strategies in three assessment methods. Ment Health Serv Res. 2003;5(3):121-135.
63. Palinkas LA. Nutritional interventions for treatment of seasonal affective disorder. CNS Neurosci Ther. 2010;16(1):3-5.
64. Shumway M, Saunders T, Shern D, et al. Preferences for schizophrenia treatment outcomes among public policy makers, consumers, families, and providers. Psychiatr Serv. 2003;54(8):1124-1128.
65. Glasgow RE, Riley WT. Pragmatic measures: what they are and why we need them. Am J Prev Med. 2013;45(2):237-243.
66. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.
67. Martinez RG, Lewis CC, Weiner BJ. Instrumentation issues in implementation science. Implement Sci. 2014;9:118.
68. Raghavan R, Bright CL, Shadoin AL. Toward a policy ecology of implementation of evidence- based practices in public mental health settings. Implement Sci. 2008;3:26.
69. Frost MH, Reeve BB, Liepa AM, Stauffer JW, Hays RD, Mayo FDAP-ROCMG. What is sufficient evidence for the reliability and validity of patient- reported outcome measures? Value Health. 2007;10 Suppl 2:S94-S105.
70. Luke DA. Multilevel modeling. Thousand Oaks, CA: Sage; 2004.
71. Ime4: Linear mixed- effects models using S4 classes [computer program]. Version R package version 0.99875-62007.
72. Rabin BA, Purcell P, Naveed S, et al. Advancing the application, quality and harmonization of implementation science measures. Implement Sci. 2012;7:119.