Implementation science approaches for integrating eHealth research into practice and policy

International Journal of Medical Informatics

Volumn 83, Issue 7, 2014, Pages

  Glasgow, Russell E ^a   Phillips, Siobhan M ^a   Sanchez, Michael A ^a  

^a NATIONAL CANCER INSTITUTE   (United States)

Author keywords

EHealth; Implementation science; Internet; Methodology; MHealth; Recommendations; Review

Indexed keywords

DESIGN; INTERNET; REVIEWS;

EHEALTH; IMPLEMENTATION SCIENCE; METHODOLOGY; MHEALTH; RECOMMENDATIONS;

RESEARCH;

ARTICLE; COMPARATIVE EFFECTIVENESS; FUNDING; HEALTH CARE COST; HEALTH CARE POLICY; HEALTH CARE PRACTICE; INFORMATION; LEARNING; METHODOLOGY; MODEL; PATIENT; PRIORITY JOURNAL; SCIENCE; TELEHEALTH; HEALTH CARE PLANNING; HUMAN; INTERNET; LEGISLATION AND JURISPRUDENCE; MEDICAL INFORMATICS; MEDICAL RESEARCH; PROCEDURES; TELEMEDICINE;

BIOMEDICAL RESEARCH; HEALTH PLAN IMPLEMENTATION; HEALTH POLICY; HUMANS; INTERNET; MEDICAL INFORMATICS; RESEARCH DESIGN; TELEMEDICINE;

EID: 84902086773     PISSN: 13865056     EISSN: 18728243     Source Type: Journal    
DOI: 10.1016/j.ijmedinf.2013.07.002     Document Type: Article

References (82)

1. Bennett G.G., Glasgow R.E. The delivery of public health interventions via the Internet: actualizing their potential. Annu. Rev. Public Health 2009, 30:273-292.
2. Noar S.M., Harrington N.G. Interactive Health Communication Technologies: Promising Strategies for Health Behavior Change 2013, Routledge, New York, NY. 1st ed.
3. Strecher V. Internet methods for delivering behavioral and health-related interventions (eHealth). Annu. Rev. Clin. Psychol. 2007, 3:53-76.
4. de Jongh T., Gurol-Urganci I., Vodopivec-Jamsek V., Car J., Atun R. Mobile phone messaging for facilitating self-management of long-term illnesses. Cochrane Database Syst. Rev. 2012, 12. CD007459.
5. Rabin B.A., Glasgow R.E. Dissemination of interactive health communication programs. Interactive Health Communication Technologies: Promising Strategies for Health Behavior Change 2012, 221-245. Routledge, New York, NY. 1st ed. S.M. Noar, N.G. Harrington (Eds.).
6. Patrick K., Raab F., Adams M.A., Dillon L., Zabinski M., Rock C.L., et al. A text message-based intervention for weight loss: randomized controlled trial. J. Med. Internet Res. 2009, 11(1):e1.
7. Brug J., Oenema A., Campbell M. Past, present and future of computer-tailored nutrition education. Am. J. Clin. Nutr. 2003, 77(4):1028S-1034S.
8. Stokols D., Hall K.L., Taylor B.K., Moser R.P. The science of team science: overview of the field and introduction to the supplement. Am. J. Prev. Med. 2008, 35(2 Suppl.):S77-S89.
9. Stokols D. Social ecology and behavioral medicine: implications for training, practice, and policy. Behav. Med. 2000, 26:129-138.
10. Catwell L., Sheikh A. Evaluating eHealth interventions: the need for continuous systemic evaluation. PLoS Med. 2009, 6(8):e1000126.
11. Lorenc T., Petticrew M., Welch V., Tugwell P. What types of interventions generate inequalities? Evidence from systematic reviews. J. Epidemiol. Community Health 2013, 67(2):190-193.
12. Bennett G.G. Connecting eHealth with 2-1-1 to reduce health disparities. Am. J. Prev. Med. 2012, 43(6 Suppl. 5):S509-S511.
13. Stange K.C., Glasgow R.E. Considering and reporting important contextual factors. Methods Brief for the AHRQ Initiative in Patient-Centered Medical Home (PCMH) 2013, Rockville, MD. Agency for Health Care Research Quality (Ed.).
14. Glasgow R.E., Green L.W., Taylor M.V., Stange K.C. An evidence integration triangle for aligning science with policy and practice. Am. J. Prev. Med. 2012, 42(6):646-654.
15. Rabin B.A., Purcell P., Naveed S., Moser R.P., Henton M.D., Proctor E.K., et al. Advancing the application, quality and harmonization of implementation science measures. Implement. Sci. 2012, 7(1):119.
16. R.E. Glasgow, W.T Riley, Pragmatic measures: what they are and why we need them, Am. J. Prev. Med., (in press).
17. Tabak R.G., Khoong E.C., Chambers D.A., Brownson R.C. Bridging research and practice: models for dissemination and implementation research. Am. J. Prev. Med. 2012, 43(3):337-350.
18. Gaglio B., Glasgow R.E. Evaluation approaches for dissemination and implementation research. Dissemination and Implementation Research in Health: Translating Science to Practice 2012, 327-356. Oxford University Press, New York. 1st ed. R. Brownson, G. Colditz, E. Proctor (Eds.).
19. Glasgow R.E. What does it mean to be pragmatic? Opportunities and challenges for pragmatic approaches. Health Educ. Behav. 2013, 43(3):257-265.
20. Riley W.T., Glasgow R.E., Etheredge L., Abernethy A.P. Rapid, responsive, relevant (R3) research: a call for a rapid learning health research enterprise. Clin. Trans. Sci. 2013, 2:10.
21. Langley G.J., Nolan K.M., Nolan T.W., Norman C.L., Provost L.P. The Improvement Guide: A Practical Approach to Enhancing Organizational Performance 1996, Jossey-Bass, San Francisco.
22. Best A., Hiatt R.A., Norman C.D. Knowledge integration: conceptualizing communications in cancer control systems. Patient Educ. Couns. 2008, 71(3):319-327.
23. Leviton L.C., Khan L.K., Rog D., Dawkins N., Cotton D. Evaluability assessment to improve public health policies, programs, and practices. Annu. Rev. Public Health 2010, 31:213-233.
24. Thorpe K.E., Zwarenstein M., Oxman A.D., Treweek S., Furberg C.D., Altman D.G., et al. A pragmatic-explanatory continuum indicator summary (PRECIS): a tool to help trial designers. CMAJ 2009, 180(10):E47-E57.
25. Krist A.H., Glenn B.A., Glasgow R.E., Balasubramanian B., Chambers D.A., Fernandez M., et al. Designing a flexible, pragmatic primary care implementation trial: the My Own Health Report (MOHR) Project. Implement. Sci. 2013, 8:73.
26. Glasgow R.E., Magid D.J., Beck A., Ritzwoller D., Estabrooks P.A. Practical clinical trials for translating research to practice: design and measurement recommendations. Med. Care 2005, 43(6):551-557.
27. Klesges L.M., Estabrooks P.A., Glasgow R.E., Dzewaltowski D. Beginning with the application in mind: designing and planning health behavior change interventions to enhance dissemination. Ann. Behav. Med. 2005, 29(Suppl.):66S-75S.
28. Greenhalgh T., Robert G., Macfarlane F., Bate P., Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004, 82(4):581-629.
29. Helfrich C.D., Damschroder L.J., Hagedorn H.J., Daggett G.S., Sahay A., Ritchie M., et al. A critical synthesis of literature on the promoting action on research implementation in health services (PARIHS) framework. Implement. Sci. 2010, 5:82.
30. Tabak R.G., Khoong E.C., Chambers D., Brownson R.C. Models in dissemination and implementation research: useful tools in public health services and systems research. Front. Public Health Serv. Syst. Res. 2013, 2(1). Article 8. Available at: http://uknowledge.uky.edu/frontiersinphssr/vol2/iss1/8.
31. Damschroder L.J., Goodrich D.E., Robinson C.H., Fletcher C.E., Lowery J.C. A systematic exploration of differences in contextual factors related to implementing the MOVE! Weight Management Program in VA: a Mixed Methods Study. BMC Health Serv. Res. 2011, 11(1):248.
32. Barr V.J., Robinson S., Marin-Link B., Underhill L., Dotts A., Ravensdale D., et al. The expanded Chronic Care Model: an integration of concepts and strategies from population health promotion and the Chronic Care Model. Hosp. Q. 2003, 7(1):73-82.
33. Koh H.K., Brach C., Harris L.M., Parchman M.L. A proposed 'health literate care model' would constitute a systems approach to improving patients' engagement in care. Health Aff. (Millwood) 2013, 32(2):357-367.
34. Glasgow R.E., McKay H.G., Piette J.D., Reynolds K.D. The RE-AIM framework for evaluating interventions: what can it tell us about approaches to chronic illness management. Patient Educ. Couns. 2001, 44:119-127.
35. Wagner E.H., Davis C., Schaefer J., Von Korff M., Austin B. A survey of leading chronic disease management programs: are they consistent with the literature?. Manag. Care Q. 1999, 7(3):56-66.
36. Coleman K., Austin B.T., Brach C., Wagner E.H. Evidence on the Chronic Care Model in the new millennium. Health Aff. (Millwood) 2009, 28(1):75-85.
37. Nundy S., Dick J.J., Goddu A.P., Hogan P., Lu C.Y., Solomon M.C., et al. Using mobile health to support the chronic care model: developing an institutional initiative. Int. J. Telemed. Appl. 2012, 2012:871925.
38. DeWalt D.A., Broucksou K.A., Hawk V., Brach C., Hink A., Rudd R., et al. Developing and testing the health literacy universal precautions toolkit. Nurs. Outlook 2011, 59(2):85-94.
39. Agency for Health Care Policy and Research Health Literacy Universal Precautions Toolkit April 2013, Available from, (accessed 05.01.13). http://www.ahrq.gov/professionals/quality-patient-safety/quality-resources/tools/literacy-toolkit/index.html.
40. Kessler R.S., Purcell E.P., Glasgow R.E., Klesges L.M., Benkeser R.M., Peek C.J. What does it mean to "Employ" the RE-AIM model?. Eval. Health Prof. 2012, 36(March (1)):44-46.
41. Gaglio B., Glasgow R.E. The RE-AIM framework: a systmatic review of use over time. Am. J. Public Health 2013, April 18 (epub ahead of print).
42. Bakken S., Ruland C.M. Translating clinical informatics interventions into routine clinical care: how can the RE-AIM framework help?. J. Am. Med. Inform. Assoc. 2009, 16(6):889-897.
43. Glasgow R.E., Nelson C.C., Kearney K.A., Reid R., Ritzwoller D.P., Strecher V.J., et al. Reach, engagement, and retention in an internet-based weight loss program in a multi-site randomized controlled trial. JMIR 2007, 9(May (2)):e11.
44. Glasgow R.E., Dickinson P., Fisher L., Christiansen S., Toobert D.J., Bender B.G., et al. Use of RE-AIM to develop a multi-media facilitation tool for the patient-centered medical home. Implement. Sci. 2011, 6:118.
45. van Zutphen M., Milder I.E., Bemelmans W.J. Integrating an eHealth program for pregnant women in midwifery care: a feasibility study among midwives and program users. J. Med. Internet Res. 2009, 11(1):e7.
46. Glasgow R.E., Askew S., Purcell P., Levine E., Stange K.C., Colditz G.A., et al. Use of RE-AIM to address health inequities: application in a low-income community health center-based weight loss and hypertension self-management program. Transl. Behav. Med. 2013, 3(2):200-210.
47. Glasgow R.E., Chambers D. Developing robust, sustainable, implementation systems using rigorous, rapid and relevant science. Clin. Transl. Sci. 2012, 5(1):48-55.
48. Kessler R., Glasgow R.E. A proposal to speed translation of healthcare research into practice: dramatic change is needed. Am. J. Prev. Med. 2011, 40(6):637-644.
49. Etheredge L.M. A rapid-learning health system. Health Aff. (Millwood) 2007, 26(2):w107-w118.
50. Institute of Medicine Assessing Medical Technologies 1985, The National Academies Press, Washington, DC.
51. Rettig R.A. Medical innovation duels cost containment. Health Aff. (Millwood) 1994, 13(3):7-27.
52. Saver R.S. Reimbursing new technologies: why are the courts judging experimental medicine?. Stanford Law Rev. 1992, 44(5):1095-1131.
53. Turchetti G., Spadoni E., Geisler E.E. Health technology assessment. Evaluation of biomedical innovative technologies. IEEE Eng. Med. Biol. Mag. 2010, 29(3):70-76.
54. Sanchez M.A., Rabin B.A., Gaglio B., Henton M., Elzarrad M.K., Purcell E.P., et al. A systematic review of eHealth cancer prevention and control interventions: new technology, same methods, and designs?. Transl. Behav. Med. 2013, (in press).
55. Gold M.R., Siegel J.E., Russell L.B., Weinstein M.C. Cost-Effectiveness in Health and Medicine 2003, Oxford University Press, New York.
56. Ritzwoller D.P., Sukhanova A., Gaglio B., Glasgow R.E. Costing behavioral interventions: a practical guide to enhance translation. Ann. Behav. Med. 2009, 37(2):218-227.
57. Gary K., Enquobahrie A., Ibanez L., Cheng P., Yaniv Z., Cleary K., et al. Agile methods for open source safety-critical software. Softw. Pract. Exp. 2011, 41(9):945-962.
58. Rivera D.E., Pew M.D., Collins L.M. Using engineering control principles to inform the design of adaptive interventions: a conceptual introduction. Drug Alcohol Depend. 2007, 88(Suppl. 2):S31-S40.
59. Lillie E.O., Patay B., Diamant J., Issell B., Topol E.J., Schork N.J. The n-of-1 clinical trial: the ultimate strategy for individualizing medicine?. Per Med. 2011, 8(2):161-173.
60. Zucker D.R., Ruthazer R., Schmid C.H. Individual (N-of-1) trials can be combined to give population comparative treatment effect estimates: methodologic considerations. J. Clin. Epidemiol. 2010, 63(12):1312-1323.
61. Backman C.L., Harris S.R., Chisholm J.A., Monette A.D. Single-subject research in rehabilitation: a review of studies using AB, withdrawal, multiple baseline, and alternating treatments designs. Arch. Phys. Med. Rehabil. 1997, 78(10):1145-1153.
62. Collins L., Murphy S.A., Strecher V. The multiphase optimization strategy (MOST) and the sequentical mulatiple assignment randomized trial (SMART): new methods for more potent eHealth interventions. Am. J. Prev. Med. 2007, 32(May (5 Suppl.)):S112-S118.
63. Norman G.J. Answering the what works? Question in health behavior change. Am. J. Prev. Med. 2008, 34(5):449-450.
64. Sox H.C., Greenfield S. Comparative effectiveness research: a report from the Institute of Medicine. Ann. Intern. Med. 2009, 151(3):203-205.
65. Selby J.V., Beal A.C., Frank L. The Patient-Centered Outcomes Research Institute (PCORI) national priorities for research and initial research agenda. JAMA 2012, 307(15):1583-1584.
66. Tunis S.R., Stryer D.B., Clancey C.M. Practical clinical trials: increasing the value of clinical research for decision making in clinical and health policy. JAMA 2003, 290:1624-1632.
67. Glasgow R.E., Gaglio B., Bennett G., Jerome G.J., Yeh H.C., Sarwer D.B., et al. Applying the PRECIS criteria to describe three effectiveness trials of weight loss in obese patients with comorbid conditions. Health Serv. Res. 2012, 47(3 Pt 1):1051-1067.
68. Koppenaal T., Linmans J., Knottnerus J.A., Spigt M. Pragmatic vs. explanatory: an adaptation of the PRECIS tool helps to judge the applicability of systematic reviews for daily practice. J. Clin. Epidemiol. 2011, 64(10):1095-1101.
69. Brown C.A., Lilford R.J. The stepped wedge trial design: a systematic review. BMC Med. Res. Methodol. 2006, 6:54.
70. Gierisch J.M., DeFrank J.T., Bowling J.M., Rimer B.K., Matuszewski J.M., Farrell D., et al. Finding the minimal intervention needed for sustained mammography adherence. Am. J. Prev. Med. 2010, 39(4):334-344.
71. Glasgow R.E., Fisher L., Strycker L.A., Hessler D., Toobert D.J., King D.K., et al. Minimal intevention needed for change: definition, use, and value for improving health and health research. Transl. Behav. Med. 2013, (in press).
72. Hussey M.A., Hughes J.P. Design and analysis of stepped wedge cluster randomized trials. Contemp. Clin. Trials. 2007, 28(2):182-191.
73. Danaher B.G., Seeley J.R. Methodological issues in research on web-based behavioral interventions. Ann. Behav. Med. 2009, 38(August (1)):28-39.
74. Koh H.K., Berwick D.M., Clancy C.M., Baur C., Brach C., Harris L.M., et al. New federal policy initiatives to boost health literacy can help the nation move beyond the cycle of costly 'crisis care'. Health Aff. (Millwood) 2012, 31(2):434-443.
75. Glasgow R.E., Steiner J.F. Comparative effectiveness research to accelerate translation: recommendations for an emerging field of science. Dissemination and Implementation Research in Health: Translating Science and Practice 2012, 72-93. Oxford University Press, New York. R.C. Brownson, G. Colditz, E. Proctor (Eds.).
76. Krist A.H., Woolf S.H. A vision for patient-centered health information systems. JAMA 2011, 305(3):300-301.
77. Shapiro J.R., Koro T., Doran N., Thompson S., Sallis J.F., Calfas K., et al. Text4Diet: a randomized controlled study using text messaging for weight loss behaviors. Prev. Med. 2012, 55(5):412-417.
78. Murdoch T.B., Detsky A.S. The inevitable application of big data to health care. JAMA 2013, 309(13):1351-1352.
79. Viswanath K. Cyberinfrastructure: an extraordinary opportunity to bridge health and communication inequalities. Am. J. Prev. Med. 2011, 40(5 Suppl. 2):S245-S248.
80. Yasnoff W.A., Sweeney L., Shortliffe E.H. Putting health IT on the path to success. JAMA 2013, 309(10):989-990.
81. Estabrooks P.A., Boyle M., Emmons K.M., Glasgow R.E., Hesse B.W., Kaplan R.M., Krist A.H., Moser R.P., Taylor M.V. Harmonized patient-reported data elements in the electronic health record: supporting meaningful use by primary care action on health behaviors and key psychosocial factors. J Am Med Inform Assoc. 2012, 19(4):575-582.
82. Christensen, Clayton M., Jerome H., Grossman M.D., Jason Hwang M.D. The Innovator's Prescription: A Disruptive Solution for Health Care 2009, McGraw-Hill, http://www.hbs.edu/faculty/product/35729.