Assessing the internal and external validity of mobile health physical activity promotion interventions: A systematic literaturereview using the RE-AIM framework

Journal of Medical Internet Research

Volumn 15, Issue 10, 2013, Pages

  Blackman, Kacie C A ^a   Zoellner, Jamie ^a   Berrey, Leanna M ^a   Alexander, Ramine ^a   Fanning, Jason ^b   Hill, Jennie L ^a   Estabrooks, Paul A ^a,c  

^a VIRGINIA POLYTECHNIC INSTITUTE AND STATE UNIVERSITY   (United States)

^b UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^c VIRGINIA TECH CARILION SCHOOL OF MEDICINE   (United States)

Author keywords

Generalizability; Mobile technology; Physical activity; Review

Indexed keywords

GENERALIZABILITY; HEALTH PROMOTION; HUMAN; MOBILE TECHNOLOGY; MOTOR ACTIVITY; PHYSICAL ACTIVITY; REVIEW; TELEMEDICINE; VALIDATION STUDY;

GENERALIZABILITY; MOBILE TECHNOLOGY; PHYSICAL ACTIVITY; REVIEW;

HEALTH PROMOTION; HUMANS; MOTOR ACTIVITY; TELEMEDICINE;

EID: 84887877073     PISSN: None     EISSN: 14388871     Source Type: Journal    
DOI: 10.2196/jmir.2745     Document Type: Review

References (63)

1. World Health Organization. 2008. Physical inactivity - a global public health problem URL: http://www.who.int/dietphysicalactivity/factsheet- inactivity/en [WebCite Cache ID 6CoJleLjJ]
2. Trojano RP, Berrigan D, Dodd KW, Mâsse LC, Tilert T, McDowell M. Physical activity in the United States measured by accelerometer. Med Sci Sports Exerc 2008 Jan;40(1):181-188. [doi: 10.1249/mss.0b013e31815a51b3] [Medline: 18091006]
3. Tucker JM, Welk GJ, Beyler NK. Physical activity in U.S.: adults compliance with the Physical Activity Guidelines for Americans. Am J Prev Med 2011 Apr;40(4):454-461. [doi: 10.1016/j.amepre.2010.12.016] [Medline: 21406280]
4. Davies CA, Spence JC, Vandelanotte C, Caperchione CM, Mummery WK. Meta-analysis of internet-delivered interventions to increase physical activity levels. Int J Behav Nutr Phys Act 2012;9:52 [FREE Full text] [doi: 10.1186/1479-5868-9-52] [Medline: 22546283]
5. Smith A. Pew Internet & American Life Project. 2010 Jul 07. Mobile Access 2010 URL: http://pewinternet.org/Reports/2010/Mobile-Access-2010.aspx [WebCite Cache ID 6CoN4Wmtq]
6. Lenhart A, Ling R, Campbell S, Purcell K. Pew Internet & American Life Project. 2010 Apr 20. Teens and mobile phones URL: http://pewinternet.org/ Reports/2010/Teens-and-Mobile-Phones.aspx [accessed 2012-12-11] [WebCite Cache ID 6Cos8OAac]
7. Cisco Systems Inc. 2012. Cisco Visual networking index: Global mobile data forecast, 2011-2016 URL: http://www.cisco.com/en/US/solutions/collateral/ ns341/ns525/ns537/ns705/ns827/white-paper-c11-520862.html [WebCite Cache ID 6CooPIV6t]
8. Smith A. Pew Internet & American Life Project. 2012 Jun 26. 17% of cell phone owners do most of their online browsing on their phone, rather than a computer or other device URL: http://pewinternet.org/Reports/2012/Cell- Internet-Use-2012.aspx [WebCite Cache ID 6Cos49n7k]
9. Buchholz SW, Wilbur J, Ingram D, Fogg L. Physical activity text messaging interventions in adults: a systematic review. Worldviews Evid Based Nurs 2013 Aug;10(3):163-173. [doi: 10.1111/wvn.12002] [Medline: 23746267]
10. Fanning J, Mullen SP, McAuley E. Increasing physical activity with mobile devices: a meta-analysis. J Med Internet Res 2012;14(6):e161 [FREE Full text] [doi: 10.2196/jmir.2171] [Medline: 23171838]
11. Martínez-Pérez B, de la Torre-Díez I, López-Coronado M. Mobile health applications for the most prevalent conditions by the World Health Organization: review and analysis. J Med Internet Res 2013;15(6):e120 [FREE Full text] [doi: 10.2196/jmir.2600] [Medline: 23770578]
12. Vodopivec-Jamsek V, de Jongh T, Gurol-Urganci I, Atun R, Car J. Mobile phone messaging for preventive health care. Cochrane Database Syst Rev 2012;12:CD007457. [doi: 10.1002/14651858.CD007457.pub2] [Medline: 23235643]
13. Fjeldsoe BS, Marshall AL, Miller YD. Behavior change interventions delivered by mobile telephone short-message service. Am J Prev Med 2009 Feb;36(2):165-173. [doi: 10.1016/j.amepre.2008.09.040] [Medline: 19135907]
14. Heron KE, Smyth JM. Ecological momentary interventions: incorporating mobile technology into psychosocial and health behaviour treatments. Br J Health Psychol 2010 Feb;15(Pt 1):1-39 [FREE Full text] [doi: 10.1348/135910709X466063] [Medline: 19646331]
15. Krishna S, Boren SA, Balas EA. Healthcare via cell phones: a systematic review. Telemed J E Health 2009 Apr;15(3):231-240. [doi: 10.1089/tmj.2008.0099] [Medline: 19382860]
16. Lau P, Lau EY, Wong DP, Ransdell L. A systematic review of information and communication technology-based interventions for promoting physical activity behavior change in children and adolescents. J Med Internet Res 2011;13(3):e48 [FREE Full text] [doi: 10.2196/jmir.1533] [Medline: 21749967]
17. Militello LK, Kelly SA, Melnyk BM. Systematic review of text-messaging interventions to promote healthy behaviors in pediatric and adolescent populations: implications for clinical practice and research. Worldviews Evid Based Nurs 2012 Apr;9(2):66-77. [doi: 10.1111/j.1741-6787.2011.00239.x] [Medline: 22268959]
18. van den Berg MH, Schoones JW, Vliet Vlieland TP. Internet-based physical activity interventions: a systematic review of the literature. J Med Internet Res 2007;9(3):e26 [FREE Full text] [doi: 10.2196/jmir.9.3.e26] [Medline: 17942388]
19. Dolan B. 2010. Smartphones to drive mHealth to 500 million users URL: http://mobihealthnews.com/9523/smartphones-to-drive-mhealth-to-500-million- users/ [WebCite Cache ID 6CotJPpNY]
20. Estabrooks PE, Gyurcsik NC. Evaluating the impact of behavioral interventions that target physical activity: issues of generalizability and public health. Psychology of Sport and Exercise 2003 Jan;4(1):41-55. [doi: 10.1016/s1469-0292(02)00016-x]
21. Riley WT, Glasgow RE, Etheredge L, Abernethy AP. Rapid, responsive, relevant (R3) research: a call for a rapid learning health research enterprise. Clin Transl Med 2013;2(1):10 [FREE Full text] [doi: 10.1186/2001-1326-2-10] [Medline: 23663660]
22. Danaher BG, Lichtenstein E, McKay HG, Seeley JR. Use of non-assigned smoking cessation programs among participants of a Web-based randomized controlled trial. J Med Internet Res 2009;11(2):e26 [FREE Full text] [doi: 10.2196/jmir.1172] [Medline: 19632976]
23. Fischer S, Stewart TE, Mehta S, Wax R, Lapinsky SE. Handheld computing in medicine. J Am Med Inform Assoc 2003 Apr;10(2):139-149 [FREE Full text] [Medline: 12595403]
24. Eysenbach G, CONSORT-EHEALTH Group. CONSORT-EHEALTH: improving and standardizing evaluation reports of Web-based and mobile health interventions. J Med Internet Res 2011;13(4):e126 [FREE Full text] [doi: 10.2196/jmir.1923] [Medline: 22209829]
25. Glasgow RE, Klesges LM, Dzewaltowski DA, Bull SS, Estabrooks P. The future of health behavior change research: what is needed to improve translation of research into health promotion practice? Ann Behav Med 2004 Feb;27(1):3-12. [doi: 10.1207/s15324796abm2701-2] [Medline: 14979858]
26. Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health 1999 Sep;89(9):1322-1327. [Medline: 10474547]
27. Akers JD, Estabrooks PA, Davy BM. Translational research: bridging the gap between long-term weight loss maintenance research and practice. J Am Diet Assoc 2010 Oct;110(10):1511-22, 1522.e1 [FREE Full text] [doi: 10.1016/j.jada.2010.07.005] [Medline: 20869490]
28. Allen K, Zoellner J, Motley M, Estabrooks PA. Understanding the internal and external validity of health literacy interventions: a systematic literature review using the RE-AIM framework. J Health Commun 2011;16 Suppl 3:55-72. [doi: 10.1080/10810730.2011.604381] [Medline: 21951243]
29. Antikainen I, Ellis R. A RE-AIM evaluation of theory-based physical activity interventions. J Sport Exerc Psychol 2011 Apr;33(2):198-214. [Medline: 21558580]
30. Bull SS, Gillette C, Glasgow RE, Estabrooks P. Work site health promotion research: to what extent can we generalize the results and what is needed to translate research to practice? Health Educ Behav 2003 Oct;30(5):537-549. [Medline: 14582596]
31. Dzewaltowski DA, Estabrooks PA, Klesges LM, Bull S, Glasgow RE. Behavior change intervention research in community settings: how generalizable are the results? Health Promot Int 2004 Jun;19(2):235-245 [FREE Full text] [Medline: 15128715]
32. Estabrooks P, Dzewaltowski DA, Glasgow RE, Klesges LM. Reporting of validity from school health promotion studies published in 12 leading journals, 1996-2000. J Sch Health 2003 Jan;73(1):21-28. [Medline: 12621720]
33. Glasgow RE, Bull SS, Gillette C, Klesges LM, Dzewaltowski DA. Behavior change intervention research in healthcare settings: a review of recent reports with emphasis on external validity. Am J Prev Med 2002 Jul;23(1):62-69. [Medline: 12093425]
34. Kessler RS, Purcell EP, Glasgow RE, Klesges LM, Benkeser RM, Peek CJ. What does it mean to "employ" the RE-AIM model? Eval Health Prof 2013 Mar;36(1):44-66. [doi: 10.1177/0163278712446066] [Medline: 22615498]
35. Klesges LM, Dzewaltowski DA, Glasgow RE. Review of external validity reporting in childhood obesity prevention research. Am J Prev Med 2008 Mar;34(3):216-223. [doi: 10.1016/j.amepre.2007.11.019] [Medline: 18312810]
36. McMahon S, Fleury J. External validity of physical activity interventions for community-dwelling older adults with fall risk: a quantitative systematic literature review. J Adv Nurs 2012 Oct;68(10):2140-2154. [doi: 10.1111/j.1365-2648.2012.05974.x] [Medline: 22416905]
37. White SM, McAuley E, Estabrooks PA, Courneya KS. Translating physical activity interventions for breast cancer survivors into practice: an evaluation of randomized controlled trials. Ann Behav Med 2009 Feb;37(1):10-19. [doi: 10.1007/s12160-009-9084-9] [Medline: 19255819]
38. Estabrooks PA, Allen KC. Updating, employing, and adapting: a commentary on What does it mean to "employ" the RE-AIM model. Eval Health Prof 2013 Mar;36(1):67-72. [doi: 10.1177/0163278712460546] [Medline: 23045308]
39. Aarons GA, Green AE, Palinkas LA, Self-Brown S, Whitaker DJ, Lutzker JR, et al. Dynamic adaptation process to implement an evidence-based child maltreatment intervention. Implement Sci 2012;7:32 [FREE Full text] [doi: 10.1186/1748-5908-7-32] [Medline: 22512914]
40. National Institutes of Health. 2012. NIH clinical research trials and you: The basics URL: http://www.nih.gov/health/clinicaltrials/basics.htm [WebCite Cache ID 6IpjfsNhO]
41. Cohen J. A Coefficient of Agreement for Nominal Scales. Educational and Psychological Measurement 1960 Apr 01;20(1):37-46. [doi: 10.1177/ 001316446002000104]
42. Shadish WR, Cook TD, Campbell DT. Experimental and quasi-experimental designs for generalized causal inference. Boston: Houghton-Mifflin; 2002.
43. Burke LE, Conroy MB, Sereika SM, Elci OU, Styn MA, Acharya SD, et al. The effect of electronic self-monitoring on weight loss and dietary intake: a randomized behavioral weight loss trial. Obesity (Silver Spring) 2011 Feb;19(2):338-344 [FREE Full text] [doi: 10.1038/oby.2010.208] [Medline: 20847736]
44. Burke LE, Styn MA, Glanz K, Ewing LJ, Elci OU, Conroy MB, et al. SMART trial: A randomized clinical trial of self-monitoring in behavioral weight management-design and baseline findings. Contemp Clin Trials 2009 Nov;30(6):540-551 [FREE Full text] [doi: 10.1016/j.cct.2009.07.003] [Medline: 19665588]
45. Conroy MB, Yang K, Elci OU, Gabriel KP, Styn MA, Wang J, et al. Physical activity self-monitoring and weight loss: 6-month results of the SMART trial. Med Sci Sports Exerc 2011 Aug;43(8):1568-1574. [doi: 10.1249/MSS. 0b013e31820b9395] [Medline: 21200337]
46. Consolvo S, Klasnja P, McDonald DW, Avrahami D, Froehlich J, LeGrand L, et al. Flowers or a robot army? Encouraging awareness & activity with personal, mobile displays. : UbiComp '08; 2008 Presented at: Proceedings of the 10th International Conference on Ubiquitous Computing; September 21-24; Seoul, Korea p. 54-63.
47. Fukuoka Y, Lindgren T, Jong S. Qualitative exploration of the acceptability of a mobile phone and pedometer-based physical activity program in a diverse sample of sedentary women. Public Health Nurs 2012;29(3):232-240. [doi: 10.1111/j.1525-1446.2011.00997.x] [Medline: 22512424]
48. Fukuoka Y, Kamitani E, Dracup K, Jong SS. New insights into compliance with a mobile phone diary and pedometer use in sedentary women. J Phys Act Health 2011 Mar;8(3):398-403. [Medline: 21487139]
49. Fukuoka Y, Vittinghoff E, Jong SS, Haskell W. Innovation to motivation-pilot study of a mobile phone intervention to increase physical activity among sedentary women. Prev Med 2010;51(3-4):287-289 [FREE Full text] [doi: 10.1016/j.ypmed.2010.06.006] [Medline: 20600263]
50. King AC, Ahn DK, Oliveira BM, Atienza AA, Castro CM, Gardner CD. Promoting physical activity through hand-held computer technology. Am J Prev Med 2008 Feb;34(2):138-142 [FREE Full text] [doi: 10.1016/j.amepre.2007.09.025] [Medline: 18201644]
51. Nguyen HQ, Gill DP, Wolpin S, Steele BG, Benditt JO. Pilot study of a cell phone-based exercise persistence intervention post-rehabilitation for COPD. Int J Chron Obstruct Pulmon Dis 2009;4:301-313 [FREE Full text] [Medline: 19750190]
52. Shapiro JR, Bauer S, Hamer RM, Kordy H, Ward D, Bulik CM. Use of text messaging for monitoring sugar-sweetened beverages, physical activity, and screen time in children: a pilot study. J Nutr Educ Behav 2008;40(6):385-391 [FREE Full text] [doi: 10.1016/j.jneb.2007.09.014] [Medline: 18984496]
53. Hurling R, Catt M, Boni MD, Fairley BW, Hurst T, Murray P, et al. Using internet and mobile phone technology to deliver an automated physical activity program: randomized controlled trial. J Med Internet Res 2007;9(2):e7 [FREE Full text] [doi: 10.2196/jmir.9.2.e7] [Medline: 17478409]
54. Prestwich A, Perugini M, Hurling R. Can implementation intentions and text messages promote brisk walking? A randomized trial. Health Psychol 2010 Jan;29(1):40-49. [doi: 10.1037/a0016993] [Medline: 20063934]
55. Sirriyeh R, Lawton R, Ward J. Physical activity and adolescents: an exploratory randomized controlled trial investigating the influence of affective and instrumental text messages. Br J Health Psychol 2010 Nov;15(Pt 4):825-840. [doi: 10.1348/135910710X486889] [Medline: 20156396]
56. Fjeldsoe BS, Miller YD, Marshall AL. MobileMums: a randomized controlled trial of an SMS-based physical activity intervention. Ann Behav Med 2010 May;39(2):101-111. [doi: 10.1007/s12160-010-9170-z] [Medline: 20174902]
57. Kirwan M, Duncan MJ, Vandelanotte C, Mummery WK. Using smartphone technology to monitor physical activity in the 10,000 Steps program: a matched case-control trial. J Med Internet Res 2012;14(2):e55 [FREE Full text] [doi: 10.2196/jmir.1950] [Medline: 22522112]
58. Lubans DR, Morgan PJ, Okely AD, Dewar D, Collins CE, Batterham M, et al. Preventing Obesity Among Adolescent Girls: One-Year Outcomes of the Nutrition and Enjoyable Activity for Teen Girls (NEAT Girls) Cluster Randomized Controlled Trial. Arch Pediatr Adolesc Med 2012 Sep 1;166(9):821-827. [doi: 10.1001/archpediatrics.2012.41] [Medline: 22566517]
59. Lubans DR, Morgan PJ, Dewar D, Collins CE, Plotnikoff RC, Okely AD, et al. The Nutrition and Enjoyable Activity for Teen Girls (NEAT girls) randomized controlled trial for adolescent girls from disadvantaged secondary schools: rationale, study protocol, and baseline results. BMC Public Health 2010;10:652 [FREE Full text] [doi: 10.1186/1471-2458-10-652] [Medline: 21029467]
60. Cheung P, Chow BC, Parfitt G. Using environmental stimuli in physical activity intervention for school teachers: A pilot study. Int Electron J Health Educ 2008;11:47-56.
61. Newton KH, Wiltshire EJ, Elley CR. Pedometers and text messaging to increase physical activity: randomized controlled trial of adolescents with type 1 diabetes. Diabetes Care 2009 May;32(5):813-815 [FREE Full text] [doi: 10.2337/dc08-1974] [Medline: 19228863]
62. Liu WT, Wang CH, Lin HC, Lin SM, Lee KY, Lo YL, et al. Efficacy of a cell phone-based exercise programme for COPD. Eur Respir J 2008 Sep;32(3):651-659 [FREE Full text] [doi: 10.1183/09031936.00104407] [Medline: 18508824]
63. The Cochrane Collaboration. 2012. Intention to treat issues URL: http://www.cochrane-net.org/openlearning/html/mod14-4.htm [WebCite Cache ID 6Ipjp6IRU]