Methodological issues in research on web-based behavioral interventions

Annals of Behavioral Medicine

Volumn 38, Issue 1, 2009, Pages 28-39

  Danaher, Brian G ^a   Seeley, John R ^a  

^a OREGON RESEARCH INSTITUTE   (United States)

Author keywords

Design; Engagement; Internet; Interventions; Measurement; Recruitment; Web based

Indexed keywords

BEHAVIOR; COMPARATIVE STUDY; HEALTH CARE QUALITY; INTERVENTION STUDY; METHODOLOGY; PARTICIPANT OBSERVATION; RESEARCH; REVIEW; VALIDITY; WEB BASED INTERVENTION; WEB BROWSER;

BEHAVIOR THERAPY; HUMANS; INTERNET; PATIENT ACCEPTANCE OF HEALTH CARE; PATIENT SATISFACTION; PATIENT SELECTION; RESEARCH DESIGN; THERAPY, COMPUTER-ASSISTED;

EID: 70449526709     PISSN: 08836612     EISSN: None     Source Type: Journal    
DOI: 10.1007/s12160-009-9129-0     Document Type: Review

References (83)

1. Onken LS, Blaine JD, Battjes RJ. Behavioral therapy research: A conceptualization of a process. In: Henngler SW, Amentos R, eds. Innovative Approaches From Difficult-To-Treat Populations. Washington: American Psychiatric Press; 1997: 477-485.
2. TR Eng DH Gustafson J Henderson H Jimison K Patrick 1999 Introduction to evaluation of interactive health communication applications. Science Panel on Interactive Communication and Health Am J Prev Med 16 1 10 15 10.1016/S0749-3797(98)00107-X 9894549
3. BJ Rounsaville KM Carroll LS Onken 2001 A stage model of behavioral therapies research: Getting started and moving on from Stage I Clin Psychol Sci Pract 8 133 142
4. RE Glasgow TM Vogt SM Boles 1999 Evaluating the public health impact of health promotion interventions: The RE-AIM framework Am J Public Health 89 9 1322 1327 10.2105/AJPH.89.9.1322 10474547
5. KH Dansky D Thompson T Sanner 2006 A framework for evaluating eHealth research Eval Program Plann 29 397 404 10.1016/j.evalprogplan.2006.08.009 17950868 (Pubitemid 44660992)
6. KM Carroll BJ Rounsaville 2003 Bridging the gap: A hybrid model to link efficacy and effectiveness research in substance abuse treatment Psychiatr Serv 54 3 333 339 10.1176/appi.ps.54.3.333 12610240 (Pubitemid 36753005)
7. SR Tunis DB Stryer CM Clancy 2003 Practical clinical trials: Increasing the value of clinical research for decision making in clinical and health policy JAMA 290 12 1624 1632 10.1001/jama.290.12.1624 14506122 (Pubitemid 37430387)
8. M Hotopf R Churchill G Lewis 1999 Pragmatic randomised controlled trials in psychiatry Br J Psychiatry 175 217 223 10.1192/bjp.175.3.217 10645321
9. RE Glasgow 2007 eHealth evaluation and dissemination research Am J Prev Med 32 5 Suppl S119 S126 10.1016/j.amepre.2007.01.023 17466816 (Pubitemid 46656328)
10. J Harvey-Berino SJ Pintauro EC Gold 2002 The feasibility of using Internet support for the maintenance of weight loss Behav Modif 26 1 103 116 10.1177/0145445502026001006 11799651 (Pubitemid 34242399)
11. KR Lorig PL Ritter DD Laurent K Plant 2006 Internet-based chronic disease self-management: A randomized trial Med Care 44 11 964 971 10.1097/01.mlr. 0000233678.80203.c1 17063127 (Pubitemid 44674028)
12. B Ljotsson C Lundin K Mitsell, et al. 2007 Remote treatment of bulimia nervosa and binge eating disorder: A randomized trial of Internet-assisted cognitive behavioural therapy Behav Res Ther 45 4 649 661 10.1016/j.brat.2006. 06.010 16899213 (Pubitemid 46282621)
13. VJ Strecher S Shiffman R West 2005 Randomized controlled trial of a web-based computer-tailored smoking cessation program as a supplement to nicotine patch therapy Addiction 100 5 682 688 10.1111/j.1360-0443.2005.01093.x 15847626 (Pubitemid 40646294)
14. DF Tate RR Wing RA Winett 2001 Using Internet technology to deliver a behavioral weight loss program JAMA 285 9 1172 1177 10.1001/jama.285.9.1172 11231746
15. GE Bond R Burr FM Wolf, et al. 2006 Preliminary findings of the effects of comorbidities on a web-based intervention on self-reported blood sugar readings among adults age 60 and older with diabetes Telemed J E Health 12 6 707 710 10.1089/tmj.2006.12.707 17250494 (Pubitemid 46146237)
16. DH Gustafson R Hawkins E Boberg, et al. 1999 Impact of a patient-centered, computer-based health information/support system Am J Prev Med 16 1 1 9 10.1016/S0749-3797(98)00108-1 9894548
17. BS Gerber MC Solomon TL Shaffer MT Quinn RB Lipton 2007 Evaluation of an internet diabetes self-management training program for adolescents and young adults Diabetes Technol Ther 9 1 60 67 10.1089/dia.2006.0058 17316099 (Pubitemid 46309708)
18. RE Glasgow KW Davidson PL Dobkin J Ockene B Spring 2006 Practical behavioral trials to advance evidence-based behavioral medicine Ann Behav Med 31 1 5 13 10.1207/s15324796abm3101-3 16472033 (Pubitemid 43297280)
19. SC Wangberg 2008 An Internet-based diabetes self-care intervention tailored to self-efficacy Health Educ Res 23 1 170 179 10.1093/her/cym014 17412717
20. DF Tate EH Jackvony RR Wing 2003 Effects of Internet behavioral counseling on weight loss in adults at risk for type 2 diabetes: A randomized trial JAMA 289 14 1833 1836 10.1001/jama.289.14.1833 12684363 (Pubitemid 37430254)
21. D Thompson T Baranowski K Cullen, et al. 2008 Food, Fun and Fitness Internet program for girls: Influencing log-on rate Health Educ Res 23 2 228 237 10.1093/her/cym020 17595175
22. G Clarke D Eubanks E Reid, et al. 2005 Overcoming Depression on the Internet (ODIN) (2): A randomized trial of a self-help depression skills program with reminders J Med Internet Res 7 2 e16 10.2196/jmir.7.2.e16 15998607 (Pubitemid 41800632)
23. L Lenert RF Muñoz JE Perez A Bansod 2004 Automated e-mail messaging as a tool for improving quit rates in an Internet smoking cessation intervention J Am Med Inform Assoc 11 4 235 240 10.1197/jamia.M1464 15064291 (Pubitemid 38887142)
24. LM Collins SA Murphy V Strecher 2007 The Multiphase Optimization Strategy (MOST) and the Sequential Multiple Assignment Randomized Trial (SMART) new methods for more potent ehealth interventions Am J Prev Med 32 5 Suppl S112 S118 10.1016/j.amepre.2007.01.022 17466815 (Pubitemid 46634959)
25. VJ Strecher JB McClure GL Alexander, et al. 2008 Web-based smoking-cessation programs: Results of a randomized trial Am J Prev Med 34 5 373 381 10.1016/j.amepre.2007.12.024 18407003
26. GJ Norman 2008 Answering the "what works?" Question in health behavior change Am J Prev Med 34 5 449 450 10.1016/j.amepre.2008.02.005 18407014
27. LL Street JB Luoma 2002 Control groups in psychosocial intervention research: Ethical and methodological issues Ethics Behav 12 1 1 30 10.1207/S15327019EB1201-1 12171079
28. R Mangunkusumo J Brug J Duisterhout H de Koning H Raat 2007 Feasibility, acceptability, and quality of Internet-administered adolescent health promotion in a preventive-care setting Health Educ Res 22 1 1 13 10.1093/her/cyl010 16714366 (Pubitemid 46134971)
29. AA Celio AJ Winzelberg DE Wilfley, et al. 2000 Reducing risk factors for eating disorders: Comparison of an Internet- and a classroom-delivered psychoeducational program J Consult Clin Psychol 68 4 650 657 10.1037/0022-006X.68.4.650 10965640
30. CA Patten IT Croghan TM Meis, et al. 2006 Randomized clinical trial of an Internet-based versus brief office intervention for adolescent smoking cessation Patient Educ Couns 64 249 258 10.1016/j.pec.2006.03.001 16616449 (Pubitemid 44772964)
31. RM Steele WK Mummery T Dwyer 2007 Examination of program exposure across intervention delivery modes: Face-to-face versus internet Int J Behav Nutr Phys Activ 4 7 10.1186/1479-5868-4-7 (Pubitemid 46511059)
32. P Carlbring E Nilsson-Ihrfelt J Waara, et al. 2005 Treatment of panic disorder: Live therapy vs. self-help via the Internet Behav Res Ther 43 10 1321 1333 10.1016/j.brat.2004.10.002 16086983 (Pubitemid 41116275)
33. B Klein JC Richards DW Austin 2005 Efficacy of Internet therapy for panic disorder J Behav Ther Exp Psychiatry 37 213 238 10.1016/j.jbtep.2005.07.001 16126161
34. G Orbach S Lindsay S Grey 2006 A randomised placebo-controlled trial of a self-help Internet-based intervention for test anxiety Behav Res Ther 45 483 496 10.1016/j.brat.2006.04.002 16814744
35. K Rothert VJ Strecher LA Doyle, et al. 2006 Web-based weight management programs in an integrated health care setting: A randomized, controlled trial Obesity 14 2 266 272 10.1038/oby.2006.34 16571852
36. HH Severson JS Gordon BG Danaher L Akers 2008 ChewFree.com: Evaluation of a Web-based cessation program for smokeless tobacco users Nicotine Tob Res 10 2 381 391 10.1080/14622200701824984 18236303 (Pubitemid 351201322)
37. BG Danaher K Smolkowski JR Seeley HH Severson 2008 Mediators of a successful Web-based smokeless tobacco cessation program Addiction 103 1706 1712 10.1111/j.1360-0443.2008.02295.x 18715238
38. L Ström R Pettersson G Andersson 2000 A controlled trial of self-help treatment of recurrent headache conducted via the Internet J Consult Clin Psychol 68 4 722 727 10.1037/0022-006X.68.4.722 10965647
39. H Spittaels I De Bourdeaudhuij C Vandelanotte 2007 Evaluation of a website-delivered computer-tailored intervention for increasing physical activity in the general population Prev Med 44 3 209 217 10.1016/j.ypmed.2006. 11.010 17197015 (Pubitemid 46330497)
40. M Jones KH Luce MI Osborne, et al. 2008 Randomized, controlled trial of an internet-facilitated intervention for reducing binge eating and overweight in adolescents Pediatrics 121 3 453 462 10.1542/peds.2007-1173 18310192
41. TD Borkovec J Miranda 1999 Between-group psychotherapy outcome research and basic science J Clin Psychol 55 2 147 158 10.1002/(SICI)1097-4679(199902)55: 2<147::AID-JCLP2>3.0.CO;2-V 10100816 (Pubitemid 29058842)
42. KG Hursey JC Rains DB Penzien JM Nash RA Nicholson 2005 Behavioral headache research: Methodologic considerations and research design alternatives Headache 45 5 466 478 10.1111/j.1526-4610.2005.05098.x 15953263 (Pubitemid 40847169)
43. M Koo H Skinner 2005 Challenges of internet recruitment: A case study with disappointing results J Med Internet Res 7 1 e6 10.2196/jmir.7.1.e6 15829478 (Pubitemid 41800642)
44. JM Watson DJ Torgerson 2006 Increasing recruitment to randomised trials: A review of randomised controlled trials BMC Med Res Methodol 6 34 10.1186/1471-2288-6-34 16854229 (Pubitemid 44350433)
45. JS Gordon L Akers HH Severson BG Danaher SM Boles 2006 Successful participant recruitment strategies for an online smokeless tobacco cessation program Nicotine Tob Res 8 S35 S41 10.1080/14622200601039014 17491169
46. HG McKay BG Danaher JR Seeley E Lichtenstein JM Gau 2008 Comparing two Web-based smoking cessation programs: Randomized controlled trial J Med Internet Res 10 5 e40 10.2196/jmir.993 19017582
47. RE Glasgow CC Nelson KA Kearney, et al. 2007 Reach, engagement, and retention in an Internet-based weight loss program in a multi-site randomized controlled trial J Med Internet Res 9 2 e11 10.2196/jmir.9.2.e11 17513282 (Pubitemid 47450389)
48. Horrigan JB, Rainie L, Allen K et al. The ever-shifting Internet population: A new look at Internet access and the digital divide. Pew Internet & American Life, 2003. Retrieved July 23, 2009 from http://www.pewinternet. org/pdfs/PIP-Shifting-Net-Pop-Report.pdf
49. Nielsen J. Digital divide: The three stages. useit com, 2006. Retrieved July 22, 2009 from http://www.useit.com/alertbox/digital-divide.html
50. SC Kalichman L Weinhardt E Benotsch C Cherry 2002 Closing the digital divide in HIV/AIDS care: Development of a theory-based intervention to increase Internet access AIDS Care 14 4 523 537 12204154
51. Kotler P, Roberto N, Lee NR. Social Marketing: Improving the Quality of Life. Thousand Oaks: Sage; 2002.
52. H Christensen A Mackinnon 2006 The law of attrition revisited J Med Internet Res 8 3 e20 10.2196/jmir.8.3.e20 17032636 (Pubitemid 44525426)
53. V Venkatesh MG Morris GB Davis FD Davis 2003 User acceptance of information technology: Toward a unified view MIS Quarterly 27 3 425 478
54. CS Porter N Donthu 2006 Using the Technology Acceptance Model to explain how attitudes determine Internet usage: The role of perceived access barriers and demographics J Bus Res 59 9 999 1007 10.1016/j.jbusres.2006.06.003 (Pubitemid 44464190)
55. LM Ritterband F Thorndike 2006 Internet interventions or patient education web sites? J Med Internet Res 8 3 e18 10.2196/jmir.8.3.e18 17032634 (Pubitemid 44525424)
56. Stanford J, Tauber ER, Fogg BJ, Marable L. Experts vs. online consumers: A comparative credibility study of health and finance Web sites. Consumer Reports Webwatch, 2002. Retrieved July 21, 2009 from http://www. consumerwebwatch.org/pdfs/expert-vs-online-consumers.pdf
57. AL Graham BC Bock NK Cobb R Niaura DB Abrams 2006 Characteristics of smokers reached and recruited to an internet smoking cessation trial: A case of denominators Nicotine Tob Res 8 Suppl 1 S43 S48 10.1080/14622200601042521 17491170
58. GL Alexander GW Divine MP Couper, et al. 2008 Effect of incentives and mailing features on online health program enrollment Am J Prev Med 34 5 382 388 10.1016/j.amepre.2008.01.028 18407004
59. BG Danaher HG McKay JR Seeley 2005 The information architecture of behavior change websites J Med Internet Res 7 2 e12 10.2196/jmir.7.2.e12 15914459 (Pubitemid 41800631)
60. G Eysenbach 2005 The law of attrition J Med Internet Res 7 1 e11 10.2196/jmir.7.1.e11 15829473 (Pubitemid 41800649)
61. M Frenn S Malin AM Villarruel, et al. 2005 Determinants of physical activity and low-fat diet among low income African American and Hispanic middle school students Public Health Nurs 22 2 89 97 10.1111/j.0737-1209.2005.220202.x 15860064 (Pubitemid 40655813)
62. Wikipedia: Web analytics. Wikipedia, 2008. Retrieved July 21, 2009 from http://en.wikipedia.org/wiki/Web-analytics
63. BG Danaher SB Boles L Akers JS Gordon HH Severson 2006 Defining participant exposure measures in Web-based health behavior change programs J Med Internet Res 8 3 e15 10.2196/jmir.8.3.e15 16954125 (Pubitemid 44525435)
64. Associated Press. Nielsen revises its gauge of Web page rankings. Associated Press, 2008. Retrieved July 22, 2009 from http://www.nytimes.com/ 2007/07/10/business/media/10online.html?ex=1341720000&en= 7ad7f7ae739cb786&ei=5088&partner=rssnyt&emc=rss
65. NK Cobb AL Graham BC Bock G Papandonatos DB Abrams 2005 Initial evaluation of a real-world Internet smoking cessation system Nicotine Tob Res 7 2 207 216 10.1080/14622200500055319 16036277 (Pubitemid 40852147)
66. MR McCoy D Couch ND Duncan GS Lynch 2005 Evaluating an Internet weight loss program for diabetes prevention Health Promot Int 20 221 228 10.1093/heapro/dai006 15797900 (Pubitemid 41253329)
67. PJ Danaher GW Mullarkey S Essegaier 2006 Factors affecting website visit duration: A cross-domain analysis J Mark Res 43 2 182 194 10.1509/jmkr.43.2.182 (Pubitemid 43813050)
68. BG Danaher SA Jazdzewski HG McKay CR Hudson 2005 Bandwidth constraints to using video and other rich media in behavior change websites J Med Internet Res 7 4 e49 10.2196/jmir.7.4.e49 16236701
69. Peterson ET. Web Site Measurement Hacks. Sebastopol: O'Reilly Media; 2005.
70. DA Williamson PD Martin MA White, et al. 2005 Efficacy of an internet-based behavioral weight loss program for overweight adolescent African-American girls Eat Weight Disord 10 3 193 203 16277142
71. comScore: Media metrix. Comscore, 2009. Retrieved July 23, 2009 from http://www.comscore.com/metrix/
72. P Farvolden E Denisoff P Selby RM Bagby L Rudy 2005 Usage and longitudinal effectiveness of a Web-based self-help cognitive behavioral therapy program for panic disorder J Med Internet Res 7 1 e7 10.2196/jmir.7.1.e7 15829479 (Pubitemid 41800643)
73. G Andersson P Carlbring A Holmstrom, et al. 2006 Internet-based self-help with therapist feedback and in vivo group exposure for social phobia: a randomized controlled trial J Consult Clin Psychol 74 4 677 686 10.1037/0022-006X.74.4.677 16881775 (Pubitemid 44199120)
74. R Hurling M Catt MD Boni, et al. 2007 Using internet and mobile phone technology to deliver an automated physical activity program: Randomized controlled trial J Med Internet Res 9 2 e7 10.2196/jmir.9.2.e7 17478409 (Pubitemid 47450388)
75. H Brendryen P Kraft 2008 Happy ending: A randomized controlled trial of a digital multi-media smoking cessation intervention Addiction 103 3 478 484 10.1111/j.1360-0443.2007.02119.x 18269367 (Pubitemid 351208112)
76. B Reynolds J Dallery P Shroff M Patak K Leraas 2008 A Web-based contingency management program with adolescent smokers J Appl Behav Anal 41 4 597 601 10.1901/jaba.2008.41-597 19192862
77. VJ Strecher A Marcus K Bishop, et al. 2005 A randomized controlled trial of multiple tailored messages for smoking cessation among callers to the cancer information service J Health Commun 10 Suppl 1 105 118 10.1080/10810730500263810 16377603 (Pubitemid 43041761)
78. KJ Preacher AF Hayes 2008 Asymptotic and resampling strategies for assessing and comparing indirect effects in multiple mediator models Behav Res Methods 40 3 879 891 10.3758/BRM.40.3.879 18697684
79. H Christensen K Griffiths C Groves A Korten 2006 Free range users and one hit wonders: Community users of an Internet-based cognitive behaviour therapy program Aust NZ J Psychiatry 40 1 59 62 10.1111/j.1440-1614.2006.01743.x (Pubitemid 43337443)
80. Lenert L. Automating smoking cessation on the web. WATI: Web-assisted Tobacco Intervention, 2005. Retrieved July 22, 2009 from http://www.wati.net/ presentations/watiII.lenert.pres.20050607.pdf
81. VJ Strecher S Shiffman R West 2006 Moderators and mediators of a Web-based computer-tailored smoking cessation program among nicotine patch users Nicotine Tob Res 8 S1 S95 S101 10.1080/14622200601039444 17491176
82. Tullis T, Albert W. Measuring the User Experience: Collecting, Analyzing, and Presenting Usability Metrics. San Francisco: Morgan Kaufmann; 2008.
83. Tullis TS, Stetson JN. A comparison of questionnaires for assessing website usability. Usability Professionals Association Conference, Minneapolis, MN, June 7-11, 2004. Retrieved July 22, 2009 from http://home.comcast.net/ %7Etomtullis/publications/UPA2004TullisStetson.pdf