Effectiveness of an internet- and app-based intervention for college students with elevated stress: Randomized controlled trial

Journal of Medical Internet Research

Volumn 20, Issue 4, 2018, Pages

  Harrer, Mathias ^g   Adam, Sophia Helen ^g   Fleischmann, Rebecca Jessica ^g   Baumeister, Harald ^a   Auerbach, Randy ^b   Bruffaerts, Ronny ^c   Cuijpers, Pim ^d   Kessler, Ronald C ^e   Berking, Matthias ^g   Lehr, Dirk ^f   Ebert, David Daniel ^g  

^a UNIVERSITY OF ULM   (Germany)

^b Och Spine at New York Presbyterian Hospitals   (United States)

^c UNIVERSITY OF LEUVEN   (Belgium)

^d VU UNIVERSITY AMSTERDAM   (Netherlands)

^e HARVARD MEDICAL SCHOOL   (United States)

^f LEUPHANA UNIVERSITY OF LÜNEBURG   (Germany)

^g UNIVERSITY OF ERLANGEN NUREMBERG   (Germany)

Author keywords

Depression; Help seeking behavior; Psychological; Randomized controlled trial; Stress; Students; Telemedicine

Indexed keywords

CONTROLLED STUDY; FEMALE; HUMAN; INTERNET; MALE; MENTAL HEALTH; MOBILE APPLICATION; PROCEDURES; PSYCHOLOGICAL RATING SCALE; PSYCHOTHERAPY; RANDOMIZED CONTROLLED TRIAL; STUDENT; TRENDS;

FEMALE; HUMANS; INTERNET; MALE; MENTAL HEALTH; MOBILE APPLICATIONS; PSYCHIATRIC STATUS RATING SCALES; PSYCHOTHERAPY; STUDENTS;

EID: 85047549982     PISSN: None     EISSN: 14388871     Source Type: Journal    
DOI: 10.2196/jmir.9293     Document Type: Article

References (77)

1. Auerbach RP, Alonso J, Axinn WG, Cuijpers P, Ebert DD, Green JG, et al. Mental disorders among college students in the World Health Organization World Mental Health Surveys. Psychol Med 2016 Oct;46(14):2955-2970 [FREE Full _text] [doi: 10.1017/S0033291716001665] [Medline: 27484622]
2. Blanco C, Okuda M, Wright C, Hasin DS, Grant BF, Liu S, et al. Mental health of college students and their non-college-attending peers: results from the National Epidemiologic Study on Alcohol and Related Conditions. Arch Gen Psychiatry 2008 Dec;65(12):1429-1437 [FREE Full _text] [doi: 10.1001/archpsyc.65.12.1429] [Medline: 19047530]
3. World Health Organization. The Global Burden of Disease: 2004 update. Geneva: WHO; 2008.
4. Bruffaerts R, Mortier P, Kiekens G, Auerbach RP, Cuijpers P, Demyttenaere K, et al. Mental health problems in college freshmen: prevalence and academic functioning. J Affect Disord 2018 Jan 01;225:97-103. [doi: 10.1016/j.jad.2017.07.044] [Medline: 28802728]
5. Breslau J, Lane M, Sampson N, Kessler RC. Mental disorders and subsequent educational attainment in a US national sample. J Psychiatr Res 2008 Jul;42(9):708-716 [FREE Full _text] [doi: 10.1016/j.jpsychires.2008.01.016] [Medline: 18331741]
6. Ebert DD, Zarski AC, Christensen H, Stikkelbroek Y, Cuijpers P, Berking M, et al. Internet and computer-based cognitive behavioral therapy for anxiety and depression in youth: a meta-analysis of randomized controlled outcome trials. PLoS One 2015;10(3):e0119895 [FREE Full _text] [doi: 10.1371/journal.pone.0119895] [Medline: 25786025]
7. Eisenberg D, Downs MF, Golberstein E, Zivin K. Stigma and help seeking for mental health among college students. Med Care Res Rev 2009 Oct;66(5):522-541. [doi: 10.1177/1077558709335173] [Medline: 19454625]
8. Ebert DD, Cuijpers P, Muñoz RF, Baumeister H. Prevention of mental health disorders using Internet- and mobile-based interventions: a narrative review and recommendations for future research. Front Psychiatry 2017;8:116 [FREE Full _text] [doi: 10.3389/fpsyt.2017.00116] [Medline: 28848454]
9. Ebert DD, Gollwitzer M, Riper H, Cuijpers P, Baumeister H, Berking M. For whom does it work? Moderators of outcome on the effect of a transdiagnostic internet-based maintenance treatment after inpatient psychotherapy: randomized controlled trial. J Med Internet Res 2013 Oct 10;15(10):e191 [FREE Full _text] [doi: 10.2196/jmir.2511] [Medline: 24113764]
10. Buntrock C, Berking M, Smit F, Lehr D, Nobis S, Riper H, et al. Preventing depression in adults with subthreshold depression: health-economic evaluation alongside a pragmatic randomized controlled trial of a web-based intervention. J Med Internet Res 2017 Jan 04;19(1):e5 [FREE Full _text] [doi: 10.2196/jmir.6587] [Medline: 28052841]
11. Chan JK, Farrer LM, Gulliver A, Bennett K, Griffiths KM. University students' views on the perceived benefits and drawbacks of seeking help for mental health problems on the Internet: a qualitative study. JMIR Hum Factors 2016;3(1):e3 [FREE Full _text] [doi: 10.2196/humanfactors.4765] [Medline: 27026140]
12. Batterham PJ, Calear AL. Preferences for Internet-based mental health interventions in an adult online sample: findings from an online community survey. JMIR Ment Health 2017 Jun 30;4(2):e26 [FREE Full _text] [doi: 10.2196/mental.7722] [Medline: 28666976]
13. Königbauer J, Letsch J, Doebler P, Ebert D, Baumeister H. Internet- and mobile-based depression interventions for people with diagnosed depression: a systematic review and meta-analysis. J Affect Disord 2017 Dec 01;223:28-40. [doi: 10.1016/j.jad.2017.07.021] [Medline: 28715726]
14. Sander L, Rausch L, Baumeister H. Effectiveness of Internet-based interventions for the prevention of mental disorders: a systematic review and meta-analysis. JMIR Ment Health 2016;3(3):e38 [FREE Full _text] [doi: 10.2196/mental.6061] [Medline: 27535468]
15. Välimäki M, Anttila K, Anttila M, Lahti M. Web-based interventions supporting adolescents and young people with depressive symptoms: systematic review and meta-analysis. JMIR Mhealth Uhealth 2017 Dec 08;5(12):e180 [FREE Full text] [doi: 10.2196/mhealth.8624] [Medline: 29222079]
16. Seo DC, Niu J. Evaluation of Internet-based interventions on waist circumference reduction: a meta-analysis. J Med Internet Res 2015 Jul 21;17(7):e181 [FREE Full _text] [doi: 10.2196/jmir.3921] [Medline: 26199208]
17. Davies EB, Morriss R, Glazebrook C. Computer-delivered and web-based interventions to improve depression, anxiety, and psychological well-being of university students: a systematic review and meta-analysis. J Med Internet Res 2014;16(5):e130 [FREE Full _text] [doi: 10.2196/jmir.3142] [Medline: 24836465]
18. Conley CS, Durlak JA, Shapiro JB, Kirsch AC, Zahniser E. A meta-analysis of the impact of universal and indicated preventive technology-delivered interventions for higher education students. Prev Sci 2016 Dec;17(6):659-678. [doi: 10.1007/s11121-016-0662-3] [Medline: 27225631]
19. Hintz S, Frazier PA, Meredith L. Evaluating an online stress management intervention for college students. J Couns Psychol 2015 Apr;62(2):137-147. [doi: 10.1037/cou0000014] [Medline: 24635586]
20. Chiauzzi E, Brevard J, Thum C, Decembrele S, Lord S. MyStudentBody-Stress: an online stress management intervention for college students. J Health Commun 2008 Sep;13(6):555-572. [doi: 10.1080/10810730802281668] [Medline: 18726812]
21. Ryan ML, Shochet IM, Stallman HM. Universal online interventions might engage psychologically distressed university students who are unlikely to seek formal help. Adv Ment Health 2010;9(1):73-83. [doi: 10.5172/jamh.9.1.73]
22. Apolinário-Hagen J, Vehreschild V, Alkoudmani RM. Current views and perspectives on e-mental health: an exploratory survey study for understanding public attitudes toward Internet-based psychotherapy in Germany. JMIR Ment Health 2017 Feb 23;4(1):e8 [FREE Full _text] [doi: 10.2196/mental.6375] [Medline: 28232298]
23. Auerbach RP, Benjet C, Bruffaerts R, Cuijpers P, Ebert DD, Kessler RC. Harvard Medical School Department of Health Care Policy. 2017. The WHO World Mental Health International College Student Project URL: https://www.hcp.med.harvard.edu/wmh/college_student_survey.php [WebCite Cache ID _6w0NBawLL]
24. Deutsches Register Klinischer Studien [German Clinical Trials Register]. DRKS. 2016 Dec 05. Online based self-help stress management program for students with feedback on demand URL: http://www.drks.de/drks_web/navigate.do?navigationId=trial.HTML&TRIAL_ID=DRKS00010212 [accessed 2018-03-05] [WebCite Cache ID _6w55Ewhjd]
25. Cohen S, Kamarck T, Mermelstein R. A global measure of perceived stress. J Health Soc Behav 1983 Dec;24(4):385-396. [Medline: 6668417]
26. Ebert DD, Lehr D, Smit F, Zarski AC, Riper H, Heber E, et al. Efficacy and cost-effectiveness of minimal guided and unguided internet-based mobile supported stress-management in employees with occupational stress: a three-armed randomised controlled trial. BMC Public Health 2014;14:807 [FREE Full _text] [doi: 10.1186/1471-2458-14-807] [Medline: 25099533]
27. Lazarus RS, Folkman S. Stress, Appraisal, and Coping. New York: Springer; 1984.
28. Berking M, Ebert D, Cuijpers P, Hofmann SG. Emotion regulation skills training enhances the efficacy of inpatient cognitive behavioral therapy for major depressive disorder: a randomized controlled trial. Psychother Psychosom 2013;82(4):234-245. [doi: 10.1159/000348448] [Medline: 23712210]
29. Mohr DC, Cuijpers P, Lehman K. Supportive accountability: a model for providing human support to enhance adherence to eHealth interventions. J Med Internet Res 2011;13(1):e30 [FREE Full _text] [doi: 10.2196/jmir.1602] [Medline: 21393123]
30. Schueller SM, Tomasino KN, Mohr DC. Integrating human support into behavioral intervention technologies: the efficiency model of support. Clin Psychol Sci Pract 2016 Nov 17;24(1):27-45. [doi: 10.1111/cpsp.12173]
31. Zarski AC, Lehr D, Berking M, Riper H, Cuijpers P, Ebert DD. Adherence to Internet-based mobile-supported stress management: a pooled analysis of individual participant data from three randomized controlled trials. J Med Internet Res 2016;18(6):e146 [FREE Full _text] [doi: 10.2196/jmir.4493] [Medline: 27357528]
32. Nielsen MG, Ørnbøl E, Vestergaard M, Bech P, Larsen FB, Lasgaard M, et al. The construct validity of the Perceived Stress Scale. J Psychosom Res 2016 May;84:22-30. [doi: 10.1016/j.jpsychores.2016.03.009] [Medline: 27095155]
33. Denovan A, Dagnall N, Dhingra K, Grogan S. Evaluating the Perceived Stress Scale among UK university students: implications for stress measurement and management. Stud High Educ 2017 Jun 22:1-14 [FREE Full _text] [doi: 10.1080/03075079.2017.1340445]
34. Reis D, Lehr D, Heber E, Ebert DD. The German version of the Perceived Stress Scale (PSS-10): evaluation of dimensionality, validity, and measurement invariance with exploratory and confirmatory bifactor modeling. Assessment 2017 Jun 01:1073191117715731. [doi: 10.1177/1073191117715731] [Medline: 28627220]
35. Lee E. Review of the psychometric evidence of the Perceived Stress Scale. Asian Nurs Res (Korean Soc Nurs Sci) 2012 Dec;6(4):121-127 [FREE Full _text] [doi: 10.1016/j.anr.2012.08.004] [Medline: 25031113]
36. Hewitt PL, Flett GL, Mosher SW. The Perceived Stress Scale: factor structure and relation to depression symptoms in a psychiatric sample. J Psychopathol Behav Assess 1992 Sep;14(3):247-257 [FREE Full _text] [doi: 10.1007/BF00962631]
37. Pbert L, Doerfler LA, DeCosimo D. An evaluation of the perceived stress scale in two clinical populations. J Psychopathol Behav Assess 1992 Dec;14(4):363-375 [FREE Full _text] [doi: 10.1007/BF00960780]
38. Klein EM, Brähler E, Dreier M, Reinecke L, Müller KW, Schmutzer G, et al. The German version of the Perceived Stress Scale - psychometric characteristics in a representative German community sample. BMC Psychiatry 2016 Dec 23;16:159 [FREE Full _text] [doi: 10.1186/s12888-016-0875-9] [Medline: 27216151]
39. Warttig SL, Forshaw MJ, South J, White AK. New, normative, English-sample data for the Short Form Perceived Stress Scale (PSS-4). J Health Psychol 2013 Dec;18(12):1617-1628. [doi: 10.1177/1359105313508346] [Medline: 24155195]
40. Mitchell AM, Crane PA, Kim Y. Perceived stress in survivors of suicide: psychometric properties of the Perceived Stress Scale. Res Nurs Health 2008 Dec;31(6):576-585. [doi: 10.1002/nur.20284] [Medline: 18449942]
41. Hautzinger M, Bailer M, Hofmeister D, Keller F. Center for Epidemiological Studies Depression Scale (CES-D; Radloff, L. S., 1977) - German adaption. Psychiatr Prax 2012;39(6):302-304 [FREE Full _text] [doi: 10.1055/s-0032-1326702]
42. Marteau TM, Bekker H. The development of a six-item short-form of the state scale of the Spielberger State-Trait Anxiety Inventory (STAI). Br J Clin Psychol 1992 Sep;31 (Pt 3):301-306. [Medline: 1393159]
43. Andrews B, Wilding JM. The relation of depression and anxiety to life-stress and achievement in students. Br J Psychol 2004 Nov;95(Pt 4):509-521. [doi: 10.1348/0007126042369802] [Medline: 15527535]
44. Brähler E, Mühlan H, Albani C, Schmidt S. Teststatistische Prüfung und Normierung der deutschen Versionen des EUROHIS-QOL Lebensqualität-Index und des WHO-5 Wohlbefindens-Index [Test statistic testing and standardization of the German versions of the EUROHIS-QOL quality of life index and the WHO-5 well-being index]. Diagn 2007 Apr;53(2):83-96 [FREE Full _text] [doi: 10.1026/0012-1924.53.2.83]
45. Gumz A, Erices R, Brähler E, Zenger M. [Factorial structure and psychometric criteria of the German translation of the Maslach Burnout Inventory-Student Version by Schaufeli et al. (MBI-SS)]. Psychother Psychosom Med Psychol 2013 Feb;63(2):77-84. [doi: 10.1055/s-0032-1323695] [Medline: 23408302]
46. Smith MM, Saklofske DH, Yan G, Sherry SB. Does perfectionism predict depression, anxiety, stress, and life satisfaction after controlling for neuroticism? J Individ Differ 2017 Apr;38(2):63-70 [FREE Full _text] [doi: 10.1027/1614-0001/a000223]
47. Slaney RB, Rice KG, Mobley M, Trippi J, Ashby JS. The revised almost perfect scale. Meas Eval Couns Dev 2001;34(3):130-145.
48. Galatzer-Levy IR, Burton CL, Bonanno GA. Coping flexibility, potentially traumatic life events, and resilience: a prospective study of college student adjustment. J Soc Clin Psychol 2012 Jun;31(6):542-567 [FREE Full _text] [doi: 10.1521/jscp.2012.31.6.542]
49. Connor KM, Davidson JR. Development of a new resilience scale: the Connor-Davidson Resilience Scale (CD-RISC). Depress Anxiety 2003;18(2):76-82. [doi: 10.1002/da.10113] [Medline: 12964174]
50. Neff KD, Rude SS, Kirkpatrick KL. An examination of self-compassion in relation to positive psychological functioning and personality traits. J Res Pers 2007 Aug;41(4):908-916 [FREE Full _text] [doi: 10.1016/j.jrp.2006.08.002]
51. Trompetter HR, de Kleine E, Bohlmeijer ET. Why does positive mental health buffer against psychopathology? An exploratory study on self-compassion as a resilience mechanism and adaptive emotion regulation strategy. Cognit Ther Res 2017;41(3):459-468 [FREE Full _text] [doi: 10.1007/s10608-016-9774-0] [Medline: 28515539]
52. Hupfeld J, Ruffieux N. Validierung einer deutschen Version der Self-Compassion Scale (SCS-D) [Validation of a German version of the Self-Compassion Scale (SCS-D)]. Z Klin Psychol Psychother 2011 Apr;40(2):115-123 [FREE Full _text] [doi: 10.1026/1616-3443/a000088]
53. Thoits PA. Self, identity, stress, and mental health. In: Aneshensel CS, Phelan JC, Bierman A, editors. Handbook of the Sociology of Mental Health. Dordrecht: Springer; 2013:357-377.
54. Ferring D, Filipp SH. Messung des selbstwertgefühls: befunde zu reliabilität, validität und stabilität der Rosenberg-Skala [Measurement of self-esteem: findings on reliability, validity, and stability of the Rosenberg Scale]. Diagn 1996;42(3):284-292.
55. Matsushita M, Adachi H, Arakida M, Namura I, Takahashi Y, Miyata M, et al. Presenteeism in college students: reliability and validity of the Presenteeism Scale for students. Qual Life Res 2011 Apr;20(3):439-446. [doi: 10.1007/s11136-010-9763-9] [Medline: 20945160]
56. Jerusalem M, Schwarzer R. Selbstwirksamkeit. Skalen zur Befindlichkeit und Persönlichkeit [Self-Efficacy. Scales for Mental State and Personality]. Berlin: Institute for Psychology, Free University Berlin; 1986.
57. Wolitzky-Taylor K. University of Texas at Austin. 2009. Randomized Clinical Trial Investigating the Efficacy of Self-Administered Interventions for Reducing Pathological Academic Worry URL: https://repositories.lib.utexas.edu/bitstream/handle/2152/7513/wolitzky-taylork81714.pdf;sequence=2 [WebCite Cache ID _6w4xzl8lt]
58. Boß L, Lehr D, Reis D, Vis C, Riper H, Berking M, et al. Reliability and validity of assessing user satisfaction with web-based health interventions. J Med Internet Res 2016 Aug 31;18(8):e234 [FREE Full _text] [doi: 10.2196/jmir.5952] [Medline: 27582341]
59. Devilly GJ, Borkovec TD. Psychometric properties of the credibility/expectancy questionnaire. J Behav Ther Exp Psychiatry 2000 Jun;31(2):73-86. [Medline: 11132119]
60. Altman DG, Schulz KF, Moher D, Egger M, Davidoff F, Elbourne D, et al. The revised CONSORT statement for reporting randomized trials: explanation and elaboration. Ann Intern Med 2001 Apr 17;134(8):663-694 [FREE Full _text] [doi: 10.7326/0003-4819-134-8-200104170-00012]
61. Leonhart R. [Estimating effect sizes in clinical trials]. Rehabilitation (Stuttg) 2004 Aug;43(4):241-246. [doi: 10.1055/s-2004-828293] [Medline: 15318292]
62. Rosnow RL, Rosenthal R. Assessing the effect size of outcome research. In: Nezu AM, Nezu CM, editors. Evidence-Based Outcome Research: A Practical Guide to Conducting Randomized Controlled Trials for Psychosocial Interventions. New York, NY, US: Oxford University Press; 2008.
63. Cohen J. Statistical Power Analysis for the Behavioral Sciences, 2nd edition. Mahwah, NJ: Lawrence Erlbaum Associates; 1988.
64. Jacobson NS, Truax P. Clinical significance: a statistical approach to defining meaningful change in psychotherapy research. J Consult Clin Psychol 1991 Feb;59(1):12-19. [Medline: 2002127]
65. Lehr D, Hillert A, Schmitz E, Sosnowsky N. Screening depressiver Störungen mittels Allgemeiner Depressions-Skala (ADS-K) und State-Trait Depressions Scales (STDS-T) [Screening of depressive disorders using the General Depression Scale (ADS-K) and State-Trait Depression Scales (STDS-T)]. Diagn 2008 Apr;54(2):61-70 [FREE Full _text] [doi: 10.1026/0012-1924.54.2.61]
66. Heber E, Ebert DD, Lehr D, Cuijpers P, Berking M, Nobis S, et al. The benefit of web- and computer-based interventions for stress: a systematic review and meta-analysis. J Med Internet Res 2017 Feb 17;19(2):e32 [FREE Full _text] [doi: 10.2196/jmir.5774] [Medline: 28213341]
67. Christensen H, Griffiths KM, Farrer L. Adherence in internet interventions for anxiety and depression. J Med Internet Res 2009;11(2):e13 [FREE Full _text] [doi: 10.2196/jmir.1194] [Medline: 19403466]
68. Richards D, Timulak L, O'Brien E, Hayes C, Vigano N, Sharry J, et al. A randomized controlled trial of an internet-delivered treatment: its potential as a low-intensity community intervention for adults with symptoms of depression. Behav Res Ther 2015 Dec;75:20-31 [FREE Full _text] [doi: 10.1016/j.brat.2015.10.005] [Medline: 26523885]
69. Fleischmann RJ, Harrer M, Zarski AC, Baumeister H, Lehr D, Ebert DD. Patients' experiences in a guided Internet- and app-based stress intervention for college students: a qualitative study. Internet Interv 2018:A (forthcoming) [FREE Full text] [doi: 10.1016/j.invent.2017.12.001]
70. Farrer L, Gulliver A, Chan JK, Bennett K, Griffiths KM. A virtual mental health clinic for university students: a qualitative study of end-user service needs and priorities. JMIR Ment Health 2015;2(1):e2 [FREE Full _text] [doi: 10.2196/mental.3890] [Medline: 26543908]
71. Eysenbach G. The law of attrition. J Med Internet Res 2005;7(1):e11 [FREE Full _text] [doi: 10.2196/jmir.7.1.e11] [Medline: 15829473]
72. Cavanagh K, Strauss C, Cicconi F, Griffiths N, Wyper A, Jones F. A randomised controlled trial of a brief online mindfulness-based intervention. Behav Res Ther 2013 Sep;51(9):573-578. [doi: 10.1016/j.brat.2013.06.003] [Medline: 23872699]
73. Frazier P, Meredith L, Greer C, Paulsen JA, Howard K, Dietz LR, et al. Randomized controlled trial evaluating the effectiveness of a web-based stress management program among community college students. Anxiety Stress Coping 2015;28(5):576-586. [doi: 10.1080/10615806.2014.987666] [Medline: 25420030]
74. Bell ML, Kenward MG, Fairclough DL, Horton NJ. Differential dropout and bias in randomised controlled trials: when it matters and when it may not. Br Med J 2013 Jan 21;346:e8668 [FREE Full _text] [Medline: 23338004]
75. Mohr DC, Ho J, Hart TL, Baron KG, Berendsen M, Beckner V, et al. Control condition design and implementation features in controlled trials: a meta-analysis of trials evaluating psychotherapy for depression. Transl Behav Med 2014 Dec;4(4):407-423 [FREE Full _text] [doi: 10.1007/s13142-014-0262-3] [Medline: 25584090]
76. Hunt J, Eisenberg D. Mental health problems and help-seeking behavior among college students. J Adolesc Health 2010 Jan;46(1):3-10. [doi: 10.1016/j.jadohealth.2009.08.008] [Medline: 20123251]
77. Andrade LH, Alonso J, Mneimneh Z, Wells JE, Al-Hamzawi A, Borges G, et al. Barriers to mental health treatment: results from the WHO World Mental Health surveys. Psychol Med 2014 Apr;44(6):1303-1317 [FREE Full _text] [doi: 10.1017/S0033291713001943] [Medline: 23931656]