The clinical effectiveness of web-based cognitive behavioral therapy with face-to-face therapist support for depressed primary care patients: Randomized controlled trial

Journal of Medical Internet Research

Volumn 15, Issue 8, 2013, Pages

  Høifødt, Ragnhild Sørensen ^a   Lillevoll, Kjersti R ^a   Griffiths, Kathleen M ^b   Wilsgaard, Tom ^a   Eisemann, Martin ^a   Waterloo, Knut ^a   Kolstrup, Nils ^a  

^a UNIVERSITY OF TROMSØ   (Norway)

^b AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

Author keywords

Cognitive therapy; Computer assisted; Depression; Internet; Mental health; Primary health care; Randomized controlled trial; Therapy

Indexed keywords

ADULT; ARTICLE; COGNITIVE THERAPY; COMPUTER-ASSISTED; CONTROLLED CLINICAL TRIAL; CONTROLLED STUDY; DEPRESSION; FEMALE; HUMAN; INTERNET; MALE; MENTAL HEALTH; MIDDLE AGED; PATIENT COMPLIANCE; PRIMARY HEALTH CARE; RANDOMIZED CONTROLLED TRIAL; THERAPY;

COGNITIVE THERAPY; COMPUTER-ASSISTED; DEPRESSION; INTERNET; MENTAL HEALTH; PRIMARY HEALTH CARE; RANDOMIZED CONTROLLED TRIAL; THERAPY;

ADULT; COGNITIVE THERAPY; DEPRESSION; FEMALE; HUMANS; INTERNET; MALE; MIDDLE AGED; PATIENT COMPLIANCE; PRIMARY HEALTH CARE;

EID: 84883376604     PISSN: None     EISSN: 14388871     Source Type: Journal    
DOI: 10.2196/jmir.2714     Document Type: Article

References (115)

1. Ayuso-Mateos JL, Vázquez-Barquero JL, Dowrick C, Lehtinen V, Dalgard OS, Casey P, ODIN Group. Depressive disorders in Europe: prevalence figures from the ODIN study. Br J Psychiatry 2001 Oct;179:308-316 [FREE Full text] [Medline: 11581110]
2. Wittchen HU, Jacobi F. Size and burden of mental disorders in Europe-a critical review and appraisal of 27 studies. Eur Neuropsychopharmacol 2005 Aug;15(4):357-376. [doi: 10.1016/j.euroneuro.2005.04.012] [Medline: 15961293]
3. Kringlen E, Torgersen S, Cramer V. A Norwegian psychiatric epidemiological study. Am J Psychiatry 2001 Jul;158(7):1091-1098. [Medline: 11431231]
4. Kessler RC, Angermeyer M, Anthony JC, DE Graaf R, Demyttenaere K, Gasquet I, et al. Lifetime prevalence and age-of-onset distributions of mental disorders in the World Health Organization's World Mental Health Survey Initiative. World Psychiatry 2007 Oct;6(3):168-176 [FREE Full text] [Medline: 18188442]
5. Kilbourne AM, Daugherty B, Pincus HA. What do general medical guidelines say about depression care? Depression treatment recommendations in general medical practice guidelines. Curr Opin Psychiatry 2007 Nov;20(6):626-631. [doi: 10.1097/YCO.0b013e3282f0c4d3] [Medline: 17921767]
6. Wittchen HU, Jacobi F, Rehm J, Gustavsson A, Svensson M, Jönsson B, et al. The size and burden of mental disorders and other disorders of the brain in Europe 2010. Eur Neuropsychopharmacol 2011 Sep;21(9):655-679. [doi: 10.1016/j.euroneuro.2011.07.018] [Medline: 21896369]
7. Cuijpers P, van Straten A, Andersson G, van Oppen P. Psychotherapy for depression in adults: a meta-analysis of comparative outcome studies. J Consult Clin Psychol 2008 Dec;76(6):909-922. [doi: 10.1037/a0013075] [Medline: 19045960]
8. Bebbington P, Brugha T, Meltzer H, Jenkins R, Ceresa C, Farrell M, et al. Neurotic disorders and the receipt of psychiatric treatment. Int Rev Psychiatry 2003;15(1-2):108-114. [doi: 10.1080/0954026021000046010] [Medline: 12745317]
9. Kessler RC, Berglund PA, Bruce ML, Koch JR, Laska EM, Leaf PJ, et al. The prevalence and correlates of untreated serious mental illness. Health Serv Res 2001 Dec;36(6 Pt 1):987-1007 [FREE Full text] [Medline: 11775672]
10. Churchill R, Hunot V, Corney R, Knapp M, McGuire H, Tylee A, et al. A systematic review of controlled trials of the effectiveness and cost-effectiveness of brief psychological treatments for depression. Health Technol Assess 2001;5(35):1-173 [FREE Full text] [Medline: 12387733]
11. Butler AC, Chapman JE, Forman EM, Beck AT. The empirical status of cognitive-behavioral therapy: a review of meta-analyses. Clin Psychol Rev 2006 Jan;26(1):17-31. [doi: 10.1016/j.cpr.2005.07.003] [Medline: 16199119]
12. Ruwaard J, Schrieken B, Schrijver M, Broeksteeg J, Dekker J, Vermeulen H, et al. Standardized web-based cognitive behavioural therapy of mild to moderate depression: a randomized controlled trial with a long-term follow-up. Cogn Behav Ther 2009;38(4):206-221. [doi: 10.1080/16506070802408086] [Medline: 19221919]
13. Andersson G, Bergström J, Holländare F, Carlbring P, Kaldo V, Ekselius L. Internet-based self-help for depression: randomised controlled trial. Br J Psychiatry 2005 Nov;187:456-461 [FREE Full text] [doi: 10.1192/bjp.187.5.456] [Medline: 16260822]
14. Berger T, Hämmerli K, Gubser N, Andersson G, Caspar F. Internet-based treatment of depression: a randomized controlled trial comparing guided with unguided self-help. Cogn Behav Ther 2011;40(4):251-266. [doi: 10.1080/16506073.2011.616531] [Medline: 22060248]
15. Johansson R, Sjöberg E, Sjögren M, Johnsson E, Carlbring P, Andersson T, et al. Tailored vs. standardized Internet-based cognitive behavior therapy for depression and comorbid symptoms: a randomized controlled trial. PLoS One 2012;7(5):e36905 [FREE Full text] [doi: 10.1371/journal.pone.0036905] [Medline: 22615841]
16. McCrone P, Knapp M, Proudfoot J, Ryden C, Cavanagh K, Shapiro DA, et al. Cost-effectiveness of computerised cognitive-behavioural therapy for anxiety and depression in primary care: randomised controlled trial. Br J Psychiatry 2004 Jul;185:55-62 [FREE Full text] [Medline: 15231556]
17. Marks IM, Mataix-Cols D, Kenwright M, Cameron R, Hirsch S, Gega L. Pragmatic evaluation of computer-aided self-help for anxiety and depression. Br J Psychiatry 2003 Jul;183:57-65 [FREE Full text] [Medline: 12835245]
18. Marks IM, Kenwright M, McDonough M, Whittaker M, Mataix-Cols D. Saving clinicians' time by delegating routine aspects of therapy to a computer: a randomized controlled trial in phobia/panic disorder. Psychol Med 2004 Jan;34(1):9-17. [Medline: 14971623]
19. Titov N. Internet-delivered psychotherapy for depression in adults. Curr Opin Psychiatry 2011 Jan;24(1):18-23. [doi: 10.1097/YCO.0b013e32833ed18f] [Medline: 20827199]
20. Christensen H, Griffiths KM, Korten AE, Brittliffe K, Groves C. A comparison of changes in anxiety and depression symptoms of spontaneous users and trial participants of a cognitive behavior therapy website. J Med Internet Res 2004 Dec 22;6(4):e46 [FREE Full text] [doi: 10.2196/jmir.6.4.e46] [Medline: 15631970]
21. Cuijpers P, Donker T, Johansson R, Mohr DC, van Straten A, Andersson G. Self-guided psychological treatment for depressive symptoms: a meta-analysis. PLoS One 2011;6(6):e21274 [FREE Full text] [doi: 10.1371/journal.pone.0021274] [Medline: 21712998]
22. Meyer B, Berger T, Caspar F, Beevers CG, Andersson G, Weiss M. Effectiveness of a novel integrative online treatment for depression (Deprexis): randomized controlled trial. J Med Internet Res 2009;11(2):e15 [FREE Full text] [doi: 10.2196/jmir.1151] [Medline: 19632969]
23. Clarke G, Kelleher C, Hornbrook M, Debar L, Dickerson J, Gullion C. Randomized effectiveness trial of an Internet, pure self-help, cognitive behavioral intervention for depressive symptoms in young adults. Cogn Behav Ther 2009;38(4):222-234 [FREE Full text] [doi: 10.1080/16506070802675353] [Medline: 19440896]
24. Farrer L, Christensen H, Griffiths KM, Mackinnon A. Internet-based CBT for depression with and without telephone tracking in a national helpline: randomised controlled trial. PLoS One 2011;6(11):e28099 [FREE Full text] [doi: 10.1371/journal.pone.0028099] [Medline: 22140514]
25. Lintvedt OK, Griffiths KM, Sørensen K, Østvik AR, Wang CE, Eisemann M, et al. Evaluating the effectiveness and efficacy of unguided Internet-based self-help intervention for the prevention of depression: a randomized controlled trial. Clin Psychol Psychother 2013;20(1):10-27. [doi: 10.1002/cpp.770] [Medline: 21887811]
26. Spek V, Cuijpers P, Nyklícek I, Riper H, Keyzer J, Pop V. Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: a meta-analysis. Psychol Med 2007 Mar;37(3):319-328. [doi: 10.1017/S0033291706008944] [Medline: 17112400]
27. Johansson R, Andersson G. Internet-based psychological treatments for depression. Expert Rev Neurother 2012 Jul;12(7):861-9; quiz 870. [doi: 10.1586/ern.12.63] [Medline: 22853793]
28. Palmqvist B, Carlbring P, Andersson G. Internet-delivered treatments with or without therapist input: does the therapist factor have implications for efficacy and cost? Expert Rev Pharmacoecon Outcomes Res 2007 Jun;7(3):291-297. [doi: 10.1586/14737167.7.3.291] [Medline: 20528315]
29. Sethi S, Campbell AJ, Ellis LA. The use of computerized self-help packages to treat adolescent depression and anxiety. Journal of Technology in Human Services 2010 Aug 31;28(3):144-160. [doi: 10.1080/15228835.2010.508317]
30. Perini S, Titov N, Andrews G. Clinician-assisted Internet-based treatment is effective for depression: randomized controlled trial. Aust N Z J Psychiatry 2009 Jun;43(6):571-578. [doi: 10.1080/00048670902873722] [Medline: 19440890]
31. Cuijpers P, Donker T, van Straten A, Li J, Andersson G. Is guided self-help as effective as face-to-face psychotherapy for depression and anxiety disorders? A systematic review and meta-analysis of comparative outcome studies. Psychol Med 2010 Dec;40(12):1943-1957. [doi: 10.1017/S0033291710000772] [Medline: 20406528]
32. Groves C, Griffiths K, Christensen H. Working out MoodGYM: A User's Guide. Canberra, Australia: Centre for Mental Health Research; 2003.
33. Powell J, Hamborg T, Stallard N, Burls A, McSorley J, Bennett K, et al. Effectiveness of a web-based cognitive-behavioral tool to improve mental well-being in the general population: randomized controlled trial. J Med Internet Res 2013;15(1):e2 [FREE Full text] [doi: 10.2196/jmir.2240] [Medline: 23302475]
34. Christensen H, Griffiths KM, Jorm AF. Delivering interventions for depression by using the Internet: randomised controlled trial. BMJ 2004 Jan 31;328(7434):265 [FREE Full text] [doi: 10.1136/bmj.37945.566632.EE] [Medline: 14742346]
35. Calear AL, Christensen H, Mackinnon A, Griffiths KM, O'Kearney R. The YouthMood Project: a cluster randomized controlled trial of an online cognitive behavioral program with adolescents. J Consult Clin Psychol 2009 Dec;77(6):1021-1032. [doi: 10.1037/a0017391] [Medline: 19968379]
36. Mackinnon A, Griffiths KM, Christensen H. Comparative randomised trial of online cognitive-behavioural therapy and an information website for depression: 12-month outcomes. Br J Psychiatry 2008 Feb;192(2):130-134 [FREE Full text] [doi: 10.1192/bjp.bp.106.032078] [Medline: 18245031]
37. Hickie IB, Davenport TA, Luscombe GM, Moore M, Griffiths KM, Christensen H. Practitioner-supported delivery of Internet-based cognitive behaviour therapy: evaluation of the feasibility of conducting a cluster randomised trial. Med J Aust 2010 Jun 7;192(11 Suppl):S31-S35. [Medline: 20528705]
38. Wang PS, Berglund P, Kessler RC. Recent care of common mental disorders in the United States : prevalence and conformance with evidence-based recommendations. J Gen Intern Med 2000 May;15(5):284-292 [FREE Full text] [Medline: 10840263]
39. Jorm AF. Mental health literacy. Public knowledge and beliefs about mental disorders. Br J Psychiatry 2000 Nov;177:396-401 [FREE Full text] [Medline: 11059991]
40. Bebbington P, Meltzer H, Brugha T, Farrell M, Jenkins R, Ceresa C, et al. Unequal access and unmet need: neurotic disorders and the use of primary care services. Int Rev Psychiatry 2003;15(1-2):115-122. [doi: 10.1080/ 0954026021000046029] [Medline: 12745318]
41. Helsedirektoratet. Nasjonale retningslinjer for diagnostisering og behandling av voksne med depresjon i primær- og spesialisthelsetjenesten. 2009. URL: http://www.helsedirektoratet.no/publikasjoner/ nasjonale- retningslinjer-for-diagnostisering-og-behandling-av-voksne-med-depresjon-i- primer-og-spesialisthelsetjenesten/ Sider/default.aspx [accessed 2013-05-08] [WebCite Cache ID 6GStEoITt]
42. National Institute for Health and Clinical Excellence. Depression in adults: the treatment and management of depression in adults. 2009. URL: http://www.nice.org.uk/nicemedia/live/12329/45888/45888.pdf [accessed 2013-05-08] [WebCite Cache ID 6GStYHltL]
43. Angermeyer MC, Matschinger H. Public attitude towards psychiatric treatment. Acta Psychiatr Scand 1996 Nov;94(5):326-336. [Medline: 9124079]
44. Priest RG, Vize C, Roberts A, Roberts M, Tylee A. Lay people's attitudes to treatment of depression: results of opinion poll for Defeat Depression Campaign just before its launch. BMJ 1996 Oct 5;313(7061):858-859 [FREE Full text] [Medline: 8870574]
45. van Schaik DJ, Klijn AF, van Hout HP, van Marwijk HW, Beekman AT, de Haan M, et al. Patients' preferences in the treatment of depressive disorder in primary care. Gen Hosp Psychiatry 2004;26(3):184-189. [doi: 10.1016/j. genhosppsych.2003.12.001] [Medline: 15121346]
46. King M, Davidson O, Taylor F, Haines A, Sharp D, Turner R. Effectiveness of teaching general practitioners skills in brief cognitive behaviour therapy to treat patients with depression: randomised controlled trial. BMJ 2002 Apr 20;324(7343):947-950 [FREE Full text] [Medline: 11964340]
47. Davidsen A. Experiences of carrying out talking therapy in general practice: a qualitative interview study. Patient Educ Couns 2008 Aug;72(2):268-275. [doi: 10.1016/j.pec.2008.03.020] [Medline: 18472244]
48. Backenstrass M, Joest K, Rosemann T, Szecsenyi J. The care of patients with subthreshold depression in primary care: is it all that bad? A qualitative study on the views of general practitioners and patients. BMC Health Serv Res 2007;7:190 [FREE Full text] [doi: 10.1186/1472-6963-7-190] [Medline: 18031573]
49. Wiebe E, Greiver M. Using cognitive behavioural therapy in practice: qualitative study of family physicians' experiences. Can Fam Physician 2005 Jul;51:992-993 [FREE Full text] [Medline: 16926952]
50. Telford R, Hutchinson A, Jones R, Rix S, Howe A. Obstacles to effective treatment of depression: a general practice perspective. Fam Pract 2002 Feb;19(1):45-52 [FREE Full text] [Medline: 11818349]
51. Mykletun A, Knudsen AK, Tangen T, Overland S. General practitioners' opinions on how to improve treatment of mental disorders in primary health care. Interviews with one hundred Norwegian general practitioners. BMC Health Serv Res 2010;10:35 [FREE Full text] [doi: 10.1186/1472-6963-10-35] [Medline: 20144205]
52. Blashki G, Parsons J, Morgan H, Hickie IB, Davenport TA. Providing psychological treatments in general practice. Rationale and practicalities. Aust Fam Physician 2003 Aug;32(8):625-630. [Medline: 12973871]
53. Eysenbach G, CONSORT-EHEALTH Group. CONSORT-EHEALTH: improving and standardizing evaluation reports of Web-based and mobile health interventions. J Med Internet Res 2011;13(4):e126 [FREE Full text] [doi: 10.2196/jmir.1923] [Medline: 22209829]
54. Melville KM, Casey LM, Kavanagh DJ. Dropout from Internet-based treatment for psychological disorders. Br J Clin Psychol 2010 Nov;49(Pt 4):455-471. [doi: 10.1348/014466509X472138] [Medline: 19799804]
55. Waller R, Gilbody S. Barriers to the uptake of computerized cognitive behavioural therapy: a systematic review of the quantitative and qualitative evidence. Psychol Med 2009 May;39(5):705-712. [doi: 10.1017/S0033291708004224] [Medline: 18812006]
56. Beck AT, Steer RA, Brown GK. BDI-II, Beck Depression Inventory: Manual. San Antonio, TX: Psychological Corp; 1996.
57. Arnau RC, Meagher MW, Norris MP, Bramson R. Psychometric evaluation of the Beck Depression Inventory-II with primary care medical patients. Health Psychol 2001 Mar;20(2):112-119. [Medline: 11315728]
58. Dozois D, Dobson KS, Ahnberg JL. A psychometric evaluation of the Beck Depression Inventory-II. Psychological Assessment 1998;10(2):83-89. [doi: 10.1037/1040-3590.10.2.83]
59. Carlbring P, Brunt S, Bohman S, Austin D, Richards J, Öst LG, et al. Internet vs. paper and pencil administration of questionnaires commonly used in panic/agoraphobia research. Computers in Human Behavior 2007 May;23(3):1421-1434. [doi: 10.1016/j.chb.2005.05.002]
60. Holländare F, Andersson G, Engström I. A comparison of psychometric properties between internet and paper versions of two depression instruments (BDI-II and MADRS-S) administered to clinic patients. J Med Internet Res 2010;12(5):e49 [FREE Full text] [doi: 10.2196/jmir.1392] [Medline: 21169165]
61. Naus MJ, Philipp LM, Samsi M. From paper to pixels: A comparison of paper and computer formats in psychological assessment. Computers in Human Behavior 2009 Jan;25(1):1-7. [doi: 10.1016/j.chb.2008.05.012]
62. Schulenberg SE, Yutrzenka BA. Equivalence of computerized and conventional versions of the Beck Depression Inventory-II (BDI-II). Curr Psychol 2001 Sep;20(3):216-230. [doi: 10.1007/s12144-001-1008-1]
63. Beck AT, Steer RA. Beck Anxiety Inventory: Manual. San Antonio, TX: The Psychological Corporation; 1993.
64. Fydrich T, Dowdall D, Chambless DL. Reliability and validity of the Beck Anxiety Inventory. Journal of Anxiety Disorders 1992 Jan;6(1):55-61. [doi: 10.1016/0887-6185(92)90026-4]
65. Steer RA, Ranieri WF, Beck AT, Clark DA. Further evidence for the validity of the Beck Anxiety Inventory with psychiatric outpatients. Journal of Anxiety Disorders 1993 Jul;7(3):195-205. [doi: 10.1016/0887-6185(93)90002-3]
66. Beck AT, Epstein N, Brown G, Steer RA. An inventory for measuring clinical anxiety: psychometric properties. J Consult Clin Psychol 1988 Dec;56(6):893-897. [Medline: 3204199]
67. Hedman E, Ljótsson B, Rück C, Furmark T, Carlbring P, Lindefors N, et al. Internet administration of self-report measures commonly used in research on social anxiety disorder: A psychometric evaluation. Computers in Human Behavior 2010 Jul;26(4):736-740. [doi: 10.1016/j.chb.2010.01. 010]
68. Zigmond AS, Snaith RP. The hospital anxiety and depression scale. Acta Psychiatr Scand 1983 Jun;67(6):361-370. [Medline: 6880820]
69. Bjelland I, Dahl AA, Haug TT, Neckelmann D. The validity of the Hospital Anxiety and Depression Scale. An updated literature review. J Psychosom Res 2002 Feb;52(2):69-77. [Medline: 11832252]
70. Andersson G, Kaldo-Sandström V, Ström L, Strömgren T. Internet administration of the Hospital Anxiety and Depression Scale in a sample of tinnitus patients. J Psychosom Res 2003 Sep;55(3):259-262. [Medline: 12932800]
71. McCue P, Buchanan T, Martin CR. Screening for psychological distress using Internet administration of the Hospital Anxiety and Depression Scale (HADS) in individuals with chronic fatigue syndrome. Br J Clin Psychol 2006 Nov;45(Pt 4):483-498. [doi: 10.1348/014466505X82379] [Medline: 17076959]
72. EuroQol Group. About EQ-5D. 2013. URL: http://www.euroqol.org/about-eq- 5d.html [accessed 2013-05-08] [WebCite Cache ID 6GSukzvVz]
73. Dolan P. Modeling valuations for EuroQol health states. Med Care 1997 Nov;35(11):1095-1108. [Medline: 9366889]
74. Lamers LM, Bouwmans CA, van Straten A, Donker MC, Hakkaart L. Comparison of EQ-5D and SF-6D utilities in mental health patients. Health Econ 2006 Nov;15(11):1229-1236. [doi: 10.1002/hec.1125] [Medline: 16625671]
75. Shervin N, Dorrwachter J, Bragdon CR, Shervin D, Zurakowski D, Malchau H. Comparison of paper and computer-based questionnaire modes for measuring health outcomes in patients undergoing total hip arthroplasty. J Bone Joint Surg Am 2011 Feb 2;93(3):285-293. [doi: 10.2106/JBJS.I.01104] [Medline: 21266642]
76. Bushnell DM, Reilly MC, Galani C, Martin ML, Ricci JF, Patrick DL, et al. Validation of electronic data capture of the Irritable Bowel Syndrome-Quality of Life Measure, the Work Productivity and Activity Impairment Questionnaire for Irritable Bowel Syndrome and the EuroQol. Value Health 2006;9(2):98-105. [doi: 10.1111/j.1524-4733.2006.00087.x] [Medline: 16626413]
77. Diener E, Emmons RA, Larsen RJ, Griffin S. The Satisfaction With Life Scale. J Pers Assess 1985 Feb;49(1):71-75. [doi: 10.1207/s15327752jpa4901-13] [Medline: 16367493]
78. Pavot W, Diener E. Review of the Satisfaction With Life Scale. Psychological Assessment 1993;5(2):164-172. [doi: 10.1037/1040-3590.5.2.164]
79. Clench-Aas J, Nes RB, Dalgard OS, Aarø LE. Dimensionality and measurement invariance in the Satisfaction with Life Scale in Norway. Qual Life Res 2011 Oct;20(8):1307-1317 [FREE Full text] [doi: 10.1007/s11136-011-9859-x] [Medline: 21308414]
80. Glaesmer H, Grande G, Braehler E, Roth M. The German Version of the Satisfaction With Life Scale (SWLS): psychometric properties, validity, and population-based norms. European Journal of Psychological Assessment 2011 May 3;27(2):127-132. [doi: 10.1027/1015-5759/a000058]
81. Meyerson P, Tryon WW. Validating Internet research: a test of the psychometric equivalence of Internet and in-person samples. Behav Res Methods Instrum Comput 2003 Nov;35(4):614-620. [Medline: 14748506]
82. Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry 1998;59 Suppl 20:22-33;quiz 34. [Medline: 9881538]
83. Saunders JB, Aasland OG, Babor TF, de la Fuente JR, Grant M. Development of the Alcohol Use Disorders Identification Test (AUDIT): WHO Collaborative Project on Early Detection of Persons with Harmful Alcohol Consumption-II. Addiction 1993 Jun;88(6):791-804. [Medline: 8329970]
84. Reinert DF, Allen JP. The alcohol use disorders identification test: an update of research findings. Alcohol Clin Exp Res 2007 Feb;31(2):185-199. [doi: 10.1111/j.1530-0277.2006.00295.x] [Medline: 17250609]
85. Babor TF, Higgins-Biddle JC, Saunders JB, Monteiro MG. The Alcohol Use Disorders Identification Test: Guidelines for Use in Primary Care 2nd edition. 2001. URL: http://whqlibdoc.who.int/hq/2001/who-msd-msb-01.6a.pdf [accessed 2013-05-10] [WebCite Cache ID 6GVRHvzpE]
86. Berman AH, Bergman H, Palmstierna T, Schlyter F. Evaluation of the Drug Use Disorders Identification Test (DUDIT) in criminal justice and detoxification settings and in a Swedish population sample. Eur Addict Res 2005;11(1):22-31. [doi: 10.1159/000081413] [Medline: 15608468]
87. Cavanagh K, Shapiro DA, Van Den Berg S, Swain S, Barkham M, Proudfoot J. The acceptability of computer-aided cognitive behavioural therapy: a pragmatic study. Cogn Behav Ther 2009;38(4):235-246. [doi: 10.1080/16506070802561256] [Medline: 19306147]
88. Garratt A, Bjørngaard JH, Dahle KA, Bjertnaes OA, Saunes IS, Ruud T. The Psychiatric Out-Patient Experiences Questionnaire (POPEQ): data quality, reliability and validity in patients attending 90 Norwegian clinics. Nord J Psychiatry 2006;60(2):89-96. [doi: 10.1080/08039480600583464] [Medline: 16635926]
89. Nasjonalt kunnskapssenter for helsetjenesten. PasOpp: hva er erfaringene dine som bruker av poliklinikk i psykiatrisk helsevern?. 2007. URL: http://www.kunnskapssenteret.no/Sp%C3%B8rreskjemabanken/ Spesialisthelsetjeneste+-+Psykisk+helsevern/ Voksne%2C+psykisk+helsevern%2C+poliklinikk.9716.cms [accessed 2013-05-10] [WebCite Cache ID 6GVRtgBlw]
90. Australian National University, Centre for Mental Health Research. The MoodGYM training program: mark III. 2008. URL: https://moodgym.anu.edu.au/ welcome [accessed 2013-05-10] [WebCite Cache ID 6GVUeWUTc]
91. Christensen H, Griffiths KM, Mackinnon AJ, Brittliffe K. Online randomized controlled trial of brief and full cognitive behaviour therapy for depression. Psychol Med 2006 Dec;36(12):1737-1746. [doi: 10.1017/ S0033291706008695] [Medline: 16938144]
92. Twisk J. Applied multilevel analysis: a practical guide. Cambridge, UK: Cambridge University Press; 2006.
93. Silfvernagel K, Carlbring P, Kabo J, Edström S, Eriksson J, MAnson L, et al. Individually tailored Internet-based treatment for young adults and adults with panic attacks: randomized controlled trial. J Med Internet Res 2012;14(3):e65 [FREE Full text] [doi: 10.2196/jmir.1853] [Medline: 22732098]
94. Morris SB, DeShon RP. Combining effect size estimates in meta-analysis with repeated measures and independent-groups designs. Psychol Methods 2002 Mar;7(1):105-125. [Medline: 11928886]
95. Thorsell J, Finnes A, Dahl J, Lundgren T, Gybrant M, Gordh T, et al. A comparative study of 2 manual-based self-help interventions, acceptance and commitment therapy and applied relaxation, for persons with chronic pain. Clin J Pain 2011 Oct;27(8):716-723. [doi: 10.1097/AJP.0b013e318219a933] [Medline: 21540740]
96. Cohen J. Statistical Power Analysis for the Behavioral Sciences. Hillsdale, NJ: L Erlbaum Associates; 1988.
97. Seggar LB, Lambert MJ, Hansen NB. Assessing clinical significance: Application to the Beck Depression Inventory. Behavior Therapy 2002 Mar;33(2):253-269. [doi: 10.1016/s0005-7894(02)80028-4]
98. Jacobson NS, Truax P. Clinical significance: a statistical approach to defining meaningful change in psychotherapy research. J Consult Clin Psychol 1991 Feb;59(1):12-19. [Medline: 2002127]
99. Choi I, Zou J, Titov N, Dear BF, Li S, Johnston L, et al. Culturally attuned Internet treatment for depression amongst Chinese Australians: a randomised controlled trial. J Affect Disord 2012 Feb;136(3):459-468. [doi: 10.1016/j.jad.2011.11.003] [Medline: 22177742]
100. Vernmark K, Lenndin J, Bjärehed J, Carlsson M, Karlsson J, Oberg J, et al. Internet administered guided self-help versus individualized e-mail therapy: A randomized trial of two versions of CBT for major depression. Behav Res Ther 2010 May;48(5):368-376. [doi: 10.1016/j.brat.2010.01.005] [Medline: 20152960]
101. Barrett JE, Williams JW, Oxman TE, Frank E, Katon W, Sullivan M, et al. Treatment of dysthymia and minor depression in primary care: a randomized trial in patients aged 18 to 59 years. J Fam Pract 2001 May;50(5):405-412. [Medline: 11350703]
102. Hermens ML, van Hout HP, Terluin B, van der Windt DA, Beekman AT, van Dyck R, et al. The prognosis of minor depression in the general population: a systematic review. Gen Hosp Psychiatry 2004;26(6):453-462. [doi: 10.1016/j.genhosppsych.2004.08.006] [Medline: 15567211]
103. Christensen H, Griffiths KM, Korten A. Web-based cognitive behavior therapy: analysis of site usage and changes in depression and anxiety scores. J Med Internet Res 2002;4(1):e3 [FREE Full text] [doi: 10.2196/jmir.4.1.e3] [Medline: 11956035]
104. Goldberg D, Bridges K, Duncan-Jones P, Grayson D. Detecting anxiety and depression in general medical settings. BMJ 1988 Oct 8;297(6653):897-899 [FREE Full text] [Medline: 3140969]
105. Bados A, Balaguer G, Saldaña C. The efficacy of cognitive-behavioral therapy and the problem of drop-out. J Clin Psychol 2007 Jun;63(6):585-592. [doi: 10.1002/jclp.20368] [Medline: 17457848]
106. Watkins E, Williams R. The efficacy of cognitive behavioral therapy. In: Checkley S, editor. The Management of Depression. Oxford, UK: Blackwell Science; 1998:165-188.
107. Wierzbicki M, Pekarik G. A meta-analysis of psychotherapy dropout. Professional Psychology: Research and Practice 1993;24(2):190-195. [doi: 10.1037/0735-7028.24.2.190]
108. Lamers F, van Oppen P, Comijs HC, Smit JH, Spinhoven P, van Balkom AJ, et al. Comorbidity patterns of anxiety and depressive disorders in a large cohort study: the Netherlands Study of Depression and Anxiety (NESDA). J Clin Psychiatry 2011 Mar;72(3):341-348. [doi: 10.4088/JCP.10m06176blu] [Medline: 21294994]
109. Jacobi F, Wittchen HU, Holting C, Höfler M, Pfister H, Müller N, et al. Prevalence, co-morbidity and correlates of mental disorders in the general population: results from the German Health Interview and Examination Survey (GHS). Psychol Med 2004 May;34(4):597-611. [doi: 10.1017/ S0033291703001399] [Medline: 15099415]
110. van Boeijen CA, van Oppen P, van Balkom AJ, Visser S, Kempe PT, Blankenstein N, et al. Treatment of anxiety disorders in primary care practice: a randomised controlled trial. Br J Gen Pract 2005 Oct;55(519):763-769 [FREE Full text] [Medline: 16212851]
111. Longwell BT, Truax P. The differential effects of weekly, monthly, and bimonthly administrations of the beck Depression Inventory-II: Psychometric properties and clinical implications. Behavior Therapy 2005 Jun;36(3):265-275 [FREE Full text] [doi: 10.1016/S0005-7894(05)80075-9]
112. Hatzenbuehler LC, Parpal M, Matthews L. Classifying college students as depressed or nondepressed using the Beck Depression Inventory: an empirical analysis. J Consult Clin Psychol 1983 Jun;51(3):360-366. [Medline: 6863694]
113. Haaga DA. Introduction to the special section on stepped care models in psychotherapy. J Consult Clin Psychol 2000 Aug;68(4):547-548. [Medline: 10965628]
114. Farrand P, Confue P, Byng R, Shaw S. Guided self-help supported by paraprofessional mental health workers: an uncontrolled before-after cohort study. Health Soc Care Community 2009 Feb;17(1):9-17. [doi: 10.1111/j.1365-2524. 2008.00792.x] [Medline: 18564197]
115. Titov N, Andrews G, Davies M, McIntyre K, Robinson E, Solley K. Internet treatment for depression: a randomized controlled trial comparing clinician vs. technician assistance. PLoS One 2010;5(6):e10939 [FREE Full text] [doi: 10.1371/journal.pone.0010939] [Medline: 20544030]