Usability evaluation with mental health professionals and young people to develop an Internet-based cognitive-behaviour therapy program for adolescents with anxiety disorders

BMC Pediatrics

Volumn 15, Issue 1, 2015, Pages

  Wozney, Lori ^a   Baxter, Pamela ^b   Newton, Amanda S ^c  

^a IWK HEALTH CENTRE   (Canada)

^b MCMASTER UNIVERSITY   (Canada)

^c UNIVERSITY OF ALBERTA   (Canada)

Author keywords

Adolescents; Anxiety; Cognitive behaviour therapy; EHealth; Internet based; Intervention research; Mental health; Usability testing; User experience

Indexed keywords

ADOLESCENT; ADULT; ANALYTICAL ERROR; ANXIETY DISORDER; ARTICLE; ATTITUDE TO COMPUTERS; CLINICAL ARTICLE; COGNITIVE THERAPY; COMPUTER INTERFACE; COMPUTER PROGRAM; CONTENT ANALYSIS; CONTROLLED STUDY; DISEASE SEVERITY; FEMALE; HEALTH CARE SURVEY; HEALTH CARE UTILIZATION; HUMAN; HUMAN COMPUTER INTERACTION; INTERNET; MALE; MENTAL HEALTH CARE PERSONNEL; PATIENT SATISFACTION; PURPOSIVE SAMPLE; SEMI STRUCTURED INTERVIEW; TASK PERFORMANCE; TELECONFERENCE; ANXIETY DISORDERS; COGNITION; HEALTH CARE PERSONNEL; MENTAL HEALTH; PHYSIOLOGY; PROCEDURES; PSYCHOLOGY; SOFTWARE; YOUNG ADULT;

ADOLESCENT; ADULT; ANXIETY DISORDERS; COGNITION; COGNITIVE THERAPY; FEMALE; HEALTH PERSONNEL; HUMANS; INTERNET; MALE; MENTAL HEALTH; PATIENT SATISFACTION; SOFTWARE; USER-COMPUTER INTERFACE; YOUNG ADULT;

EID: 84959156529     PISSN: None     EISSN: 14712431     Source Type: Journal    
DOI: 10.1186/s12887-015-0534-1     Document Type: Article

References (55)

1. Merikangas KR, He JP, Burnstein M, Swanson SA, Avenevoli S, Cui L, et al. Lifetime prevalence of mental disorders in U.S. adolescents: results from the National Comorbidity Survey Replication - Adolescent Supplement (NCS-A). J Am Acad Child Adolesc Psychiatry. 2010;49(10):980-9.
2. Merikangas KR, He JP, Burnstein M, Swendsen J, Avenevoli S, Case B, et al. Service utilization for lifetime mental disorders in U.S. adolescents: Results of the National Comorbidity Survey Replication - Adolescent Supplement (NCS-A). J Am Acad Child Adolesc Psychiatry. 2011;50(1):32-45.
3. Boydell KM, Pong R, Volpe T, Tilleczek K, Wilson E, Lemieux S. Family perspectives on pathways to mental health care for children and youth in rural communities. J Rural Health. 2006;22:182-8.
4. Diaz-Granados N, Georgiades K, Boyle MH. Regional and individual influences on use of mental health services in Canada. Can J Psychiatry. 2010;55:9-20.
5. Thomas CR, Holzer CE. The continuing shortage of child and adolescent psychiatrists. J Am Acad Child Adolesc Psychiatry. 2006;45:1023-31.
6. Reid GJ, Brown JB. Money, case complexity, and wait lists: Perspectives on problems and solutions at children's mental health centers in Ontario. J Behav Health Serv Res. 2008;35:334-46.
7. Gulliver A, Griffiths K, Christensen H. Perceived barriers and facilitators to mental health help-seeking in young people: a systematic review. BMC Psychiatry. 2010;10:113.
8. Gould MS, Velting D, Kleinman M, Lucas C, Thomas JG, Chung M. Teenagers' attitudes about coping strategies and help-seeking behavior for suicidality. J Am Acad Child Adolesc Psychiatry. 2004;43(9):1124-33.
9. Kelly CM, Jorm AF, Wright A. Improving mental health literacy as a strategy to facilitate early intervention for mental disorders. Med J Aust. 2007;187(7 Suppl):S26-30.
10. Ciarrochi J, Heaven PC, Supavadeeprasit S. The link between emotion identification skills and socio-emotional functioning in early adolescence: a 1-year longitudinal study. J Adolesc. 2008;5:565-82.
11. Rickwood D, Bradford S. The role of self-help in the treatment of mild anxiety disorders in young people: an evidence-based review. Psychol Res Behav Manag. 2012;5:25-36.
12. Richardson T, Stallard P, Velleman S. Computerised cognitive behavioural therapy for the prevention and treatment of depression and anxiety in children and adolescents: A systematic review. Clin Child Fam Psychol Rev. 2010;13:275-90.
13. Skinner H, Biscope S, Poland B, Goldberg E. How adolescents use technology for health information: Implications for health professionals from focus group studies. J Med Internet Res. 2003;5(4), e32.
14. Calear AL, Christensen H. Review of internet-based prevention and treatment programs for anxiety and depression in children and adolescents. Med J Aust. 2010;192(11 Suppl):12-4.
15. Silverman WK, Pina AA, Viswesvaran C. Evidence-based psychosocial treatments for phobic and anxiety disorders in children and adolescents. J Clin Child Adolesc Psychol. 2008;37(1):105-30.
16. Ollendick TH1, Jarrett MA, Grills-Taquechel AE, Hovey LD, Wolff JC. Comorbidity as a predictor and moderator of treatment outcome in youth with anxiety, affective, attention deficit/hyperactivity disorder, and oppositional/conduct disorders. Clin Psychol Rev. 2008;28(8):1447-71.
17. Kendall PC. Treating anxiety disorders in children: results of a randomized clinical trial. J Consult Clin Psychol. 1994;62(1):100-10.
18. Seligman LD, Ollendick TH. Cognitive-behavioral therapy for anxiety disorders in youth Child. Adolesc Psychiatr Clin N Am. 2011;20(2):217-38.
19. Rialon Berry R, Lai B. The Emerging Role of Technology in Cognitive-Behavioral Therapy for Anxious Youth: A Review. J Ration-Emotive Cogn-Behav Therapy. 2014;32(1):57-66.
20. Khanna MS, Kendall PC. Computer-assisted cognitive behavioral therapy for child anxiety: Results of a randomized clinical trial. J Consult Clin Psychol. 2010;78(5):737-45.
21. Amir N, Taylor CT. Combining computerized home-based treatments for generalized anxiety disorder: an attention modification program and cognitive behavioral therapy. Behav Ther. 2012;43(3):546-59.
22. Spence SH, Donovan CL, March S, Gamble A, Anderson RE, Prosser S, et al. A randomized controlled trial of online versus clinic-based CBT for adolescent anxiety. J Consult Clin Psychol. 2011;79(5):629-42.
23. Filbert K, Huguet A, Hundert A, McGrath PJ, Perri K, Turner K, & Wozney L. Promoting eHealth in Research and Clinical Practice: A Snapshot of Studies Conducted by the Centre for Research in Family Health (CRFH) at the IWK Health Centre. Psynopsis 2013: (Summer):22 &25.
24. McGrath PJ, Lingley-Pottie P, Thurston C, MacLean C, Cunningham C, Waschbusch DA, et al. Telephone-based mental health interventions for child disruptive behavior or anxiety disorders: randomized trials and overall analysis. J Am Acad Child Adolesc Psychiatry. 2011;50(11):1162-72.
25. Friedberg RD, McClure JM. Clinical practice of cognitive therapy with children and adolescents: The nuts and bolts. New York: Guilford Press; 2002.
26. Morrison LG, Yardley L, Powell J, Michie S. What design features are used in effective e-health interventions? A review using techniques from critical interpretive synthesis. Telemed J E Health. 2012;18(2):137-44.
27. Goldberg L, Lide B, Lowry S, Massett HA, O'Connell T, Preece J, et al. Usability and accessibility in consumer health informatics: current trends and future challenges. Am J Prev Med. 2011;40(5 Suppl 2):S187-97.
28. Breakey VR, Warias AV, Ignas DM, White M, Blanchette VS, Stinson JN. The value of usability testing for Internet-based adolescent self-management interventions: "Managing Hemophilia Online". BMC Med Inform Decis Mak. 2013;4(13):113.
29. Jaspers MWM. A comparison of usability methods for testing interactive health technologies: Methodological aspects and empirical evidence. Int J Med Inform. 2009;78(5):340-53.
30. Yen PY, Bakken S. Review of health information technology usability study methodologies. J Am Med Inform Assoc. 2012;19(3):413-22.
31. Gothfelf, J.; Lean UX. Applying Lean Principles to Improve User Experience; O'Reilly Media; February 22, 2013.
32. Ambler SW. Tailoring usability into agile software development projects, Maturing Usability. London: Springer; 2008. p. 75-95.
33. Andreasen MS, Nielsen HV, Schroder SO, Stage J. What happened to remote usability testing? An empirical study of three methods. Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 2007.
34. United Nations Youth. In: United Nations Department of Economic and Social Affairs (UNDESA). 2011. http://apps.who.int/adolescent/second-decade/section2/page1/recognizing-adolescence.html. Accessed 15 Dec 2015.
35. Nielsen J. Usability Engineering. San Francisco: Morgan Kaufmann; 1994.
36. Lewis C, Wharton C. Cognitive Walkthroughs. In: Helander M, editor. Handbook of Human-Computer Interaction. Amsterdam: Elsevier; 1997. p. 717-32.
37. Bangor A, Kortum P, Miller J. Determining what individual SUS scores mean: Adding an adjective rating scale. J Usability Studies 2009;4(3):114-123.
38. Sauro J, Lewis J. Quantifying the User Experience: Practical Statistics for User Research. San Francisco: Morgan Kaufmann; 2012.
39. Lewis JR. Sample Sizes for Usability Studies: Additional Considerations. Hum Factors. 1994;36(2):368-78.
40. Dumas JS, Molich R, Jeffries R. Describing usability problems: Are we sending the right message. Interact 2004, July-August:24-29.
41. Rubin J, Chisnell D. Handbook of Usability Testing: How to Plan, Design and Conduct Effective Tests. Indianapolis: Wiley Publishing; 2008.
42. David A, Glore P. The Impact of Design and Aesthetics on Usability, Credibility, and Learning in Online Courses. In J. Sanchez & K. Zhang (Eds.), Proceedings of World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education; 2010 (p. 42). Chesapeake, VA: AACE.
43. Tractinsky N, Katz A, Ikar D. What is beautiful is usable. Interacting with Comput. 2000;13(2):127-45.
44. Amon KL, Campbell AJ, Hawke C, Steinbeck K. Facebook as a Recruitment Tool for Adolescent Health Research: A Systematic Review. Acad Pediatr. 2014;14(5):439-47.
45. Lenhart A, Purcell K, Smith A, Zickuhr K. Social media and mobile internet use among teens and young adults. [ http://www.pewinternet.org/Reports/2010/Social-Media-and-Young-Adults.aspx ] Accessed 15 Dec 2015.
46. Zack SE, Castonguay LG, Boswell JF. Youth working alliance: a core clinical construct in need of empirical maturity. Harv Rev Psychiatry. 2007;15(6):278-88.
47. Raita A, Antti O. Too good to be bad: Favorable product expectations boost subjective usability ratings. Interacting with Comput. 2011;23(4):363-71.
48. Chu BC, Choudhury Khanna MS, Shortt A, Pincus D, Creed T, Kendall PC. Alliance, technology, and outcome in the treatment of anxious youth. Cogn Behav Pract. 2004;11(1):44-55.
49. Liao QV, Fu WT. Age differences in credibility judgments of online health information. ACM Trans Comput-Human Interact (TOCHI). 2014;21(1):2.
50. Flanagin A, Metzger M. That's Incredible: Students' Judgements about the Credibility of Online Information. Teacher. 2011;10-12.
51. Ranney ML, Choo EK, Spirito A, Mello MJ. Adolescents' preference for technology-based emergency department behavioral interventions: does it depend on risky behaviors? Pediatr Emerg Care. 2013;29(4):475-81.
52. Markopoulos P, Bekker M. On the assessment of usability testing methods for children. Interacting with Comput. 2003;15(2):227-43.
53. Hanna L, Risden K, Czerwinski M, Alexander K. The role of usability research in designing children's computer products. In: Druin A, editor. The Design of Children's Technology. San Francisco: Morgan Kaufman; 1999.
54. Faulkner L. Beyond the five-user assumption: benefits of increased sample sizes in usability testing. Behav Res Methods Instrum Comput. 2003;35(3):379-83.
55. Kushniruk A. Evaluation in the design of health information systems: application of approaches emerging from usability engineering. Comput Biol Med. 2002;32(3):141-9.