Usability testing of an electronic patientreported outcome system for survivors of critical illness

American Journal of Critical Care

Volumn 25, Issue 4, 2016, Pages 340-349

  Cox, Christopher E ^a   Wysham, Nicholas G ^a   Kamal, Arif H ^a   Jones, Derek M ^b   Cass, Brian ^c   Tobin, Maria ^c   White, Douglas B ^d   Kahn, Jeremy M ^d   Hough, Catherine L ^e   Carson, Shannon S ^c  

^a DUKE UNIVERSITY SCHOOL OF MEDICINE   (United States)

^b DUKE CLINICAL RESEARCH INSTITUTE   (United States)

^c UNIVERSITY OF NORTH CAROLINA   (United States)

^d UNIVERSITY OF PITTSBURGH SCHOOL OF MEDICINE   (United States)

^e UNIVERSITY OF WASHINGTON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AGED; COMPUTER INTERFACE; CRITICAL ILLNESS; FEMALE; HUMAN; INTERNET; MALE; MIDDLE AGED; PATIENT-REPORTED OUTCOME; QUESTIONNAIRE; SURVIVOR;

AGED; CRITICAL ILLNESS; FEMALE; HUMANS; INTERNET; MALE; MIDDLE AGED; PATIENT REPORTED OUTCOME MEASURES; SURVEYS AND QUESTIONNAIRES; SURVIVORS; USER-COMPUTER INTERFACE;

EID: 84977521145     PISSN: 10623264     EISSN: None     Source Type: Journal    
DOI: 10.4037/ajcc2016952     Document Type: Article

References (41)

1. Marcano Belisario JS, Jamsek J, Huckvale K, O'Donoghue J, Morrison CP, Car J. Comparison of self-administered survey questionnaire responses collected using mobile apps versus other methods. Cochrane Database Syst Rev. 2015 Jul 27;7:MR000042.
2. Coons SJ, Eremenco S, Lundy JJ, O'Donohoe P, O'Gorman H, Malizia W. Capturing patient-reported outcome (PRO) data electronically: the past, present, and promise of ePRO measurement in clinical trials. Patient. 2015;8(4):301-309.
3. Unroe M, Kahn JM, Carson SS, et al. One-year trajectories of care and resource utilization for recipients of prolonged mechanical ventilation: a cohort study. Ann Intern Med. 2010; 153(3):167-175.
4. Mikkelsen ME, Christie JD, Lanken PN, et al. The adult respiratory distress syndrome cognitive outcomes study: long-term neuropsychological function in survivors of acute lung injury. Am J Respir Crit Care Med. 2012; 185(12): 1307-1315.
5. Herridge MS, Tansey CM, Matté A, et al. Functional disability 5 years after acute respiratory distress syndrome. N Engl J Med. 2011;364(14):1293-1304.
6. Herridge M, Cox CE. Linking ICU practice to long-term outcome: fostering a longitudinal vision for ICU-acquired morbidity. Am J Respir Crit Care Med. 2012;186(4):299-300.
7. Chen KF, Colantuoni E, Siddiqi F, et al. Repeated attempts using different strategies are important for timely contact with study participants. J Clin Epidemiol. 2011;64(10):1144-1151.
8. US Department of Health & Human Services. Health information privacy. 2015. http://www.hhs.gov/ocr/privacy/. Accessed April 14, 2016.
9. Usability.gov. Research-based web design & usability guidelines. 2013. http://www.usability.gov/sites/default/files /documents/guidelines_book.pdf?post=yes. Accessed April 14, 2016.
10. Duracinsky M, Lalanne C, Goujard C, et al. Electronic versus paper-based assessment of health-related quality of life specific to HIV disease: reliability study of the PROQOL-HIV questionnaire. J Med Internet Res. 2014;16(4):e115.
11. Tiplady B, Goodman K, Cummings G, et al. Patient-reported outcomes in rheumatoid arthritis. Patient. 2010;3(3):133-143.
12. Tolley C, Rofail D, Gater A, Lalonde JK. The feasibility of using electronic clinical outcome assessments in people with schizophrenia and their informal caregivers. Patient Relat Outcome Meas. 2015;6:91-101.
13. Abernethy AP, Ahmad A, Zafar SY, Wheeler JL, Reese JB, Lyerly HK. Electronic patient-reported data capture as a foundation of rapid learning cancer care. Med Care. 2010; 48(6 Suppl):S32-S38.
14. Black N. Patient reported outcome measures could help transform healthcare. BMJ. 2013;346:f167.
15. Basch E, Torda P, Adams K. Standards for patient-reported outcome-based performance measures. JAMA. 2013; 310(2): 139-140.
16. Coons SJ, Gwaltney CJ, Hays RD, et al. Recommendations on evidence needed to support measurement equivalence between electronic and paper-based patient-reported outcome (PRO) measures: ISPOR ePRO Good Research Practices Task Force report. Value Health. 2009;12(4):419-429.
17. Zigmond AS, Snaith RP. The hospital anxiety and depression scale. Acta Psychiatr Scand. 1983;67(6):361-370.
18. Weiss DS. The impact of events scale-revised. In: Wilson JP, Keane TM, eds. Assessing Psychological Trauma and PTSD: A Practitioner's Handbook. New York, NY: Guilford Press; 2004:168-189.
19. Cella D, Riley W, Stone A, et al. The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005-2008. J Clin Epidemiol. 2010;63(11) 1179-1194.
20. Carver CS. You want to measure coping but your protocol's too long: consider the Brief COPE. Int J Behav Med. 1997;4: 92-100.
21. de Jager CA, Budge MM, Clarke R. Utility of TICS-M for the assessment of cognitive function in older adults. Int J Geriatr Psychiatry. 2003;18(4):318-324.
22. Nielsen J. Usability 101: introduction to usability. www .nngroup.com/articles/usability-101-introduction-to-usability/. Accessed April 14, 2016.
23. Cox CE, Wysham NG, Walton B, et al. Development and usability testing of a web-based decision aid for families of patients receiving prolonged mechanical ventilation. Ann Intensive Care. 2015;5(6):6.
24. Brooke J. A quick and dirty usability scale. In: Jordan PW, Thomas B, Weerdmeester BA, McClellan AL, eds. Usability Evaluation in Industry. London, England: Taylor and Francis; 1986.
25. Genov A. Iterative usability testing as continuous feedback: a control systems perspective. J Usability Stud. 2005;1:18-27.
26. Nielsen J. Heuristic evaluation. In: Nielsen J, Mack RL, eds. Usability Inspection Methods. New York, NY: John Wiley & Sons; 1994.
27. Nielsen J. The usability engineering life cycle. Computer. 1992;25:12-22.
28. Virzi RA, Sorce JF, Herbert LB. A comparison of three usability evaluation methods: heuristic, think-aloud, and performance testing. Proc Hum Fact Ergon Soc. 1993; 37: 309-313.
29. Attkisson CC Zwick R. The client satisfaction questionnaire: psychometric properties and correlations with service utilization and psychotherapy outcome. Eval Program Plann. 1982;5(3):233-237.
30. Knaus WA, et al. APACHE II: a severity of disease classification system. Crit Care Med. 1985;13(10):818-829.
31. Bangor A, Kotum P, Miller J. Determining what individual SUS scores mean: adding an adjective rating scale. J Usability Stud. 2009;4:114-123.
32. Patrick DL, Burke LB, Gwaltney CJ, et al. Content validity- establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO Good Research Practices Task Force report: part 2, assessing respondent understanding. Value Health. 2011;14(8):978-988.
33. Jensen RE, Snyder CF, Abernethy AP, et al. Review of electronic patient-reported outcomes systems used in cancer clinical care. J Oncol Pract. 2014;10(4):e215-e222.
34. Needham DM, Dinglas VD, Bienvenu OJ, et al. One year outcomes in patients with acute lung injury randomised to initial trophic or full enteral feeding: prospective follow-up of EDEN randomised trial. BMJ. 2013;346:f1532.
35. Kyte D, Draper H, Calvert M. Patient-reported outcome alerts: ethical and logistical considerations in clinical trials. JAMA. 2013;310(12):1229-1230.
36. Wysham NG, Abernethy AP, Cox CE. Setting the vision: applied patient-reported outcomes and smart, connected digital healthcare systems to improve patient-centered outcomes prediction in critical illness. Curr Opin Crit Care. 2014;20(5):566-572.
37. Institute of Medicine. The National Academies Collection: Reports funded by National Institutes of Health. In: Grossmann C, Powers B, McGinnis JM, eds. Digital Infrastructure for the Learning Health System: The Foundation for Continuous Improvement in Health and Health Care: Workshop Series Summary. Washington, DC: National Academies Press; 2011.
38. Longo DR, Woolf SH. Rethinking the information priorities of patients. JAMA. 2014;311(18):1857-1858.
39. Elliott D, Davidson JE, Harvey MA, et al. Exploring the scope of post-intensive care syndrome therapy and care: engagement of non-critical care providers and survivors in a second stakeholders meeting. Crit Care Med. 2014;42(12): 2518-2526.
40. Gwaltney CJ, Shields AL, Shiffman S. Equivalence of electronic and paper-and-pencil administration of patient-reported outcome measures: a meta-analytic review. Value Health. 2008;11(2):322-333.
41. Greysen SR, Chin Garcia C, Sudore RL, Cenzer IS, Covinsky KE. Functional impairment and Internet use among older adults: implications for meaningful use of patient portals. JAMA Intern Med. 2014;174(7):1188-1190.