Quantifying usability: An evaluation of a diabetes mHealth system on effectiveness, efficiency, and satisfaction metrics with associated user characteristics

Journal of the American Medical Informatics Association

Volumn 23, Issue 1, 2016, Pages 5-11

  Georgsson, Mattias ^a,b   Staggers, Nancy ^a,c  

^a UNIVERSITY OF UTAH SCHOOL OF MEDICINE   (United States)

^b BLEKINGE INSTITUTE OF TECHNOLOGY   (Sweden)

^c UNIVERSITY OF MARYLAND SCHOOL OF NURSING   (United States)

Author keywords

Diabetes; Mobile health; Self management; Usability evaluation; User centered design

Indexed keywords

ADULT; ARTICLE; CLINICAL ARTICLE; CLINICAL EFFECTIVENESS; DIABETES MELLITUS; ERROR; FEMALE; HUMAN; INFORMATION TECHNOLOGY; MALE; METRIC SYSTEM; MHEALTH; MOBILE PHONE; PATIENT SATISFACTION; STANDARDIZATION; TASK PERFORMANCE; AGE; AGED; COMPUTER INTERFACE; CONSUMER ATTITUDE; MIDDLE AGED; PRODUCTIVITY; SELF CARE; STANDARDS; TELEMEDICINE;

ADULT; AGE FACTORS; AGED; CONSUMER BEHAVIOR; DIABETES MELLITUS; EFFICIENCY; FEMALE; HUMANS; MALE; MIDDLE AGED; PATIENT SATISFACTION; SELF CARE; TELEMEDICINE; USER-COMPUTER INTERFACE;

EID: 84959476628     PISSN: 10675027     EISSN: 1527974X     Source Type: Journal    
DOI: 10.1093/jamia/ocv099     Document Type: Article

References (44)

1. Sutcliffe P, Martin S, Sturt J, et al. Systematic review of communication technologies to promote access and engagement of young people with diabetes into healthcare. BMC Endocr Disord. 2011;11:1.
2. Quinn CC, Royak-Schaler R, Lender D, et al. Patient understanding of diabetes self-management: participatory decision-making in diabetes care. J Diabetes Sci Technol. 2011;5(3):723-730.
3. Jones KR, Lekhak N, Kaewluang N. Using mobile phones and short message service to deliver self-management interventions for chronic conditions: a meta-review. Worldviews Evid Based Nurs. 2014;11(2):81-88.
4. Arsand E, Tatara N, Ostengen G, et al. Mobile phone-based self-management tools for type 2 diabetes: the few touch application. J Diabetes Sci Technol. 2010;4(2):328-336.
5. Kouris I, Mougiakakou S, Scarnato L, et al. Mobile phone technologies and advanced data analysis towards the enhancement of diabetes self-management. Int J Electron Healthc. 2010;5(4):386-402.
6. Mulvaney SA, Ritterband LM, Bosslet L. Mobile intervention design in diabetes: review and recommendations. Curr Diab Rep. 2011;11(6):486-493.
7. Tsai CC, Lee G, Raab F, et al. Usability and feasibility of PmEB: a mobile phone application for monitoring real time caloric balance. Mobile Netw Appl. 2007;12(2-3):173-184.
8. El-Gayar O, Timsina P, Nawar N, et al. Mobile applications for diabetes self-management: status and potential. J Diabetes Sci Technol. 2013;7(1): 247-262.
9. International Telecommunications Union. The World in 2014: ICT Facts and Figures. Geneva: International Telecommunications Union (ITU); 2014.
10. CTIA-The Wireless Association. Wireless Industry Survey 2013. CTIA: The Wireless Association; 2014.
11. Lyles CR, Sarkar U, Osborn CY. Getting a technology-based diabetes intervention ready for prime time: a review of usability testing studies. Curr Diab Rep. 2014;14(10):534.
12. Bevan N. International standards for usability should be more widely used. J Usability Stud. 2009;4(3):106-113.
13. Svanaes D, Das A, Alsos OA. The contextual nature of usability and its relevance to medical informatics. Stud Health Technol Inform. 2008;136:541-546.
14. Frokjaer E, Hertzum M, Hornbaek K. Measuring usability: are effectiveness, efficiency, and satisfaction really correlated? In Proceedings of the SIGCHI conference on Human factors in computing systems. The Hague, The Netherlands: ACM; 2000:345-352.
15. Or C, Tao D. Usability study of a computer-based self-management system for older adults with chronic diseases. JMIR Res Protoc. 2012;1(2):e13.
16. Li LC, Adam PM, Townsend AF, et al. Usability testing of ANSWER: a webbased methotrexate decision aid for patients with rheumatoid arthritis. BMC Med Inform Decis Mak. 2013;13:131.
17. Coursaris CK, Kim DJ. A meta-analytical review of empirical mobile usability studies. J Usability Stud. 2011;6(3):117-171.
18. International Organization for Standardization. Ergonomic requirements for office work with visual display terminals (VDTs) Part 11 Guidance on usability. International standard, 9241-11. Geneve: ISO; 1998.
19. Kushniruk AW, Borycki EM, Kuwata S, et al. Emerging approaches to usability evaluation of health information systems: towards in-situ analysis of complex healthcare systems and environments. Stud Health Technol Inform. 2011;169:915-919.
20. Liljegren E. Usability in a medical technology context assessment of methods for usability evaluation of medical equipment. Intern J Indust Ergonom.2006;36(4):345-352.
21. Yardley L, Morrison LG, Andreou P, et al. Understanding reactions to an internet-delivered health-care intervention: accommodating user preferences for information provision. BMC Med Inform Decis Mak. 2010;10:52.
22. Nielsen J. Usability Engineering. Boston: Academic Press; 1993:xiv, 358 p.
23. Nielsen J. Heuristic evaluation. In Mack RL, Nielsen J. eds. Usability Inspection Methods. New York: John Wiley & Sons inc; 1994: 25-62.
24. Nielsen J. Why You Only Need to Test with 5 Users. 2000 March 19 [accessed December 27, 2014]; http://www.nngroup.com/articles/whyyou-only-need-to-test-with-5-users/.
25. Nielsen J, Landauer TK. A mathematical model of the finding of usability problems. In Proceedings of the INTERACT '93 and CHI '93 conference on human factors in computing systems. ACM: Amsterdam, The Netherlands;1993: 206-213.
26. Virzi RA. Refining the test phase of usability evaluation: how many subjects is enough? Hum Factors. 1992;34(4):457-468.
27. Maguire M. Methods to support human-centred design. Intern J Hum Comput Stud. 2001;55(4):587-634.
28. Kushniruk AW, Patel VL. Cognitive and usability engineering methods for the evaluation of clinical information systems. J Biomed Inform.2004;37(1):56-76.
29. International Organization for Standardization. Ergonomics of human-system interaction-Part 210: human-centred design for interactive systems. International standard, 9241-210. Geneve: ISO; 2010.
30. Jaja C, Pares-Avila J, Wolpin S, et al. Usability evaluation of the interactive Personal Patient Profile-Prostate decision support system with African American men. J Natl Med Assoc. 2010;102(4):290-297.
31. Bevan N. International Standards for HCI. In Claude G, ed. Encyclopedia of Human Computer Interaction. Hershey, PA, USA: IGI Global; 2006:362-372.
32. Brooke J. SUS: a "quick and dirty" usability scale. In Jordan PW, et al., eds. Usability Evaluation in Industry. London; Bristol: Taylor & Francis;1996:189-194.
33. Lewis JR, Sauro J. The Factor Structure of the System Usability Scale. In Proceedings of the 1st International Conference on Human Centered Design: Held as Part of HCI International 2009. San Diego, CA: Springer-Verlag;2009: 94-103.
34. Bangor A, Kortum PT, Miller JT. An empirical evaluation of the system usability scale. Intern J Hum Comput Interact. 2008;24(6):574-594.
35. Brooke J. SUS: a retrospective. J Usability Stud. 2013;8(2):29-40.
36. Bangor A, Kortum P, Miller J. Determining what individual SUS scores mean: adding an adjective rating scale. J Usability Stud. 2009;4(3):114-123.
37. Capozza K, Woolsey S, Georgsson M, et al. Going mobile with diabetes support: a randomized study of a text message-based personalized behavioral intervention for type 2 diabetes self-care. Diabetes Spectr.2015;28(2):83-91.
38. Karsh BT, Weinger MB, Abbott PA, et al. Health information technology: fallacies and sober realities. JAMIA. 2010;17(6):617-623.
39. TechSmith Corporation. Morae Usability Testing and Market Research Software. Okemos, MI, USA: TechSmith Corporation; 2014.
40. Microsoft Corporation. Microsoft Excel 2010 for Windows. Redmond, WA, USA: Microsoft Corporation; 2010.
41. IBM Corporation. IBM SPSS Statistics for Windows. Armonk, NY, USA: IBM Corporation; 2013.
42. Czaja SJ, Sharit J, Lee CC, et al. Factors influencing use of an e-health website in a community sample of older adults. JAMIA. 2013;20(2):277-284.
43. El-Gayar O, Timsina P, Nawar N, et al. A systematic review of IT for diabetes self-management: are we there yet? Int J Med Inform. 2013;82(8):637-652.
44. Quinn CC, Shardell MD, Terrin ML, et al. Cluster-randomized trial of a mobile phone personalized behavioral intervention for blood glucose control. Diabetes Care. 2011;34(9):1934-1942.