Implementation of a user-centered framework in the development of a web-based health information database and call center

Journal of Biomedical Informatics

Volumn 44, Issue 5, 2011, Pages 897-908

  Taylor, Heather A ^a,b   Sullivan, Dori ^a   Mullen, Cydney ^b   Johnson, Constance M ^a  

^a DUKE UNIVERSITY MEDICAL CENTER   (United States)

^b FirstHealth Moore Regional Hospital   (United States)

Author keywords

Consumer health information; Internet; User centered design; User computer interface

Indexed keywords

CALL CENTERS; CASE ANALYSIS; CONSUMER HEALTH INFORMATION; HEALTH INFORMATIONS; HUMAN COMPUTER INTERFACES; INFORMATION QUALITY; USER CENTERED DESIGNS; USER SATISFACTION; USER-CENTERED;

DESIGN; HEALTH; HEALTH CARE; HUMAN COMPUTER INTERACTION; INTERNET; USER INTERFACES;

WEBSITES;

ANALYTIC METHOD; CALL CENTER; COGNITION; CONSUMER; CONTENT BASED TESTING; EXPERT BASED TESTING; HEALTHCARE CONSUMER; HUMAN; INFORMATION; INFORMATION CENTER; INFORMATION LITERACY; INFORMATION QUALITY; MEDICAL INFORMATION; MEDICAL PRACTICE; PRIORITY JOURNAL; REVIEW; SATISFACTION; WEB BROWSER;

CONSUMER HEALTH INFORMATION; DATABASES, FACTUAL; HUMANS; INTERNET; PATIENT EDUCATION AS TOPIC; USER-COMPUTER INTERFACE;

EID: 80052878497     PISSN: 15320464     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jbi.2011.03.001     Document Type: Review

References (93)

1. Pew Internet & American Life Project. The engaged e-patient population; 2008. http://www.pewinternet.org/topics/Health.aspx.
2. Eysenbach G. Recent advances: consumer health informatics. BMJ 2002, 320(7251):1713-1716.
3. Heese B.W., Nelson D.E., Kreps G.L., Croyle R.T., Arora N.K., Rimer B.K., et al. The impact of the Internet and its implications for health care providers: findings from the first health information national trends survey. Arch Intern Med 2005, 165:2618-2624.
4. Broom A. Virtually hea@lthy: the impact of internet use on disease experience and the doctor-patient relationship. Qual Health Res 2005, 15(3):325-345.
5. McMullan M. Patients using the internet to obtain health information: how this affects the patient-professional relationship. Patient Educ Couns 2006, 63(1-2):24-28.
6. Murray E., Lo B., Pollack L., Donelan K., Catania J., White M., et al. The impact of health information on the internet on the physician-patient relationship. Arch Intern Med 2003, 163(14):1727-1734.
7. Impicciatore P., Pandolfini C., Casella N., Bonati M. Reliability of health information for the public on the World Wide Web: systematic survey of advice on managing fever in children at home. BMJ 1997, 314:1875-1879.
8. Eysenbach G., Powell J., Kuss O., Sa E.R. Empirical studies assessing the quality of health information for consumers on the World Wide Web: a systematic review. J Am Med Assoc 2002, 287(20):2691-2700.
9. Berland G.K., Elliot M.N., Morales L.S., Algazy J.I., Kravitz R.L., Broder M.S., et al. Health information on the internet: accessibility, quality, and readability in English and Spanish. J Am Med Assoc 2001, 285(20):2612-2621.
10. Bernstam E.V., Shelton D.M., Walji M., Meric-Bernstam F. Instruments to assess the quality of health information on the World Wide Web: what can our patients actually use?. Int J Med Inform 2005, 74(1):13-19.
11. Eysenbach G., Köhler C. Does the internet harm health? Database of adverse events related to the Internet has been set up. BMJ 2002, 324(7331):239.
12. Kortum P., Edwards C., Richards-Kortum R. The impact of inaccurate health information in a secondary school learning environment. J Med Internet Res 2008, 10(2):e17.
13. Morahan-Martin J.M. How Internet users find, evaluate, and use online health information: a cross-cultural review. CyberPsychol Behav 2004, 7(5):495-510.
14. Bessell T.L., McDonald S., Silagy C.A., Anderson J.N., Hiller J.E., Sansom L.N. Do Internet interventions for consumers cause more harm than good? A systematic review. Health Expect 2002, 5:28-37.
15. Crocco A.G., Villasis-Keever M., Jadad A.R. Two wrongs don't make a right: harm aggravated by inaccurate information on the internet. Pediatrics 2002, 109(3):522-523.
16. Roberts J.M., Copeland K.L. Clinical websites are currently dangerous to health. Int J Med Inform 2001, 62(2-3):181-187.
17. Johnson C.M., Johnson T.R., Zhang J. A user-centered framework for redesigning health care interfaces. J Biomed Inform 2005, 38(1):75-87.
18. Eysenbach G., Jadad A.R. Evidence-based patient choice and consumer health informatics in the information age. J Med Internet Res 2001, 3(2):e19.
19. Badenoch D., Tomlin A. How electronic communication is changing healthcare: usability is a main barrier to effective electronic information systems. BMJ 2004, 328(7455):1564.
20. Bias R.G., Mayhew D.J. Cost-justifying usability: an update for the Internet age 2005, Morgan Kauffman Publishers, San Francisco (CA).
21. Pressman R.S. Software engineering: a practitioner's approach 2009, McGraw Hill, New York (NY). seventh ed.
22. Seffah A., Gulliksen J., Desmarais M.C. Human-centered software engineering: integrating usability in the software development lifecycle 2005, Springer, Netherlands.
23. Mayhew D.J. The usability engineering lifecycle 1999, Morgan Kaufmann, San Francisco (CA).
24. Nielsen J., Tahir M. Homepage usability: 50 websites deconstructed 2002, New Riders Publishing, Indianapolis (IN).
25. Shneiderman B., Plaisant C. Designing the user interface. Strategies for effective human-computer interaction 2009, Addison Wesley Longman, Reading (MA). 5th ed.
26. Johnson C., Turley J. A new approach to building web-based interfaces for healthcare consumers. Health Inform J 2007, 2(2):e8.
27. Health on the Net. The HONcode in brief; 1997. http://www.hon.ch/HONcode/Webmasters/Conduct.html.
28. Winker M.A., Flanagin A., Chi-Lum B., White J., Andrews K., Kennett R., et al. Guidelines for medical and health information websites on the internet: principles governing AMA web sites. J Am Med Assoc 2002, 283(12):1600-1606.
29. World Wide Web Consortium (W3C). Web Content Accessibility Guidelines 1.0; 1999. http://www.w3.org/TR/WCAG10/.
30. Nielsen J. Usability engineering 1993, Academic Press, Boston.
31. Hackos J.T., Redish J.C. User and task analysis for interface design 1998, John Wiley & Sons, Inc., New York (NY).
32. A guide to task analysis 1993, Taylor & Francis, London. B. Kirwan, L.K. Ainsworth (Eds.).
33. Jenkins D.P., Stanton N.A., Salmon P.M., Walker G.H. Cognitive work analysis: coping with complexity (human factors in defense) 2009, Ashgate Publishing Company, Burlington (VT).
34. Duncan V., Fitcher D.M. What words and where? Applying usability testing techniques to name a new live reference service. J Med Libr Assoc 2004, 92(2):218-225.
35. Choi J., Bakken S. Heuristic evaluation of a web-based educational resource for low literacy NICU parents. Stud Health Technol Inform 2006, 122:194-199.
36. Stoddard J.L., Augustson E.M., Mabry P.L. The importance of usability testing in the development of an internet-based smoking cessation treatment resource. Nicotine Tob Res 2006, (Suppl. 1):S87-S93.
37. Usability inspection methods 1994, John Wiley & Sons Inc, New York (NY). J. Nielson, R.L. Mack (Eds.).
38. Dix A., Finlay J., Abowd G.D., Beale R. Human-computer interaction 2004, Pearson Education Limited, England. third ed.
39. Ericcson A.K., Simon K. Protocol analysis: verbal reports as data, revised version 1993, MIT Press, Cambridge (MA).
40. Faulkner L. Beyond the five-user assumption: benefits of increased sample sizes in usability testing. Behav Res Methods Instrum Comput 2003, 35(3):379-383.
41. Tullis T., Albert B. Measuring the user experience: collecting, analyzing, and presenting usability metrics 2008, Morgan Kaufmann Publishers, New York (NY).
42. Aronson AR, Bodenreider O, Chang HF, Humphrey SM, Mork JG, Nelson SJ, Rindflesch TC, Wilbur WJ. The NLM indexing initiative. In: Proceedings of the AMIA fall symposium; 2000. p. 17-21.
43. Fry E.B. A readability formula that saves time. J Reading 1968, 11:513-516.
44. McLaughlin G.H. SMOG grading - a new readability formula. J Reading 1969, 12:639-646.
45. Singh J. RAIN: readability assessment instrument manual 2003, ONE Research Institute, Midlothian (VA). second ed.
46. Doak C.C., Doak L.G., Root J.H. Teaching patients with low literacy skills 1996, J.B. Lippincott Company, Philadelphia (PA).
47. Lewis J.R. IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use. Int J Hum Comput Interact 1995, 7(1):57-78.
48. Weiss B.D., Mays M.Z., Martz W., Merriam Castro K., DeWalt D., Pignone M.P., et al. Quick assessment of literacy in primary care: the newest vital sign. Ann Fam Med 2005, 3(6):514-522.
49. Weiss B.D. Health literacy and patient safety: help patients understand. Manual for clinicians 2007, American Medical Association and American Medical Association Foundation, Chicago (IL). second ed.
50. Gabbard J.L., Hix D., Swan J.E. User-centered design and evaluation of virtual environments. IEEE Comput Graph Appl 1999, 19(6):51-59.
51. Hix D, Swan JE, Gabbard J, McGee M, Durbin J, King T. User-centered design and evaluation of a real-time battlefield visualization virtual environment. In: Proceedings of the IEEE VR'9 conference. Houston (TX); 1999. p. 1-8.
52. Gabbard JL, Swan JE, Hix D, Lanzagorta MA, Livingston MA, Brown D, et al. Usability engineering: domain analysis activities for augmented reality systems. In: Proceedings SPIE; 2002. p. 445-57.
53. Hix D, Gabbard JL, Swan JE, Livingston MA, Höllerer TH, Baillot Y, et al. A cost-effective usability evaluation progression for novel interactive systems. In: Proceedings of the 37th Hawaii international conference on system sciences; 2004. p. 1-10.
54. Lathan C.E., Sebrechts M.M., Newman D.J., Doarn C.R. Heuristic evaluation of a web-based interface for internet telemedicine. Telemed J 1999, 5(2):177-185.
55. Choi J., Bakken S. Heuristic evaluation of a web-based educational resource for low literacy NICU parents. Stud Health Technol Inform 2006, 122:194-199.
56. Karahoca A., Bayraktar E., Tatoglu E., Karahoca D. Information system design for a hospital emergency department: a usability analysis of software prototypes. J Biomed Inform 2010, 43(2):224-232.
57. Allen M., Currie L.M., Bakken S., Patel V.L., Cimino J.J. Heuristic evaluation of paper-based web pages: a simplified inspection usability methodology. J Biomed Inform 2006, 39:412-423.
58. Nahm E., Preece J., Resnick B., Mills M.E. Usability of health web sites for older adults: a preliminary study. CIN 2004, 22(6):326-334.
59. Tang Z., Johnson T.R., Tindall R.D., Zhang J. Applying heuristic evaluation to improve the usability of a telemedicine system. Telemedicine 2006, 12(1):24-34.
60. Ebenezer C. Usability evaluation of an NHS library website. Health Info Libr J 2003, 20:134-142.
61. Ostergren M., Karras B.T. Active Options: leveraging existing knowledge and usability testing to develop a physical activity program website for older adults. AMIA Annu Symp Proc 2007, 578-582.
62. Anselmo M.A., Lash K.M., Stieb E.S., Haver K.E. Cystic Fibrosis on the Internet: a survey of site adherence to AMA guidelines. Pediatrics 2004, 114(1):100-103.
63. Bouchier H., Bath P.A. Evaluation of websites that provide information on Alzheimer's disease. Health Inform J 2003, 9(1):17-32.
64. Zeng X., Parmanto B. Evaluation of web accessibility of consumer health information websites. AMIA Annu Symp Proc 2003, 743-747.
65. Zayas-Caban T., Marquard J.L., Radhakrishnan K., Duffey N., Evernden D.L. Scenario-based user testing to guide consumer health informatics design. AMIA Annu Symp Proc 2009, 55:719-723.
66. Horsky J., Kaufman D.R., Oppenheim M.I., Patel V.L. A framework for analyzing the cognitive complexity of computer-assisted clinical ordering. J Biomed Inform 2003, 36:4-22.
67. Johnson CD, Zeiger RF, Das AK, Goldstein MK. Task analysis of writing hospital admission orders: evidence of a problem-focused approach. In: Proc AMIA; 2006. p. 389.
68. Fonda S.J., Paulsen C.A., Perkins J., Kedziora R.J., Rodbard D., Bursell S.E. Usability test of an internet-based informatics tool for diabetes care providers: the comprehensive diabetes management program. Diabetes Technol Ther 2008, 10(1):16-24.
69. Wu R.C., Orr M.C., Chignell S.E., Straus S.E. Usability of a mobile electronic medical record prototype: a verbal protocol analysis. Inform Health Soc Care 2008, 33(2):139-149.
70. Kushniruk A.W., Triola M.M., Borycki M., Stein B., Kannry J.L. Technology induced error and usability: the relationship between usability problems and prescription errors of a handheld application. IJMI 2005, 74:519-526.
71. Duncan V.D., Fichter D.M. What words and where? Applying usability testing techniques to name a new live reference service. J Med Libr Assoc 2004, 92(2):218-225.
72. Dabbs A.D., Myers B.A., McCurry K.R., Dunbar-Jacob J., Hawkins R.P., Begey A., et al. User-centered design and interactive health technologies for patients. CIN 2009, 27(3):175-183.
73. Bailey RW, Allan RW, Raiello P. Usability testing vs. heuristic evaluation: a head-to-head comparison. In: Proceedings of the human factors and ergonomics society, 36th annual meeting. Santa Monica (CA); 1992. p. 490-13.
74. Jeffries R, Miller J, Wharton C, Uyeda K. User interface evaluation in the real world: a comparison of four techniques. In: Proceedings of the conference on human factors in computing system (CHI 91). New Orleans (LA); 1991. p. 119-24.
75. Karat CM, Campbell R, Fiegel T. Comparisons of empirical testing and walkthrough methods in user interface evaluation. In: Proceedings of the CHI'92; 1992. p. 397-404.
76. Lewis CH, Polson PG, Wharton C, Rieman J. Testing a walk through methodology for theory-based design of walk-up-and-use interfaces. In: Proceedings of the ACM CHI'90 conference on human factors in computing systems. New York; 1991. p. 235-42.
77. Desurvire H, Kondziela J, Atwood, M. What is gained and lost when using evaluation methods other than empirical testing. In: Proceedings of the conference on human factors in computing systems (CHI 92). Monterey, CA; 1992. p. 125-26.
78. Nielsen J. Finding usability problems through heuristic evaluation. In: Bauersfeld P, Bennet J, Lynch G, editors. Proceedings in the ACM CHI'92 international conference on human factors in computing systems; 1992. p. 373-80.
79. Virzi R.A. Refining the test phase of usability evaluation: how many subjects is enough. Hum Factors 1992, 34(4):457-468.
80. US Department of Education. The health literacy of America's adults: results from the 2003 National Assessment of Adult Literacy. Publication No. 2006-483; 2006.
81. Schillinger D., Barton L.R., Karter A.J., Wang F., Adler N. Does literacy mediate the relationship between education and health outcomes? A study of a low income population with diabetes. Public Health Rep 2006, 121(3):245-254.
82. Morris N.S., Maclean C.D., Littenberg B. Literacy and health outcomes: a cross-sectional study in 1002 adults with diabetes. BMC Fam Pract 2006, 7:49.
83. Wolf M.S., Davis T.C., Tilson H.H., Bass P.F., Parker R.M. Misunderstanding of prescription drug warning labels among patients with low literacy. Am J Health Syst Pharm 2006, 63(11):1048-1055.
84. Shin T., Fan X. Comparing response rates from web and mail surveys: a meta-analysis. Field Methods 2008, 20(3):249-271.
85. Van Selm M., Jankowski N.W. Conducting online surveys. Qual Quant 2006, 40(3):435-456.
86. Pew Internet & American Life Project. Wired seniors: four million Americans aged 65 and older are online, sending email to family members and surfing for important information; 2001. http://www.pewinternet.org/Press-Releases/2001/Wired-Seniors-Four-million-Americans-aged-65-and-over-are-online-sending-email-to-family-m.aspx.
87. van Gelder M.M.H.J., Bretveid R.W., Roeleveld N. Web-based questionnaires: the future in epidemiology?. Am J Epidemiol 2010, 172(11):1292-1298.
88. Akl E.A., Maroun N., Klocke R.A., Montori V., Schünemann H.F. Electronic mail was not better than postal mail for surveying residents and faculty. J Clin Epidemiol 2005, 58(4):425-429.
89. Rankin K.M., Rauscher G.H., McCarthy B., Erdal S., Lada P., Il'yasova D., et al. Comparing the reliability of responses to telephone-administered versus self-administered web-based surveys in a case-control study of adult malignant brain cancer. Cancer Epidemiol Biomarkers Prev 2008, 17(10):2639-2646.
90. Touvier M., Méjean C., Kesse-Guyot E., Pollet C., Malon A., Castetbon K., et al. Comparison between web-based and paper versions of a self-administered anthropometric questionnaire. Eur J Epidemiol 2010, 25(5):287-296.
91. Kroth P.J., McPherson L., Leverence R., Pace W., Daniels E., Rhyne R.L., et al. Combining web-based and mail surveys improves response rates: a PBRN study from PRIME Net. Ann Fam Med 2009, 7(3):245-248.
92. Couper M.P., Kapteyn A., Schonlau M., Winter J. Noncoverage and nonresponse in an internet survey. Soc Sci Res 2007, 36(1):131-148.
93. Edwards P.J., Roberts I., Clarke M.J., Diquiseppi C., Wentz R., Kwan I., et al. Methods of increase response to postal and electronic questionnaires. Cochrane Database Syst Rev 2009, 8(3):MR000008.