Evaluating consumer health information websites: The importance of collecting observational, user-driven data

IEEE International Professional Communication Conference

Volumn , Issue , 2010, Pages 333-338

  Van Den Haak, Maaike ^a   Van Hooijdonk, Charlotte ^a  

^a VU University   (Australia)

Author keywords

Consumer health information (CHI) websites; Observational user research; Think aloud method; Usability; User characteristics

Indexed keywords

CONSUMER HEALTH INFORMATION (CHI) WEBSITES; THINK ALOUD; USABILITY; USER CHARACTERISTICS; USER RESEARCH;

HEALTH; QUALITY CONTROL; RESEARCH; WORLD WIDE WEB;

USABILITY ENGINEERING;

EID: 77956427382     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPCC.2010.5530031     Document Type: Conference Paper

References (46)

1. Fox, S. Online Health Search 2006 (Pew Internet & American Life Project), URL (consulted November 2008): http://ppp.pewinternet.org/pdfs/PIP- Online-Health-2006.pdf
2. Cline, R.J.W. and K.M. Haynes. Consumer health information seeking on the internet: the state of the art. Health Education Research. 16: 671-692, 2001
3. Anderson, J.G. Consumers of e-health: Patterns of Use and Barriers. Social Science Computer Review. 22: 242-248, 2004
4. Rice, R.E. Influences, usage, and outcomes of Internet health information searching: Multivariate results from the Pew surveys. International Journal of Medical Informatics. 75: 8-28, 2006
5. Andreassen, H.K., M.M. Bujnowska-Fedak, C.E Chronaki, R.C. Dumitru, I. Pedule, S. Santana, H. Voss, and R. Wynn. European citizens' use of E-health services: A study of seven countries. BMC Public Health. 7:e7, 2007
6. Kim, P., T.R. Eng, M.J. Deering, and A. Maxfield. Published criteria for evaluating health related web sites: review. Br Med J. 318: 647-649, 1999
7. Eysenbach, G., J. Powell, and O. Kuss, O. Empirical studies assessing the quality of health information for consumers on the world wide web: a systematic review. JAMA. 20: 2691-2700, 2002
8. Harland, J. and P. Bath. Assessing the quality of websites providing information on multiple sclerosis: evaluating tools and comparing sites. Health Informatics Journal. 13:207-221, 2007
9. Bernstam, E.V., D.M. Shelton, M. Walji, and F. Meric-Bernstam. Instruments to assess the quality of health information on the World Wide Web: what can our patients actually use? International Journal of Medical Informatics. 74: 13-19, 2005
10. Ademiluyi, G., C.E. Rees, and C.E. Sheard. Evaluating the reliability and validity of three tools to assess the quality of health information on the Internet. Patient Education and Counseling. 50: 151-155, 2003
11. Cullen, R., and C. Houghton, C. Democracy online: An assessment of New Zealand Government Web Sites. Government Information Quarterly. 17: 243-267, 2000
12. Haak, van den, M.J., M. Jong, de, and P.J. Schellens. Evaluating municipal websites: A methodological comparison of three think-aloud variants. Government Information Quarterly. 26: 193-202, 2009
13. Battleson, B., A. Booth, and J. Weintrop. Usability testing of an academic library web site: a case study. Journal of Academic Librarianship. 237: 188-189, 2001
14. Campbell, N. Usability Assessment of Library-Related Web Sites: Methods and Case studies, LITA, Chicago, 2001
15. Haak, M.J., van den, M. Jong, de, and P.J. Schellens. Retrospective versus concurrent think-aloud protocols: Testing the usability of an online library catalogue. Behaviour & Information Technology. 22: 339-351, 2003
16. Sienot, M. Pretesting web sites: a comparison between the plus-minus method and the think-aloud method for the World Wide Web. Journal of Business and Technical Communication. 11: 469-482, 1997
17. Benbunan-Fich, R. Using protocol analysis to evaluate the usability of a commercial Web site. Information and Management. 39: 151-163, 2001
18. Kools, M., RA.C Ruiter, M.W.J. Wiel, van de, and G. Kok. Testing the usability of access structures in a health education brochure. British Journal of Health Psychology, 12: 525-541, 2007
19. Nijland, N., J. Gemert-Pijnen, van, H. Boer, M.F. Stee-houder, and E.R. Seydel. Evaluation of internet-based technology for supporting self-care: problems encountered by patients and caregivers when using self-care applications. J. Med Internet Research. 10: e13, 2008
20. Johnston, S.K., H.Q. Nguyen, and S. Wolpin. Designing and Testing a Web-Based interface for Self-monitoring of Exercise and Symptoms for Older Adults with Chronic Obstructive Pulmonary Disease. Computers, Informatics, Nursing. 27: 166-174, 2009
21. Peute, L.W.P., R. Spithoven, P.J.M. Bakker, and MW.M Jaspers. Usability Studies on Interactive Health Information Systems; Where do we stand? (327-332). In: S.K. Andersen (Ed.). eHealth Beyond the Horizon - Get IT There, IOS Press, 2008
22. Jaspers, MW.M. A comparison of usability methods for testing interactive health technologies: Methodological aspects and empirical evidence. International Journal of Medical Informatics. 78:340-353, 2009
23. Haak, M.J., van den. A penny for your thoughts - investigating the validity and reliability of think-aloud protocols for usability testing. 2008
24. Eysenbach, G. Design and evaluation of consumer health information websites. In: D. Lewis, G. Eysenbach, R. Kukafka, H. Jimison, Z. Stavri (Eds.). Consumer Health Informatics. Springer, New York, 2005
25. Goldberg, J.H., M.J. Stimson, M. Lewenstein, N. Scott, and A.M. Wichansky. Eye tracking in web search tasks: Design implications. Proceedings of the Eye Tracking Research & Applications Symposium 2002. ACM, New York, 2002.
26. Birru, M.S., V.M. Monaco, L. Charles, H. Drew, V. Njie, T. Bierria, and colleagues. Internet usage by low-literacy adults seeking health information: an observational analysis. Journal of Medical Internet Research. 6: e25, 2004
27. Crystal, A., and J. Greenberg. Relevance criteria identified by health information users during web searches. Journal of the American Society for Information Science and Technology. 57: 1368-1382, 2006
28. Czaja, S.J., J. Sharit, and S.N. Nair. Usability of the Medicare Health Web Site, JAMA. 300:790-792, 2008
29. Eysenbach, G., and C. Köhler. How do consumers search for and appraise health information on the world wide web? Qualitative study using focus groups, usability tests, and indepth interviews. BMJ. 3247: 573-577, 2002
30. Gilbert, L.K., J. Temby, and S. Rogers. Evaluating a teen STD prevention Web site. Journal of Adolescent Health. 37: 236-242, 2005
31. Graham, L., T. Tse, and A. Keselman. Exploring user navigation during online health information seeking. AMIA Annual Symposium Proceedings. 299-303, 2006
32. Grama, L.M., M. Beckwith, W. Bittinger, D. Blais, C. Lollar, A. Middleswarth, and colleagues. The role of user input in shaping online information from the National Cancer Institute. J Med Internet Res. 7: e25, 2005
33. Hansen, D.L., H.A. Derry, P.J. Resnick, and C.R. Richardson. Adolescents Searching for Health Information on the Internet: An Observational Study. Journal of Medical Internet Research. 5: e25, 2003
34. Hinchliffe, A., and W.K. Mummery. Applying usability testing techniques to improve a health promotion website. Health Promotion Journal of Australia. 19: 29-35, 2008
35. Keselman, A., A.C. Browne, and D.R. Kaufman. Consumer Health Information Seeking as Hypothesis Testing. Journal of the American Medical Informatics Association. 15: 484-495, 2008
36. Lewis, D., S. Gundwardena, and G. El Saadawi. Caring Connection: Developing an Internet Resource for Family Caregivers of Children With Cancer. CIN: Computers, Informatics, Nursing. 23: 265-274, 2005
37. McCray A.T., E. Dorfman, A. Ripple, N.C. Ide, M, Jha, D.G. Katz, and colleagues. Usability issues in developing a Web-based consumer health site. AMIA Annual Symposium Proceedings. 556-560, 2000
38. McKemmish, S., R. Manaszewicz, F. Burstein, and J. Fisher. Consumer empowerment through metadata-based information quality reporting: The Breast Cancer Knowledge Online Portal. Journal of the American Society for Information Science and Technology. 60: 1792-1807, 2009
39. Moore, M., R.G., Bias, K. Prentice, R. Fletcher, and T. Vaughn. Web usability testing with a Hispanic medically underserved population. J Med Libr Assoc. 97: 114-121, 2009
40. Nahm, E.S., J. Preece, B. Resnick, and M.E. Mills. Usability of health web sites for older adults. Computers, Informatics, Nursing. 22: 326-334, 2004
41. Ostergren, M.J and B.T. Karras. ActiveOptions: leveraging existing knowledge and usability testing to develop a physical activity program website for older adults. AMIA Annual Symposium Proceedings. 578-582, 2007
42. Priest, L., L. Nayak, and I. Stuart-Hamilton. Website task performance by older adults. Behaviour & Information Technology. 26: 285-295, 2007
43. Sillence, E., P. Briggs, P.R. Harris, and L. Fishwick. How do patients evaluate and make use of online health information? Social Science & Medicine. 64: 1853-1862, 2007
44. Sillence, E., P. Briggs, P.R. Harris, and L. Fishwick. A framework for understanding trust factors in web-based health advice. International Journal of Human-Computer Studies. 64: 697-713, 2006
45. Williams, P., D. Nicholas, P. Huntington, and F. McLean. Surfing for health: user evaluation of a health information website. Part two: fieldwork. Health Info Libr J. 19: 214-225, 2002
46. Zeng, Q.T., S. Kogan, R.M. Plovnick, J. Crowell, E.M. Lacroix, and R.A. Greenes. Positive attitudes and failed queries: an exploration of the conundrums of consumer health information retrieval. Int J Med Inform. 73: 45-55, 2004