Usability evaluation methods: Mind the gaps

ACM International Conference Proceeding Series

Volumn , Issue , 2009, Pages 122-131

  De Kock, Estelle ^a   Van Biljon, Judy ^a   Pretorius, Marco ^a  

^a UNIVERSITY OF SOUTH AFRICA   (South Africa)

Author keywords

Eye tracking; Heuristic evaluation; Usability; User testing

Indexed keywords

EYE-TRACKING; HEURISTIC EVALUATION; INSPECTION METHODS; LEARNING MANAGEMENT SYSTEM; USABILITY EVALUATION METHODS; USABILITY METHODS; USABILITY PROBLEMS; USABILITY TESTING; USER TESTING; WEB SITE DESIGN;

ENGINEERS; INSPECTION; RESEARCH; USABILITY ENGINEERING; USER INTERFACES; WORLD WIDE WEB;

HEURISTIC METHODS;

EID: 74049085809     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1632149.1632166     Document Type: Conference Paper

References (31)

1. 9241-11, I.: Guidance on Usability (1998) [cited 15 March 2009], Available from: http://www.iso.org/iso/en/CatalogueDetailPage.CatalogueDetail? CSNUMBER=16883.
2. Äijö, R.,Mantere, J. 2001. Are Non-Expert Usability Evaluations Valuable? In 18th International Symposium on Human Factors in Telecommunications (HfT'01). Bergen, Norway.
3. Aula, A., Majaranta, P., Räihä, K.J., 2005. Eye-Tracking Reveals the Personal Styles for Search Result Evaluation. Interact 2005, LNCS 3585, 1058-1061.
4. Bednarik, R., Tukiainen, M. 2006. An eye-tracking methodology for characterizing program comprehension processes. In ETRA 2006. San Diego, California,: ACM 1-59593-305-0/06/0003.
5. Desurvire, H.W. 1994. Faster, Cheaper!! Are Usability Inspection Methods as Effective as Empirical Testing? Usability Inspection Methods, Mack. John Wiley & Sons, New York, NY.
6. Desurvire, H.W., Kondziela, J.M., & Atwood, M.E. 1992. What is gained and lost when using evaluation methods other than empirical testing. Proceedings of the HCI'92 Conference on People and Computers VII. 89-102.
7. Ehmke, C.,Wilson, S. 2007. Identifying Web Usability Problems from Eye-Tracking Data. Proceedings of the 21st British CHI Group Annual Conference on HCI 2007: People and Computers XXI: HCI...but not as we know it. University of Lancaster, United Kingdom, ISBN:978-1-902505-94-7, 1: 119-128,.
8. Fu, L., Salvendy, G., Turley, L. 2002. Effectiveness of user testing and heuristic evaluation as a function of performance classifications. Behaviour & Information Technology. 21(2) 137-143.
9. Gray, W.D., Salzman, M.C. 1998. Damaged Merchandise? A Review of Experiments That Compare Usability Evaluation Methods. Human-computer interaction 13, 203-261.
10. Hartson, H.R., Terence, S.A., Williges, R.C. 2001. Criteria For Evaluating Usability Evaluation Methods. International journal of human-computer interaction. 13(4), 373-410.
11. Hertzum, M.,Jacobsen, N.E. 2003. The Evaluator Effect: A Chilling Fact About Usability Evaluation Methods. International journal of human-computer interaction. 15(1), 183-204.
12. Jeffries, R., Desurvire, H.W. 1992. Usability Testing vs. Heuristic Evaluation: Was there a contest? SIGCHI Bulletin. 24(4).
13. Jeffries, R., Miller, J.R., Wharton, C., Uyeda, K.M. 1992. User interface evaluation in the real-world : a comparison of four techniques. ACM SIGCHI Bulletin, 24 (4) : 39-41, ISSN:0736-6906 (October 1992)
14. Karat, C.M., Campbell, R., & Fiegel, T. 1992. Comparison of empirical testing and walkthrough methods in user interface evaluation. Proceedings of the ACM CHI'92 Conference on Human Factors in Computing Systems. 397-404.
15. Karn, K.S., Jacob, R.J.K. 2003. Eye tracking in human-computer interaction and usability research: Ready to deliver the promises. In The mind's eye, cognitive and Applied Aspects of Eye movement Research. Elsevier, Amsterdam.
16. Kasarskis, P., Stehwien, J., Hickox, J., Aretz, A.2001. Comparison of expert and novice scan behaviours during VFR flight. 11th International Symposium on Aviation Psychology Columbus, OH: The Ohio State University. [cited: 16 April 2009], Available from: http://www.humanfactors.uiuc.edu/ Reports&PapersPDFs/isap01/proced01.pdf.
17. Law, E.L.,Hvannberg, E.T. 2004. Analysis of strategies for improving and estimating the effectiveness of heuristic evaluation. In Proceedings of NordiCHI'04. Tampere, Finland: ACM.
18. Nielsen, J. 1992. Finding usability problems through heuristic evaluation. Conference on Human Factors in Computing Systems. Proceedings of the SIGCHI conference on Human factors in computing systems, Monterey, California, United States, ISBN:0-89791-513-5, 373-380,
19. Nielsen, J. 2003. Jacob Nielsen's Alertbox: Usability 101. [cited 15 April 2009] Available from: http://www.useit.com/alertbox/20030825.html
20. Nielsen, J. 1994. Heuristic evaluation. In: J. Nielsen and R.L. Mack, (eds.): Usability inspection methods. John Wiley & Sons, New York, 22-62.
21. Nielsen, J.,Levy, J. 1994. Measuring Usability: Preference vs. Performance. Communications of the ACM. 37, 66-76.
22. Nielsen, J.,Mollich, R.1990. Heuristic evaluation of User interfaces. CHI'90 Proceedings. 249-256.
23. Preece, J., Rogers, Y., and Sharp, H. 2002. Interaction Design: beyond human-computer interaction. John Wiley & Sons, Inc.
24. Pretorius, M.C., Calitz, A.P., van Greunen, D. 2005. The Added Value of Eye Tracking in the Usability Evaluation of a Network Management Tool. In Proceedings of the 2005 annual research conference of the South African institute of computer scientists and information technologists on IT research in developing countries. White River, South Africa.
25. Sauro, J., Kindlund, E. 2005. A Method to Standardize Usability Metrics into a Single Score. Proceedings of the SIGCHI conference on Human factors in computing systems Portland, Oregon, USA, ISBN:1-58113-998-5, 401-409
26. Schneiderman, B. 1998. Designing the user Interface: Strategies for effective human-computer interaction. Addison Wesley Longman, Reading, MA.
27. Ssemugabi, S., De Villiers, R. 2007. A comparative study of two usability evaluation methods using a web-based e-learning application. Proceedings of the 2007 annual research conference of the South African institute of computer scientists and information technologists on IT research in developing countries Port Elizabeth, South Africa. ISBN:978-1-59593-775-9, 226: 132-142.
28. Thimbleby, H. 2007. Press on. MIT Press, Cambridge.
29. Tognazzini, B. 2003. First Principles of Interaction design. [cited 8 June 2009]; Available from: www.asktog.com/basics/firstPrinciples.html.
30. van Greunen, D., Wesson, J. 2001. Formal usability testing - Informing design. [Cited 6 June 2009]. http://osprey.unisa.ac.za/saicsit2001/Electronic/ paper20.pdf
31. Wheeler Atkinson, B.F., Bennet, T.O., Bahr, G.S., Nelson, M.W. 2007. Development of a Multiple Heuristic Evaluatin Table (MHET) to Support Software Development and Usability Analysis. [Cited 25 May 2009]. Available from: http://research.fit.edu/carl/documents/MHET.pdf