Comparison of techniques for matching of usability problem descriptions

Interacting with Computers

Volumn 20, Issue 6, 2008, Pages 505-514

  Hornbæk, Kasper ^a   Frøkjær, Erik ^a  

^a UNIVERSITY OF COPENHAGEN   (Denmark)

Author keywords

Evaluator effect; Problem matching; Similarity; Usability evaluation; Usability problems

Indexed keywords

HUMAN COMPUTER INTERACTION; SOFTWARE ENGINEERING;

EVALUATOR EFFECT; PROBLEM MATCHING; SIMILARITY; USABILITY EVALUATION; USABILITY PROBLEMS;

USABILITY ENGINEERING;

EID: 56549096003     PISSN: 09535438     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.intcom.2008.08.005     Document Type: Article

References (27)

1. Andre T.S., Hartson H.R., Belz S.M., and McCreary F.A. The user action framework: a reliable foundation for usability engineering support tools. International Journal of Human-Computer Studies 54 1 (2001) 107-136
2. In: Beyer H., and Holtzblatt K. (Eds). Contextual Design: A Customer-Centered Approach to Systems Designs (1997), Morgan Kaufmann
3. Cockton G., Lavery D., and Woolrych A. Inspection-based evaluations. In: Sears A., and Jacko J.A. (Eds). The Human-Computer Interaction Handbook Second Edition (2007), Mahwah, NJ, Lawrence Erlbaum Associates 171-1190
4. Cockton G., Woolrych A., Hall L., and Hindmarch M. Changing analysts' tunes: the surprising impact of a new instrument for usability inspection method assessment. Proceedings of People and Computers XVII: Designing for Society (2003), Springer 145-162
5. Cohen, J., 1969. Statistical power analysis for the behavioral sciences.
6. Connell I., Blandford A., and Green T. CASSM and cognitive walkthrough: usability issues with ticket wending machines. Behaviour and Information Technology 23 5 (2004) 307-320
7. Connell, I.W., Hammond, N.V., 1999. Comparing usability evaluation principles with heuristics: problem instances vs. problem types. In: Proceedings of IFIP TC.13 International Conference on Human-Computer Interaction, 621-629.
8. Dumas, J., Redish, J., 1999. A Practical Guide to Usability Testing. Intellect.
9. Hartson H.R., Andre T.S., and Williges R.C. Criteria for evaluating usability evaluation methods. International Journal of Human-Computer Interaction 13 4 (2001) 373-410
10. Hertzum M., and Jacobsen N.E. The evaluator effect: a chilling fact about usability evaluation methods. International Journal of Human-Computer Interaction 13 (2001) 421-443
11. Jacobsen N.E., Hertzum M., and John B.E. The evaluator effect in usability tests. Proceedings of ACM CHI'98 Conference Summary (1998), ACM Press, New York, NY 255-256
12. John B.E., and Mashyna M.M. Evaluating a multimedia authoring tool. Journal of the American Society of Information Science 48 9 (1997) 1004-1022
13. Keenan S.L., Hartson H.R., Kafura D.G., and Schulman R.S. The usability problem taxonomy: a framework for classification and analysis. Empirical Software Engineering 4 1 (1999) 71-104
14. Kessner M., Wood J., Dillon R.F., and West R.L. On the reliability of usability testing. Proceedings of Extended Abstract of ACM Conference on Human Factors in Computing Systems (2001), ACM Press, New York, NY 97-98
15. Lavery D., Cockton G., and Atkinson M.P. Comparison of evaluation methods using structured usability problem reports. Behaviour and Information Technology 16 4/5 (1997) 246-266
16. Mack R.L., and Montaniz F. Observing, predicting, and analyzing usability problems. In: Nielsen J., and Mack R.L. (Eds). Usability Inspection Methods (1994), John Wiley and Sons 295-339
17. Mankoff J., Dey A.K., Hsieh G., Kientz J., Ames M., and Lederer S. Heuristic evaluation of ambient displays. CHI Letters, CHI 2003, ACM Conference on Human Factors in Computing Systems 5 1 (2003) 169-176
18. Molich R., and Dumas J. Comparative usability evaluation (CUE-4). Behaviour and Information Technology. 27 3 (2008) 263-281
19. Molich R., Ede M.R., Kaasgaard K., and Karyukin B. Comparative usability evaluation. Behaviour and Information Technology 23 1 (2004) 65-74
20. Nielsen J. Finding usability problems through heuristic evaluation usability walkthroughs. In: Baursfield P., Bennet J., and Lynch G. (Eds). Proceedings of ACM CHI'92 Conference on Human Factors in Computing Systems (1992), ACM Press, New York, NY 373-380
21. Norman D.A. Cognitive engineering. User Centered System Design (1986), Erlbaum, Hillsdale, NJ 31-61
22. Nørgaard, M., Hornbæk, K., 2006, What do usability evaluators do in practice? An explorative study of think-aloud testing. In: ACM Symposium on Designing Interactive Systems (DIS 2006). ACM Press, New York, 209-218.
23. Rand W.M. Objective criteria for the evaluation of clustering methods. Journal of the American Statistical Association 66 (1971) 846-850
24. Rosenthal R., and Rosnow R.L. Essentials of Behavioral Research: Methods and Data Analysis (1991), McGraw-Hill, Boston, MA
25. Skov, M., Stage, J., 2005. Supporting problem identification in usability evaluations. In: Proceedings of Australian Computer-Human Interaction Conference 2005.
26. Sutcliffe A., Ryan M., Doubleday A., and Springett M. Model mismatch analysis: towards a deeper explanation of users' usability problems. Behaviour and Information Technology 19 1 (2000) 43-55
27. Tversky A. Features of similarity. Psychological Review 84 4 (1977) 327-352