Usability problem reports for comparative studies: Consistency and inspectability

Human-Computer Interaction

Volumn 23, Issue 4, 2008, Pages 329-380

  Vermeeren, Arnold P O S ^a   Attema, Jelle ^a   Akar, Evren ^a   de Ridder, Huib ^a   von Doorn, Andrea J ^a   Erbuǧ, Çiǧdem ^b   Berkman, Ali E ^b   Maguire, Martin C ^c  

^a DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

^b MIDDLE EAST TECHNICAL UNIVERSITY   (Turkey)

^c LOUGHBOROUGH UNIVERSITY   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

LABORATORIES;

ANALYSIS PROCESSES; COMPARATIVE STUDIES; DATA ANALYSIS; PROFESSIONAL PRACTICES; TEST PROTOCOLS; USABILITY PROBLEMS; USABILITY TESTS;

TESTING;

EID: 57749110924     PISSN: 07370024     EISSN: None     Source Type: Journal    
DOI: 10.1080/07370020802536396     Document Type: Article

References (21)

1. Barendregt, W. and Bekker, M. M. (2006) Developing a coding scheme for detecting usability and fun problems in computer games for young children. Behavior Research Methods, 38, pp. 382-389.
2. Cockton, G., Lavery, D. and Woolrych, A. (2002) Inspection-based evaluations. The human-computer interaction handbook: Fundamentals, evolving technologies and emerging applications, pp. 1118-1138. Erlbaum, Mahwah, NJ
3. Guba, E. G. and Lincoln, Y. S. (1989) Fourth generation evaluation, Sage, London
4. Hartson, H. R. (2003) Cognitive, physical, sensory and functional affordances in interaction design. Behaviour & Information Technology, 22:5, pp. 315-338.
5. Hartson, H. R., Andre, T. S. and Williges, R. C. (2001) Criteria for evaluating usability evaluation methods. International Journal of Human-Computer Interaction, 13:4, pp. 373-410.
6. Hertzum, M. and Jacobsen, N. E. (2001) The evaluator effect: A chilling fact about usability evaluation methods. International Journal of Human-Computer Interaction, 13:4, pp. 421-443.
7. Hertzum, M., Jacobsen, N. E. and Molich, R. (2002) Usability inspections by groups of specialists: Perceived agreement in spite of disparate observations. Extended Abstracts of the ACM CHI 2002 Conference. ACM, New York
8. Hoenderdos, R., Vermeeren, A. P. O. S., Bekker, M. M. and Pierik, A. (2002) Design for experience: The "Look, mama!" experience. Proceedings of Interaction Design and Children Conference 2002 Shaker Publishing BV, Maastricht, the Netherlands
9. Jacobsen, N. E., Hertzum, M. and John, B. E. (1998) The evaluator effect in usability tests. Proceedings of the CHI'98 Conference on Human Factors in Computing Systems (Summary) ACM, New York
10. Kanis, H. (1993) Reliability in ergonomics/human factors. Contemporary ergonomics: Ergonomics and energy, pp. 91-96. Taylor & Francis, London
11. Lavery, D., Cockton, G. and Atkinson, M. (1997) Comparison of evaluation methods using structured usability reports. Behaviour & Information Technology, 16:4, pp. 246-266.
12. Law, E. L. -C. and Hvannberg, E. T. (2004) Analysis of combinatorial user effect in international usability tests. Proceedings of ACM CHI 2004 Conference on Human Factors in Computing Systems ACM, New York
13. Molich, R., Ede, M. R., Kaasgaard, K. and Karyukin, B. (2004) Comparative usability evaluation. Behaviour & Information Technology, 23:1, pp. 65-74.
14. Noiwan, J. and Norcio, A. F. (2006) Cultural differences on attention and perceived usability: Investigating color combinations of animated graphics. International Journal of Human-Computer Studies, 64:2, pp. 103-122.
15. Park, K. S. and Lim, C. H. (1999) A structured methodology for comparative evaluation of user interface designs using usability criteria and measures. International Journal of Industrial Ergonomics, 23, pp. 379-389.
16. Vermeeren, A. P. O. S. (1999) Designing scenarios and tasks for user trials for home electronic devices. Human factors in product design: Current practice and future trends, pp. 47-55. Taylor & Francis, London
17. Vermeeren, A. P. O. S. (2004) Structured video analysis of user test data, using the DEVAN tool. Usability testing: Methods, experiences, achievements, pp. 123-140. Middle East Technical University, Faculty of Architecture, Ankara, Turkey
18. Vermeeren, A. P. O. S., Bekker, M. M., van Kesteren, I. E. H. and de Ridder, H. (2007) Experiences with structured interviewing of children during usability tests. Proceedings of HCI 2007, The 21st British HCI Group Annual Conference BCS, Swindon, UK
19. Vermeeren, A. P. O. S., den Bouwmeester, K., Aasman, J. and de Ridder, H. (2002) DEVAN: A tool for detailed video analysis of user test data. Behaviour & Information Technology, 21:6, pp. 403-423.
20. Vermeeren, A. P. O. S., Koenderink-van Doorn, A.J. and de Ridder, H. (2006) Reliability of a checklist-based user test data analysis procedure. Proceedings IEA 2006 Congress: Meeting Diversity in Ergonomics Elsevier, Amsterdam
21. Vermeeren, A. P. O. S., van Kesteren, I. E. H. and Bekker, M. M. (2003) Managing the evaluator effect in user testing. Proceedings of INTERACT'03 IOS Press, Amsterdam