Technical review: Current issues of usability testing

IETE Technical Review (Institution of Electronics and Telecommunication Engineers, India)

Volumn 26, Issue 6, 2009, Pages 402-406

  Alshamari, Majed ^a   Mayhew, Pam ^a  

^a UNIVERSITY OF EAST ANGLIA   (United Kingdom)

Author keywords

Evaluator; Number of users; Tasks; Usability in the future.; Usability testing; Web usability

Indexed keywords

SYSTEM USABILITY; TECHNICAL REVIEWS; USABILITY TESTING; WEB USABILITY;

USABILITY ENGINEERING;

EID: 73249143277     PISSN: 02564602     EISSN: None     Source Type: Journal    
DOI: 10.4103/0256-4602.57825     Document Type: Review

References (32)

1. X. Faulkner. Usability Engineering, Macmillan Press Ltd, 2000.
2. A. Seffah, M. Donyaee, R. Kline, and H. Padda. "Usability measurement and metrics: A consolidated model". Software Quality Vol. 14, pp.159-178, 2006.
3. G. Lindgaard, and J. Chattratichart. "Usability Testing: What Have We Overlooked?", CHI 2007 Proceeding. San Jose, CA, USA: ACM Press, pp. 1415-1424, 2007.
4. P. Zaphiris, and S. Kurniawan. Human Computer Interaction Research in Web Design and Evaluation, Idea Group Publishing, 2006.
5. M. Alshamari, and P. Mayhew, "Task Design: Its Impact on Usability Testing", The Third International Conference on Internet and Web Applications and Services, IEEE, Athens, Greece, pp. 583-589, 2008.
6. A. Vermeeren, I. Kesteren, and M. Bekker. "Managing the 'Evaluator Effect' in User Testing", INTERACT, IOS Press, pp. 647-654, 2003.
7. M. Hertzum, and N.E. Jacobsen. "The Evaluator Effect: A Chilling Fact About Usability Evaluation Methods". International Journal of Human-Computer Interaction Vol. 15. pp. 183-204, 2003.
8. M. Nørgaard, and K. Hornbæk. "What do usability evaluators do in practice?: an explorative study of think-aloud testing", Symposium on Designing Interactive Systems, pp. 209 - 218. 2006.
9. W. Barendregt, and M. Bekker. "Managing the evaluator effect in the analysis of video data of children's computer games", Proceedings of the BCS-HCI, People and Computers XVIII - Design for Life, Leeds, UK, 2004.
10. J. Nielsen. Why You Only Need to Test with 5 Users, Available from: http://www.useit.com, 2000.
11. C. Turner, J. Nielsen, and J.Lewis, "Determining Usability Test Sample Size". International Encyclopedia of Ergonmics and Human Factors Vol. 3. pp, 3084-3088, 2006.
12. L. Faulkner, "Beyond the five-user assumption: Benefits of increased sample sizes in usability testing", Behavior Research Methods, Instruments, and Computers, Psychonomic Society Publications, pp. 379-383, 2003.
13. R. Molich, M. Ede, K. Kaasgaard, and B. Karyukin. "Comparative Usability Evaluation". Behaviour and Information Technology Vol,23. pp, 65-74, 2004.
14. A. Woolrych, and G. Cockton. "Why and when five test users aren't enough", IHM-HCI 2001 Conference, Toulouse, France, pp. 105-108, 2001.
15. J. Nielsen, M. Hertzum, and B. John. "The evaluator effect in usability studies: Problem detection and severity judgements", HFES pp. 1336-1340 1998.
16. C. Wilson, "Taking usability practitioners to task". Interactions Vol. 14, pp.48-49, 2007.
17. K. Hornbaek, and E. Frokjaer, "Comparing Usability Problems and Redesign Proposals as Input to Practical Systems Development". CHI 2005 (2005).
18. C. Wolf, J. Carroll, T. Landauer, B. John, and J. Whiteside, "The role of laboratory experiments in HCI: help, hindrance, or ho-hum?", ACM SIGCHI Bulletin ACM New York, NY, USA: pp. 265-268 1989.
19. T. Tullis, S. Fleischman, M. McNulty, C. Cianchette, and M. Bergel. "An Empirical Comparison of Lab and Remote Usability Testing of Web Sites", Usability Professionals Association Conference, 2002.
20. A. Wichansky. "Usability testing in 2000 and beyond". Ergonomics, Vol, 43 pp, 998-1006, 2000.
21. K. Hornbæk. "Current practice in measuring usability: Challenges to usability studies and research". Int. J. Hum.-Comput. Stud. Vol, 64.pp,79-102,2006.
22. J. Sauro, and E. Kindlund. "A Method to Standardize Usability Metrics Into a Single Score", Conference on Human Factors in Computing Systems, Portland, Oregon, USA, 2005, pp. 401 - 409.
23. J. Nielsen, Success Rate: The Simplest Usability Metric. Available from: http://www.useit.com, 2001.
24. K. Hornbaek, and J. Stage. "The Interplay Between Usability Evaluation and User Interaction Design". International Journal of Human-Computer Interaction Vol, 21. pp, 117-123, 2006.
25. J. Artim. Usability Problem Severity Ratings, Available from: http:// primaryview.org, 2003.
26. M. Hertzum. "Problem Prioritization in usability Evalution: From severity assessments toward impact on design". International Journal of Human-Computer Interaction Vol. 21, pp. 125-146, 2006.
27. G. Di Lucca, and A. Fasolino, "Testing Web-based applications: The state of the art and future trends". Information and Software Technology Vol.48. pp. 1172-1186, 2006.
28. C. Osterbauer, M. Köhle, T. Grechenig, and M. Tscheligi, "Web Usability Testing: A case study of usability testing of chosen sites (banks, daily newspapers, insurances)", the Sixth Australian World Wide Web Conference, 2000.
29. R. Sherry and Y. Chen, "The assessment of usability of electronic shopping: A heuristic evaluation". Internationa journal of Information Management Vol. 25, pp. 516-532, 2005.
30. M. Levi, and F. Conrad, Usability testing of World Wide Web sites: a CHI 97 workshop. SIGCHI Bull Vol. 29 40-43 1997.
31. R. Stanley Dicks, "Mis-usability: on the uses and misuses of usability testing", ACM Special Interest Group for Design of Communication, ACM Press, Toronto, Ontario, Canada, pp. 26 -30. 2002.
32. A. Anandhan, S. Dhandapani, H. Reza, and K. Namasivayam. "Web usability testing - CARE methodology", the Third conference on Information Technology: New Generations (ITNG'06), IEEE, pp. 450-500.