What happened to remote usability testing?: An empirical study of three methods

Conference on Human Factors in Computing Systems - Proceedings

Volumn , Issue , 2007, Pages 1405-1414

  Andreasen, Morten Sieker ^a   Nielsen, Henrik Villemann ^b   Schrøder, Simon Ormholt ^c   Stage, Jan ^b  

^a SYSTEMATIC A S   (Denmark)

^b AALBORG UNIVERSITY   (Denmark)

^c Danske Bank Group   (Denmark)

Author keywords

Empirical study; Remote testing; Usability testing

Indexed keywords

NUMERICAL ANALYSIS; PROBLEM SOLVING; SOFTWARE ENGINEERING; SOFTWARE TESTING; USER INTERFACES;

EMPIRICAL STUDY; REMOTE TESTING; SOFTWARE ORGANIZATIONS; USABILITY TESTING;

USABILITY ENGINEERING;

EID: 35348836706     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1240624.1240838     Document Type: Conference Paper

References (35)

1. Ames, M. Final Report on Remote Usability Studies. http://www.ocf. berkeley.edu/~morganya/research/dmp/report.html.
2. Andreasen, M. S., Nielsen, H. V., Schrøder, S. O. and Stage, J. Usability in open source software development: Opinions and practice. Information Technology and Control 35A, 3 (2006), 303-312.
3. Bartek, V. and Cheatham, D. Experience Remote Usability Testing, Part 1. http://www-106.ibm.com/developerworks/library/wa-rmusts1/.
4. Bartek, V. and Cheatham, D. Experience Remote Usability Testing, Part 2. http://www-106.ibm.com/developerworks/web/ library/wa-rmusts2.html.
5. Bartek, V. and Cheatham, D. Experiences in Remote Rsability Evaluations. http://www-3.ibm.com /ibm/easy/eou ext.nsf/Publish/50 ?OpenDocument&/ Publish/1116/$File/paper1116.pdf.
6. Benson, C., Muller-Prove, M. and Mzourek, J. Professional usability in open source projects: Gnome, openoffice.org, netbeans. Proceedings of CHI 2004, ACM Press (2004), 1083-1084.
7. Brush, A. B., Ames, M. and Davis, J. A comparison of synchronous remote and local usability studies for an expert interface. Proceedings of CHI 2004, ACM Press (2004), 1179-1182.
8. Castillo, J. C., Hartson, H. R. and Hix, D. Remote usability evaluation: Can users report their own critical incidents? Proceedings of CHI 1998, ACM Press (1998), 253-254.
9. de Vreede, G.-J., Fruhling, A. and Chakrapani, A. A repeatable collaboration process for usability testing. Proceedings of HICSS 2005, IEEE Computer Society (2005), Track 1, p. 46.
10. Dempsey, B. J., Weiss, D., Jones, P. and Greenberg, J. Who is an open source software developer? Communications of the ACM 45, 2 (2002), 67-72.
11. Dray, S. and Siegel, D. Remote possibilities?: International usability testing at a distance, interactions 11, 2 (2004), 10-17.
12. Eklund, S., Feldman, M., Trombley, M. and Sinha, R. Improving the Usability of Open Source Software: Usability Testing of staroffice cale. http://www.sims.berkeley.edu/~sinha/opensource.html.
13. Frishberg, N., Dirks, A. M., Benson, C., Nickell, S. and Smith, S. Getting to know you: Open source development meets usability. Proceedings of CHI 2002, ACM Press (2002), 932-933.
14. Gough, D. and Phillips, H. Remote Online Usability Testing: Why, How, and When to Use it. http://www.boxesandarrows.com/view/remote online usability testing why how and when to use it.
15. Hammontree, M., Weiler, P. and Nayak, N. Remote usability testing. Interactions 1, 3 (1994), 21-25.
16. Hartson, H. R. and Castillo, J. C. Remote evaluation for post-deployment usability improvement. Proceedings of AVI 1998, ACM Press (1998), 22-29.
17. Hartson, H. R., Castillo, J. C., Kelso, J. and Neale, W. C. Remote evaluation: The network as an extension of the usability laboratory. Proceedings of CHI 1996, ACM Press (1996), 228-235.
18. Hertzum, M. and Jacobsen, N. E. The evaluator effect: A chilling fact about usability evaluation methods. International Journal of Human-Computer Interaction 15, 1 (2003), 183-204.
19. Houck-Whitaker, J. Remote Testing versus Lab Testing. http://boltpeters.com/articles/versus.html.
20. Karat, C.-M., Campbell, R. and Fiegel, T. Comparison of empirical testing and walkthrough methods in user interface evaluation. Proceedings of CHI 1992, ACM Press (1992), 397-404.
21. Kjeldskov, J., Skov, M. B. and Stage, J. Does time heal: A longitudinal study of usability. Proceedings of OZCHI 2005, ACM Press (2005), 1-10.
22. Krauss, F. S. H. Methodology for remote usability activities: A case study. IBM Systems Journal 42, 4 (2003), 582-593.
23. McFadden, E., Hager, D. R., Elie, C. J. and Blackwell, J. M. Remote usability evaluation: Overview and case studies. International Journal of Human-Computer Interaction 14, 3&4 (2002), 489-502.
24. Moon, J. Y. and Sproull, L. Essence of Distributed Work: The Case of the linux Kernel. http://www.firstmonday.org/issues/issue511/moon/ index.html.
25. Murphy J., Howard S., Kjeldskov K. and Goschnick, S. Location, location, location: Challenges of outsourced usability evaluation. Proceedings of the Workshop on Improving the Interplay between Usability Evaluation and User Interface Design, NordiCHI 2004, Aalborg University, Department of Computer Science, HCI-Lab Report no. 2004/2 (2004), 12-15.
26. Nichols, D. M. and Twidale, M. B. Usability and open source software. Technical Report 10/02, Department of Computer Science, University of Waikato, Working Paper Series ISSN 1170-487X, 2002.
27. Olmsted, E. and Gill, M. In-person usability study compared with self-administered web (remote-different time-place) study: Does mode of study produce similar results? Proceedings of UPA 2005, UPA (2005).
28. Petrie, H., Hamilton, F., King, N. and Pavan, P. Remote usability evaluation with disabled people. Proceedings ofCHI 2006, ACM Press (2006), 1133-1141.
29. Raymond. E. The Revenge of the Hackers. O'Reilly and Associates, 1999.
30. Rubin, J. Handbook of Usability Testing. Wiley, 1994.
31. Safire, M. Remote moderated usability. http://www.upassoc.org/usability resources/conference/ 2004/im safire.html, 2004.
32. Scholtz, J. Adaption of traditional usability testing methods for remote testing. Proceedings of HICCS '01, IEEE (2001).
33. Skov, M. B. and Stage, J. Supporting problem identification in usability evaluations. Proceedings of OzCHI 2005, ACM Press (2005), 1-9.
34. Thompson, K. E., Rozanski, E. P. and Haake, A. R. Here, there, anywhere: Remote usability testing that works. Proceedings of CITCS 2004, ACM Press (2004), 132-137.
35. Winckler, M. A. A., Freitas, C. M. D. S. and de Lima, J. V. Usability remote evaluation for www. Proceedings of CHI 2000, ACM Press (2000), 131-132.