It's worth the hassle!: The added value of evaluating the usability of mobile systems in the field

ACM International Conference Proceeding Series

Volumn 189, Issue , 2006, Pages 272-280

  Nielsen, Christian Monrad ^a   Overgaard, Michael ^b   Pedersen, Michael Bach ^c   Stage, Jan ^d   Stenild, Sigge ^e  

^a NNIT AS   (Denmark)

^b Kommunedata   (Denmark)

^c ETI A/S   (Denmark)

^d AALBORG UNIVERSITY   (Denmark)

^e Guppyworks ^*  (Denmark)

Author keywords

Experimental comparison; Field test; Laboratory test; Usability evaluation

Indexed keywords

PROBLEM SOLVING; RESEARCH AND DEVELOPMENT MANAGEMENT;

EXPERIMENTAL COMPARISON; FIELD TESTS; LABORATORY TESTS; USABILITY EVALUATION;

HUMAN COMPUTER INTERACTION;

EID: 34547176802     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1182475.1182504     Document Type: Conference Paper

References (31)

1. Abowd, G. and Mynatt, E. (2000) Charting past, present and future research in ubiquitous computing. ACM Transactions on Computer-Human Interaction, 7(1):29-58.
2. Baillie, L. (2003) Future Telecommunication: Exploring actual use, In Proceedings of IFIP TC 13 International Conference on Human-Computer Interaction, (INTERACT '03). IOS Press.
3. Bohnenberger, T., Jameson, A., Krüger, A., and Butz, A. (2002) Location-Aware Shopping Assistance: Evaluation of a Decision-Theoretic Approach. In Proceedings of Mobile HCI 2002. Springer-Verlag, LNCS.
4. Brewster S. (2002) Overcoming the Lack of Screen Space on Mobile Computers. Personal and Ubiquitous Computing, 6, 188-205
5. Dix, A., Finlay, J., Abowd, G. and Beale, R. (1998) Human-Computer Interaction, Prentice Hall Europe, Second Edition.
6. Esbjörnsson M., Juhlin O. and Östergren M. (2003) Motorcyclists Using Hocman Field Trials on Mobile Interaction. In Proceedings of the 5th International Mobile HCI2003 conference. Springer-Verlag, LNCS.
7. Frøkjær, E., Hertzum, M. and Hornbæk, K. (2000) Measuring Usability: Are Effectiveness, Efficiency, and Satisfaction Really Correlated? In Proceedings of the ACM CHI 2000 Conference on Human Factors in Computing Systems. ACM Press.
8. Gray, W. D. and Salzman, M. C. (1998) Damaged merchandise? A review of experiments that compare usability evaluation methods. Human-Computer Interaction, 13(3):203-261.
9. Hart, S. G., and Staveland, L. E. (1988) Development of a multi-dimensional workload rating scale: Results of empirical and theoretical research. In P. A. Hancock & N. Meshkati (Eds.), Human mental workload. Elsevier Science Publishers.
10. Hertzum, M. (1999) User Testing in Industry: A Case Study of Laboratory, Workshop, and Field Tests. In Proceedings of the 5th ERCIM Workshop, pp. 59-72.
11. Hertzum, M. and Jacobsen, N.E. (2001) The Evaluator Effect: A Chilling Fact about Usability Evaluation Methods. International Journal of Human-Computer Interaction, 13(4).
12. ISO The international Organization for Standardization (1998) Ergonomic requirements for office work with visual display terminals (VDTs). Part 11: Guidance on usability (ISO 9241-11).
13. Johnson P. (1998) Usability and Mobility; Interactions on the move. In Proceedings of the First Workshop on Human-Computer Interaction with Mobile Devices. GIST Technical Report G98-1.
14. 14.Kaikkonen, A., Kallio, T., Kekäläinen, Á., Kankainen, A. and Cankar, M. (2005) Usability testing of mobile applications: A comparison between laboratory and field testing. Journal of Usability Studies, 1(1):4-16.
15. 15.Karat, C, Campbell, R. and Fiegel, T. (1992) Comparison of Empirical Testing and Walkthrough Methods in User Interface Evaluation. In Proceedings of the SIGCHI conference on Human factors in computing systems 1992. ACM.
16. Kjeldskov, J. and Stage, J. (2004) New Techniques for Usability Evaluation of Mobile Systems. International Journal of Human-Computer Studies, 60(4-5):599-620.
17. Kjeldskov, J. and Skov, M. B. (2003) Creating a Realistic Laboratory Setting: A Comparative Study of Three Think-Aloud Usability Evaluations of a Mobile System. In Proceedings of the 9th IFIP TC13 International Conference on Human Computer Interaction, Interact 2003. IOS Press.
18. Kjeldskov, J., Skov, M.B., Als, B.S. and Heegh, R.T. (2004) Is it Worth the Hassle? Exploring the Added Value of Evaluating the Usability of Context-Aware Mobile Systems in the Field. In Proceedings of the 6th International Mobile HCI 2004 conference. LNCS, Springer-Verlag.
19. Lai J., Cheng K., Green P. and Tsimhoni O. (2001) On the Road and on the Web? Comprehension of synthetic speech while driving. In Proceedings of CHI'2001, pp. 206-212. ACM.
20. Molich, R. (2000) Brugervenlige EDB-Systemer, 2nd edition. Ingeniøren|Bøger.
21. Molich, R., Ede, M.R., Kaasgaard, K. and Karyukin, B. (2004) Comparative usability evaluation. Behaviour & Information Technology, 23(1).
22. Newman, W.H. and Lamming, M.G. (1995) Interactive System Design. Addison-Wesley.
23. Nielsen, C.M., Overgaard, M., Pedersen, M.B. and Stenild, S. (2004) The Development of a Mobile System for Communicating and Collaborating - An ObjectOriented HCI Approach, Department of Computer Science, Aalborg University, 2004.
24. Norman, D. (1990). The Design of Everyday Things, Doubleday and Company, 2002 Edition.
25. Nyyssönen, Roto and Kaikkonen (2002). Mini-Camera for Usability Tests and Demonstration. Presented in Demo Sessions at the 4th International Symposium on Human Computer Interaction with Mobile Devices, 2002, Nokia Research Center.
26. Pedell, S., Graham C., Kjeldskov J. and Davies, J. (2003) Mobile Evaluation: What the Data and the Metadata Told Us. In Proceedings of OzCHI 2003, pp. 96-105.
27. Pirhonen, A., Brewster, S. and Holguin, C (2002) Gestural an Audio Metaphors as a Means of Control for Mobile Devices. In Proceedings of CHI'2002. ACM.
28. Rowley, D. E. (1994) Usability Testing in the Field: Bringing the Laboratory to the User. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM Press.
29. Rubin, Jeffrey (1994). Handbook of Usability Testing -how to plan, design, and conduct effective tests, John Wiley & sons, Inc.
30. Salvucci D. D. (2001) Predicting the Effects of In-Car Interfaces on Driver Behaviour using a Cognitive Architecture. In Proceedings of CHI'2001, pp 120-127. ACM.
31. Sannella, M. J. (1994)Constraint Satisfaction and Debugging for Interactive User Interfaces. Ph.D. Thesis, University of Washington, Seattle, WA.