Evaluating the usability of a mobile guide: The influence of location, participants and resources

Behaviour and Information Technology

Volumn 24, Issue 1, 2005, Pages 51-65

  Kjeldskov, J ^a,b   Graham, C ^a   Pedell, S ^a   Vetere, F ^a   Howard, S ^a   Balbo, S ^a   Davies, J ^a  

^a UNIVERSITY OF MELBOURNE   (Australia)

^b AALBORG UNIVERSITY   (Denmark)

Author keywords

[No Author keywords available]

Indexed keywords

DATA ACQUISITION; HEURISTIC METHODS; USABILITY ENGINEERING;

DATA COLLECTION; MOBILE GUIDES;

MOBILE TELECOMMUNICATION SYSTEMS;

EID: 19944418435     PISSN: 0144929X     EISSN: 13623001     Source Type: Journal    
DOI: 10.1080/01449290512331319030     Document Type: Article

References (55)

1. ABOWD, D., ATKESON, C., HONG, J., LONG, S. and PINKERTON, M., 1996, Cyberguide: a Mobile context-aware tour guide. Wireless Networks, 3, 421-433.
2. ANDRADE, M.T., SANTOS, E., LIVADITI, J. and TSAKALI, M., 2002, Managing multimedia content and delivering services across multiple client platforms using XML. Proceedings of Mobile Tourism Support, Pisa, Italy, available online at http://www.mguides.info
3. BAILEY, R.W., ALLAN, R.W. and RAIELLO, P., 1992, Usability testing vs. heuristic evaluation: a head-to-head comparison. Proceedings of the Human Factors and Ergonomics Society 36th Annual Meeting, Santa Monica, California (Santa Monica: Human Factors Society), pp. 409-413.
4. BOHNENBERGER, T., JAMESON, A., KRÜGER, A. and BUTZ, A., 2002, Location-aware shopping assistance: evaluation of a decision-theoretic approach. Proceedings of Mobile HCI 2002, Pisa, Italy (Berlin: LNCS, Springer-Verlag).
5. BORNTRÄGER, C., CHEVERST, K., DAVIES, N., DIX, A., FRIDAY, A. and SEITZ, J., 2003, Experiments with multi-modal interfaces in a context-aware city guide. Proceedings of Mobile HCI 2003, Udine, Italy, available online at http://www.mguides.info
6. BORNTRÄGER, C. and CHEVERST, K., 2003, Social and technical pitfalls designing a tourist guide system. Proceedings of HCI in Mobile Guides, Udine, Italy.
7. BREWSTER, S., 2002, Overcoming the lack of screen space on mobile computers. Personal and Ubiquitous Computing, 6, 188-205.
8. CHEVERST, K., DAVIES, N. and MITCHELL, K., 2002, Exploring context-aware information push. Personal and Ubiquitous Computing, 6, 276-281.
9. CHEVERST, K., DAVIES, N., MITCHELL, K., FRIDAY, A. and EFSTRATIOU, C., 2000 Developing a context-aware electronic tourist guide: some issues and experiences. Proceedings of CHI'00, The Hague, Netherlands (New York: ACM), pp. 17-24.
10. CHINCHOLLE, D., GOLDSTEIN, M., NYBERG, M. and ERIKSON, M., 2002, Lost or found? a usability evaluation of a mobile navigation and location-based service. Proceedings of Mobile HCI 2002, Pisa, Italy (LNCS: Springer-Verlag), pp. 211-224.
11. DUMAS, J.S., and REDISH, J.C., 1999, A Practical Guide to Usability Testing (Exeter: Intellect).
12. FITHIAN, R., IACHELLO, G., MOGHAZY, J., POUSMAN, Z. and STASKO, J., 2003, The design and evaluation of a mobile location-aware handheld event planner. Proceedings of Mobile HCI 2003 Udine, Italy (LNCS, Springer-Verlag), pp. 145-160.
13. GRAY, W.D. and SALTZMAN M.C., 1998, Damaged merchandise? a review of experiments that compare usability evaluation methods. Human-Computer Interaction, 13, 203-261.
14. GUBA, E.G. and LINCOLN, Y.S., 1989, Fourth Generation Evaluation (California: Sage Publications).
15. HENDERSON, R., PODD, J., SMITH, M. and VARELA-ALVAREZ, H., 1995, An examination of four user-based software evaluation methods. Interacting with Computers, 7, 412-432.
16. IACUCCI, G., KELA, J. and PEHONEN, P., 2004, Computational support to record and re-experience visits. Personal and Ubiquitous Computing, 8, 100-109.
17. JOHNSON, P., 1998, Usability and mobility: interactions on the move. Proceedings of the First Workshop on Human-Computer Interaction with Mobile Devices, Glasgow, UK (Glasgow: Glasgow University), available online at http://www.dcs.gla.ac.uk/ ~johnson/papers/mobile/HCIMD1.html
18. KARAT, C.M., CAMPBELL, R., and FIEGEL, T., 1992, Comparison of empirical testing and walkthrough methods in user interface evaluation. Proceedings of CHI'92 (New York: ACM) pp. 397-404.
19. KOLARI, J. and VIRTANEN, T., 2003, In the zone: views through a context-aware mobile portal. Proceedings of HCI in Mobile Guides, Udine, Italy, available online at http://www.mguides.info/
20. KJELDSKOV, J. and SKOV, M. B., 2003, Creating a realistic laboratory setting: a comparative study of three think-aloud usability evaluations of a mobile system. Proceedings of Interact 2003 (Zürich, Switzerland: IOS Press), pp. 663-370.
21. KJELDSKOV, J. and STAGE, J., 2004, New techniques for usability evaluation of mobile systems. International Journal of Human-Computer Studies, 60, 599-620.
22. KJELDSKOV, J., HOWARD, S., MURPHY, J., CARROLL, J., VETERE, F. and GRAHAM, C., 2003, Designing TramMate - a context aware mobile system supporting use of public transportation. Proceedings of DUX 2003. (San Francisco, CA, USA: ACM).
23. KJELDSKOV, J., SKOV, M.B. and STAGE, J., 2004a, Instant data analysis: conducting usability evaluations in a day. Proceedings of NordiCHI 2004 (Tampere, Finland: ACM), pp. 233-240.
24. KJELDSKOV, J., SKOV, M.B., ALS, B.S. and HØEGH, R.T., 2004b, Is it worth the hassle? Exploring the added value of evaluating the usability of context-aware mobile systems in the field. Proceedings of Mobile HCI 2004. Glasgow, Scotland (LNCS, Springer-Verlag), pp. 61-73.
25. KRAY, C. and BAUS, J., 2003, A survey of mobile guides. Proceedings of HCI in Mobile Guides, Udine, Italy, available online at http:// www.mguides.info/
26. LAAKSO, K., GJESDAL, O. and SULEBAK, J.R., 2003, Tourist information and navigation support by using 3D maps displayed on mobile devices. Proceedings of HCI in Mobile Guides, Udine, Italy, available online at http://www.mguides.info/
27. LINCOLN, Y.S., and GUBA, E.G., 1986, But is it rigorous? Trustworthiness and authenticity in naturalistic evaluation. In Naturalistic Evolution, D.D. Williams (Ed.) pp. 73-84 (San Francisco: Jossey-Bass).
28. MAKIMOTO, T. and MANNERS, D., 1997, Digital Nomad (Chichester: John Wiley & Sons).
29. MOLICH, R., 2000, Usable Web Design (In Danish) (Ingeniøren | bøger).
30. MOLICH, R., BEVAN, N., CURSON, I., BUTLER, S., KINDLUND, E., MILLER, D. and KIRAKOWSKI, J., 1998, Comparative evaluation of usability tests. Proceedings of the Usability Professionals Association Conference, pp. 189-200. Washington DC, USA (Usability Professionals' Association).
31. NAYAK, N.P., MRAZEK, D. and SMITH, R.D., 1995, Analysing and communicating usability data. SIGCHI Bulletin, 27, 22-30.
32. NIELSEN, C., 1998, Testing in the field. Proceedings of the Third Asia Pacific Computer Human-Interaction Conference, APCHI 1998 (California, IEEE Computer Society), pp. 285-290.
33. NIELSEN, J., 1994, Guerrilla HCI: using discount usability engineering to penetrate the intimidation barrier. In Cost-Justifying Usability, R.G. Bias, and D.J. Mayhew (Eds.) pp. 245-272 (Academic Press Professional).
34. NIELSEN, J., 1993, Usability Engineering. (Morgan Kaufmann).
35. NIELSEN, J. and MOLICH, R., 1990, Heuristic evaluation of user interfaces. Proceedings of CHI'90, Seattle, USA (New York: ACM Press), pp. 249-256.
36. OMODEI, M.M., WEARING, A.J. and MCLENNAN, J., 2002, Head-mounted video and cued recall: a minimally reactive methodology for understanding, detecting and preventing error in the control of complex systems. Proceedings of the 21st European Annual Conference of Human Decision Making and Control (Scotland: University of Glasgow).
37. PEDELL, S., GRAHAM, C., KJELDSKOV, J. and DAVIES, J., 2003, Mobile evaluation: what the metadata and the data told us. Proceedings of OzCHI 2003, Brisbane, Australia (Brisbane: CHISIG), pp. 96-105.
38. PETRIE, H., JOHNSON, V., FURNER, S., and STROTHOTTE, T., 1998, Design lifecycles and wearable computers for users with disabilities. Proceedings of the First Workshop on Human-Computer Interaction with Mobile Devices, Glasgow, UK (Glasgow: Glasgow University).
39. PIRHONEN, A., BREWSTER, S.A. and HOLGUIN, C., 2002, Gestural and audio metaphors as a means of control for mobile devices. Proceedings of CHI 2002 (New York: ACM), pp. 291-298.
40. PO, S., HOWARD, S., VETERE, F. and SKOV, M., 2004, Heuristic evaluation and mobile usability: bridging the realism gap. Proceedings of Mobile HCI 2004, Glasgow, Scotland (LNCS, Springer-Verlag), pp. 49-60.
41. POSPISCHIL, G., UMLAUFT, M. and MICHLMAYR, E., 2002, Designing LoL@, a mobile tourist guide for UMTS. Proceedings of Mobile HCI 2002, Pisa, Italy (LNCS, Springer-Verlag), pp. 140-154.
42. PREECE, J., ROGERS, H., SHARP, D., BENYON, D., HOLLAND, S. and CAREY, T., 1994, Human-Computer Interaction (Workingham: Addison-Wesley).
43. REID, H., 2002, Maps on your PDA - simple stuff #8 - Mapping the Trade Show Floor. Directions Magazine 2002, Available online at: http:// www.directionsmag.com/article.php?article_id = 199 (accessed 2 June 2004).
44. ROCCHI, C., STOCK, O. and ZANCANARO, M., 2003, Semantic-based multimedia representations for the museum experience. Proceedings of HCI in Mobile Guides, Udine, Italy, available online at http:// www.mguides.info/
45. RUBIN, J., 1994, Handbook of Usability Testing (Chichester: John Wiley & Sons).
46. SANDERSON, P.M. and FISHER, C., 1994, Exploratory sequential data analysis: foundations. Human-Computer Interaction, 9, 251-317.
47. SAWHNEY, N. and SCHMANDT, C., 2000, Nomadic radio: speech and audio interaction for contextual messaging in nomadic environments. Transactions on Computer-Human Interaction, 7, 353-383.
48. SCHMIDT-BELZ, B. and POSLAD, S., 2003, User validation of a mobile tourism service. Proceedings of HCI in Mobile Guides, Udine, Italy, available online at http://www.mguides.info/
49. SCHMIDT-BELZ, B., LAAMANEN, H., POSLAD, S. and ZIPF, A., 2003, Location-based mobile tourist services - first user experiences, Information and Communication Technologies in Tourism, 2003, 115-123.
50. SMITH, J., MACKANESS, W., KEALY, A. and WILLIAMSON, I.P., 2004, Spatial data infrastructure requirements for mobile location based journey planning. Transactions in GIS, 8, 23-44.
51. STRAUSS, A. and CORBIN, J., 1997, Grounded Theory in Practice (Thousand Oaks: Sage Publications).
52. TAMMINEN, S., OULASVIRTA, A., TOISKALLIO, K. and KANKAINEN, A., 2003, Understanding mobile contexts. Proceedings of Mobile HCI 2003, Italy, Udine (LNCS, Springer-Verlag), pp. 17-31.
53. UMLAUFT, M., POSPISCHIL, G., NIKLFELD, G. and MICHLMAYR, E., 2003, LoL@, a mobile tourist guide for UMTS, Information Technology & Tourism, 5, 151-164.
54. VETERE, F., HOWARD, S., PEDELL, S. and BALBO, S., 2003, Walking through mobile use: novel heuristics and their application. Proceedings of OzCHI 2003, Brisbane, Australia (Brisbane: CHISIG), pp. 24-32.
55. WHARTON, C., RIEMAN, J., LEWIS, C, and POLSON, P., 1994, The cognitive walkthrough: a practitioner's guide. In Usability Inspection Methods, J. Nielsen, and R. L. Mack (Eds.) pp. 105-140 (Chichester: John Wiley & Sons).