Evaluating the effectiveness of interactive map interface designs: A case study integrating usability metrics with eye-movement analysis

Cartography and Geographic Information Science

Volumn 36, Issue 1, 2009, Pages 5-17

  Çöltekin, Arzu ^a   Heil, Benedikt ^a   Garlandini, Simone ^a   Fabrikant, Sara Irina ^a  

^a UNIVERSITY OF ZURICH   (Switzerland)

Author keywords

Eye movement analysis; Geographic visualization; Human computer interaction; Interactive maps; Interface evaluation

Indexed keywords

HUMAN COMPUTER INTERACTION; INTERFACES (COMPUTER); SYSTEMS ANALYSIS; VISUALIZATION;

BOTTOM LINES; COGNITIVE PROCESSING; COMPLETION TIME; DESIGN ISSUES; EYE MOVEMENT ANALYSIS; EYE-TRACKING; FACTORIAL EXPERIMENTS; GEOGRAPHIC VISUALIZATION; INTERACTIVE MAPS; INTERFACE EVALUATION; MAP INTERFACES; NOVICE USERS; USABILITY METHODS; USABILITY METRICS; USABILITY PROBLEMS; USER SATISFACTIONS;

EYE MOVEMENTS;

CARTOGRAPHY; CONFERENCE PROCEEDING; DESIGN METHOD; MAP; VISUALIZATION;

EID: 60849130412     PISSN: 15230406     EISSN: None     Source Type: Journal    
DOI: 10.1559/152304009787340197     Document Type: Conference Paper

References (35)

1. Bojko, A. 2006. Using eye Tracking to compare web page designs: A case study. Journal of Usability Studies 3(1): 112-20.
2. Brodersen, L. Andersen, H.H.K., and S. Weber. 2002. Applying eye-movement tracking for the study of map perception and map design. Publications Series 4, Volume 9. National Survey and Cadastre, Denmark.
3. Brooke, J. 1996. SUS: A "quick and dirty" usability scale. In: Jordan, P.W., Thomas, B., Weerdmeester, B.A., and A.L. McClelland (eds), Usability Evaluation in Industry, 1st ed. pp. 189-94. London, U.K.: Taylor and Francis.
4. Byrne, M.D. Anderson, J.R. Douglas, S., and M. Matessa. 1999. Eye tracking the visual search of clickdown menus. In: Proceedings, ACM Human Factors in Computing Systems (CHI '99), New York, New York. pp. 402-9.
5. Chin, J.P. Diehl, V.A., and K. Norman. 1988. Development of an instrument measuring user satisfaction of the human-computer interface. In: Proceedings, ACM Human Factors in Computing Systems (CHI '88), Washington, D.C. pp. 213-218.
6. Dix, A. Finlay, J. Abowd, G., and R. Beale. 2004. Human-computer interaction, 3rd ed. Harlow, Essex, England: Pearson Education Limited.
7. Duchowski, A.T. 2007. Eye tracking methodology: Theory and Practice, 2nd ed. London, U.K.: Springer.
8. Fabrikant, S.I., S. Rebich-Hespanha, N. Andrienko, G. Andrienko, and D.R. Montello. 2008. Novel method to measure inference affordance in static small multiple displays representing dynamic processes. The Cartographic Journal 45(3): 201-15.
9. Fuhrmann, S., P. Ahonen-Rainio, R. M. Edsall, S. I. Fabrikant, E.L. Kona, C. Tobon, C. Ware, and S. Wilson. 2005. Making useful and useable geovisualisation: Design and evaluation issues. In: Dykes, M., A.M. MacEachren, and M.-J. Kraak (eds), Exploring Geovisualisation. Amsterdam, The Netherlands: Elsevier Ltd. pp. 553-66.
10. Goldberg, J.H., and X.P. Kotval. 1999. Computer interface evaluation using eye movements: Methods and constructs. International Journal of Industrial Ergonomics 24: 631-45.
11. Goldberg, J.H., M.J. Stimson, M. Lewenstein, N. Scott, and A.M. Wichansky. 2002. Eye tracking in web search tasks: Design implications. In: Proceedings, Eye Tracking Research and Applications Symposium 2002, New York, New York, USA. pp. 51-58.
12. Good, M., T.M. Spine, J. Whiteside, and P. George. 1986. User-derived impact analysis as a tool for usability engineering. In: Proceedings, Human Factors in Computing Systems (CHI '86), NewYork, USA. pp. 241-46.
13. Haklay, M., and A. Zafiri. 2008. Usability engineering for GIS: Learning from a screenshot. Special Issue on Use and User Issues The Cartographic Journal 2(45): 87-97.
14. Harrower, M., and B. Sheesley. 2005. Designing better map interfaces: A framework for panning and zooming. Transactions in GIS 9(2): 77-89.
15. Hegarty, M., and D. Waller. 2004. A dissociation between mental rotation and perspective taking spatial abilities. Intelligence 32(2): 175-91.
16. Henderson, J.M., and F. Ferreira. 2004. Scene perception for psycholinguistics. In: Henderson, J.M., and F. Ferreira (eds), The Interface of Vision, Language, and Action. Eye Movements and the Visual World. New York, New York: Psychology Press. pp. 1-58.
17. Howard, D.L., and A.M. MacEachren. 1996. Interface design for geographic visualization: Tools for representing reliability. Cartography and Geographic Information Science 2(23): 59-77.
18. Irwin, E. 2004. Fixation location and fixation duration as indices of cognitive processing. In: Henderson, J.M., and F. Ferreira (eds), The Interface of Vision, Language, and Action. Eye Movements and the Visual World. New York, New York: Psychology Press. pp. 105-34.
19. Jacob, R., and K. Karn. 2003. Eye tracking in human-computer interaction and usability research: Ready to deliver the promises. In: Hyönä, J. Radach, R., and H. Deubel (eds), The Mind's Eye: Cognitive and Applied Aspects of Eye Movement Research. Amsterdam, The Netherlands: Elsevier Ltd. pp. 573-605
20. Knapp, L. 1995. A task analysis approach to the visualization of geographic data. In: Nyerges, T.L., D.M. Mark, R. Laurini, and M.J. Egenhofer (eds), Cognitive Aspects of Human-Computer Interaction for Geographic Information Systems, 1st ed. Norwell, MA, USA: Kluwer Academic Publishers. pp 355-71.
21. Koua, E.L., A.M. MacEachren, and M.-J. Kraak. 2006. Evaluating the usability of visualisation methods in an exploratory geovisualization environment. International Journal of Geographical Information Science 20: 425-48.
22. Koua, E.L., and M.-J. Kraak. 2004. A usability framework for the design and evaluation of an exploratory geovisualisation environment. In: Proceedings, The 8th International Conference on Information Visualisation (IV '04), London, U.K. pp. 153-58.
23. Larkin, J.H., and H.A. Simon. 1987. Why a diagram is (sometimes) worth ten thousand words. Cognitive Science 11(1): 65-100.
24. Lewis, J. 1995. IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use. International Journal of Human-Computer Interaction 7(1): 57-78.
25. MacEachren, A.M., and M.-J. Kraak. 2001. Research challenges in geovisualization. Cartography and Geographic Information Science 28(1): 3-12.
26. Medyckyj-Scott, D. 1993. Designing geographical information systems for use. In: Medyckyj-Scott, D., and H.M. Hearnshaw (eds), Human Factors in Geographical Information Systems, London, U.K.: Belhaven Press. pp. 87-100.
27. Nielsen, J. 1993. Usability Engineering. San Diego, California, USA: Academic Press.
28. Nivala, A.-M., S.A. Brewster, and L.T. Sarjakoski. 2008. Usability evaluation of web mapping sites. Special Issue on Use and User Issues of The Cartographic Journal 45(2): 130-40.
29. Nyerges, T.L. 1993. How do people use geographical information systems? In: Medyckyj-Scott, D., and H. M. Hearnshaw (eds), Human Factors in Geographical Information Systems. London, U,K.: Belhaven Press. pp 37-50.
30. Pretorius, M.C.,A. P. Calitz, and D.vanGreunen. 2005. The added value of eye tracking in the usability evaluation of a network management tool. In: Proceedings, The 2005 Annual Research Conference of the South African institute of Computer Scientists and informatum Technologists on IT Research in Developng Countnes (SAICSIT '05), White River, South Affica. pp. 1-10.
31. Robinson, A.C., J. Chen, E.J. Lengerich, H.G. Meyer, and A.M. MacEachren. 2005. Combining usability techniques to design geovisualization tools for epidemiology. Cartography and Geographic Information Science 32(4): 243-55.
32. Steinke, T.R. 1987. Eye movement studies in cartography and related fields. Cartographica 24(2): 40-73.
33. Tullis, T.S., and J.N. Stetson. 2004. A comparison of questionnaires for assessing website usability. In: Proceedings, Usability Professionals Association Conference (UPA 2004), Minneapolis, Minnesotta. pp. 7-11.
34. Webb, N., and T. Renshaw. 2008. Eyetracking in HCI. In: Cairns, P., and A.L. Cox (eds), Research Methods for Human Computer Interaction. Cambridge: Cambridge University Press. pp. 35-69.
35. You, M., C.-W. Chen, H. Liu, and H. Lin. 2007. A usability evaluation of web map zoom and pan functions. International Journal of Design 1(1): 15-25.