Evaluating visual analytics with eye tracking

ACM International Conference Proceeding Series

Volumn 10-November-2015, Issue , 2014, Pages 61-69

  Kurzhals, Kuno ^a   Fisher, Brian ^b   Burch, Michael ^a   Weiskopf, Daniel ^a  

^a UNIVERSITY OF STUTTGART   (Germany)

^b SIMON FRASER UNIVERSITY   (Canada)

Author keywords

Evaluation methods; Eye tracking; Visual analytics; Visual cognition; Visualization

Indexed keywords

COGNITIVE SYSTEMS; FLOW VISUALIZATION;

EVALUATION METHODOLOGIES; EVALUATION METHODS; EYE-TRACKING; PSYCHOLOGICAL RESEARCH; SCIENTIFIC PUBLICATIONS; VISUAL ANALYTICS; VISUAL COGNITION; VISUALIZATION ENVIRONMENT;

VISUALIZATION;

EID: 84955499162     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2669557.2669560     Document Type: Conference Paper

References (56)

1. E. W. Anderson. Evaluating visualization using cognitive measures. In Proc. Wksp. Beyond Time and Errors: Novel Eval. Meth. for Vis., pages 5: 1-5: 4, 2012.
2. G. L. Andrienko, N. V. Andrienko, M. Burch, and D. Weiskopf. Visual analytics methodology for eye movement studies. IEEE Trans. Vis. and Comput. Gr., 18(12): 2889-2898, 2012.
3. E. Bekele, Z. Zheng, A. Swanson, J. Crittendon, Z. Warren, and N. Sarkar. Understanding how adolescents with autism respond to facial expressions in virtual reality environments. IEEE Trans. Vis. and Comput. Gr., 19(4): 711-720, 2013.
4. I. Biederman. Perceiving real-world scenes. Sci., 177(4043): 77-80, 1972.
5. I. Biederman and P. C. Gerhardstein. Viewpoint-dependent mechanisms in visual object recognition: Reply to Tarr and Bülthoff. J. Exp. Psychol.: Human Perception and Performance, 21(6): 1506-1514, 1995.
6. T. Blascheck, K. Kurzhals, M. Raschke, M. Burch, D. Weiskopf, and T. Ertl. State-of-The-art of visualization for eye tracking data. In Proc. EuroVis State of the Art Reports, 2014.
7. M. Burch, G. Andrienko, N. Andrienko, M. Höferlin, M. Raschke, and D. Weiskopf. Visual task solution strategies in tree diagrams. In Proc. IEEE Pac. Vis. Symp., pages 169-176, Feb 2013.
8. M. Burch, N. Konevtsova, J. Heinrich, M. Höferlin, and D. Weiskopf. Evaluation of traditional, orthogonal, and radial tree diagrams by an eye tracking study. IEEE Trans. Vis. and Comput. Gr., 17(12): 2440-2448, 2011.
9. M. Burch, A. Kull, and D. Weiskopf. AOI Rivers for visualizing dynamic eye gaze frequencies. Comput. Gr. Forum, 32(3): 281-290, 2013.
10. S. K. Card, A. Newell, and T. P. Moran. The Psychology of Human-Computer Interaction. L. Erlbaum Associates, 1983.
11. S. Carpendale. Evaluating information visualizations. In Information Visualization: Human-Centered Issues and Perspectives, pages 19-45. Springer, 2008.
12. F. Courtemanche, E. Ameur, A. Dufresne, M. Najjar, and F. Mpondo. Activity recognition using eye-gaze movements and traditional interactions. Interacting with Computers, 23(3): 202-213, 2011.
13. M. DeAngelus and J. B. Pelz. Top-down control of eye movements: Yarbus revisited. Vis. Cogn., 17(6): 790-811, 2009.
14. A. Duchowski. A breadth-first survey of eye-tracking applications. Behav. Res. Meth. Instr., & Comput., 34(4): 455-470, 2002.
15. N. Elmqvist and J. S. Yi. Patterns for visualization evaluation. In Proc. Wksp. Beyond Time and Errors: Novel Eval. Meth. for Vis., pages 12: 1-12: 8, 2012.
16. K. A. Ericsson and H. A. Simon. Protocol Analysis: Verbal Reports as Data. MIT Press, 1993.
17. C. M. D. S. Freitas, M. S. Pimenta, and D. L. Scapin. User-centered evaluation of information visualization techniques: Making the HCI-InfoVis connection explicit. In W. Huang, editor, Handbook of Human Centric Visualization, pages 315-336. Springer, 2014.
18. J. Goldberg and J. Helfman. Eye tracking for visualization evaluation: Reading values on linear versus radial graphs. Info. Vis., 10(3): 182-195, 2011.
19. J. H. Goldberg and J. I. Helfman. Comparing information graphics: A critical look at eye tracking. In Proc. Wksp. Beyond Time and Errors: Novel Eval. Meth. for Vis., pages 71-78, 2010.
20. M. A. Goodale. How (and why) the visual control of action differs from visual perception. Proc. Roy. Soc. B: Bio. Sci., 281(1785): 20140337, 2014.
21. T. Grindinger, A. T. Duchowski, and M. W. Sawyer. Group-wise similarity and classification of aggregate scanpaths. In Proc. Symp. ETRA, pages 101-104, 2010.
22. K. Holmqvist, M. Nyström, R. Andersson, R. Dewhurst, H. Jarodzka, and J. Van de Weijer. Eye Tracking: A Comprehensive Guide to Methods and Measures. Oxford University Press, 2011.
23. W. Huang. Using eye tracking to investigate graph layout effects. In Proc. Asia-Pac. Symp. Vis., pages 97-100, 2007.
24. T. Isenberg, P. Isenberg, J. Chen, M. Sedlmair, and T. Möller. A systematic review on the practice of evaluating visualization. IEEE Trans. Vis. and Comput. Gr., 19(12): 2818-2827, 2013.
25. S.-H. Kim, Z. Dong, H. Xian, B. Upatising, and J. S. Yi. Does an eye tracker tell the truth about visualizations?: Findings while investigating visualizations for decision making. IEEE Trans. Vis. and Comput. Gr., 18(12): 2421-2430, 2012.
26. Y. Kim and A. Varshney. Persuading visual attention through geometry. IEEE Trans. Vis. and Comput. Gr., 14(4): 772-782, 2008.
27. J. Klingner, R. Kumar, and P. Hanrahan. Measuring the task-evoked pupillary response with a remote eye tracker. In Proc. Symp. ETRA, pages 69-72, 2008.
28. K. Kurzhals, F. Heimerl, and D. Weiskopf. ISeeCube: Visual analysis of gaze data for video. In Proc. Symp. ETRA, pages 43-50, 2014.
29. K. Kurzhals, M. Höferlin, and D. Weiskopf. Evaluation of attention-guiding video visualization. Comput. Gr. Forum, 32(3): 51-60, 2013.
30. K. Kurzhals and D. Weiskopf. Space-time visual analytics of eye-tracking data for dynamic stimuli. IEEE Trans. Vis. and Comput. Gr., 19(12): 2129-2138, 2013.
31. H. Lam, E. Bertini, P. Isenberg, C. Plaisant, and S. Carpendale. Empirical studies in information visualization: Seven scenarios. IEEE Trans. Vis. and Comput. Gr., 18(9): 1520-1536, 2012.
32. G. Liu, E. L. Austen, K. S. Booth, B. D. Fisher, R. Argue, M. Rempel, and J. T. Enns. Multiple-object tracking is based on scene, not retinal, coordinates. J. Exp. Psychol.: Human Perception and Performance, 31(2): 235-247, 2005.
33. G. R. Loftus and N. H. Mackworth. Cognitive determinants of flxation location during picture viewing. J. Exp. Psychol.: Human Perception and Performance, 4(4): 565-572, 1978.
34. A. D. Milner and M. A. Goodale. Two visual systems re-viewed. Neuropsychologia, 46(3): 774-785, 2008.
35. C. Plaisant. The challenge of information visualization evaluation. In Proc. Adv. Vis. Interf., pages 109-116, 2004.
36. B. A. Po, B. D. Fisher, and K. S. Booth. Pointing and visual feedback for spatial interaction in large-screen display environments. In Proc. Third Int'l Symp. Smart Gr., volume 2733 of Lect. Notes Comp. Sci., pages 22-38. Springer, 2003.
37. A. Poole and L. Ball. Eye tracking in human-computer interaction and usability research: Current status and future prospects. In C. Ghaoui, editor, Encyclopedia of Human-Computer Interaction, pages 211-219. Idea Group Inc., 2006.
38. Z. W. Pylyshyn. Situating vision in the world. Trends Cogn. Sci., 4(5): 197-207, 2000.
39. W. Ribarsky, B. D. Fisher, and W. M. Pottenger. Science of analytical reasoning. Info. Vis., 8(4): 254-262, 2009.
40. G. Ristovski, M. Hunter, B. Olk, and L. Linsen. EyeC: Coordinated views for interactive visual exploration of eye-tracking data. In Proc. Conf. Info. Vis. (IV), pages 239-248, 2013.
41. H.-J. Schulz, T. Nocke, M. Heitzler, and H. Schumann. A design space of visualization tasks. IEEE Trans. Vis. and Comput. Gr., 19(12): 2366-2375, 2013.
42. H. Siirtola, T. Laivo, T. Heimonen, and K.-J. Raiha. Visual perception of parallel coordinate visualizations. In Proc. Conf. Info. Vis. (IV), pages 3-9, 2009.
43. H. Song, J. Yun, B. Kim, and J. Seo. GazeVis: Interactive 3D gaze visualization for contiguous cross-sectional medical images. IEEE Trans. Vis. and Comput. Gr., 20(5): 726-739, 2014.
44. B. Spence. The broker. In A. Ebert, A. Dix, N. D. Gershon, and M. Pohl, editors, Human Aspects of Visualization, volume 6431 of Lect. Notes Comp. Sci., pages 10-22. Springer, 2011.
45. S. L. Star. The structure of ill-structured solutions: Boundary objects and heterogeneous distributed problem solving. In M. Huhns and L. Gasser, editors, Readings in Distributed AI. Morgan Kaufmann, 1988.
46. C. Swindells, M. Tory, and R. Dreezer. Comparing parameter manipulation with mouse, pen, and slider user interfaces. Comput. Gr. Forum, 28(3): 919-926, 2009.
47. M. K. Tanenhaus, M. J. Spivey-Knowlton, K. M. Eberhard, and J. C. Sedivy. Integration of visual and linguistic information in spoken language comprehension. Sci., 268(5217): 1632-1634, 1995.
48. J. J. Thomas and K. A. Cook, editors. Illuminating the Path: The Research and Development Agenda for Visual Analytics. IEEE Computer Society Press, 2005.
49. A. Torralba, A. Oliva, M. S. Castelhano, and J. M. Henderson. Contextual guidance of eye movements and attention in real-world scenes: The role of global features in object search. Psychol. Rev., 113(4): 766-786, 2006.
50. M. Tory. User studies in visualization: A reection on methods. In W. Huang, editor, Handbook Human Centric Visualization, pages 411-426. Springer, 2014.
51. M. Tory, M. S. Atkins, A. E. Kirkpatrick, M. Nicolaou, and G.-Z. Yang. Eyegaze analysis of displays with combined 2D and 3D views. In Proc. IEEE Vis. Conf., pages 519-526, 2005.
52. H. Y. Tsang, M. Tory, and C. Swindells. eSeeTrack - visualizing sequential flxation patterns. IEEE Trans. Vis. and Comput. Gr., 16(6): 953-962, 2010.
53. J. J. van Wijk. Evaluation: A challenge for visual analytics. IEEE Comput., 46(7): 56-60, 2013.
54. C. Ware. Visual queries: The foundation of visual thinking. In S.-O. Tergan and T. Keller, editors, Knowledge and Information Visualization, volume 3426 of Lect. Notes Comp. Sci., pages 27-35. Springer, 2005.
55. A. L. Yarbus. Eye Movements and Vision. Plenum Press, 1967.
56. G. J. Zelinsky, R. P. N. Rao, M. M. Hayhoe, and D. H. Ballard. Eye movements reveal the spatiotemporal dynamics of visual search. Psychol. Sci., 8(6): 448-453, 1997.