Space-time visual analytics of eye-tracking data for dynamic stimuli

IEEE Transactions on Visualization and Computer Graphics

Volumn 19, Issue 12, 2013, Pages 2129-2138

  Kurzhals, Kuno ^a   Weiskopf, Daniel ^a  

^a UNIVERSITY OF STUTTGART   (Germany)

Author keywords

dynamic areas of interest; Eye tracking; motion compensated heat map; space time cube; spatiotemporal clustering

Indexed keywords

EYE-TRACKING; HEAT MAPS; MULTIPLE COORDINATED VIEWS; SPACE-TIME CUBE; SPATIO-TEMPORAL CLUSTERING; SPATIOTEMPORAL CHARACTERISTICS; TEMPORAL INFORMATION; VISUALIZATION TECHNIQUE;

COLOR IMAGE PROCESSING; EYE MOVEMENTS; GEOMETRY; THREE DIMENSIONAL COMPUTER GRAPHICS;

VISUALIZATION;

ALGORITHM; ARTICLE; ATTENTION; COMPUTER GRAPHICS; COMPUTER INTERFACE; EYE FIXATION; EYE MOVEMENT; FACTUAL DATABASE; HUMAN; INFORMATION RETRIEVAL; METHODOLOGY; PHYSIOLOGY; SPATIOTEMPORAL ANALYSIS; PROCEDURES;

ALGORITHMS; ATTENTION; COMPUTER GRAPHICS; DATABASES, FACTUAL; EYE MOVEMENTS; FIXATION, OCULAR; HUMANS; INFORMATION STORAGE AND RETRIEVAL; SPATIO-TEMPORAL ANALYSIS; USER-COMPUTER INTERFACE;

EID: 84886649594     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVCG.2013.194     Document Type: Article

References (47)

1. OpenCV. http://opencv.willowgarage.com, 2013.
2. SMI BeGaze eye tracking analysis software. http://www.smivision.com, 2013.
3. Tobii Studio 3.2. http://www.tobii.com, 2013.
4. W. Aigner, S. Miksch, H. Schumann, and C. Tominski. Visualization of Time-Oriented Data. Springer, London, UK, 2011.
5. G. Andrienko, N. Andrienko, M. Burch, and D. Weiskopf. Visual analytics methodology for eye movement studies. IEEE Transactions on Visualization and Computer Graphics, 18(12):2889-2898, 2012.
6. P. Blignaut. Visual span and other parameters for the generation of heatmaps. In Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications, pages 125-128, 2010.
7. A. Bojko. Informative or misleading Heatmaps deconstructed. In Human-Computer Interaction. New Trends, volume 1, pages 30-39. Springer, 2009.
8. R. P. Botchen, S. Bachthaler, F. Schick, M. Chen, G. Mori, D. Weiskopf, and T. Ertl. Action-based multifield video visualization. IEEE Transactions on Visualization and Computer Graphics, 14(4):885-899, 2008. (Pubitemid 351780214)
9. E. Bruno and D. Pellerin. Video shot detection based on linear prediction of motion. In Proceedings of the IEEE International Conference on Multimedia and Expo, volume 1, pages 289-292, 2002.
10. M. Burch, N. Konevtsova, J. Heinrich, M. Ḧoferlin, and D. Weiskopf. Evaluation of traditional, orthogonal, and radial tree diagrams by an eye tracking study. IEEE Transactions on Visualization and Computer Graphics, 17(12):2440-2448, 2011.
11. R. Carmi and L. Itti. Visual causes versus correlates of attentional selection in dynamic scenes. Vision Research, 46(26):4333-4345, 2006. (Pubitemid 44646528)
12. M. Chen, R. Botchen, R. Hashim, D. Weiskopf, T. Ertl, and I. Thornton. Visual signatures in video visualization. IEEE Transactions on Visualization and Computer Graphics, 12(5):1093-1100, 2006. (Pubitemid 44955642)
13. D. Comaniciu and P. Meer. Mean shift: A robust approach toward feature space analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(5):603-619, 2002. (Pubitemid 34550429)
14. A. Duchowski and B. McCormick. Gaze-contingent video resolution degradation. In Proceedings of Photonics West'98 Electronic Imaging, pages 318-329, 1998.
15. A. Duchowski, M. Price, M. Meyer, and P. Orero. Aggregate gaze visualization with real-time heatmaps. In Proceedings of the Symposium on Eye Tracking Research and Applications, pages 13-20, 2012.
16. A. T. Duchowski. A breadth-first survey of eye-tracking applications. Behavior Research Methods, Instruments, & Computers, 34(4):455-470, 2002.
17. G. Farneb̈ack. Two-frame motion estimation based on polynomial expansion. In Proceedings of the 13th Scandinavian conference on Image analysis, pages 363-370, 2003.
18. P. Gatalsky, N. Andrienko, and G. Andrienko. Interactive analysis of event data using space-time cube. In Proceedings of the Eighth International Conference on Information Visualisation IV, pages 145-152, 2004.
19. R. Goldstein, R. Woods, and E. Peli. Where people look when watching movies: Do all viewers look at the same place Computers in Biology and Medicine, 37(7):957-964, 2007. (Pubitemid 46617479)
20. M. Harrower and C. Brewer. ColorBrewer.org: an online tool for selecting colour schemes for maps. The Cartographic Journal, 40(1):27-37, 2003. (Pubitemid 36901477)
21. K. Holmqvist, M. Nystr̈om, R. Andersson, R. Dewhurst, H. Jarodzka, and J. Van de Weijer. Eye Tracking: A Comprehensive Guide to Methods and Measures. Oxford University Press, 2011.
22. J. S. Hunter. The exponentially weighted moving average. Journal of Quality Technology, 18(4):203-210, 1986.
23. A. K. Jain, M. N. Murty, and P. J. Flynn. Data clustering: A review. ACM Computing Surveys, 31(3):264-323, 1999.
24. D. Keim, F. Mansmann, J. Schneidewind, J. Thomas, and H. Ziegler. Visual analytics: Scope and challenges. In Visual Data Mining, volume 4404 of Lecture Notes in Computer Science, pages 76-90. 2008.
25. F. C. Li, A. Gupta, E. Sanocki, L.-w. He, and Y. Rui. Browsing digital video. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 169-176, 2000.
26. X. Li, A. Ç ̈oltekin, and M.-J. Kraak. Visual exploration of eye movement data using the space-time-cube. In Proceedings of the 6th International Conference on Geographic Information Science, pages 295-309, 2010.
27. P. Marchant, D. Raybould, T. Renshaw, and R. Stevens. Are you seeing what I'm seeing An eye-tracking evaluation of dynamic scenes. Digital Creativity, 20(3):153-163, 2009.
28. P. Mital, T. Smith, R. Hill, and J. Henderson. Clustering of gaze during dynamic scene viewing is predicted by motion. Cognitive Computation, 3(1):5-24, 2011.
29. N. V. Patel and I. K. Sethi. Video shot detection and characterization for video databases. Pattern Recognition, 30:583-592, 1997. (Pubitemid 127419706)
30. A. Poole and L. Ball. Eye tracking in HCI and usability research. In Encyclopedia of Human Computer Interaction, volume 1, pages 211-219. Information Science Reference, 2006.
31. G. Rakoczi and M. Pohl. Visualisation and analysis of multiuser gaze data: Eye tracking usability studies in the special context of e-learning. In Proceedings of the 12th IEEE International Conference on Advanced Learning Technologies, pages 738-739, 2012.
32. M. Raschke, X. Chen, and T. Ertl. Parallel scan-path visualization. In Proceedings of the Symposium on Eye Tracking Research and Applications, pages 165-168, 2012.
33. J. Roberts. State of the art: Coordinated multiple views in exploratory visualization. In Proceedings of the International Conference on Coordinated and Multiple Views in Exploratory Visualization, pages 61-71, 2007. (Pubitemid 47515157)
34. D. D. Salvucci and J. H. Goldberg. Identifying fixations and saccades in eye-tracking protocols. In Proceedings of the Symposium on Eye Tracking Research and Applications, pages 71-78, 2000.
35. A. Santella and D. DeCarlo. Robust clustering of eye movement recordings for quantification of visual interest. In Proceedings of the Symposium on Eye Tracking Research and Applications, pages 27-34, 2004.
36. Y. Sawahata, R. Khosla, K. Komine, N. Hiruma, T. Itou, S. Watanabe, Y. Suzuki, Y. Hara, and N. Issiki. Determining comprehension and quality of tv programs using eye-gaze tracking. Pattern Recognition, 41(5):1610-1626, 2008.
37. B. Shneiderman. The eyes have it: A task by data type taxonomy for information visualizations. In Proceedings of the IEEE Symposium on Visual Languages, pages 336-343, 1996.
38. A. F. Smeaton, P. Over, and A. R. Doherty. Video shot boundary detection: Seven years of TRECVid activity. Computer Vision and Image Understanding, 114(4):411-418, 2010.
39. T. Smith and J. Henderson. Attentional synchrony in static and dynamic scenes. Journal of Vision, 8(6):773-773, 2008.
40. B. Tatler, N. Wade, H. Kwan, J. Findlay, and B. Velichkovsky. Yarbus, eye movements, and vision. i-Perception, 1(1):7-27, 2010.
41. G. Tien, M. S. Atkins, and B. Zheng. Measuring gaze overlap on videos between multiple observers. In Proceedings of the Symposium on Eye Tracking Research and Applications, pages 309-312, 2012.
42. M. Tory and C. Swindells. Comparing ExoVis, orientation icon, and inplace 3D visualization techniques. In Proceedings of Graphics Interface, pages 57-64, 2003.
43. H. Y. Tsang, M. Tory, and C. Swindells. eSeeTrack-visualizing sequential fixation patterns. IEEE Transactions on Visualization and Computer Graphics 16, 6(6):953-962, 2010.
44. P.-H. Tseng, R. Carmi, I. G. Cameron, D. P. Munoz, and L. Itti. Quantifying center bias of observers in free viewing of dynamic natural scenes. Journal of Vision, 9(7):1-16, 2009.
45. M. W. Van Someren, Y. F. Barnard, and Sandberg. The Think Aloud Method: A Practical Guide to Modelling Cognitive Processes. Academic Press, London, 1994.
46. D. Weiskopf and G. Erlebacher. Overview of flow visualization. In C. D. Hansen and C. R. Johnson, editors, The Visualization Handbook, pages 261-278. Elsevier, Amsterdam, 2005.
47. D. S.Wooding. Fixation maps: quantifying eye-movement traces. In Proceedings of the Symposium on Eye Tracking Research and Applications, pages 31-36, 2002.