Applying computational tools to predict gaze direction in interactive visual environments

ACM Transactions on Applied Perception

Volumn 5, Issue 2, 2008, Pages

  Peters, Robert J ^a   Itti, Laurent ^b  

^a University of Southern California ^*  (United States)

^b UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

Active vision; Computational modeling; Eye movements; Immersive environments; Video games; Visual attention

Indexed keywords

ACTIVE VISION; ALGORITHMIC METHODS; COGNITIVE STATES; COMPUTATIONAL MODELING; COMPUTATIONAL NEUROSCIENCE; COMPUTATIONAL TOOLS; DYNAMIC ENVIRONMENTS; DYNAMIC EVENTS; EYE POSITION; EYE-MOVEMENTS; GAZE BEHAVIOR; GAZE DIRECTION; GLOBAL DISTRIBUTIONS; HUMAN OBSERVERS; HUMAN OPERATORS; IMMERSIVE ENVIRONMENTS; INTERACTIVE VIRTUAL ENVIRONMENTS; PROMISING APPROACH; VIDEO GAMES; VIRTUAL AGENTS; VISUAL ATTENTION; VISUAL BEHAVIOR; VISUAL ENVIRONMENTS; VISUAL FEATURES; VISUAL PERCEPTIONS;

CHLORINE COMPOUNDS; FORECASTING; GAME THEORY; HEURISTIC METHODS; HEURISTIC PROGRAMMING;

VIRTUAL REALITY;

EID: 50249088113     PISSN: 15443558     EISSN: 15443965     Source Type: Journal    
DOI: 10.1145/1279920.1279923     Document Type: Article

References (46)

1. BAILENSON, J. AND YEE, N. 2005. Digital chameleons: Automatic assimilation of nonverbal gestures in immersive virtual environments. Psychological Science 16, 814-819.
2. BALLARD, D., HAYHOE, M., AND PELZ, J. 1995. Memory representations in natural tasks. Journal of Cognitive Neuroscience 7, 1 (Winter), 66-80.
3. BURT, P. AND ADELSON, E. 1983. The laplacian pyramid as a compact image code. IEEE Transactions on Communications 31, 4, 532-540.
4. CARMI, R. AND ITTI, L. 2004. Bottom-up and top-down influences on attentional allocation in natural dyamic scenes. In Proc. Vision Science Society Annual Meeting (VSS04). 20.
5. FINNEY, S.A. 2001. Real-time data collection in linux: A case study. Behavior Research Methods, Instruments, and Computers 33, 167-173.
6. GREENSPAN, H., BELONGIE, S., GOODMAN, R., PERONA, P., RAKSHIT, S., AND ANDERSON, C. 1994. Overcomplete steerable pyramid filters and rotation invariance. In Proceedings Computer Vision and Pattern Recognition. IEEE Computer Society, Los Alamitos, CA. 222-228.
7. HAYHOE, M. 2004. Advances in relating eye movements and cognition. Infancy 6, 2, 267-274.
8. HAYHOE, M., BALLARD, D., TRIESCH, J., AND SHINODA, H. 2002. Vision in natural and virtual environments. In Proceedings of the Symposium on Eye Tracking Research & Applications (ETRA). 7-13.
9. HAYHOE, M., SHRIVASTAVA, A., MRUCZEK, R., AND PELZ, J. 2003. Visual memory and motor planning in a natural task. Journal of Vision 3, 1, 49-63.
10. HENDERSON, J. M. AND HOLLINGWORTH, A. 1999. High-level scene perception. Annual Review of Psychology 50, 243-271.
11. ITTI, L. AND BALDI, P. 2005. A principled approach to detecting surprising events in video. In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR). San Siego, CA. 631-637.
12. ITTI, L. AND KOCH, C. 2001. Feature combination strategies for saliency-based visual attention systems. Journal of Electronic Imaging 10, 1 (Jan.), 161-169.
13. ITTI, L., KOCH, C., AND NIEBUR, E. 1998. A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 20, 11 (Nov.), 1254-1259.
14. ITTI, L., DHAVALE, N., AND PIGHIN, F. 2003. Realistic avatar eye and head animation using a neurobiological model of visual attention. In Proceedings of SPIE 48th Annual International Symposium on Optical Science and Technology. 64-78.
15. KOCH, C. AND ULLMAN, S. 1985. Shifts in selective visual-attention - towards the underlying neural circuitry. Human Neurobiology 4, 4, 219-227.
16. LAND, M. AND HAYHOE, M. 2001. In what ways do eye movements contribute to everyday activities? Vision Research 41, 25-26, 3559-3565.
17. LAND, M., MENNIE, N., AND RUSTED, J. 1999. The roles of vision and eye movements in the control of activities of daily living. Perception 28, 11, 1311-1328.
18. MANNAN, S., RUDDOCK, K., AND WOODING, D. 1997. Fixation patterns made during brief examination of two-dimensional images. Perception 26, 8, 1059-1072.
19. MAY, J., DEAN, M., AND BARNARD, P. 2003. Using film cutting techniques in interface design. Human-Computer Interaction 18, 4, 325-372.
20. NAJEMNIK, J. AND GEISLER, W. 2005. Optimal eye-movement strategies in visual search. Nature (London) 434, 7031 (Mar.), 387-391.
21. NAVALPAKKAM, V. AND ITTI, L. 2005. Modeling the influence of task on attention. Vision Research 45, 2 (Jan.), 205-231.
22. NAVALPAKKAM, V. AND ITTI, L. 2006. Optimal cue selection strategy. In Advances in Neural Information Processing Systems, Vol. 19 (NIPS*2005). MIT Press, Cambridge, MA. 1-8.
23. PARKER, R. 1978. Picture processing during recognition. Journal of Experimental Psychology - Human Perception and Performance 4, 2, 284-293.
24. PARKHURST, D. AND NIEBUR, E. 2004. Texture contrast attracts overt visual attention in natural scenes. European Journal of Neuroscience 19, 3 (Feb.), 783-789.
25. PARKHURST, D., LAW, K., AND NIEBUR, E. 2002. Modeling the role of salience in the allocation of overt visual attention. Vision Research 42, 1, 107-123.
26. PELI, V., GOLDSTEIN, T., AND WOODS, R. 2005. Scanpaths of motion sequences: Where people look when watching movies. In Proceedings of the Fourth Starkfest Conference on Vision and Movement in Man and Machines. School of Optometry, UC Berkeley, Berkeley, CA. 18-21.
27. PETERS, C. AND O'SULLIVAN, C. 2003. Bottom-up visual attention for virtual human animation. In Computer Animation and Social Agents 2003. 111-117.
28. PETERS, R., IYER, A., ITTI, L., AND KOCH, C. 2005. Components of bottom-up gaze allocation in natural images. Vision Research 45, 18, 2397-2416.
29. POMPLUN, M. 2005. Saccadic selectivity in complex visual search displays. Vision Research 46, 12 (June), 1886-1900.
30. PRIVITERA, C. AND STARK, L. 1998. Evaluating image processing algorithms that predict regions of interest. Pattern Recognition Letters 19, 11, 1037-1043.
31. PRIVITERA, C. AND STARK, L. 2000. Algorithms for defining visual regions-of-interest: Comparison with eye fixations. IEEE Transactions on Pattern Analysis and Machine Intelligence 22, 9, 970-982.
32. RAO, R., ZELINSKY, G., HAYHOE, M., AND BALLARD, D. 2002. Eye movements in iconic visual search. Vision Research 42, 11 (May), 1447-1463.
33. RAYNER, K. 1998. Eye movements in reading and information processing: 20 years of research. Psychological Bulletin 124, 3 (Nov.), 372-422.
34. REINAGEL, P. AND ZADOR, A. 1999. Natural scene statistics at the centre of gaze. Network-Computation in Neural Systems 10, 4 (Nov.), 341-350.
35. RENSINK, R. A. 2000. The dynamic representation of scenes. Visual Cognition 7, 17-42.
36. SODHI, M., REIMER, B., COHEN, J., VASTENBURG, E., KAARS, R., AND KIRSCHENBAUM, S. 2002. On-road driver eye-movement tracking using head-mounted devices. In Proceedings of the Symposium on Eye Tracking Research & Applications (ETRA). 61-68.
37. STAMPE, D. M. 1993. Heuristic filtering and reliable calibration methods for video based pupil tracking systems. Behavior Research Methods, Instruments, and Computers 25, 2, 137-142.
38. TERZOPOULOS, D. AND RABIE, T. F. 1997. Animat vision: Active vision in artificial animals. Videre: Journal of Computer Vision Research 1, 1, 2-19.
39. TOET, A. 2006. Gaze directed displays as an enabling technology for attention aware systems. Computers in Human Behavior 22, 4 (July), 615-647.
40. TORRALBA, A. 2003. Modeling global scene factors in attention. Journal of the Optical Society of America A-Optics Image Science and Vision 20, 7 (July), 1407-1418.
41. TOSI, V., MECACCI, L., AND PASQUALI, E. 1997. Scanning eye movements made when viewing film: Preliminary observations. International Journal of Neuroscience 92, 1-2, 47-52.
42. TREISMAN, A. AND GELADE, G. 1980. A feature-integration theory of attention. Cognitive Psychology 12, 97-136.
43. VOGE, S. 1999. Looking at paintings: Patterns of eye movements in artistically naive and sophisticated subjects. Leonardo 32, 4, 325-325.
44. WOLFE, J. AND HOROWITZ, T. 2004. What attributes guide the deployment of visual attention and how do they do it? Nature Reviews Neuroscience 5, 6 (June), 495-501.
45. YARBUS, A. 1967. Eye movements during perception of complex objects. In Eye Movements and Vision, L. Riggs, Ed. Plenum Press, New York.
46. ZETZSCHE, C., SCHILL, K., DEUBEL, H., KRIEGER, G., UMKEHRER, E., AND BEINLICH, S. 1998. Investigation of a sensorimotor system for saccadic scene analysis: an integrated approach. In From animals to animats, Proceedings of the Fifth International Conference on the Simulation of Adaptive Behavior. Vol. 5. 120-126.