Head and eye gaze dynamics during visual attention shifts in complex environments

Journal of Vision

Volumn 12, Issue 2, 2012, Pages 1-16

  Doshi, Anup ^a   Trivedi, Mohan M ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Active perception; Attention; Driver assistance systems; Exogenous vs. Endogenous cues; Top down and bottom up attention shifts

Indexed keywords

ADULT; ARTICLE; ASSOCIATION; ATTENTION; BIOLOGICAL MODEL; CAR DRIVING; ENVIRONMENT; EYE FIXATION; EYE MOVEMENT; FEMALE; HEAD MOVEMENT; HUMAN; MALE; PHYSIOLOGY; PSYCHOMOTOR PERFORMANCE; VISION;

ADULT; ATTENTION; AUTOMOBILE DRIVING; CUES; ENVIRONMENT; EYE MOVEMENTS; FEMALE; FIXATION, OCULAR; HEAD MOVEMENTS; HUMANS; MALE; MODELS, NEUROLOGICAL; PSYCHOMOTOR PERFORMANCE; VISUAL PERCEPTION;

EID: 84862072135     PISSN: None     EISSN: 15347362     Source Type: Journal    
DOI: 10.1167/12.2.9     Document Type: Article

References (63)

1. Angell, L., Auflick, J., Austria, P. A., Kochhar, D., Tijerina, L., Biever, W., et al. (2006). Driver workload metrics task 2 final report (Report DOT HS 810635). Washington, DC: NHTSA, U.S. Department of Transportation.
2. Asteriadis, S., Tzouveli, P., Karpouzis, K., & Kollias, S. (2009). Estimation of behavioral user state based on eye gaze and head poseVApplication in an e-learning environment. Multimedia Tools and Applications, 41, 469-493.
3. Ballard, D. H., & Hayhoe, M. M. (2009). Modelling the role of task in the control of gaze. Visual Cognition, 17, 1185-1204.
4. Bartz, A. E. (1966). Eye and head movement in peripheral vision: Nature of compensatory eye movements. Science, 152, 1644-1645.
5. Batista, J. P. (2005). A real-time driver visual attention monitoring system. In J. Marques, N. Pérez de la Blanca, & P. Pina (Eds.), Iberian Conference on Pattern Recognition and Image Analysis (vol. 3522, pp. 200-208). Heidelberg: Springer Berlin.
6. Bizzi, E., Kalil, R. E., & Morasso, P. (1972). Two modes of active eye-head coordination in monkeys. Brain Research, 40, 45-48.
7. Cardosi, K. M. (1999). Human factors for air traffic control specialists: A user's manual for your brain (Report DOT/FAA/AR-99/39). Washington, DC: Federal Aviation Administration, U.S. Department of Transportation.
8. Carmi, R., & Itti, L. (2006). Visual causes versus correlates of attentional selection in dynamic scenes. Vision Research, 46, 4333-4345. Available from http://www.sciencedirect.com/science/article/B6T0W-4M4TNJ1-2/2/2a4f8e772f046d1d0eb9ea90e57eeaf1.
9. Cheng, S. Y., & Trivedi, M. M. (2006). Turn intent analysis using body-pose for intelligent driver assistance. IEEE Pervasive Computing, Special Issue on Intelligent Transportation Systems, 5, 28-37.
10. Corneil, B. D., & Munoz, D. P. (1999). Human eye-head gaze shifts in a distractor task: II. Reduced threshold for initiation of early head movements. Journal of Neurophysiology, 86, 1406-1421.
11. Dodge, R. (1921). The latent time of compensatory eye movements. Journal of Experimental Psychology, 4, 247-269.
12. Doshi, A., Cheng, S. Y., & Trivedi, M. M. (2009). A novel, active heads-up display for driver assistance. IEEE Transactions on Systems, Man, and Cybernetics, Part B, 39, 85-93.
13. Doshi, A., & Trivedi, M. M. (2009a). Head and gaze dynamics in visual attention and context learning. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (pp. 77-84). Miami, FL, USA.
14. Doshi, A., & Trivedi, M. M. (2009b). On the roles of eye gaze and head dynamics in predicting driver's intent to change lanes. IEEE Transactions on Intelligent Transportation Science, 10, 453-462.
15. Durlach, P. J. (2004). Change blindness and its implications for complex monitoring and control systems design and operator training. Human-Computer Interaction, 19, 423-451.
16. Eckstein, M. P., Caspi, A., Beutter, B. R., & Pham, B. T. (2004). The decoupling of attention and eyemovements during multiple fixation search. Journal of Vision, 4(8):165, 165a, http://www.journalofvision. org/content/4/8/165, doi:10.1167/4.8.165.
17. Freedman, E. G. (2008). Coordination of the eyes and head during visual orienting. Experimental Brain Research, 190, 369-387.
18. Fuller, J. H. (1992). Comparison of head movement strategies among mammals. In A. Berthoz, W. Graf, & P. P. Vidal (Eds.), Head-neck sensory motor system (pp. 101-114). New York: Oxford Press.
19. Goossens, H. H. L. M., & Opstal, A. J. V. (1997). Human eye-head coordination in two dimensions under different sensorimotor conditions. Experimental Brain Research, 114, 542-560.
20. Henderson, J. M., Brockmole, J. R., Castelhano, M. S., & Mack, M. (2007). Visual saliency does not account for eye movements during visual search in realworld scenes. In R. P. V. Gompel, M. H. Fischer, W. S. Murray, & R. L. Hill (Eds.), Eye movements (pp. 537-562). Oxford, UK: Elsevier. Available from http://www.sciencedirect.com/science/article/B87JD-4PFGDST-14/2/71b923d388d1e0a0ef1f6a6aeb98d6a8.
21. Herst, A. N., Epelboim, J., & Steinman, R. M. (2001). Temporal coordination of the human head and eye during a natural sequential tapping task. Vision Research, 41, 3307-3319.
22. Itti, L., & Koch, C. (2000). A saliency-based search mechanism for overt and covert shifts of visual attention. Vision Research, 40, 1489-1506.
23. Jovancevic, J., Sullivan, B., & Hayhoe, M. (2006). Control of attention and gaze in complex environments. Journal of Vision, 6(12):9, 1431-1450, http://www.journalofvision.org/content/6/12/9, doi:10.1167/6.12.9.
24. Khan, A. Z., Blohm, G., McPeek, R. M., & Lefvre, P. (2009). Differential influence of attention on gaze and head movements. Journal of Neurophysiology, 101, 198-206.
25. Land, M. F. (1992). Predictable eye-head coordination during driving. Nature, 359, 318-320.
26. Landry, S. J., Sheridan, T. B., & Yufik, Y. M. (2001). A methodology for studying cognitive groupings in a target-tracking task. IEEE Transactions on Intelligent Transportation Systems, 2, 92-100.
27. Lee, S. E., Olsen, C. B., & Wierwille, W. W. (2004). A comprehensive examination of naturalistic lane changes (Report DOT HS 809702). Washington, DC: NHTSA, U.S. Department of Transportation.
28. Lee, Y. C., Lee, J. D., & Boyle, L. N. (2007). Visual attention in driving: The effects of cognitive load and visual disruption. Human Factors, 49, 721-733.
29. Levy, J., & Pashler, H. (2008). Task prioritization in multitasking during driving: Opportunity to abort a concurrent task does not insulate braking responses from dual-task slowing. Applied Cognitive Psychology, 22, 507-525.
30. Levy, J., Pashler, H., & Boer, E. (2006). Central interference in driving: Is there any stopping the psychological refractory period? Psychological Science, 17, 228-235.
31. Mahadevan, V., & Vasconcelos, N. (2010). Spatiotemporal saliency in dynamic scenes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32, 171-177.
32. Matsumoto, Y., Ogasawara, T., & Zelinsky, A. (2000). Behavior recognition based on head pose and gaze direction measurement. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, 2000, 3, 2127-2132.
33. McCall, J. C., & Trivedi, M. M. (2007). Driver behavior and situation aware brake assistance for intelligent vehicles. Proceedings of the IEEE, Special Issue on Advanced Automobile Technology, 95, 374-387.
34. McCall, J. C., Wipf, D., Trivedi, M. M., & Rao, B. (2007). Lane change intent analysis using robust operators and sparse Bayesian learning. IEEE Transactions on Intelligent Transportation Systems, 8, 431-440.
35. Mennie, N. R., Hayhoe, M. M., & Sullivan, B. T. (2007). Look-ahead fixations: Anticipatory eye movements in natural tasks. Experimental Brain Research, 179, 427-442.
36. Mennie, N. R., Hayhoe, M. M., Sullivan, B. T., & Walthew, C. (2003). Look ahead fixations and visuo-motor planning. Journal of Vision, 3(9):123, 123a, http://www.journalofvision.org/content/3/9/123, doi:10.1167/3.9.123.
37. Morasso, P., Sandini, G., Tagliasco, V., & Zaccaria, R. (1977). Control strategies in the eye-head coordination system. IEEE Transactions on Systems, Man and Cybernetics, 7, 639-651.
38. Mozer, M. C., & Sitton, M. (1998). Computational modeling of spatial attention. In H. Pashler (Ed.), Attention (chap. 3, pp. 341-394). East Sussex, UK: Psychology Press.
39. Murphy-Chutorian, E., Doshi, A., & Trivedi, M. M. (2007). Head pose estimation for driver assistance systems: A robust algorithm and experimental evaluation. IEEE International Transportation Systems Conference, 709-714.
40. Murphy-Chutorian, E., & Trivedi, M. M. (2009). Head pose estimation in computer vision: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31, 607-626.
41. Navalpakkam, V., & Itti, L. (2005). Modeling the influence of task on attention. Vision Research, 45, 205-231.
42. Oliver, N., Rosario, B., & Pentland, A. (2000). A Bayesian computer vision system for modeling human interactions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22, 831-843.
43. Pashler, H., Johnston, J. C., & Ruthruff, E. (2001). Attention and performance. Annual Review of Psychology, 52, 629-651.
44. Peden, M., Scurfield, R., Sleet, D., Mohan, D., Hyder, A. A., Jarawan, E., & Mathers, C. (Eds.) (2004). World report on road traffic injury prevention. Geneva, Switzerland: World Health Organization.
45. Pelz, J., Hayhoe, M., & Loeber, R. (2001). The coordination of eye, head, and hand movements in a natural task. Experimental Brain Research, 139, 266-277.
46. Pentland, A. (2007). Social signal processing [Exploratory DSP]. IEEE Signal Processing, 24, 108-111.
47. Pentland, A., & Liu, A. (1999). Modeling and prediction of human behavior. Neural Computation, 11, 229-242.
48. Peters, R. J., & Itti, L. (2006). Beyond bottom-up: Incorporating task-dependent influences into a computational model of spatial attention. IEEE Conference on Computer Vision and Pattern Recognition, 1-8.
49. Recarte, M. A., & Nunes, L. M. (2000). Effects of verbal and spatial-imagery tasks on eye fixations while driving. Journal of Experimental Psychology: Applied, 6, 31-43.
50. Ron, S., Berthoz, A., & Gur, S. (1993). Saccade vestibuloocular reflex cooperation and eye head uncoupling during orientation to flashed target. The Journal of Physiology, 464, 595-611.
51. Rothkopf, C. A., Ballard, D., & Hayhoe, M. (2007). Task and context determine where you look. Journal of Vision, 7(14):16, 1-20, http://www.journalofvision. org/content/7/14/16, doi:10.1167/7.14.16.
52. Ryoo, M. S., & Aggarwal, J. K. (2007). Hierarchical recognition of human activities interacting with objects. IEEE Conference on Computer Vision and Pattern Recognition, 0, 1-8.
53. Seeing Machines faceLAB Head and Eye Tracker (2004). This is a product available from the Seeing Machines company, more info is available online here: http://www.seeingmachines.com/product/facelab/.
54. Tipping, M. E., & Faul, A. C. (2003). Fast marginal likelihood maximisation for sparse Bayesian models. In C. M. Bishop & B. J. Frey (Eds.), Proceedings of the Ninth International Workshop on Artificial Intelligence and Statistics (pp. 1-13). Key West, FL.
55. TORCS, The Open Racing Car Simulator (2010). This is open source software which can be downloaded here: http://torcs.sourceforge.net/.
56. Trivedi, M. M., & Cheng, S. Y. (2007). Holistic sensing and active displays for intelligent driver support systems. IEEE Computer, Special Issue on Human-Centered Computing, 40, 60-68.
57. Trivedi, M. M., Gandhi, T., & McCall, J. C. (2007). Looking in and looking out of a vehicle: Computer vision-based enhanced vehicle safety. IEEE Transactions on Intelligent Transportation Systems, 8, 108-120.
58. Viola, P., & Jones, M. J. (2001). Rapid object detection using a boosted cascade of simple features. IEEE Conference on Computer Vision and Pattern Recognition, 1, 511-518.
59. Wu, J., & Trivedi, M. M. (2007). Simultaneous eye tracking and blink detection with interactive particle filters. EURASIP Journal on Advances in Signal Processing, 2008, 114:1-114:17.
60. Yantis, S. (1998). Control of visual attention. In H. Pashler (Ed.), Attention (pp. 13-74). Hove, UK: Psychology Press.
61. Zangemeister, W. H., & Stark, L. (1982). Types of gaze movement: Variable interactions of eye and head movements. Experimental Neurology, 77, 563-577.
62. Zelinsky, G. J., Zhang, W., Yu, B., Chen, X., & Samaras, D. (2005). The role of top-down and bottom-up processes in guiding eye movements during visual search. In Neural Information Processing Systems Conference (vol. 18, pp. 1569-1576). Cambridge, MA: MIT Press.
63. Zhang, L., Tong, M. H., Marks, T. K., Shan, H., & Cottrell, G. W. (2008). Sun: A Bayesian framework for saliency using natural statistics. Journal of Vision, 8(7):32, 1-20, http://www.journalofvision.org/content/8/7/32, doi:10.1167/8.7.32.