Influence of soundtrack on eye movements during video exploration

Journal of Eye Movement Research

Volumn 5, Issue 4, 2012, Pages 2-

  Coutrot, Antoine ^a   Guyader, Nathalie ^a   Ionescu, Gelu ^a   Caplier, Alice ^a  

^a UNIV GRENOBLE ALPES   (France)

Author keywords

Attention; Audio visual; Eye movements; Multimodal; Sound; Videos

Indexed keywords

EID: 84916639256     PISSN: None     EISSN: 19958692     Source Type: Journal    
DOI: None     Document Type: Article

References (50)

1. Arndt, P. A., & Colonius, H. (2003). Two stages in crossmodal saccadic integration: evidence from a visual-auditory focused attention task. Experimental Brain Research, 150, 417- 426.
2. Bahill, T., Adler, D., & Stark, L. (1975). Most naturally occurring human saccades have magnitudes of 15 degrees or less. Investigative Ophthalmology, 14(6), 468-469.
3. Belopolsky, A. V., & Theeuwes, J. (2009). When Are Attention and Saccade Preparation Dissociated? Psychological Science, 20(11), 1340-1347.
4. Boccignone, G., Chianese, A., Moscato, V., & Picariello, A. (2005). Foveated Shot Detection for Video Segmentation. IEEE Transactions on Circuits and Systems for Video Technology, 15(3), 1-13.
5. Boccignone, G., & Ferraro, M. (2004). Modelling gaze shift as a constrained random walk. Physica A, 331, 207-218.
6. Burg, E. Van der, Olivers, C. N. L., Bronkhorst, A. W., & Theeuwes, J. (2008). Pip and pop: Nonspatial auditory signals improve spatial visual search. Journal of Experimental Psychology: Human Perception and Performance, 34(5), 1053- 1065.
7. Carmi, R., & Itti, L. (2006). Visual causes versus correlates of attentional selection in dynamic scenes. Vision Research, 46(26), 4333-4345.
8. Carpenter, R. H. S. (1988). Movements of the eyes (2nd rev. & enlarged ed.). London, England: Pion Limited.
9. Corneil, B. D., & Munoz, D. P. (1996). The influence of auditory and visual distractors on human orienting gaze shifts. The Journal of neuroscience, 16(24), 8193-8207.
10. Corneil, B. D., Van Wanrooij, M., Munoz, D. P., & Van Opstal, A. J. (2002). Auditory-visual interactions subserving goaldirected saccades in a complex scene. Journal of Neurophysiology, 88, 438-454.
11. Coutrot, A., Ionescu, G., Guyader, N., & Rivet, B. (2011). Audio Tracks Do Not Influence Eye Movements When Watching Videos. In 34th european conference on visual perception (ecvp 2011) (p. 137). Toulouse, France.
12. Dorr, M., Martinetz, T., Gegenfurtner, K. R., & Barth, E. (2010). Variability of eye movements when viewing dynamic natural scenes. Journal of Vision, 10(28), 1-17.
13. Evangelopoulos, G., Zlatintsi, A., Skoumas, G., Rapantzikos, K., Potamianos, A., Maragos, P., et al. (2009). Video event detection and summarization using audio, visual and text saliency. In Proc. ieee international conf. on acoustics, speech and signal processing (icassp-09) (pp. 3553-3556). Taipei, Taiwan.
14. Gailey, L. (1987). Psychological parameters of lip-reading skill in hearing by eye: The psychology of lip-reading. Hillsdale, NJ, England: R. Dodd & B. Campbell.
15. Garsoffky, B., Huff, M., & Schwan, S. (2007). Changing viewpoints during dynamic events. Perception, 36(3), 366-374.
16. Goldstein, R. B., Woods, R. L., & Peli, E. (2007). Where people look when watching movies: Do all viewers look at the same place? Computers in Biology and Medicine, 37(7), 957-964.
17. Hasson, U., Landesman, O., Knappmeyer, B., Vallines, I., Rubin, N., & Heeger, D. J. (2008). Neurocinematics: The Neuroscience of Film. Projections, 2(1), 1-26.
18. Ho-Phuoc, T., Guyader, N., Landragin, F., & Guérin-Dugué, A. (2012). When viewing natural scenes, do abnormal colours impact on spatial or temporal parameters of eye movements? Journal of Vision, 12(2), 1-13.
19. Ionescu, G., Guyader, N., & Guérin-Dugué, A. (2009). SoftEye software., IDDN.FR.001.200017.000.S.P.2010.003.31235.
20. Itti, L. (2005). Quantifying the contribution of low-level saliency to human eye movements in dynamic scenes. Visual Cognition, 12(6), 1093-1123.
21. Itti, L., Koch, C., & Niebur, E. (1998). A model of saliencybased visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(11), 1254-1259.
22. Jeffers, J., & Barley, M. (1971). Speechreading (lipreading). Springfield, IL: Charles C. Thomas.
23. Klein, R. M. (1980). Does oculomotor readiness mediate cognitive control of visual attention? In R. S. Nickerson (Ed.), Attention and performance viii (pp. 259-276). Hillsdale, NJ: Lawrence Erlbaum.
24. Le Meur, O., Le Callet, P., & Barba, D. (2007). Predicting visual fixations on video based on low-level visual features. Vision Research, 47, 2483-2498.
25. Marat, S., Guyader, N., & Pellerin, D. (2009). Gaze prediction improvement by adding a face feature to a saliency model. In A. A. Zaher (Ed.), Recent advances in signal processing (pp. 195-210). InTech.
26. Marat, S., Ho-Phuoc, T., Granjon, L., Guyader, N., Pellerin, D., & Guérin-Dugué, A. (2009). Modelling Spatio-Temporal Saliency to Predict Gaze Direction for Short Videos. International Journal of Computer Vision, 82(3), 231-243.
27. McDonald, J. J., Teder-Sälejärvi, W. A., & Hillyard, S. A. (2000). Involuntary orienting to sound improves visual perception. Nature, 407, 906-908.
28. McGurk, H., & MacDonald, J. (1976). Hearing lips and seing voices. Nature, 264, 746-748.
29. Mital, P. K., Smith, T. J., Hill, R. L., & Henderson, J. M. (2010). Clustering of Gaze During Dynamic Scene Viewing is Predicted by Motion. Cognitive Computation, 3(1), 5-24.
30. Parkhurst, D., Law, K., & Niebur, E. (2002). Modeling the role of salience in the allocation of overt visual attention. Vision Research, 42, 107-123.
31. Pelz, J. B., & Canosa, R. (2001). Oculomotor behavior and perceptual strategies in complex tasks. Vision Research, 41, 3587-3596.
32. Quigley, C., Onat, S., Harding, S., Cooke, M., & König, P. (2008). Audio-visual integration during overt visual attention. Journal of Eye Movement Research, 1(2), 1-17.
33. Rapantzikos, K., Evangelopoulos, G., Maragos, P., & Avrithis, Y. (2007). An audio-visual saliency model for movie summarization. In Ieee 9th international workshop on multimedia signal processing (mmsp 2007) (pp. 320-323). New York, USA: Springer-Verlag.
34. Rizzolatti, G., Riggio, L., Dascola, I., & Umiltá, C. (1987). Reorienting attention across the horizontal and vertical meridians: Evidence in favor of a premotor theory of attention. Neuropsychologia, 25(1, Part 1), 31-40.
35. Ruesch, J., Lopes, M., Bernardino, A., Hörnstein, J., Santos- Victor, J., & Pfeifer, R. (2008). Multimodal Saliency-Based Bottom-Up Attention, A Framework for the Humanoid Robot iCub. In Ieee international conference on robotics and automation (pp. 962-967). Pasadena, CA, USA.
36. Smith, T. J., Levin, D., & Cutting, J. E. (2012). A Window on Reality: Perceiving Edited Moving Images. Current Directions in Psychological Science, 21(2), 107-113.
37. Song, G., Pellerin, D., & Granjon, L. (2011). Sound effect on visual gaze when looking at videos. In 19th european signal processing conference (eusipco 2011). Barcelona, Spain.
38. Spence, C., & Driver, J. (1997). Audiovisual links in exogenous covert spatial orienting. Perception & Psychophysics, 59(1), 1-22.
39. Summerfield, Q. (1987). Some preliminaries to a comprehensive account of audio-visual speech perception. Hillsdale, NJ, England: B. Dodd & R. Campbell.
40. Tatler, B. W. (2007). The central fixation bias in scene viewing: Selecting an optimal viewing position independently of motor biases and image feature distributions. Journal of Vision, 7(14), 1-17.
41. Tatler, B. W., Baddeley, R. J., & Gilchrist, I. D. (2005). Visual correlates of fixation selection: effects of scale and time. Vision Research, 45, 643-659.
42. Tatler, B. W., Baddeley, R. J., & Vincent, B. T. (2006). The long and the short of it: Spatial statistics at fixation vary with saccade amplitude and task. Vision Research, 46, 1857- 1862.
43. Tatler, B. W., & Vincent, B. T. (2008). Systematic tendencies in scene viewing. Journal of Eye Movement Research, 2(5), 1-18.
44. Torralba, A., Oliva, A., & Castelhano, M. (2006). Contextual guidance of eye movements and attention in real-world scenes: The role of global features in object search. Psychological Review, vol. 113, 766-786.
45. Tseng, P.-H., Carmi, R., Cameron, I. G. M., Munoz, D. P., & Itti, L. (2009). Quantifying center bias of observers in free viewing of dynamic natural scenes. Journal of Vision, 9(7), 1-16.
46. Tsotsos, J. K., Culhane, S. M., Yan Kei Wai, W., Lai, Y., Davis, N., & Nuflo, F. (1995). Modeling visual attention via selective tuning. Artificial Intelligence, 78, 507-545.
47. Vatikiotis-Bateson, E., Eigsti, I., & Yano, S. (1998). Eye movement of perceivers during audiovisualspeech perception. Perception & Psychophysics, 60(6), 926-940.
48. Wang, H. X., Freeman, J., Merriam, E. P., Hasson, U., & Heeger, D. J. (2012). Temporal eye movement strategies during naturalistic viewing. Journal of Vision, 12(1), 1-27.
49. Yantis, S., & Jonides, J. (1984). Abrupt Visual Onsets and Selective Attention: Evidence From Visual Search. Journal of Experimental Psychology: Human Perception and Performance, 10(5), 601-621.
50. Zou, H., Müller, H. J., & Shi, Z. (2012). Non-spatial sounds regulate eye movements and enhance visual search. Journal of Vision, 12(5), 1-18.