Emotion modulates eye movement patterns and subsequent memory for the gist and details of movie scenes

Journal of Vision

Volumn 14, Issue 3, 2014, Pages

  Subramanian, Ramanathan ^a   Shankar, Divya ^b   Sebe, Nicu ^b   Melcher, David ^a,b  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^b UNIVERSITY OF TRENTO   (Italy)

Author keywords

Attention; Emotional movie clips; Eye movements; Long term memory; Short term memory

Indexed keywords

ADULT; ARTICLE; ATTENTION; AUDIOVISUAL EQUIPMENT; EMOTION; EMOTIONAL MOVIE CLIPS; EYE MOVEMENT; FEMALE; HUMAN; LONG TERM MEMORY; LONG-TERM MEMORY; MALE; PHYSIOLOGY; SHORT TERM MEMORY; SHORT-TERM MEMORY; YOUNG ADULT;

ATTENTION; EMOTIONAL MOVIE CLIPS; EYE MOVEMENTS; LONG-TERM MEMORY; SHORT-TERM MEMORY;

ADULT; ATTENTION; EMOTIONS; EYE MOVEMENTS; FEMALE; HUMANS; MALE; MEMORY, LONG-TERM; MEMORY, SHORT-TERM; MOTION PICTURES AS TOPIC; YOUNG ADULT;

EID: 84897080094     PISSN: None     EISSN: 15347362     Source Type: Journal    
DOI: 10.1167/14.3.31     Document Type: Article

References (37)

1. Attar, C. H., Andersen, S. K., & Müller, M. M. (2010). Time course of affective bias in visual attention: Convergent evidence from steady-state visual evoked potentials and behavioral data. Neuro-Image, 53(4), 1326-1333.
2. Bartolini, E. E. (2011). Eliciting emotion with film: Development of a stimulus set. (Honors thesis), Wesleyan University, Middletown, CT, USA.
3. Buchanan, T. W., & Adolphs, R. (2002). The role of the human amygdala in emotional modulation of longterm declarative memory. In S. Moore & M. Oaksford (Eds.), Emotional cognition: From brain to behavior (pp. 9-34). London, UK: John Benjamins.
4. Buswell, G. (1935). How people look at pictures: A study of the psychology of perception in art. Chicago: University of Chicago Press.
5. Calvo, M. G., & Lang, P. J. (2004). Gaze patterns when looking at emotional pictures: Motivationally biased attention. Motivation and Emotion, 28(3), 221-243.
6. Dorr, M., Martinetz, T., Gegenfurtner, K., & Barth, E. (2010). Variability of eye movements when viewing dynamic natural scenes. Journal of Vision, 10(10): 28, 1-17, http://www.journalofvision.org/content/10/10/28, doi:10.1167/10.10.28.
7. Dorr, M., Vig, E., & Barth, E. (2012). Eye movement prediction and variability on natural video data sets. Visual Cognition, 20, 495-514.
8. Furman, O., Dorfman, N., Hasson, U., Davachi, L., & Dudai, Y. (2007). They saw a movie: Long-term memory for an extended audiovisual narrative. Learning & Memory, 14(6), 457-467.
9. Goldstein, R. B., Woods, R. L., & Peli, E. (2007). Where people look when watching movies: Do all viewers look at the same place? Computers in Biology and Medicine, 37(7), 957-964.
10. Hasson, U., Landesman, O., Knappmeyer, B., Vallines, I., Rubin, N., & Heeger, D. J. (2008). Neurocinematics: The neuroscience of films. Projections: The Journal for Movies and Mind, 2(1), 1-26.
11. Hasson, U., Malach, R., & Heeger, D. J. (2010). Reliability of cortical activity during natural stimulation. Trends in Cognitive Sciences, 14(1), 40-48.
12. Hasson, U., Nir, Y., Levy, I., Fuhrmann, G., & Malach, R. (2004). Intersubject synchronization of cortical activity during natural vision. Science, 303(5664), 1634-1640.
13. Hirose, Y., Tatler, B., & Regan, O. (2010). Perception and memory across viewpoint changes in moving images. Journal of Vision, 10(4):2, 1-20, http://www.journalofvision.org/content/10/4/2, doi:10.1167/10.4.2.
14. Hollingworth, A. (2006). Visual memory for natural scenes: Evidence from change detection and visual research. Visual Cognition, 14, 781-807.
15. Hollingworth, A., Williams, C., & Henderson, J. (2001). To see and remember: Visually specific information is retained in memory from previously attended objects in natural scenes. Psychonomic Bulletin & Review, 8(4), 761-768.
16. Judd, T., Ehinger, K., Durand, F., & Torralba, A. (2009). Learning to predict where humans look. International Conference on Computer Vision, 2009, 2106-2113.
17. Kaspar, K., Hloucal, T.-M. M., Kriz, J., Canzler, S., Gameiro, R. R. R., Krapp, V., & König, P. (2013). Emotions' impact on viewing behavior under natural conditions. PLoS One, 8(1), e52737.
18. Kensinger, E. A. (2009). Remembering the details: Effects of emotion. Emotion Review, 1(2), 99-113.
19. Kensinger, E. A., Garoff-Eaton, R. J., & Schacter, D. L. (2007). Effects of emotion on memory specificity: Memory trade-offs elicited by negative visually arousing stimuli. Journal of Memory and Language, 56(4), 575-591.
20. Melcher, D. (2010). Accumulating and remembering the details of neutral and emotional natural scenes. Perception, 39, 1011-1025.
21. Melcher, D., & Kowler, E. (2001). Visual scene memory and the guidance of saccadic eye movements. Vision Research, 41(25-26), 3597-3611.
22. Nuthmann, A., & Henderson, J. M. (2010). Objectbased attentional selection in scene viewing. Journal of Vision, 10(8):20, 1-19, http://www.journalofvision.org/content/10/8/20, doi:10.1167/10.8.20.
23. Pertzov, Y., Avidan, G., & Zohary, E. (2009). Accumulation of visual information across multiple fixations. Journal of Vision, 9(10):2, 1-12, http://www.journalofvision.org/content/9/10/2, doi:10.1167/9.10.2.
24. Rimmele, U., Davachi, L., Petrov, R., Dougal, S., & Phelps, E. A. (2011). Emotion enhances the subjective feeling of remembering, despite lower accuracy for contextual details. Emotion, 11(3), 553-562.
25. Sharot, T., & Phelps, E. A. (2004). How arousal modulates memory: Disentangling the effects of attention and retention. Cognitive, Affective, & Behavioral Neuroscience, 4(3), 294-306.
26. Smith, T. J. (2013). Watching you watch movies: Using eye tracking to inform cognitive film theory. In A. P. Shimamura (Ed.), Psychocinematics: Exploring cognition at the movies (pp. 165-191). New York: Oxford University Press.
27. Smith, T. J., & Mital, P. K. (2013). Attentional synchrony and the influence of viewing task on gaze behavior in static and dynamic scenes. Journal of Vision, 13(8):16, 1-24, http://www.journalofvision.org/content/13/8/16, doi:10.1167/13.8.16.
28. Soleymani, M., Pantic, M., & Pun, T. (2012). Multimodal emotion recognition in response to videos. IEEE Transactions on Affective Computing, 3(2), 211-223.
29. Tatler, B., Gilchrist, I., & Land, M. (2005). Visual memory for objects in natural scenes: From fixations to object files. Quarterly Journal of Experimental Psychology. A, Human Experimental Psychology, 58A(5), 931-960.
30. Tatler, B., Hayhoe, M. M., Land, M. F., & Ballard, D. H. (2011). Eye guidance in natural vision: Reinterpreting salience. Journal of Vision, 11(5):5, 1-23, http://www.journalofvision.org/content/11/5/5,doi:10.1167/11.5.5.
31. Tatler, B., & Melcher, D. (2007). Pictures in mind: Initial encoding of object properties varies with the realism of the scene stimulus. Perception, 36, 1715-1729.
32. Tatler, B., & Tatler, S. (2013). The influence of instructions on object memory in a real world setting. Journal of Vision, 13(2):5, 1-13, http://www.journalofvision.org/content/13/2/5, doi:10.1167/13.2.5.
33. Tosi, V., Mecacci, L., & Pasquali, E. (1997). Scanning eye movements made when viewing film: Preliminary observations. The International Journal of Neuroscience, 92(1-2), 47-52.
34. Vig, E., Dorr, M., Martinetz, T., & Barth, E. (2011). Eye movements show optimal average anticipation with natural dynamic scenes. Cognitive Computation, 3(1), 79-88.
35. Viola, P., & Jones, M. J. (2004). Robust real-time face detection. International Journal of Computer Vision, 57(2), 137-154.
36. Wang, H. X., Freeman, J., Merriam, E. P., Hasson, U., & Heeger, D. J. (2012). Temporal eye movement strategies during naturalistic viewing. Journal of Vision, 12(1):16, 1-27, http://www.journalofvision.org/content/12/1/16, doi:10.1167/12.1.16.
37. Yarbus, A. L. (1967). Eye movements and vision. New York: Plenum.