Affective salience can reverse the effects of stimulus-driven salience on eye movements in complex scenes

Frontiers in Psychology

Volumn 3, Issue SEP, 2012, Pages

  Niu, Yaqing ^a   Todd, Rebecca M ^a   Anderson, A K ^a  

^a UNIVERSITY OF TORONTO   (Canada)

Author keywords

Affective salience; Attention; Bottom up; Eye movements; Regions of interest; Stimulus driven; Top down; Visual salience

Indexed keywords

EID: 84867085418     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2012.00336     Document Type: Article

References (54)

1. Amaral, D. G., Behniea, H., and Kelly, J. L. (2003). Topographic organization of projections from the amygdala to the visual cortex in the macaque monkey. Neuroscience 118, 1099-1120.
2. Baizer, J. S., Desimone, R., and Ungerleider, L. G. (1993). Comparison of subcortical connections of inferior temporal and posterior parietal cortex in monkeys. Vis. Neurosci. 10, 59-72.
3. Baizer, J. S., Ungerleider, L. G., and Desimone, R. (1991). Organization of visual inputs to the inferior temporal and posterior parietal cortex in macaques. J. Neurosci. 11, 168-190.
4. Balan, P. F., and Gottlieb, J. (2006). Integration of exogenous input into a dynamic salience map revealed by perturbing attention. J. Neurosci. 26, 9239-9249.
5. Birmingham, E., Bischof, W. F., and Kingstone, A. (2009a). Get real! Resolving the debate about equivalent social stimuli. Vis. Cogn. 17, 904-924.
6. Birmingham, E., Bischof, W. F., and Kingstone, A. (2009b). Salience does not account for fixations to eyes within social scenes. Vision Res. 49, 2992-3000.
7. Bisley, J.W., and Goldberg, M. E. (2010). Attention, intention, and priority in the parietal lobe. Annu. Rev. Neu- rosci. 33, 1-21.
8. Blatt, G. J., Andersen, R. A., and Stoner, G. R. (1990). Visual receptive field organization and corticocortical connections of the lateral intraparietal area (area LIP) in the macaque. J. Comp. Neurol. 299, 421-445.
9. Cerf, M., Frady, E. P., and Koch, C. (2009). J. Vis. 9, 1-15.
10. Cerf, M., Harel, J., Einhauser, W., and Koch, C.(2008). Predicting human gaze using low-level saliency combined with face detection. Advances in Neural Information Processing Sys- tems 20, 241-248.
11. Corbetta, M., and Shulman, G. L. (2002). Control of goal-directed and stimulus-driven attention in the brain. Nat. Rev. Neurosci. 3, 201-215.
12. Cunningham, W. A., Van Bavel, J. J., and Johnsen, I. R. (2008). Affective flexibility: evaluative processing goals shape amygdala activity. Psychol. Sci. 19, 152-160.
13. Dorris, M. C., and Glimcher, P. W. (2004). Activity in posterior parietal cortex is correlated with the relative subjective desirability of action. Neuron 44, 365-378.
14. Findlay, J. M., and Walker, R. (1999). A model of saccade generation based on parallel processing and competitive inhibition. Behav. Brain Sci. 22, 661-721.
15. Fox, E. R., Russo, R., and Dutton, K. (2002). Attentional bias for threat: evidence for delayed disengagement from emotional faces. Cogn. Emot. 16, 355-79.
16. Frintrop, S., Nuchter, A., Surmann, H., Hertzberg, J. (2004)."Salience-based object recognition in 3D data," in Proceedings of IEEE International Conference on Intelligent Robots and Systems (IROS 2004), Vol. 3, Prague, 2167-2172.
17. Goldberg, M. E., Bisley, J. W., Powell, K. D., and Gottlieb, J. (2006). Saccades, salience and attention:the role of the lateral intraparietal area in visual behavior. Prog. Brain Res. 155, 157-175
18. Hou, X., and Zhang, L. (2007). "Salience detection: a spectral residual approach. Proc. IEEE. Comput. Soc. Conf. Comput. Vis. Pattern. Recognit. 1-8.
19. Humphrey, K., Underwood, G., and Lambert, T. (2012). Salience of the lambs: a test of the salience map hypothesis with pictures of emotive objects. J. Vis. 12(1):22, 1-15.
20. Itti, L., and Koch, C. (2000). A saliencebased search mechanism for overt and covert shifts of visual attention. Vision Res. 40, 1489-1506.
21. James, W. (1890). Principles of Psychol- ogy. New York: Holt.
22. Kawasaki, H., Kaufman, O., Damasio, H., Damasio, A. R., Granner, M., Bakken, H., Hori, T., Howard, M. A. III, and Adolphs, R. (2001). Single-neuron responses to emotional visual stimuli recorded in human ventral prefrontal cortex. Nat. Neurosci. 4, 15-16.
23. Knight, M. R., Seymour, T. L., Gaunt, J., Baker, C., Nesmith, K., and Mather, M. (2007). Aging and goaldirected emotional attention: distraction reverses emotional biases. Emotion 7, 705-714.
24. Koch, C., and Ullman, S. (1985). Shifts in selective visual attention: towards the underlying neural circuitry. Hum. Neurobiol. 4, 219-227.
25. Krieger, G., Rentschler, I., Hauske, G., Schill, K., and Zetzsche, C. (2000). Object and scene analysis by saccadic eye-movements: an investigation with higher-order statistics. Spat. Vis. 13, 201-214.
26. LaBar, K. S., Mesulam, M., Gitelman, D. R., and Weintraub, S. (2000). Emotional curiosity: modulation of visuospatial attention by arousal is preserved in aging and early-stage Alzheimer's disease. Neuropsycholo- gia 38, 1734-1740.
27. Lang, P. J., Greenwald, M. K., Bradley, M. M., and Hamm, A. (1993).
28. Looking at pictures: affective, facial, visceral, and behavioural reactions. Psychophysiology 30, 261-273.
29. Lee, T.-H., Itti, L., and Mather, M. (2012). Evidence for arousalbiased competition in perceptual learning. Front. Psychol. 3:241. doi:10.3389/fpsyg.2012.00241
30. Mannan, S. K., Ruddock, K. H., and Wooding, D. S. (1996). The relationship between the locations of spatial features and those of fixations made during visual examination of briefly presented images. Spat. Vis. 10, 165-188.
31. Mannan, S. K., Ruddock, K. H., and Wooding, D. S. (1997). Fixation patterns made during brief examination of two-dimensional images. Perception 26, 1059-1072.
32. Mogg, K., and Bradley, B. P. (1999). Some methodological issues in assessing attentional biases for threatening faces in anxiety: a replication study using a modified version of the probe detection task. Behav. Res. Ther. 37, 595-604.
33. Niu, Y., Todd, R. M., Kyan, M., and Anderson, A. K. (2012). Visual and emotional salience influence eye movement. ACM Trans. Appl. Per- cept. doi: 10.1145/2325722.2325726 Nummenmaa, L., Hyona, J., and Calvo, M. G. (2006). Eye movement assessment of selective attentional capture by emotional pictures. Emotion 6, 257-268.
34. Nummenmaa, L., Hyona, J., and Calvo, M. G. (2009). Emotional scene content drives the saccade generation system reflexively. J. Exp. Psy- chol. Hum. Percept. Perform. 35, 305-323.
35. Parkhurst, D., Law, K., and Niebur, E. (2002). Modeling the role of salience in the allocation of overt visual attention. Vision Res. 42, 107-123.
36. Parkhurst, D. J., and Niebur, E. (2003). Scene content selected by active vision. Spat. Vis. 6, 125-154.
37. Parkhurst, D. J., and Niebur, E. (2004). Texture contrast attracts overt visual attention in natural scenes. Eur. J. Neurosci. 19, 783-789.
38. Pessoa, L., andAdolphs, R. (2010). Emotion processing and the amygdala: from a "low road" to "many roads" of evaluating biological significance. Nat. Rev. Neurosci. 11, 773-783.
39. Reinagel, P., and Zador, A. M. (1999). Natural scene statistics at the centre of gaze. Network 10, 1-10.
40. Rempel-Clower, N. L., and Barbas, H. (2000). The laminar pattern of connections between prefrontal and anterior temporal cortices in the Rhesus monkey is related to cortical structure and function. Cereb. Cortex 10, 851-865.
41. Riggs, L., McQuiggan, D. A., Anderson, A. K., and Ryan, J. D. (2010). Eye movement monitoring reveals differential influences of emotion on memory. Front. Psychol. 1:205. doi:10.3389/fpsyg.2010.00205
42. Rizzolatti, G., Riggio, L., Dascola, I., and Umilta, C. (1987). Reorienting attention across the horizontal and vertical meridians: evidence in favor of a premotor theory of attention. Neuropsychologia 25, 31-40.
43. Rosenholtz, R. (1999). A simple salience model predicts a number of motion popout phenomena. Vision Res. 39, 3157-3163.
44. Rosler, A., Ulrich, C., Billino, J., Sterzer, P., Weidauer, S., Bernhardt, T., Steinmetz, H., Frohich, L., and Kleinschmidt, A. (2005). Effects of arousing emotional scenes on the distribution of visuospatial attention: changes with aging and early subcortical vascular dementia. J. Neurol. Sci. 229-230, 109-116.
45. Rowe, G., Hirsh, J. B., and Anderson, A. K. (2007). Positive affect increases the breadth of attentional selection. Proc. Natl. Acad. Sci. U.S.A. 104, 383-388.
46. Schmitz, T. W., De Rosa, E., and Anderson, A. K. (2009). Opposing influences of affective state valence on visual cortical encoding. J. Neurosci. 29, 7199-7207.
47. Schutz, A. C., Trommershauser, J., and Gegenfurtner, K. R. (2012). Dynamic integration of information about salience and value for saccadic eye movements.Proc. Natl. Acad. Sci. U.S.A. 109, 7547-7552.
48. Sharot, T., Davidson, M. L., Carson, M. M., and Phelps, E. A. (2008). Eye movements predict recollective experience. PLoS ONE 3, e2884. doi:10.1371/journal.pone.0002884
49. Shipp, S. (2003). The functional logic of cortico-pulvinar connections. Phi- los. Trans. R. Soc. Lond. B Biol. Sci. 358, 1605-1624.
50. Sugrue, L. P., Corrado, G. S., and Newsome, W. T. (2004). Matching behavior and the representation of value in the parietal cortex. Science 304, 1782-1787.
51. Thompson, K. G., and Bichot, N. P. (2005). A visual salience map in the primate frontal eye field. Prog. Brain Res. 147, 251-262.
52. Todd, R.M., andAnderson, A.K.(2009). Six degrees of separation: the amygdala regulates social behavior and perception. Nat. Neurosci. 12, 1-3.
53. Todd, R. M., Cunningham, W. A., Anderson, A. K., and Thompson, E. (2012). Affect-biased attention as emotion regulation. Trends Cogn. Sci. (Regul. Ed.) 16, 365-372.
54. Torralba, A. (2003). Modeling global scene factors in attention. J. Opt. Soc. Am. 20, 1407-1418.