Forced to remember: When memory is biased by salient information

Behavioural Brain Research

Volumn 283, Issue , 2015, Pages 1-10

  Santangelo, Valerio ^a,b  

^a UNIVERSITY OF PERUGIA   (Italy)

^b IRCCS FONDAZIONE SANTA LUCIA   (Italy)

Author keywords

Attention; FMRI; Natural scenes; Salience; Semantics; Working memory

Indexed keywords

ARTICLE; ATTENTION; DORSAL FRONTOPARIETAL NETWORK; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; MEMORY; MEMORY CONSOLIDATION; NERVE CELL NETWORK; NEUROIMAGING; PERCEPTION; POSTERIOR PARIETAL CORTEX; RECALL; RECOGNITION; SALIENCE; SEMANTICS; SHORT TERM MEMORY; STRIATE CORTEX; VENTRAL FRONTOPARIETAL NETWORK; WORKING MEMORY; BRAIN; PHYSIOLOGY;

BRAIN; HUMANS; MEMORY; PERCEPTION; SEMANTICS;

EID: 84921827300     PISSN: 01664328     EISSN: 18727549     Source Type: Journal    
DOI: 10.1016/j.bbr.2015.01.013     Document Type: Review

References (140)

1. Yen S.-C., Finkel L.H. Salience. Encyclopedia of the human brain 2002, Academic Press, San Diego, CA. V.S. Ramachandran (Ed.).
2. Koch C., Ullman S. Shifts in selective visual attention: towards the underlying neural circuitry. Hum Neurobiol 1985, 4:219-227.
3. Itti L., Koch C. A saliency-based mechanism for overt and covert shifts of visual attention. Vis Res 2000, 40:1489-1506.
4. Posner M.I. Orienting of attention. Q J Exp Psychol 1980, 32:3-25.
5. Posner M.I., Cohen Y. Components of visual orienting. Attention and performance X 1984, 531-556. Erlbaum, Hillsdale, NJ. D. Bouma, D. Bouwhuis (Eds.).
6. Klein R.M., Shore D. Relations among modes of visual orienting. Attention and performance XVIII: control of cognitive processes 2000, 195-208. MIT Press, Cambridge, MA. S. Monsell, J. Driver (Eds.).
7. Underwood B.J. The effect of successive interpolations on retroactive and proactive inhibition. Psychol Monogr 1945, 59:i-33.
8. Underwood B.J. Interference and forgetting. Psychol Rev 1957, 64:49-60.
9. Brown J. Some test of the decay theory of immediate memory. Q J Exp Psychol 1958, 10:12-21.
10. Jonides J., Lewis R.L., Nee D.E., Lustig C.A., Berman M.G., Moore K.S. The mind and brain of short-term memory. Annu Rev Psychol 2008, 59:193-224.
11. Deese J. On the prediction of occurrence of particular verbal intrusions in immediate recall. J Exp Psychol 1959, 58:17-22.
12. Roediger H.L., McDermott K.B. Creating false memories: remembering words not presented in lists. J Exp Psychol Learn Mem Cogn 1995, 24:803-814.
13. Henderson J.M., Hollingworth A. High-level scene perception. Annu Rev Psychol 1999, 50:243-271.
14. Spence C., Parise C. Prior-entry. A review. Conscious Cogn 2010, 19:364-379.
15. Lamy D., Zoaris L. Task-irrelevant stimulus salience affects visual search. Vis Res 2009, 49:1472-1480.
16. Zehetleitner M., Hegenloh M., Müller H.J. Visually guided pointing movements are driven by the salience map. J Vis 2011, 31:11.
17. Lamy D.F., Kristjánsson A. Is goal-directed attentional guidance just intertrial priming? A review. J Vis 2013, 13:14.
18. Theeuwes J. Top-down and bottom-up control of visual selection. Acta Psychol 2010, 135:77-99.
19. Theeuwes J. Feature-based attention: it is all bottom-up priming. Philos Trans R Soc Lond B Biol Sci 2013, 368:20130055.
20. Santangelo V., Spence C. Is the exogenous orienting of spatial attention truly automatic? Evidence from unimodal and multisensory studies. Conscious Cogn 2008, 17:989-1015.
21. Awh E., Belopolsky A.V., Theeuwes J. Top-down versus bottom-up attentional control: a failed theoretical dichotomy. Trends Cogn Sci 2012, 16:437-443.
22. Macaluso E., Doricchi F. Attention and predictions: control of spatial attention beyond the endogenous-exogenous dichotomy. Front Hum Neurosci 2013, 7:685.
23. Treisman A.M., Gelade G. A feature-integration theory of attention. Cogn Psychol 1980, 12:97-136.
24. Borji A., Sihite D.N., Itti L. Quantitative analysis of human-model agreement in visual saliency modeling: a comparative study. IEEE Trans Image Process 2013, 22:55-69.
25. Itti L., Koch C. Computational modelling of visual attention. Nat Rev Neurosci 2001, 2:194-203.
26. Itti L., Koch C., Niebur E. A model of salience-based visual attention for rapid scene analysis. IEEE Trans Pattern Anal Mach Intell 1998, 20:1254-1259.
27. Didday R.L., Arbib M.A. Eye movements and visual perception: a "two visual system" model. Int J Man-Machine Stud 1975, 7:547-569.
28. Carmi R., Itti L. Visual causes versus correlates of attentional selection in dynamic scenes. Vis Res 2006, 46:4333-4345.
29. Bordier C., Puja F., Macaluso E. Sensory processing during viewing of cinematographic material: computational modeling and functional neuroimaging. NeuroImage 2013, 67:213-226.
30. Nardo D., Santangelo V., Macaluso E. Spatial orienting in complex audiovisual environments. Hum Brain Mapp 2014, 35:1597-1614.
31. Borji A., Sihite D.N., Itti L. Objects do not predict fixations better than early saliency: A re-analysis of Einhauser et al.'s data. J Vis 2013, 13:18.
32. Einhäuser W., Spain M., Perona P. Objects predict fixations better than early saliency. J Vis 2008, 8:18.1-26.
33. Elazary L., Itti L. Interesting objects are visually salient. J Vis 2008, 8:3.1-15.
34. Yund E.W., Efron R. Model for the relative salience of the pitch of pure tones presented dichotically. J Acoust Soc Am 1977, 62:607-617.
35. Kayser C., Petkov C.I., Lippert M., Logothesis N.K. Mechanisms for allocating auditory attention: an auditory saliency map. Curr Biol 2005, 15:1943-1947.
36. Spence C., Santangelo V. Auditory attention. Oxford handbook of auditory science: hearing 2010, 249-270. Oxford University Press, Oxford, UK. C. Plack (Ed.).
37. Bregman A. Auditory scene analysis: the perceptual organization of sound 1990, MIT Press, Cambridge, Mass.
38. Rauschecker J.P., Tian B., Hauser M. Processing of complex sounds in the macaque nonprimary auditory cortex. Science 1995, 268:111-114.
39. Schreiner C.E., Read H.L., Sutter M.L. Modular organization of frequency integration in primary auditory cortex. Annu Rev Neurosci 2000, 23:501-529.
40. Tordini F., Bregman A., Ankolekar A., Sanholm T.E., Cooperstock J.R. Toward an improved model of auditory saliency. Presented at ICAD, International Conference on Auditory Displays, 2013, 6-10 July, Lodz, Poland 2013.
41. Einhäuser W., Rutishauser U., Kock C. Task-demands can immediately reverse the effects of sensory-driven saliency in complex visual stimuli. J Vis 2008, 8:1-19.
42. Henderson J.M., Brockmole J.R., Castelhano M.S., Mack M. Visual saliency does not account for eye-movements during visual search in real-world scenes. Eye movement research: insight into mind and brain 2006, 537-562. Elsevier, Oxford. R. van Gompel, M. Fischer, W. Murray, R. Hill (Eds.).
43. Underwood G., Foulsham T., van Loon E., Humphreys L., Bloyce J. Eye movements during scene inspection: a test of the saliency map hypothesis. Eur J Cogn Psychol 2006, 18:321-342.
44. Foulsham T., Barton J.J., Kingstone A., Dewhurst R., Underwood G. Fixation and saliency during search of natural scenes: the case of visual agnosia. Neuropsychologia 2009, 47:1994-2003.
45. Mannan S.K., Kennard C., Husain M. The role of visual salience in directing eye movements in visual object agnosia. Curr Biol 2009, 19:R247-R248.
46. Lu S., Han S. Attentional capture is contingent on the interaction between task demand and stimulus salience. Atten Percept Psychophys 2009, 71:1015-1026.
47. Schubö A., Müller H.J. Selecting and ignoring salient objects within and across dimensions in visual search. Brain Res 2009, 1283:84-101.
48. Pomplun M. Saccadic selectivity in complex visual search displays. Vision Res 2006, 46:1886-1900.
49. Summerfield J.J., Lepsien J., Gitelman D.R., Mesulam M.M., Nobre A.C. Orienting attention based on long-term memory experience. Neuron 2006, 49:905-916.
50. Dowd E.W., Mitroff S.R. Attentional guidance by working memory overrides salience cues in visual search. J Exp Psychol Hum Percept Perform 2013, 39:1786-1796.
51. Humphrey K., Underwood G. Domain knowledge moderates the influence of visual saliency in scene recognition. Br J Psychol 2009, 100:377-398.
52. Anderson B.A. A value-driven mechanism of attentional selection. J Vis 2013, 13:pii: 7.
53. Krebs R.M., Boehler C.N., Egner T., Woldorff M.G. The neural underpinnings of how reward associations can both guide and misguide attention. J Neurosci 2011, 31:9752-9759.
54. Stritzke M., Trommershäuser J., Gegenfurtner K.R. Effects of salience and reward information during saccadic decisions under risk. J Opt Soc Am A 2009, 26:B1-B13.
55. Chun M.M. Contextual cueing of visual attention. Trends Cogn Sci 2000, 4:170-178.
56. Seitz A.R., Watanabe T. The phenomenon of task-irrelevant perceptual learning. Vision Res 2009, 49:2604-2610.
57. Hollingworth A. Guidance of visual search by memory and knowledge. Nebr Symp Motiv 2012, 59:63-89.
58. Biggs A.T., Kreager R.D., Gibson B.S., Villano M., Crowell C.R. Semantic and affective salience: the role of meaning and preference in attentional capture and disengagement. J Exp Psychol Hum Percept Perform 2012, 38:531-541.
59. Birmingham E., Bischof W.F., Kingstone A. Saliency does not account for fixations to eyes within social scenes. Vis Res 2009, 49:2992-3000.
60. Chen X., Mihalas S., Niebur E., Stuphorn V. Mechanisms underlying the influence of saliency on value-based decisions. J Vis 2013, 13:18. [1-23].
61. Coco M.I., Malcom G.L., Keller F. The interplay of bottom-up and top-down mechanisms in visual guidance during object naming. Q J Exp Psychol 2014, 67:1096-1120.
62. Santangelo V., di Francesco S.A., Mastroberardino S., Macaluso E. Processing of contextual and saliency signals in parietal cortex during the encoding of natural scenes in working memory 2015, [Submitted for publication].
63. Spotorno S., Tatler B.W., Faure S. Semantic versus perceptual salience in visual scenes: findings from change detection. Acta Psychol 2013, 142:168-176.
64. Stirk J.A., Underwood G. Low-level visual saliency does not predict change detection in natural scenes. J Vis 2007, 7:1-10.
65. Corbetta M., Patel G., Shulman G.L. The reorienting system of the human brain: From environment to theory of mind. Neuron 2008, 58:307-324.
66. Corbetta M., Shulman G.L. Control of goal-directed and stimulus-driven attention in the brain. Nat Rev Neurosci 2002, 3:201-215.
67. Doricchi F., Macci E., Silvetti M., Macaluso E. Neural correlates of the spatial expectancy components of endogenous and stimulus-driven orienting of attention in the Posner task. Cereb Cortex 2010, 20:1574-1585.
68. Hopfinger J.B., West V.M. Interactions between endogenous and exogenous attention on cortical visual processing. NeuroImage 2006, 31:774-789.
69. Kincade J.M., Abrams R.A., Astafiev S.V., Shulman G.L., Corbetta M. An event-related functional magnetic resonance imaging study of voluntary and stimulus-driven orienting of attention. J Neurosci 2005, 25:4593-4604.
70. Indovina I., Macaluso E. Dissociation of stimulus relevance and saliency factors during shifts of visuospatial attention. Cereb Cortex 2007, 17:1701-1711.
71. Natale E., Marzi C.A., Macaluso E. FMRI correlates of visuo-spatial re-orienting investigated with an attention shifting double-cue paradigm. Hum Brain Mapp 2009, 30:2367-2381.
72. Santangelo V., Olivetti Belardinelli M., Spence C., Macaluso E. Interactions between voluntary and stimulus-driven spatial attention mechanisms across sensory modalities. J Cogn Neurosci 2009, 21:2384-2397.
73. Serences J.T., Shomstein S., Leber A.B., Golay X., Egeth H.E., Yantis S. Coordination of voluntary and stimulus-driven attentional control in human cortex. Psychol Sci 2005, 16:114-122.
74. Serences J.T., Yantis S. Spatially selective representations of voluntary and stimulus-driven attentional priority in human occipital, parietal, and frontal cortex. Cereb Cortex 2007, 17:284-293.
75. Berger A., Henik A., Rafal R. Competition between endogenous and exogenous orienting of visual attention. J Exp Psychol Gen 2005, 134:207-221.
76. Santangelo V., Finoia P., Raffone A., Olivetti Belardinelli M., Spence C. Perceptual load affects exogenous spatial orienting while working memory load does not. Exp Brain Res 2008, 184:371-382.
77. Santangelo V., Olivetti Belardinelli M., Spence C. The suppression of reflexive visual and auditory orienting when attention is otherwise engaged. J Exp Psychol Hum Percept Perform 2007, 33:137-148.
78. Santangelo V., Spence C. Assessing the automaticity of the exogenous orienting of tactile attention. Perception 2007, 36:1497-1505.
79. Santangelo V., Spence C. Assessing the effect of verbal working memory load on visuo-spatial exogenous orienting. Neurosci Lett 2007, 413:105-109.
80. Santangelo V., Botta F., Lupiáñez J., Spence C. The time-course of attentional capture under dual-task conditions. Atten Percept Psychophys 2011, 73:15-23.
81. Torralba A., Oliva A., Castelhano M.S., Henderson J.M. Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. Psychol Rev 2006, 113:766-786.
82. Oliva A., Torralba A. The role of context in object recognition. Trends Cogn Sci 2007, 11:520-527.
83. Wolfe J.M. Guided search 2.0. A revised model of visual search. Psychon Bull Rev 1994, 1:202-228.
84. Wolfe J.M., Horowitz T.S. What attributes guide the deployment of visual attention and how do they do it. Nat Rev Neurosci 2004, 5:495-501.
85. Wolfe J.M., Võ M.L., Evans K.K., Greene M.R. Visual search in scenes involves selective and nonselective pathways. Trends Cogn Sci 2011, 15:77-84.
86. Wang Q., Yuan Y., Yan P., Li X. Saliency detection by multiple-instance learning. IEEE Trans Cybern 2013, 43:660-672.
87. Kalinli O., Narayanan S. Prominence detection using auditory attention cues and task-dependent high level information. IEEE Trans Audio Speech Lang Process 2009, 17:1009-1024.
88. Russell A.F., Mihalas S., von der Heydt R., Niebur E., Etienne-Cummings R. A model of proto-object based saliency. Vis Res 2014, 94:1-15.
89. Yanulevskaya V., Uijlings J., Geusebroek J.M., Sebe N., Smeulders A. A proto-object-based computational model for visual saliency. J Vis 2013, 13:27. [1-19].
90. Chen Z. Object-based attention: a tutorial review. Atten Percept Psychophys 2012, 74:784-802.
91. Ho M.C., Yeh S.L. Effects of instantaneous object input and past experience on object-based attention. Acta Psychol 2009, 132:31-39.
92. Kimchi R., Yeshurun Y., Cohen-Savransky A. Automatic, stimulus-driven attentional capture by objecthood. Psychon Bull Rev 2007, 14:166-172.
93. Matsukura M., Vecera S.P. The return of object-based attention: selection of multiple-region objects. Percept Psychophys 2006, 68:1163-1175.
94. Awh E., Jonides J. Overlapping mechanisms of attention and spatial working memory. Trends Cogn Sci 2001, 5:119-126.
95. Chun M.M., Turk-Browne N.B. Interactions between attention and memory. Curr Opin Neurobiol 2007, 17:177-184.
96. Gazzaley A., Nobre A.C. Top-down modulation: bridging selective attention and working memory. Trends Cogn Sci 2012, 16:129-135.
97. LaBar K.S., Gitelman D.R., Parrish T.B., Mesulam M. Neuroanatomic overlap of working memory and spatial attention networks: a functional MRI comparison within subjects. NeuroImage 1999, 10:695-704.
98. Corbetta M., Kincade J.M., Shulman G.L. Neural systems for visual orienting and their relationships to spatial working memory. J Cogn Neurosci 2002, 14:508-523.
99. Santangelo V., Macaluso E. The contribution of working memory to divided attention. Hum Brain Mapp 2013, 34:158-175.
100. Naghavi H.R., Nyberg L. Common fronto-parietal activity in attention, memory, and consciousness: share demands on integrations. Conscious Cogn 2005, 14:390-425.
101. Bundesen C. A theory of visual attention. Psychol Rev 1990, 97:523-547.
102. Bundesen C., Habekost T., Kyllingsbaek S. A neural theory of visual attention and short-term memory (NTVA). Neuropsychologia 2011, 49:1446-1457.
103. Cowan N. Activation, attention, and short-term memory. Mem Cognit 1993, 21:162-167.
104. Cowan N. The focus of attention as observed in visual working memory tasks: making sense of competing claims. Neuropsychologia 2011, 49:1401-1406.
105. Oberauer K., Lewandowsky S., Farrell S., Jarrold C., Greaves M. Modeling working memory: an interference model of complex span. Psychon Bull Rev 2012, 19:779-819.
106. Davachi L. Item, context and relational episodic encoding in humans. Curr Opin Neurobiol 2006, 16:693-700.
107. Simons J.S., Spiers H.J. Prefrontal and medial temporal lobe interactions in long-term memory. Nat Rev Neurosci 2003, 4:637-648.
108. Squire L.R., Stark C.E., Clark R.E. The medial temporal lobe. Annu Rev Neurosci 2004, 27:279-306.
109. Fine M.S., Minnery B.S. Visual salience affects performance in a working memory task. J Neurosci 2009, 29:8016-8021.
110. Luck S.J., Vogel E.K. Visual working memory capacity: from psychophysics and neurobiology to individual differences. Trends Cogn Sci 2013, 17:391-400.
111. Santangelo V., Macaluso E. Visual salience improves spatial working memory via enhanced parieto-temporal functional connectivity. J Neurosci 2013, 33:4110-4117.
112. Pooresmaeili A., Bach D.R., Dolan R.J. The effect of visual salience on memory-based choices. J Neurophysiol 2014, 111:481-487.
113. Melcher D., Piazza M. The role of attentional priority and saliency in determining capacity limits in enumeration and visual working memory. PLoS One 2011, 6:e29296.
114. Dempere-Marco L., Melcher D.P., Deco G. Effective visual working memory capacity: an emergent effect from the neural dynamics in an attractor network. PLoS One 2012, 7:e42719.
115. Pedale T., Santangelo V. Perceptual salience affects the contents of working memory during free-recollection of objects from natural scenes. Front Hum Neurosci 2015, 9:60.
116. Friedman A. Framing pictures: The role of knowledge in automatized encoding and memory for gist. J Exp Psychol Gen 1979, 108:316-355.
117. Goodman G.S. Picture memory: how the action schema affects retention. Cogn Psychol 1980, 12:473-495.
118. Hock H.S., Romanski L., Galie A., Williams C.S. Real-world schemata and scene recognition in adults and children. Mem Cognit 1978, 6:423-431.
119. Pezdek K., Whetstone T., Reynolds K., Askari N., Dougherty T. Memory for real-world scenes: the role of consistency with schema expectation. J Exp Psychol Learn Mem Cogn 1989, 15:587-595.
120. Silva M.M., Groeger J.A., Bradshaw M.F. Attention-memory interactions in scene perception. Spat Vis 2006, 19:9-19.
121. Botta F., Santangelo V., Raffone A., Olivetti Belardinelli M., Lupianez J. Exogenous and endogenous spatial attention effects on visuo-spatial working memory. Q J Exp Psychol 2010, 63:1590-1602.
122. Gazzaley A., Cooney J.W., McEvoy K., Knight R.T., D'Esposito M. Top-down enhancement and suppression of the magnitude and speed of neural activity. J Cogn Neurosci 2005, 17:507-517.
123. Schmidt B.K., Vogel E.K., Woodman G.F., Luck S.J. Voluntary and automatic attentional control of visual working memory. Percept Psychophys 2002, 64:754-763.
124. Li Z. A saliency map in primary visual cortex. Trends Cogn Sci 2002, 6:9-16.
125. Zhang X., Zhaoping L., Zhou T., Fang F. Neural activities in V1 create a bottom-up saliency map. Neuron 2012, 73:183-192.
126. Ptak R. The frontoparietal attention network of the human brain: action, saliency, and a priority map of the environment. Neuroscientist 2012, 18:502-515.
127. Thompson K.G., Bichot N.P. A visual salience map in the primate frontal eye field. Prog Brain Res 2005, 147:251-262.
128. Bisley J.W., Goldberg M.E. Attention, intention, and priority in the parietal lobe. Annu Rev Neurosci 2010, 33:1-21.
129. Geng J.J., Mangun G.R. Anterior intraparietal sulcus is sensitive to bottom-up attention driven by stimulus salience. J Cogn Neurosci 2009, 21:1584-1601.
130. Gottlieb J.P., Kusunoki M., Goldberg M.E. The representation of visual salience in monkey parietal cortex. Nature 1998, 391:481-484.
131. Shipp S. The brain circuitry of attention. Trends Cogn Sci 2004, 8:223-230.
132. Yoshida M., Itti L., Berg D.J., Ikeda T., Kato R., Takaura K., et al. Residual attention guidance in blindsight monkeys watching complex natural scenes. Curr Biol 2012, 22:1429-1434.
133. Betz T., Wilming N., Bogler C., Haynes J.D., König P. Dissociation between saliency signals and activity in early visual cortex. J Vis 2013, 13(6):1-12.
134. Gottlieb J. From thought to action: the parietal cortex as a bridge between perception, action, and cognition. Neuron 2007, 53:9-16.
135. Bogler C., Bode S., Haynes J.D. Decoding successive computational stages of saliency processing. Curr Biol 2011, 21:1667-1671.
136. Nardo D., Santangelo V., Macaluso E. Stimulus-driven orienting of visuo-spatial attention in complex dynamic environments. Neuron 2011, 69:1015-1028.
137. Berman R., Colby C. Attention and active vision. Vis Res 2009, 49:1233-1248.
138. Howard L.R., Kumaran D., Ólafsdóttir H.F., Spiers H.J. Double dissociation between hippocampal and parahippocampal responses to object-background context and scene novelty. J Neurosci 2011, 31:5253-5261.
139. Geng J.J., Vossel S. Re-evaluating the role of TPJ in attentional control: contextual updating. Neurosci Biobehav Rev 2013, 37:2608-2620.
140. Remy F., Vayssiere N., Pins D., Boucart M., Fabre-Thorpe M. Incongruent object/context relationship in visual scenes: where are they processed in the brain. Brain Cogn 2014, 84:34-43.