Parietal cortex integrates contextual and saliency signals during the encoding of natural scenes in working memory

Human Brain Mapping

Volumn 36, Issue 12, 2015, Pages 5003-5017

  Santangelo, Valerio ^a,b   di Francesco, Simona Arianna ^a,c   Mastroberardino, Serena ^a   Macaluso, Emiliano ^a  

^a IRCCS FONDAZIONE SANTA LUCIA   (Italy)

^b UNIVERSITY OF PERUGIA   (Italy)

^c SAPIENZA UNIVERSITY OF ROME   (Italy)

Author keywords

Attention; Context; fMRI; Natural scenes; Parietal cortex; Saliency; Working memory

Indexed keywords

ADULT; ANGULAR GYRUS; ARTICLE; BOLD SIGNAL; COMPARATIVE STUDY; CONTEXTUAL SIGNAL; CONTROLLED STUDY; ECHO PLANAR IMAGING; EPISODIC MEMORY; EYE TRACKING; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HEAD MOVEMENT; HUMAN; HUMAN EXPERIMENT; INFERIOR PARIETAL CORTEX; INFORMATION RETRIEVAL; INTRAPARIETAL SULCUS; KERNEL METHOD; MALE; MIDDLE FRONTAL GYRUS; NERVOUS SYSTEM PARAMETERS; NEUROIMAGING; NORMAL HUMAN; NUCLEAR MAGNETIC RESONANCE IMAGING; NUCLEAR MAGNETIC RESONANCE SCANNER; PARIETAL CORTEX; PREMOTOR CORTEX; PRIORITY JOURNAL; RIGHT HANDEDNESS; SALIENCY SIGNAL; SPATIAL MEMORY; SUPRAMARGINAL GYRUS; TIME SERIES ANALYSIS; VISUAL FIELD; VISUAL MEMORY; WORKING MEMORY; ANALYSIS OF VARIANCE; ASSOCIATION; ATTENTION; BLOOD; BRAIN MAPPING; EYE MOVEMENT; HEMISPHERIC DOMINANCE; IMAGE PROCESSING; PARIETAL LOBE; PATTERN RECOGNITION; PHOTOSTIMULATION; PHYSIOLOGY; REACTION TIME; SHORT TERM MEMORY; VASCULARIZATION; YOUNG ADULT;

OXYGEN;

ADULT; ANALYSIS OF VARIANCE; ATTENTION; BRAIN MAPPING; CUES; EYE MOVEMENTS; FEMALE; FUNCTIONAL LATERALITY; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; MEMORY, SHORT-TERM; OXYGEN; PARIETAL LOBE; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; REACTION TIME; YOUNG ADULT;

EID: 84956577521     PISSN: 10659471     EISSN: 10970193     Source Type: Journal    
DOI: 10.1002/hbm.22984     Document Type: Article

References (66)

1. Anticevic A, Repovs G, Shulman GL, Barch DM (2010): When less is more: TPJ and default network deactivation during encoding predicts working memory performance. Neuroimage 49:2638-2648.
2. Botta F, Santangelo V, Raffone A, Olivetti Belardinelli M, Lupianez J (2010): Exogenous and endogenous spatial attention effects on visuo-spatial working memory. Q J Exp Psychol 63:1590-1602.
3. Buchel C, Holmes AP, Rees G, Friston KJ (1998): Characterizing stimulus-response functions using nonlinear regressors in parametric fMRI experiments. Neuroimage 8:140-148.
4. Cabeza R, Ciaramelli E, Olson IR, Moscovitch M (2008): The parietal cortex and episodic memory: an attentional account. Nat Rev Neurosci 9:613-625.
5. Champod AS, Petrides M (2007): Dissociable roles of the posterior parietal and the prefrontal cortex in manipulation and monitoring processes. Proc Natl Acad Sci USA 104:14837-14842.
6. Corbetta M, Kincade JM, Ollinger JM, McAvoy MP, Shulman GL (2000): Voluntary orienting is dissociated from target detection in human posterior parietal cortex. Nat Neurosci 3:292-297.
7. Corbetta M, Patel G, Shulman GL (2008): The reorienting system of the human brain: From environment to theory of mind. Neuron 58:307-324.
8. Corbetta M, Shulman GL (2002): Control of goal-directed and stimulus-driven attention in the brain. Nat Rev Neurosci 3:201-215.
9. Corbetta M, Tansy AP, Stanley CM, Astafiev SV, Snyder AZ, Shulman GL (2005): A functional MRI study of preparatory signals for spatial location and objects. Neuropsychologia 43:2041-2056.
10. Doricchi F, Macci E, Silvetti M, Macaluso E (2010): Neural correlates of the spatial expectancy components of endogenous and stimulus-driven orienting of attention in the Posner task. Cereb Cortex 20:1574-1585.
11. Einhäuser W, Spain M, Perona P (2008): Objects predict fixation better than early saliency. J Vis 8:18.1-26.
12. Fine MS, Minnery BS (2009): Visual salience affects performance in a working memory task. J Neurosci 29:8016-8021.
13. Foulsham T, Underwood G (2008): What can saliency models predict about eye movements? Spatial and sequential aspects of fixations during encoding and recognition. J Vis 8:6.1-17.
14. Friston KJ, Glaser DE, Henson RN, Kiebel S, Phillips C, Ashburner J (2002): Classical and Bayesian inference in neuroimaging: Applications. Neuroimage 16:484-512.
15. Fuster JM (2006): The cognit: A network model of cortical representation. Int J Psychophysiol 60:125-132.
16. Gazzaley A, Cooney JW, McEvoy K, Knight RT, D'Esposito M (2005): Top-down enhancement and suppression of the magnitude and speed of neural activity. J Cogn Neurosci 17:507-517.
17. Gazzaley A, Nobre AC (2012): Top-down modulation: Bridging selective attention and working memory. Trends Cogn Sci 16:129-135.
18. Geng JJ, Vossel S (2013): Re-evaluating the role of TPJ in attentional control: Contextual updating? Neurosci Biobehav Rev 27:2608-2620.
19. Goodman GS (1980): Picture memory: How the action schema affects retention. Cogn Psychol 12:473-495.
20. Gottlieb J (2007): From thought to action: the parietal cortex as a bridge between perception, action, and cognition. Neuron 53:9-16.
21. Hahn B, Ross TJ, Stein EA (2006): Neuroanatomical dissociation between bottom-up and top-down processes of visuospatial selective attention. Neuroimage 32:842-853.
22. Hasson U, Nir Y, Levy I, Fuhrmann G, Malach R (2004): Intersubject synchronization of cortical activity during natural vision. Science 303:1634-1640.
23. Henderson JM (2003): Human gaze control during real-world scene perception. Trends Cogn Sci 7:498-504.
24. Henderson JM, Hollingworth A (1999): High-level scene perception. Annu Rev Psychol 50:243-271.
25. Hollingworth A, Henderson JM (1998): Does consistent scene context facilitate object perception? J Exp Psychol Gen 127:398-415.
26. Hopfinger JB, West VM (2006): Interactions between endogenous and exogenous attention on cortical visual processing. Neuroimage 31:774-789.
27. Kincade JM, Abrams RA, Astafiev SV, Shulman GL, Corbetta M (2005): An event-related functional magnetic resonance imaging study of voluntary and stimulus-driven orienting of attention. J Neurosci 25:4593-4604.
28. Ikkai A, Curtis CE (2011): Common neural mechanisms supporting spatial working memory, attention and motor intention. Neuropsychologia 49:1428-1434.
29. Indovina I, Macaluso E (2007): Dissociation of stimulus relevance and saliency factors during shifts of visuospatial attention. Cereb Cortex 17:1701-1711.
30. Itti L, Koch C (2001): Computational modelling of visual attention. Nat Rev Neurosci 2:194-203.
31. Itti L, Koch C, Niebur E (1998): A model of saliency-based visual attention for rapid scene analysis. IEEE Trans Pattern Anal Mach Intell 20:1254-1259.
32. Luck SJ, Vogel EK (2013): Visual working memory capacity: From psychophysics and neurobiology to individual differences. Trends Cogn Sci 17:391-400.
33. Macaluso E, Doricchi F (2013): Attention and predictions: control of spatial attention beyond the endogenous-exogenous dichotomy. Front Hum Neurosci 7:685.
34. Mack SC, Eckstein MP (2011): Object co-occurrence serves as a contextual cue to guide and facilitate visual search in a natural viewing environment. J Vis 11:1-16.
35. Majerus S, Bastin C, Poncelet M, Van der Linden M, Salmon E, Collette F, Maquet P (2007): Short-term memory and the left intraparietal sulcus: Focus of attention? Further evidence from a face short-term memory paradigm. Neuroimage 35:353-367.
36. McCarthy G, Puce A, Constable RT, Krystal JH, Gore JC, Goldman-Rakic P (1996): Activation of human prefrontal cortex during spatial and nonspatial working memory tasks measured by functional MRI. Cereb Cortex 6:600-611.
37. Melcher D, Piazza M (2011): The role of attentional priority and saliency in determining capacity limits in enumeration and visual working memory. Plos One 6:e29296.
38. Nardo D, Santangelo V, Macaluso E (2011): Stimulus-driven orienting of visuo-spatial attention in complex dynamic environments. Neuron 69:1015-1028.
39. Natale E, Marzi CA, Macaluso E (2009): FMRI correlates of visuo-spatial re-orienting investigated with an attention shifting double-cue paradigm. Hum Brain Mapp 30:2367-2381.
40. Nobre AC, Coull JT, Frith CD, Mesulam MM (1999): Orbitofrontal cortex is activated during breaches of expectation in tasks of visual attention. Nat Neurosci 2:11-12.
41. Oliva A, Torralba A (2007): The role of context in object recognition. Trends Cogn Sci 11:520-527.
42. Peelen MV, Kastner S (2014): Attention in the real world: toward understanding its neural basis. Trends Cogn Sci 18:242-250.
43. Pezdek K, Whetstone T, Reynolds K, Askari N, Dougherty T (1989): Memory for real-world scenes: The role of consistency with schema expectation. J Exp Psychol Learn Mem Cogn 15:587-595.
44. Pinker S (2007): The Stuff of Thought: Language as a Window onto Human Nature. New York: Viking Press.
45. Pooresmaeili A, Bach DR, Dolan RL (2014): The effect of visual salience on memory-based choices. J Neurophysiol 111:481-487.
46. Preston TJ, Guo F, Das K, Giesbrecht B, Eckstein MP (2013): Neural representation of contextual guidance in visual search of real-world scenes. J Neurosci 33:7846-7855.
47. Remy F, Vayssiere N, Pins D, Boucart M, Fabre-Thorpe M (2014): Incongruent object/context relationship in visual scenes: Where are they processed in the brain? Brain Cogn 84:34-43.
48. Santangelo V, Macaluso E (2013): Visual salience improves spatial working memory via enhanced parieto-temporal functional connectivity. J Neurosci 33:4110-4117.
49. Santangelo V, Olivetti Belardinelli M, Spence C, Macaluso E (2009): Interactions between voluntary and stimulus-driven spatial attention mechanisms across sensory modalities. J Cogn Neurosci 21:2384-2397.
50. Schmidt BK, Vogel EK, Woodman GF, Luck SJ (2002): Voluntary and automatic attentional control of visual working memory. Percept Psychophys 64:754-763.
51. Serences JT, Shomstein S, Leber AB, Golay X, Egeth HE, Yantis S (2005): Coordination of voluntary and stimulus-driven attentional control in human cortex. Psychol Sci 16:114-122.
52. Serences JT, Yantis S (2007): Spatially selective representations of voluntary and stimulus-driven attentional priority in human occipital, parietal, and frontal cortex. Cereb Cortex 17:284-293.
53. Shulman GL, Astafiev SV, McAvoy MP, d'Avossa G, Corbetta M (2007): Right TPJ deactivation during visual search: functional significance and support for a filter hypothesis. Cereb Cortex 17:2625-2633.
54. Shulman GL, McAvoy MP, Cowan MC, Astafiev SV, Tansy AP, d'Avossa G, Corbetta M (2003): Quantitative analysis of attention and detection signals during visual search. J Neurophysiol 90:3384-3397.
55. Silva MM, Groeger JA, Bradshaw MF (2004): Attention-memory interactions in scene perception. Spat Vis 19:9-19.
56. Spotorno S, Tatler BW, Faure S (2013): Semantic versus perceptual salience in visual scenes: Findings from change detection. Acta Psychol 142:168-176.
57. Stirk JA, Underwood G (2007): Low-level visual saliency does not predict change detection in natural scenes. J Vis 7:1-10.
58. Todd JJ, Marois R (2004): Capacity limit of visual short-term memory in human posterior parietal cortex. Nature 428:751-754.
59. Torralba A, Oliva A, Castelhano MS, Henderson JM (2006): Contextual guidance of eye movements and attention in real-world scenes: The role of global features in object search. Psychol Rev 113:766-786.
60. Weidner R, Krummenacher J, Reimann B, Muller HJ, Fink GR (2008): Sources of top-down control in visual search. J Cogn Neurosci 21:2100-2113.
61. Wojciulik E, Kanwisher N (1999): The generality of parietal involvement in visual attention. Neuron 23:747-764.
62. Wolfe JM (1994): Guided search 2.0. A revised model of visual search. Psychon Bull Rev 1:202-228.
63. Wolfe JM, Horowitz TS (2004): What attributes guide the deployment of visual attention and how do they do it? Nat Rev Neurosci 5:495-501.
64. Wolfe JM, Võ ML, Evans KK, Greene MR (2011): Visual search in scenes involves selective and non-selective pathways. Trends Cogn Sci 15:77-84.
65. Xu Y, Chun MM (2006): Dissociable neural mechanisms supporting visual short-term memory for objects. Nature 440:91-95.
66. Yoshida M, Itti L, Berg DJ, Ikeda T, Kato R, Takaura K, White BJ, Munoz DP, Isa T (2012): Residual attention guidance in blind sight monkeys watching complex natural scenes. Curr Biol 22:1429-1434.