The neural correlates of visual working memory encoding: A time-resolved fMRI study

Neuropsychologia

Volumn 49, Issue 6, 2011, Pages 1527-1536

  Todd, J Jay ^a   Han, Suk Won ^b   Harrison, Stephenie ^b   Marois, René ^b  

^a EXPONENT INC   (United States)

^b VANDERBILT UNIVERSITY   (United States)

Author keywords

Attention; Encoding; FMRI; Inferior frontal junction; Prefrontal cortex; Working memory

Indexed keywords

ADULT; ARTICLE; ATTENTIONAL BLINK; BRAIN REGION; CONSCIOUSNESS; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; INFERIOR FRONTAL GYRUS; MALE; MEMORY CONSOLIDATION; NORMAL HUMAN; PREFRONTAL CORTEX; STIMULUS RESPONSE; TASK PERFORMANCE; VISUAL MEMORY; WORKING MEMORY;

ADOLESCENT; ADULT; ANALYSIS OF VARIANCE; BRAIN MAPPING; CEREBRAL CORTEX; COLOR PERCEPTION; EVOKED POTENTIALS; FACE; FEMALE; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; MEMORY, SHORT-TERM; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; REACTION TIME; REFERENCE VALUES; RETENTION (PSYCHOLOGY); TIME FACTORS; VISUAL PERCEPTION; YOUNG ADULT;

EID: 79955839781     PISSN: 00283932     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuropsychologia.2011.01.040     Document Type: Article

References (105)

1. Akyürek E.G., Hommel B. Short-term memory and the attentional blink: Capacity versus content. Memory & Cognition 2005, 33(4):654-663.
2. Akyürek E.G., Hommel B., Jolicœur P. Direct evidence for a role of working memory in the attentional blink. Memory & Cognition 2007, 35(4):621-627.
3. Alvarez G.A., Cavanagh P. The capacity of visual short-term memory is set both by visual information load and by number of objects. Psychological Science 2004, 15(2):106-111.
4. Andersen R.A., Essick G.K., Siegel R.M. Encoding of spatial location by posterior parietal neurons. Science 1985, 230(4724):456-458.
5. Asplund C.L., Todd J.J., Snyder A.P., Marois R. A central role for the lateral prefrontal cortex in goal-directed and stimulus-driven attention. Nature Neuroscience 2010, 13(4):507-512.
6. Awh E., Barton B., Vogel E.K. Visual working memory represents a fixed number of items regardless of complexity. Psychological Science 2007, 18(7):622-628.
7. Awh E., Jonides J., Reuter-Lorenz P.A. Rehearsal in spatial working memory. Journal of Experimental Psychology: Human Perception & Performance 1998, 24(3):780-790.
8. Baddeley A. Working memory. Science 1992, 255:556-559. 5044.
9. Baddeley A.D., Logie R. Working memory: The multiple component model. Models of working memory: Mechanisms of active maintenance .and executive control 1999, 28-61. Cambridge University Press, New York. A. Miyake, P. Shah (Eds.).
10. Bisley J.W., Goldberg M.E. Neuronal activity in the lateral intraparietal area and spatial attention. Science 2003, 299(5603):81-86.
11. Boynton G.M., Engel S.A., Glover G.H., Heeger D.J. Linear systems analysis of. functional magnetic resonance imaging in human V1. Journal of Neuroscience 1996, 16(13):4207-4221.
12. Brass M., Derrfuss J., Forstmann B., von Cramon D.Y. The role of the inferior frontal junction area in cognitive control. Trends in Cognitive Sciences 2005, 9(7):314-316.
13. Brass M., von Cramon D.Y. Decomposing components of task preparation with functional magnetic resonance imaging. Journal of Cognitive Neuroscience 2004, 16(4):609-620.
14. Braver T.S., Barch D.M., Kelley W.M., Buckner R.L., Cohen N.J., Miezin F.M., et al. Direct comparison of prefrontal cortex regions engaged by working and long-term memory tasks. NeuroImage 2001, 14(1 (Pt 1)):48-59.
15. Bunge S.A. How we use rules to select actions: A review of evidence from cognitive neuroscience. Cognitive, Affective & Behavioral Neuroscience 2004, 4(4):564-579.
16. Bunge S.A., Kahn I., Wallis J.D., Miller E.K., Wagner A.D. Neural circuits subserving the retrieval and maintenance of abstract rules. Journal of Neurophysiology 2003, 90(5):3419-3428.
17. Chun M.M., Potter M.C. A two-stage model for multiple target detection in rapid serial visual presentation. Journal of Experimental Psychology: Human Perception and Performance 1995, 21:109-127.
18. Clark V.P., Parasuraman R., Keil K., Kulansky R., Fannon S., Maisog J.M., et al. Selective attention to face identity and color studied with fMRI. Human Brain Mapping 1997, 5(4):293-297.
19. Colby C.L., Duhamel J.R., Goldberg M.E. Visual, presaccadic, and cognitive activation of single neurons in monkey lateral intraparietal area. Journal of Neurophysiology 1996, 76(5):2841-2852.
20. Cooper A.C., Humphreys G.W., Hulleman J., Praamstra P., Georgeson M. Transcranial magnetic stimulation to right parietal cortex modifies the attentional blink. Experimental Brain Research 2004, 155(1):24-29.
21. Corbetta M., Kincade J.M., Shulman G.L. Neural systems for visual orienting and their relationships to spatial working memory. Journal of Cognitive Neuroscience 2002, 14(3):508-523.
22. Corbetta M., Miezin F.M., Dobmeyer S., Shulman G.L., Petersen S.E. Selective and divided attention during visual discriminations of shape, color, and speed: Functional anatomy by positron emission tomography. Journal of Neuroscience 1991, 11(8):2383-2402.
23. Courtney S.M, Ungerleider L.G., Keil K., Haxby J.V. Transient and sustained activity in a distributed neural system for human working memory. Nature 1997, 386(6625):608-611.
24. Cowan N. The magical number 4 in short-term memory: A reconsideration of mental storage capacity. Behavioral and Brain Sciences 2001, 24(1):87-185.
25. Curby K.M., Gauthier I. A visual short-term memory advantage for faces. Psychonomic Bulletin & Review 2007, 14(4):620-628.
26. Curtis C.E., D'Esposito M. Persistent activity in the prefrontal cortex during working memory. Trends in Cognitive Science 2003, 7(9):415-423.
27. D'Esposito M., Postle B.R., Jonides J., Smith E.E. The neural substrate and temporal dynamics of interference effects in working memory as revealed by event-related functional MRI. Proceedings of the National Academy of Sciences of the United States of America 1999, 96(13):7514-7519.
28. de Fockert J.W., Rees G., Frith C.D., Lavie N. The role of working memory in visual selective attention. Science 2001, 291(5509):1803-1806.
29. Derrfuss J., Brass M., von Cramon D.Y. Cognitive control in the posterior frontolateral cortex: Evidence from common activations in task coordination, interference control, and working memory. NeuroImage 2004, 23(2):604-612.
30. Di Lollo V., Kawahara J., Shahab Ghorashi S.M., Enns J.T. The attentional blink: Resource depletion or temporary loss of control?. Psychological Research 2005, 69(3):191-200.
31. Downing P.E. Interactions between visual working memory and selective attention. Psychological Science 2000, 11(6):467-473.
32. Druzgal T.J., D'Esposito M. Dissecting contributions of prefrontal cortex and fusiform face area to face working memory. Journal of Cognitive Neuroscience 2003, 15(6):771-784.
33. Dux P.E., Ivanoff J., Asplund C.L., Marois R. Isolation of a central bottleneck of information processing with time-resolved FMRI. Neuron 2006, 52(6):1109-1120.
34. Dux P.E., Marois R. The attentional blink: A review of data and theory. Attention, Perception & Psychophysics 2009, 71(8):1683-1700.
35. Dux P.E., Tombu M.N., Harrison S., Rogers B.P., Tong F., Marois R. Training improves multitasking performance by increasing the speed of information processing in human prefrontal cortex. Neuron 2009, 63(1):127-138.
36. Eng H.Y., Chen D., Jiang Y. Visual working memory for simple and complex visual stimuli. Psychonomic Bulletin & Review 2005, 12(6):1127-1133.
37. Feinstein J.S., Stein M.B., Castillo G.N., Paulus M.P. From sensory processes to conscious perception. Consciousness and Cognition 2004, 13(2):323-335.
38. Formisano E., Goebel R. Tracking cognitive processes with functional MRI mental chronometry. Current Opinion in Neurobiology 2003, 13(2):174-181.
39. Fougnie D., Marois R. Distinct capacity limits for attention and working memory: Evidence from attentive tracking and visual working memory paradigms. Psychological Science 2006, 17(6):526-534.
40. Funahashi S., Bruce C.J., Goldman-Rakic P.S. Mnemonic coding of visual space. in the monkey's dorsolateral prefrontal cortex. Journal of Neurophysiology 1989, 61(2):331-349.
41. Gauthier I., Skudlarski P., Gore J.C., Anderson A.W. Expertise for cars and birds recruits brain areas involved in face recognition. Nature Neuroscience 2000, 3(2):191-197.
42. Gottlieb J.P., Kusunoki M., Goldberg M.E. The representation of visual salience in monkey parietal cortex. Nature 1998, 391(6666):481-484.
43. Grodzinsky Y., Santi A. The battle for Broca's region. Trends in Cognitive Sciences 2008, 12(12):474-480.
44. Gross J., Schmitz F., Schnitzler I., Kessler K., Shapiro K., Hommel B., et al. Modulation of long-range neural synchrony reflects temporal limitations of visual attention in humans. Proceedings of the National Academy of Sciences of the United States of America 2004, 101(35):13050-13055.
45. Hannula D.E., Simons D.J., Cohen N.J. Imaging implicit perception: Promise and pitfalls. Nature Reviews Neuroscience 2005, 6(3):247-255.
46. Haxby J.V., Petit L., Ungerleider L.G., Courtney S.M. Distinguishing the functional roles of multiple regions in distributed neural systems for visual working memory. NeuroImage 2000, 11(2):145-156.
47. Haxby J.V., Ungerleider L.G., Horwitz B., Maisog J.M., Rapoport S.I., Grady C.L. Face encoding and recognition in the human brain. Proceedings of the National Academy of Sciences of the United States of America 1996, 93(2):922-927.
48. Haynes J.D., Rees G. Predicting the orientation of invisible stimuli from activity in human primary visual cortex. Nature Neuroscience 2005, 8(5):686-691.
49. Hein G., Alink A., Kleinschmidt A., Müller N.G. The attentional blink modulates activity in the early visual cortex. Journal of Cognitive Neuroscience 2009, 21(1):197-206.
50. Henson R.N., Price C.J., Rugg M.D., Turner R., Friston K.J. Detecting latency differences in event-related BOLD responses: Application to words versus nonwords and initial versus repeated face presentations. NeuroImage 2002, 15(1):83-97.
51. Jolicœur P. Modulation of the attentional blink by on-line response selection: Evidence from speeded and unspeeded task1 decisions. Memory & Cognition 1998, 26(5):1014-1032.
52. Jolicœur P., Dell'Acqua R. The demonstration of short-term consolidation. Cognitive Psychology 1998, 36(2):138-202.
53. Kamitani Y., Tong F. Decoding the visual and subjective contents of the human brain. Nature Neuroscience 2005, 8(5):679-685.
54. Kanwisher N., McDermott J., Chun M.M. The fusiform face area: A module in human extrastriate cortex specialized for face perception. Journal of Neuroscience 1997, 17(11):4302-4311.
55. Kastner S., Ungerleider L.G. Mechanisms of visual attention in the human cortex. Annual Review of Neuroscience 2000, 23:315-341.
56. Kessler K., Schmitz F., Gross J., Hommel B., Shapiro K., Schnitzler A. Target consolidation under high temporal processing demands as revealed by MEG. NeuroImage 2005, 26(4):1030-1041.
57. Kihara K., Hirose N., Mima T., Abe M., Fukuyama H., Osaka N. The role of left and right intraparietal sulcus in the attentional blink: A transcranial magnetic stimulation study. Experimental Brain Research 2007, 178(1):135-140.
58. Kourtzi Z., Kanwisher N. Representation of perceived object shape by the human lateral occipital complex. Science 2001, 293(5534):1506-1509.
59. Kranczioch C., Debener S., Maye A., Engel A.K. Temporal dynamics of access to consciousness in the attentional blink. NeuroImage 2007, 37(3):947-955.
60. Kranczioch C., Debener S., Schwarzbach J., Goebel R., Engel A.K. Neural correlates of conscious perception in the attentional blink. NeuroImage 2005, 24(3):704-714.
61. Kriegeskorte N., Simmons W.K., Bellgowan P.S., Baker C.I. Circular analysis in systems neuroscience: The dangers of double dipping. Nature Neuroscience 2009, 12(5):535-540.
62. LaBar K.S., Gitelman D.R., Parrish T.B., Mesulam M. Neuroanatomic overlap of working memory and spatial attention networks: A functional MRI comparison within subjects. NeuroImage 1999, 10(6):695-704.
63. Liao C.H., Worsley K.J., Poline J.B., Aston J.A., Duncan G.H., Evans A.C. Estimating the delay of the fMRI response. NeuroImage 2002, 16(3 (Pt 1)):593-606.
64. Linden D.E., Bittner R.A., Muckli L., Waltz J.A., Kriegeskorte N., Goebel R., et al. Cortical capacity constraints for visual working memory: Dissociation of fMRI load effects in a fronto-parietal network. NeuroImage 2003, 20(3):1518-1530.
65. Luck S.J., Hollingworth A. Visual memory 2008, Oxford University Press, New York.
66. Luck S.J., Vogel E.K. The capacity of visual working memory for features and conjunctions. Nature 1997, 390(6657):279-281.
67. Majerus S., Bastin C., Poncelet M., Van der Linden M., Salmon E., Collette F., et al. Short-term memory and the left intraparietal sulcus: Focus of attention? Further evidence from a face short-term memory paradigm. NeuroImage 2007, 35(1):353-367.
68. Marcantoni W.S., Lepage M., Beaudoin G., Bourgouin P., Richer F. Neural correlates of dual task interference in rapid visual streams: An fMRI study. Brain and Cognition 2003, 53(2):318-321.
69. Marois R., Chun M.M., Gore J.C. Neural correlates of the attentional blink. Neuron 2000, 28:299-308.
70. Marois R., Yi D.J., Chun M.M. The neural fate of consciously perceived and missed events in the attentional blink. Neuron 2004, 41(3):465-472.
71. Martens S., Munneke J., Smid H., Johnson A. Quick minds don't blink: Electrophysiological correlates of individual differences in attentional selection. Journal of Cognitive Neuroscience 2006, 18(9):1423-1438.
72. Mayer J.S., Bittner R.A., Nikolić D., Bledowski C., Goebel R., Linden D.E.J. Common neural substrates for visual working memory and attention. NeuroImage 2007, 36(2):441-453.
73. McCarthy G., Puce A., Gore J.C., Allison T. Face-specific processing in the human fusiform gyrus. Journal of Cognitive Neuroscience 1997, 9(5):605-610.
74. Miezin F.M., Maccotta L., Ollinger J.M., Petersen S.E., Buckner R.L. Characterizing the hemodynamic response: Effects of presentation rate, sampling procedure, and the possibility of ordering brain activity based on relative timing. NeuroImage 2000, 11(6 (Pt 1)):735-759.
75. Miller B.T., Deouell L.Y., Dam C., Knight R.T., D'Esposito M. Spatio-temporal dynamics of neural mechanisms underlying component operations in working memory. Brain Research 2008, 1206:61-75.
76. Miller E.K., Erickson C.A., Desimone R. Neural mechanisms of visual working. memory in prefrontal cortex of the macaque. Journal of Neuroscience 1996, 16(16):5154-5167.
77. Motes M.A., Rypma B. Working memory component processes: Isolating BOLD signal changes. NeuroImage 2010, 49(2):1933-1941.
78. Munk M.H., Linden D.E., Muckli L., Lanfermann H., Zanella F.E., Singer W., et al. Distributed cortical systems in visual short-term memory revealed by event-related functional magnetic resonance imaging. Cerebral Cortex 2002, 12(8):866-876.
79. Nieuwenstein M.R., Potter M.C. Temporal limits of selection and memory encoding. Psychological Science 2006, 17(6):471-475.
80. Oh S., Kim M. The role of spatial working memory in visual search efficiency. Psychonomic Bulletin & Review 2004, 11(2):275-281.
81. Olivers C.N., van der Stigchel S., Hulleman J. Spreading the sparing: Against a limited-capacity account of the attentional blink. Psychological Research 2007, 71(2):126-139.
82. Ouimet C., Jolicœur P. Beyond task 1 difficulty: The duration of T1 encoding modulates the attentional blink. Visual Cognition 2007, 15(3):290-304.
83. Pessoa L., Gutierrez E., Bandettini P., Ungerleider L. Neural correlates of visual working memory: fMRI amplitude predicts task performance. Neuron 2002, 35(5):975-987.
84. Petrides M. Frontal lobes and working memory: Evidence from investigations of the effects of cortical excisions in nonhuman primates. Handbook of neuropsychology 1994, 59-82. Elsevier, Amsterdam. J. Boller, J. Grafman (Eds.).
85. Petrides M. Specialized systems for the processing of mnemonic information within the primate frontal cortex. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences 1996, 351(1346):1455-1461.
86. Ploran E.J., Nelson S.M., Velanova K., Donaldson D.I., Petersen S.E., Wheeler M.E. Evidence accumulation and the moment of recognition: Dissociating perceptual recognition processes using fMRI. Journal of Neuroscience 2007, 27(44):11912-11924.
87. Postle B.R., Zarahn E., D'Esposito M. Using event-related fMRI to assess delay-period activity during performance of spatial and nonspatial working memory tasks. Brain Research. Brain Research Protocols 2000, 5(1):57-66.
88. Ranganath C., DeGutis J., D'Esposito M. Category-specific modulation of inferior temporal activity during working memory encoding and maintenance. Cognitive Brain Research 2004, 20(1):37-45.
89. Raymond J.E., Shapiro K.L., Arnell K.M. Temporary suppression of visual processing in an RSVP task: An attentional blink?. Journal of Experimental Psychology: Human Perception & Performance 1992, 18(3):849-860.
90. Rensink R.A. Visual search for change: A probe into the nature of attentional processing. Visual Cognition 2000, 7:345-376.
91. Roth J.K., Serences J.T., Courtney S.M. Neural system for controlling the contents of object working memory in humans. Cerebral Cortex 2006, 16(11):1595-1603.
92. Rypma B., D'Esposito M. The roles of prefrontal brain regions in components of working memory: Effects of memory load and individual differences. Proceedings of the National Academy of Sciences of the United States of America 1999, 96(11):6558-6563.
93. Sergent C., Baillet S., Dehaene S. Timing of the brain events underlying access to consciousness during the attentional blink. Nature Neuroscience 2005, 8(10):1391-1400.
94. Todd J.J., Marois R. Capacity limit of visual short-term memory in human posterior parietal cortex. Nature 2004, 428(6984):751-754.
95. Todd J.J., Marois R. Posterior parietal cortex activity predicts individual differences in visual short-term memory capacity. Cognitive, Affective, & Behavioral Neuroscience 2005, 5(2):144-155.
96. Vogel E.K., Woodman G.F., Luck S.J. Storage of features, conjunctions, and objects in visual working memory. Journal of Experimental Psychology: Human Perception and Performance 2001, 27(1):92-114.
97. Vogel E.K., Woodman G.F., Luck S.J. The time course of consolidation in visual working memory. Journal of Experimental Psychology: Human Perception and Performance 2006, 32(6):1436-1451.
98. Vul E., Harris C., Winkielman P., Pashler H. Puzzlingly high correlations in fMRI studies of emotion, personality, and social cognition. Perspectives on Psychological Science 2009, 4(3):274-290.
99. Wheeler M.E., Treisman A.M. Binding in short-term visual memory. Journal of Experimental Psychology: General 2002, 131(1):48-64.
100. Williams M.A., Visser T.A., Cunnington R., Mattingley J.B. Attenuation of neural responses in primary visual cortex during the attentional blink. Journal of Neuroscience 2008, 28(39):9890-9894.
101. Woodman G.F., Luck S.J. Visual search is slowed when visuospatial working memory is occupied. Psychonomic Bulletin & Review 2004, 11(2):269-274.
102. Woodman G.F., Vogel E.K. Fractionating working memory: Consolidation and maintenance are independent processes. Psychological Science 2005, 16(2):106-113.
103. Xu Y., Chun M.M. Dissociable neural mechanisms supporting visual short-term memory for objects. Nature 2006, 440(7080):91-95.
104. Zarahn E., Aguirre G., D'Esposito M. A trial-based experimental design for fMRI. NeuroImage 1997, 6(2):122-138.
105. Zeki S., Watson J.D., Lueck C.J., Friston K.J., Kennard C., Frackowiak R.S. A direct demonstration of functional specialization in human visual cortex. Journal of Neuroscience 1991, 11(3):641-649.