Cross-Modal Decoding of Neural Patterns Associated with Working Memory: Evidence for Attention-Based Accounts of Working Memory

Cerebral Cortex

Volumn 26, Issue 1, 2016, Pages 166-179

  Majerus, Steve ^a,b   Cowan, Nelson ^c   Péters, Frédéric ^a   Van Calster, Laurens ^a   Phillips, Christophe ^a,b   Schrouff, Jessica ^a,d  

^a UNIVERSITY OF LIÈGE   (Belgium)

^b FUND FOR SCIENTIFIC RESEARCH   (Belgium)

^c UNIVERSITY OF MISSOURI   (United States)

^d STANFORD UNIVERSITY   (United States)

Author keywords

attention; fMRI; intraparietal sulcus; multivariate voxel pattern analysis; verbal; visual; working memory

Indexed keywords

ADULT; ARTICLE; ATTENTION; BRAIN CORTEX; BRAIN REGION; DORSAL ATTENTION NETWORK; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; INTRAPARIETAL SULCUS; MALE; NERVE CELL NETWORK; NORMAL HUMAN; PRIORITY JOURNAL; RECOGNITION; TASK PERFORMANCE; VISUAL INFORMATION; WORKING MEMORY; ADOLESCENT; BRAIN MAPPING; COGNITION; LEARNING; PHYSIOLOGY; PSYCHOMOTOR PERFORMANCE; SHORT TERM MEMORY; VISION; YOUNG ADULT;

ADOLESCENT; ADULT; ATTENTION; BRAIN MAPPING; CEREBRAL CORTEX; COGNITION; FEMALE; HUMANS; MALE; MEMORY, SHORT-TERM; PSYCHOMOTOR PERFORMANCE; VERBAL LEARNING; VISUAL PERCEPTION; YOUNG ADULT;

EID: 84959902345     PISSN: 10473211     EISSN: 14602199     Source Type: Journal    
DOI: 10.1093/cercor/bhu189     Document Type: Article

References (81)

1. Anderson DE, Vogel EK, Awh E. 2013. A common discrete resource for visual working memory and visual search. Psycholog Sci. 24: 929-938.
2. Anderson JS, Ferguson MA, Lopez-Larson M, Yurgelun-Todd D. 2010. Topographic maps of multisensory attention. PNAS. 107: 20110-20114.
3. Andersson JL, Hutton C, Ashburner J, Turner R, Friston K. 2001. Modeling geometric deformations in EPI time series. NeuroImage. 13: 903-919.
4. Asplund CL, Todd JJ, Snyder AP, Marois R. 2010. A central role for the lateral prefrontal cortex in goal directed and stimulus-driven attention. Nat Neurosci. 13: 507-512.
5. Baddeley AD. 1986. Working Memory. Oxford, UK: Oxford University Press.
6. Beck VM, Hollingworth A, Luck SJ. 2012. Simultaneous control of attention by multiple working memory representations. Psychol Sci. 23: 887-898.
7. Brahmbhatt SB, McAuley T, Barch DM. 2008. Functional developmental similarities and differences in the neural correlates of verbal and nonverbal workingmemory tasks. Neuropsychologia. 46: 1020-1031.
8. Buckner RL, Andrews-Hanna JR, Schacter DL. 2008. The brain's default network: Anatomy, function, and relevance to disease. The Year in Cognitive Neuroscience. Ann N Y Acad Sci. 1124: 1-38.
9. Burges CJC. 1998. A tutorial on support vector machines for pattern recognition. Boston: Kluwer Academic Publishers.
10. Camos V, Mora G, Oberauer K. 2011. Adaptive choice between articulatory rehearsal and attentional refreshing in verbal working memory. Mem Cognit. 39: 231-244.
11. Chein JM, Moore AB, Conway ARA. 2011. Domain-general mechanisms of complex working memory span. NeuroImage. 54: 550-559.
12. Conrad R. 1964. Acoustic confusion in immediate memory. Br J Psychol. 55: 75-84.
13. Conrad R, Hull AJ. 1964. Information, acoustic confusion and memory span. Br J Psychol. 55: 429-432.
14. Corbetta M, Shulman GL. 2002. Control of goal-directed and stimulusdriven attention in the brain. Nat Rev Neurosci. 3: 201-215.
15. Cowan N. 1995. Attention and Memory: An Integrated Framework. New York: Oxford University Press.
16. Cowan N. 2001. The magical number 4 in short-term memory: A reconsideration of mental storage capacity. Behav Brain Sci. 24: 87-185.
17. Cowan N, Elliott EM, Saults JS, Morey CC, Mattox S, Hismjatullina A, Conway ARA. 2005. On the capacity of attention: Its estimation and its role in working memory and cognitive aptitudes. Cognit Psychol. 51: 42-100.
18. Cowan N, Fristoe NM, Elliott EM, Brunner RP, Saults JS. 2006. Scope of attention, control of attention, and intelligence in children and adults. Mem Cognit. 34: 1754-1768.
19. Cowan N, Li D, Moffitt A, Becker TM, Martin EA, Saults JS, Christ SE. 2011. A neural region of abstract working memory. J Cognit Neurosci. 23: 2852-2863.
20. Cowan N, Morey CC. 2007. How can dual-task working memory retention limits be investigated? Psychol Sci. 18: 686-688.
21. Dumontheil I, Thompson R, Duncan J. 2011. Assembly and use of new task rules in the frontoparietal cortex. J Cognit Neurosci. 23: 168-182.
22. Duncan J. 2013. The structure of cognition: Attentional episodes in mind and brain. Neuron. 80: 35-50.
23. Emrich S, Riggall AC, LaRocque JJ, Postle BR. 2013. Distributed patterns of activity in sensory cortex reflect the precision of multiple items maintained in visual short-term memory. J Neurosci. 33: 6516-6523.
24. Farrer C, Frith CD. 2002. Experiencing oneself versus another person as being the case of an action: The neural correlates of the experience of agency. Neuroimage. 15: 596-603.
25. Fedorenko E, Duncan J, Kanwisher N. 2013. Broad domain generality in focal regions of frontal and parietal cortex. PNAS. doi: 10. 1073/ pnas. 1315235110.
26. Fias W, Lammertyn J, Caessens B, Orban GA. 2007. Processing of abstract ordinal knowledge in the horizontal segment of the intraparietal sulcus. J Neurosci. 27: 8592-8596.
27. Fuster JM. 1999. Memory in the Cerebral Cortex: An Empirical Approach to Neural Networks in the Human and Nonhuman Primate. Cambridge, MA: MIT Press. 372 p.
28. Gazzaley A, Nobre AC. 2012. Top-down modulation: bridging selective attention and working memory. Trends Cogn Sci. 16: 129-135.
29. Green S, Soto D. 2014. Functional connectivity between ventral and dorsal frontoparietal networks underlies stimulus-driven and working memory-driven sources of visual distraction. NeuroImage. 84: 290-298.
30. Hautzel H, Mottaghy FM, Schmidt D, Zemb M, Shah NJ, Müller-Gärtner H-W, Krause BJ. 2002. Topographic segregation and convergence of verbal, object, shape and spatial working memory in humans. Neurosci Lett. 323: 156-160.
31. Henson RNA, Burgess H, Frith CD. 2000. Recoding, storage, rehearsal and grouping in verbal short-term memory: An fMRI study. Neuropsychologia. 38: 426-440.
32. Hutton C, Bork A, Josephs O, Deichmann R, Ashburner J, Turner R. 2002. Image distortion correction in fMRI: A quantitative evaluation. NeuroImage. 16: 217-240.
33. Johnston SJ, Linden DE, Shapiro KL. 2012. Functional imaging reveals working memory and attention interact to produce the attentional blink. J Cogn Neurosci. 24: 28-38.
34. Kelley TA, Lavie N. 2011. Working memory load modulates distractor competition in primary visual cortex. Cereb Cortex. 21: 659-665.
35. Kuo BC, Stokes MG, Nobre AC. 2012. Attention modulates maintenance of representations in visual short-term memory. J Cogn Neurosci. 24: 51-60.
36. LaRocque JJ, Lewis-Peacock JA, Drysdale AT, Oberauer K, Postle BR. 2013. Decoding attended information in short-term memory: An EEG Study. J Cogn Neurosci. 25: 127-142.
37. Lavie N. 2005. Distracted and confused? Selective attention under load. Trends Cogn Sci. 9: 75-82.
38. Lavie N, Hirst A, De Fockert JW, Viding E. 2004. Load theory of selective attention and cognitive control. J Exp Psychol Gen. 133: 339-354.
39. Lee W, Reeve J, Xue Y, Xiong J. 2012. Neural differences between intrinsic reasons for doing versus extrinsic reasons for doing: An fMRI study. Neurosci Res. 73: 68-72.
40. Lewis-Peacock JA, Drysdale AT, Oberauer K, Postle BR. 2012. Neural evidence for a distinction between short-term memory and the focus of attention. J Cogn Neurosci. 24: 61-79.
41. Lewis-Peacock JA, Postle BR. 2012. Decoding the internal focus of attention. Neuropsychologia. 50: 470-478.
42. Logie RH, Della Sala S, Wynn V, Baddeley A. 2000. Visual similarity effects in immediate verbal serial recall. Q J Exp Psychol. 53A: 626-646.
43. Luck SJ, Vogel EK. 1997. The capacity of visual working memory for features and conjunctions. Nature. 390: 279-281.
44. Lycke C, Specht K, Ersland L, Hugdahl K. 2008. An fMRI study of phonological and spatial working memory using identical stimuli. Scand J Psychol. 49: 393-401.
45. Majerus S, Attout L, D'Argembeau A, Degueldre C, Fias W, Maquet P, Martinez Perez T, Stawarczyk D, Salmon E, Van der Linden M et al. 2012. Attention supports verbal short-term memory via competition between dorsal and ventral attention networks. Cereb Cortex. 22: 1086-1097.
46. Majerus S, D'Argembeau A, Martinez T, Belayachi S, Van der Linden M, Collette F, Salmon E, Seurinck R, Fias W, Maquet P. 2010. The commonality of neural networks for verbal and visual short-term memory. J Cogn Neurosci. 22: 2570-2593.
47. Majerus S, Salmon E, Attout L. 2013. The importance of encoding-related neural dynamics in the prediction of inter-individual differences in verbal working memory performance. PLoS ONE. 8: e69278.
48. Martín-Loeches M, Schweinberger SR, Sommer W. 1998. The phonological similarity effect in working memory: An ERP study comparing auditory and visual input modalities. J Psychophysiol. 12: 144-158.
49. McCandliss BD, Cohen L, Dehaene S. 2003. The visual word form area: expertise for reading in the fusiform gyrus. Trends Cogn Sci. 7: 293-299.
50. Mikl M, Marecek R, Hlustik P, Pavlicova M, Drastich A, Chlebus P, Brazdil M, Krupa P. 2008. Effects of spatial smoothing on fMRI group inferences. Magn Reson Imaging. 26: 490-503.
51. Morey CC, Bieler M. 2013. Visual short-term memory always requires attention. Psychon Bull Rev. 20: 163-170.
52. Morey CC, Cowan N. 2004. When visual and verbal memories compete: evidence of cross-domain limits in working memory. Psychon Bull Rev. 11: 296-301.
53. Morey CC, Cowan N, Morey RD, Rouder JN. 2011. Flexible attention allocation to visual and auditory working memory tasks: manipulating reward induces a tradeoff. Atten Percept Psychophys. 73: 458-472.
54. Morrison AB, Conway ARA, Chein JM. 2014. Primacy and recency effects as indices of the focus of attention. Front Hum Neurosci. 8: doi: 10. 3389/fnhum. 2014. 00006.
55. Nee DE, Jonides J. 2011. Dissociable contributions of prefrontal cortex and the hippocampus to short-term memory: evidence for a 3-state model of memory. NeuroImage. 54: 1540-1548.
56. Nee DE, Jonides J. 2008. Neural correlates of access to short-term memory. PNAS. 105: 14228-14233.
57. Nystrom LE, Braver TS, Sabb FW, Delgado MR, Noll DC, Cohen JD. 2000. Working memory for letters, shapes, and locations: fMRI evidence against stimulus-based regional organization in human prefrontal cortex. NeuroImage. 11: 424-446.
58. Ötzekin I, Davachi L, McElree B. 2010. Are representations in working memory distinct from representations in long-term memory?: Neural evidence in support of a single store. Psychol Sci. 21: 1123-1133.
59. Ötzekin I, McElree B, Staresina BP, Davachi L. 2009. Working memory retrieval: contributions of the left prefrontal cortex, the left posterior parietal cortex, and the hippocampus. J Cognit Neurosci. 21: 581-593.
60. Pessoa L, Gutierrez E, Bandettini PA, Ungerleider L. 2002. Neural correlates of visual working memory: fMRI amplitude predicts task performance. Neuron. 35: 975-987.
61. Rahm B, Kaiser J, Unterrainer JM, Simon J, Bledowski C. 2014. fMRI characterization of visual working memory recognition. Neuro-Image. 90: 413-422.
62. Rämä P, Sala JB, Gillen JS, Pekar JJ, Courtney SM. 2001. Dissociation of the neural systems for working memory maintenance of verbal and nonspatial visual information. Cogn Affect Behav Neurosci. 1: 161-171.
63. Ravizza SM, Delgado MR, Chein JM, Becker JT, Fiez JA. 2004. Functional dissociations within the inferior parietal cortex in verbal working memory. NeuroImage. 22: 562-573.
64. Raye CL, Johnson MK, Mitchell KJ, Greene EJ, Johnson MR. 2007. Refreshing: A minimal executive function. Cortex. 43: 135-145.
65. Riggall AC, Postle BR. 2012. The relationship between working memory storage and elevated activity as measured with functional magnetic resonance imaging. J Neurosci. 32: 12990-12998.
66. Rodriguez-Jimenez R, Avila C, Garcia-Navarro C, Bagney A, Martinez de Aragon A, Ventura-Campos N, Martinez-Gras I, Forn C, Ponce G, Rubio G et al. 2005. Differential dorsolateral prefrontal cortex activation during a verbal n-back task according to sensory modality. Behav Brain Res. 205: 299-302.
67. Roelofs A, van Turennout M, Coles MGH. 2006. Anterior cingulate cortex activity can be independent of response conflict in Strooplike tasks. PNAS. 103: 13884-13889.
68. Saults JS, Cowan N. 2007. A central capacity limit to the simultaneous storage of visual and auditory arrays in working memory. J Exp Psychol Gen. 136: 663-684.
69. Schnur TT, Schwartz MF, Kimberg DY, Hirshorn E, Coslett HB, Thompson-Schill SL. 2009. Localizing interference during naming: convergent neuroimaging and neuropsychological evidence for the function of Broca's area. PNAS. 106: 322-307.
70. Schrouff J, Kussé C, Wehenkel L, Maquet P, Phillips C. 2012. Decoding semi-constrained brain activity from fmri using support vector machines and gaussian processes. PLoS ONE. 7: e35860.
71. Schrouff J, Rosa MJ, Rondina JM, Marquand MF, Chu C, Ashburner J, Phillips C, Richiardi J, Mourão-Miranda J. 2013. PRoNTo: Pattern recognition for neuroimaging toolbox. Neuroinformatics. 11: 319-337.
72. Sternberg S. 1966. High-speed scanning in human memory. Science. 153: 652-654.
73. Stevanovski B, Jolicoeur P. 2007. Visual short-term memory: central capacity limitations in short-term consolidation. Visual Cogn. 15: 532-563.
74. Stroop JR. 1935. Studies of interference in serial verbal reactions. J Exp Psychol. 18: 643-662.
75. Talmi D, Grady CL, Goshen-Gottstein Y, Moscovitch M. 2005. Neuroimaging the serial position curve: An fMRI test of the single-process vs. The dual process (STM-LTM) model of the primacy and recency effects. Psychol Sci. 16: 716-723.
76. Thompson-Schill SL, Jonides J, Marshuetz C, Smith EE, D'Esposito M, Kan IP, Knight RT, Swick D. 2002. Effects of frontal lobe damage on interference effects in working memory. Cogn Affect Behav Neurosci. 2: 109-120.
77. Todd JJ, Fougnie D, Marois R. 2005. Visual short-term memory load suppresses temporo-parietal junction activity and induces inattentional blindness. Psychol Sci. 16: 965-972.
78. Todd JJ, Marois R. 2004. Capacity limit of visual short-term memory in human posterior parietal cortex. Nature. 428: 751-754.
79. Van Essen DC, Dickson J, Harwell J, Hanlon D, Anderson CH, Drury HA. 2001. An integrated software system for surface-based analyses of cerebral cortex. J Am Med Inform Assoc. 8: 443-459.
80. Xu Y, Chun MM. 2006. Dissociable neural mechanisms supporting visual short-term memory for objects. Nature. 440: 91-95.
81. Zorzi M, Di Bono MG, Fias W. 2011. Distinct representations of numerical and non-numerical order in the human intraparietal sulcus revealed bymultivariate pattern recognition. NeuroImage. 56: 674-680.