Integration of "what" and "where" in frontal cortex during visual imagery of scenes

NeuroImage

Volumn 60, Issue 1, 2012, Pages 47-58

  De Borst, Aline W ^a,b   Sack, Alexander T ^a   Jansma, Bernadette M ^a   Esposito, Fabrizio ^a,c   De Martino, Federico ^a   Valente, Giancarlo ^a   Roebroeck, Alard ^a   Di Salle, Francesco ^a,b   Goebel, Rainer ^a,d   Formisano, Elia ^a  

^a MAASTRICHT UNIVERSITY   (Netherlands)

^b UNIVERSITY OF PISA   (Italy)

^c UNIVERSITY OF NAPLES FEDERICO II   (Italy)

^d NETHERLANDS INSTITUTE FOR NEUROSCIENCE   (Netherlands)

Author keywords

EEG; FMRI; Frontal cortex; Mental imagery; Scenes

Indexed keywords

ADULT; ARTICLE; BETA RHYTHM; BRAIN MAPPING; BRAIN REGION; CALCARINE SULCUS; CONTROLLED STUDY; FEMALE; FRONTAL CORTEX; FUNCTIONAL MAGNETIC RESONANCE IMAGING; FUNCTIONAL NEUROIMAGING; HUMAN; HUMAN EXPERIMENT; IMAGERY; IMAGINATION; LATENT PERIOD; MALE; MENTAL TASK; NEUROANATOMY; NORMAL HUMAN; PARAHIPPOCAMPAL GYRUS; PARIETAL GYRUS; PRIORITY JOURNAL; RESPONSE TIME; SENSORY CORTEX; SUPERIOR FRONTAL GYRUS; TASK PERFORMANCE; THETA RHYTHM; VISUAL IMAGINATION;

ADOLESCENT; ADULT; ELECTROENCEPHALOGRAPHY; FEMALE; FRONTAL LOBE; FUNCTIONAL NEUROIMAGING; HUMANS; IMAGINATION; MAGNETIC RESONANCE IMAGING; MALE; YOUNG ADULT;

EID: 84856013438     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2011.12.005     Document Type: Article

References (85)

1. Alivisatos B., Petrides M. Functional activation of the human brain during mental rotation. Neuropsychologia 1997, 35:111-118.
2. Asada H., Fukuda Y., Tsunoda S., Yamaguchi M., Tonoike M. Frontal midline theta rhythms reflect alternative activation of prefrontal cortex and anterior cingulate cortex in humans. Neurosci. Lett. 1999, 274:29-32.
3. Babiloni C., Babiloni F., Carducci F., Cincotti F., Vecchio F., Cola B., Rossi S., Miniussi C., Rossini P.M. Functional frontoparietal connectivity during short-term memory as revealed by high-resolution EEG coherence analysis. Behav. Neurosci. 2004, 118:687-697.
4. Bachevalier J., Meunier M., Lu M.X., Ungerleider L.G. Thalamic and temporal cortex input to medial prefrontal cortex in rhesus monkeys. Exp. Brain Res. 1997, 115:430-444.
5. Barrett J., Ehrlichman H. Bilateral hemispheric alpha activity during visual imagery. Neuropsychologia 1982, 20:703-708.
6. Bastiaansen M.C., van der Linden M., Ter Keurs M., Dijkstra T., Hagoort P. Theta responses are involved in lexical-semantic retrieval during language processing. J. Cogn. Neurosci. 2005, 17:530-541.
7. Bhattacharya J., Petsche H. Drawing on mind's canvas: differences in cortical integration patterns between artists and non-artists. Hum. Brain Mapp. 2005, 26:1-14.
8. Buckner R.L., Raichle M.E., Miezin F.M., Petersen S.E. Functional anatomic studies of memory retrieval for auditory words and visual pictures. J. Neurosci. 1996, 16:6219-6235.
9. Buzsaki G., Kaila K., Raichle M. Inhibition and brain work. Neuron 2007, 56:771-783.
10. Cavanna A.E., Trimble M.R. The precuneus: a review of its functional anatomy and behavioural correlates. Brain 2006, 129:564-583.
11. Cohen M.S., Kosslyn S.M., Breiter H.C., DiGirolamo G.J., Thompson W.L., Anderson A.K., Brookheimer S.Y., Rosen B.R., Belliveau J.W. Changes in cortical activity during mental rotation. A mapping study using functional MRI. Brain 1996, 119(Pt 1):89-100.
12. Dale A.M., Buckner R.L. Selective averaging of rapidly presented individual trials using fMRI. Hum. Brain Mapp. 1997, 5:329-340.
13. Daselaar S.M., Prince S.E., Dennis N.A., Hayes S.M., Kim H., Cabeza R. Posterior midline and ventral parietal activity is associated with retrieval success and encoding failure. Front. Hum. Neurosci. 2009, 3:13.
14. Deiber M.P., Missonnier P., Bertrand O., Gold G., Fazio-Costa L., Ibanez V., Giannakopoulos P. Distinction between perceptual and attentional processing in working memory tasks: a study of phase-locked and induced oscillatory brain dynamics. J. Cogn. Neurosci. 2007, 19:158-172.
15. Delorme A., Makeig S. EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods 2004, 134:9-21.
16. D'Esposito M., Detre J.A., Alsop D.C., Shin R.K., Atlas S., Grossman M. The neural basis of the central executive system of working memory. Nature 1995, 378:279-281.
17. D'Esposito M., Detre J.A., Aguirre G.K., Stallcup M., Alsop D.C., Tippet L.J., Farah M.J. A functional MRI study of mental image generation. Neuropsychologia 1997, 35:725-730.
18. Ekstrom A. How and when the fMRI BOLD signal relates to underlying neural activity: the danger in dissociation. Brain Res. Rev. 2010, 62:233-244.
19. Farah M.J., Hammond K.M., Levine D.N., Calvanio R. Visual and spatial mental imagery: dissociable systems of representation. Cogn. Psychol. 1988, 20:439-462.
20. Formisano E., Goebel R. Tracking cognitive processes with functional MRI mental chronometry. Curr. Opin. Neurobiol. 2003, 13:174-181.
21. Formisano E., Linden D.E., Di Salle F., Trojano L., Esposito F., Sack A.T., Grossi D., Zanella F.E., Goebel R. Tracking the mind's image in the brain I: time-resolved fMRI during visuospatial mental imagery. Neuron 2002, 35:185-194.
22. Friston K.J., Harrison L., Penny W. Dynamic causal modelling. NeuroImage 2003, 19:1273-1302.
23. Genovese C.R., Lazar N.A., Nichols T. Thresholding of statistical maps in functional neuroimaging using the false discovery rate. NeuroImage 2002, 15:870-878.
24. Gevins A., Smith M.E., McEvoy L., Yu D. High-resolution EEG mapping of cortical activation related to working memory: effects of task difficulty, type of processing, and practice. Cereb. Cortex 1997, 7:374-385.
25. Gill H.S., O'Boyle M.W., Hathaway J. Cortical distribution of EEG activity for component processes during mental rotation. Cortex 1998, 34:707-718.
26. Goebel R., Linden D.E., Lanfermann H., Zanella F.E., Singer W. Functional imaging of mirror and inverse reading reveals separate coactivated networks for oculomotion and spatial transformations. Neuroreport 1998, 9:713-719.
27. Goebel R., Esposito F., Formisano E. Analysis of functional image analysis contest (FIAC) data with brainvoyager QX: from single-subject to cortically aligned group general linear model analysis and self-organizing group independent component analysis. Hum. Brain Mapp. 2006, 27:392-401.
28. Goldstein E.B. Sensation and Perception 2002, Wadsworth, Belmont, CA. 5th edn.
29. Hayes S.M., Nadel L., Ryan L. The effect of scene context on episodic object recognition: parahippocampal cortex mediates memory encoding and retrieval success. Hippocampus 2007, 17:873-889.
30. Ishai A., Ungerleider L.G., Haxby J.V. Distributed neural systems for the generation of visual images. Neuron 2000, 28:979-990.
31. Ishai A., Haxby J.V., Ungerleider L.G. Visual imagery of famous faces: effects of memory and attention revealed by fMRI. NeuroImage 2002, 17:1729-1741.
32. Jensen O., Tesche C.D. Frontal theta activity in humans increases with memory load in a working memory task. Eur. J. Neurosci. 2002, 15:1395-1399.
33. Jung T.P., Makeig S., Humphries C., Lee T.W., McKeown M.J., Iragui V., Sejnowski T.J. Removing electroencephalographic artifacts by blind source separation. Psychophysiology 2000, 37:163-178.
34. Kavanagh R.N., Darcey T.M., Lehmann D., Fender D.H. Evaluation of methods for three-dimensional localization of electrical sources in the human brain. IEEE Trans. Biomed. Eng. 1978, 25:421-429.
35. Klein I., Dubois J., Mangin J.F., Kherif F., Flandin G., Poline J.B., Denis M., Kosslyn S.M., Le Bihan D. Retinotopic organization of visual mental images as revealed by functional magnetic resonance imaging. Brain Res. Cogn. Brain Res. 2004, 22:26-31.
36. Klimesch W. EEG-alpha rhythms and memory processes. Int. J. Psychophysiol. 1997, 26:319-340.
37. Klimesch W., Doppelmayr M., Rohm D., Pollhuber D., Stadler W. Simultaneous desynchronization and synchronization of different alpha responses in the human electroencephalograph: a neglected paradox?. Neurosci. Lett. 2000, 284:97-100.
38. Knauff M., Kassubek J., Mulack T., Greenlee M.W. Cortical activation evoked by visual mental imagery as measured by fMRI. Neuroreport 2000, 11:3957-3962.
39. Kosslyn S.M., Thompson W.L. When is early visual cortex activated during visual mental imagery?. Psychol. Bull. 2003, 129:723-746.
40. Kosslyn S.M., Behrmann M., Jeannerod M. The cognitive neuroscience of mental imagery. Neuropsychologia 1995, 33:1335-1344.
41. Kosslyn S.M., Pascual-Leone A., Felician O., Camposano S., Keenan J.P., Thompson W.L., Ganis G., Sukel K.E., Alpert N.M. The role of area 17 in visual imagery: convergent evidence from PET and rTMS. Science 1999, 284:167-170.
42. Kosslyn S.M., Ganis G., Thompson W.L. Neural foundations of imagery. Nat. Rev. Neurosci. 2001, 2:635-642.
43. Lamm C., Windischberger C., Leodolter U., Moser E., Bauer H. Evidence for premotor cortex activity during dynamic visuospatial imagery from single-trial functional magnetic resonance imaging and event-related slow cortical potentials. NeuroImage 2001, 14:268-283.
44. Le Bihan D., Turner R., Zeffiro T.A., Cuenod C.A., Jezzard P., Bonnerot V. Activation of human primary visual cortex during visual recall: a magnetic resonance imaging study. Proc. Natl. Acad. Sci. U. S. A. 1993, 90:11802-11805.
45. Levine D.N., Warach J., Farah M. Two visual systems in mental imagery: dissociation of "what" and "where" in imagery disorders due to bilateral posterior cerebral lesions. Neurology 1985, 35:1010-1018.
46. Linden D.E., Thornton K., Kuswanto C.N., Johnston S.J., van de Ven V., Jackson M.C. The brain's voices: comparing nonclinical auditory hallucinations and imagery. Cereb Cortex 2011, 21:330-337.
47. Lu Y., Bagshaw A.P., Grova C., Kobayashi E., Dubeau F., Gotman J. Using voxel-specific hemodynamic response function in EEG-fMRI data analysis. NeuroImage 2006, 32:238-247.
48. Lu Y., Grova C., Kobayashi E., Dubeau F., Gotman J. Using voxel-specific hemodynamic response function in EEG-fMRI data analysis: an estimation and detection model. NeuroImage 2007, 34:195-203.
49. Makeig S., Debener S., Onton J., Delorme A. Mining event-related brain dynamics. Trends Cogn. Sci. 2004, 8:204-210.
50. Mantini D., Perrucci M.G., Del Gratta C., Romani G.L., Corbetta M. Electrophysiological signatures of resting state networks in the human brain. Proc. Natl. Acad. Sci. U. S. A. 2007, 104:13170-13175.
51. Marks D.F., Isaac A.R. Topographical distribution of EEG activity accompanying visual and motor imagery in vivid and non-vivid imagers. Br. J. Psychol. 1995, 86(Pt 2):271-282.
52. Mellet E., Tzourio N., Crivello F., Joliot M., Denis M., Mazoyer B. Functional anatomy of spatial mental imagery generated from verbal instructions. J. Neurosci. 1996, 16:6504-6512.
53. Mellet E., Petit L., Mazoyer B., Denis M., Tzourio N. Reopening the mental imagery debate: lessons from functional anatomy. NeuroImage 1998, 8:129-139.
54. Mellet E., Tzourio-Mazoyer N., Bricogne S., Mazoyer B., Kosslyn S.M., Denis M. Functional anatomy of high-resolution visual mental imagery. J. Cogn. Neurosci. 2000, 12:98-109.
55. Mitchell K.J., Johnson M.K., Raye C.L., D'Esposito M. fMRI evidence of age-related hippocampal dysfunction in feature binding in working memory. Brain Res. Cogn. Brain Res. 2000, 10:197-206.
56. Munk M.H., Linden D.E., Muckli L., Lanfermann H., Zanella F.E., Singer W., Goebel R. Distributed cortical systems in visual short-term memory revealed by event-related functional magnetic resonance imaging. Cereb. Cortex 2002, 12:866-876.
57. Neuper C., Pfurtscheller G. Event-related dynamics of cortical rhythms: frequency-specific features and functional correlates. Int. J. Psychophysiol. 2001, 43:41-58.
58. Nikolaev A.R., Anokhin A.P. EEG frequency ranges during perception and mental rotation of two- and three-dimensional objects. Neurosci. Behav. Physiol. 1998, 28:670-677.
59. O'Craven K.M., Kanwisher N. Mental imagery of faces and places activates corresponding stiimulus-specific brain regions. J. Cogn. Neurosci. 2000, 12:1013-1023.
60. Onton J., Delorme A., Makeig S. Frontal midline EEG dynamics during working memory. NeuroImage 2005, 27:341-356.
61. Petsche H., Lacroix D., Lindner K., Rappelsberger P., Schmidt-Henrich E. Thinking with images or thinking with language: a pilot EEG probability mapping study. Int. J. Psychophysiol. 1992, 12:31-39.
62. Petsche H., Kaplan S., von Stein A., Filz O. The possible meaning of the upper and lower alpha frequency ranges for cognitive and creative tasks. Int. J. Psychophysiol. 1997, 26:77-97.
63. Podzebenko K., Egan G.F., Watson J.D. Widespread dorsal stream activation during a parametric mental rotation task, revealed with functional magnetic resonance imaging. NeuroImage 2002, 15:547-558.
64. Prabhakaran V., Narayanan K., Zhao Z., Gabrieli J.D. Integration of diverse information in working memory within the frontal lobe. Nat. Neurosci. 2000, 3:85-90.
65. Prince S.E., Dennis N.A., Cabeza R. Encoding and retrieving faces and places: distinguishing process- and stimulus-specific differences in brain activity. Neuropsychologia 2009, 47:2282-2289.
66. Richter W., Ugurbil K., Georgopoulos A., Kim S.G. Time-resolved fMRI of mental rotation. Neuroreport 1997, 8:3697-3702.
67. Richter W., Somorjai R., Summers R., Jarmasz M., Menon R.S., Gati J.S., Georgopoulos A.P., Tegeler C., Ugurbil K., Kim S.G. Motor area activity during mental rotation studied by time-resolved single-trial fMRI. J. Cogn. Neurosci. 2000, 12:310-320.
68. Riesenhuber M., Poggio T. Models of object recognition. Nat. Neurosci. 2000, 1199-1204. (Suppl).
69. Roebroeck A., Formisano E., Goebel R. Mapping directed influence over the brain using Granger causality and fMRI. NeuroImage 2005, 25:230-242.
70. Rugg M.D., Venables P.H. EEG correlates of the acquisition of high- and low-imagery words. Neurosci. Lett. 1980, 16:67-70.
71. Sack A.T., Sperling J.M., Prvulovic D., Formisano E., Goebel R., Di Salle F., Dierks T., Linden D.E. Tracking the mind's image in the brain II: transcranial magnetic stimulation reveals parietal asymmetry in visuospatial imagery. Neuron 2002, 35:195-204.
72. Sack A.T., Camprodon J.A., Pascual-Leone A., Goebel R. The dynamics of interhemispheric compensatory processes in mental imagery. Science 2005, 308:702-704.
73. Serences J.T. A comparison of methods for characterizing the event-related BOLD timeseries in rapid fMRI. NeuroImage 2004, 21:1690-1700.
74. Swadlow H.A. Fast-spike interneurons and feedforward inhibition in awake sensory neocortex. Cereb. Cortex 2003, 13:25-32.
75. Tagaris G.A., Kim S.G., Strupp J.P., Andersen P., Ugurbil K., Georgopoulos A.P. Quantitative relations between parietal activation and performance in mental rotation. Neuroreport 1996, 7:773-776.
76. Talairach J., Tournoux P. Co-planar Stereotaxic Atlas of the Human Brain: 3-Dimenstional Proportional System - An Approach to Cerebral Imaging 1988, Thieme Medical Publishers, New York.
77. Talati A., Hirsch J. Functional specialization within the medial frontal gyrus for perceptual go/no-go decisions based on "what," "when," and "where" related information: an fMRI study. J. Cogn. Neurosci. 2005, 17:981-993.
78. Tallon-Baudry C., Bertrand O., Peronnet F., Pernier J. Induced gamma-band activity during the delay of a visual short-term memory task in humans. J. Neurosci. 1998, 18:4244-4254.
79. Tallon-Baudry C., Bertrand O., Fischer C. Oscillatory synchrony between human extrastriate areas during visual short-term memory maintenance. J. Neurosci. 2001, 21:RC177.
80. Trojano L., Grossi D., Linden D.E., Formisano E., Hacker H., Zanella F.E., Goebel R., Di Salle F. Matching two imagined clocks: the functional anatomy of spatial analysis in the absence of visual stimulation. Cereb. Cortex 2000, 10:473-481.
81. Trojano L., Grossi D., Linden D.E., Formisano E., Goebel R., Cirillo S., Elefante R., Di Salle F. Coordinate and categorical judgements in spatial imagery. An fMRI study. Neuropsychologia 2002, 40:1666-1674.
82. Tulving E., Markowitsch H.J., Craik F.E., Habib R., Houle S. Novelty and familiarity activations in PET studies of memory encoding and retrieval. Cereb. Cortex 1996, 6:71-79.
83. Ungerleider L.G., Haxby J.V. 'What' and 'where' in the human brain. Curr. Opin. Neurobiol. 1994, 4:157-165.
84. Valdes-Sosa P.A., Roebroeck A., Daunizeau J., Friston K. Effective connectivity: influence, causality and biophysical modeling. NeuroImage 2011, 58:339-361.
85. Ward B.D. Deconvolution Analysis of FMRI Time Series Data http://afni.nimh.nih.gov/pub/dist/doc/manual/Deconvolvem.pdf.