Electrical neuroimaging of memory discrimination based on single-trial multisensory learning

NeuroImage

Volumn 62, Issue 3, 2012, Pages 1478-1488

  Thelen, Antonia ^a   Cappe, Céline ^b   Murray, Micah M ^a,c,d,e  

^a UNIVERSITY OF LAUSANNE   (Switzerland)

^b EPFL   (Switzerland)

^c LAUSANNE UNIVERSITY HOSPITAL   (Switzerland)

^d University of Lausanne   (Switzerland)

^e VANDERBILT UNIVERSITY MEDICAL CENTER   (United States)

Author keywords

Auditory cortex; Cross modal; Event related potential (ERP); Memory; Multisensory; Object recognition

Indexed keywords

ADULT; ARTICLE; CONTROLLED STUDY; EVOKED VISUAL RESPONSE; FEMALE; HUMAN; HUMAN EXPERIMENT; LEARNING; MALE; MEMORY; MEMORY DISCRIMINATION; MIDDLE TEMPORAL GYRUS; NEUROIMAGING; NORMAL HUMAN; POSTERIOR TEMPORAL GYRUS; PRIORITY JOURNAL; PSYCHOPHYSICS; RECOGNITION; TASK PERFORMANCE; TEMPORAL GYRUS; VISUAL STIMULATION;

ACOUSTIC STIMULATION; ADULT; AUDITORY PERCEPTION; BRAIN; BRAIN MAPPING; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS, VISUAL; FEMALE; HUMANS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; MALE; MEMORY; PHOTIC STIMULATION; RECOGNITION (PSYCHOLOGY); VISUAL PERCEPTION; YOUNG ADULT;

EID: 84863451130     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2012.05.027     Document Type: Article

References (65)

1. Baier B., Kleinschmidt A., Muller N.G. Cross-modal processing in early visual and auditory cortices depends on expected statistical relationship of multisensory information. J. Neurosci. 2006, 26(47):12260-12265.
2. Brunet D., Murray M.M., Michel C.M. Spatiotemporal analysis of multichannel EEG: CARTOOL. Comput. Intell. Neurosci. 2011, 2011:813-870.
3. Butler A.J., James K.H. Cross-modal versus within-modal recall: differences in behavioral and brain responses. Behav. Brain Res. 2011, 224:387-396.
4. Calvert G.A. The handbook of multisensory processes 2004, MIT Press, Cambridge, MA.
5. Cappe C., Thut G., Romei V., Murray M.M. Auditory-visual multisensory interactions in humans: timing, topography, directionality, and sources. J. Neurosci. 2010, 30(38):12572-12580.
6. Cappe C., Thelen A., Romei V., Thut G., Murray M.M. Looming signals reveal synergistic principles of multisensory integration. J. Neurosci. 2012, 32(4):1171-1182.
7. De Lucia M., Clarke S., Murray M.M. A temporal hierarchy for conspecific vocalization discrimination in humans. J. Neurosci. 2010, 30(33):11210-11221.
8. De Lucia M., Michel C.M., Murray M.M. Comparing ICA-based and single-trial topographic ERP analyses. Brain Topogr. 2010, 23(2):119-127.
9. Grave de Peralta Menendez R., Gonzalez Andino S., Lantz G., Michel C.M., Landis T. Noninvasive localization of electromagnetic epileptic activity. I. Method descriptions and simulations. Brain Topogr. 2001, 14(2):131-137.
10. Grave de Peralta Menendez R., Murray M.M., Michel C.M., Martuzzi R., Gonzalez Andino S.L. Electrical neuroimaging based on biophysical constraints. Neuroimage 2004, 21(2):527-539.
11. Diaconescu A.O., Alain C., McIntosh A.R. The co-occurrence of multisensory facilitation and cross-modal conflict in the human brain. J. Neurophysiol. 2011, 106:2896-2909.
12. Gonzalez Andino S.L., Murray M.M., Foxe J.J., de Peralta Menendez R.G. How single-trial electrical neuroimaging contributes to multisensory research. Exp. Brain Res. 2005, 166(3-4):298-304.
13. Gottfried J.A., Smith A.P., Rugg M.D., Dolan R.J. Remembrance of odors past: human olfactory cortex in cross-modal recognition memory. Neuron 2004, 42(4):687-695.
14. Guthrie D., Buchwald J.S. Significance testing of difference potentials. Psychophysiology 1991, 28(2):240-244.
15. Hamilton W. Lectures on Metaphysics and Logic 1859, Gould & Lincoln, Boston.
16. Kayser C., Logothetis N.K., Panzeri S. Visual enhancement of the information representation in auditory cortex. Curr. Bio. 2010, 20(1):19-24.
17. Kim R.S., Seitz A.R., Shams L. Benefits of stimulus congruency for multisensory facilitation of visual learning. PLoS One 2008, 3(1):e1532.
18. Knebel J.F., Murray M.M. Towards a resolution of conflicting models of illusory contour processing in humans. Neuroimage 2012, 59(3):2808-2817.
19. Knebel J.F., Toepel U., Hudry J., le Coutre J., Murray M.M. Generating controlled image sets in cognitive neuroscience research. Brain Topogr. 2008, 20(4):284-289.
20. Knebel J.F., Javitt D.C., Murray M.M. Impaired early visual response modulations to spatial information in chronic schizophrenia. Psychiatry Res. 2011, 193(3):168-176.
21. Koenig T., Melie-Garcia L. A method to determine the presence of averaged event-related fields using randomization tests. Brain Topogr. 2010, 23(3):233-242.
22. Lehmann D. Principles of spatial analysis. Methods of Analysis of Brain Electrical and Magnetic Signals 1987, vol. 1:309-354. Elsevier, Amsterdam. A.S. Gevins, A. Remond (Eds.).
23. Lehmann S., Murray M.M. The role of multisensory memories in unisensory object discrimination. Brain Res. Cogn. Brain Res. 2005, 24(2):326-334.
24. Lehmann D., Skrandies W. Reference-free identification of components of checkerboard evoked multichannel potential fields. Electroencephalogr. Clin. Neurophysiol. 1980, 48:609-621.
25. Liu H., Agam Y., Madsen J.R., Kreiman G. Timing, timing, timing: fast decoding of object information from intracranial field potentials in human visual cortex. Neuron 2009, 62(2):281-290.
26. Martuzzi R., Murray M.M., Meuli R.A., Thiran J.P., Maeder P.P., Michel C.M., Grave de Peralta Menendez R., Gonzalez Andino S.L. Methods for determining frequency- and region-dependent relationships between estimated LFPs and BOLD responses in humans. J. Neurophysiol. 2009, 101(1):491-502.
27. Meyer K., Kaplan J.T., Essex R., Webber C., Damasio H., Damasio A. Predicting visual stimuli on the basis of activity in auditory cortices. Nat. Neurosci. 2010, 13(6):667-668.
28. Meylan R.V., Murray M.M. Auditory-visual multisensory interactions attenuate subsequent visual responses in humans. Neuroimage 2007, 35(1):244-254.
29. Michel C.M., Murray M.M. Towards the utilization of EEG as a brain imaging tool. Neuroimage 2012, 10.1016/j.neuroimage.2011.12.039.
30. Michel C.M., Murray M.M., Lantz G., Gonzalez S., Spinelli L., Grave de Peralta R. EEG source imaging. Clin. Neurophysiol. 2004, 115(10):2195-2222.
31. Molholm S., Ritter W., Javitt D.C., Foxe J.J. Multisensory visual-auditory object recognition in humans: a high-density electrical mapping study. Cereb. Cortex 2004, 14:452-465.
32. Mouchetant-Rostaing Y., Giard M.H., Delpuech C., Echallier J.F., Pernier J. Early signs of visual categorization for biological and non-biological stimuli in humans. Neuroreport 2000, 11(11):2521-2525.
33. Murray M.M., Sperdin H.F. Single-trial multisensory learning and memory retrieval. Multisensory object perception in the primate brain 2010, 10.1007/978-1-4419-5615_11. J. Kaiser, M.J. Naumer (Eds.).
34. Murray M.M., Michel C.M., Grave de Peralta R., Ortigue S., Brunet D., Gonzalez Andino S., Schnider A. Rapid discrimination of visual and multisensory memories revealed by electrical neuroimaging. Neuroimage 2004, 21(1):125-135.
35. Murray M.M., Foxe J.J., Wylie G.R. The brain uses single-trial multisensory memories to discriminate without awareness. Neuroimage 2005, 27(2):473-478.
36. Murray M.M., Brunet D., Michel C.M. Topographic ERP analyses: a step-by-step tutorial review. Brain Topogr. 2008, 20(4):249-264.
37. Murray M.M., De Santis L., Thut G., Wylie G.R. The costs of crossing paths and switching tasks between audition and vision. Brain Cogn. 2009, 69(1):47-55.
38. Naghavi H.R., Eriksson J., Larsson A., Nyberg L. Cortical regions underlying successful encoding of semantically congruent and incongruent associations between common auditory and visual objects. Neurosci. Lett. 2011, 505(2):191-195.
39. Naue N., Rach S., Struber D., Huster R.J., Zaehle T., Korner U., Herrmann C.S. Auditory event-related response in visual cortex modulates subsequent visual responses in humans. J. Neurosci. 2011, 31(21):7729-7736.
40. Nyberg L., Habib R., McIntosh A.R., Tulving E. Reactivation of encoding-related brain activity during memory retrieval. Proc. Natl. Acad. Sci. U. S. A. 2000, 97(20):11120-11124.
41. Oldfield R.C. The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 1971, 9(1):97-113.
42. Perrin F., Pernier J., Bertrand O., Giard M.H., Echallier J.F. Mapping of scalp potentials by surface spline interpolation. Electroencephalogr. Clin. Neurophysiol. 1987, 66(1):75-81.
43. Pourtois G., Delplanque S., Michel C., Vuilleumier P. Beyond conventional event-related brain potential (ERP): exploring the time-course of visual emotion processing using topographic and principal component analyses. Brain Topogr. 2008, 20(4):265-277.
44. Raij T., Ahveninen J., Lin F.H., Witzel T., Jääskeläinen I.P., Letham B., Israeli E., Sahyoun C., Vasios C., Stufflebeam S., Hämäläinen M., Belliveau J.W. Onset timing of cross-sensory activations and multisensory interactions in auditory and visual sensory cortices. Eur. J. Neurosci. 2010, 31(10):1772-1782.
45. Ranganath C., Rainer G. Neural mechanisms for detecting and remembering novel events. Nat. Rev. Neurosci. 2003, 4(3):193-202.
46. Rousselet G.A., Fabre-Thorpe M., Thorpe S.J. Parallel processing in high-level categorization of natural images. Nat. Neurosci. 2002, 5(7):629-630.
47. Rugg M.D., Johnson J.D., Park H., Uncapher M.R. Encoding-retrieval overlap in human episodic memory: a functional neuroimaging perspective. Prog. Brain Res. 2008, 169:339-352.
48. Schneider T.R., Debener S., Oostenveld R., Engel A.K. Enhanced EEG gamma-band activity reflects multisensory semantic matching in visual-to-auditory object priming. Neuroimage 2008, 42(3):1244-1254.
49. Seeck M., Michel C.M., Mainwaring N., Cosgrove R., Blume H., Ives J., Landis T., Schomer D.L. Evidence for rapid face recognition from human scalp and intracranial electrodes. Neuroreport 1997, 8(12):2749-2754.
50. Shams L., Seitz A.R. Benefits of multisensory learning. Trends Cogn. Sci. 2008, 12(11):411-417.
51. Shams L., Wozny D.R., Kim R., Seitz A. Influences of multisensory experience on subsequent unisensory processing. Front. Psychol. 2011, 2(264).
52. Snodgrass J.G., Vanderwart M. A standardized set of 260 pictures: norms for name agreement, image agreement, familiarity, and visual complexity. J. Exp. Psychol. Hum. Learn. Mem. 1980, 6(2):174-215.
53. Spence C., Nicholls M.E., Driver J. The cost of expecting events in the wrong sensory modality. Percept. Psychophys. 2001, 63(2):330-336.
54. Stein B.E., Meredith M.A. The merging of the senses 1993, The MIT Press, Cambridge Mass.; London.
55. Talairach J., Tournoux P. Co-planar stereotaxic atlas of the human brain: 3-dimensional proportional system: an approach to cerebral imaging 1988, G. Thieme Medical Publishers, Stuttgart; New York.
56. Tanabe H.C., Honda M., Sadato N. Functionally segregated neural substrates for arbitrary audiovisual paired-association learning. J. Neurosci. 2005, 25(27):6409-6418.
57. Thorpe S., Fize D., Marlot C. Speed of processing in the human visual system. Nature 1996, 381(6582):520-522.
58. Toepel U., Knebel J.F., Hudry J., le Coutre J., Murray M.M. The brain tracks the energetic value in food images. Neuroimage 2009, 44(3):967-974.
59. Tzovara, A., Murray, M.M., Michel, C.M., De Lucia, M., in press. A tutorial review of electrical neuroimaging from group-average to single-trial event-related potentials. Dev. Neuropsychol.
60. van der Linden M., van Turennout M., Indefrey P. Formation of category representations in superior temporal sulcus. J. Cogn. Neurosci. 2010, 22(6):1270-1282.
61. VanRullen R., Thorpe S.J. Is it a bird? Is it a plane? Ultra-rapid visual categorisation of natural and artifactual objects. Perception 2001, 30(6):655-668.
62. von Kriegstein K., Giraud A.L. Implicit multisensory associations influence voice recognition. PLoS Biol. 2006, 4(10):e326.
63. Wheeler M.E., Petersen S.E. Memory's echo: vivid remembering reactivates sensory-specific cortex. Proc. Natl. Acad. Sci. U. S. A. 2000, 97(20):11125-11129.
64. Werner S., Noppeney U. Distinct functional contributions of primary sensory and association areas to audiovisual integration in object categorization. J. Neurosci. 2010, 30(7):2662-2675.
65. Wozny D.R., Shams L. Computational characterization of visually induced auditory spatial adaptation. Front. Integr. Neurosci. 2011, 5(75).