The efficacy of single-trial multisensory memories

Multisensory Research

Volumn 26, Issue 5, 2013, Pages 483-502

  Thelen, Antonia ^a   Murray, Micah M ^a,b,c  

^a LAUSANNE UNIVERSITY HOSPITAL   (Switzerland)

^b University of Lausanne   (Switzerland)

^c VANDERBILT UNIVERSITY   (United States)

Author keywords

Auditory; Cross modal; Learning; Memory; Multisensory; Object; Visual

Indexed keywords

AUDITORY; CROSS-MODAL; LEARNING; MULTISENSORY; OBJECT; VISUAL;

BRAIN; DATA STORAGE EQUIPMENT;

OBJECT RECOGNITION;

AUDITORY STIMULATION; BRAIN; HEARING; HUMAN; MEMORY; PERCEPTIVE DISCRIMINATION; PHOTOSTIMULATION; PHYSIOLOGY; REVIEW; VISION;

ACOUSTIC STIMULATION; AUDITORY PERCEPTION; BRAIN; DISCRIMINATION (PSYCHOLOGY); HUMANS; MEMORY; PHOTIC STIMULATION; VISUAL PERCEPTION;

EID: 84893234027     PISSN: 22134794     EISSN: 22134808     Source Type: Journal    
DOI: 10.1163/22134808-00002426     Document Type: Article

References (50)

1. Amedi, A., von Kriegstein, K., van Atteveldt, N. M., Beauchamp, M. S. and Naumer, M. J. (2005). Functional imaging of human crossmodal identification and object reocognition, Exp. Brain Res. 166, 559-571. (Pubitemid 41502099)
2. Beer, A. L., Plank, T., Meyer, G. and Greenlee, M. W. (2013). Combined diffusion-weighted and functional magnetic resonance imaging reveals a temporal-occipital network involved in auditory-visual object processing, Front. Integr. Neurosci. 7, 5.
3. Butler, A. J. and James, K. H. (2011). Cross-modal versus within-modal recall: Differences in behavioral and brain responses, Behav. Brain Res. 224, 387-396.
4. Cappe, C., Rouiller, E. M. and Barone, P. (2009). Multisensory anatomical pathways, Hearing Res. 258, 28-36.
5. Cappe, C., Thut, G., Romei, V. and Murray, M. M. (2010). Auditory-visual multisensory interactions in humans: timing, topography, directionality, and sources, J. Neurosci. 30, 12572-12580.
6. Cappe, C., Thelen, A., Romei, V., Thut, G. and Murray, M. M. (2012). Looming signals reveal synergistic principles of multisensory interactions, J. Neurosci. 32, 1171-1182.
7. Chen, Y. C. and Yeh, S. L. (2008). Visual events modulated by sound in repetition blindness, Psychon. B. Rev. 15, 404-408.
8. Colombo, M. and Gross, C. G. (1994). Responses of inferior temporal cortex and hippocampal neurons during delayed matching to sample in monkeys (Macaca fascicularis), Behav. Neurosci. 108, 443-455. (Pubitemid 24200052)
9. Ghazanfar, A. A. and Schroeder, C. E. (2006). Is neocortex essentially multisensory? Tr. Cogn. Sci. 10, 278-285. (Pubitemid 43870163)
10. Gibson, J. R. and Maunsell, J. H. R. (1997). Sensory modality specificity of neural activity related to memory in visual cortex, J. Neurophysiol. 78, 1263-1275. (Pubitemid 27400669)
11. Gottfried, J. A., Smith, A. P. R., Rugg, M. D. and Dolan, R. J. (2004). Remembrance of odors past: human olfactory cortex in cross-modal recognition memory, Neuron 42, 687-695. (Pubitemid 38639886)
12. Guo, J. and Guo, A. (2005). Crossmodal interactions between olfactory and visual learning in Drosophila, Science 309, 307-310. (Pubitemid 40967868)
13. Haenny, P. E., Maunsell, J. H. R. and Schiler, P. H. (1988). State dependent activity in monkey visual cortex: II. Retinal and extraretinal factors in V4, Exp. Brain Res. 69, 245-259. (Pubitemid 18034791)
14. Hamilton, W. (1859). Lectures on Metaphysics and Logic. Gould & Lincoln, Boston, MA, USA.
15. James, T.W., Humphrey, G. K., Gati, J. S., Servos, P.,Menon, R. S. and Goodale,M. A. (2002). Haptic study of three-dimensional objects activates extrastriate visual areas, Neuropsychologia 40, 1706-1714. (Pubitemid 34462878)
16. Johansson, B. B. (2012). Multisensory stimulation in stroke rehabilitation, Front. Hum. Neurosci. 6, 60.
17. Lehmann, S. and Murray, M. M. (2005). The role of multisensory memories in unisensory object discrimination, Cogn. Brain Res. 24, 326-334. (Pubitemid 40922640)
18. Maunsell, J. H. R., Sclar, G., Nealey, T. A. and Depriest, D. D. (1991). Extraretinal representations in area V4 in the macaque monkey, Visual Neurosci. 7, 561-573.
19. Meylan, R. V. and Murray, M. M. (2007). Auditory-visual multisensory interactions attenuate subsequent visual responses in humans, Neuroimage 35, 244-254. (Pubitemid 46240934)
20. Michel, C. M. and Murray, M. M. (2012). Towards the utilization of EEG as a brain imaging tool, Neuroimage 61, 371-385.
21. Michel, C. M., Murray, M. M., Lantz, G., Gonzalez, S., Spinelli, L. and Grave de Peralta, R. (2004). EEG source imaging, Clin. Neurophysiol. 115, 2195-2222. (Pubitemid 39200787)
22. Murray, E. A. and Bussey, T. J. (1999). Perceptual-mnemonic functions of the perirhinal cortex, Tr. Cogn. Sci. 3, 142-151. (Pubitemid 29155464)
23. Murray, E. A. and Gaffan, D. (1994). Removal of the amygdala plus subjacent cortex disrupts the retention of both intramodal and crossmodal associative memories in monkeys, Behav. Neurosci. 108, 494-500. (Pubitemid 24200057)
24. Murray, M. M., Cappe, C., Romei, V., Martuzzi, R. and Thut, G. (2012). Auditory-visual multisensory interactions in humans: a synthesis of findings from behavior, ERPs, fMRI, and TMS, in:The New Handbook of Multisensory Processes , B. E. Stein (Ed.), pp. 223-238. MIT Press, Cambridge, MA, USA.
25. Murray, M. M. and Sperdin, H. F. (2010). Single-trial multisensory learning and memory retrieval, in:Multisensory Object Perception in the Primate Brain , J. Kaiser and M. J. Naumer (Eds), pp. 191-208. Springer Heidelberg, Germany.
26. Germany. Mrray, M. M., Brunet, D. andMichel, C. M. (2008). Topographic ERP analyses: a step-by-step tutorial review, Brain Topogr. 20, 249-264.
27. Murray, M. M., Foxe, J. J. and Wylie, G. R. (2005). The brain uses single-trial multisensory memories to discriminate without awareness, Neuroimage 27, 473-478. (Pubitemid 41074847)
28. Murray, M. M., Michel, C. M., Grave de Peralta, R., Ortigue, S., Brunet, D., Andino, S. G. and Schnider, A. (2004). Rapid discrimination of visual and multisensory memories revealed by electrical neuroimaging, Neuroimage 21, 125-135. (Pubitemid 38115003)
29. Naci, L., Taylor, K. I., Cusack, R. and Tyler, L. K. (2012). Are the senses enough for sense? Early high-level feedback shapes our comprehension of multisensory objects, Front. Integr. Neurosci. 6, 82.
30. Naue, N., Rach, S., Struber, D., Huster, R. J., Zaehle, T., Korner, U. and Herrmann, C. S. (2011). Auditory event-related response in visual cortex modulates subsequent visual responses in humans, J. Neurosci. 31, 7729-7736.
31. Naumer, M. J., Doehrmann, O., Müller, N. G., Muckli, L., Kaiser, J. and Hein, G. (2009).Cortical plasticity of audio- visual object representations, Cereb. Cortex 19, 1641-1653.
32. Nyberg, L., Habib, R.,McIntosh, A. R. and Tulving, E. (2000). Reactivation of encoding-related brain activity during memory retrieval, Proc. Natl Acad. Sci. USA 97, 11120-11124.
33. Ranganath, C. and Rainer, G. (2003). Neural mechanisms for detecting and remembering novel events, Nat. Rev. Neurosci. 4, 193-202. (Pubitemid 37280184)
34. Shams, L., Wozny, D. R., Kim, R. and Seitz, A. (2011). Influences of multisensory experience on subsequent unisensory processing, Front. Psychol. 2, 264.
35. Shams, L. and Seitz, A. R. (2008). Benefits of multisensory learning, Tr. Cogn. Sci. 12, 411-417.
36. Spence, C., Nicholls, M. E. and Driver, J. (2001). The cost of expecting events in the wrong sensory modality, Percept. Psychophys. 63, 330-336. (Pubitemid 33610252)
37. Tanabe, H. C., Honda, M. and Sadato, N. (2005). Functionally segregated neural substrates for arbitrary audiovisual paired-association learning, J. Neurosci. 25, 6409-6418. (Pubitemid 40962537)
38. Taylor, K. I., Moss, H. E., Stamatakis, E. A. and Tyler, L. K. (2006). Binding crossmodal object features in perirhinal cortex, Proc. Natl Acad. Sci. USA 103, 8239-8244. (Pubitemid 43801082)
39. Taylor, K. I., Stamatakis, E. A. and Tyler, L. K. (2009). Crossmodal integration of object features: voxel-based correlations in brain-damaged patients, Brain 132, 671-683.
40. Thelen, A., Cappe, C. and Murray, M. M. (2012). Electrical neuroimaging of memory discrimination based on single-trial multisensory learning, Neuroimage 62, 1478-1488.
41. Thelen, A. and Murray, M. M. (2013). Predicting individual differences in the impact of multisensory, single-trial exposure upon subsequent object recognition. Neuroscience 2013 Abstracts, Program No. 765.15483. Society for Neuroscience, San Diego, California, USA.
42. Thelen, A., Talsma, D. and Murray, M. M. (submitted). The efficacy of single-trial multisensory memories for visual and auditory object recognition, J. Cognitive Neurosci. Tsivilis
43. D., Otten, L. J. and Rugg, M. D. (2001). Context effects on the neural correlates of recognition memory: an electrophysiological study, Neuron 31, 497-505. (Pubitemid 32778567)
44. Tzovara, A., Murray, M. M., Plomp, G., Herzog, M., Michel, C. M. and De Lucia, M. (2012a). Decoding stimulus-related information from single-trial EEG responses based on voltage topographies, Pattern Recogn. 45, 2109-2122.
45. Tzovara, A., Murray, M. M., Michel, C. M. and De Lucia, M. (2012b). A tutorial review of electrical neuroimaging from group-average to single-trial event-related potentials, Dev. Neuropsychol. 37, 518-544.
46. van der Linden, M., van Turennout, M. and Indefrey, P. (2010). Formation of category representations in superior temporal sulcus, J. Cognitive Neurosci. 22, 1270-1282.
47. Von Kriegstein, K. and Giraud, A. L. (2006). Implicit multisensory associations influence voice recognition, PLoS Biol. 4, e326.
48. Wheeler, M. E., Petersen, S. E. and Buckner, R. L. (2000). Memory's echo: vivid remembering reactivates sensory-specific cortex, Proc. Natl Acad. Sci. USA 97, 11125-11129.
49. Wozny, D. R. and Shams, L. (2011). Computational characterization of visually induced auditory spatial adaptation, Front. Integr. Neurosci. 5, 75.
50. Zangenehpour, S. and Zatorre, R. J. (2010). Crossmodal recruitment of primary visual cortex following brief exposure to bimodal audiovisual stimuli, Neuropsychologia 48, 591-600.