What you see is not (always) what you hear: Induced gamma band responses reflect cross-modal interactions in familiar object recognition

Journal of Neuroscience

Volumn 27, Issue 5, 2007, Pages 1090-1096

  Yuval Greenberg, Shlomit ^a   Deouell, Leon Y ^a  

^a HEBREW UNIVERSITY OF JERUSALEM   (Israel)

Author keywords

Auditory; EEG; Event related potentials; Gamma; Human; Multisensory; Object recognition; Oscillations; Visual

Indexed keywords

ARTICLE; BRAIN DEPTH STIMULATION; BRAIN FUNCTION; BRAIN REGION; CONTROLLED STUDY; ELECTROENCEPHALOGRAPHY; EVENT RELATED POTENTIAL; GAMMA NERVE FIBER; HUMAN; OSCILLATION; PRIORITY JOURNAL; RECOGNITION; VISUAL INFORMATION; VISUAL STIMULATION;

ACOUSTIC STIMULATION; ADULT; AUDITORY PERCEPTION; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FEMALE; HUMANS; MALE; PHOTIC STIMULATION; RECOGNITION (PSYCHOLOGY); VISUAL PERCEPTION;

EID: 33846821628     PISSN: 02706474     EISSN: 02706474     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.4828-06.2007     Document Type: Article

References (49)

1. Başar-Eroǧlu C, Strüber D, Schurmann M, Stadler M, Başar E (1996) Gamma-band responses in the brain: a short review of psychophysiological correlates and functional significance. Int J Psychophysiol 24:101-112.
2. Bertelson P, de Gelder B (2004) The psychology of multimodal perception. In: Crossmodal space and crossmodal attention (Spence C, Driver J, eds), pp 141-177. Oxford: Oxford UP.
3. Blair RC, Karniski W (1993) An alternative method for significance testing of wave-form difference potentials. Psychophysiology 30:518-524.
4. Busch NA, Herrmann CS, Müller MM, Lenz D, Gruber T (2007) A cross-laboratory study of event-related gamma activity in a standard object recognition paradigm. NeuroImage 33:1169-1177.
5. Colin C, Radeau M, Soquet A, Dachy B, Deltenre P (2002) Electrophysiology of spatial scene analysis: the mismatch negativity (MMN) is sensitive to the ventriloquism illusion. Clin Neurophysiol 113:507-518.
6. Eckhorn R, Bauer R, Jordan W, Brosch M, Kruse W, Munk M, Reitboeck HJ (1988) Coherent oscillations: a mechanism of feature linking in the visual cortex? Multiple electrode and correlation analyses in the cat. Biol Cybern 60:121-130.
7. Ernst MO, Banks MS (2002) Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415:429-433.
8. Ernst MO, Banks MS, Bulthoff HH (2000) Touch can change visual slant perception. Nat Neurosci 3:69-73.
9. Fiebach CJ, Gruber T, Supp GG (2005) Neuronal mechanisms of repetition priming in occipitotemporal cortex: spatiotemporal evidence from functional magnetic resonance imaging and electroencephalography. J Neurosci 25:3414-3422.
10. Fort A, Delpuech C, Pernier J, Giard MH (2002) Early auditory-visual interactions in human cortex during nonredundant target identification. Brain Res Cogn Brain Res 14:20-30.
11. Giard MH, Peronnet F (1999) Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study. J Cogn Neurosci 11:473-490.
12. Gray CM, Singer W (1989) Stimulus-specific neuronal oscillations in orientation columns of cat visual cortex. Proc Natl Acad Sci USA 86:1698-1702.
13. Gruber T, Müller MM (2002) Effects of picture repetition on induced gamma band responses, evoked potentials, and phase synchrony in the human EEG. Brain Res Cogn Brain Res 13:377-392.
14. Gruber T, Müller MM (2005) Oscillatory brain activity dissociates between associative stimulus content in a repetition priming task in the human EEG. Cereb Cortex 15:109-116.
15. Gruber T, Müller MM, Keil A (2002) Modulation of induced gamma band responses in a perceptual learning task in the human EEG. J Cogn Neurosci 14:732-744.
16. Hairston WD, Laurienti PJ, Mishra G, Burdette JH, Wallace MT (2003a) Multisensory enhancement of localization under conditions of induced myopia. Exp Brain Res 152:404-408.
17. Hairston WD, Wallace MT, Vaughan JW, Stein BE, Norris JL, Schirillo JA (2003b) Visual localization ability influences cross-modal bias. J Cogn Neurosci 15:20-29.
18. Heron J, Whitaker D, McGraw F (2004) Sensory uncertainty governs the extent of audio-visual interaction. Vision Res 44:2875-2884.
19. Herrmann CS, Mecklinger A, Pfeifer E (1999) Gamma responses and ERPs in a visual classification task. Clin Neurophysiol 110:636-642.
20. Herrmann CS, Lenz D, Junge S, Busch NA, Maess B (2004) Memory-matches evoke human gamma-responses. BMC Neurosci 5:13.
21. Jung TP, Makeig S, Westerfield M, Townsend J, Courchesne E, Sejnowski TJ (2000) Removal of eye activity artifacts from visual event-related potentials in normal and clinical subjects. Clin Neurophysiol 111:1745-1758.
22. Kaiser J, Hertrich I, Ackermann H, Lutzenberger W (2006) Gamma-band activity over early sensory areas predicts detection of changes in audiovisual speech stimuli. NeuroImage 30:1376-1382.
23. Lachaux JP, George N, Tallon-Baudry C, Martinerie J, Hugueville L, Minotti L, Kahane P, Renault B (2005) The many faces of the gamma band response to complex visual stimuli. NeuroImage 25:491-501.
24. Lehmann S, Murray MM (2005) The role of multisensory memories in unisensory object discrimination. Brain Res Cogn Brain Res 24:326-334.
25. Lenz D, Schadow J, Thaerig S, Busch NA, Herrmann CS (2007) What's that sound? Matches with auditory long-term memory induce gamma activity in human EEG. Int J Psychophysiol, in press.
26. Lutzenberger W, Pulvermüller F, Birbaumer N (1994) Words and pseudowords elicit distinct patterns of 30-Hz EEG responses in humans. Neurosci Lett 176:115-118.
27. Lutzenberger W, Pulvermüller F, Elbert T, Birbaumer N (1995) Visual stimulation alters local 40-Hz responses in humans: an EEG-study. Neurosci Lett 183:39-42.
28. McGurk H, MacDonald J (1976) Hearing lips and seeing voices. Nature 264:746-748.
29. Molholm S, Ritter W, Murray MM, Javitt DC, Schroeder CE, Foxe JJ (2002) Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Cogn Brain Res 14:115-128.
30. Molholm S, Ritter W, Javitt DC, Foxe JJ (2004) Multisensory visual-auditory object recognition in humans: a high-density electrical mapping study. Cereb Cortex 14:452-465.
31. Müller MM, Bosch J, Elbert T, Kreiter A, Sosa MV, Sosa PV, Rockstroh B (1996) Visually induced gamma-based responses in human electroencephalographic activity: a link to animal studies. Exp Brain Res 112:96-102.
32. Murray MM, Wylie GR, Higgins BA, Javitt DC, Schroeder CE, Foxe JJ (2002) The spatiotemporal dynamics of illusory contour processing: combined high-density electrical mapping, source analysis, and functional magnetic resonance imaging. J Neurosci 22:5055-5073.
33. Murray MM, Foxe DM, Javitt DC, Foxe JJ (2004) Setting boundaries: brain dynamics of modal and amodal illusory shape completion in humans. J Neurosci 24:6898-6903.
34. Sams M, Aulanko R, Hamalainen M, Hari R, Lounasmaa OV, Lu ST, Simola J (1991) Seeing speech: visual information from lip movements modifies activity in the human auditory cortex. Neurosci Lett 127:141-145.
35. Senkowski D, Talsma D, Herrmann CS, Woldorff MG (2005) Multisensory processing and oscillatory gamma responses: effects of spatial selective attention. Exp Brain Res 166:411-426.
36. Senkowski D, Talsma D, Grigutsch M, Herrmann CS, Woldorff MG (2007) Good times for multisensory integration: effects of the precision of temporal synchrony as revealed by gamma-band oscillations. Neuropsychologia 45:561-571.
37. Schroeder CE, Foxe J (2005) Multisensory contributions to low-level, "unisensory: processing. Curr Opin Neurobiol 15:454-458.
38. Stekelenburg JJ, Vroomen J, de Gelder B (2004) Illusory sound shifts induced by the ventriloquist illusion evoke the mismatch negativity. Neurosci Lett 357:163-166.
39. Tallon C, Bertrand O, Bouchet P, Pernier J (1995) Gamma-range activity evoked by coherent visual stimuli in humans. Eur J Neurosci 7:1285-1291.
40. Tallon-Baudry C (2003) Oscillatory synchrony and human visual cognition. J Physiol (Paris) 97:355-363.
41. Tallon-Baudry C, Bertrand O (1999) Oscillatory gamma activity in humans and its role in object representation. Trends Cogn Sci 3:151-162.
42. Tallon-Baudry C, Bertrand O, Delpuech C, Pernier J (1996) Stimulus specificity of phase-locked and non-phase-locked 40 Hz visual responses in human. J Neurosci 16:4240-4249.
43. Tallon-Baudry C, Bertrand O, Delpuech C, Permier J (1997) Oscillatory gamma-band (30-70 Hz) activity induced by a visual search task in humans. J Neurosci 17:722-734.
44. Tallon-Baudry C, Bertrand O, Peronnet F, Pernier J (1998) Induced gamma-band activity during the delay of a visual short-term memory task in humans. J Neurosci 18:4244-4254.
45. Talsma D, Woldorff MG (2005) Selective attention and multisensory integration: multiple phases of effects on the evoked brain activity. J Cogn Neurosci 17:1098-1114.
46. Teder-Sälejärvi WA, McDonald JJ, Di Russo F, Hillyard SA (2002) An analysis of audio-visual crossmodal integration by means of event-related potential (ERP) recordings. Brain Res Cogn Brain Res 14:106-114.
47. Thompson-Schill SL, D'Esposito M, Aguirre GK, Farah MJ (1997) Role of left inferior prefrontal cortex in retrieval of semantic knowledge: a reevaluation. Proc Natl Acad Sci USA 94:14792-14797.
48. Welch RB, Warren DH (1980) Immediate perceptual response to intersensory discrepancy. Psychol Bull 88:638-667.
49. Witten IB, Knudsen EI (2005) Why seeing is believing: merging auditory and visual worlds. Neuron 48:489-496.