Modality shift effects mimic multisensory interactions: An event-related potential study

Experimental Brain Research

Volumn 182, Issue 2, 2007, Pages 199-214

  Gondan, Matthias ^a   Vorberg, Dirk ^b   Greenlee, Mark W ^a  

^a UNIVERSITY OF REGENSBURG   (Germany)

^b TECHNICAL UNIVERSITY OF BRAUNSCHWEIG   (Germany)

Author keywords

Divided attention; Event related potentials; Modality shift effect; Multisensory processes

Indexed keywords

ADULT; ARTICLE; AUDITORY STIMULATION; CLINICAL ARTICLE; ELECTROENCEPHALOGRAM; EVENT RELATED POTENTIAL; FEMALE; HUMAN; MALE; NORMAL HUMAN; PRIORITY JOURNAL; SENSORY STIMULATION; VISUAL STIMULATION;

ACOUSTIC STIMULATION; ADULT; ATTENTION; BRAIN MAPPING; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS, AUDITORY; EVOKED POTENTIALS, VISUAL; FEMALE; HUMANS; MALE; MODELS, STATISTICAL; PHOTIC STIMULATION; RANDOM ALLOCATION; REACTION TIME; SIGNAL DETECTION (PSYCHOLOGY); TIME FACTORS;

EID: 36849011573     PISSN: 00144819     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00221-007-0982-4     Document Type: Article

References (57)

1. Alsius A, Navarra J, Campbell R, Soto-Faraco S (2005) Audiovisual integration of speech falters under high attention demands. Curr Biol 15:839-843
2. Barth DS, Goldberg N, Brett B, Di S (1995) The spatiotemporal organization of auditory, visual, and auditory-visual evoked potentials in rat cortex. Brain Res 678:177-190
3. Beauchamp MS, Lee KE, Argall BD, Martin A (2004) Integration of auditory and visual information about objects in superior temporal sulcus. Neuron 41:809-823
4. Besle J, Fort A, Giard MH (2004) Interest and validity of the additive model in electrophysiological studies of multisensory interactions. Cogn Process 5:189-192
5. Blair RC, Karninski W (1993) An alternative method for significance testing of waveform difference potentials. Psychophysiology 30:518-524
6. Calvert GA, Bullmore ET, Brammer MJ, Campbell R, Williams SCR, McGuire PK, Woodruff PWR, Iversen SD, David AS (1997).Activation of auditory cortex during silent lipreading. Science 276:593-596
7. Calvert GA, Hansen PC, Iversen SD, Brammer M (2001) Detection of audio-visual integration sites by application of electrophysiological criteria to the BOLD effect. Neuroimage 14:427-438
8. Cohen R, Rist F (1992) The modality shift effect. Further explorations at the crossroads. Ann N Y Acad Sci 658:163-181
9. Colonius H (1990) Possibly dependent probability summation of reaction time. J Math Psychol 34:253-275
10. Colonius H, Vorberg D (1994) Distribution inequalities for parallel models with unlimited capacity. J Math Psychol 38:35-58
11. Corballis MC (2002) Hemispheric interactions in simple reaction time. Neuropsychologia 40:423-434
12. Diederich A, Colonius H (2005) Bimodal and trimodal multisensory enhancement: effects of stimulus onset and intensity on reaction time. Percept Psychophys 66:1388-1404
13. Feintuch U, Cohen A (2002) Visual attention and coactivation of response decisions for features from different dimensions. Psychol Sci 13:361-369
14. Ferstl R, Hanewinkel R, Krag P (1994) Is the modality shift effect specific for schizophrenia patients? Schizophr Bull 20:367-373
15. Fort A, Delpuech C, Pernier J, Giard MH (2002a) Dynamics of cortico-subcortical cross-modal operations involved in audio-visual object detection in humans. Cereb Cortex 12:1031-1039
16. Fort A, Delpuech C, Pernier J, Giard MH (2002b) Early auditory-visual interactions in human cortex during nonredundant target identification. Brain Res Cogn Brain Res 14:20-30
17. Foxe JJ, Morocz IA, Murray MM, Higgins BA, Javitt DC, Schroeder CE (2000) Multisensory auditory-somatosensory interactions in early cortical processing revealed by high-density electrical mapping. Brain Res Cogn Brain Res 10:77-83
18. Ghazanfar AA, Maier JX, Hofmann KL, Logothetis NK (2005) Multisensory integration of dynamic faces and voices in Rhesus monkey auditory cortex. J Neurosci 25:5004-5012
19. Giard MH, Peronnet F (1999) Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study. J Cogn Neurosci 11:473-490
20. Gobbelé R, Schürmann M, Forss N, Juottonen K, Buchner H, Hari R (2003) Activation of the human posterior parietal and temporoparietal cortices during audiotactile interaction. Neuroimage 20:503-511
21. Gondan M, Röder B (2006) A new method for detecting interactions between the senses in event-related potentials. Brain Res 1073-1074:389-397
22. Gondan M, Lange K, Rösler F, Röder B (2004) The redundant target effect is affected by modality switch costs. Psychon Bull Rev 11:307-313
23. Hikosaka K, Iwai E, Saito HA, Tanaka K (1988) Polysensory properties of neurons in the anterior bank of the caudal superior temporal sulcus of the macaque monkey. J Neurophysiol 60:1615-1637
24. Luce RD (1986) Response times. Their role in inferring elementary mental organization. Oxford University Press, New York
25. Lütkenhöhner B, Lammertmann C, Simões C, Hari R (2002) Magnetoencephalographic correlates of audiotactile interaction. Neuroimage 15:509-522
26. Mangun GR, Hillyard SA, Luck SJ (1993). Electrocortical substrates of visual selective attention. In: Meyer DE, Kornblum S (eds) Attention and performance XIV, MIT Press, Cambridge, pp 219-243
27. Manuzza S (1980) Cross-modal reaction time and schizophrenic attentional deficit: a critical review. Schizophr Bull 6:654-675
28. Matsuhashi M, Ikeda A, Ohara S, Matsumoto R, Yamamoto J, Takayama M, Satow T, Begum T, Usui K, Nagamine T, Mikuni N, Takahashi J, Miyamoto S, Fukuyama H, Shibasaki H (2004) Multisensory convergence at human temporo-parietal junction-epicortical recording of evoked responses. Clin Neurophysiol 115:1145-1160
29. Meredith MA, Stein BE (1987) Spatial factors determine the activity of multisensory neurons in the cat's superior colliculus. Brain Res 420:162-166
30. Miller J (1982) Divided attention: evidence for coactivation with redundant signals. Cognit Psychol 14:247-279
31. Miller J (1986) Timecourse of coactivation in bimodal divided attention. Percept Psychophys 40:331-343
32. Miller J, Ulrich R (2003) Simple reaction time and statistical facilitation: a parallel grains model. Cognit Psychol 46:101-151
33. Molholm S, Ritter W, Murray MM, Javitt DC, Schroeder CE, Foxe JJ (2002) Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Brain Res Cogn Brain Res 14:115-128
34. Molholm S, Ritter W, Javitt DC, Foxe JJ (2004) Multisensory visual-auditory object recognition in humans: a high-density electrical mapping study. Cereb Cortex 14:452-465
35. Molholm S, Sehatpour P, Mehta AD, Shpaner M, Gomez-Ramirez M, Ortigue S, Dyke JP, Schwartz TH, Foxe JJ (2006) Audio-visual multisensory integration in superior parietal lobule revealed by human intracranial recordings. J Neurophysiol 96:721-729
36. Mowrer OH, Rayman NN, Bliss EL (1940) Preparatory set (expectancy)-an experimental demonstration of its 'central' locus. J Exp Psychol 26:357-372
37. Murray MM, Molholm S, Michel CM, Heslenfeld DJ, Ritter W, Javitt DC, Schroeder CE, Foxe JJ (2005) Grabbing your ear: rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment. Cereb Cortex 5:963-974
38. Posner MI (1980) Orienting of attention. Q J Exp Psychol 32:3-25
39. Raab DH (1962) Statistical facilitation of simple reaction times. Trans N Y Acad Sci 24:574-590
40. Rist F, Cohen R (1987) Effects of modality shift on event-related potentials and reaction times of chronic schizophrenics. In: Johnson JR, Rohrbaugh JW, Parasuraman R (eds) Current trends in event-related potential research. Electroencephalogr Clin Neurophysiol Suppl 40:738-745
41. Sakowitz OW, Quiroga RQ, Schürmann M, Başar E (2005) Spatio-temporal frequency characteristics of intersensory components in audiovisually evoked potentials. Brain Res Cogn Brain Res 23:316-326
42. Schlack A, Strebing-D'Angelo S, Hartung K, Hoffmann KP, Bremmer F (2005) Multisensory space representations in the Macaque ventral intraparietal area. J Neurosci 25:4616-4625
43. Schroeder CE, Foxe JJ (2002) The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex. Brain Res Cogn Brain Res 14:187-198
44. Schroeder CE, Molholm S, Lakatos P, Ritter W, Foxe JJ (2004) Human-simian correspondence in the early cortical processing of multisensory cues. Cogn Process 5:140-151
45. Schürmann M, Kolev V, Menzel K, Yordanova J (2002) Spatial coincidence modulates interaction between visual and somatosensory evoked potentials. Neuroreport 13:779-783
46. Schwarz W (1994) Diffusion, superposition, and the redundant-targets effect. J Math Psychol 38:504-520
47. Spence C, Nicholls MER, Driver J (2001) The cost of expecting events in the wrong sensory modality. Percept Psychophys 63:330-336
48. Sutton S, Zubin J (1965) Effect of sequence on reaction time in schizophrenia. In: Welford AT, Birren JE (eds) Behavior, aging, and the nervous system. Thomas, Springfield, pp 562-597
49. Talsma D, Woldorff MG (2005) Selective attention and multisensory integration: multiple phases of effects on the evoked brain activity. J Cogn Neurosci 17:1098-1114
50. Teder-Sälejärvi WA, McDonald JJ, Di Russo F, Hillyard SA (2002) An analysis of audio-visual crossmodal integration by means of event-related potential (ERP) recordings. Brain Res Cogn Brain Res 14:106-114
51. Wallace MT, Stein BE (2001) Sensory and multisensory responses in the newborn monkey superior colliculus. J Neurosci 21:8886-8894
52. Wallace MT, Ramachandran R, Stein BE (2004) A revised view of sensory cortical parcellation. Proc Natl Acad Sci 101:2167-2172
53. Walter WG, Cooper R, Aldridge VJ, McCallum WC, Winter AL (1964) The contingent negative variation. Nature 203:380-384
54. van Wassenhove V, Grant KW, Poeppel D (2005) Visual speech speeds up the neural processing of auditory speech. Proc Natl Acad Sci 102:1181-1186
55. Welch RB, Warren DH (1986) Intersensory interactions. In: Boff KR, Kaufman L, Thomas JP (eds) Handbook of perception and human performance. Wiley, New York, pp 25/1-25/36
56. Whitley E, Ball J (2002) Statistics review 5: comparison of means. Crit Care 6:424-428
57. Zubin J (1975) The problem of attention in schizophrenia. In: Kietzmann ML, Sutton S, Zubin J (eds) Experimental approaches to psychopathology. Academic, New York, pp 139-166