Evidence for multisensory integration in the elicitation of prior entry by bimodal cues

Experimental Brain Research

Volumn 222, Issue 1-2, 2012, Pages 11-20

  Barrett, Doug J K ^a   Krumbholz, Katrin ^b  

^a UNIVERSITY OF LEICESTER   (United Kingdom)

^b MRC INSTITUTE OF HEARING RESEARCH   (United Kingdom)

Author keywords

Crossmodal; Exogenous attention; Intramodal; Multisensory integration

Indexed keywords

ADULT; AGED; ARTICLE; AUDITORY SYSTEM; FEMALE; HEARING; HUMAN; MALE; PRIORITY JOURNAL; SENSORIMOTOR INTEGRATION; SENSORY STIMULATION; VISION; VISUAL SYSTEM;

ACOUSTIC STIMULATION; ADULT; ANALYSIS OF VARIANCE; ATTENTION; AUDITORY PERCEPTION; BIAS (EPIDEMIOLOGY); CUES; FEMALE; HUMANS; JUDGMENT; MALE; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; PROBABILITY; PSYCHOMETRICS; PSYCHOPHYSICS; REACTION TIME; VISUAL PERCEPTION; YOUNG ADULT;

EID: 84866367398     PISSN: 00144819     EISSN: 14321106     Source Type: Journal    
DOI: 10.1007/s00221-012-3191-8     Document Type: Article

References (67)

1. Angelaki DE, Gu Y, DeAngelis GC (2009) Multisensory integration: psychophysics, neurophysiology, and computation. Curr Opin Neurobiol 19:452-458
2. Barrett DJK, Edmondson-Jones AM, Hall DA (2010) Attention in neglect and extinction: assessing the degree of correspondence between visual and auditory impairments using matched tasks. J Clin Exp Neuropsychol 32:71-80
3. Battaglia PW, Jacobs RA, Aslin RN (2003) Bayesian integration of visual and auditory signals for spatial localization. J Opt Soc Am 20:1391-1397
4. Bertelson P, Vroomen J, De Gelder B, Driver J (2000) The ventriloquist effect does not depend on the direction of deliberate visual attention. Atten Percept Psychophys 62:321-332
5. Botta F, Santengelo V, Raffone A, Sanabria D, Lupianez J, Belardinelli MO (2011) Multisensory integration affects visuo-spatial working memory. J Exp Psychol Hum Percept 37:1099-1109
6. Brainard DH (1997) The psychophysics toolbox. Spat Vis 10:433-436
7. Calvert GA, Thesen T (2004) Multisensory integration: methodological approaches and emerging principles in the human brain. J Physiol Paris 98:191-205
8. Chambers CD, Stokes MG, Mattingley JB (2004) Modality-specific control of strategic spatial attention in parietal cortex. Neuron 44:925-930
9. Driver J, Spence C (1998) Cross-modal links in spatial attention. Philos Trans R Soc B 353:1319-1331
10. Duncan J, Martens S, Ward R (1997) Restricted attentional capacity within but not between sensory modalities. Nature 387:809-810
11. Ernst MO, Banks MS (2002) Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415:429-433
12. Ernst MO, Bulthoff HH (2004) Merging the senses into a robust percept. Trends Cogn Sci 8:162-169
13. Eskes GA, Klein RM, Dove MB, Coolican J, Shore DI (2007) Comparing temporal order judgments and choice reaction time tasks as indices of exogenous spatial cuing. J Neurosci Methods 166:259-265
14. Farah MJ, Wong AB, Monheit MA, Morrow LA (1989) Parietal lobe mechanisms of spatial attention: modality-specific or supramodal? Neuropsychologia 27:461-470
15. Forster B, Cavina-Pratesi C, Aglioti SM, Berlucchi G (2002) Redundant target effect and intersensory facilitation from visual-tactile interactions in simple reaction time. Exp Brain Res 143:480-487
16. Frassinetti F, Bolognini N, Làdavas E (2002) Enhancement of visual perception by crossmodal visuo-auditory interaction. Exp Brain Res 147:332-343
17. Gaudrain E, Li S, Ban VS, Patterson RD (2009) The role of glottal pulse rate and vocal tract length in the perception of speaker identity. Proceedings of the 10th Annual Conference of the International Speech Communication Association (Interspeech 2009). ISSN 1990-9772. p148-151
18. Gu Y, Angelaki DE, DeAngelis GC (2008) Neural correlates of multi-sensory cue integration in macaque area MSTd. Nat Neurosci 11:1201-1210
19. Harrington LK, Peck KP (1998) Spatial disparity affects visual-auditory interactions in human sensorimotor processing. Exp Brain Res 122:247-252
20. Hill NI, Darwin CJ (1996) Lateralization of a perturbed harmonic: effects of onset asynchrony and mistuning. J Acoust Soc Am 100:2352-2364
21. Ho C, Santangelo V, Spence C (2009) Multisensory warning signals: when spatial correspondence matters. Exp Brain Res 195:261-272
22. Holmes NP (2007) The law of inverse effectiveness in neurons and behaviour: multisensory integration versus normal variability. Neuropsychologia 45:3340-3345
23. Holmes NP, Spence C (2005) Multisensory integration: space, time and superadditivity. Curr Biol 15:R762-R764
24. Hukin RW, Darwin CJ (1995) Effects of contralateral presentation and of interaural time differences in segregating a harmonic from a vowel. J Acoust Soc Am 98:1380-1387
25. Kanabus M, Szelag E, Rojek E, Poppel E (2002) Temporal order judgement for auditory and visual stimuli. Acta Neurobiol Exp 62:263-270
26. Kingdom AA, Prins N (2010) Psychophysics a practical introduction. Academic Press, London
27. Koelewijn T, Bronkhorst A, Theeuwes J (2010) Attention and the multiple stages of multisensory integration: a review of audiovisual studies. Acta Psychol 134:372-384
28. Ma WJ, Pouget A (2008) Linking neurons to behavior in multisensory perception: a computational review. Brain Res 1242:4-12
29. McDonald JJ, Teder-Salejarvi WA, Di Russo F, Hillyard SA (2005) Neural basis of auditory-induced shifts in visual time-order perception. Nat Neurosci 8:1197-1202
30. McDonald JJ, Teder-Sälejärvi WA, Ward LM (2001) Multisensory integration and crossmodal attention effects in the human brain. Science 292:1791-1792
31. McDonald JJ, Ward LM (1999) Spatial relevance determines facilitatory and inhibitory effects of auditory covert spatial orienting. J Exp Psychol Hum Percept 25:1234-1252
32. McFarland DJ, Cacace AT, Setzen G (1998) Temporal-order discrimination for selected auditory and visual stimulus dimensions. J Speech Lang Hear Res 41:300-314
33. Meredith MA, Stein BE (1983) Interactions among converging sensory inputs in the superior colliculus. Science 221:389-391
34. Meyer DE, Osman AM, Irwin DE, Yantis S (1988) Modern mental chronometry. Biol Psychol 26:3-67
35. Miller J (1986) Timecourse of coactivation in bimodal divided attention. Percept Psychophys 40:331-343
36. Molholm S, Ritter W, Murray MM, Javitt DC, Schroeder CE, Foxe JJ (2002) Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Cogn Brain Res 14:115-128
37. Moore BCJ (2004) An introduction to the psychology of hearing, 5th edn. Elsevier Academic Press, London
38. Mondor TA, Amirault KJ (1998) Effect of same-and different-modality spatial cues on auditory and visual target identification. J Exp Psychol Hum Percept 24:745-755
39. Morgan ML, DeAngelis GC, Angelaki DE (2008) Multisensory integration in macaque visual cortex depends on cue reliability. Neuron 59:662-673
40. Müller HJ, Rabbitt PM (1989) Reflexive and voluntary orienting of visual attention: time course of activation and resistance to interruption. J Exp Psychol Hum Percept 15:315-330
41. Mulligan RM, Shaw ML (1980) Multimodal signal detection: independent decisions vs. integration. Percept Psychophys 28:471-478
42. Roach NW, Heron J, McGraw PV (2006) Resolving multisensory conflict: a strategy for balancing the costs and benefits of audio-visual integration. Philos Trans R Soc B 273:2159-2168
43. Santangelo V, Ho C, Spence C (2008a) Capturing spatial attention with multisensory cues. Psychon Bull Rev 15:398-403
44. Santangelo V, Spence C (2007) Multisensory cues capture spatial attention regardless of perceptual load. J Exp Psychol Hum Percept 33:1311-1321
45. Santangelo V, Spence C (2009) Crossmodal exogenous orienting improves the accuracy of temporal order judgements. Exp Brain Res 194:577-586
46. Santangelo V, Van der Lubbe RHJ, Belardinelli MO, Postma A (2006) Spatial attention triggered by unimodal, crossmodal, and bimodal exogenous cues: a comparison of reflexive orienting mechanisms. Exp Brain Res 173:40-48
47. Santangelo V, Van der Lubbe RHJ, Olivetti Belardinelli M, Postma A (2008b) Multisensory integration affects ERP components elicited by exogenous cues. Exp Brain Res 185:269-277
48. Schneider KA, Bevelier D (2003) Components of visual prior entry. Cogn Psychol 47:333-366
49. Shore DI, Spence C, Klein RM (2001) Visual prior entry. Psychol Sci 12:205-212
50. Sinnett S, Soto-Faraco S, Spence C (2008) The co-occurrence of multisensory competition and facilitation. Acta Psychol 128:153-161
51. Spence C (2010) Crossmodal spatial attention. Ann N Y Acad Sci 1191:182-200
52. Spence C, Parise C (2010) Prior-entry: a review. Conscious Cogn 19:364-379
53. Spence C, Driver J (1997) Audiovisual links in exogenous covert spatial orienting. Percept Psychophys 59:1-22
54. Spence C, Driver J (1999) A new approach to the design of multimodal warning signals. In: Harris D (ed) Engineering psychology and cognitive ergonomics, vol IV. Ashgate Publishing, Aldershot, pp 455-461
55. Stein BE, Stanford TR (2008) Multisensory integration: current issues from the perspective of the single neuron. Nat Rev Neurosci 9:255-266
56. Stein BE, Stanford TR, Ramachandran R, Perrault TJ, Rowland BA (2009) Challenges in quantifying multisensory integration: alternative criteria, models, and inverse effectiveness. Exp Brain Res 198:113-126
57. Stelmach LB, Herdman CM (1991) Directed attention and perception of temporal order. J Exp Psychol Hum Percept 17:539-550
58. Störmer VS, McDonald JJ, Hillyard SA (2009) Cross-modal cueing of attention alters appearance and early cortical processing of visual stimuli. Proc Natl Acad Sci USA 106:22456-22461
59. Talsma D, Senkowski D, Soto-Faraco S, Woldorff MG (2010) The multifaceted interplay between attention and multisensory integration. Trends Cogn Sci 14:400-410
60. Teder-Sälejärvi W, Russo FD, McDonald J, Hillyard SA (2005) Effects of spatial congruity on audio-visual multimodal integration. J Cogn Neurosci 17:1396-1409
61. Tollin DJ (2003) The lateral superior olive: a functional role in sound source localization. Neuroscientist 9:127-143
62. van Eijk RLJ, Kohlrausch A, Juola FJ, van de Par S (2008) Audio-visual synchrony and temporal order judgements: effects of experimental method and stimulus type. Percept Psychophys 70:955-968
63. Ward LM (1994) Supramodal and modality-specific mechanisms for stimulus-driven shifts of auditory and visual attention. Can J Exp Psychol 48:242-259
64. Werner S, Noppeney U (2010) Superadditive responses in superior temporal sulcus predict audiovisual benefits in object categorization. Cereb Cortex 20:1829-1842
65. Yates MJ, Nicholls ER (2011) Somatosensory prior entry. Atten Percept Psychophys 71(4):847-859
66. Zampini M, Shore DI, Spence C (2005) Audiovisual prior entry. Neurosci Lett 381:217-222
67. Zimmer U, Macaluso E (2007) Processing of multisensory spatial congruency can be dissociated from working memory and visuo-spatial attention. Eur J Neurosci 26:1681-1691