Multisensory enhancement: Gains in choice and in simple response times

Experimental Brain Research

Volumn 189, Issue 2, 2008, Pages 133-143

  Hecht, David ^a,b   Reiner, Miriam ^a   Karni, Avi ^b  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

^b UNIVERSITY OF HAIFA   (Israel)

Author keywords

Choice reaction time; Inverse effectiveness; Multisensory enhancement; Simple reaction time

Indexed keywords

ARTICLE; AUDITORY STIMULATION; BAYES THEOREM; COGNITION; MOTOR PERFORMANCE; PERCEPTION; PRIORITY JOURNAL; SENSORY SYSTEM; VISUAL STIMULATION;

ACOUSTIC STIMULATION; ADULT; AUDITORY PERCEPTION; CHOICE BEHAVIOR; FEMALE; HUMANS; MALE; PHOTIC STIMULATION; PHYSICAL STIMULATION; PSYCHOMOTOR PERFORMANCE; REACTION TIME; TOUCH; VISUAL PERCEPTION;

EID: 48349112625     PISSN: 00144819     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00221-008-1410-0     Document Type: Article

References (74)

1. Balas M (2006) Context and experience as factors in motor interference and motor representations: learning a finger opposition sequence and handwriting - behavioral and fMRI studies. Ph.D. thesis, University of Haifa, Israel
2. PM Bays DM Wolpert 2007 Computational principles of sensorimotor control that minimize uncertainty and variability J Physiol 278 2 387 396
3. M Delazer A Lochy C Jenner F Domahs T Benke 2002 When writing 0 (zero) is easier than writing O (o): a neuropsychological case study of agraphia Neuropsychologia 40 12 2167 2177
4. A Diederich H Colonius 2004 Bimodal and trimodal multisensory enhancement: effects of stimulus onset and intensity on reaction time Percept Psychophys 66 8 1388 1404
5. A Diederich H Colonius D Bockhorst S Tabeling 2003 Visual-tactile spatial interaction in saccade generation Exp Brain Res 148 3 328 37
6. A Diederich H Colonius 1987 Intersensory facilitation in the motor component? Psychol Res 49 1 23 29
7. Donders FC (1969) Over de snelheid van psychische processen (On the speed of psychological processes). In: Koster W (ed and trans) Attention and performance: II. North-Holland, Amsterdam (Original work published 1868)
8. MC Doyle RJ Snowden 2001 Identification of visual stimuli is improved by accompanying auditory stimuli: the role of eye movements and sound location Perception 30 7 795 810
9. B Forster C Cavina-Pratesi S Aglioti G Berlucchi 2002 Redundant target effect and intersensory facilitation from visual-tactile interactions in simple reaction time Exp Brain Res 143 4 480 487
10. A Fort C Delpuech J Pernier MH Giard 2002 Dynamics of cortico-subcortical cross-modal operations involved in audio-visual object detection in humans Cereb Cortex 12 10 1031 1039
11. JJ Foxe IA Morocz MM Murray BA Higgins DC Javitt CE Schroeder 2000 Multisensory auditory-somatosensory interactions in early cortical processing revealed by high-density electrical mapping Brain Res Cogn Brain Res 10 1 77 83
12. AA Ghazanfar JX Maier KL Hoffman NK Logothetis 2005 Multisensory integration of dynamic faces and voices in rhesus monkey auditory cortex J Neurosci 25 20 5004 5012
13. MH Giard F Peronnet 1999 Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study J Cogn Neurosci 11 5 473 490
14. M Giray R Ulrich 1993 Motor coactivation revealed by response force in divided and focused attention J Exp Psychol Hum Percept Perform 19 6 1278 91
15. R Gobbelé M Schürmann N Forss K Juottonen H Buchner R Hari 2003 Activation of the human posterior and temporoparietal cortices during audiotactile interaction Neuroimage 20 1 503 511
16. JA Gottfried RJ Dolan 2003 The nose smells what the eye sees: crossmodal visual facilitation of human olfactory perception Neuron 39 2 375 386
17. MSA Graziano 2001 A system of multimodal areas in the primate brain Neuron 29 4 6
18. MSA Graziano LAJ Reiss CG Gross 1999 A neuronal representation of the location of nearby sounds Nature 397 428 430
19. K Grill-Spector N Kanwisher 2005 Visual recognition. As soon as you know it is there, you know what it is Psychol Sci 16 2 152 160
20. B Hauptmann A Karni 2002 From primed to learn: the saturation of repetition priming and the induction of long-term memory Brain Res Cogn Brain Res 13 3 313 322
21. D Hecht M Reiner A Karni 2008 Enhancement of response times to bi- and tri-modal sensory stimuli during active movements Exp Brain Res 185 4 655 665
22. MA Heller 1982 Visual and tactual texture perception: intersensory cooperation Percept Psychophys 31 4 339 344
23. M Hershenson 1962 Reaction time as a measure of intersensory facilitation J Exp Psychol 63 289 293
24. J Honoré M Bourdeaud'hui L Sparrow 1989 Reduction of cutaneous reaction time by directing eyes towards the source of stimulation Neuropsychologia 27 3 367 371
25. W Jiang MT Wallace H Jiang JW Vaughan BE Stein 2001 Two cortical areas mediate multisensory integration in superior colliculus neurons J Neurophysiol 85 2 506 522
26. C Kayser CI Petkov M Augath NK Logothetis 2005 Integration of touch and sound in auditory cortex Neuron 48 2 373 384
27. KP Körding 2007 Decision theory: what "should" the nervous system do? Science 318 5850 606 610
28. KP Körding DM Wolpert 2006 Bayesian decision theory in sensorimotor control Trends Cog Sci 10 7 320 326
29. PJ Laurienti JH Burdette JA Maldjian MT Wallace 2006 Enhanced multisensory integration in older adults Neurobiol Aging 27 8 1155 1163
30. Lederman SJ, Klatzky RL, Hamilton C, Morgan T (2002) Integrating multimodal information about surface texture via a probe: relative contributions of haptic and touch-produced sound sources. In: Proceedings of the 10th annual symposium on haptic interfaces for teleoperators and virtual environment systems (IEEE VR '02), Orlando, Florida, USA, pp 97-104
31. Luce RD (1991) Response times. Oxford University Press
32. ML Mack I Gauthier J Sadr TJ Palmeri 2008 Object detection and basic-level categorization: sometimes you know it is there before you know what it is Psychon B Rev 15 1 28 35
33. Mack ML, Wong ACN, Gauthier I, Palmeri TJ (2006) The time course of visual object detection and categorization. J Vis 6(6):608. http:// journalofvision.org/6/6/608/. doi: 10.1167/6.6.608
34. JO Miller KA Low 2001 Motor processes in simple, go/no-go, and choice reaction time tasks: a psychophysiological analysis J Exp Psychol Hum Percept Perform 27 2 266 289
35. J Miller R Ulrich Y Lamarre 2001 Locus of the redundant-signals effect in bimodal divided attention: a neurophysiological analysis Percept Psychophys 63 3 555 562
36. J Miller 1986 Time course of coactivation in bimodal divided attention Percept Psychophys 40 331 343
37. J Miller 1982 Divided attention: evidence for coactivation with redundant signals Cognit Psychol 14 2 247 279
38. S Molholm W Ritter DC Javitt JJ Foxe 2004 Multisensory visual-auditory object recognition in humans: a high-density electrical mapping study Cereb Cortex 14 4 452 65
39. S Molholm W Ritter MM Murray DC Javitt CE Schroeder JJ Foxe 2002 Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study Brain Res Cogn Brain Res 14 1 115 28
40. MM Murray S Molholm CM Michel DJ Heslenfeld W Ritter DC Javitt CE Schroeder JJ Foxe 2005 Grabbing your ear: rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment Cereb Cortex 15 7 963 974
41. A Nagy G Eördegh Z Paróczy Z Márkus G Benedek 2006 Multisensory integration in the basal ganglia Eur J Neurosci 24 3 917 924
42. A Nagy Z Paróczy M Norita G Benedek 2005 Multisensory responses and receptive field properties of neurons in the substantia nigra and in the caudate nucleus Eur J Neurosci 22 2 419 424
43. RS Nickerson 1973 Intersensory facilitation of reaction time: energy summation or preparation enhancement? Psychol Rev 80 6 489 509
44. EC Odgaard Y Arieh LE Marks 2004 Brighter noise: sensory enhancement of perceived loudness by concurrent visual stimulation Cogn Affect Behav Neurosci 4 2 127 132
45. RC Oldfield 1971 The assessment and analysis of handedness: the Edinburgh inventory Neuropsychologia 9 1 97 113
46. JP Orliaquet S Kandel LJ Boë 1997 Visual perception of motor anticipation in cursive handwriting: influence of spatial and movement information on the prediction of forthcoming letters Perception 26 7 905 12
47. TJ Perrault Jr JW Vaughan BE Stein MT Wallace 2003 Neuron-specific response characteristics predict the magnitude of multisensory integration J Neurophysiol 90 6 4022 4026
48. FM Plat P Praamstra MW Horstink 2000 Redundant-signals effects on reaction time, response force, and movement-related potentials in Parkinson's disease Exp Brain Res 130 4 533 539
49. DH Raab 1962 Statistical facilitation of simple reaction times Trans NY Acad Sci 24 574 590
50. BA Rowland S Quessy TR Stanford BE Stein 2007 Multisensory integration shortens physiological response latencies J Neurosci 27 22 5879 84
51. BA Rowland TR Stanford BE Stein 2007 A Bayesian model unifies multisensory spatial localization with the physiological properties of the superior colliculus Exp Brain Res 180 1 153 61
52. D Sagi B Julesz 1985 'Where' and 'what' in vision Science 228 4704 1217 9
53. D Sagi B Julesz 1984 Detection versus discrimination of visual orientation Perception 13 5 619 628
54. RF Schmidt WJ Schady HE Torebjork 1990 Gating of tactile input from the hand. I. Effects of finger movement Exp Brain Res 79 1 97 102
55. RF Schmidt HE Torebjork WJ Schady 1990 Gating of tactile input from the hand. II. Effects of remote movements and anaesthesia Exp Brain Res 79 1 103 108
56. R Sekuler AB Sekuler R Lau 1997 Sound alters visual motion perception Nature 385 6614 308
57. K Seki SI Perlmutter EE Fetz 2003 Sensory input to primate spinal cord is presynaptically inhibited during voluntary movement Nat Neurosci 6 1309 16
58. S Shimojo L Shams 2001 Sensory modalities are not separate modalities: plasticity and interactions Curr Opin Neurobiol 11 4 505 509
59. EE Smith 1968 Choice reaction time: an analysis of major theoretical positions Psychol Bull 69 2 77 110
60. R Sosnik T Flash B Hauptmann A Karni 2007 The acquisition and implementation of the smoothness maximization motion strategy is dependent on spatial accuracy demands Exp Brain Res 176 2 311 331
61. R Sosnik B Hauptmann A Karni T Flash 2004 When practice leads to co-articulation: the evolution of geometrically defined movement primitives Exp Brain Res 156 4 422 438
62. DL Sparks 1986 Translation of sensory signals into commands for control of saccadic eye movements: role of primate superior colliculus Physiol Rev 66 1 118 171
63. Stein BE, Jiang W, Stanford TR (2004) Multisensory integration in single neurons of the midbrain. In: Calvert G, Spence C, Stein BE (eds) The handbook of multisensory processes. MIT, Cambridge, pp 243-264
64. BE Stein N London LK Wilkinson DD Price 1996 Enhancement of perceived visual intensity by auditory stimuli: a psychophysical analysis J Cogn Neurosci 8 497 506
65. Stein BE, Meredith MA (1993) The merging of the senses. MIT, Cambridge
66. S Sternberg 1969 The discovery of processing stages: extensions of Donders' method Acta Psychol 30 276 315
67. M Taylor-Clarke S Kennett P Haggard 2002 Vision modulates somatosensory cortical processing Curr Biol 12 3 233 236
68. R Ulrich J Miller H Schröter 2007 Testing the race model inequality: an algorithm and computer programs Behav Res Meth Instr 39 2 291 302
69. R Ulrich S Mattes JO Miller 1999 Donders's assumption of pure insertion: an evaluation on the basis of response dynamics Acta Psychol 102 1 43 75
70. MT Wallace MA Meredith BE Stein 1998 Multisensory integration in the superior colliculus of the alert cat J Neurophysiol 80 2 1006 1110
71. MT Wallace MA Meredith BE Stein 1993 Converging influences from visual, auditory, and somatosensory cortices onto output neurons of the superior colliculus J Neurophysiol 69 1797 1809
72. Watanabe K (2001) Crossmodal interaction in humans. Ph.D. thesis, California Institute of Technology, Pasadena
73. SR Williams CE Chapman 2002 Time course and magnitude of movement-related gating of tactile detection in humans. III. Effect of motor task J Neurophysiol 88 4 1968 1979
74. SR Williams CE Chapman 2000 Time course and magnitude of movement-related gating of tactile detection in humans. II. Effects of stimulus intensity on detection and scaling of tactile stimuli J Neurophysiol 84 2 863 875