Modeling multisensory processes in saccadic responses: Time-window-of-integration model

The Neural Bases of Multisensory Processes

Volumn , Issue , 2011, Pages 253-276

  Diederich, Adele ^a   Colonius, Hans ^b  

^a JACOBS UNIVERSITY BREMEN   (Germany)

^b UNIVERSITY OF OLDENBURG   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85022345155     PISSN: None     EISSN: None     Source Type: Book    
DOI: None     Document Type: Chapter

References (60)

1. Amlôt, R., R. Walker, J. Driver, and C. Spence. 2003. Multimodal visual-somatosensory integration in saccade generation. Neuropsychologia 41:1-15.
2. Anastasio, T.J., P.E. Patton, and K. Belkacem-Boussaid. 2000. Using Bayes' rule to model multisensory enhancement in the superior colliculus. Neural Computation 12:1165-1187.
3. Arndt, A., and H. Colonius. 2003. Two separate stages in crossmodal saccadic integration: Evidence from vary-ing intensity of an auditory accessory stimulus. Experimental Brain Research 150:417-426.
4. Bell, A.H., A. Meredith, A.J. Van Opstal, and D.P. Munoz. 2005. Crossmodal integration in the primate superior colliculus underlying the preparation and initiation of saccadic eye movements. Journal of Neurophysiology 93:3659-3673.
5. Clemo, H.R., and B.E. Stein. 1986. Effects of cooling somatosensory corticotectal influences in cat. Journal of Neurophysiology 55:1352-1368.
6. Colonius, H., and P. Arndt. 2001. A two-stage model for visual-auditory interaction in saccadic latencies. Perception & Psychophysics, 63:126-147.
7. Colonius, H., and A. Diederich. 2002. A maximum-likelihood approach to modeling multisensory enhance-ment. In Advances in Neural Information Processing Systems 14, T.G. Ditterich, S. Becker, and Z. Ghahramani (eds.). Cambridge, MA: MIT Press.
8. Colonius, H., and A. Diederich. 2004. Multisensory interaction in saccadic reaction time: A time-window-of-integration model. Journal of Cognitive Neuroscience 16:1000-1009.
9. Colonius, H., and A. Diederich. 2006. Race model inequality: Interpreting a geometric measure of the amount of violation. Psychological Review 113(1):148-154.
10. Colonius, H., and A. Diederich. 2010. The optimal time window of visual-auditory integration: A reaction time analysis. Frontiers in Integrative Neuroscience, 4:11. doi:10.3389/fnint.2010.00011.
11. Colonius, H., and D. Vorberg. 1994. Distribution inequalities for parallel models with unlimited capacity. Journal of Mathematical Psychology 38:35-58.
12. Colonius, H., A. Diederich, and R. Steenken. 2009. Time-window-of-integration (TWIN) model for saccadic reaction time: Effect of auditory masker level on visual-auditory spatial interaction in elevation. Brain Topography 21:177-184.
13. Corneil, B.D., and D.P. Munoz. 1996. The influence of auditory and visual distractors on human orienting gaze shifts. Journal of Neuroscience 16:8193-8207.
14. Corneil, B.D., M. Van Wanrooij, D.P. Munoz, A.J. Van Opstal. 2002. Auditory-visual interactions subserving goal-directed saccades in a complex scene. Journal of Neurophysiology 88:438-454.
15. Diederich, A. 1995. Intersensory facilitation of reaction time: Evaluation of counter and diffusion coactivation models. Journal of Mathematical Psychology 39:197-215.
16. Diederich, A. 2008. A further test on sequential sampling models accounting for payoff effects on response bias in perceptual decision tasks. Perception & Psychophysics 70(2):229-256.
17. Diederich, A., and H. Colonius. 2004a. Modeling the time course of multisensory interaction in manual and saccadic responses. In Handbook of multisensory processes, ed. G. Calvert, C. Spence, and B.E. Stein, 395-408. Cambridge, MA: MIT Press.
18. Diederich, A., and H. Colonius. 2004b. Bimodal and trimodal multisensory enhancement: Effects of stimulus onset and intensity on reaction time. Perception & Psychophysics 66(8):1388-1404.
19. Diederich, A., and H. Colonius. 2007a. Why two "distractors" are better than one: Modeling the effect of nontarget auditory and tactile stimuli on visual saccadic reaction time. Experimental Brain Research 179:43-54.
20. Diederich, A., and H. Colonius. 2007b. Modeling spatial effects in visual-tactile saccadic reaction time. Perception & Psychophysics 69(1):56-67.
21. Diederich, A., and H. Colonius. 2008. Crossmodal interaction in saccadic reaction time: Separating multisensory from warning effects in the time window of integration model. Experimental Brain Research 186:1-22.
22. Diederich, A., H. Colonius, D. Bockhorst, and S. Tabeling. 2003. Visual-tactile spatial interaction in saccade generation. Experimental Brain Research 148:328-337.
23. Diederich, A., H. Colonius, and A. Schomburg. 2008. Assessing age-related multisensory enhancement with the time-window-of-integration model. Neuropsychologia 46:2556-2562.
24. Doyle, M.C., and R. Walker. 2002. Multisensory interactions in saccade target selection: Curved saccade tra-jectories Experimental Brain Research 142:116-130.
25. Driver, J., and C. Spence. 2004. Crossmodal spatial attention: Evidence from human performance. In Crossmodal space and crossmodal attention, ed. C. Spence and J. Driver, 179-220. Oxford: Oxford Univ. Press.
26. Eimer, M. 2001. Crossmodal links in spatial attention between vision, audition, and touch: Evidence from event-related brain potentials. Neuropsychologia 39:1292-1303.
27. Frens, M.A., A.J. Van Opstal, and R.F. Van der Willigen. 1995. Spatial and temporal factors determine auditory-visual interactions in human saccadic eye movements. Perception & Psychophysics 57:802-816.
28. Harrington, L.K., and C.K. Peck. 1998. Spatial disparity affects visual-auditory interactions in human senso-rimotor processing. Experimental Brain Research 122:247-252.
29. Hershenson, M. 1962. Reaction time as a measure of intersensory facilitation. Journal of Experimental Psychology 63:289-293.
30. Hughes, H.C., P.-A. Reuter-Lorenz, G. Nozawa, and R. Fendrich. 1994. Visual-auditory interactions in sen-sorimotor processing: Saccades versus manual responses. Journal of Experimental Psychology: Human Perception and Performance 20:131-153.
31. Hughes, H.C., M.D. Nelson, and D.M. Aronchick. 1998. Spatial characteristics of visual-auditory summation in human saccades. Vision Research 38:3955-3963.
32. Jiang, W., M.T. Wallace, H. Jiang, J.W. Vaughan, and B.E. Stein. 2001. Two cortical areas mediate multisensory integration in superior colliculus neurons. Journal of Neurophysiology 85:506-522.
33. Jiang, W., H. Jiang, and B.E. Stein. 2002. Two cortical areas facilitate multisensory orientation behaviour. Journal of Cognitive Neuroscience 14:1240-1255.
34. Körding, K.P., U. Beierholm, W.J. Ma, S. Quartz, J.B. Tenenbaum et al. 2007. Causal inference in multisensory perception. PLoS ONE 2(9):e943, doi:10.1371/journal.pone.0000943.
35. Klein, R., and A. Kingstone. 1993. Why do visual offsets reduce saccadic latencies? Behavioral and Brain Sciences 16(3):583-584.
36. Luce, R.D. 1986. Response times: Their role in inferring elementary mental organization. New York: Oxford Univ. Press.
37. Meredith, M.A. 2002. On the neural basis for multisensory convergence: A brief overview. Cognitive Brain Research 14:31-40.
38. Meredith, M.A., and B.E. Stein. 1986. Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration. Journal of Neurophysiology 56:640-662.
39. Meredith, M.A., J.W. Nemitz, and B.E. Stein. 1987. Determinants of multisensory integration in superior col-liculus neurons. I. Temporal factors. Journal of Neuroscience 10:3215-3229.
40. Miller, J.O. 1982. Divided attention: Evidence for coactivation with redundant signals. Cognitive Psychology 14:247-279.
41. Munoz, D.P., and R. H. Wurtz. 1995. Saccade-related activity in monkey superior colliculus. I. Characteristics of burst and buildup cells. Journal of Neurophysiology 73:2313-2333.
42. Navarra, J., A. Vatakis, M. Zampini, S. Soto-Faraco, W. Humphreys, and C. Spence. 2005. Exposure to asyn-chronous audiovisual speech extends the temporal window for audiovisual integration. Cognitive Brain Research 25:499-507.
43. Nickerson, R.S. 1973. Intersensory facilitation of reaction time: Energy summation or preparation enhance-ment. Psychological Review 80:489-509.
44. Raab, D.H. 1962. Statistical facilitation of simple reaction times. Transactions of the New York Academy of Science 24:574-590.
45. Reuter-Lorenz, P.A., H.C. Hughes, and R. Fendrich. 1991. The reduction of saccadic latency by prior offset of the fixation point: An analysis of the gap effect. Perception & Psychophysics 49(2):167-175.
46. Ross, S.M., and L.E. Ross. 1981. Saccade latency and warning signals: Effects of auditory and visual stimulus onset and offset. Perception & Psychophysics 29(5):429-437.
47. Rowland, B.A., and B.E. Stein. 2008. Temporal profiles of response enhancement in multisensory integration. Frontiers in Neuroscience 2:218-224.
48. Schweickert, R., D.L. Fisher, and K. Sung. Discovering Cognitive Architecture by Selectively Influencing Mental Processes. London: World Scientific Publishing (in press).
49. Sinclair, C., and G.R. Hammond. 2009. Excitatory and inhibitory processes in primary motor cortex during the foreperiod of a warned reaction time task are unrelated to response expectancy. Experimental Brain Research 194:103-113.
50. Spence, C., and S. Squire. 2003. Multisensory integration: Maintaining the perception of synchrony. Current Biology 13:R519-R521.
51. Stein, B.E., and Meredith M.A. 1993. The Merging of the Senses. Cambridge, MA: MIT Press.
52. Stein, B.E., W.S. Huneycutt, and M.A. Meredith. 1988. Neurons and behavior: The same rules of multisensory integration apply. Brain Research 448:355-358.
53. Stein, B.E., W. Jiang, and T.R. Stanford. 2004. Multisensory integration in single neurons in the midbrain. In Handbook of multisensory processes, ed. G. Calvert, C. Spence, and B.E. Stein, 243-264. Cambridge, MA: MIT Press.
54. Sternberg, S. 2001. Separate modifiability, mental modules, and the use of pure and composite measures to reveal them. Acta Psychologica 106:147-246.
55. Todd, J.W. 1912. Reaction to multiple stimuli, in Archives of Psychology, No. 25. Columbia contributions to philosophy and psychology, ed. R.S. Woodworth, Vol. XXI, No. 8, New York: The Science Press.
56. Townsend, J.T., and G. Nozawa. 1995. Spatio-temporal properties of elementary perception: An investigation of parallel, serial, and coactive theories. Journal of Mathematical Psychology 39:321-359.
57. Van Opstal, A.J., and D.P. Munoz. 2004. Auditory-visual interactions subserving primate gaze orienting. In Handbook of multisensory processes, ed. G. Calvert, C. Spence, and B.E. Stein, 373-393. Cambridge, MA: MIT Press.
58. Van Wassenhove, V., K.W. Grant, and D. Poeppel. 2007. Temporal window of integration in auditory-visual speech perception. Neuropsychologia 45:598-607.
59. Van Zandt, T. 2002. Analysis of response time distributions. In Stevens' handbook of experimental psychology, vol. 4, 3rd edn, ed. H. Pashler. New York: Wiley & Sons, Inc.
60. Whitchurch, E.A., and T.T. Takahashi. 2006. Combined auditory and visual stimuli facilitate head saccades in the barn owl (Tyto alba). Journal of Neurophysiology 96:730-745.