Computing an optimal time window of audiovisual integration in focused attention tasks: Illustrated by studies on effect of age and prior knowledge

Experimental Brain Research

Volumn 212, Issue 3, 2011, Pages 327-337

  Colonius, Hans ^a,c   Diederich, Adele ^b,c  

^a UNIVERSITY OF OLDENBURG   (Germany)

^b JACOBS UNIVERSITY BREMEN   (Germany)

^c Research Center Neurosensory Science   (Germany)

Author keywords

Multisensory integration; Optimal time window of integration focused attention; Saccadic reaction time

Indexed keywords

AGE; AGED; ARTICLE; ATTENTION; AUDITORY STIMULATION; HUMAN; PRIORITY JOURNAL; REACTION TIME; SACCADIC EYE MOVEMENT; SPATIAL ORIENTATION; TIME PERCEPTION; TIME WINDOW OF INTEGRATION; VELOCITY; VISUAL INFORMATION; VISUAL ORIENTATION; VISUAL STIMULATION;

ACOUSTIC STIMULATION; ADULT; AGING; ATTENTION; AUDITORY PERCEPTION; FEMALE; HUMANS; KNOWLEDGE; MALE; PHOTIC STIMULATION; REACTION TIME; SACCADES; TIME FACTORS; VISUAL PERCEPTION;

EID: 79960937680     PISSN: 00144819     EISSN: 14321106     Source Type: Journal    
DOI: 10.1007/s00221-011-2732-x     Document Type: Article

References (63)

1. Alais D, Burr D (2004) The ventriloquist effect results from nearoptimal bimodal integration. Curr Biol 14:257-262 (Pubitemid 38215356)
2. Anastasio TJ, Patton PE, Belkacem-Boussaid K (2000) Using Bayes' rule to model multisensory enhancement in the superior colliculus. Neural Comput 12:1165-1187
3. Battaglia PW, Jacobs RA, Aslin RN (2003) Bayesian integration of visual and auditory signals for spatial localization. J Opt Soc Am Optic Image Vis 20:1391-1397
4. Beierholm U, Koerding K, Shams L, Ma WJ (2008) Comparing Bayesian models for multisensory cue combination without mandatory integration. Advances in neural information processing systems, vol 20. The MIT Press, Cambridge, pp 81-88
5. Cohen MX (2011) It's about time. Front Hum Neurosci 5:2. doi: 10.3389/fnhum.2011.00002
6. Colonius H, Arndt P (2001) two-stage model for visual-auditory interaction in saccadic latencies. Percept Psychophys 63:126-147 (Pubitemid 33610236)
7. Colonius H, Diederich A (2010) The optimal time window of visual-auditory integration: a reaction time analysis. Front Integr Neurosci 4:11. doi:10.338/fnint.2010.00011
8. Colonius H, Diederich A (2006) Race model inequality: interpreting a geometric measure of the amount of violation. Psychol Rev 113(1):148-154 (Pubitemid 43283714)
9. Colonius H, Diederich A (2004) Multisensory interaction in saccadic reaction time: a time-window-of-integration model. J Cog Neurosci 16:1000-1009 (Pubitemid 38998777)
10. Colonius H, Diederich A (2004) Why aren't all deep superior colliculus neurons multisensory? A Bayes' ratio analysis. Cog Affect Behav Neurosci 4(3):344-353 (Pubitemid 39350500)
11. Corneil BD, Munoz DP (1996) The influence of auditory and visual distractors on human orienting gaze shifts. J Neurosci 16:8193-8207 (Pubitemid 26405079)
12. Diederich A, Colonius H (2011) Modeling multisensory processes in saccadic responses: time-window-of-integration model. In: Wallace MT, Murray MM (eds) Frontiers in the neural bases of multisensory processes. CRC Press, Boca Raton
13. Diederich A, Colonius H (2007) Why two "distractors" are better than one: modeling the effect of non-target auditory and tactile stimuli on visual saccadic reaction time. Exp Brain Res 179:43-54
14. Diederich A, Colonius H (2007) Modeling spatial effects in visual-tactile saccadic reaction time. Percept Psychophys 69(1):56-67
15. Diederich A, Colonius H (2008) Crossmodal interaction in saccadic reaction time: separating multisensory from warning effects in the time window of integration model. Exp Brain Res 186:1-22
16. Diederich A, Colonius H (2008) When a high-intensity " distractor" is better then a low-intensity one: modeling the effect of an auditory or tactile nontarget stimulus on visual saccadic reaction time. Brain Res 1242:219-230
17. Diederich A, Colonius H (2004) Modeling the time course of multisensory interaction in manual and saccadic responses. In: Calvert G, Spence C, Stein BE (eds) Handbook of multisensory processes. The MIT Press, Cambridge, pp 395-408
18. Diederich A, Colonius H (1987) Intersensory facilitation in the motor component? A reaction time analysis. Psychol Res 49:23-29
19. Diederich A, Colonius H, Schomburg A (2008) Assessing age-related multisensory enhancement with the time-window-of-integration model. Neuropsychologia 46:2556-2562
20. Di Luca M, Machulla TK, Ernst MO (2009) Recalibration of multisensory simultaneity: cross-modal transfer coincides with a change in perceptual latency. J Vis 9(12):1-16
21. Ernst MO (2007) Learning to integrate arbitrary signals from vision and touch. J Vis 7(5):1-14
22. Ernst MO, Banks MS (2002) Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415(6870):429-433 (Pubitemid 34100953)
23. Ernst MO (2005) A Bayesian view on multimodal cue integration. In: Knoblich G, Thornton I, Grosjean M, Shiffrar M (eds) Human body perception from the inside out. Oxford University Press, New York, pp 105-131
24. Frens MA, Van Opstal AJ, Vander Willigen RF (1995) Spatial and temporal factors determine auditory-visual interactions in human saccadic eye movements. Percept Psychophys 57:802-816
25. Giray M, Ulrich R (1993) Motor coactivation revealed by response force in divided and focused attention. J Exp Psychol Hum Percept Perform 19(6):1278-1291
26. Harrington LK, Peck CK (1998) Spatial disparity affects visualauditory interactions in human sensorimotor processing. Exp Brain Res 122:247-252 (Pubitemid 28414358)
27. Hillis JM, Ernst MO, Banks MS, Landy MS (2002) Combining sensory information: mandatory fusion within, but not between, senses. Science 298(5598):1627-1630 (Pubitemid 35387202)
28. Hugenschmidt CE, Mozolic JL, Tan H, Kraft RA, Laurienti PJ (2009) Age-related increase in cross-sensory noise in resting and steady-state cerebral perfusion. Brain Topogr 21(3-4):241-251
29. Hughes HC, Nelson MD, Aronchick DM (1998) Spatial characteristics of visual-auditory summation in human saccades. Vis Res 38:3955-3963 (Pubitemid 28433182)
30. Innes-Brown H, Crewther D (2009) The Impact of spatial Incongruence on an auditory-visual Illusion. PLoS ONE 4(7). doi: 10.1371/journal.pone.0006450
31. Keetels M, Vroomen J (2007) No effect of auditory-visual spatial disparity on temporal recalibration. Exp Brain Res 182(4):559-565 (Pubitemid 47403853)
32. Körding KP, Beierholm U, Ma WJ, Quartz S, Tenenbaum JB, Shams L (2007) Causal inference in multisensory perception. PLoS ONE 2(9):e943. doi:10.1371/journal.pone.0000943
33. Kotz S, Kozubowski TJ, Podgórski K (2001) The Laplace distribution and generalizations. A revisit with applications to communications, economics, engineering, and finance. Birkhäuser, Boston
34. Kubovy M, Schutz M (2010) Audio-visual objects. Rev Phil Psych 1:41-61
35. Laurienti PJ, Burdette JH, Maldjian JA, Wallace MT (2006) Enhanced multisensory integration in older adults. Neurobiol Aging 27:1155-1163 (Pubitemid 43850639)
36. Lewkowicz DJ (1996) Perception of auditory-visual temporal synchrony in human infants. J Exp Psychol: Hum Percept Perform 22:1094-1106
37. Lewkowicz DJ (2010) Infant perception of audio-visual speech synchrony. Dev Psychol 46(1):66-77
38. Meredith MA (2002) On the neural basis for multisensory convergence: a brief overview. Cogn Brain Res 14:31-40
39. Miller JO (1982) Divided attention: evidence for coactivation with redundant signals. Cogn Psychol 14:247-279
40. Molholm S, Ritter W, Javitt DC, Foxe JJ (2004) Multisensory visual-auditory object recognition in humans: a highdensity electrical mapping study. Cereb Cortex 14:452-465 (Pubitemid 38506976)
41. Parise C, Spence C (2009) 'When birds of a feather clock together': synesthetic correspondences modulate audiovisual integration in non-synesthetes. PLoS ONE 4(5):e5664
42. Peiffer AM, Mozolica JL, Hugenschmidt CE, Laurienti PJ (2007) Age-related multisensory enhancement in a simple audiovisual detection task. Neuro Report 18(10):1077-1081 (Pubitemid 46905188)
43. Poliakoff E, Shore DI, Lowe C, Spence C (2006) Visuotactile temporal order judgments in ageing. Neurosci Lett 396(3):207-211 (Pubitemid 43331032)
44. Powers AR III, Hillock AR, Wallace MT (2009) Perceptual training narrows the temporal window of multisensory binding. J Neurosci 29(39):12265-12274
45. Raab DH (1962) Statistical facilitation of simple reaction times. Trans NY Acad Sci 24:574-590
46. Roach NW, Heron J, McGraw PV (2006) Resolving multisensory conflict: a strategy for balancing the costs and benefits of audiovisual integration. Proc Biol Sci 273:2159-2168 (Pubitemid 44318305)
47. Roseboom W, Nishida S, Arnold DH (2009) The sliding window of audio-visual simultaneity. J Vis 9(12):4.1-8.1
48. Sanabria D, Soto-Faraco S, Chan JS, Spence C (2005) Intramodal perceptual grouping modulates multisensory integration: evidence from the crossmodal congruency task. Neurosci Lett 377:59-64 (Pubitemid 40255640)
49. Sato Y, Toyoizumi T, Aihara K (2007) Bayesian inference explains perception of unity and ventriloquism aftereffect: identification of common sources of audiovisual stimuli. Neural Comput 19(12):3335-3355
50. Setti A, Burke KE, Kenny RA, Newell FN (2011) Is inefficient multisensory processing associated with falls in older people. Exp Brain Res 209(3):375-384
51. Shams L, Kamitani Y, Shimojo S (2000) Illusions. What you see is what you hear. Nature 408(6814):788
52. Shams L, Kamitani Y, Shimojo S (2002) Visual illusion induced by sound. Brain Res Cogn Brain Res 14(1):147-152 (Pubitemid 34626805)
53. Shams L, Ma WJ, Beierholm U (2005) Sound-induced flash illusion as an optimal percept. Neuroreport 16:1923-1927 (Pubitemid 41653515)
54. Soto-Faraco S, Lyons J, Gazzaniga M, Spence C, Kingstone A (2002) The ventriloquist in motion: illusory capture of dynamic information across sensory modalities. Cognit Brain Res 14:139-146 (Pubitemid 34626804)
55. Spence C (2007) Audiovisual multisensory integration. Acoust Sci Technol 28:61-70
56. Stein BE, Meredith MA (1993) The merging of the senses. The MIT Press, Cambridge
57. Van Wanrooij MM, Bell AH, Munoz DP, Van Opstal AJ (2009) The effect of spatial-temporal audiovisual disparities on saccades in a complex scene. Exp Brain Res 198:425-437
58. Van Wanrooij MM, Bremen P, Van Opstal AJ (2010) Acquired prior knowledge modulates audiovisual integration. Eur J Neurosci 31:1763-1771
59. Vroomen J, Keetels M (2010) Perception of intersensory synchrony: a tutorial review. Attent Percept Psychophys 72:871-884
60. Vroomen J, Keetels M, de Gelder B, Bertelson P (2004) Recalibration of temporal order perception by exposure to audio-visual asynchrony. Brain Res Cogn Brain Res 22:32-35 (Pubitemid 39550749)
61. Wallace MT, Roberson GE, Hairston WD, Stein BE, Vaughan JW, Schirillo JA (2004) Unifying multisensory signals across time and space. Exp Brain Res 158(2):252-258 (Pubitemid 39281121)
62. Whitchurch EA, Takahashi TT (2006) Combined auditory and visual stimuli facilitate head saccades in the barn owl (Tyto alba). J Neurophysiol 96:730-745 (Pubitemid 44155213)
63. Wozny D, Beierholm U, Shams L (2010) Probability matching as a computational strategy used in perception. PLoS Comput Biol 6(8):e1000871. doi:10.1371/journal.pcbi.1000871