Recalibration of the Multisensory Temporal Window of Integration Results from Changing Task Demands

PLoS ONE

Volumn 8, Issue 8, 2013, Pages

  Mégevand, Pierre ^a   Molholm, Sophie ^a   Nayak, Ashabari ^a   Foxe, John J ^a  

^a ALBERT EINSTEIN COLLEGE OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY; ADULT; ARTICLE; AUDITORY DISCRIMINATION; AUDITORY STIMULATION; CONTROLLED STUDY; DECISION MAKING; EXECUTIVE FUNCTION; FACILITATION; FEMALE; HUMAN; HUMAN EXPERIMENT; MALE; MENTAL TASK; MULTISENSORY TEMPORAL WINDOW OF INTEGRATION; NERVOUS SYSTEM PARAMETERS; NEUROPHYSIOLOGY; PROCESS OPTIMIZATION; RESPONSE TIME; SENSORY ANALYSIS; VISUAL DISCRIMINATION; VISUAL STIMULATION;

ADOLESCENT; ADULT; AUDITORY PERCEPTION; DISCRIMINATION (PSYCHOLOGY); FEMALE; HUMANS; MALE; REACTION TIME; TIME PERCEPTION; VISUAL PERCEPTION; YOUNG ADULT;

EID: 84881326630     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0071608     Document Type: Article

References (77)

1. Spence C, Squire S, (2003) Multisensory integration: maintaining the perception of synchrony. Curr Biol 13: R519-521.
2. Vroomen J, Keetels M, (2010) Perception of intersensory synchrony: a tutorial review. Atten Percept Psychophys 72: 871-884.
3. Diederich A, Colonius H, (2009) Crossmodal interaction in speeded responses: time window of integration model. Prog Brain Res 174: 119-135.
4. Fujisaki W, Nishida S, (2009) Audio-tactile superiority over visuo-tactile and audio-visual combinations in the temporal resolution of synchrony perception. Exp Brain Res 198: 245-259.
5. Boenke LT, Deliano M, Ohl FW, (2009) Stimulus duration influences perceived simultaneity in audiovisual temporal-order judgment. Exp Brain Res 198: 233-244.
6. Zampini M, Guest S, Shore DI, Spence C, (2005) Audio-visual simultaneity judgments. Percept Psychophys 67: 531-544.
7. Zampini M, Shore DI, Spence C, (2003) Audiovisual temporal order judgments. Exp Brain Res 152: 198-210.
8. Dixon NF, Spitz L, (1980) The detection of auditory visual desynchrony. Perception 9: 719-721.
9. van Wassenhove V, Grant KW, Poeppel D, (2007) Temporal window of integration in auditory-visual speech perception. Neuropsychologia 45: 598-607.
10. Vatakis A, Spence C, (2006) Audiovisual synchrony perception for music, speech, and object actions. Brain Res 1111: 134-142.
11. van Eijk RL, Kohlrausch A, Juola JF, van de Par S, (2008) Audiovisual synchrony and temporal order judgments: effects of experimental method and stimulus type. Percept Psychophys 70: 955-968.
12. Stevenson RA, Zemtsov RK, Wallace MT (2012) Individual Differences in the Multisensory Temporal Binding Window Predict Susceptibility to Audiovisual Illusions. J Exp Psychol Hum Percept Perform.
13. Stone JV, Hunkin NM, Porrill J, Wood R, Keeler V, et al. (2001) When is now? Perception of simultaneity. Proc Biol Sci 268: 31-38.
14. Donohue SE, Woldorff MG, Mitroff SR, (2010) Video game players show more precise multisensory temporal processing abilities. Atten Percept Psychophys 72: 1120-1129.
15. Powers AR, (2009) Perceptual training narrows the temporal window of multisensory binding. J Neurosci 29: 12265-12274.
16. Fujisaki W, Shimojo S, Kashino M, Nishida S, (2004) Recalibration of audiovisual simultaneity. Nat Neurosci 7: 773-778.
17. Vroomen J, Keetels M, de Gelder B, Bertelson P, (2004) Recalibration of temporal order perception by exposure to audio-visual asynchrony. Brain Res Cogn Brain Res 22: 32-35.
18. Heron J, Roach NW, Whitaker D, Hanson JV, (2010) Attention regulates the plasticity of multisensory timing. Eur J Neurosci 31: 1755-1762.
19. Zampini M, Shore DI, Spence C, (2005) Audiovisual prior entry. Neurosci Lett 381: 217-222.
20. Spence C, Parise C, (2010) Prior-entry: a review. Conscious Cogn 19: 364-379.
21. Miller J, Schwarz W, (2006) Dissociations between reaction times and temporal order judgments: a diffusion model approach. J Exp Psychol Hum Percept Perform 32: 394-412.
22. Foss-Feig JH, Kwakye LD, Cascio CJ, Burnette CP, Kadivar H, et al. (2010) An extended multisensory temporal binding window in autism spectrum disorders. Exp Brain Res 203: 381-389.
23. Hairston WD, Burdette JH, Flowers DL, Wood FB, Wallace MT, (2005) Altered temporal profile of visual-auditory multisensory interactions in dyslexia. Exp Brain Res 166: 474-480.
24. Kwakye LD, Foss-Feig JH, Cascio CJ, Stone WL, Wallace MT (2010) Altered auditory and multisensory temporal processing in autism spectrum disorders. Front Integr Neurosci 4.
25. Diederich A, Colonius H, (2004) Bimodal and trimodal multisensory enhancement: effects of stimulus onset and intensity on reaction time. Percept Psychophys 66: 1388-1404.
26. Miller J, (1986) Timecourse of coactivation in bimodal divided attention. Percept Psychophys 40: 331-343.
27. Vatakis A, Navarra J, Soto-Faraco S, Spence C, (2008) Audiovisual temporal adaptation of speech: temporal order versus simultaneity judgments. Exp Brain Res 185: 521-529.
28. Hirsh IJ, Sherrick CE Jr, (1961) Perceived order in different sense modalities. J Exp Psychol 62: 423-432.
29. Jaskowski P, Jaroszyk F, Hojan-Jezierska D, (1990) Temporal-order judgments and reaction time for stimuli of different modalities. Psychol Res 52: 35-38.
30. Rutschmann J, Link R, (1964) Perception of Temporal Order of Stimuli Differing in Sense Mode and Simple Reaction Time. Percept Mot Skills 18: 345-352.
31. Talsma D, Woldorff MG, (2005) Selective attention and multisensory integration: multiple phases of effects on the evoked brain activity. J Cogn Neurosci 17: 1098-1114.
32. Eriksen CW, (1988) A source of error in attempts to distinguish coactivation from separate activation in the perception of redundant targets. Percept Psychophys 44: 191-193.
33. Gondan M, Heckel A, (2008) Testing the race inequality: A simple correction procedure for fast guesses. Journal of Mathematical Psychology 52: 322-325.
34. Miller J, Lopes A, (1991) Bias produced by fast guessing in distribution-based tests of race models. Percept Psychophys 50: 584-590.
35. Miller J, (2004) Exaggerated redundancy gain in the split brain: A hemispheric coactivation account. Cognitive Psychology 49: 118-154.
36. Rach S, Diederich A, Steenken R, Colonius H, (2010) The race model inequality for censored reaction time distributions. Atten Percept Psychophys 72: 839-847.
37. Miller J, (1982) Divided attention: evidence for coactivation with redundant signals. Cogn Psychol 14: 247-279.
38. Gondan M, (2009) Testing the race model inequality in redundant stimuli with variable onset asynchrony. J Exp Psychol Hum Percept Perform 35: 575-579.
39. Ulrich R, Miller J, Schroter H, (2007) Testing the race model inequality: an algorithm and computer programs. Behav Res Methods 39: 291-302.
40. Kiesel A, Miller J, Ulrich R, (2007) Systematic biases and Type I error accumulation in tests of the race model inequality. Behav Res Methods 39: 539-551.
41. Gondan M, (2010) A permutation test for the race model inequality. Behav Res Methods 42: 23-28.
42. Colonius H, Diederich A, (2006) The race model inequality: Interpreting a geometric measure of the amount of violation. Psychological Review 113: 148-154.
43. Kuss M, Jakel F, Wichmann FA, (2005) Bayesian inference for psychometric functions. J Vis 5: 478-492.
44. Treutwein B, Strasburger H, (1999) Fitting the psychometric function. Percept Psychophys 61: 87-106.
45. Wichmann FA, Hill NJ, (2001) The psychometric function: I. Fitting, sampling, and goodness of fit. Percept Psychophys 63: 1293-1313.
46. Neal RM (2003) Slice sampling. Annals of Statistics: 705-741.
47. Spence C, Shore DI, Klein RM, (2001) Multisensory prior entry. J Exp Psychol Gen 130: 799-832.
48. Barrett DJK, Krumbholz K, (2012) Evidence for multisensory integration in the elicitation of prior entry by bimodal cues. Experimental Brain Research 222: 11-20.
49. Jaskowski P, (1996) Simple reaction time and perception of temporal order: dissociations and hypotheses. Percept Mot Skills 82: 707-730.
50. Neumann O, Niepel M (2004) Timing of "Perception" and Perception of "Time". In: Kaernbach C, Schroger E, Muller H, editors. Psychophysics beyond sensation: Laws and invariants of human cognition. Mahwah, N.J.: Lawrence Erlbaum Associates. 245-269.
51. Sternberg S, Knoll RL, (1973) The perception of temporal order: Fundamental issues and a general model. Attention and performance IV: 629-685.
52. Molholm S, Ritter W, Murray MM, Javitt DC, Schroeder CE, et al. (2002) Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Brain Res Cogn Brain Res 14: 115-128.
53. Brandwein AB, Foxe JJ, Butler JS, Russo NN, Altschuler TS, et al. (2012) The Development of Multisensory Integration in High-Functioning Autism: High-Density Electrical Mapping and Psychophysical Measures Reveal Impairments in the Processing of Audiovisual Inputs. Cerebral Cortex.
54. Brandwein AB, Foxe JJ, Russo NN, Altschuler TS, Gomes H, et al. (2011) The Development of Audiovisual Multisensory Integration Across Childhood and Early Adolescence: A High-Density Electrical Mapping Study. Cerebral Cortex 21: 1042-1055.
55. Li RJ, Polat U, Scalzo F, Bavelier D (2010) Reducing backward masking through action game training. J Vis 10.
56. Green CS, Bavelier D, (2003) Action video game modifies visual selective attention. Nature 423: 534-537.
57. Hodges DA, Hairston WD, Burdette JH, (2005) Aspects of multisensory perception: the integration of visual and auditory information in musical experiences. Annals of the New York Academy of Sciences 1060: 175-185.
58. Petrini K, Dahl S, Rocchesso D, Waadeland C, Avanzini F, et al. (2009) Multisensory integration of drumming actions: musical expertise affects perceived audiovisual asynchrony. Experimental Brain Research 198: 339-352.
59. Powers AR, (2012) Neural correlates of multisensory perceptual learning. J Neurosci 32: 6263-6274.
60. Hillock AR, Powers AR, Wallace MT, (2011) Binding of sights and sounds: age-related changes in multisensory temporal processing. Neuropsychologia 49: 461-467.
61. Cardoso-Leite P, Gorea A, Mamassian P (2007) Temporal order judgment and simple reaction times: Evidence for a common processing system. J Vis 7.
62. Schwarz W, (2006) On the relationship between the redundant signals effect and temporal order judgments: Parametric data and a new model. Journal of Experimental Psychology: Human Perception and Performance 32: 558-573.
63. Meredith MA, Nemitz JW, Stein BE, (1987) Determinants of multisensory integration in superior colliculus neurons. I. Temporal factors. J Neurosci 7: 3215-3229.
64. Wallace MT, Wilkinson LK, Stein BE, (1996) Representation and integration of multiple sensory inputs in primate superior colliculus. J Neurophysiol 76: 1246-1266.
65. Bushara KO, Grafman J, Hallett M, (2001) Neural correlates of auditory-visual stimulus onset asynchrony detection. J Neurosci 21: 300-304.
66. Bushara KO, Hanakawa T, Immisch I, Toma K, Kansaku K, et al. (2002) Neural correlates of cross-modal binding. Nat Neurosci 6: 190-195.
67. Calvert GA, Hansen PC, Iversen SD, Brammer MJ, (2001) Detection of audio-visual integration sites in humans by application of electrophysiological criteria to the BOLD effect. Neuroimage 14: 427-438.
68. Noesselt T, Rieger JW, Schoenfeld MA, Kanowski M, Hinrichs H, et al. (2007) Audiovisual temporal correspondence modulates human multisensory superior temporal sulcus plus primary sensory cortices. J Neurosci 27: 11431-11441.
69. Molholm S, Sehatpour P, Mehta AD, Shpaner M, Gomez-Ramirez M, et al. (2006) Audio-visual multisensory integration in superior parietal lobule revealed by human intracranial recordings. J Neurophysiol 96: 721-729.
70. Noesselt T, Bergmann D, Münte TF, Heinze H-J, Spence C (2012) Coding of multisensory temporal patterns in human superior temporal sulcus. Frontiers in Integrative Neuroscience 6.
71. Moran RJ, Molholm S, Reilly RB, Foxe JJ, (2008) Changes in effective connectivity of human superior parietal lobule under multisensory and unisensory stimulation. European Journal of Neuroscience 27: 2303-2312.
72. Bonath B, Tyll S, Budinger E, Krauel K, Hopf JM, et al. (2013) Task-demands and audio-visual stimulus configurations modulate neural activity in the human thalamus. Neuroimage 66: 110-118.
73. Giard MH, Peronnet F, (1999) Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study. J Cogn Neurosci 11: 473-490.
74. Senkowski D, Molholm S, Gomez-Ramirez M, Foxe JJ, (2006) Oscillatory Beta Activity Predicts Response Speed during a Multisensory Audiovisual Reaction Time Task: A High-Density Electrical Mapping Study. Cerebral Cortex 16: 1556-1565.
75. Senkowski D, Saint-Amour D, Hofle M, Foxe JJ, (2011) Multisensory interactions in early evoked brain activity follow the principle of inverse effectiveness. Neuroimage 56: 2200-2208.
76. Sperdin HF, Cappe C, Foxe JJ, Murray MM, (2009) Early, low-level auditory-somatosensory multisensory interactions impact reaction time speed. Front Integr Neurosci 3: 2.
77. Murray MM, Molholm S, Michel CM, Heslenfeld DJ, Ritter W, et al. (2005) Grabbing your ear: rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment. Cereb Cortex 15: 963-974.