Binding of sights and sounds: Age-related changes in multisensory temporal processing

Neuropsychologia

Volumn 49, Issue 3, 2011, Pages 461-467

  Hillock, Andrea R ^a   Powers, Albert R ^a   Wallace, Mark T ^a  

^a VANDERBILT UNIVERSITY   (United States)

Author keywords

Asynchrony; Auditory; Development; Intersensory; Simultaneity; Visual

Indexed keywords

ADULT; AGE; ARTICLE; AUDITORY STIMULATION; BRAIN FUNCTION; CHILD; CONTROLLED STUDY; CORRELATIONAL STUDY; DECISION MAKING; FEMALE; HEARING; HUMAN; HUMAN EXPERIMENT; MALE; NORMAL HUMAN; SCHOOL CHILD; TASK PERFORMANCE; VISION; VISUAL STIMULATION;

ACOUSTIC STIMULATION; ADULT; AGING; AUDITORY PERCEPTION; CHILD; CUES; DATA INTERPRETATION, STATISTICAL; FEMALE; HUMANS; MALE; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; SPACE PERCEPTION; VISUAL PERCEPTION; YOUNG ADULT;

EID: 79551492277     PISSN: 00283932     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuropsychologia.2010.11.041     Document Type: Article

References (57)

1. Alais D., Burr D. The ventriloquist effect results from near-optimal bimodal integration. Current Biology 2004, 14(3):257-262.
2. Bahrick L.E. Infants' perception of substance and temporal synchrony in multimodal events. Infant Behavior & Development 1983, 6:429-451.
3. Bahrick L.E. Infants' intermodal perception of two levels of temporal structure in natural events. Infant Behavior & Development 1987, 10:387-416.
4. Bahrick L.E. Intermodal learning in infancy: Learning on the basis of two kinds of invariant relations in audible and visible events. Child Development 1988, 59(1):197-209.
5. Barutchu A., Danaher J., Crewther S.G., Innes-Brown H., Shivdasani M.N., Paolini A.G. Audiovisual integration in noise by children and adults. Journal of Experimental Child Psychology 2010, 105(1-2):38-50.
6. Bushara K.O., Grafman J., Hallett M. Neural correlates of auditory-visual stimulus onset asynchrony detection. The Journal of Neuroscience 2001, 21(1):300-304.
7. Calvert G.A., Campbell R., Brammer M.J. Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Current Biology 2000, 10(11):649-657.
8. Calvert G.A., Hansen P.C., Iversen S.D., Brammer M.J. Detection of audio-visual integration sites in humans by application of electrophysiological criteria to the BOLD effect. Neuroimage 2001, 14(2):427-438.
9. Colonius H., Diederich A. Multisensory interaction in saccadic reaction time: A time-window-of-integration model. Journal of Cognitive Neuroscience 2004, 16(6):1000-1009.
10. Dhamala M., Assisi C.G., Jirsa V.K., Steinberg F.L., Kelso J.A. Multisensory integration for timing engages different brain networks. Neuroimage 2007, 34(2):764-773.
11. Dixon N.F., Spitz L. The detection of auditory visual desynchrony. Perception 1980, 9(6):719-721.
12. Ernst M.O. Multisensory integration: A late bloomer. Current Biology 2008, 18(12):R519-R521.
13. Ernst M.O., Banks M.S. Humans integrate visual and haptic information in a statistically optimal fashion. Nature 2002, 415(6870):429-433.
14. Frens M.A., Van Opstal A.J., Van der Willigen R.F. Spatial and temporal factors determine auditory-visual interactions in human saccadic eye movements. Perception and Psychophysics 1995, 57(6):802-816.
15. Fujisaki W., Shimojo S., Kashino M., Nishida S. Recalibration of audiovisual simultaneity. Nature Neuroscience 2004, 7(7):773-778.
16. Giedd J.N., Blumenthal J., Jeffries N.O., Castellanos F.X., Liu H., Zijdenbos A., et al. Brain development during childhood and adolescence: A longitudinal MRI study. Nature Neuroscience 1999, 2(10):861-863.
17. Gogtay N., Giedd J.N., Lusk L., Hayashi K.M., Greenstein D., Vaituzis A.C., et al. Dynamic mapping of human cortical development during childhood through early adulthood. Proceedings of the National Academy of Sciences of the United States of America 2004, 101(21):8174-8179.
18. Gori M., Del Viva M., Sandini G., Burr D.C. Young children do not integrate visual and haptic form information. Current Biology 2008, 18(9):694-698.
19. Grant K.W., Seitz P.F. The use of visible speech cues for improving auditory detection of spoken sentences. The Journal of the Acoustical Society of America 2000, 108(3 Pt 1):1197-1208.
20. Hairston W.D., Burdette J.H., Flowers D.L., Wood F.B., Wallace M.T. Altered temporal profile of visual-auditory multisensory interactions in dyslexia. Experimental Brain Research 2005, 166(3-4):474-480.
21. Hari R., Renvall H. Impaired processing of rapid stimulus sequences in dyslexia. Trends in Cognitive Sciences 2001, 5(12):525-532.
22. Helbig H.B., Ernst M.O. Optimal integration of shape information from vision and touch. Experimental Brain Research 2007, 179(4):595-606.
23. Hughes H.C., Reuter-Lorenz P.A., Nozawa G., Fendrich R. Visual-auditory interactions in sensorimotor processing: Saccades versus manual responses. Journal of Experimental Psychology: Human Perception and Performance 1994, 20(1):131-153.
24. Koppen C., Spence C. Audiovisual asynchrony modulates the Colavita visual dominance effect. Brain Research 2007, 1186:224-232.
25. Laasonen M., Service E., Virsu V. Temporal order and processing acuity of visual, auditory, and tactile perception in developmentally dyslexic young adults. Cognitive, Affective & Behavioral Neuroscience 2001, 1(4):394-410.
26. Laasonen M., Service E., Virsu V. Crossmodal temporal order and processing acuity in developmentally dyslexic young adults. Brain and Language 2002, 80(3):340-354.
27. Laasonen M., Tomma-Halme J., Lahti-Nuuttila P., Service E., Virsu V. Rate of information segregation in developmentally dyslexic children. Brain and Language 2000, 75(1):66-81.
28. Lewkowicz D.J. Developmental changes in infants' bisensory response to synchronous durations. Infant Behavior & Development 1986, 9(3):335-353.
29. Lewkowicz D.J. Infants' response to temporally based intersensory equivalence: The effect of synchronous sounds on visual preferences for moving stimuli. Infant Behavior & Development 1992, 15(3):297-324.
30. Lewkowicz D.J. Perception of auditory-visual temporal synchrony in human infants. Journal of Experimental Psychology: Human Perception & Performance 1996, 22(5):1094-1106.
31. Lewkowicz D.J. Infants' perception of the audible, visible and bimodal attributes of multimodal syllables. Child Development 2000, 71(5):1241-1257.
32. The development of intersensory perception: Comparative perspectives 1994, Lawrence Erlbaum Associates, Inc., Hillsdale, NJ. D.J. Lewkowicz, R. Lickliter (Eds.).
33. Lovaas O.I., Schreibman L., Koegel R., Rehm R. Selective responding by autistic children to multiple sensory input. Journal of Abnormal Psychology 1971, 77(3):211-222.
34. Lovelace C.T., Stein B.E., Wallace M.T. An irrelevant light enhances auditory detection in humans: A psychophysical analysis of multisensory integration in stimulus detection. Brain Research. Cognitive Brain Research 2003, 17(2):447-453.
35. Massaro D.W. Children's perception of visual and auditory speech. Child Development 1984, 55(5):1777-1788.
36. McGurk H., MacDonald J. Hearing lips and seeing voices. Nature 1976, 264(5588):746-748.
37. Mongillo E.A., Irwin J.R., Whalen D.H., Klaiman C., Carter A.S., Schultz R.T. Audiovisual processing in children with and without autism spectrum disorders. Journal of Autism and Developmental Disorders 2008, 38(7):1349-1358.
38. Munhall K.G., Gribble P., Sacco L., Ward M. Temporal constraints on the McGurk effect. Perception and Psychophysics 1996, 58(3):351-362.
39. Nardini M., Jones P., Bedford R., Braddick O. Development of cue integration in human navigation. Current Biology 2008, 18(9):689-693.
40. Noesselt T., Rieger J.W., Schoenfeld M.A., Kanowski M., Hinrichs H., Heinze H.J., et al. Audiovisual temporal correspondence modulates human multisensory superior temporal sulcus plus primary sensory cortices. The Journal of Neuroscience 2007, 27(42):11431-11441.
41. Pfefferbaum A., Mathalon D.H., Sullivan E.V., Rawles J.M., Zipursky R.B., Lim K.O. A quantitative magnetic resonance imaging study of changes in brain morphology from infancy to late adulthood. Archives of Neurology 1994, 51(9):874-887.
42. Powers, A. R., Hevey, M., & Wallace, M. T. (Unpublished results). Neural correlates of multisensory perceptual training.
43. Powers A.R., Hillock A.R., Wallace M.T. Perceptual training narrows the temporal window of multisensory binding. The Journal of Neuroscience 2009, 29(39):12265-12274.
44. Schneider T.R., Debener S., Oostenveld R., Engel A.K. Enhanced EEG gamma-band activity reflects multisensory semantic matching in visual-to-auditory object priming. Neuroimage 2008, 42(3):1244-1254.
45. Senkowski D., Schneider T.R., Tandler F., Engel A.K. Gamma-band activity reflects multisensory matching in working memory. Experimental Brain Research 2009, 198(2-3):363-372.
46. Senkowski D., Talsma D., Grigutsch M., Herrmann C.S., Woldorff M.G. Good times for multisensory integration: Effects of the precision of temporal synchrony as revealed by gamma-band oscillations. Neuropsychologia 2007, 45(3):561-571.
47. Shams L., Kamitani Y., Shimojo S. Illusions. What you see is what you hear. Nature 2000, 408(6814):788.
48. Shams L., Kamitani Y., Shimojo S. Visual illusion induced by sound. Brain Research. Cognitive Brain Research 2002, 14(1):147-152.
49. Smith E.G., Bennetto L. Audiovisual speech integration and lipreading in autism. Journal of Child Psychology and Psychiatry and Allied Disciplines 2007, 48(8):813-821.
50. Spelke E.S. Perceiving bimodally specified events in infancy. Developmental Psychology 1979, 15:626-636.
51. Sumby W.H., Pollack I. Visual contributions to speech intelligibility in noise. Journal of the Acoustical Society of America 1954, 26:212-215.
52. Tremblay C., Champoux F., Voss P., Bacon B.A., Lepore F., Theoret H. Speech and non-speech audio-visual illusions: A developmental study. PLoS One 2007, 2(1):e742.
53. van Wassenhove V., Grant K.W., Poeppel D. Visual speech speeds up the neural processing of auditory speech. Proceedings of the National Academy of Sciences of the United States of America 2005, 102(4):1181-1186.
54. van Wassenhove V., Grant K.W., Poeppel D. Temporal window of integration in auditory-visual speech perception. Neuropsychologia 2007, 45(3):598-607.
55. Virsu V., Lahti-Nuuttila P., Laasonen M. Crossmodal temporal processing acuity impairment aggravates with age in developmental dyslexia. Neuroscience Letters 2003, 336(3):151-154.
56. Williams J.H., Massaro D.W., Peel N.J., Bosseler A., Suddendorf T. Visual-auditory integration during speech imitation in autism. Research in Developmental Disabilities 2004, 25(6):559-575.
57. Wozny D.R., Beierholm U.R., Shams L. Human trimodal perception follows optimal statistical inference. Journal of Vision 2008, 8(3). 24 21-11.