Neural dynamics of audiovisual synchrony and asynchrony perception in 6-month-old infants

Frontiers in Psychology

Volumn 4, Issue JAN, 2013, Pages

  Kopp, Franziska ^a   Dietrich, Claudia ^a  

^a MAX PLANCK INSTITUTE FOR HUMAN DEVELOPMENT   (Germany)

Author keywords

Asynchrony; Audiovisual; Erp; Infancy; Multisensory perception; Synchrony

Indexed keywords

EID: 84874730670     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2013.00002     Document Type: Article

References (58)

1. Ackles, P. (2008). Stimulus novelty and cognitive-related ERP components of the infant brain. Percept. Mot. Skills 106, 3-20.
2. Bahrick, L. E. (1983). Infants' perception of substance and temporal synchrony in multimodal events. Infant Behav. Dev. 6, 429-451.
3. Bahrick, L. E. (2001). Increasing specificity in perceptual development: infants' detection of nested levels of multimodal stimulation. J. Exp. Child. Psychol. 79, 253-270.
4. Besle, J., Bertrand, O., and Giard, M.-H. (2009). Electrophysiological (EEG, sEEG, MEG) evidence for multiple audiovisual interactions in the human auditory cortex. Hear. Res. 258, 143-151.
5. Besle, J., Fort, A., Delpuech, C., and Giard, M.-H. (2004). Bimodal speech: early suppressive visual effects in human auditory cortex. Eur. J. Neurosci. 20, 2225-2234.
6. Bushara, K. O., Grafman, J., and Hallett, M. (2001). Neural correlates of auditory-visual stimulus onset asynchrony detection. J. Neurosci. 21, 300-304.
7. De Gelder, B., and Bertelson, P. (2003). Multisensory integration, perception and ecological validity. Trends Cogn. Sci. (Regul. Ed.) 7, 460-467.
8. de Haan, M. (2007). Infant EEG and Event-Related Potentials. Hove: Psychology Press.
9. de Haan, M., and Nelson, C. A. (1997). Recognition of the mother's face by six-month-old infants: a neurobehavioral study. Child Dev. 68, 187-210.
10. Dixon, N. F., and Spitz, L. (1980). The detection of auditory visual desynchrony. Perception 9, 719-721.
11. Dodd, B. (1979). Lip reading in infants: attentiontospeechpresentedin-and out-of-synchrony. Cogn. Psychol. 11, 478-484.
12. Doesburg, S. M., Emberson, L. L., Rahi, A., Cameron, D., and Ward, L. M. (2007). Asynchrony from synchrony: long-range gamma-band neural synchrony accompanies perception of audiovisual speech asynchrony. Exp. Brain Res. 185, 11-20.
13. Fendrich, R., and Corballis, P. M. (2001). The temporal cross-capture of audition and vision. Percept. Psychophys. 63, 719-725.
14. Flom, R., and Bahrick, L. E. (2007). The development of infant discrimination of affect in multimodal and unimodal stimulation: the role of intersensory redundancy. Dev. Psychol. 43, 238-252.
15. Fort, A., Delpuech, C., Pernier, J., and Giard,M.-H. (2002). Early auditory-visual interactions in human cortex during nonredundant target identification. Brain Res. Cogn. Brain Res. 14, 20-30.
16. Fort, A., and Giard, M. (2004). "Multiple electrophysiological mechanisms of audiovisual integration in human perception," in The Handbook of Multisensory Processes, eds G. A. Calvert, C. Spence, and B. E. Stein (Cambridge, MA: MIT Press), 503-515.
17. Foxe, J. J., and Molholm, S. (2009). Ten years at the multisensory forum: musings on the evolution of a field. Brain Topogr. 21, 149-154.
18. Fujisaki, W., Shimojo, S., Kashino, M., and Nishida,S. (2004). Recalibration of audiovisual simultaneity. Nat. Neurosci. 7, 773-778.
19. Hay-McCutcheon, M. J., Pisoni, D. B., and Hunt, K. K. (2009). Audiovisual asynchrony detection and speech perception in hearing-impaired listeners with cochlear implants: a preliminary analysis. Int. J. Audiol. 48, 321-333.
20. Hill Karrer, J., Karrer, R., Bloom, D., Chaney, L., and Davis, R. (1998). Event-related brain potentials during an extended visual recognition memory task depict delayed development of cerebral inhibitory processes among 6-month-old infants with Down syndrome. Int. J. Psychophysiol. 29, 167-200.
21. Hyde, D. C., Jones, B. L., Flom, R., and Porter, C. L. (2011). Neural signatures of face-voice synchrony in 5-month-old human infants. Dev. Psychobiol. 53, 359-370.
22. Hyde, D. C., Jones, B. L., Porter, C. L., and Flom, R. (2010). Visual stimulation enhances auditory processing in 3-month-old infants and adults. Dev. Psychobiol. 52, 181-189.
23. Junghöfer, M., Elbert, T., Tucker, D. M., and Braun, C. (1999). The polar average reference effect:a bias in estimating the head surface integral in EEG recording. Clin. Neurophysiol. 110, 1149-1155.
24. Karrer, R., and Monti, L. A. (1995). Event-related potentials of 4-6-week-old infants in a visual recognition memory task. Electroen-cephalogr. Clin. Neurophysiol. 94, 414-424.
25. Kopp, F., and Lindenberger, U. (2011). Effects of joint attention on long-term memory in 9-month-old infants: an event-related potentials study. Dev. Sci. 14, 660-672.
26. Kopp, F., and Lindenberger, U. (2012). Social cues at encoding affect memory in four-month-old infants. Soc. Neurosci. 7, 458-472.
27. Lewkowicz, D. J. (1986). Developmental changes in infants' bisensory response to synchronous durations. Infant Behav. Dev. 9, 335-353.
28. Lewkowicz, D. J. (1992). Infants' response to temporally based inter-sensory equivalence: the effect of synchronous sounds on visual preferences for moving stimuli. Infant Behav. Dev. 15, 297-324.
29. Lewkowicz, D. J. (1996). Perception of auditory-visual temporal synchrony in human infants. J. Exp. Psychol. Hum. Percept. Perform. 22, 1094-1106.
30. Lewkowicz, D. J. (2000). The development of intersensory temporal perception: an epigenetic systems/limitations view. Psychol. Bull. 126, 281-308.
31. Lewkowicz, D. J. (2010). Infant perception of audiovisual speech synchrony. Dev. Psychol. 46, 66-77.
32. Lewkowicz, D. J., Leo, I., and Simion, F. (2010). Intersensory perception at birth: newborns match nonhuman primate faces and voices. Infancy 15, 46-60.
33. Lewkowicz, D. J., Sowinski, R., and Place,S. (2008). The decline of cross-species intersensory perception in human infants: underlying mechanisms and its developmental persistence. Brain Res. 1242, 291-302.
34. Macaluso, E., George, N., Dolan, R., Spence, C., and Driver, J. (2004). Spatial and temporal factors during processing of audiovisual speech: a PET study. Neuroimage 21, 725-732.
35. Miller, L. M., and D'Esposito, M. D. (2005). Perceptual fusion and stimulus coincidence in the cross-modal integration of speech. J. Neurosci. 25, 5884-5893.
36. Navarra, J., Hartcher-O'Brien, J., Piazza, E., and Spence, C. (2009). Adaptation to audiovisual asynchrony modulates the speeded detection of sound. Proc. Natl. Acad. Sci. U.S.A. 106, 9169-9173.
37. Navarra, J., Vatakis, A., Zampini, M., Soto-Faraco, S., Humphreys, W., and Spence, C. (2005). Exposure to asynchronous audiovisual speech extends the temporal window for audiovisual integration. Brain Res. Cogn. Brain Res. 25, 499-507.
38. Petrini, K., Dahl, S., Rocchesso, D., Waadeland, C. H., Avanzini, F., Puce, A., et al. (2009a). Multisensory integration of drumming actions: musical expertise affects perceived audio-visual synchrony. Exp. Brain Res. 198, 339-352.
39. Petrini, K., Russell, M., and Pollick, F. (2009b). When knowing can replace seeing in audiovisual integration of actions. Cognition 110, 432-439.
40. Pilling, M. (2009). Auditory event-related potentials (ERPs) in audio-visual speech perception. J. Speech Lang. Hear. Res. 52, 1073-1081.
41. Putzar, L., Goerendt, I., Lange, K., Rösler,F.,and Röder,B. (2007). Early visual deprivation impairs multisensory interactions in humans. Nat. Neurosci. 10, 1243-1245.
42. Snyder, K., Webb, S. J., and Nelson, C. A. (2002). Theoretical and methodological implications of variability in infant brain response during a recognition memory paradigm. Infant Behav. Dev. 25, 466-494.
43. Spelke, E. S. (1979). Perceiving bimodally specified events in infancy. Dev. Psychol. 15, 626-636.
44. Spence, C., and Squire, S. (2003). Multi-sensory integration: maintaining the perception of synchrony. Curr. Biol. 13, R519-R521.
45. Stekelenburg, J. J., and Vroomen, J. (2007). Neural correlates of multi-sensory integration of ecologically valid audiovisual events. J. Cogn. Neurosci. 19, 1964-1973.
46. Stets, M., Stahl, D., and Reid, V. M. (2012). A meta-analysis investigating factors underlying attrition rates in infant ERP studies. Dev. Neuropsychol. 37, 226-252.
47. Stevenson, R. A., VanDerKlok, R. M., Pisoni, D. B., and James, T. W. (2011). Discrete neural substrates underlie complementary audiovisual speech integration processes. Neuroimage 55, 1339-1345.
48. Talsma, D., Senkowski, D., Soto-Faraco, S., and Woldorff, M. G. (2010). The multifaceted interplay between attention and multisensory integration. Trends Cogn. Sci. (Regul. Ed.) 14, 400-410.
49. Talsma,D.,Senkowski,D.,andWoldorff, M. G. (2009). Intermodal attention affects the processing of the temporal alignment of audiovisual stimuli. Exp. Brain Res. 198, 313-328.
50. Thomas, D. G., Whitaker, E., Crow, C. D., Little, V., Love, L., Lykins, M. S., et al. (1997). Event-related potential variability as a measure of information storage in infant development. Dev. Neuropsychol. 13, 205-232.
51. van Wassenhove, V., Grant, K. W., and Poeppel, D. (2005). Visual speech speeds up the neural processing of auditory speech. Proc. Natl. Acad. Sci. U.S.A. 102, 1181-1186.
52. Vatakis, A., Navarra, J., Soto-Faraco, S., and Spence, C. (2007). Temporal recalibration during asynchronous audiovisual speech perception. Exp. Brain Res. 181, 173-181.
53. Vatakis, A., and Spence, C. (2006). Audiovisual synchrony perception for music, speech, and object actions. Brain Res. 1111, 134-142.
54. Vroomen, J., and Stekelenburg, J. J. (2009). Visual anticipatory information modulates multisensory interactions of artificial audiovisual stimuli. J. Cogn. Neurosci. 22, 1583-1596.
55. Wallace, M. T., Perrault, T. J. Jr., Hairston, W. D., and Stein, B. E. (2004). Visual experience is necessary for the development of multisensory integration. J. Neurosci. 24, 9580-9584.
56. Webb, S. J., Long, J. D., and Nelson, C. A. (2005). A longitudinal investigation of visual event-related potentials in the first year of life. Dev. Sci. 8, 605-616.
57. Welch, R. B., and Warren, D. H. (1980). Immediate perceptual response to intersensory discrepancy. Psychol. Bull. 88, 638-667.
58. Wunderlich, J. L., Cone-Wesson, B. K., and Shepherd, R. (2006). Maturation of the cortical auditory evoked potentials in infants and young children. Hear. Res. 212, 185-202