Audiovisual temporal fusion in 6-month-old infants

Developmental Cognitive Neuroscience

Volumn 9, Issue , 2014, Pages 56-67

  Kopp, Franziska ^a  

^a MAX PLANCK INSTITUTE FOR HUMAN DEVELOPMENT   (Germany)

Author keywords

Audiovisual; ERP; Infancy; Multisensory perception; Synchrony

Indexed keywords

BRAIN; ELECTROENCEPHALOGRAPHY; EVOKED RESPONSE; FEMALE; HEARING; HUMAN; INFANT; MALE; PHYSIOLOGY; TIME; VISION;

AUDITORY PERCEPTION; BRAIN; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FEMALE; HUMANS; INFANT; MALE; TIME FACTORS; VISUAL PERCEPTION;

EID: 84893945550     PISSN: 18789293     EISSN: 18789307     Source Type: Journal    
DOI: 10.1016/j.dcn.2014.01.001     Document Type: Article

References (63)

1. P.K. Ackles Stimulus novelty and cognitive-related ERP components of the infant brain Percept. Mot. Skills 106 2008 3 20
2. P.K. Ackles, and K.G. Cook Attention or memory? Effects of familiarity and novelty on the Nc component of event-related brain potentials in six-month-old infants Int. J. Neurosci. 117 2007 837 867 (Pubitemid 46650677)
3. Aslin What's in a look? Dev. Sci. 10 2007 48 53
4. L.E. Bahrick Infants' perception of substance and temporal synchrony in multimodal events Infant Behav. Dev. 6 1983 429 451
5. L.E. Bahrick Infants' intermodal perception of two levels of temporal structure in natural events Infant Behav. Dev. 10 1987 387 416
6. J. Besle, O. Bertrand, and M.-H. Giard Electrophysiological (EEG, sEEG, MEG) evidence for multiple audiovisual interactions in the human auditory cortex Hear. Res. 258 2009 143 151
7. J. Besle, A. Fort, C. Delpuech, and M.H. Giard Bimodal speech: early suppressive visual effects in the human auditory cortex Eur. J. Neurosci. 20 2004 2225 2234 (Pubitemid 39331143)
8. D. Bristow, G. Dehaene-Lambertz, J. Mattout, C. Soares, T. Gliga, S. Baillet, and J.-F. Mangin Hearing faces: how the infant brain matches the face it sees with the speech it hears J. Cogn. Neurosci. 21 2009 905 921
9. D. Burr, and M. Gori Multisensory integration develops late in humans M.M. Murray, M.T. Wallace, The Neural Basis of Multisensory Processes 2012 CRC Press Boca Raton (FL)
10. K.O. Bushara, J. Grafman, and M. Hallett Neural correlates of auditory-visual stimulus onset asynchrony detection J. Neurosci. 21 2001 300 304 (Pubitemid 32098753)
11. J. Colombo, and D.W. Mitchell Infant visual habituation Neurobiol. Learn. Mem. 92 2009 225 234
12. M. Dhamala, C.G. Assisi, V.K. Jirsa, F.L. Steinberg, and J.A.S. Kelso Multisensory integration for timing engages different brain networks Neuroimage 34 2007 764 773 (Pubitemid 44827750)
13. N.F. Dixon, and L. Spitz The detection of auditory visual desynchrony Perception 9 1980 719 721 (Pubitemid 11114821)
14. B. Dodd Lip reading in infants: attention to speech presented in- and out-of-synchrony Cogn. Psychol. 11 1979 478 484
15. R. Fendrich, and P.M. Corballis The temporal cross-capture of audition and vision Percept. Psychophys. 63 2001 719 725 (Pubitemid 33603924)
16. W. Fujisaki, S. Shimojo, M. Kashino, and S. Nishida Recalibration of audiovisual simultaneity Nat. Neurosci. 7 2004 773 778 (Pubitemid 38859063)
17. M.H. Giard, and F. Peronnet Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study J. Cogn. Neurosci. 11 1999 473 490 (Pubitemid 29520540)
18. A.R. Hillock, A.R. Powers, and M.T. Wallace Binding of sights and sounds: age-related changes in multisensory temporal processing Neuropsychologia 49 2011 461 467
19. G. Hollich, R.S. Newman, and P.W. Juszyk Infants' use of synchronized visual information to separate streams of speech Child Dev. 76 2005 598 613 (Pubitemid 40747169)
20. D.C. Hyde, B.L. Jones, R. Flom, and C.L. Porter Neural signatures of face-voice synchrony in 5-month-old human infants Dev. Psychobiol. 53 2011 359 370
21. D.C. Hyde, B.L. Jones, C.L. Porter, and R. Flom Visual stimulation enhances auditory processing in 3-month-old infants and adults Dev. Psychobiol. 52 2010 181 189
22. R. Karrer, and L.A. Monti Event-related potentials of 4-6-week-old infants in a visual recognition memory task Electroencephalogr. Clin. Neurophysiol. 94 1995 414 434
23. A.J. King Multisensory integration: strategies for synchronization Curr. Biol. 15 2005 R339 R341
24. F. Kopp, and C. Dietrich Neural dynamics of audiovisual synchrony and asynchrony perception in 6-month-old infants Front. Psychol. 4 2013 2 10.3389/fpsyg.2013.00002
25. F. Kopp, and U. Lindenberger Effects of joint attention on long-term memory in 9-month-old infants: an event-related potentials study Dev. Sci. 14 2011 660 672
26. F. Kopp, and U. Lindenberger Social cues at encoding affect memory in four-month-old infants Soc. Neurosci. 7 2012 458 472
27. D.J. Lewkowicz Developmental changes in infants' bisensory response to synchronous durations Infant Behav. Dev. 9 1986 335 353
28. D.J. Lewkowicz Infants' response to temporally based intersensory equivalence: the effect of synchronous sounds on visual preferences for moving stimuli Infant Behav. Dev. 15 1992 297 324
29. D.J. Lewkowicz Perception of auditory-visual temporal synchrony in human infants J. Exp. Psychol. Hum. Percept. Perform. 22 1996 1094 1106 (Pubitemid 126418442)
30. D.J. Lewkowicz The development of intersensory temporal perception: an epigenetic systems/limitations view Psychol. Bull. 126 2000 281 308
31. D.J. Lewkowicz Infant perception of audiovisual speech synchrony Dev. Psychol. 46 2010 66 77
32. D.J. Lewkowicz, I. Leo, and F. Simion Intersensory perception at birth: newborns match nonhuman primate faces and voices Infancy 15 2010 46 60
33. D.J. Lewkowicz, R. Sowinski, and S. Place The decline of cross-species intersensory perception in human infants: underlying mechanisms and its developmental persistence Brain Res. 1242 2008 291 302
34. E. Macaluso, N. George, R. Dolan, C. Spence, and J. Driver Spatial and temporal factors during processing of audiovisual speech: a PET study Neuroimage 21 2004 725 732 (Pubitemid 38229935)
35. L.M. Miller, and M. D'Esposito Perceptual fusion and stimulus coincidence in the cross-modal integration of speech J. Neurosci. 25 2005 5884 5893 (Pubitemid 40911419)
36. J. Navarra, A. Alsius, I. Velasco, S. Soto-Faraco, and C. Spence Perception of audiovisual speech synchrony for native and non-native language Brain Res. 1323 2010 84 93
37. J. Navarra, A. Vatakis, M. Zampini, S. Soto-Faraco, W. Humphreys, and C. Spence Exposure to asynchronous audiovisual speech extends the temporal window for audiovisual integration Cogn. Brain Res. 25 2005 499 507 (Pubitemid 41443353)
38. L. Nikkel, and R. Karrer Differential effects of experience on the ERP and behavior of 6-month-old infants Dev. Neuropsychol. 10 1994 1 11
39. M. Pilling Auditory event-related potentials (ERPs) in audiovisual speech perception Journal of Speech Language, and Hearing Research 52 2009 1073 1081
40. F. Perrin, J. Pernier, O. Bertrand, and J.F. Echallier Spherical splines for scalp potential and current density mapping Electroencephalogr. Clin. Neurophysiol. 72 1990 184 187
41. K. Petrini, S. Dahl, D. Rocchesso, C.H. Waadeland, F. Avanzini, A. Puce, and F.E. Pollick Multisensory integration of drumming actions: musical expertise affects perceived audiovisual synchrony Exp. Brain Res. 198 2009 339 352
42. M. Pieszek, A. Widmann, T. Gruber, and E. Schröger The human brain maintains contradictory and redundant auditory sensory predictions PLoS ONE 8 2013 e53634 10.1371/journal.pone.0053634
43. A.R. Powers, A.R. Hillock, and M.T. Wallace Perceptual training narrows the temporal window of multisensory binding J. Neurosci. 29 2009 12265 12274
44. G.D. Reynolds, and J.E. Richards Familiarization, attention, and recognition memory in infancy: an event-related potential and source-localization study Dev. Psychol. 4 2005 598 615 (Pubitemid 41168501)
45. J.E. Richards Attention affects the recognition of briefly presented visual stimuli in infants: an ERP study Dev. Sci. 6 2003 312 328 (Pubitemid 36737466)
46. E.S. Spelke Perceiving bimodally specified events in infancy Dev. Psychol. 15 1979 626 636
47. C. Spence, and S. Squire Multisensory integration: maintaining the perception of synchrony Curr. Biol. 13 2003 R519 R521
48. J.J. Stekelenburg, and J. Vroomen Neural correlates of multisensory integration of ecologically valid audiovisual events J. Cogn. Neurosci. 19 2007 1964 1973 (Pubitemid 350220508)
49. M. Stets, and V. Reid Infant ERP amplitudes change over the course of an experimental session: implications for cognitive processes and methodology Brain Dev. 33 2011 558 568
50. R.A. Stevenson, N.A. Altieri, S. Kim, D.B. Pisoni, and T.W. James Neural processing of asynchronous audiovisual speech perception Neuroimage 49 2010 3308 3318
51. R.A. Stevenson, R.M. VanDerKlok, D.B. Pisoni, and T.W. James Discrete neural substrates underlie complementary audiovisual speech integration processes Neuroimage 55 2011 1339 1345
52. R.A. Stevenson, R.K. Zemtsov, and M.T. Wallace Individual differences in the multisensory temporal binding window predict susceptibility to audiovisual illusions J. Exp. Psychol. Hum. Percept. Perform. 38 2012 1517 1529
53. D. Talsma, D. Senkowski, S. Soto-Faraco, and M.G. Woldorff The multifaceted interplay between attention and multisensory integration Trends Cogn. Sci. 14 2010 400 410
54. D. Talsma, D. Senkowski, and M.G. Woldorff Intermodal attention affects the processing of the temporal alignment of audiovisual stimuli Exp. Brain Res. 198 2009 313 328
55. D. Talsma, and A.-L. van Harmelen Procedures and strategies for optimizing the signal-to-noise ratio in event-related potential data T.C. Handy, Brain Signal Analysis: Advances in Neuroelectric and Neuromagnetic Methods 2009 The MIT Press Cambridge (Mass.)
56. J. Timm, I. SanMiguel, K. Saupe, and E. Schröger The N1-suppression effect for self-initiated sounds is independent of attention BMC Neurosci. 14 2013 2 10.1186/1471-2202-14-2
57. V. Van Wassenhove, K.W. Grant, and D. Poeppel Visual speech speeds up the neural processing of auditory speech PNAS 102 2005 1181 1186 (Pubitemid 40170746)
58. V. Van Wassenhove, K.W. Grant, and D. Poeppel Temporal window of integration in auditory-visual speech perception Neuropsychologia 45 2007 598 607 (Pubitemid 44894453)
59. A. Vatakis, J. Navarra, S. Soto-Faraco, and C. Spence Temporal recalibration during asynchronous audiovisual speech perception Exp. Brain Res. 181 2007 173 181 (Pubitemid 47030006)
60. A. Vatakis, and C. Spence Audiovisual synchrony perception for music, speech, and object actions Brain Res. 1111 2006 134 142 (Pubitemid 44331172)
61. J. Vroomen, and J.J. Stekelenburg Visual anticipatory information modulates multisensory interactions of artificial audiovisual stimuli J. Cogn. Neurosci. 22 2009 1583 1596
62. S.J. Webb, J.D. Long, and C.A. Nelson A longitudinal investigation of visual event-related potentials in the first year of life Dev. Sci. 8 2005 605 616 (Pubitemid 41596056)
63. S.A. Wiebe, C.L. Cheatham, A.F. Lukowski, J.C. Haight, A.J. Muehleck, and P.J. Bauer Infants' ERP responses to novel and familiar stimuli change over time: implications for novelty detection and memory Infancy 9 2006 21 44 (Pubitemid 43231033)