Neural signatures of face-voice synchrony in 5-month-old human infants

Developmental Psychobiology

Volumn 53, Issue 4, 2011, Pages 359-370

  Hyde, Daniel C ^a   Jones, Blake L ^b   Flom, Ross ^b   Porter, Chris L ^b  

^a HARVARD UNIVERSITY   (United States)

^b BRIGHAM YOUNG UNIVERSITY   (United States)

Author keywords

Attention; Auditory processing; Event related potentials; Infancy; Intersensory; Memory; Multisensory; Perception; Sensory integration; Visual processing

Indexed keywords

ARTICLE; ATTENTION; AUDITORY STIMULATION; BRAIN CORTEX; BRAIN MAPPING; ELECTROENCEPHALOGRAPHY; EVOKED RESPONSE; FACE; FEMALE; HEARING; HUMAN; INFANT; MALE; MEMORY; PHOTOSTIMULATION; PHYSIOLOGY; VISION; VOICE;

ACOUSTIC STIMULATION; ATTENTION; AUDITORY PERCEPTION; BRAIN MAPPING; CEREBRAL CORTEX; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FACE; FEMALE; HUMANS; INFANT; MALE; MEMORY; PHOTIC STIMULATION; VISUAL PERCEPTION; VOICE;

EID: 79954424923     PISSN: 00121630     EISSN: 10982302     Source Type: Journal    
DOI: 10.1002/dev.20525     Document Type: Article

References (66)

1. Ackles, P. K., & Cook, K. G. (1998). Stimulus probability and event-related potentials of the brain in 6-month-old human infants: A parametric study. International Journal of Psychophysiology, 29(2), 115-143.
2. Bahrick, L. E. (1992). Infants' perceptual differentiation of amodal and modality-specific audio-visual relations. Journal of Experimental Child Psychology, 53, 180-199.
3. Bahrick, L. E. (2000). Increasing specificity in the development of intermodal perception. In: D. Muir, & A. Slater (Eds.), Infant development: The essential readings (pp. 117-136). Maklen, MA: Blackwell.
4. Bahrick, L. E. (2001). Increasing specificity in perceptual development: Infants' detection of nested levels of multimodal stimulation. Journal of Experimental Child Psychology, 79, 253-270.
5. Bahrick, L. E., Hernandez-Reif, M., & Flom, R. (2005). The development of infant learning about specific face-voice relations. Developmental Psychology, 41(3), 541-552.
6. Bahrick, L. E., & Lickliter, R. (2002). Intersensory redundancy guides early perceptual and cognitive development. In: R. Kail (Ed.), Advances in child development and behavior (Vol. 30, pp. 153-187). New York: Academic Press.
7. Bahrick, L. E., Netto, D., & Hernandez-Reif, M. (1998). Intermodal perception of adult and child faces and voices by infants. Child Development, 69(5), 1263-1275.
8. Bahrick, L. E., Walker, A., & Neisser, U. (1981). Selective looking by infants. Cognitive Psychology, 13(3), 377-390.
9. Besle, J., Fort, A., Delpuech, C., & Giard, M. (2004). Bimodal speech: Early suppressive visual effects in human auditory cortex. European Journal of Neuroscience, 20(8), 2225-2234.
10. Braida, L. D. (1991). Crossmodal integration in the identification of consonant segments. The Quarterly Journal of Experimental Psychology, 43(3), 647-677.
11. Bristow, D., Dehaene-Lambertz, G., Mattout, J., Soares, C., Gliga, T., Baillet, S., & Mangin, J. (2009). Hearing faces: How the infant brain matches the face it sees with the speech it hears. Journal of Cognitive Neuroscience, 21(5), 905-921.
12. Butterfield, E. C., & Siperstein, G. N. (1970). Influence of contingent auditory stimulation upon non-nutritional suckle. In: J. F. Bosma (Ed.), Third Symposium on Oral Sensation and Perception: The mouth of the infant (pp. 313-334). Springfield, IL: Charles C. Thomas.
13. Calvert, G. A. (2001). Crossmodal processing in the human brain: Insights from functional neuroimaging studies. Cerebral Cortex, 11(12), 1110-1123.
14. M. de Haan (Ed.). (2007). Infant EEG and event-related potentials. London: Psychology Press.
15. de Haan, M., & Nelson, C. A. (1997). Recognition of the mother's face by six-month-old infants: A neurobehavioral study. Child Development, 68, 187-210.
16. Dodd, B. (1979). Lip reading in infants: Attention to speech presented in-and out-of-synchrony. Cognitive Psychology, 11(4), 478-484.
17. Doesburg, S. M., Emberson, L., Rahi, A., Cameron, D., & Ward, L. M. (2008). Asynchrony from synchrony: Gamma-band neural synchrony and perception of audiovisual speech asynchrony. Experimental Brain Research, 185(1), 11-20.
18. Elsabbagh, M., Volein, A., Csibra, G., Holmboe, K., Garwood, H., Tucker, L., Krljes, S., Baron-Cohen, S., Bolton, P., Charman, T., Baird, G., & Johnson, M. H. (2009). Neural correlates of eye gaze processing in the infant broader Autism phenotype. Biological Psychiatry, 65, 31-38.
19. Erber, N. P. (1975). Auditory-visual perception of speech. Journal of Speech and Hearing Disorders, 40, 481-492.
20. Flom, R., Whipple, H., & Hyde, D. (2009). Infants' intermodal perception of canine (canis familairis) facial expressions and vocalizations. Developmental Psychology, 45, 1143-1151.
21. Frank, M. C., Slemmer, J. A., Marcus, G. F., & Johnson, S. P. (2009). Information from multiple modalities helps 5-month-olds learn abstract rules. Developmental Science, 12(4), 504-509.
22. Gogate, L. J. (2010). Learning of syllable-object relations by preverbal infants: The role of temporal synchrony and syllable distinctiveness. Journal of Experimental Child Psychology, 105(3), 178-197.
23. Gogate, L. J., Prince, C. G., & Matatyaho, D. J. (2009). Two-month-old infants' sensitivity to changes in syllable-object pairings: The role of temporal synchrony. Journal of Experimental Psychology: Human Perception and Performance, 35, 508-519.
24. Goldman, D. Z., Shapiro, E. G., & Nelson, C. A. (2004). Measurement of vigilance in 2-year-old children. Developmental Neuropsychology, 25(3), 227-250.
25. Grant, K. W., & Seitz, P. (2000). The use of visible speech cues for improving auditory detection of spoken sentences. The Journal of the Acoustical Society of America, 108(3), 1197-1208.
26. Green, K. P. (1998). The use of auditory and visual information during phonetic processing: Implications for theories of speech perception. In: R. Campbell, B. Dodd, & D. Burnham (Eds.), Hearing by Eye II: Advances in the Psychology of Speechreading and Auditory-visual Speech. Psychology Press Ltd., East Sussex, UK, 3-25.
27. Grossmann, T., Gliga, T., Johnson, M. H., & Mareschal, D. (2009). The neural basis of perceptual category learning in human infants. Journal of Cognitive Neuroscience, 21(12), 2276-2286.
28. Grossmann, T., Striano, T., & Friederici, A. D. (2006). Crossmodal integration of emotional information from face and voice in the infant brain. Developmental Science, 9(3), 309-315.
29. Hyde, D. C., Jones, B. L., Porter, C. L., & Flom, R. (2010). Visual stimulation enhances auditory processing in 3-month-old infants and adults. Developmental Psychobiology, 52(2), 181-189.
30. Hyde, D. C., & Spelke, E. S. Neural signatures of number processing in human infants: evidence for two core systems underlying numerical cognition. To appear in Developmental Science, no. doi:10.1111/j.1467-7687.2010.00987.x
31. Izard, V., Dehaene-Lambertz, G., & Dehaene, S. (2008). Distinct cerebral pathways for object identity and number in human infants. PLos Biology, 6(2), 0275-0285.
32. Johnson, M. H., Dzurawaec, S., Ellis, H., & Morton, J. (1991). Newborns' preferential tracking of face-like stimuli and its subsequent decline. Cognition, 40(1-2), 1-19.
33. Jones, J. A., & Callan, D. E. (2003). Brain activity during audiovisual speech perception: An fMRI study of the McGurk effect. NeuroReport, 14, 1129-1133.
34. Kaiser, J., Hertrich, I., Ackermann, H., Mathiak, K., & Lutzenberger, W. (2005). Hearing lips: Gamma-band activity during audio-visual speech perception. Cerebral Cortex, 15, 646-653.
35. Kuhl, P. K., & Meltzoff, A. N. (1982). The bimodal perception of speech in infancy. Science, 218(4577), 1138-1141.
36. Kushnerenko, E., Teinonen, T., Volein, A., & Csibra, G. (2008). Electrophysiological evidence of illusory speech percept in human infants. PNAS, 105, 11442-11445.
37. Lewkowicz, D. J. (1992a). Infants' response to temporally based intersensory equivalence: The effect of synchronous sounds on visual preferences for moving stimuli. Infant Behavior and Development, 15(3), 297-324.
38. Lewkowicz, D. J. (1992b). Infants' responsiveness to auditory and visual components of a sounding/moving compound stimulus in human infants. Perception and Psychophysics, 52(5), 519-528.
39. Lewkowicz, D. J. (1996). Perception of auditory-visual temporal synchrony in human infants. Journal of Experimental Psychology: Human Perception and Performance, 22, 1094-1106.
40. Lewkowicz, D. J. (2000). Development of intersensory temporal perception: An epigenetic systems/limitations view. Psychological Bulletin, 126(2), 281-308.
41. Lewkowicz, D. (2010). Infant perception of audio-visual speech synchrony. Developmental Psychology, 46(1), 66-77.
42. Lewkowicz, D. J., & Ghazanfar, A. A. (2009). The emergence of multisensory systems through perceptual narrowing. Trends in Cognitive Sciences, 13, 470-478.
43. Lewkowicz, D. J., & Kraebel, K. S. (2004). The value of multisensory redundancy in the development of intersensory perception. In: G. A. Calvert, C. Spence, & B. E. Stein (Eds.), The handbook of multisensory processes (pp. 655-678). Cambridge, MA: MIT Press.
44. Lewkowicz, D., Sowinski, R., & Place, S. (2008). The decline of cross-species intersensory perception in human infants: Underlying mechanisms and its developmental persistence. Brain Research, 1242, 291-302.
45. Massaro, D. W. (1987). Speech perception by ear and eye: A paradigm for psychological inquiry. Hillsdale, NJ: Erlbaum.
46. Massaro, D. W. (1998). Perceiving talking faces: From speech perception to a behavioral principle. Cambridge, MA: MIT Press.
47. Miller, L. M., & D'Esposito, M. (2005). Perceptual fusion and stimulus coincidence in the cross-modal integration of speech. Journal of Neuroscience, 22, 5884-5893.
48. Näätänen, R., & Winkler, I. (1999). The concept of auditory stimulus representation in cognitive neuroscience. Psychological Bulletin, 12, 826-859.
49. Nelson, C. A. (1994). Neural correlates of recognition memory in the first postnatal year of life. In: G. Dawson, & K. Fischer (Eds.), Human development and the developing brain (pp. 269-313). New York: Guilford Press.
50. Nelson, C. A. (1996). Electrophysiological correlates of early memory development. In: H. W. Reese, & M. D. Franzen (Eds.), Thirteenth West Virginia University Conference on Life Span Development Psychology: Biological and neurological mechanisms (pp. 95-131). Hillsdale, NJ: Erlbaum.
51. Nelson, C. A. (1998). The nature of early memory. Preventive Medicine, 27, 172-179.
52. Nelson, C. A., & Collins, P. F. (1991). Event-related potential and looking-time analysis of infants' responses to familiar and novel events: Implications for visual-recognition memory. Developmental Psychology, 27, 50-58.
53. Nelson, C. A., & Collins, P. F. (1992). Neural and behavioral correlates of recognition memory in 4- and 8-month-old infants. Brain and Cognition, 19, 105-121.
54. Quinn, P. C., Westerlund, A., & Nelson, C. A. (2006). Neural markers of categorization in 6 month old infants. Psychological Science, 17, 59-66.
55. Pilling, M. (2009). Auditory event-related potentials (ERPs) in audiovisual speech perception. Journal of Speech, Language, and Hearing Research, 52(4), 1073-1081.
56. Reynolds, G. D., Courage, M. L., & Richards, J. E. (2010). Infant attention and visual preferences: Converging evidence from behavior, event-related potentials and cortical source localization. Developmental Psychology, 46, 886-904.
57. Reynolds, G. D., & Richards, J. E. (2005). Familiarization, attention, and recognition memory in infancy: An event-related potential and cortical source localization study. Developmental Psychology, 41, 598-615.
58. Scheier, C., Lewkowicz, D. J., & Shimojo, S. (2003). Sound induces perceptual reorganization of an ambiguous motion display in human infants. Developmental Science, 6(3), 233-241.
59. Scott, L. S., & Nelson, C. A. (2006). Featural and configural face processing in adults and infants: A behavioral and electrophysiological investigation. Perception, 35(8), 1107-1128.
60. Shulman, G. L., Corbetta, M., Buckner, R. L., Raichle, M. E., Fiez, J. A., Miezin, F.M., & Peterson, S. E. (1997). Top-down modulation of early sensory cortex. Cerebral Cortex, 7, 193-206.
61. Spelke, E. S., Born, W. S., & Chu, F. (1983). Perception of moving, sounding objects by four-month-old infants. Perception, 12(6), 719-732.
62. Sumby, W. H., & Pollack, I. (1954). Visual contribution to speech intelligibility in noise. Journal of the Acoustical Society of America, 26, 212-215.
63. Summerfield, A. Q. (1979). Use of visual information in phonetic perception. Phonetica, 36, 314-331.
64. van Wassenhove, V., Grant, K. W., & Poeppel, D. (2005). Visual speech speeds up the neural processing of auditory speech. Proceeding of the National Academy of Sciences of the United States of America, 102, 1181-1186.
65. Vouloumanos, A., & Werker, J. F. (2007). Listening to language at birth: Evidence for a bias for speech in neonates. Developmental Science, 10(2), 159-164.
66. Wright, T. M., Pelphrey, K. A., Allison, T., McKeown, M. J., & McCarthy, G. (2003). Polysensory interaction along temporal regions evoked by audiovisual speech. Cerebral Cortex, 13, 1034-1043.