Infant Perception of Audio-Visual Speech Synchrony

Developmental Psychology

Volumn 46, Issue 1, 2010, Pages 66-77

  Lewkowicz, David J ^a  

^a FLORIDA ATLANTIC UNIVERSITY   (United States)

Author keywords

audio visual synchrony; audiovisual speech; infants; intersensory

Indexed keywords

ANALYSIS OF VARIANCE; ARTICLE; AUDITORY STIMULATION; ELECTROENCEPHALOGRAPHY; FEMALE; HABITUATION; HEARING; HUMAN; INFANT; MALE; METHODOLOGY; PATTERN RECOGNITION; PHOTOSTIMULATION; PHYSIOLOGY; PSYCHOPHYSICS; REACTION TIME; TIME PERCEPTION; VISION;

ACOUSTIC STIMULATION; ANALYSIS OF VARIANCE; AUDITORY PERCEPTION; ELECTROENCEPHALOGRAPHY; FEMALE; HABITUATION, PSYCHOPHYSIOLOGIC; HUMANS; INFANT; MALE; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; PSYCHOPHYSICS; REACTION TIME; TIME PERCEPTION; VISUAL PERCEPTION;

EID: 76449099119     PISSN: 00121649     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0015579     Document Type: Article

References (70)

1. Bahrick L.E. Intermodal learning in infancy: Learning on the basis of two kinds of invariant relations in audible and visible events. Child Development 59 (1988) 197-209
2. Bahrick L.E., Hernandez-Reif M., and Flom R. The development of infant learning about specific face-voice relations. Developmental Psychology 41 3 (2005) 541-552
3. Bahrick L.E., and Lickliter R. Intersensory redundancy guides attentional selectivity and perceptual learning in infancy. Developmental Psychology 36 2 (2000) 190-201
4. Bahrick L.E., Lickliter R., and Flom R. Intersensory redundancy guides the development of selective attention, perception, and cognition in infancy. Current Directions in Psychological Science 13 3 (2004) 99-102
5. Bahrick L.E., Walker A., and Neisser U. Selective looking by infants. Cognitive Psychology 13 3 (1981) 377-390
6. Bergeson T.R., Pisoni D.B., and Davis R.A.O. Development of audiovisual comprehension skills in prelingually deaf children with cochlear implants. Ear and Hearing 26 2 (2005) 149-164
7. Brannon E.M., Suanda S., and Libertus K. Temporal discrimination increases in precision over development and parallels the development of numerosity discrimination. Developmental Science 10 6 (2007) 770-777
8. Brookes H., Slater A., Quinn P.C., Lewkowicz D.J., Hayes R., and Brown E. Three-month-old infants learn arbitrary auditory-visual pairings between voices and faces. Infant and Child Development 10 1-2 (2001) 75-82
9. Bushara K.O., Grafman J., and Hallett M. Neural correlates of auditory-visual stimulus onset asynchrony detection. Journal of Neuroscience 21 1 (2001) 300-304
10. Canfield R.L., and Haith M.M. Young infants' visual expectations for symmetric and asymmetric stimulus sequences. Developmental Psychology 27 2 (1991) 198-208
11. Colombo J., and Richman W.A. Infant timekeeping: Attention and temporal estimation in 4-month-olds. Psychological Science 13 5 (2002) 475-479
12. Dixon N.F., and Spitz L.T. The detection of auditory visual desynchrony. Perception 9 (1980) 719-721
13. Dodd B. Lip reading in infants: Attention to speech presented in- and out-of-synchrony. Cognitive Psychology 11 4 (1979) 478-484
14. Fraisse P. The adaptation of the child to time. In: Friedman W.J. (Ed). The developmental psychology of time (1982), Academic Press, New York 113-140
15. Fujisaki W., Shimojo S., Kashino M., and Nishida S. Recalibration of audiovisual simultaneity. Nature Neuroscience 7 7 (2004) 773-778
16. Gibson E.J. Principles of perceptual learning and development (1969), Appleton, New York
17. Gibson E.J. Perceptual development from the ecological approach. In: Lamb M.E., Brown A.L., and Rogoff B. (Eds). Advances in developmental psychology (1984), Erlbaum, Hillsdale, NJ 243-286
18. Gibson J.J. The senses considered as perceptual systems (1966), Houghton-Mifflin, Boston
19. Grant K.W., van Wassenhove V., and Poeppel D. Detection of auditory (cross-spectral) and auditory-visual (cross-modal) synchrony. Speech Communication 44 1-4 (2004) 43-53
20. Hollich G., Newman R.S., and Jusczyk P.W. Infants' use of synchronized visual information to separate streams of speech. Child Development 76 3 (2005) 598-613
21. Kahana-Kalman R., and Walker-Andrews A.S. The role of person familiarity in young infants' perception of emotional expressions. Child Development 72 2 (2001) 352-369
22. Kamachi M., Hill H., Lander K., and Vatikiotis-Bateson E. Putting the face to the voice: Matching identity across modality. Current Biology 13 19 (2003) 1709-1714
23. Kuhl P.K., and Meltzoff A.N. The bimodal perception of speech in infancy. Science 218 4577 (1982, December 10) 1138-1141
24. Kuhl P.K., and Meltzoff A.N. The intermodal representation of speech in infants. Infant Behavior & Development 7 3 (1984) 361-381
25. Lewkowicz D.J. Developmental changes in infants' bisensory response to synchronous durations. Infant Behavior & Development 9 3 (1986) 335-353
26. Lewkowicz D.J. The role of temporal factors in infant behavior and development. In: Levin I., and Zakay D. (Eds). Time and human cognition: A life-span perspective (1989), North-Holland, Amsterdam 9-62
27. Lewkowicz D.J. Infants' response to temporally based intersensory equivalence: The effect of synchronous sounds on visual preferences for moving stimuli. Infant Behavior & Development 15 3 (1992) 297-324
28. Lewkowicz D.J. Infants' responsiveness to the auditory and visual attributes of a sounding/moving stimulus. Perception & Psychophysics 52 5 (1992) 519-528
29. Lewkowicz D.J. Infants' response to the audible and visible properties of the human face: I. Role of lexical-syntactic content, temporal synchrony, gender, and manner of speech. Developmental Psychology 32 2 (1996) 347-366
30. Lewkowicz D.J. Perception of auditory-visual temporal synchrony in human infants. Journal of Experimental Psychology: Human Perception and Performance 22 5 (1996) 1094-1106
31. Lewkowicz D.J. Infants' response to the audible and visible properties of the human face: II. Discrimination of differences between singing and adult-directed speech. Developmental Psychobiology 32 (1998) 261-274
32. Lewkowicz D.J. The development of intersensory temporal perception: An epigenetic systems/limitations view. Psychological Bulletin 126 2 (2000) 281-308
33. Lewkowicz D.J. Infants' perception of the audible, visible and bimodal attributes of multimodal syllables. Child Development 71 5 (2000) 1241-1257
34. Lewkowicz D.J. Heterogeneity and heterochrony in the development of intersensory perception. Cognitive Brain Research 14 (2002) 41-63
35. Lewkowicz D.J. Learning and discrimination of audiovisual events in human infants: The hierarchical relation between intersensory temporal synchrony and rhythmic pattern cues. Developmental Psychology 39 5 (2003) 795-804
36. Lewkowicz D.J., and Ghazanfar A.A. The decline of cross-species intersensory perception in human infants. Proceedings of the National Academy of Sciences, USA 103 17 (2006) 6771-6774
37. Lewkowicz D.J., and Kraebel K. The value of multimodal redundancy in the development of intersensory perception. In: Calvert G.A., Spence C., and Stein B.E. (Eds). The handbook of multisensory processing (2004), MIT Press, Cambridge, MA 655-678
38. Lewkowicz D.J., and Lickliter R. The development of intersensory perception: Comparative perspectives (1994), Erlbaum, Hillsdale, NJ
39. Lewkowicz D.J., Sowinski R., and Place S. The decline of cross-species intersensory perception in human infants: Underlying mechanisms and its developmental persistence. Brain Research 1242 (2008) 291-302
40. Lickliter R., and Bahrick L.E. The development of infant intersensory perception: Advantages of a comparative convergent-operations approach. Psychological Bulletin 126 2 (2000) 260-280
41. Lickliter R., Bahrick L.E., and Honeycutt H. Intersensory redundancy facilitates prenatal perceptual learning in bobwhite quail (Colinus virginianus) embryos. Developmental Psychology 38 1 (2002) 15-23
42. Lickliter R., Bahrick L.E., and Honeycutt H. Intersensory redundancy enhances memory in bobwhite quail embryos. Infancy 5 3 (2004) 253-269
43. Meredith M.A., Nemitz J.W., and Stein B.E. Determinants of multisensory integration in superior colliculus neurons: I. Temporal factors. Journal of Neuroscience 7 10 (1987) 3215-3229
44. Munhall K.G., and Buchan J.N. Something in the way she moves. Trends in Cognitive Sciences 8 2 (2004) 51-53
45. Munhall K.G., and Vatikiotis-Bateson E. The moving face during speech communication. In: Campbell R., Dodd B., and Burnham D. (Eds). Hearing by eye II: Advances in the psychology of speechreading and auditory-visual speech (1998), Psychology Press, Hove, England 123-139
46. Munhall K.G., and Vatikiotis-Bateson E. Spatial and temporal constraints on audiovisual speech perception. In: Calvert G.A., Spence C., and Stein B.E. (Eds). The handbook of multisensory processes (2004), MIT Press, Cambridge, MA 177-188
47. Navarra J., Vatakis A., Zampini M., Soto-Faraco S., Humphreys W., and Spence C. Exposure to asynchronous audiovisual speech extends the temporal window for audiovisual integration. Cognitive Brain Research 25 2 (2005) 499-507
48. Neil P.A., Chee-Ruiter C., Scheier C., Lewkowicz D.J., and Shimojo S. Development of multisensory spatial integration and perception in humans. Developmental Science 9 5 (2006) 454-464
49. Nelson K. Event knowledge: Structure and function in development (1986), Erlbaum, Hillsdale, NJ
50. Nelson K. Young minds in social worlds (2007), Harvard University Press, Cambridge, MA
51. Partan S., and Marler P. Communication goes multimodal. Science 283 5406 (1999, February 26) 1272-1273
52. Patterson M.L., and Werker J.F. Matching phonetic information in lips and voice is robust in 4.5-month-old infants. Infant Behavior & Development 22 2 (1999) 237-247
53. Patterson M.L., and Werker J.F. Infants' ability to match dynamic phonetic and gender information in the face and voice. Journal of Experimental Child Psychology 81 1 (2002) 93-115
54. Patterson M.L., and Werker J.F. Two-month-old infants match phonetic information in lips and voice. Developmental Science 6 2 (2003) 191-196
55. Rowe C. Receiver psychology and the evolution of multicomponent signals. Animal Behaviour 58 (1999) 921-931
56. Saygin A.P., Driver J., and de Sa V.R. In the footsteps of biological motion and multisensory perception: Judgments of audiovisual temporal relations are enhanced for upright walkers. Psychological Science 19 5 (2008) 469-475
57. Scheier C., Lewkowicz D.J., and Shimojo S. Sound induces perceptual reorganization of an ambiguous motion display in human infants. Developmental Science 6 3 (2003) 233-241
58. Stein B.E., and Meredith M.A. The merging of the senses (1993), MIT Press, Cambridge, MA
59. Stein B.E., and Stanford T.R. Multisensory integration: Current issues from the perspective of the single neuron. Nature Reviews Neuroscience 9 4 (2008) 255-266
60. Sumby W.H., and Pollack I. Visual contribution to speech intelligibility in noise. Journal of the Acoustical Society of America 26 (1954) 212-215
61. Summerfield A.Q. Use of visual information in phonetic perception. Phonetica 36 (1979) 314-331
62. Thelen E., and Smith L.B. A dynamic systems approach to the development of cognition and action (1994), MIT Press, Cambridge, MA
63. Vatakis A., and Spence C. Crossmodal binding: Evaluating the "unity assumption" using audiovisual speech stimuli. Perception & Psychophysics 69 5 (2007) 744-756
64. Vroomen J., Keetels M., de Gelder B., and Bertelson P. Recalibration of temporal order perception by exposure to audio-visual asynchrony. Cognitive Brain Research 22 1 (2004) 32-35
65. Walker-Andrews A.S. Intermodal perception of expressive behaviors: Relation of eye and voice?. Developmental Psychology 22 3 (1986) 373-377
66. Walker-Andrews A.S. Infants' perception of expressive behaviors: Differentiation of multimodal information. Psychological Bulletin 121 3 (1997) 437-456
67. Wallace M.T. The development of multisensory integration. In: Calvert G.A., Spence C., and Stein B.E. (Eds). The handbook of multisensory processes (2004), MIT Press, Cambridge, MA 625-642
68. Welch R.B., and Warren D.H. Immediate perceptual response to intersensory discrepancy. Psychological Bulletin 88 (1980) 638-667
69. Wentworth N., and Haith M.M. Infants' acquisition of spatiotemporal expectations. Developmental Psychology 34 2 (1998) 247-257
70. Yehia H., Rubin P., and Vatikiotis-Bateson E. Quantitative association of vocal-tract and facial behavior. Speech Communication 26 1-2, (1998) 23-43