Development of multisensory temporal perception

The Neural Bases of Multisensory Processes

Volumn , Issue , 2011, Pages 325-343

  Lewkowicz, David J ^a  

^a FLORIDA ATLANTIC UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84921587232     PISSN: None     EISSN: None     Source Type: Book    
DOI: None     Document Type: Chapter

References (121)

1. Bahrick, L.E. 1983. Infants' perception of substance and temporal synchrony in multimodal events. Infant Behavior & Development 6:429-51.
2. Bahrick, L.E. 1994. The development of infants' sensitivity to arbitrary intermodal relations. Ecological Psychology 6:111-23.
3. Bahrick, L.E., and R. Lickliter. 2000. Intersensory redundancy guides attentional selectivity and perceptual learning in infancy. Developmental Psychology 36:190-201.
4. Bahrick, L.E., R. Lickliter, and R. Flom. 2004. Intersensory redundancy guides the development of selective attention, perception, and cognition in infancy. Current Directions in Psychological Science 13:99-102.
5. Birch, H.G., and A. Lefford. 1963. Intersensory development in children. Monographs of the Society for Research in Child Development 25.
6. Birch, H.G., and A. Lefford. 1967. Visual differentiation, intersensory integration, and voluntary motor control. Monographs of the Society for Research in Child Development 32:1-87.
7. Bizley, J.K., F.R. Nodal, V.M. Bajo, I. Nelken, and A.J. King. 2007. Physiological and anatomical evidence for multisensory interactions in auditory cortex. Cerebral Cortex 17:2172-89.
8. Brannon, E.M., S. Suanda, and K. Libertus. 2007. Temporal discrimination increases in precision over develop-ment and parallels the development of numerosity discrimination. Developmental Science 10:770-7.
9. Bremner, A.J., N.P. Holmes, and C. Spence. 2008. Infants lost in (peripersonal) space? Trends in Cognitive Sciences 12:298-305.
10. Brookes, H., A. Slater, P.C. Quinn et al. 2001. Three-month-old infants learn arbitrary auditory-visual pairings between voices and faces. Infant & Child Development 10:75-82.
11. Bushara, K.O., J. Grafman, and M. Hallett. 2001. Neural correlates of auditory-visual stimulus onset asyn-chrony detection. Journal of Neuroscience 21:300-4.
12. Calvert, G.A., M.J. Brammer, E.T. Bullmore et al. 1999. Response amplification in sensory-specific corti-ces during crossmodal binding. Neuroreport: For Rapid Communication of Neuroscience Research 10:2619-23.
13. Calvert, G.A., C. Spence, and B. Stein (eds.). 2004. The Handbook of Multisensory Processes. Cambridge, MA: MIT Press.
14. Canfield, R.L., and M.M. Haith. 1991. Young infants' visual expectations for symmetric and asymmetric stimu-lus sequences. Developmental Psychology 27:198-208.
15. Canfield, R.L., E.G. Smith, M.P. Brezsnyak, and K.L. Snow. 1997. Information processing through the first year of life: A longitudinal study using the visual expectation paradigm. Monographs of the Society for Research in Child Development 62:v-vi, 1-145.
16. Clifton, R.K. 1974. Heart rate conditioning in the newborn infant. Journal of Experimental Child Psychology 18:9-21.
17. Colombo, J., and W.A. Richman. 2002. Infant timekeeping: Attention and temporal estimation in 4-month-olds. Psychological Science 13:475-9.
18. Donohue, R.L., and W.K. Berg. 1991. Infant heart-rate responses to temporally predictable and unpredictable events. Developmental Psychology 27:59-66.
19. Fiser, J., and R.N. Aslin. 2002. Statistical learning of new visual feature combinations by infants. Proceedings of the National Academy of Sciences of the United States of America 99:15822-6.
20. Foxe, J.J., and C.E. Schroeder. 2005. The case for feedforward multisensory convergence during early cortical processing. Neuroreport 16:419.
21. Fraisse, P. 1982. The adaptation of the child to time. In W.J. Friedman (ed.), The developmental psychology of time, 113-40. New York: Academic Press.
22. Frank, M.C., J.A. Slemmer, G.F. Marcus, and S.P. Johnson. 2009. Information from multiple modalities helps 5-month-olds learn abstract rules. Developmental Science 12:504-9.
23. Fujisaki, W., S. Shimojo, M. Kashino, and S.Y. Nishida. 2004. Recalibration of audiovisual simultaneity. Nature Neuroscience 7:773-8.
24. Gardner, J.M., D.J. Lewkowicz, S.A. Rose, and B.Z. Karmel. 1986. Effects of visual and auditory stimula-tion on subsequent visual preferences in neonates. International Journal of Behavioral Development 9:251-63.
25. Gebhard, J.W., and G.H. Mowbray. 1959. On discriminating the rate of visual flicker and auditory flutter. American Journal of Psychology 72:521-9.
26. Gerken, L. 2006. Decisions, decisions: Infant language learning when multiple generalizations are possible. Cognition 98:B67-74.
27. Ghazanfar, A.A., and C.E. Schroeder. 2006. Is neocortex essentially multisensory? Trends in Cognitive Sciences 10:278-85. Epub 2006 May 18.
28. Ghazanfar, A.A., J.X. Maier, K.L. Hoffman, and N.K. Logothetis. 2005. Multisensory integration of dynamic faces and voices in rhesus monkey auditory cortex. Journal of Neuroscience 25:5004-12.
29. Giard, M.H., and F. Peronnet. 1999. Auditory-visual integration during multimodal object recognition in humans: A behavioral and electrophysiological study. Journal of Cognitive Neuroscience 11:473-90.
30. Gibson, J.J. 1966. The senses considered as perceptual systems. Boston: Houghton-Mifflin.
31. Gibson, E.J. 1969. Principles of perceptual learning and development. New York: Appleton.
32. Gómez, R.L., and J. Maye. 2005. The developmental trajectory of nonadjacent dependency learning. Infancy 7:183-206.
33. Gottlieb, G. 1971. Ontogenesis of sensory function in birds and mammals. In The biopsychology of develop-ment, ed. E. Tobach, L.R. Aronson, and E. Shaw, 67-128. New York: Academic Press.
34. Gottlieb, G., D. Wahlsten, and R. Lickliter. 2006. The significance of biology for human development: A devel-opmental psychobiological systems view. In Handbook of child psychology, ed. R. Lerner, 210-57. New York: Wiley.
35. Greenfield, P.M. 1991. Language, tools and brain: The ontogeny and phylogeny of hierarchically organized sequential behavior. Behavioral and Brain Sciences 14:531-95.
36. Gulya, M., and M. Colombo. 2004. The ontogeny of serial-order behavior in humans (Homo sapiens): Representation of a list. Journal of Comparative Psychology 118:71-81.
37. Handel, S., and L. Buffardi. 1969. Using several modalities to perceive one temporal pattern. Quarterly Journal of Experimental Psychology 21:256-66.
38. Johnson, S.P., K.J. Fernandes, M.C. Frank et al. 2009. Abstract rule learning for visual sequences in 8- and 11-month-olds. Infancy 14:2-18.
39. Kahana-Kalman, R., and A.S. Walker-Andrews. 2001. The role of person familiarity in young infants' percep-tion of emotional expressions. Child Development 72:352-69.
40. Kamachi, M., H. Hill, K. Lander, and E. Vatikiotis-Bateson. 2003. Putting the face to the voice: Matching identity across modality. Current Biology 13:1709-14.
41. Kellman, P.J., and M.E. Arterberry. 1998. The cradle of knowledge: Development of perception in infancy. Cambridge, MA: MIT Press.
42. King, A.J., M.E. Hutchings, D.R. Moore, and C. Blakemore. 1988. Developmental plasticity in the visual and auditory representations in the mammalian superior colliculus. Nature 332:73-6.
43. Kirkham, N.Z., J.A. Slemmer, and S.P. Johnson. 2002. Visual statistical learning in infancy: Evidence for a domain general learning mechanism. Cognition 83:B35-42.
44. Knudsen, E.I., and M.S. Brainard. 1991. Visual instruction of the neural map of auditory space in the develop-ing optic tectum. Science 253:85-7.
45. Kuhl, P.K., and A.N. Meltzoff. 1982. The bimodal perception of speech in infancy. Science 218:1138-41.
46. Kuhl, P.K., and A.N. Meltzoff. 1984. The intermodal representation of speech in infants. Infant Behavior & Development 7:361-81.
47. Lashley, K.S. 1951. The problem of serial order in behavior. In Cerebral mechanisms in behavior: The Hixon symposium, ed. L.A. Jeffress, 123-47. New York: Wiley.
48. Lewkowicz, D.J. 1986. Developmental changes in infants' bisensory response to synchronous durations. Infant Behavior & Development 9:335-53.
49. Lewkowicz, D.J. 1992a. Infants' response to temporally based intersensory equivalence: The effect of synchro-nous sounds on visual preferences for moving stimuli. Infant Behavior & Development 15:297-324.
50. Lewkowicz, D.J. 1992b. Infants' responsiveness to the auditory and visual attributes of a sounding/moving stimulus. Perception & Psychophysics 52:519-28.
51. Lewkowicz, D.J. 1994. Limitations on infants' response to rate-based auditory-visual relations. Developmental Psychology 30:880-92.
52. Lewkowicz, D.J. 1996. Perception of auditory-visual temporal synchrony in human infants. Journal of Experimental Psychology: Human Perception & Performance 22:1094-106.
53. Lewkowicz, D.J. 2000a. The development of intersensory temporal perception: An epigenetic systems/limita-tions view. Psychological Bulletin 126:281-308.
54. Lewkowicz, D.J. 2000b. Infants' perception of the audible, visible and bimodal attributes of multimodal syl-lables. Child Development 71:1241-57.
55. Lewkowicz, D.J. 2002. Heterogeneity and heterochrony in the development of intersensory perception. Cognitive Brain Research 14:41-63.
56. Lewkowicz, D.J. 2003. Learning and discrimination of audiovisual events in human infants: The hierarchical relation between intersensory temporal synchrony and rhythmic pattern cues. Developmental Psychology 39:795-804.
57. Lewkowicz, D.J. 2004. Perception of serial order in infants. Developmental Science 7:175-84.
58. Lewkowicz, D.J. 2008. Perception of dynamic and static audiovisual sequences in 3- and 4-month-old infants. Child Development 79:1538-54.
59. Lewkowicz, D.J. 2010. Infant perception of audio-visual speech synchrony. Developmental Psychology 46:66-77.
60. Lewkowicz, D.J., and I. Berent. 2009. Sequence learning in 4-month-old infants: Do infants represent ordinal information? Child Development 80:1811-23.
61. Lewkowicz, D., and K. Kraebel. 2004. The value of multisensory redundancy in the development of intersen-sory perception. The Handbook of Multisensory Processes: 655-78. Cambridge, MA: MIT Press.
62. Lewkowicz, D.J., and A.A. Ghazanfar. 2006. The decline of cross-species intersensory perception in human infants. Proceedings of the National Academy of Sciences of the United States of America 103:6771-4.
63. Lewkowicz, D.J., and G. Turkewitz. 1980. Cross-modal equivalence in early infancy: Auditory-visual intensity matching. Developmental Psychology 16:597-607.
64. Lewkowicz, D.J., and G. Turkewitz. 1981. Intersensory interaction in newborns: Modification of visual prefer-ences following exposure to sound. Child Development 52:827-32.
65. Lewkowicz, D.J., R. Sowinski, and S. Place. 2008. The decline of cross-species intersensory perception in human infants: Underlying mechanisms and its developmental persistence. Brain Research 1242:291-302.
66. Lewkowicz, D.J., I. Leo, and F. Simion. 2010. Intersensory perception at birth: Newborns match non-human primate faces and voices. Infancy 15:46-60.
67. Lickliter, R., and L.E. Bahrick. 2000. The development of infant intersensory perception: Advantages of a comparative convergent-operations approach. Psychological Bulletin 126:260-80.
68. Lickliter, R., and H. Banker. 1994. Prenatal components of intersensory development in precocial birds. In Development of intersensory perception: Comparative perspectives, ed. D.J. Lewkowicz and R. Lickliter, 59-80. Norwood, NJ: Lawrence Erlbaum Associates, Inc.
69. Lickliter, R., D.J. Lewkowicz, and R.F. Columbus. 1996. Intersensory experience and early perceptual devel-opment: The role of spatial contiguity in bobwhite quail chicks' responsiveness to multimodal maternal cues. Developmental Psychobiology 29:403-16.
70. Maier, N.R.F., and T.C. Schneirla. 1964. Principles of animal psychology. New York: Dover Publications.
71. Marcovitch, S., and D.J. Lewkowicz. 2009. Sequence learning in infancy: The independent contributions of conditional probability and pair frequency information. Developmental Science 12:1020-5.
72. Marcus, G.F., S. Vijayan, S. Rao, and P. Vishton. 1999. Rule learning by seven-month-old infants. Science 283:77-80.
73. Marcus, G.F., K.J. Fernandes, and S.P. Johnson. 2007. Infant rule learning facilitated by speech. Psychological Science 18:387-91.
74. Marks, L. 1978. The unity of the senses. New York: Academic Press.
75. Martin, J.G. 1972. Rhythmic (hierarchical) versus serial structure in speech and other behavior. Psychological Review 79:487-509.
76. McGurk, H., and J. MacDonald. 1976. Hearing lips and seeing voices. Nature 264:229-39.
77. Molholm, S., W. Ritter, M.M. Murray et al. 2002. Multisensory auditory-visual interactions during early sensory processing in humans: A high-density electrical mapping study. Cognitive Brain Research 14:115-28.
78. Munhall, K.G., and E. Vatikiotis-Bateson. 2004. Spatial and temporal constraints on audiovisual speech percep-tion. In The handbook of multisensory processes, ed. G.A. Calvert, C. Spence, and B.E. Stein, 177-88. Cambridge, MA: MIT Press.
79. Myers, A.K., B. Cotton, and H.A. Hilp. 1981. Matching the rate of concurrent tone bursts and light flashes as a function of flash surround luminance. Perception & Psychophysics 30(1):33-8.
80. Navarra, J., A. Vatakis, M. Zampini et al. 2005. Exposure to asynchronous audiovisual speech extends the tem-poral window for audiovisual integration. Cognitive Brain Research 25:499-507.
81. Nazzi, T., and F. Ramus. 2003. Perception and acquisition of linguistic rhythm by infants. Speech Communication 41:233-43.
82. Neil, P.A., C. Chee-Ruiter, C. Scheier, D.J. Lewkowicz, and S. Shimojo. 2006. Development of multisensory spatial integration and perception in humans. Developmental Science 9:454-64.
83. Nelson, K. 1986. Event knowledge: Structure and function in development. Hillsdale, NJ: Lawrence Erlbaum Associates.
84. Nelson, K. 2007. Young minds in social worlds. Cambridge, MA: Harvard Univ. Press.
85. Oppenheim, R.W. 1981. Ontogenetic adaptations and retrogressive processes in the development of the nervous system and behavior: A neuroembryological perspective. In Maturation and development: Biological and psychological perspectives, ed. K.J. Connolly and H.F.R. Prechtl, 73-109. Philadelphia, PA: Lippincott.
86. Partan, S., and P. Marler. 1999. Communication goes multimodal. Science 283:1272-3.
87. Patterson, M.L., and J.F. Werker. 2002. Infants' ability to match dynamic phonetic and gender information in the face and voice. Journal of Experimental Child Psychology 81:93-115.
88. Patterson, M.L., and J.F. Werker. 2003. Two-month-old infants match phonetic information in lips and voice. Developmental Science 6(2):191-6.
89. Piaget, J. 1952. The origins of intelligence in children. New York: International Universities Press.
90. Pons, F., D.J. Lewkowicz, S. Soto-Faraco, and N. Sebastián-Gallés. 2009. Narrowing of intersensory speech perception in infancy. Proceedings of the National Academy of Sciences of the United States of America 106:10598-602.
91. Reardon, P., and E.W. Bushnell. 1988. Infants' sensitivity to arbitrary pairings of color and taste. Infant Behavior and Development 11:245-50.
92. Romei, V., M.M. Murray, C. Cappe, and G. Thut. 2009. Preperceptual and stimulus-selective enhancement of low-level human visual cortex excitability by sounds. Current Biology 19:1799-805.
93. Rowe, C. 1999. Receiver psychology and the evolution of multicomponent signals. Animal Behaviour 58:921-31.
94. Saffran, J.R., R.N. Aslin, and E.L. Newport. 1996. Statistical learning by 8-month-old infants. Science 274:1926-8.
95. Scheier, C., D.J. Lewkowicz, and S. Shimojo. 2003. Sound induces perceptual reorganization of an ambiguous motion display in human infants. Developmental Science 6:233-44.
96. Sekuler, R., A.B. Sekuler, and R. Lau. 1997. Sound alters visual motion perception. Nature 385:308.
97. Shams, L., Y. Kamitani, and S. Shimojo. 2000. What you see is what you hear. Nature 408(6814):788.
98. Shipley, T. 1964. Auditory flutter-driving of visual flicker. Science 145:1328-30.
99. Slater, A., E. Brown, and M. Badenoch. 1997. Intermodal perception at birth: Newborn infants' memory for arbitrary auditory-visual pairings. Early Development & Parenting 6:99-104.
100. Slater, A., P.C. Quinn, E. Brown, and R. Hayes. 1999. Intermodal perception at birth: Intersensory redundancy guides newborn infants' learning of arbitrary auditory-visual pairings. Developmental Science 2:333-8.
101. Slutsky, D.A., and G.H. Recanzone. 2001. Temporal and spatial dependency of the ventriloquism effect. Neuroreport 12:7-10.
102. Stein, B.E., and M.A. Meredith. 1993. The Merging of the Senses. Cambridge, MA: MIT Press.
103. Stein, B.E., and T.R. Stanford. 2008. Multisensory integration: Current issues from the perspective of the single neuron. Nature Reviews. Neuroscience 9:255-66.
104. Stein, B.E., D. Burr, C. Constantinidis et al. 2010. Semantic confusion regarding the development of multisen-sory integration: A practical solution. European Journal of Neuroscience 31:1713-20.
105. Thelen, E., and L.B. Smith. 1994. A dynamic systems approach to the development of cognition and action. Cambridge, MA: MIT Press.
106. Thomas, K.M., and C.A. Nelson. 2001. Serial reaction time learning in preschool- and school-age children. Journal of Experimental Child Psychology 79:364-87.
107. Turkewitz, G. 1994. Sources of order for intersensory functioning. In The development of intersensory percep-tion: Comparative perspectives, ed. D.J. Lewkowicz and R. Lickliter, 3-17. Hillsdale, NJ: Lawrence Erlbaum Associates.
108. Turkewitz, G., and P.A. Kenny. 1982. Limitations on input as a basis for neural organization and perceptual development: A preliminary theoretical statement. Developmental Psychobiology 15:357-68.
109. Vroomen, J., M. Keetels, B. de Gelder, and P. Bertelson. 2004. Recalibration of temporal order perception by exposure to audio-visual asynchrony. Cognitive Brain Research 22:32-5.
110. Walker-Andrews, A.S. 1986. Intermodal perception of expressive behaviors: Relation of eye and voice? Developmental Psychology 22:373-7.
111. Walker-Andrews, A.S. 1997. Infants' perception of expressive behaviors: Differentiation of multimodal infor-mation. Psychological Bulletin 121:437-56.
112. Walker-Andrews, A.S., L.E. Bahrick, S.S. Raglioni, and I. Diaz. 1991. Infants' bimodal perception of gender. Ecological Psychology 3:55-75.
113. Wallace, M.T., and B.E. Stein. 1997. Development of multisensory neurons and multisensory integration in cat superior colliculus. Journal of Neuroscience 17:2429-44.
114. Wallace, M.T., and B.E. Stein. 2001. Sensory and multisensory responses in the newborn monkey superior col-liculus. Journal of Neuroscience 21:8886-94.
115. Wallace, M.T., R. Ramachandran, and B.E. Stein. 2004. A revised view of sensory cortical parcellation. Proceedings of the National Academy of Sciences of the United States of America 101:2167-72.
116. Wallace, M.T., B.E. Stein, and R. Ramachandran. 2006. Early experience determines how the senses will inter-act: A revised view of sensory cortical parcellation. Journal of Neurophysiology 101:2167-72.
117. Welch, R.B., and D.H. Warren. 1980. Immediate perceptual response to intersensory discrepancy. Psychological Bulletin 88:638-67.
118. Welch, R.B., L.D. Duttenhurt, and D.H. Warren. 1986. Contributions of audition and vision to temporal rate perception. Perception & Psychophysics 39:294-300.
119. Werner, H. 1973. Comparative psychology of mental development. New York: International Universities Press.
120. Yehia, H., P. Rubin, and E. Vatikiotis-Bateson. 1998. Quantitative association of vocal-tract and facial behavior. Speech Communication 26:23-43.
121. Zangenehpour, S., A.A. Ghazanfar, D.J. Lewkowicz, and R.J. Zatorre. 2009. Heterochrony and cross-species intersensory matching by infant vervet monkeys. PLoS ONE 4:e4302.