Cross-modal mapping of visual and acoustic displays in infants: The effect of dynamic and static components

European Journal of Developmental Psychology

Volumn 10, Issue 3, 2013, Pages 337-358

  Jeschonek, Susanna ^a   Pauen, Sabina ^a,b   Babocsai, Lysett ^a,b  

^a HAMBURG UNIVERSITY OF APPLIED SCIENCES   (Germany)

^b UNIVERSITY OF HEIDELBERG   (Germany)

Author keywords

Cross modal perception; Dynamic; Infants; Pitch; Spatial height; Static

Indexed keywords

EID: 84876235583     PISSN: 17405629     EISSN: 17405610     Source Type: Journal    
DOI: 10.1080/17405629.2012.681590     Document Type: Article

References (40)

1. Bahrick, L. E. 1983. Infants' perception of substance and temporal synchrony in multimodal events. Infant Behavior and Development, 6: 429-451.
2. Bahrick, L. E. 1992. Infants' perceptual differentiation of amodal and modality-specific audio-visual relations. Journal of Experimental Child Psychology, 53: 180-199.
3. Ben-Artzi, E. and Marks, L. E. 1995. Visual-auditory interaction in speeded classification: Role of stimulus difference. Perception and Psychophysics, 57: 1151-1162.
4. Clifton, R. K., Morrongiello, B. A., Kulig, J. W. and Dowd, J. M. 1981. Newborns' orientation towards sound: Possible implications for cortical development. Child Development, 52: 833-838.
5. Dodd, B. 1979. Lip reading in infants: Attention to speech presented in- and out-of-synchrony. Cognitive Psychology, 11: 478-484.
6. Eitan, Z. and Granot, R. Y. 2006. How music moves: Musical parameters and listeners' images of motion. Music Perception, 23(3): 221-247.
7. Eitan, Z. and Timmers, R. 2010. Beethoven's last piano sonata and those who follow crocodiles: Cross-domain mappings of auditory pitch in a musical context. Cognition, 114: 405-422.
8. Harrison, J. E. and Baron-Cohen, S. 1997. "Synaesthesia: An introduction". In Synaesthesia: Classic and contemporary readings, Edited by: Baron-Cohen, S. and Harrison, J. 173-181. Oxford, UK: Blackwell.
9. Lawson, K. R. & Ruff, H. A. 1984. Infants' Visual Following: The effect of Size and Sound. Developmental Psychyology, 20(3): 427-434.
10. Lidji, P., Kolinsky, R., Lochy, A. and Morais, J. 2007. Spatial associations for musical stimuli: A piano in the head?. Journal of Experimental Psychology: Human Perception and Performance, 33: 1189-1207.
11. Maeda, F., Kanai, R. and Shimojo, S. 2004. Changing pitch induced visual motion illusion. Current Biology, 14(23): R990-R991.
12. Marks, L. E. 1974. On associations of light and sound: The mediation of brightness, pitch, and loudness. American Journal of Psychology, 87: 173-188.
13. Marks, L. E. 1975. On coloured-hearing synaesthesia: Cross-modal translations of sensory dimensions. Psychological Bulletin, 82: 303-331.
14. Marks, L. E. 1978. The unity of the senses: Interrelations among the modalities, New York, NY: Academic Press.
15. Marks, L. E., Hammeal, R. and Bornstein, M. 1987. Perceiving similarity and comprehending metaphor. Monographs of the Society for Research in Child Development, 52(Serial No. 215)
16. Martino, G. and Marks, L. E. 2001. Synesthesia: Strong and weak. Current Directions in Psychological Science, 10: 61-65.
17. Maurer, D. 1997. "Neonatal synaesthesia: Implications for the processing of speech and faces". In Synaesthesia: Classic and contemporary readings, Edited by: S. Baron-Cohen & J.E. Harrison. 224-242. Malden, MA: Blackwell Publishers.
18. Maurer, D. and Mondloch, C. J. 2005. "Neonatal synesthesia: A reevaluation". In Synesthesia: Perspectives from cognitive neuroscience, Edited by: Robertson, L. C. and Sagiv, N. 193-213. New York, NY: Oxford University Press.
19. Melara, R. D. and Marks, L. E. 1990. Processes underlying dimensional interactions: Correspondences between linguistic and nonlinguistic dimensions. Memory & Cognition, 18: 477-495.
20. Mondloch, C. J. and Maurer, D. 2004. Do small white balls squeak? Pitch-object correspondences in young children. Cognitive, Affective, & Behavioral Neuroscience, 4(2): 133-136.
21. Morrongiello, B. A., Fenwick, K. D., Hillier, L. and Chance, G. 1994. Sound localization in newborn human infants. Developmental Psychobiology, 27: 519-538.
22. Mossbridge, J. A., Grabowecky, M. and Suzuki, S. 2011. Changes in auditory frequency guide visual-spatial attention. Cognition, 121: 133-139.
23. Muir, D., Abraham, W., Forbes, B. and Harris, L. 1979. The ontogenesis of auditory localization response from birth to four months of age. Canadian Journal of Psychology, 33(4): 320-333.
24. Muir, D. and Field, J. 1979. Newborn infants orient to sounds. Child Development, 50: 431-436.
25. Pratt, C. C. 1930. The spatial character of high and low tones. Journal of Experimental Psychology, 13(3): 278-285.
26. Roffler, S. K. and Butler, R. A. 1968. Localization of tonal stimuli in the vertical plane. Journal of the Acoustical Society of America, 43: 1260-1266.
27. Rusconi, E., Kwan, B., Giordano, B. L., Umilità, C. and Butterworth, B. 2006. Spatial representation of pitch height: The SMARC effect. Cognition, 99: 113-129.
28. Simner, J. 2010. Defining synaesthesia. British Journal of Psychology, 103: 1-15.
29. Simner, J., Harrold, J., Creed, H., Monro, L. and Foulkes, L. 2009. Early detection of markers for synaesthesia in childhood populations. Brain, 132: 57-64.
30. Spector, F. and Maurer, D. 2009. Synesthesia: A new approach to understanding the development of perception. Developmental Psychology, 45: 175-189.
31. Spelke, E. S. 1979. Perceiving bimodally specified events in infancy. Developmental Psychology, 15: 626-636.
32. Spelke, E. S. 1981. The infant's acquisition of knowledge of bimodally specified events. Journal of Experimental Child Psychology, 31: 279-299.
33. Starkey, P., Spelke, E. S. and Gelman, R. 1990. Numerical abstraction by human infants. Cognition, 36: 97-127.
34. Wagner, S. E., Winner, E., Cicchetti, D. and Gardner, H. 1981. Metaphorical mapping in human infants. Child Development, 52(2): 728-731.
35. Walker, A. S. 1982. Intermodal perception of expressive behaviors by human infants. Journal of Experimental Child Psychology, 33: 514-535.
36. Walker, P., Bremner, G., Mason, U., Spring, J., Mattock, K.Slater, A. 2010. Preverbal infants' sensitivity to synaesthetic cross-modality correspondences. Psychological Science, 21: 21-25.
37. Walker-Andrews, A. S. 1986. Intermodal perception of expressive behaviors: Relation of eye and voice?. Developmental Psychology, 22: 373-377.
38. Walker-Andrews, A. S. 1988. Infants' perception of the affordances of expressive behaviors. Advances in Infancy Research, 5: 173-221.
39. Walker-Andrews, A. S., Bahrick, L. E., Raglioni, S. S. and Diaz, I. 1991. Infants' bimodal perception of gender. Ecological Psychology, 3: 55-75.
40. Ward, J., Huckstep, B. and Tsakanikos, E. 2006. Sound-colour synaesthesia: To what extent does it use cross-modal mechanisms common to us all?. Cortex, 42: 264-280.