Visuoauditory mappings between high luminance and high pitch are shared by chimpanzees (Pan troglodytes) and humans

Proceedings of the National Academy of Sciences of the United States of America

Volumn 108, Issue 51, 2011, Pages 20661-20665

  Ludwig, Vera U ^a,b   Adachi, Ikuma ^c   Matsuzawa, Tetsuro ^c  

^a CHARITÉ UNIVERSITÄTSMEDIZIN BERLIN   (Germany)

^b HUMBOLDT UNIVERSITY   (Germany)

^c KYOTO UNIVERSITY   (Japan)

Author keywords

Audio visual correspondences; Comparative cognition; Language evolution; Multisensory integration; Sound symbolism

Indexed keywords

ACCURACY; ADULT; ANIMAL EXPERIMENT; ARTICLE; AUDITORY STIMULATION; CROSS MODAL CORRESPONDENCE; DARKNESS; FEMALE; HUMAN; HUMAN EXPERIMENT; HUMAN VERSUS ANIMAL COMPARISON; LIGHT; LUMINANCE; MALE; NONHUMAN; PAN TROGLODYTES; PERCEPTION; PITCH; PRIORITY JOURNAL; SPECIES DIFFERENCE; VISUAL STIMULATION;

ACOUSTIC STIMULATION; ADOLESCENT; ADULT; ANIMALS; AUDITORY PERCEPTION; FEMALE; HUMANS; LANGUAGE; MODELS, STATISTICAL; PAN TROGLODYTES; PITCH DISCRIMINATION; SOUND; SPECIES SPECIFICITY; TIME FACTORS; VISION, OCULAR; VISUAL PERCEPTION;

ANIMALIA; PAN; PAN TROGLODYTES; PRIMATES;

EID: 84855478831     PISSN: 00278424     EISSN: 10916490     Source Type: Journal    
DOI: 10.1073/pnas.1112605108     Document Type: Article

References (61)

1. Martino G, Marks LE (2001) Synesthesia: Strong and weak. Curr Dir Psychol Sci 10: 61-65.
2. Evans KK, Treisman A (2010) Natural cross-modal mappings between visual and auditory features. J Vis 10:6-12.
3. Hubbard TL (1996) Synesthesia-like mappings of lightness, pitch, and melodic interval. Am J Psychol 109:219-238.
4. Marks LE, Hammeal RJ, Bornstein MH (1987) Perceiving similarity and comprehending metaphor. Monogr Soc Res Child Dev 52:1-102.
5. Ward J, Huckstep B, Tsakanikos E (2006) Sound-colour synaesthesia: To what extent does it use cross-modal mechanisms common to us all? Cortex 42:264-280.
6. Mondloch CJ, Maurer D (2004) Do small white balls squeak? Pitch-object correspondences in young children. Cogn Affect Behav Neurosci 4:133-136. (Pubitemid 39167156)
7. Walker P, et al. (2010) Preverbal infants' sensitivity to synaesthetic cross-modality correspondences. Psychol Sci 21:21-25.
8. Spector F, Maurer D (2008) The colour of Os: Naturally biased associations between shape and colour. Perception 37:841-847.
9. Spector F, Maurer D (2009) Synesthesia: A new approach to understanding the development of perception. Dev Psychol 45:175-189.
10. Wagner K, Dobkins KR (2011) Synaesthetic associations decrease during infancy. Psychol Sci 22:1067-1072.
11. Palmeri TJ, Blake R, Marois R, Flanery MA, Whetsell W, Jr. (2002) The perceptual reality of synesthetic colors. Proc Natl Acad Sci USA 99:4127-4131. (Pubitemid 34252240)
12. Simner J, et al. (2006) Synaesthesia: The prevalence of atypical cross-modal experiences. Perception 35:1024-1033. (Pubitemid 44619140)
13. Simner J, Ward J (2006) Synaesthesia: The taste of words on the tip of the tongue. Nature 444:438 (abstr). (Pubitemid 44809052)
14. Morgan GA, Goodson FE, Jones T (1975) Age differences in the associations between felt temperatures and color choices. Am J Psychol 88:125-130.
15. Melara RD (1989) Dimensional interaction between color and pitch. J Exp Psychol Hum Percept Perform 15:69-79.
16. Hashiya K, Kojima S (2001) Primate Origins of Human Cognition and Behavior, ed Matsuzawa T (Springer, Tokyo), pp 155-189.
17. Izumi A, Kojima S (2004) Matching vocalizations to vocalizing faces in a chimpanzee (Pan troglodytes). Anim Cogn 7:179-184.
18. Parr LA (2004) Perceptual biases for multimodal cues in chimpanzee (Pan troglodytes) affect recognition. Anim Cogn 7:171-178.
19. Hashiya K, Kojima S (2001) Acquisition of auditory-visual intermodal matching to sample by a chimpanzee (Pan troglodytes): Comparision with visual-visual intramodal matching. Anim Cogn 4:231-239.
20. Martinez L, Matsuzawa T (2009) Effect of species-specificity in auditory-visual intermodal matching in a chimpanzee (Pan troglodytes) and humans. Behav Processes 82:160-163.
21. Matsuzawa T (2009) Symbolic representation of number in chimpanzees. Curr Opin Neurobiol 19:92-98.
22. Townsend JT, Ashby FG (1983) Stochastic Modelling of Elementary Psychological Processes (Cambridge Univ Press, New York).
23. Occelli V, Spence C, Zampini M (2009) Compatibility effects between sound frequency and tactile elevation. Neuroreport 20:793-797.
24. Putzar L, Goerendt I, Lange K, Rösler F, Röder B (2007) Early visual deprivation impairs multisensory interactions in humans. Nat Neurosci 10:1243-1245. (Pubitemid 47480300)
25. Cohen J (1988) Statistical Power Analysis for the Behavioral Sciences (Academic, New York), 2nd Ed.
26. Martinez L, Matsuzawa T (2009) Visual and auditory conditional position discrimination in chimpanzees (Pan troglodytes). Behav Processes 82:90-94.
27. Foxe JJ, Schroeder CE (2005) The case for feedforward multisensory convergence during early cortical processing. Neuroreport 16:419-423. (Pubitemid 40477541)
28. Cohen Kadosh R, Henik A (2007) Can synaesthesia research inform cognitive science? Trends Cogn Sci 11:177-184. (Pubitemid 46467490)
29. Stein BE, Meredith MA (1993) The Merging of the Senses (MIT Press, Cambridge, MA).
30. Calvert GA, Spence C, Stein BE (2004) The Handbook of Multisensory Processes (MIT Press, Cambridge, MA).
31. Murray MM, Wallace MT (2011) The Neural Bases of Multisensory Processes (CRC Press, Boca Raton, FL).
32. Seyfarth RM, Cheney DL (2009) Seeing who we hear and hearing who we see. Proc Natl Acad Sci USA 106:669-670.
33. Adachi I, Kuwahata H, Fujita K (2007) Dogs recall their owner's face upon hearing the owner's voice. Anim Cogn 10:17-21. (Pubitemid 44877337)
34. Proops L, McComb K, Reby D (2009) Cross-modal individual recognition in domestic horses (Equus caballus). Proc Natl Acad Sci USA 106:947-951.
35. Sliwa J, Duhamel J-R, Pascalis O, Wirth S (2011) Spontaneous voice-face identity matching by rhesus monkeys for familiar conspecifics and humans. Proc Natl Acad Sci USA 108:1735-1740.
36. Adachi I, Hampton RR (2011) Rhesus monkeys see who they hear: Spontaneous cross-modal memory for familiar conspecifics. PLoS ONE 6:e23345.
37. Ghazanfar AA, Logothetis NK (2003) Neuroperception: Facial expressions linked to monkey calls. Nature 423:937-938. (Pubitemid 36806899)
38. Ghazanfar AA, Nielsen K, Logothetis NK (2006) Eye movements of monkey observers viewing vocalizing conspecifics. Cognition 101:515-529. (Pubitemid 44511927)
39. Ghazanfar AA, Chandrasekaran C, Logothetis NK (2008) Interactions between the superior temporal sulcus and auditory cortex mediate dynamic face/voice integration in rhesus monkeys. J Neurosci 28:4457-4469.
40. Calvert GA, Campbell R, Brammer MJ (2000) Evidence from functional magnetic resonance imaging of cross-modal binding in the human heteromodal cortex. Curr Biol 10:649-657. (Pubitemid 30354700)
41. Barraclough NE, Xiao D, Baker CI, Oram MW, Perrett DI (2005) Integration of visual and auditory information by superior temporal sulcus neurons responsive to the sight of actions. J Cogn Neurosci 17:377-391. (Pubitemid 40364527)
42. Ramachandran VS, Hubbard EM (2001) Synaesthesia: A window into perception, thought and language. J Conscious Stud 8:3-34.
43. Thorndike EL (1943) The origin of language. Science 98:1-6.
44. Kita S, Kantartzis K, Imai M (2010) in Evolution of Language: The Proceedings of the 8th International Conference, eds Smith ADM, De Boer B, Schouwstra M (World Scientific, Singapore), pp 206-213.
45. Hinton L, Nichols J, Ohala JJ (1994) Sound Symbolism (Cambridge Univ Press, Cambridge, UK).
46. Nuckolls JB (1999) The case for sound symbolism. Annu Rev Anthropol 28:225-252.
47. Sapir E (1929) A study in phonetic symbolism. J Exp Psychol 12:225-239.
48. Newman SS (1933) Further experiments in phonetic symbolism. Am J Psychol 45: 53-75.
49. Köhler W (1947) Gestalt Psychology (Liveright, New York), 2nd Ed.
50. Köhler W (1929) Gestalt Psychology (Liveright, New York).
51. Davis R (1961) The fitness of names to drawings: A cross-cultural study in Tanganyika. Br J Psychol 52:259-268.
52. Maurer D, Pathman T, Mondloch CJ (2006) The shape of boubas: Sound-shape correspondences in toddlers and adults. Dev Sci 9:316-322. (Pubitemid 43572369)
53. LeCron Foster M (1978) in Human Evolution: Biosocial Perspectives, eds Washburn SL, McCown ER (Benjamin Cummins, Menlo Park, CA), pp 77-122.
54. Paget R (1930) Human Speech (Routledge and Kegan Paul, London).
55. Matsuzawa T, Tomonaga M, Tanaka M (2006) Cognitive Development in Chimpanzees (Springer, Tokyo).
56. Matsuzawa T (2003) The Ai project: Historical and ecological contexts. Anim Cogn 6: 199-211.
57. Brozzoli C, et al. (2008) Touch perception reveals the dominance of spatial over digital representation of numbers. Proc Natl Acad Sci USA 105:5644-5648. (Pubitemid 351753916)
58. Shore DI, Barnes ME, Spence C (2006) Temporal aspects of the visuotactile congruency effect. Neurosci Lett 392:96-100. (Pubitemid 41757583)
59. Spence C, Kingstone A, Shore DI, Gazzaniga MS (2001) Representation of visuotactile space in the split brain. Psychol Sci 12:90-93. (Pubitemid 33614992)
60. Rosenthal R (1991) Meta-Analytic Procedures for Social Research (Sage, Newbury Park, CA), Rev. Ed.
61. Loftus GR, Masson MEJ (1994) Using confidence intervals in within-subject designs. Psychon Bull Rev 1:476-490.