The evolution of speech: Vision, rhythm, cooperation

Trends in Cognitive Sciences

Volumn 18, Issue 10, 2014, Pages 543-553

  Ghazanfar, Asif A ^a   Takahashi, Daniel Y ^a  

^a PRINCETON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BIOLOGY; COGNITIVE SYSTEMS;

AUDIO-VISUAL SPEECH; FACIAL EXPRESSIONS; FACIAL MOTIONS; HUMAN SPEECH; MULTISENSORY; REVIEW DATUM; TURN-TAKING;

SPEECH;

ANIMAL COMMUNICATION; APE; ASSOCIATION; CALLITHRIX; CALLITRICHINAE; CONVERGENT EVOLUTION; COOPERATION; FACIAL EXPRESSION; HAPLORHINI; HETEROCEPHALUS; HUMAN; INTERPERSONAL COMMUNICATION; LANGUAGE; LIP; MACACA FUSCATA; NONHUMAN; PAN TROGLODYTES; RECOGNITION; REVIEW; RHESUS MONKEY; SPECIES; SPEECH; SPEECH DEVELOPMENT; SPEECH INTELLIGIBILITY; SPEECH PERCEPTION; SPEECH RHYTHM; SQUIRREL MONKEY; VISION; VOCALIZATION; ANIMAL; EVOLUTION; HUMAN RELATION; PATTERN RECOGNITION; PERIODICITY; PHYSIOLOGY;

ANIMALS; BIOLOGICAL EVOLUTION; COOPERATIVE BEHAVIOR; FACIAL EXPRESSION; HUMANS; INTERPERSONAL RELATIONS; PATTERN RECOGNITION, PHYSIOLOGICAL; PERIODICITY; SPEECH; VISION, OCULAR; VOCALIZATION, ANIMAL;

EID: 84908022874     PISSN: 13646613     EISSN: 1879307X     Source Type: Journal    
DOI: 10.1016/j.tics.2014.06.004     Document Type: Review

References (136)

1. Huxley T.H. Evidences as to Man's Place in Nature 1863, Williams and Norgate.
2. Vargha-Khadem F., et al. FOXP2 and the neuroanatomy of speech and language. Nat. Rev. Neurosci. 2005, 6:131-138.
3. Lieberman P., et al. Vocal tract limitations on the vowel repertoires of rhesus monkey and other non-human primates. Science 1969, 164:1185-1187.
4. Deacon T.W. The Symbolic Species: The Coevolution of Language and the Brain 1997, W.W. Norton and Company.
5. Dunbar R. Grooming, Gossip and the Evolution of Language 1998, Harvard University Press.
6. Rizzolatti G., Arbib M.A. Language within our grasp. Trends Neurosci. 1998, 21:188-194.
7. Jarvis E.D. Learned birdsong and the neurobiology of human language. Ann. N. Y. Acad. Sci. 2004, 1016:749-777.
8. Arbib M.A., et al. Primate vocalization, gesture, and the evolution of human language. Curr. Anthropol. 2008, 49:1053-1076.
9. Tomasello M. Origins of Human Communication 2008, MIT Press.
10. Bates E. The emergence of symbols: ontogeny and phylogeny. Children's Language and Communication (Minnesota Symposia on Child Psychology, Vol. 12) 1979, 121-157. Lawrence Erlbaum Associates. W.A. Collins (Ed.).
11. Pinker S., Jackendoff R. The faculty of language: what's special about it?. Cognition 2005, 95:201-236.
12. Fitch W.T. The Evolution of Language 2010, Cambridge University Press.
13. Radick G. The Simian Tongue: The Long Debate About Animal Language 2007, University of Chicago Press.
14. Lowell M.S. A Rage to Live: A Biography of Richard and Isabel Burton 1998, Little, Brown and Company.
15. Fitch W.T. The evolution of speech: a comparative review. Trends Cogn. Sci. 2000, 4:258-267.
16. Ghazanfar A.A., Santos L.R. Primate brains in the wild: the sensory bases for social interactions. Nat. Rev. Neurosci. 2004, 5:603-616.
17. Dobson S.D. Socioecological correlates of facial mobility in nonhuman anthropoids. Am. J. Phys. Anthropol. 2009, 138:413-420.
18. Gustison M.L., et al. Derived vocalizations of geladas (Theropithecus gelada) and the evolution of vocal complexity in primates. Philos. Trans. R. Soc. Lond. B: Biol. Sci. 2012, 367:1847-1859.
19. McComb K., Semple S. Coevolution of vocal communication and sociality in primates. Biol. Lett. 2005, 1:381-385.
20. Yehia H., et al. Linking facial animation, head motion and speech acoustics. J. Phon. 2002, 30:555-568.
21. Chandrasekaran C., et al. The natural statistics of audiovisual speech. PLoS Comput. Biol. 2009, 5:e1000436.
22. Sumby W.H., Pollack I. Visual contribution to speech intelligibility in noise. J. Acoust. Soc. Am. 1954, 26:212-215.
23. Ross L.A., et al. Do you see what I am saying? Exploring visual enhancement of speech comprehension in noisy environments. Cereb. Cortex 2007, 17:1147-1153.
24. van Wassenhove V., et al. Visual speech speeds up the neural processing of auditory speech. Proc. Natl. Acad. Sci. U.S.A. 2005, 102:1181-1186.
25. McGurk H., MacDonald J. Hearing lips and seeing voices. Nature 1976, 264:746-748.
26. Rosenblum L.D. Primacy of multimodal speech perception. The Handbook of Speech Perception 2005, 51-78. Blackwell Publishing. D.B. Pisoni, R.E. Remez (Eds.).
27. Narins P.M., et al. Bimodal signal requisite for agonistic behavior in a dart-poison frog, Epipedobates femoralis. Proc. Natl. Acad. Sci. U.S.A. 2003, 100:577-580.
28. Taylor R.C., et al. Multimodal signal variation in space and time: how important is matching a signal with its signaler?. J. Exp. Biol. 2011, 214:815-820.
29. Uetz G.W., Roberts J.A. Multisensory cues and multimodal communication in spiders: insights from video/audio playback studies. Brain Behav. Evol. 2002, 59:222-230.
30. Burrows A.M., et al. Facial musculature in the rhesus macaque (Macaca mulatta): evolutionary and functional contexts with comparisons to chimpanzees and humans. J. Anat. 2009, 215:320-334.
31. Sherwood C.C. Comparative anatomy of the facial motor nucleus in mammals, with an analysis of neuron numbers in primates. Anat. Rec. A: Discov. Mol. Cell. Evol. Biol. 2005, 287A:1067-1079.
32. Sherwood C.C., et al. Cortical orofacial motor representation in old world monkeys, great apes, and humans. II. Stereologic analysis of chemoarchitecture. Brain Behav. Evol. 2004, 63:82-106.
33. Andrew R.J. The origin and evolution of the calls and facial expressions of the primates. Behaviour 1962, 20:1-109.
34. Hauser M.D., et al. The role of articulation in the production of rhesus monkey, Macaca mulatta, vocalizations. Anim. Behav. 1993, 45:423-433.
35. Partan S.R. Single and multichannel facial composition: facial expressions and vocalizations of rhesus macaques (Macaca mulata). Behaviour 2002, 139:993-1027.
36. Fitch W.T., Hauser M.D. Vocal production in nonhuman primates - acoustics, physiology, and functional constraints on honest advertisement. Am. J. Primatol. 1995, 37:191-219.
37. Ghazanfar A.A., Rendall D. Evolution of human vocal production. Curr. Biol. 2008, 18:R457-R460.
38. Ghazanfar A.A., Logothetis N.K. Facial expressions linked to monkey calls. Nature 2003, 423:937-938.
39. Parr L.A. Perceptual biases for multimodal cues in chimpanzee (Pan troglodytes) affect recognition. Anim. Cogn. 2004, 7:171-178.
40. Jordan K.E., et al. Monkeys match the number of voices they hear with the number of faces they see. Curr. Biol. 2005, 15:1034-1038.
41. Ghazanfar A.A., et al. Vocal tract resonances as indexical cues in rhesus monkeys. Curr. Biol. 2007, 17:425-430.
42. Sliwa J., et al. Spontaneous voice-face identity matching by rhesus monkeys for familiar conspecifics and humans. Proc. Natl. Acad. Sci. U.S.A. 2011, 108:1735-1740.
43. Adachi I., Hampton R.R. Rhesus monkeys see who they hear: spontaneous crossmodal memory for familiar conspecifics. PLoS ONE 2011, 6:e23345.
44. Habbershon H.M., et al. Rhesus macaques recognize unique multimodal face-voice relations of familiar individuals and not of unfamiliar ones. Brain Behav. Evol. 2013, 81:219-225.
45. Chandrasekaran C., et al. Monkeys and humans share a common computation for face/voice integration. PLoS Comput. Biol. 2011, 7:e1002165.
46. Ghitza O. Linking speech perception and neurophysiology: speech decoding guided by cascaded oscillators locked to the input rhythm. Front. Psychol. 2011, 2:130.
47. Greenberg S., et al. Temporal properties of spontaneous speech - a syllable-centric perspective. J. Phon. 2003, 31:465-485.
48. Saberi K., Perrott D.R. Cognitive restoration of reversed speech. Nature 1999, 398:760.
49. Smith Z.M., et al. Chimaeric sounds reveal dichotomies in auditory perception. Nature 2002, 416:87-90.
50. Elliot T.M., Theunissen F.E. The modulation transfer function for speech intelligibility. PLoS Comput. Biol. 2009, 5:e1000302.
51. Ghitza O., Greenberg S. On the possible role of brain rhythms in speech perception: Intelligibility of time-compressed speech with periodic and aperiodic insertions of silence. Phonetica 2009, 66:113-126.
52. Vitkovitch M., Barber P. Visible speech as a function of image quality: effects of display parameters on lipreading ability. Appl. Cogn. Psychol. 1996, 10:121-140.
53. Ghazanfar A.A., Poeppel D. The neurophysiology and evolution of the speech rhythm. The Cognitive Neurosciences V 2014, 629-638. MIT Press. M.S. Gazzaniga (Ed.).
54. Giraud A-L., Poeppel D. Cortical oscillations and speech processing: emerging computational principles and operations. Nat. Neurosci. 2012, 15:511-517.
55. Ghazanfar A.A., Takahashi D.Y. Facial expressions and the evolution of the speech rhythm. J. Cogn. Neurosci. 2014, 26:1196-1207.
56. Cohen Y.E., et al. Acoustic features of rhesus vocalizations and their representation in the ventrolateral prefrontal cortex. J. Neurophysiol. 2007, 97:1470-1484.
57. MacNeilage P.F. The frame/content theory of evolution of speech production. Behav. Brain Sci. 1998, 21:499-511.
58. Preuschoft S. Primate faces and facial expressions. Soc. Res. 2000, 67:245-271.
59. Hinde R.A., Rowell T.E. Communication by posture and facial expressions in the rhesus monkey (Macaca mulatta). Proc. Zool. Soc. Lond. 1962, 138:1-21.
60. Redican W.K. Facial expressions in nonhuman primates. Primate Behavior: Developments in Field and Laboratory Research 1975, 103-194. Academic Press. L.A. Rosenblum (Ed.).
61. Van Hooff J.A.R.A.M. Facial expressions of higher primates. Symp. Zool. Soc. Lond. 1962, 8:97-125.
62. Parr L.A., et al. Influence of social context on the use of blended and graded facial displays in chimpanzees. Int. J. Primatol. 2005, 26:73-103.
63. Kemp C., Kaplan G. Facial expressions in common marmosets (Callithrix jacchus) and their use by conspecifics. Anim. Cogn. 2013, 16:773-788.
64. De Marco A., Visalberghi E. Facial displays in young tufted capuchin monkeys (Cebus apella): appearance, meaning, context and target. Folia Primatol. (Basel) 2007, 78:118-137.
65. Newell T.G. Social encounters in two prosimian species. Psychon. Sci. 1971, 24:128-130.
66. Ferrari P.F., et al. Reciprical face-to-face communication between rhesus macaque mothers and their newborn infants. Curr. Biol. 2009, 19:1768-1772.
67. Livneh U., et al. Self-monitoring of social facial expressions in the primate amygdala and cingulate cortex. Proc. Natl. Acad. Sci. U.S.A. 2012, 109:18956-18961.
68. Shepherd S.V., et al. Facial muscle coordination during rhythmic facial expression and ingestive movement. J. Neurosci. 2012, 32:6105-6116.
69. Ghazanfar A.A., et al. Dynamic, rhythmic facial expressions and the superior temporal sulcus of macaque monkeys: implications for the evolution of audiovisual speech. Eur. J. Neurosci. 2010, 31:1807-1817.
70. Gottlieb G. Individual Development and Evolution: The Genesis of Novel Behavior 1992, Oxford University Press.
71. Locke J.L. The Child's Path to Spoken Language 1993, Harvard University Press.
72. Smith A., Zelaznik H.N. Development of functional synergies for speech motor coordination in childhood and adolescence. Dev. Psychobiol. 2004, 45:22-33.
73. Preuschoff K., et al. Human insula activation reflects risk prediction errors as well as risk. J. Neurosci. 2008, 28:2745-2752.
74. Davis B.L., MacNeilage P.F. The articulatory basis of babbling. J. Speech Hear. Res. 1995, 38:1199-1211.
75. Lindblom B., et al. Phonetic systems and phonological development. Developmental Neurocognition: Speech and Face Processing in the First Year of Life 1996, 399-409. Kluwer Academic Publishers. B. de Boysson-Bardies (Ed.).
76. Oller D.K. The Emergence of the Speech Capacity 2000, Lawrence Erlbaum.
77. Dolata J.K., et al. Characteristics of the rhythmic organization of vocal babbling: Implications for an amodal linguistic rhythm. Infant Behav. Dev. 2008, 31:422-431.
78. Nathani S., et al. Final syllable lengthening (FSL) in infant vocalizations. J. Child Lang. 2003, 30:3-25.
79. Green J.R., et al. Development of chewing in children from 12 to 48 months: longitudinal study of EMG patterns. J. Neurophysiol. 1997, 77:2704-2727.
80. Kiliaridis S., et al. Characteristics of masticatory mandibular movements and velocity in growing individuals and young adults. J. Dent. Res. 1991, 70:1367-1370.
81. Locke J.L. Lipsmacking and babbling: syllables, sociality and survival. The Syllable in Speech Production 2008, 111-129. Lawrence Erlbaum Associates. B.L. Davis, K. Zajdo (Eds.).
82. Morrill R.J., et al. Monkey lip-smacking develops like the human speech rhythm. Dev. Sci. 2012, 15:557-568.
83. Moore C.A., Ruark J.L. Does speech emerge from earlier appearing motor behaviors?. J. Speech Hear. Res. 1996, 39:1034-1047.
84. Steeve R.W. Babbling and chewing: jaw kinematics from 8 to 22 months. J. Phon. 2010, 38:445-458.
85. Steeve R.W., et al. Babbling, chewing, and sucking: oromandibular coordination at 9 months. J. Speech Lang. Hear. Res. 2008, 51:1390-1404.
86. Hiiemae K.M., Palmer J.B. Tongue movements in feeding and speech. Crit. Rev. Oral Biol. Med. 2003, 14:413-429.
87. Hiiemae K.M., et al. Hyoid and tongue surface movements in speaking and eating. Arch. Oral Biol. 2002, 47:11-27.
88. Ostry D.J., Munhall K.G. Control of jaw orientation and position in mastication and speech. J. Neurophysiol. 1994, 71:1528-1545.
89. Matsuo K., Palmer J.B. Kinematic linkage of the tongue, jaw, and hyoid during eating and speech. Arch. Oral Biol. 2010, 55:325-331.
90. Takahashi D.Y., et al. Information theoretic interpretation of frequency domain connectivity measures. Biol. Cybern. 2010, 103:463-469.
91. Ghazanfar A.A., et al. Cineradiography of monkey lip-smacking reveals putative precursors of speech dynamics. Curr. Biol. 2012, 22:1176-1182.
92. Ghazanfar A.A., et al. Monkeys are perceptually tuned to facial expressions that exhibit a theta-like speech rhythm. Proc. Natl. Acad. Sci. U.S.A. 2013, 110:1959-1963.
93. Steckenfinger S.A., Ghazanfar A.A. Monkey visual behavior falls into the uncanny valley. Proc. Natl. Acad. Sci. U.S.A. 2009, 106:18362-18466.
94. Bergman T.J. Speech-like vocalized lip-smacking in geladas. Curr. Biol. 2013, 23:R268-R269.
95. Lameira A.R., et al. Primate feedstock for the evolution of consonants. Trends Cogn. Sci. 2014, 18:60-62.
96. Levinson S.C. On the human interactional engine. Roots of Human Sociality 2006, 39-69. Berg Publishers. N.J. Enfield, S.C. Levinson (Eds.).
97. Sacks H., et al. Simplest systematics for organization of turn-taking for conversation. Language 1974, 50:696-735.
98. Stivers T., et al. Universals and cultural variation in turn-taking in conversation. Proc. Natl. Acad. Sci. U.S.A. 2009, 106:10587-10592.
99. Hewes G.W. Primate communication and the gestural origin of language. Curr. Anthropol. 1973, 14:5-24.
100. Borjon J.I., Ghazanfar A.A. Convergent evolution of vocal cooperation without convergent evolution of brain size. Brain Behav. Evol. 2014, (in press).
101. Takahashi D.Y., et al. Coupled oscillator dynamics of vocal turn-taking in monkeys. Curr. Biol. 2013, 23:2162-2168.
102. Zahed S.R., et al. Male parenting and response to infant stimuli in the common marmoset (Callithrix jacchus). Am. J. Primatol. 2008, 70:84-92.
103. Burkart J.M., van Schaik C.P. Cognitive consequences of cooperative breeding in primates?. Anim. Cogn. 2010, 13:1-19.
104. Hare B., et al. Tolerance allows bonobos to outperform chimpanzees on a cooperative task. Curr. Biol. 2007, 17:619-623.
105. Chen H-C., et al. Contact calls of common marmosets (Callithrix jacchus): influence of age of caller on antiphonal calling and other vocal responses. Am. J. Primatol. 2009, 71:165-170.
106. Ghazanfar A.A., et al. The units of perception in the antiphonal calling behavior of cotton-top tamarins (Saguinus oedipus): playback experiments with long calls. J. Comp. Physiol. A 2001, 187:27-35.
107. Ghazanfar A.A., et al. Temporal cues in the antiphonal long-calling behaviour of cottontop tamarins. Anim. Behav. 2002, 64:427-438.
108. Miller C.T., Wang X. Sensory-motor interactions modulate a primate vocal behavior: antiphonal calling in common marmosets. J. Comp. Physiol. A: Neuroethol. Sens. Neural Behav. Physiol. 2006, 192:27-38.
109. Bezerra B.M., Souto A. Structure and usage of the vocal repertoire of Callithrix jacchus. Int. J. Primatol. 2008, 29:671-701.
110. Miller C.T., et al. The communicative content of the common marmoset phee call during antiphonal calling. Am. J. Primatol. 2010, 72:974-980.
111. Norcross J.L., Newman J.D. Context and gender-specific differences in the acoustic structure of common marmoset (Callithrix jacchus) phee calls. Am. J. Primatol. 1993, 30:37-54.
112. Oullier O., et al. Social coordination dynamics: measuring human bonding. Soc. Neurosci. 2008, 3:178-192.
113. Schmidt R., Morr S. Coordination dynamics of natural social interactions. Int. J. Sport Psychol. 2010, 41:105-106.
114. O'Dell M.L., et al. Modeling turn-taking rhythms with oscillators. Linguist. Ural. 2012, 48:218-227.
115. Jerison H.J. Evolution of the Brain and Intelligence 1973, Academic Press.
116. Steiper M.E., Young N.M. Primate molecular divergence dates. Mol. Phylogenet. Evol. 2006, 41:384-394.
117. Yosida S., et al. Antiphonal vocalization of a subterranean rodent, the naked mole-rat (Heterocephalus glaber). Ethology 2007, 113:703-710.
118. Masataka N., Biben M. Temporal rules regulating affiliative vocal exchanges of squirrel monkeys. Behaviour 1987, 101:311-319.
119. Sugiura H. Matching of acoustic features during the vocal exchange of coo calls by Japanese macaques. Anim. Behav. 1998, 55:673-687.
120. Kondo N., et al. A temporal rule in vocal exchange among large-billed crows Corvus macrorhynchos in japan. Ornithol. Sci. 2010, 9:83-91.
121. Nakahara F., Miyazaki N. Vocal exchanges of signature whistles in bottlenose dolphins (Tursiops truncatus). J. Ethol. 2011, 29:309-320.
122. Grafe T.U. The function of call alternation in the African reed frog (Hyperolius marmoratus): precise call timing prevents auditory masking. Behav. Ecol. Sociobiol. 1996, 38:149-158.
123. Zelick R., Narins P.M. Characterization of the advertisement call oscillator in the frog Eleutherodactylus coqui. J. Comp. Physiol. A 1985, 156:223-229.
124. Greenfield M.D. Synchronous and alternating choruses in insects and anurans: common mechanisms and diverse functions. Am. Zool. 1994, 34:605-615.
125. Laje R., Mindlin G.B. Highly structured duets in the song of the South American hornero. Phys. Rev. Lett. 2003, 91:258104.
126. Logue D.M., et al. The behavioural mechanisms underlying temporal coordination in black-bellied wren duets. Anim. Behav. 2008, 75:1803-1808.
127. Hall M.L. A review of vocal duetting in birds. Adv. Stud. Behav. 2009, 40:67-121.
128. Caselli C.B., et al. Vocal behavior of black-fronted titi monkeys (Callicebus nigrifrons): acoustic properties and behavioral contexts of loud calls. Am. J. Primatol. 2014, 76:788-800.
129. Mitani J.C. Gibbon song duets and intergroup spacing. Behaviour 1985, 92:59-96.
130. Geissmann T. Duet-splitting and the evolution of gibbon songs. Biol. Rev. 2002, 77:57-76.
131. Yoshida S., Okanoya K. Evolution of turn-taking: a bio-cognitive perspective. Cogn. Stud. 2005, 12:153-165.
132. Burkart J.M., et al. Cooperative breeding and human cognitive evolution. Evol. Anthropol. 2009, 18:175-186.
133. Jarvis E.D. Selection for and against vocal learning in birds and mammals. Ornithol. Sci. 2006, 5:5-14.
134. Logue D.M., Hall M.L. Migration and the evolution of duetting in songbirds. Proc. Biol. Sci. 2014, 281:20140103.
135. Krubitzer L.A., Seelke A.M. Cortical evolution in mammals: the bane and beauty of phenotypic variability. Proc. Natl. Acad. Sci. U.S.A. 2012, 109(Suppl. 1):10647-10654.
136. Marder E. Neuromodulation of neuronal circuits: back to the future. Neuron 2012, 76:1-11.