The origin of human multi-modal communication

Philosophical Transactions of the Royal Society B: Biological Sciences

Volumn 369, Issue 1651, 2014, Pages

  Levinson, Stephen C ^a,b   Holler, Judith ^a  

^a MAX PLANCK INSTITUTE FOR PSYCHOLINGUISTICS   (Netherlands)

^b RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

Author keywords

Deixis; Gesture; Iconicity; Intentional vocalization; Language evolution; Multi modal communication

Indexed keywords

HUMAN EVOLUTION; LANGUAGE; PHYLOGENETICS; SIGNALING; VOCALIZATION;

EID: 84905251121     PISSN: 09628436     EISSN: 14712970     Source Type: Journal    
DOI: 10.1098/rstb.2013.0302     Document Type: Article

References (125)

1. Hauser MD, Chomsky N, Fitch WT. 2002 The faculty of language: what is it, who has it, and how did it evolve? Science 298, 1569-1579. (doi: 10. 1126/science. 298. 5598. 1569).
2. Tomasello M. 2008 Origins of human communication. Cambridge, UK: MIT Press.
3. Clark HH. 1996 Using language. Cambridge, UK: Cambridge University Press.
4. Goldin-Meadow S, McNeill D, Singleton J. 1996 Silence is liberating: removing the handcuffs on grammatical expression in the manual modality. Psychol. Rev. 103, 34-55. (doi: 10. 1037/0033-295X. 103. 1. 34).
5. McNeill D. 1992 Hand and mind: what gestures reveal about thought. Chicago, IL: Chicago University Press.
6. Kendon A. 2004 Gesture: visible action as utterance. Cambridge, UK: Cambridge University Press.
7. Dediu D, Levinson SC. 2013 On the antiquity of language: the reinterpretation of Neandertal linguistic capacities and its consequences. Front. Psychol. 4, 397. (doi: 10. 3389/fpsyg. 2013. 00397).
8. Schepartz LA. 1993 Language and modern human origins. Yearb. Phys. Anthropol. 36, 91-126. (doi: 10. 1002/ajpa. 1330360607).
9. Jürgens U. 2002 Neural pathways underlying vocal control. Neurosci. Biobehav. Rev. 26, 235-258. (doi: 10. 1016/S0149-7634(01)00068-9).
10. Simonyan K, Horwitz B. 2011 Laryngeal motor cortex and control of speech in humans. Neuroscientist 17, 197-208. (doi: 10. 1177/1073858410386727).
11. MacLarnon A, Hewitt G. 2004 Increased breathing control: another factor in the evolution of human language. Evol. Anthropol. 13, 181-97. (doi: 10. 1002/evan. 20032).
12. Fitch WT. 2009 Fossil cues to the evolution of speech. In The cradle of language (eds RP Botha, C Knight), pp. 112-134. Oxford, UK: Oxford University Press.
13. Bramble DM, Lieberman DE. 2004 Endurance running and the evolution of Homo. Nature 432, 345-352. (doi: 10. 1038/nature03052).
14. Draper MH, Ladefoged P, Whitteridge D. 1960 Expiratory pressures and air flow during speech. Br. Med. J. 1, 1837-1843. (doi: 10. 1136/bmj. 1. 5189. 1837).
15. Tylor E. 1865 Researches into the early history of mankind and the development of civilization. London, UK: Murray.
16. Hewes G. 1973 Primate communication and the gestural origin of language. Curr. Anthropol. 14, 65-84. (doi: 10. 1086/201401).
17. Kendon A. 1975 Gesticulation, speech, and the gesture theory of language origins. Sign Lang. Stud. 9, 349-373. (doi: 10. 1353/sls. 1975. 0016).
18. Kendon A. 1991 Some considerations for a theory of language origins. Man 26, 199-221. (doi: 10. 2307/2803829).
19. Armstrong DF, Wilcox S. 2007 The gestural origin of language. Oxford, UK: Oxford University Press.
20. Sterelny K. 2012 Language, gesture, skill: the co-evolutionary foundations of language. Phil. Trans. R. Soc. B 367, 2141-2151. (doi: 10. 1098/rstb. 2012. 0116).
21. Corballis MC. 2002 From hand to mouth: the origins of language. Princeton, NJ: Princeton University Press.
22. Arbib MA. 2005 From monkey-like action recognition to human language: an evolutionary framework for neurolinguistics. Behav. Brain Sci. 28, 105-124. (doi: 10. 1017/S0140525X05000038).
23. Gentilucci M, Corballis MC. 2006 From manual gesture to speech: a gradual transition. Neurosci. Biobehav. Rev. 30, 949-960. (doi: 10. 1016/j. neubiorev. 2006. 02. 004).
24. Corballis MC. 2009 The evolution of language. Ann. NY Acad. Sci. 1156, 19-43. (doi: 10. 1111/j. 1749-6632. 2009. 04423. x).
25. Call J, Tomasello M. 2007 The gestural communication of apes and monkeys. Manhaw, NJ: LEA.
26. Gruber T, Zuberbühler K. 2013 Vocal recruitment for joint travel in wild chimpanzees. PLoS ONE 8, e76073. (doi: 10. 1371/journal. pone. 0076073).
27. Schel AM, Townsend SW, Machanda Z, Zuberbühler K, Slocombe KE. 2013 Chimpanzee alarm call production meets key criteria for intentionality. PLoS ONE 8, e76674. (doi: 10. 1371/journal. pone. 0076674).
28. Liebal K, Pika S, Tomasello M. 2006 Gestural communication of orangutans (Pongo pygmaeus). Gesture 6, 1-38. (doi: 10. 1075/gest. 6. 1. 02lie).
29. Pollick AS, de Waal FB. 2007 Ape gestures and language evolution. Proc. Natl Acad. Sci. USA 104, 8184-8189. (doi: 10. 1073/pnas. 0702624104).
30. Rossano F. 2013 Gaze in conversation. In The handbook of conversation analysis (eds T Stivers, J Sidnell), pp. 308-29. Chichester, UK: Wiley-Blackwell.
31. Thorpe WH. 1966 Ritualization in ontogeny. I. Animal play. Phil. Trans. R. Soc. Lond. B 251, 311-319. (doi: 10. 1098/rstb. 1966. 0015).
32. Scott-Phillips TC, Blythe RA, Gardner A, West SA. 2012 How do communication systems emerge? Proc. R. Soc. B 279, 1943-1949. (doi: 10. 1098/rspb. 2011. 2181).
33. Clark HH. 2005 Coordinating with each other in a material world. Discourse Stud. 7, 507-525. (doi: 10. 1177/1461445605054404).
34. Levinson SC. 1983 Pragmatics. Cambridge, UK: Cambridge University Press.
35. Sperber D, Wilson D. 1986 Relevance: communication and cognition. Cambridge, UK: Cambridge University Press.
36. Grice HP. 1989 Studies in the way of words. Cambridge, MA: Harvard University Press.
37. Schegloff EA. 2007 Sequence organization in interaction: a primer in conversation analysis, vol. 1. Cambridge, UK: Cambridge University Press.
38. Tomasello M. 2014 A natural history of human thinking. Cambridge, MA: Harvard University Press.
39. Levinson SC. 2000 Presumptive meanings: the theory of generalized conversational implicature. Cambridge, UK: MIT Press.
40. Levinson SC. 2013 Recursion in pragmatics. Language 89, 149-162. (doi: 10. 1353/lan. 2013. 0005).
41. Mehl MR, Vazire S, Ramírez-Esparza N, Slatcher RB, Pennebaker JW. 2007 Are women really more talkative than men? Science 317, 82. (doi: 10. 1126/science. 1139940).
42. Stivers T et al. 2009 Universals and cultural variation in turn-taking in conversation. Proc. Natl Acad. Sci. USA 106, 10 587-10 592. (doi: 10. 1073/pnas. 0903616106).
43. Indefrey P, Levelt WJ. 2004 The spatial and temporal signatures of word production components. Cognition 92, 101-144. (doi: 10. 3389/fpsyg. 2011. 00255).
44. DeLong KA, Urbach TP, Kutas M. 2005 Probabilistic word pre-activation during language comprehension inferred from electrical brain activity. Nat. Neurosci. 8, 1117-1121. (doi: 10. 1038/nn1504).
45. Pickering MJ, Garrod S. 2007 Do people use language production to make predictions during comprehension? Trends Cogn. Sci. 11, 105-110. (doi: 10. 1016/j. tics. 2006. 12. 002).
46. Magyari L, de Ruiter JP. 2012 Prediction of turnends based on anticipation of upcoming words. Front. Psychol. 3, 376. (doi: 10. 3389/fpsyg. 2012. 00376).
47. Snow CE. 1977 The development of conversation between mothers and babies. J. Child Lang. 4, 1-22. (doi: 10. 1017/S0305000900000453).
48. Méndez-Cárdenas MG, Zimmermann E. 2009 Duetting-a mechanism to strengthen pair bonds in a dispersed pair-living primate (Lepilemur edwardsi)? Am. J. Phys. Anthropol. 139, 523-532. (doi: 10. 1002/ajpa. 21017).
49. Snowdon CT, Cleveland J. 1984 'Conversations' among pygmy marmosets. Am. J. Primatol. 7, 15-20. (doi: 10. 1002/ajp. 1350070104).
50. Takahashi DY, Narayanan DZ, Ghazanfar AA. 2013 Coupled oscillator dynamics of vocal turn-taking in monkeys. Curr. Biol. 23, 2162-2168. (doi: 10. 1016/j. cub. 2013. 09. 005).
51. Lemasson A, Glas L, Barbu S, Lacroix A, Guilloux M, Remeuf K, Koda H. 2011 Youngsters do not pay attention to conversational rules: is this so for nonhuman primates? Sci. Rep. 1, 22. (doi: 10. 1038/srep00022).
52. Inoue Y, Sinun W, Yosida S, Okanoya K. 2013 Intergroup and intragroup antiphonal songs in wild male Muellers gibbons (Hylobates muelleri). Interact. Stud. 14, 24-43. (doi: 10. 1075/is. 14. 1. 03ino).
53. Geissmann T. 2002 Duet-splitting and the evolution of gibbon songs. Biol. Rev. 77, 57-76. (doi: 10. 1017/S1464793101005826).
54. Haimoff EH. 1986 Convergence in the duetting of monogamous Old World primates. J. Hum. Evol. 15, 51-59. (doi: 10. 1016/S0047-2484(86) 80065-3).
55. Wilkinson R, Leudar I, Pika S. 2012 Requesting behaviors within episodes of active sharing. In Developments in primate gesture research, vol. 6 (eds S Pika, K Liebal), pp. 199-221. Amsterdam, The Netherlands: John Benjamins.
56. Argyle M, Cook M. 1976 Gaze and mutual gaze. Cambridge, UK: Cambridge University Press.
57. Bard KA, Myowa-Yamakoshi M, Tomonaga M, Tanaka M, Costall A, Matsuzawa T. 2005 Group differences in the mutual gaze of chimpanzees (Pan troglodytes). Dev. Psychol. 41, 616-624. (doi: 10. 1037/0012-1649. 41. 4. 616).
58. Nettle D, Cronin KA, Bateson M. 2013 Responses of chimpanzees to cues of conspecific observation. Anim. Behav. 86, 595-602. (doi: 10. 1016/j. anbehav. 2013. 06. 015).
59. Kobayashi H, Kohshima S. 2001 Unique morphology of the human eye and its adaptive meaning: comparative studies on external morphology of the primate eye. J. Hum. Evol. 40, 419-435. (doi: 10. 1006/jhev. 2001. 0468).
60. Farroni T, Csibra G, Simion F, Johnson MH. 2002 Eye contact detection in humans from birth. Proc. Natl Acad. Sci. USA 99, 9602-9605. (doi: 10. 1073/pnas. 152159999).
61. Levinson SC. 2006 On the human 'interaction engine'. In Roots of human sociality: culture, cognition and interaction (eds NJ Enfield, SC Levinson), pp. 39-69. Oxford, UK: Berg.
62. Bates E. 1976 Language and context: the acquisition of pragmatics, vol. 13. New York, NY: Academic Press.
63. Tomasello M, Carpenter M, Liszkowski U. 2007 A new look at infant pointing. Child Dev. 78, 705-722. (doi: 10. 1111/j. 1467-8624. 2007. 01025. x).
64. Liszkowski U, Brown P, Callaghan T, Takada A, de Vos C. 2012 A prelinguistic gestural universal of human communication. Cogn. Sci. 36, 698-713. (doi: 10. 1111/j. 1551-6709. 2011. 01228. x).
65. Carpendale JI, Carpendale AB. 2010 The development of pointing: from personal directedness to interpersonal direction. Hum. Dev. 53, 110-126. (doi: 10. 1159/000315168).
66. Pika S, Liebal K, Tomasello M. 2005 Gestural communication in subadult bonobos (Pan paniscus): repertoire and use. Am. J. Primatol. 65, 39-61. (doi: 10. 1002/ajp. 20096).
67. Hobaiter C, Leavens DA, Byrne RW. 2013 Deictic gesturing in wild chimpanzees (Pan troglodytes)? Some possible cases. J. Comp. Psychol. 128, 82-87. (doi: 10. 1037/a0033757).
68. Pika S, Mitani J. 2006 Referential gestural communication in wild chimpanzees (Pan troglodytes). Curr. Biol. 16, R191-R192. (doi: 10. 1016/j. cub. 2006. 02. 037).
69. Leavens DA, Hopkins WD, Bard KA. 1996 Indexical and referential pointing in chimpanzees (Pan troglodytes). J. Comp. Psychol. 110, 346. (doi: 10. 1037/0735-7036. 110. 4. 346).
70. Matthews D, Behne T, Lieven E, Tomasello M. 2012 Origins of the human pointing gesture: a training study. Dev. Sci. 15, 817-829. (doi: 10. 1111/j. 1467-7687. 2012. 01181. x).
71. Camaioni L, Perucchini P, Bellagamba F, Colonnesi C. 2004 The role of declarative pointing in developing a theory of mind. Infancy 5, 291-308. (doi: 10. 1207/s15327078in0503_3).
72. Cochet H, Vauclair J. 2010 Pointing gestures produced by toddlers from 15 to 30 months: different functions, hand shapes and laterality patterns. Infant Behav. Dev. 33, 431-441. (doi: 10. 1016/j. infbeh. 2010. 04. 009).
73. Wittgenstein L. 1969 On certainty. Oxford, UK: Basil Blackwell.
74. Schilbach L, Wilms M, Eickhoff SB, Romanzetti S, Tepest R, Bente G, Shah NJ, Fink GR, Vogeley K. 2010 Minds made for sharing: initiating joint attention recruits reward-related neurocircuitry. J. Cogn. Neurosci. 22, 2702-2715. (doi: 10. 1162/jocn. 2009. 21401).
75. Levinson SC. 2003 Space in language and cognition: explorations in cognitive diversity. Cambridge, UK: Cambridge University Press.
76. De Vos C. 2012 Sign-spatiality in Kata Kolok: how a village sign language in Bali inscribes its signing space. PhD thesis, Radboud University Nijmegen, Nijmegen, The Netherlands.
77. Perniss P, Thompson RL, Vigliocco G. 2010 Iconicity as a general property of language: evidence from spoken and signed languages. Front. Psychol. 1, 227. (doi: 10. 3389/fpsyg. 2010. 00227).
78. Mithen S. 1996 The prehistory of the mind: the cognitive origins of art, religion and science. London, UK: Thames and Hudson.
79. Marshack A. 1976 Some implications of the paleolithic symbolic evidence for the origin of language. Curr. Anthropol. 17, 274-282. (doi: 10. 1086/201716).
80. Slobin DI. 1968 Antonymic phonetic symbolism in three natural languages. J. Pers. Soc. Psychol. 10, 301-305. (doi: 10. 1037/h0026575).
81. Hinton L, Nichols J, Ohala J (eds) 1994 Sound symbolism. Cambridge, UK: Cambridge University Press.
82. Dingemanse M. In press. Expressiveness and system integration. On the typology of ideophones, with special reference to Siwu. STUF-Language Typology and Universals.
83. Haiman J. 1985 Natural syntax: iconicity and erosion. Cambridge, UK: Cambridge University Press.
84. McNeill D. 1985 So you think gestures are nonverbal? Psychol. Rev. 92, 350-371. (doi: 10. 1037/0033-295X. 92. 3. 350).
85. Holler J, Beattie G. 2002 A micro-analytic investigation of how iconic gestures and speech represent core semantic features in talk. Semiotica 142, 31-69. (doi: 10. 1515/semi. 2002. 077).
86. Holler J, Beattie G. 2003 How iconic gestures and speech interact in the representation of meaning: are both aspects really integral to the process? Semiotica 146, 81-116. (doi: 10. 1515/semi. 2003. 083).
87. Armstrong DF, Stokoe WC, Wilcox SE. 1995 Gesture and the nature of language. Cambridge, UK: Cambridge University Press.
88. Beattie G, Shovelton H. 2002 An experimental investigation of some properties of individual iconic gestures that mediate their communicative power. Br. J. Psychol. 93, 179-192. (doi: 10. 1348/000712602162526).
89. Stokoe WC. 2001 Language in hand: why sign came before speech. Washington, DC: Gallaudet University Press.
90. Arbib MA. 2012 How the brain got language: the mirror system hypothesis. Oxford, UK: Oxford University Press.
91. Fitch WT. 2010 The evolution of language. Cambridge, UK: Cambridge University Press.
92. Stout D. 2011 Stone toolmaking and the evolution of human culture and cognition. Phil. Trans. R. Soc. B 366, 1050-1059. (doi: 10. 1098/rstb. 2010. 0369).
93. Hockett C. 1960 The origin of speech. Sci. Am. 203, 88-111. (doi: 10. 1038/scientificamerican0960-88).
94. Perniss P, Vigliocco G. 2014 The bridge of iconicity: from a world of experience to the experience of language. Phil. Trans. R. Soc. B 369, 20130300. (doi: 10. 1098/rstb. 2013. 0300).
95. Jackendoff R. 1999 Possible stages in the evolution of the language capacity. Trends Cogn. Sci. 3, 272-279. (doi: 10. 1016/S1364-6613(99)01333-9).
96. Marentette P, Nicoladis E. 2012 Does ontogenetic ritualization explain early communicative gestures in human infants? In Developments in primate gesture research, vol. 6 (eds S Pika, K Liebal), pp. 33-54. Amsterdam, The Netherlands: John Benjamins.
97. Jaffe J, Beebe B, Feldstein S, Crown CL, Jasnow MD, Rochat P, Stern DN. 2001 Rhythms of dialogue in infancy: coordinated timing in development. Monogr. Soc. Res. Child Dev. 66, i-viii, 1-132.
98. Garvey C. 1984 Children's talk. Cambridge, MA: Harvard University Press.
99. Aflalo TN, Graziano MS. 2006 Possible origins of the complex topographic organization of motor cortex: reduction of a multidimensional space onto a two-dimensional array. J. Neurosci. 26, 6288-6297. (doi: 10. 1523/JNEUROSCI. 0768-06. 2006).
100. Meier JD, Aflalo TN, Kastner S, Graziano MS. 2008 Complex organization of human primary motor cortex: a high-resolution fMRI study. J. Neurophysiol. 100, 1800-1812. (doi: 10. 1152/jn. 90531. 2008).
101. Graziano MS, Aflalo TN. 2007 Mapping behavioral repertoire onto the cortex. Neuron 56, 239-251. (doi: 10. 1016/j. neuron. 2007. 09. 013).
102. Vauclair J. 2004 Lateralization of communicative signals in nonhuman primates and the hypothesis of the gestural origin of language. Interact. Stud. 5, 363-384. (doi: 10. 1075/is. 5. 3. 04vau).
103. Meguerditchian A, Vauclair J. 2006 Baboons communicate with their right hand. Behav. Brain Res. 171, 170-174. (doi: 10. 1016/j. bbr. 2006. 03. 018).
104. Meguerditchian A, Vauclair J, Hopkins WD. 2010 Captive chimpanzees use their right hand to communicate with each other: implications for the origin of the cerebral substrate for language. Cortex 46, 40-48. (doi: 10. 1016/j. cortex. 2009. 02. 013).
105. Fitch WT, Braccini SN. 2013 Primate laterality and the biology and evolution of human handedness: a review and synthesis. Ann. NY Acad. Sci. 1288, 70-85. (doi: 10. 1111/nyas. 12071).
106. Iverson JM, Goldin-Meadow S. 1998 Why people gesture when they speak. Nature 396, 228. (doi: 10. 1038/24300).
107. Iverson JM, Goldin-Meadow S. 2001 The resilience of gesture in talk: gesture in blind speakers and listeners. Dev. Sci. 4, 416-422. (doi: 10. 1111/1467-7687. 00183).
108. Rizzolatti G, Fadiga L, Gallese V, Fogassi L. 1996 Premotor cortex and the recognition of motor actions. Cogn. Brain Res. 3, 131-141. (doi: 10. 1016/0926-6410(95)00038-0).
109. Rizzolatti G, Arbib MA. 1998 Language within our grasp. Trends Neurosci. 21, 188-194. (doi: 10. 1016/S0166-2236(98)01260-0).
110. Rizzolatti G, Craighero L. 2004 The mirror-neuron system. Annu. Rev. Neurosci. 27, 169-192. (doi: 10. 1146/annurev. neuro. 27. 070203. 144230).
111. McNeill D. 2012 How language began: gesture and speech in human evolution. Cambridge, UK: Cambridge University Press.
112. Kendon A. 1972 Some relationships between body motion and speech. An analysis of an example. In Studies in dyadic communication (eds A Siegman, B Pope), pp. 177-210. Elmsford, NY: Pergamon Press.
113. Kendon A. 1980 Gesticulation and speech: two aspects of the process of utterance. In The relationship of verbal and nonverbal communication (ed. MR Key), pp. 207-227. The Hague, The Netherlands: Mouton and Co.
114. Kendon A. 2000 Language and gesture: unity or duality. In Language and gesture (ed. D McNeill), pp. 47-63. Cambridge, UK: Cambridge University Press.
115. McNeill D. 2005 Gesture and thought. Chicago, IL: University of Chicago Press.
116. Kendon A. 1985 Some uses of gesture. In Perspectives on silence (eds D Tannen, M Saville-Troike), pp. 215-234. Norwood, NJ: Ablex.
117. Gershkoff-Stowe L, Goldin-Meadow S. 2002 Is there a natural order for expressing semantic relations? Cogn. Psychol. 45, 375-412. (doi: 10. 1016/S0010-0285(02)00502-9).
118. Goldin-Meadow S. 2003 Hearing gesture: how our hands help us think. Cambridge, MA: Harvard University Press.
119. Skipper JI, Goldin-Meadow S, Nusbaum HC, Small SL. 2007 Speech-associated gestures, Broca's area, and the human mirror system. Brain Lang. 101, 260-277. (doi: 10. 1016/j. bandl. 2007. 02. 008).
120. Willems RM, Hagoort P. 2007 Neural evidence for the interplay between language, gesture, and action: a review. Brain Lang. 101, 278-289. (doi: 10. 1016/j. bandl. 2007. 03. 004).
121. Willems RM, Özyürek A, Hagoort P. 2007 When language meets action: the neural integration of gesture and speech. Cerebral Cortex 17, 2322-2333. (doi: 10. 1093/cercor/bhl141).
122. Bavelas JB, Gerwing J, Sutton C, Prevost D. 2008 Gesturing on the telephone: independent effects of dialogue and visibility. J. Mem. Lang. 58, 495-520. (doi: 10. 1016/j. jml. 2007. 02. 004).
123. Holler J, Tutton M, Wilkin K. 2011 Co-speech gestures in the process of meaning coordination. In Proc. 2nd GESPIN-Gesture and Speech in Interaction Conf., Bielefeld, 5-7 September 2011. See http://hdl. handle. net/11858/00-001M-0000-0012-1BB3-D.
124. Alibali MW, Heath DC, Myers HJ. 2001 Effects of visibility between speaker and listener on gesture production: some gestures are meant to be seen. J. Mem. Lang. 44, 169-188. (doi: 10. 1006/jmla. 2000. 2752).
125. Jacobs N, Garnham A. 2007 The role of conversational hand gestures in a narrative task. J. Mem. Lang. 56, 291-303. (doi: 10. 1016/j. jml. 2006. 07. 011).