The influence of the visual modality on language structure and conventionalization: Insights from sign language and gesture

Topics in Cognitive Science

Volumn 7, Issue 1, 2015, Pages 2-11

  Perniss, Pamela ^a   Özyürek, Asli ^b   Morgan, Gary ^c  

^a UNIVERSITY OF BRIGHTON   (United Kingdom)

^b RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

^c CITY UNIVERSITY   (United Kingdom)

Author keywords

Conventionalization; Cross linguistic comparison; Cross modal comparison; Gesture; Language emergence; Language structure; Sign language; Visual modality

Indexed keywords

GESTURE; HUMAN; LANGUAGE; LANGUAGE DEVELOPMENT; PATTERN RECOGNITION; PHYSIOLOGY; SIGN LANGUAGE;

GESTURES; HUMANS; LANGUAGE; LANGUAGE DEVELOPMENT; PATTERN RECOGNITION, VISUAL; SIGN LANGUAGE;

EID: 84921460120     PISSN: 17568757     EISSN: 17568765     Source Type: Journal    
DOI: 10.1111/tops.12127     Document Type: Article

References (32)

1. Barsalou, L. W., Simmons, K., Barbey, A. K., & Wilson, C. D. (2003). Grounding conceptual knowledge in modality-specific systems. Trends in Cognitive Science, 7(2), 84-91.
2. Brentari, D. (2010) (Ed.). Sign Languages. Cambridge language surveys. Cambridge, England: Cambridge University Press.
3. Brentari, D., Coppola, M., Mazzoni, L., & Goldin-Meadow, S. (2012). When does a system become phonological? Handshape production in gesturers, signers, and homesigners. Natural Language and Linguistic Theory, 30(1), 1-31.
4. Emmorey, K. (1999). Do signers gesture? In L. Messing & R. Campbell (Eds.), Gesture, speech, and sign. Oxford, England: Oxford University Press.
5. Emmorey, K. (2002). Language, cognition, and the brain: Insights from sign language research. Mahwah, NJ: Lawrence Erlbaum and Associates.
6. Emmorey, K. (2007). The psycholinguistics of signed and spoken languages: How biology affects processing. In G. Gaskell (Ed.), The oxford handbook of psycholinguistics (pp. 703-721). Oxford, England: Oxford University Press.
7. Goldin-Meadow, S. (2003). The resilience of language: What gesture creation in deaf children can tell us about how all children learn language. New York: Psychology Press.
8. Goldin-Meadow, S., McNeill, D., & Singleton, J. (1996). Silence is liberating: Removing the handcuffs on grammatical expression in the manual modality. Psychological Review, 103, 34-55.
9. Goldin-Meadow, S., So, W.-C., Özyürek, A., & Mylander, C. (2008). The natural order of events: How speakers of different languages represent events nonverbally. Proceedings of the National Academy of Sciences, 105(27), 9163-9168.
10. Green, J., Kelly, B., & Schembri, A. (2014). Finding common ground: Sign language and gesture research in Australia. Australian Journal of Linguistics, 34(2), 185-192.
11. Green, J., & Wilkins, D. P. (2014). With or without speech: Arandic sign language from central Australia. Australian Journal of Linguistics, 34(2), 234-261.
12. Hostetter, A. B., & Alibali, M. W. (2008). Visible embodiment: Gestures as simulated action. Psychonomic Bulletin & Review, 15(3), 495-514.
13. Hostetter, A. B., & Alibali, M. W. (2010). Language, gesture, action! A test of the gesture as simulated action framework. Journal of Memory and Language, 63, 245-257.
14. Janzen, T., & Shaffer, B. (2002). Gesture as the substrate in the process of ASL grammaticization. In R. P. Meier, D. Quinto-Pozos, & K. Cormier (Eds.), Modality and structure in signed and spoken languages (pp. 199-223). Cambridge, England: Cambridge University Press.
15. Kelly, S. D., Özyürek, A., & Maris, E. (2010). Two sides of the same coin: Speech and gesture mutually interact to enhance comprehension. Psychological Science, 21(2), 260-267.
16. Kendon, A. (2004). Gesture: Visible action as utterance. Cambridge: Cambridge University Press.
17. Kendon, A. (2008). Some reflections on the relationship between 'gesture' and 'sign'. Gesture, 8(3), 348-366.
18. Kendon, A. (2014). Semiotic diversity in utterance production and the concept of 'language'. Philosophical Transactions of the Royal Society B, 369, 20130293.
19. Kita, S., & Özyürek, A. (2003). What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for an interface representation of spatial thinking and speaking. Journal of Memory and Language, 48(1), 16-32.
20. Klima, E., & Bellugi, U. (1979). The signs of language. Cambridge, MA: Harvard University Press.
21. Liddell, S. K. (2003). Grammar, gesture and meaning in American Sign Language. Cambridge, England: Cambridge University Press.
22. McNeill, D. (1992). Hand and mind: What gestures reveal about thought. Chicago: University of Chicago Press.
23. McNeill, D. (2005). Gesture and thought. Chicago: University of Chicago Press.
24. Özyürek, A. (2012). Gesture. In R. Pfau, M. Steinbach, & B. Woll (Eds.), Sign language: An international handbook (pp. 626-646). Berlin: Mouton.
25. Perniss, P., Thompson, R. L., & Vigliocco, G. (2010). Iconicity as a general property of language: Evidence from spoken and signed languages. Frontiers in Psychology, 1, 1-15. doi:10.3389/fpsyg.2010.00227.
26. Perniss, P., & Vigliocco, G. (2014). The bridge of iconicity: From a world of experience to the experience of language. Philosophical Transactions of the Royal Society B, 369, 20130300.
27. Sandler, W., Meir, I., Padden, C., & Aronoff, M. (2005). The emergence of grammar: Systematic structure in a new language. Proceedings of the National Academy of Sciences, 102(7), 2661-2665.
28. Schembri, A., Jones, C., & Burnham, D. (2005). Comparing action gestures and classifier verbs of motion: Evidence from Australian Sign Language, Taiwan Sign Language, and non-signers' gestures without speech. Journal of Deaf Studies & Deaf Education, 10(3), 272-290.
29. Senghas, A., Kita, S., & Özyürek, A. (2004). Children creating core properties of language: Evidence from an emerging sign language in Nicaragua. Science, 305(5691), 1779-1782.
30. Stokoe, W. (1960). Sign language structure: An outline of the visual communication systems of the American Deaf. Silver Spring, MD: Linstok Press.
31. Vigliocco, G., Perniss, P., & Vinson, D. (2014). Language as a multimodal phenomenon: Implications for language learning, processing, and evolution. Philosophical Transactions of the Royal Society B, 369, 20130292.
32. Wilcox, S., Rossini, P., & Pizzuto, E. (2010). Grammaticalization in sign languages. In D. Brentari (Ed.), Sign languages (pp. 332-354). Cambridge Language Surveys. Cambridge, England: Cambridge University Press.