Can experience with co-speech gesture influence the prosody of a sign language? Sign language prosodic cues in bimodal bilinguals

Bilingualism

Volumn 15, Issue 2, 2012, Pages 402-412

  Brentari, Diane ^a   Nadolske, Marie A ^b   Wolford, George ^c  

^a UNIVERSITY OF CHICAGO   (United States)

^b MONTCLAIR STATE UNIVERSITY   (United States)

^c PURDUE UNIVERSITY   (United States)

Author keywords

character viewpoint; constructed action; discourse; gesture; language contact; narrative; prosody; second language acquisition; sign language

Indexed keywords

EID: 84858849911     PISSN: 13667289     EISSN: 14691841     Source Type: Journal    
DOI: 10.1017/S1366728911000587     Document Type: Article

References (60)

1. Aarons, D. (1994). Aspects of syntax of American Sign Language. Ph.D. dissertation, Boston University.
2. Baker, C., & Padden, C. (1978). Focusing on the non-manual components of American Sign Language. In P. Siple (ed.), Understanding language through sign language research, pp. 27-57. New York: Academic Press.
3. Boyes Braem, B. (1999). Rhythmic temporal patterns in the signing of early and late learners of German Swiss Sign Language. Language and Speech, 42, 177-208.
4. Brentari, D. (1998). A prosodic model of sign language phonology. Cambridge, MA: MIT Press.
5. Brentari, D. (ed.) (2010). Sign languages: A Cambridge language survey. Cambridge: Cambridge University Press.
6. Brentari, D., & Crossley, L. (2002). Prosody on the hands and face: Evidence from American Sign Language. Sign Language and Linguistics, 5, 105-130.
7. Brentari, D., González, C., Seidl, A., & Wilbur, R. (2011). Sensitivity to visual prosodic cues in signers and nonsigners. Language and Speech, 54 (1), 49-72.
8. Brentari, D., & Poizner, H. (1994) A phonological analysis of a deaf Parkinsonian signer. Language and Cognitive Processes, 9 (1), 69-100.
9. Casey, S.,&Emmorey,K. (2008). Co-speech gesture in bimodal bilinguals. Language and Cognitive Process, 24, 290-312.
10. Cohn, J., Reed, L. I., Ambadar, Z., Xiao, J., & Moriyama, T. (2004). Automatic analysis and recognition of brow actions and head motion in spontaneous facial behavior. IEEE Internal Conference on Systems, Man, and Cybernetics, pp. 210-616. http://ieeexplore.ieee.org (retrieved October 31, 2011).
11. Duncan, S. (1996). Grammatical form and 'thinking-forspeaking' in Mandarin Chinese and English: An analysis based on speech-accompanying gestures. Ph.D. dissertation, University of Chicago.
12. Emmorey, K., &McCullough, S. (2008). The bimodal bilingual brain: Effects of sign language experience. Brain and Language, 109, 124-132.
13. Engberg-Pedersen, E. (1995). Point of view expressed through shifters. In K. Emmorey & J. Reilly (eds.), Language, gesture and space, pp. 133-170. Mahwah, NJ: Lawrence Erlbaum.
14. Fenlon, J., Denmark, T., Campbell, R.,&Woll, B. (2007). Seeing sentence boundaries. Sign Language & Linguistics, 10, 177-200.
15. Gee, J.,&Kegl, J. (1993). Narrative/story structure, pausing, and American Sign Language. Discourse Processes, 6, 243-258.
16. Grosjean, F., & Dechamps, A. (1975). Analyse contrastive des variables temporelles de l'anglais et du français: Vitesse de parole et variables composantes, phénomènes. Phonetica, 31, 144-184.
17. Grosjean, F., & Lane, H. (1977). Pauses and syntax in American Sign Language. Cognition, 5, 101-117.
18. Gullberg, M. (2010). Methodological reflections on gesture analysis in second language acquisition and bilingualism research. Second Language Research, 26, 75-102.
19. Gullberg, M. (2006). Some reasons for studying gesture and second language acquisition (Hommage à Adam Kendon). International Review of Applied Linguistics, 44, 103-124.
20. House, D. (2007). Integrating audio and visual cues for speaker friendliness in multimodal speech synthesis. Proceedings from the 8th Annual Interspeech Conference, pp. 1250-1253. Antwerp: International Speech Communication Association.
21. Kendon, A. (2004). Gesture: Visible action as utterance. Cambridge: Cambridge University Press.
22. Kipp, M., Neff, M., Kipp, K., & Albrecht, I. (2007). Towards natural gesture synthesis: Evaluating gesture units in a datadriven approach to gesture synthesis. Proceedings of the 7th International Conference on Intelligent Virtual Agents, pp. 15-28. Berlin: Springer Verlag.
23. Kita, S. (2009). Cross-cultural variation in speechaccompanying gesture. Language and Cognitive Processes, 24, 145-167.
24. Klatt, D. (1976). Linguistic uses of segmental duration in English: Acoustic and perceptual evidence. Journal of the Acoustical Society of America, 59, 1208-1221.
25. Krahmer, E., & Swerts, M. (2005). How children and adults produce and perceive uncertainty in audiovisual speech, Language and Speech, 48, 29-53.
26. Krahmer, E., & Swerts, M. (2007). The effects of visual beats on prosodic prominence: Acoustic analyses, auditory perception and visual perception. Journal of Memory and Language, 57, 396-414.
27. Krahmer, E., & Swerts, M. (2009). Audiovisual prosody -introduction to the special issue. Language and Speech, 52 (2-3), 129-133.
28. Liddell, S. (1978). Non-manual signals and relative clauses in American Sign Language. In P. Siple (ed.), Understanding sign language through sign language research, pp. 59-90. New York: Academic Press.
29. Liddell, S.,&Johnson, R. (1989).American Sign Language: The phonological base. Sign Language Studies, 64, 197-277.
30. Loehr, D. (2004). Gesture and intonation. Ph.D. dissertation, Georgetown University.
31. Loehr, D. (2007). Aspects of rhythm in gesture and speech. Gesture, 7 (2), 179-214.
32. Lucas, C., & Valli, C. (1992). Language contact in the American Deaf community. New York: Academic Press.
33. Mazzoni, L. (2008). Classificatori e impersonamento nella Lingua dei Segni Italiana. Pisa: Plus.
34. McClave, E. (1998). Pitch and manual gestures. Journal of Psycholinguistic Research, 27, 69-90.
35. McClave, E., Kim, H., Tamer, R., & Mileff, M. (2007). Head movements in the context of speech in Arabic, Bulgarian, Korean, and African-American Vernacular English. Gesture, 7 (3), 343-390.
36. McGory, J. (1997). The acquisition of intonation patterns in English by native speakers of Korean and Mandarin. Ph.D. dissertation, The Ohio State University.
37. McNeill, D. (1992). Hand and mind: What gestures reveal about thought. Chicago: University of Chicago Press.
38. McNeill, D. (2000). Language and gesture. Cambridge: Cambridge University Press.
39. Morgan, G. (2000). Discourse cohesion in sign and speech. International Journal of Bilingualism, 4 (3), 279-300.
40. Nadolske, M. (2009). Mastering the pressures of variation: A cognitive linguistic examination of advanced hearing ASL L2 signers. Ph.D. dissertation, Purdue University.
41. Nespor, M., & Sandler, W. (1999). Prosody in Israeli Sign Language. Language and Speech, 42, 143-176.
42. Nespor,M., & Vogel, I. (1986). Prosodic phonology. Dordrecht: Foris.
43. Nicodemus, B. (2010). Prosodic markers and utterance boundaries in American Sign Language interpretation. Washington, DC: Gallaudet University Press.
44. Parrill, F. (2010). Viewpoint in speech-gesture integration: Linguistic structure, discourse structure, and event structure. Language and Cognitive Processes, 25, 650-668.
45. Perlmutter, D. (1992). Sonority and syllable structure in American Sign Language. Linguistic Inquiry, 23, 407-442.
46. Pfau, R., & Quer, J. (2010). Nonmanuals: Their grammatical and prosodic roles. In Brentari (ed.), pp. 381-402.
47. Poggi, I., Pelachaud, C., & De Rosis, F. (2000). Eye communication in a conversational 3D synthetic agent. AI Communications, 13, 169-181.
48. Pyers, J., & Emmorey, K. (2008). The face of bimodal bilingualism: Grammatical markers in American Sign Language are produced when bilinguals speak to English monolinguals. Psychological Science, 19, 531-536.
49. Queen, R. (2001). Bilingual intonation patterns: Evidence of language change in Turkish-German bilingual children. Language in Society, 30, 55-80.
50. Quinto-Pozos, D., & Mehta, S. (2010). Register variation in mimetic gestural complements to signed language. Journal of Pragmatics, 42, 557-584.
51. Riazantseva, A. (2002). Second language proficiency and pausing: A study of Russian speakers. Studies in Second Language Acquisition, 23, 487-526.
52. Sandler, W., & Lillo-Martin, D. (2006). Sign language and linguistic universals. Cambridge: Cambridge University Press.
53. Stam, G. (2006). Thinking for speaking about motion: L1 and L2 speech and gesture. International Review Applied Linguistics, 44, 145-171.
54. Tang, G., Brentari, D., González, C., & Sze, F. (2010). Crosslinguistic variation in the use of prosodic cues: The case of blinks. In Brentari (ed.), pp. 519-541.
55. Trouvain, J., & Gut, U. (2007). Non-native prosody: Phonetic description and teaching practice. Berlin: Mouton de Gruyter.
56. Tyrone, M., Nam, H., Saltzman, E., Mathur, G., & Goldstein, L. (2010). Prosody and movement in American Sign Language: A task-dynamics approach. Presented at the Prosody 2010 Conference, Chicago.
57. Wilbur, R. B. (1994). Eyeblinks & ASL phrase structure. Sign Language Studies, 84, 221-240.
58. Wilbur, R. B., & Patschke, C. G. (1998). Body leans and the marking of contrast in American Sign Language. Journal of Pragmatics, 30, 275-303.
59. Wilcox, S. (2007). Routes from gesture to language. In E. Pizzuto, P. Pietrandrea & R. Simone (eds.), Verbal and signed languages: Comparing structures, constructs and methodologies, pp. 107-131. Berlin: Mouton de Gruyter.
60. Wilcox, S., Rossini, P., & Pizzuto, E. A. (2010). Grammaticalization in sign languages. In Brentari (ed.), pp. 332-356.