Sensitivity to visual prosodic cues in signers and nonsigners

Language and Speech

Volumn 54, Issue 1, 2011, Pages 49-72

  Brentari, Diane ^a   González, Carolina ^a   Seidl, Amanda ^a   Wilbur, Ronnie ^a  

^a PURDUE UNIVERSITY   (United States)

Author keywords

gesture; Intonational Phrase; Prosodic Word; prosody; sign language

Indexed keywords

EID: 79953042134     PISSN: 00238309     EISSN: None     Source Type: Journal    
DOI: 10.1177/0023830910388011     Document Type: Article

References (70)

1. Allen, G.D., Wilbur, R.B., and Schick, B.S. (1991). Aspects of rhythm in American Sign Language. Sign Language Studies, 72, 297-320.
2. Baker, S.A., Michnick-Golinkoff, R., and Petitto, L.A. (2006). New insights into old puzzles from infants' categorical discrimination of soundless phonetic units. Language Learning and Development, 2(3), 147-162.
3. Baldwin, D., Baird, J., Saylor, M., and Clark, A. (2001). Infants parse dynamic action. Child Development, 72, 708-717.
4. Balog, H., and Brentari, D. (2008). The relationship between early gestures and intonation. First Language, 18, 141-163.
5. Battison, R. (1978). Lexical borrowing in American Sign Language. Silver Spring, MD: Linstok Press.
6. Boyes Braem, P. (1999). Rhythmic and temporal patterns in the signing of deaf early and late signers of Swiss German Sign Language. Language and Speech, 42, 177-208.
7. Brand, R.J., Baldwin, D.A., and Ashburn, L. (2002). Evidence for "Motionese": Mothers modify their infant-directed actions. Developmental Science, 5, 72-83.
8. Brand, R.J., and Tapscott, S. (2007). Acoustic packaging of action sequences by infants. Infancy, 11, 321-332.
9. Brentari, D. (1998). A prosodic model of ASL phonology. Cambridge, MA: MIT Press.
10. Brentari, D. (2006). Effects of language modality on word segmentation: An experimental study of phonological factors in a sign language. In S. Anderson, L. Goldstein, and C. Best (Eds.), Papers in Laboratory Phonology, 8 (pp. 155-164). The Hague: Mouton de Gruyter.
11. Brentari, D., and Crossley, L. (2002). Prosody on the hands and face: Evidence from American Sign Language. Sign Language and Linguistics, 5(2), 105-130.
12. Brentari, D., Poizner, H., and Kegl, J. (1995). Aphasic and Parkinsonian signing: Differences in phonological disruptions. Brain and Language, 48, 69-105.
13. Carroll, J., and Gibson, E. (1986). Infant perception of gestural contrasts: Prerequisites for the acquisition of visually specified language. Journal of Child Language, 13, 21-49.
14. Cassell, J., Nakano, Y.I., Bickmore, T.W., Sidner, C.L., and Rich, C. (2001). Non-verbal cues for discourse structure. Proceedings of the 41st annual meeting of the Association of Computational Linguistics (ACL). Toulouse, France.
15. Cassell, J., and Thorisson, K. (1999). The power of a nod and a glance: Envelope vs. emotional feedback in animated conversational agents. Applied Artificial Intelligence, 13(4), 519-538.
16. Cutler, A., and Butterfield, S. (1992). Rhythmic cues to speech segmentation: Evidence from juncture misperception. Journal of Memory and Language, 31, 218-236.
17. Cutler, A., and Norris, D. (1988). The role of strong syllables in segmentation for lexical access. Journal of Experimental Psychology: Human Perception and Performance, 14(11), 113-121.
18. Eccarius, P., and Brentari, D. (2007). Symmetry and dominance: A cross-linguistic study of signs and classifier constructions. Lingua, 117, 1169-1201.
19. Fenlon, J., Denmark, T., Campbell, R., and Woll, B. (2007). Seeing sentence boundaries. Sign Language and Linguistics, 10(2), 177-200.
20. Gogate, L., and Bahrick, L.E. (2001). Intersensory redundancy and seven-month-old infants' memory for arbitrary syllable-object relations. Infancy, 2, 219-231.
21. Gogate, L.J., Bahrick, L.E., and Watson, J.D. (2000). A study of multimodal motherese: The role of temporal synchrony between verbal labels and gestures. Child Development, 71(4), 876-892.
22. Golinkoff, R.M., and Alioto, A. (1995). Infant-directed speech facilitates lexical learning in adults hearing Chinese: Implications for language acquisition. Journal of Child Language, 22, 703-726.
23. Grosjean, F., and Lane, H. (1977). Pauses and syntax in American Sign Language. Cognition, 5(2), 101-117.
24. Johnson, E.K., and Jusczyk, P.W. (2001). Word segmentation by 8-month-olds: When speech cues count more than statistics. Journal of Memory and Language, 44, 548-567.
25. Johnson, E.K., and Seidl, A. (2008a). At eleven months, prosody still outranks statistics. Developmental Science, 11(6), 1-11.
26. Johnson, E.K., and Seidl, A. (2008b). A cross-linguistic perspective on the detection of juncture in speech. Infancy, 13(5), 440-455.
27. Jusczyk, P.W. (2003). American infants' perception of cues to grammatical units in non-native languages and music: Evidence from Polish and Japanese. In D. Houston, A. Seidl, G. Hollich, E. K. Johnson, and A. Jusczyk (Eds.), Jusczyk Lab Final Report. Retrieved from http://hincapie.psych.purdue.edu/Jusczyk Jusczyk, P.W., Cutler, A., and Redanz, N.J. (1993). Preference for the predominant stress patterns of English words. Child Development, 64, 675-687.
28. Jusczyk, P.W., Hohne, E., and Bauman, A. (1999). Infants' sensitivity to allophonic cues for word segmentation. Perception and Psychophysics, 61(8), 1465-1473.
29. Keating, P. (2005). D-prime (signal detection) analysis. http://www.linguistics.ucla.edu/faciliti/facilities/statistics/dprime.htm.
30. Kegl, J., Senghas, A., and Coppola, M. (1999). Creation through contact: Sign language emergence and sign language change in Nicaragua. In M. DeGraff (Ed.), Language creation and language change: Creolization, diachrony, and development (pp. 179-237). Cambridge, MA: MIT Press.
31. Kellman, P.J., and Spelke, E. (1983). Perception of partly occluded objects in infancy. Cognitive Psychology, 15(4), 483-524.
32. Kendon, A. (2004). Gesture: Visible action as utterance. Cambridge: Cambridge University Press.
33. Krahmer, E., and Swerts, M. (2007). The effects of visual beats on prosodic prominence: Acoustic analyses, auditory perception and visual perception. Journal of Memory and Language, 57(3), 396-415.
34. Launer, P.B. (1982). "A plane" is not "to fly": Acquiring the distinction between related nouns and verbs in American Sign Language. Doctoral Dissertation, New York University.
35. Liddell, S. (1978). Non-manual signals and relative clauses in American Sign language. In P. Siple (Ed.), Understanding sign language through sign language research (pp. 59-90). New York: Academic Press.
36. Liddell, S. (1984). THINK and BELIEVE: Sequentiality in American Sign Language. Language, 60, 372-392.
37. Malaia, E., and Wilbur, R.B. (2009). Kinematic signatures of telic and atelic events in ASL predicates. Manuscript, Purdue University.
38. Masataka, N. (2000). The role of modality and input in the earliest stages of language acquisition: Studies of Japanese Sign Language. In C. D. Chamberlain, J. P. Morford, and R. Mayberry (Eds.), Language acquisition by eye (pp. 3-24). Mahwah, NJ: Erlbaum.
39. McClave, E. (1998). Pitch and manual gestures. Journal of Psycholinguistic Research, 27(1), 69-90.
40. McCullough, S., Emmorey, K., and Sereno, M. (2005). Neural organization for recognition of grammatical and emotional facial expressions in deaf ASL signers and hearing nonsigners. Cognitive Brain Research, 22(2), 193-203.
41. McNeill, D. (1992). Hand and mind: What gestures reveal about thought. Chicago, IL: University of Chicago Press.
42. McQueen, J.M. (1996). Word spotting. Language and Cognitive Processes, 11(6), 695-699.
43. Meier, R.P. (1982). Icons, analogues and morphemes: The acquisition of verb agreement in American Sign Language. Doctoral Dissertation, University of California, San Diego, CA.
44. Meier, R.P., Pizer, G., and Shaw, K. (2008). Child-directed signing. Paper presented at the First SignTyp Conference, June 26-28, 2008, University of Connecticut, Storrs, CT.
45. Nazzi, T., Kemler Nelson, D., Jusczyk, P.W., and Jusczyk, A.M. (2000). Six-month-olds' detection of clauses embedded in continuous speech: Effects of prosodic well-formedness. Infancy, 1, 123-147.
46. Nespor, M., and Sandler, W. (1999). Prosody in Israeli Sign language. Language and Speech, 42, 143-176.
47. Nicodemus, B., and Smith, C. (2005). Prosody and utterance boundaries in ASL interpretation. 32nd Annual Meeting of the Berkeley Linguistics Society.
48. Norris, D., McQueen, J.M., Cutler, A., and Butterfield, S. (1997). The possible-word constraint in the segmentation of continuous speech. Cognitive Psychology, 34(3), 191-243.
49. Orfanidou, E., Adam, R., Morgan, G., and McQueen, J.M. (2009). Making sense of nonsense in British Sign Language (BSL): The contribution of different phonological parameters to sign recognition. Memory and Cognition, 37, 302-315.
50. Orfanidou, E., Adam, R., Morgan, G., and McQueen, J.M. (2010). Recognition of signed and spoken language: Different sensory inputs, the same segmentation procedure. Journal of Memory and Language, 62(3), 272-283.
51. Perlmutter, D. (1992). Sonority and syllable structure in American Sign Language. Linguistic Inquiry, 23, 407-442.
52. Petitto, L.A., Zatorre, R.J., Gauna, K., Nikelski, E.J., Dostie, D., and Evans, A.C. (2000). Speech-like cerebral activity in profoundly deaf people processing signed languages: Implications for the neural basis of human language. Proceedings of the National Academy of Science, 97(25), 13961-13966.
53. Pierrehumbert, J. (1980). The phonology and phonetics of English intonation. Doctoral Dissertation, MIT, Cambridge, MA.
54. Reilly, J., and Anderson, D. (2002). FACES: The acquisition of non-manual morphology in ASL. In G. Morgan and B. Woll (Eds.), Directions in sign language acquisition (pp. 159-181). Amsterdam: John Benjamins Associates.
55. Sandler, W., and Lillo-Martin, D. (2006). Sign language and linguistic universals. New York: Cambridge University Press.
56. Saylor, M., Baldwin, D., Baird, J., and LaBounty, J. (2007). Infants' on-line segmentation of dynamic human action. Journal of Cognition and Development, 8(1), 113-128.
57. Schley, S. (1991). Infant discrimination of gestural classes: Perceptual precursors of ASL acquisition. Sign Language Studies, 20, 277-296.
58. Seidl, A. (2007). Infants' use and weighting of prosodic cues in clause segmentation. Journal of Memory and Language, 57(1), 24-48.
59. Selkirk, E. (1984). Phonology and syntax: The relation between sound and structure. Cambridge,.
60. Senghas, A., and Coppola, M. (2001). Children creating language: How Nicaraguan Sign Language acquired a spatial grammar. Psychological Science, 12(4), 323-328.
61. Soderstrom, M., Seidl, A., Kemler Nelson, D.G., and Jusczyk, P.W. (2003). The prosodic bootstrapping of phrases: Evidence from prelinguistic infants. Journal of Memory and Language, 49, 249-267.
62. Suomi, K., McQueen, J.M., and Cutler, A. (1997). Vowel harmony and speech segmentation in Finnish. Journal of Memory and Language, 36, 422-444.
63. Tang, G., Brentari, D., González, C., and Sze, F. (2010). Crosslinguistic variation in the use of prosodic cues: The case of blinks. In D. Brentari (Ed.), Sign languages: A Cambridge language survey (pp. 519-542). Cambridge: Cambridge University Press.
64. Werker, J.F., and Tees, R.C. (1984). Cross-language speech perception: Evidence for perceptual reorganization during the first year of life. Infant Behavior and Development, 7, 49-63.
65. Wilbur, R.B. (1994). Eye blinks and ASL phrase structure. Sign Language Studies, 84, 221-240.
66. Wilbur, R.B. (1999). Stress in ASL: Empirical evidence and linguistic issues. Language and Speech, 42(2/3), 229-250.
67. Wilbur, R.B. (2009). Effects of varying rate of signing on ASL manual signs and nonmanual markers. Language and Speech, 52(2/3), 245-285.
68. Wilbur, R.B., and Malaia, E. (2008). Contributions of sign language research to gesture understanding: What can multimodal computational systems learn from sign language research. International Journal of Semantic Computing, 2(1), 5-19.
69. Wilbur, R.B., and Patschke, C. (1998). Body leans and marking contrast in ASL. Journal of Pragmatics, 30, 275-303.
70. Yasinnik, Y., Renwick, M., and Shattuck-Hufnagel, S. (2004). The timing of speech-accompanying gestures with respect to prosody. Paper presented at the From Sound to Sense Conference, MIT, Cambridge, MA.