Adapting speaking after evidence of misrecognition: Local and global hyperarticulation

Speech Communication

Volumn 50, Issue 3, 2008, Pages 163-178

  Stent, Amanda J ^a,b   Huffman, Marie K ^b   Brennan, Susan E ^a,b  

^a USA   (United States)

^b STONY BROOK UNIVERSITY   (United States)

Author keywords

Adaptation in speaking; Clear speech; Hyperarticulation; Speaking rate; Speech recognition; Spoken dialog

Indexed keywords

ERROR ANALYSIS; SPEECH PROCESSING; SPEECH SYNTHESIS;

HYPERARTICULATION; SPEAKING RATE; SPOKEN DIALOGS;

SPEECH RECOGNITION;

EID: 38649085999     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2007.07.005     Document Type: Article

References (49)

1. Allen J., Byron D., Dzikovska M., Ferguson G., Galescu L., and Stent A. Toward conversational human-computer interaction. AI Magazine 22 4 (2001) 27-38
2. Batliner A., Fischer K., Huber R., Spilker J., and Noth E. How to find trouble in communication. Speech Comm. 40 (2003) 117-143
3. Bell A., Jurafsky D., Fosler-Lussier E., Girand C., Gregory M., and Gildea D. Effects of disfluencies, predictability, and utterance position on word form variation in English conversation. J. Acoust. Soc. Amer. 113 (2003) 1001-1024
4. Bennett C., and Rudnicky A. The Carnegie Mellon communicator corpus. Proc. Internat. Conf. Spoken Language Process (2002), International Speech Communication Association, Denver, Colorado 341-344
5. Bohus, D., Rudnicky, A., 2005. Sorry, I didn't catch that!-An investigation of non-understanding errors and recovery strategies. Proc. SIGDial Workshop Discourse and Dialogue. Lisbon, Portugal, ACL, pp. 128-143.
6. Bradlow A.R., and Bent T. The clear speech effect for non-native listeners. J. Acoust. Soc. Amer. 112 (2002) 272-284
7. Bradlow A.R. Confluent talker- and listener-oriented forces in clear speech production. In: Gussenhoven C., Rietveld T., and Warner N. (Eds). Papers in Laboratory Phonology VII (2002), Mouton de Gruyter, Berlin/New York 241-273
8. Brennan S.E. Conversation with and through computers. User Modeling and User-Adapted Interaction 1 (1991) 67-86
9. Brennan S.E. Lexical entrainment in spontaneous dialog. Proc. 1996 Internat. Sympos. Spoken Dialogue (ISSD-96) (1996), Acoustical Society of Japan, Philadelphia, PA 41-44
10. Brennan S.E., and Clark H.H. Conceptual pacts and lexical choice in conversation. J. Exp. Psychol.: Learn. Memory Cognit. 6 (1996) 1482-1493
11. Bulyko I., Kirchhoff K., Ostendorf M., and Goldberg J. Error-correction detection and response generation in a spoken dialogue system. Speech Comm. 45 (2005) 271-288
12. Choularton S., and Dale R. User responses to speech recognition errors: consistency of behaviour across domains. Proc. 10th Austr. Internat. Conf. Speech Sci. Technol. (2004), The Australian Speech Science and Technology Association, Sydney, Australia 457-462
13. Cohen J. Statistical Power Analysis for the Behavioral Sciences. 2nd ed. (1988), Academic Press, New York
14. Core M.G., and Schubert L.K. A model of speech repairs and other disruptions. Proc. AAAI Fall Sympos. Psychol. Models Commun. Collabor. Syst. (1999), American Association for Artificial Intelligence, North Falmouth, MA 48-53
15. Cutler A., and Butterfield S. Durational cues to word boundaries in clear speech. Speech Comm. 9 (1990) 485-495
16. Ferguson C. Towards a characterization of English foreigner talk. Anthropol. Linguist. 17 (1975) 1-14
17. Fernald A., and Simon T. Expanded intonation contours in mothers' speech to newborns. Develop. Psychol. 20 (1984) 104-113
18. Ferreira F., Ferraro V., and Bailey K.G.D. Good-enough representations in language comprehension. Curr. Direct. Psychol. Sci. 11 (2002) 11-15
19. Gieselmann, P., 2006. Comparing error-handling strategies in human-human and human-robot dialogues. Proc. 8th Conf. Nat. Language Process. (KONVENS). Konstanz, Germany, pp. 24-31.
20. Gorin A., Abella A., Riccardi G., and Wright J. Automated natural spoken dialog. Computer 35 4 (2002) 51-56
21. Harnsberger, J.D., Goshert, L.A., 2000. Reduced, citation, and hyperarticulated speech in the laboratory: an acoustic analysis. Research on Spoken Language Processing Report No. 24. Bloomington, IN, Speech Research Laboratory, Indiana University.
22. Hirschberg J., Litman D., and Swerts M. Prosodic cues to recognition errors. Proc. Internat. Workshop Automat. Speech Recognit. Understand. (ASRU'99) (1999), IEEE, Keystone, CO 349-352
23. Hirschberg J., Litman D., and Swerts M. Generalizing prosodic prediction of speech recognition errors. Proc. Internat. Conf. Spoken Language Process. (ICSLP) Vol. 1 (2000), International Speech Communication Association, Beijing, China 254-257
24. Hirschberg J., Litman D., and Swerts M. Prosodic and other cues to speech recognition failures. Speech Comm. 43 (2004) 155-175
25. Hockey B., Lemon O., Campana E., Hiatt L., Aist G., Hieronymus J., et al. Targeted help for spoken dialogue systems: intelligent feedback improves nai{dotless}̈ve users' performance. Proc. Euro. Chapter Meet. Associat. Comput. Linguist. (2003), Association for Computational Linguistics, Budapest, Hungary 147-154
26. Huang X., Acero A., and Hon H. Spoken Language Processing: A Guide to Theory, Algorithm and System Development (2001), Prentice Hall, Upper Saddle River, NJ
27. Johnson K., Flemming E., and Wright R. The hyperspace effect: phonetic targets are hyperarticulated. Language 69 (1993) 505-528
28. Kirchhoff, K., 2001. A comparison of classification techniques for the automatic detection of error corrections in human-computer dialogues. Proc. NAACL Workshop Adaptat. Dialogue Syst. Pittsburgh, PA, Association for Computational Linguistics.
29. Knight S., Gorrell G., Rayner M., Milward D., Koeling R., and Lewin I. Comparing grammar-based and robust approaches to speech understanding: a case study. Proc. Eurospeech 2001 (2001), International Speech Communication Association, Aalborg, Denmark 1779-1782
30. Kraljic T., and Brennan S.E. Using prosody and optional words to disambiguate utterances: for the speaker or for the addressee?. Cognit. Psychol. 50 (2005) 194-231
31. Krause J., and Braida L. Acoustic properties of naturally produced clear speech at normal speaking rates. J. Acoust. Soc. Amer. 115 (2004) 362-378
32. Levow G.A. Characterizing and recognizing spoken corrections in human-computer dialogue. Proc. COLING-ACL 1998 (1998), Association for Computational Linguistics, Montreal, Quebec, Canada 736-742
33. Levow, G.A., 1999. Understanding recognition failurers in spoken corrections in human-computer dialogue. Proc. ESCA Workshop on Dialogue and Prosody, Eindhoven, Netherlands, ESCA.
34. Litman D., Hirschberg J., and Swerts M. Characterizing and predicting corrections in spoken dialogue systems. Comput. Linguist. 32 3 (2006) 417-438
35. Moon S.-J., and Lindblom B. Interaction between duration, context, and speaking style in English stressed vowels. J. Acoust. Soc. Amer. 96 (1994) 40-55
36. Oviatt S.L., Levow G., Moreton E., and MacEachern M. Modeling global and focal hyperarticulation during human-computer error resolution. J. Acoust. Soc. Amer. 104 (1998) 3080-3098
37. Oviatt S.L., MacEachern M., and Levow G. Predicting hyperarticulate speech during human-computer error resolution. Speech Comm. 24 (1998) 1-23
38. Picheny M.A., Durlach N.I., and Braida L.D. Speaking clearly for the hard of hearing. I. Intelligibility differences between clear and conversational speech. J. Speech Hear. Res. 28 (1985) 96-103
39. Picheny M.A., Durlach N.I., and Braida L.D. Speaking clearly for the hard of hearing. II. Acoustic characteristics of clear and conversational speech. J. Speech Hear. Res. 29 (1986) 434-446
40. Schmandt C., and Arons B. A conversational telephone messaging system. IEEE Trans. Consum. Electron. 30 (1984) xxi-xxiv
41. Schmandt C.M., and Hulteen E.A. The intelligent voice-interactive interface. Proc. Conf. Human Factors Comput. Syst. (1982), ACM Press, Gaithersburg, MD 363-366
42. Shriberg, E., Wade, E., Price, P., 1992. Human-machine problem solving using spoken language systems (SLS): factors affecting performance and user satisfaction. Proc. Workshop Speech and Nat. Language at the Human Language Technol. Conf. Harriman, NY, Association for Computational Linguistics, pp. 49-54.
43. Sikveland R.O. How do we speak to foreigners?-phonetic analyses of speech communication between L1 and L2 speakers of Norwegian. Proc. Fonetik 2006 (2006), Centre for Language and Literature, Lund University, Lund, Sweden 109-112
44. Soltau H., and Waibel A. On the influence of hyperarticulated speech on recognition performance. Proc. Internat. Conf. Spoken Language Process. (1998), International Speech Communication Association, Beijing, China 229-232
45. Soltau H., and Waibel A. Phone dependent modeling of hyperarticulated effects. Proc. Internat. Conf. Spoken Language Process. (ICSLP) Vol. 4 (2000), International Speech Communication Association, Beijing, China 105-108
46. Soltau H., and Waibel A. Specialized acoustic models for hyperarticulated speech. Proc. IEEE Internat. Conf. Appl. Speech and Signal Process. Vol. 3 (2000), IEEE, Istanbul, Turkey 1779-1782
47. Summers W.V., Pisoni D.B., Bernacki R.H., Pedlow R.I., and Stokes M.A. Effects of noise on speech production: acoustic and perceptual analysis. J. Acoust. Soc. Amer. 84 (1988) 917-928
48. Wade E., Shriberg E.E., and Price P.J. User behaviors affecting speech recognition. Proc. 2nd Internat. Conf. Spoken Language Process. (1992), International Speech Communication Association, Banff, Alberta, Canada 995-998
49. Whalen D.H., Magen H.S., Pouplier M., Kang A.M., and Iskarous K. Vowel production and perception: hyperarticulation without a hyperspace effect. Language Speech 47 (2004) 155-174