Linguistic Adaptations during Spoken and Multimodal Error Resolution

Language and Speech

Volumn 41, Issue 3-4, 1998, Pages 419-442

  Oviatt, Sharon ^a   Bernard, Jon ^b   Levow, Gina Anne ^b  

^a OREGON HEALTH AND SCIENCE UNIVERSITY   (United States)

^b NONE

Author keywords

Error resolution; Hyperarticulation; Linguistic contrast; Multimodal interaction; Spiral errors; Spoken and multimodal interaction

Indexed keywords

ARTICLE; COMPUTER INTERFACE; COMPUTER SIMULATION; HUMAN; LINGUISTICS; NATURAL LANGUAGE PROCESSING; PHONETICS; SEMANTICS; SPEECH; SPEECH INTELLIGIBILITY; VERBAL BEHAVIOR;

COMPUTER SIMULATION; HUMANS; NATURAL LANGUAGE PROCESSING; PHONETICS; PSYCHOLINGUISTICS; SEMANTICS; SPEECH ACOUSTICS; SPEECH INTELLIGIBILITY; USER-COMPUTER INTERFACE; VERBAL BEHAVIOR;

EID: 0347663785     PISSN: 00238309     EISSN: None     Source Type: Journal    
DOI: 10.1177/002383099804100409     Document Type: Article

References (36)

1. AYERS, G. (1994). Discourse functions of pitch range in spontaneous and read speech. Working Papers in Linguistics, Ohio State University, Columbus OH, 44, 1-49.
2. BANSE, R., & SCHERER, K. (1996). Acoustic profiles in vocal emotion expression. Journal of Personality and Social Psychology. 70 (3), 614-636.
3. BOND, Z. S., & MOORE, T. J. (1994). A note on the acoustic-phonetic characteristics of inadvertently clear speech. Speech Communication, 14, 325-337.
4. FRANKISH, C., HULL, R., & MORGAN, P. (1995). Recognition accuracy and user acceptance of pen interfaces. In Proceedings of the Conference on Human Factors in Computing Systems, (CHI'95) (pp. 503-510). New York: ACM Press.
5. FRENCH, P., & LOCAL, J. (1986). Prosodic features and the management of interruptions. In C. Johns-Lewis (Eds.), Intonation in Discourse (pp. 157-180). San Diego, CA: College-Hill Press.
6. GAGNOULET, C. (1989). Voice replaces dial in new public phones. International Voice Systems Review, 1 (1).
7. GREENBERG, S. (1997a). On the origins of speech intelligibility in the real world. In Proceedings of the Conversational Speech Recognition Workshop/DARPA Hup-5E Evaluation. Baltimore, Maryland.
8. GREENBERG, S. (1997b). The Switchboard Transcription Project. In Proceedings of the Conversational Speech Recognition Worshop/DARPA Hub-5E Evaluation. Baltimore, Maryland.
9. JUNQUA, J. C. (1993). The lombard reflex and its role on human listeners and automatic speech recognizers. Journal of the Acoustical Society of America, 93 (1), 510-524.
10. KAMM, C. A. (1994). User interfaces for voice applications. In D. B. Roe & J. Wilpon (Eds.), Voice communication between humans and machines, (pp.422-442). Washington, DC: National Academy Press.
11. KARIS, D., & DOBROTH, K. M. (1991). Automating services with speech recognition over the public switched telephone network: Human factors considerations. IEEE Journal of Selected Areas in Communications, 9 (4), 574-585.
12. LEWIS, C., & NORMAN, D. A. (1986). Designing for error. In D. A. Norman & S. W. Draper, (Eds.), User-centered system design, (pp. 411-432). Hillsdale, NJ: Lawrence Erlbaum.
13. LINDBLOM, B. (1990). Explaining phonetic variation: A sketch of the H and H theory. In W. Hardcastle & A. Marchal, (Eds.), Speech production and speech modeling (pp. 403-439). Dordrecht: Kluwer.
14. LINDBLOM, B., BROWNLEE, S., DAVIS, B., & MOON, S. J. (1992). Speech transforms. Speech Communication, 11 (4 and 5), 347-368.
15. LIVELY, S. E., PISONI, D. B., van SUMMERS, W., & BERNACKI, R. (1993). Effects of cognitive workload on speech production: Acoustic analyses and perceptual consequences. Journal of the Acoustical Society of America, 93 (5), 2962-2973.
16. MARTIN, A., FISCUS, J., FISHER, B., PALLETT, D., & PRZYBOCKI, M. (1997). System descriptions and performance summary. In Proceedings of the Conversational Speech Recognition Workshop/DARPA Hub-5E Evaluation. Baltimore, Maryland.
17. OVIATT, S. L. (1996). User-centered design of spoken language and multimodal interfaces, IEEE, Multimedia, 3 (4), 26-35.
18. OVIATT, S. L. (1997). Multimodal interactive maps: Designing for human performance. Human-Computer Interaction, 12 (1 & 2), 93-129.
19. OVIATT, S. L., & COHEN, P. R. (1991). Discourse structure and performance efficiency in interactive and noninteractive spoken modalities. Computer Speech and Language, 5 (4), 297-326.
20. OVIATT, S. L., COHEN, P. R., FONG, M. W., & FRANK, M. P. (1992). A rapid semiautomatic simulation technique for investigating interactive speech and handwriting. In J. Ohala. (Ed.), Proceedings of the International Conference on Spoken Language Processing (Vol. 2, pp. 1351-1354). Alberta, Canada: University of Alberta Press.
21. OVIATT, S. L., DEANGELI, A., & KUHN, K. (1997). Integration and synchronization of input modes during multimodal human-computer interaction. In Proceedings of Conference on Human Factors in Computing Systems (CHI '97) (pp. 415-422). New York: ACM Press.
22. OVIATT, S. L., LEVOW, G., MORETON, E., & MacEACHERN, M. (1998). Modeling global and focal hyperarticulation during human-computer error resolution. Journal of the Acoustical Society of America, 104 (5), 3080-3098.
23. OVIATT, S. L., MACEACHERN, M., & LEVOW, G. (1998). Predicting hyperarticulate speech during human-computer error resolution. Speech Communication, 24, 87-110.
24. OVIATT, S. L., & OLSEN, E. (1994). Integration themes in multimodal human-computer interaction. In K. Shirai & S. Furui (Eds.), Proceedings of the International Conference on Spoken Language Processing, Vol. 2 (pp. 551-554). Yokohama, Japan: Acoustical Society of Japan.
25. OVIATT, S. L., & vanGENT, R. (1996). Error resolution during multimodal human-computer interaction. In T. Bunnell & W. Idsardi (Eds.), Proceedings of the International Conference on Spoken Language Processing, Vol. 1 (pp.204-207). Wilmington, DE: University of Delaware and A. I. du-Pont Institute.
26. RHYNE, J. R., & WOLF, C. G. (1993). Recognition-based user interfaces. In H. R. Hartson & D. Hix (Eds.), Advances in human-computer interaction, Vol. 4 (pp. 191-250). Norwood, NJ: Ablex Publishing Corporation.
27. RUDNICKY, A. I., & HAUPTMANN, A. G. (1992). Multimodal interaction in speech systems. In M. M. Blattner & R. B. Dannenberg (Eds.), Multimedia interface design (pp. 147-171). Menlo Park, CA: Addison-Wesley.
28. SHRIBERG, E., WADE, E., & PRICE, P. (1992). Human-machine problem solving using spoken language systems (SLS): Factors affecting performance and user satisfaction. In Proceedings of the DARPA Speech and Natural Language Workshop (pp. 49-54). San Mateo, CA: Morgan Kaufmann Publishers.
29. SPITZ, J. (1991). Collection and analysis of data from real users: Implications for speech recognition/ understanding systems. In Proceedings of the 4th Darpa Workshop on Speech and Natural Language, San Mateo, CA: Morgan Kaufmann Publishers.
30. STORK, D. G., & HENNECKE, M. E. (Eds.) (1995). Speechreading by humans and machines. New York: Springer-Verlag.
31. SUMMERS, W. V. PISONI, D. B., BERNACKI, R. H., PEDLOW, R. I., & STOKES, M. A. (1988). Effects of noise on speech production: Acoustic and perceptual analyses. Journal of the Acoustical Society of America, 84, 917-928.
32. SWERTS, M., BOUWHUIS, D. G., & COLLIER, R. (1994). Melodic cues to the perceived finality of utterances. Journal of the Acoustical Society of America, 96 (4), 2064-2075.
33. SWERTS, M., & OSTENDORF, M. (1997). Prosodic and lexical indications of discourse structure in human-machine interactions. Speech Communication, 22 (1), 25-41.
34. TOLKMITT, E. J., & SCHERER, K. R. (1986). Effect of experimentally induced stress on vocal parameters. Journal of Experimental Psychology, 12, 302-312.
35. WEINTRAUB, M., TAUSSIG, K., HUNICKE-SMITH, K., & SNODGRASS, A. (1997). Effect of speaking style on LVCSR performance. In Proceedings of the Conversational Speech Recognition Workshop/DARPA Hub-5E Evaluation. Baltimore, Maryland.
36. WILLIAMS, C. E., & STEVENS, K. N. (1969). On determining the emotional state of pilots during flight: An exploratory study. Aerospace Medicine, 40, 1369-1372.