Helping agents help their users despite imperfect speech recognition

AAAI Spring Symposium - Technical Report

Volumn SS-11-05, Issue , 2011, Pages 12-17

  Gordon, Joshua B ^a   Passonneau, Rebecca J ^b   Epstein, Susan L ^b,c  

^a Department of Earth and Environmental Sciences   (United States)

^b CITY UNIVERSITY OF NEW YORK   (United States)

^c CITY UNIVERSITY OF NEW YORK   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

HUMAN COMPUTER INTERACTION; SPEECH PROCESSING;

CONFIDENCE MEASURE; HUMAN-MACHINE DIALOGUE; MULTITHREADED; NOISY SPEECH RECOGNITION; PIPELINE ARCHITECTURE; SEMI-SYNCHRONOUS ARCHITECTURE; SPOKEN DIALOGUE SYSTEM; SPOKEN LANGUAGES;

SPEECH RECOGNITION;

EID: 80051510557     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (35)

1. Allen, J.; Ferguson, G.; and Stent, A. 2001. An architecture for more realistic conversational systems. In Proc. of the 6th International Conference on Intelligent User Interfaces, pp. 1-8.
2. Bangalore, S. 2006. Editorial Introduction to the Special Issue on Spoken Language Understanding in Conversational Systems. Speech Communication 48: 233-238. (Pubitemid 43207398)
3. Bangalore, S.; Boulllier, P.; Nasr, A.; Rambow, O.; and Sagot, B. 2009. MICA: a probabilistic dependency parser based on tree insertion grammars. In Proc. of the NAACL HLT 2009 Companion Volume: Short Papers, pp. 185-188.
4. Blaylock, N.; Allen, J.; and Ferguson, G. 2002. Synchronization in an asynchronous agent-based architecture for dialogue systems. In Proc. of SIGDIAL 2002, pp. 1-10.
5. Bohus, D. and Rudnicky, A. 2002. Integrating multiple knowledge sources for utterance-level confidence annotation in the CMU Communicator spoken dialog system. Technical. report CS-190, Carnegie Mellon University.
6. Bohus, D. and Rudnicky, A. I. 2009. The RavenClaw dialog management framework: Architecture and systems. Computer Speech & Language 23(3): 332-361.
7. Clark, H. H. and Schaefer, E. F. 1989. Contributing to discourse. Cognitive Science 13(2): 259-294.
8. Epstein, S. L. 1994. For the Right Reasons: The FORR Architecture for Learning in a Skill Domain. Cognitive Science 18(3): 479-511.
9. Epstein, S. L. and Petrovic, S. 2006. Relative Support Weight Learning for Constraint Solving. In Proc. of the AAAI Workshop on Learning for Search, pp. 115-122.
10. Gordon, J. and Passonneau, R. J. 2010. An Evaluation Framework for Natural Language Understanding in Spoken Dialogue Systems. In Proc. of LREC 2010, pp. 72-77.
11. Gupta, N.; Tur, G.; Hakkani-Tur, D.; Bangalore, S.; Riccardi, G.; and Gilbert, M. 2006. The AT&T spoken language understanding system. IEEE Transactions on Audio, Speech, and Language Processing, 14(1): 213-222.
12. Huggins-Daines, D.; Kumar, M.; Chan, A.; Black, A. W.; Ravishankar, M.; and Rudnicky, A. 2006. PocketSphinx: A free, real-time continuous speech recognition system for hand-held devices. In Proc. of ICASSP 2006, pp. 185-189.
13. Komatani, K., Kanda, N.; Ogata, T.; and Okuno, H. G. 2005. Contextual constraints based on dialogue models in database search task for spoken dialogue systems. In Proc. of Interspeech 2005, pp. 877-880.
14. Lemon, O. 2003. Managing dialogue interaction: A multilayered approach. SIGDIAL 2003, pp. 168-177.
15. Leuski, A.; Patel, R.; Traum, D.; and Kennedy, B. 2006. Building effective question answering characters. In Proc. of SIGDIAL 2006, pp. 18-27.
16. Leuski, A. and Traum, D. 2010. Practical Language Processing for Virtual Humans. In Proc. of IAAI-10.
17. Levin, E. and Passonneau, R. J. 2006. A WOz Variant with Contrastive Conditions. In Proc. of Interspeech 2006 Satelite Workshop: Dialogue on Dialogues.
18. Ligorio, T.; Epstein, S. L.; Passonneau, R. J.; and Gordon, J. B. 2010a. What You Did and Didn't Mean: Noise, Context, and Human Skill. In Proc. of Cognitive Science - 2010.
19. Ligorio, T.; Epstein S. L.; and Passonneau, R. J. 2010b. Wizards' Dialogue Strategies to Handle Noisy Speech Recognition. In Proc. of the IEEE SLT 2010. Berkeley CA.
20. Ochs, E. 1979. Planned and unplanned discourse. In Syntax and semantics, vol. 12: Discourse and syntax, ed. by T. Givon. New York: Academic Press.
21. Paek, T. and Horvitz, E. 2000. Conversation as action under uncertainty. In Proc. of the Sixteenth Conference on Uncertainty in Artificial Intelligence, pp. 455-464.
22. Passonneau, R. J.; Epstein, S. L.; and Gordon, J. B. 2009. Help Me Understand You: Addressing the Speech Recognition Bottleneck. In Proc. of the AAAI Spring Symposium on Agents that Learn from Human Teachers.
23. Passonneau, R. J., Epstein, S. L.; Ligorio, T.; Gordon, J.; and Bhutada, P. 2010. Learning About Voice Search for Spoken Dialogue Systems. In Proc. of NAACL HLT 2010, pp. 840-848.
24. Ratcliff, J. W. and Metzener, D. 1988. Pattern Matching: The Gestalt Approach, Dr. Dobb's Journal, p.46.
25. Raux, A. and Eskenazi, M. 2007. A multi-layer architecture for semi-synchronous event-driven dialogue management. In Proc. of IEEE ASRU 2007, pp. 514-519.
26. Raux, A., Langner, B. A.; Black, W.; and Eskenazi, M. 2005. Let's Go Public! Taking a spoken dialog system to the real world. In Proc. of Interspeech 2005.
27. Renais, S., Hain, T.; and Bourlard, H. 2008. Interpretation of multiparty meetings: The AMI and AMIDA projects. In Proc. of Hands-Free Speech Communication and Microphone Arrays (HSCMA-2008), pp. 115-118.
28. Rieser, V.; Kruijff-Korbayová, I.; and Lemon, O. 2005. A corpus collection and annotation framework for learning multimodal clarification strategies. In Proc. of SIGDIAL 2005, pp. 97-106.
29. Schlangen, D. and Skantze, G. 2009. A general, abstract model of incremental dialogue processing. In Proc. of EACL 2009, pp. 710-718.
30. Skantze, G. 2003. Exploring human error handling strategies: Implications for Spoken Dialogue Systems. Speech Communication 45(3): 325-341. (Pubitemid 40266147)
31. Skantze, G. and Gustafson, J. 2009. Attention and interaction control in a human-human-computer dialogue setting. In Proc. of SIGDIAL 2009, pp. 310-313.
32. Wang, Y.-Y.; Yu, D.; Ju, Y.-C.; and Acero, A. 2008. An introduction to voice search. IEEE Signal Processing Magazine, 25(3): 28-38.
33. Ward, W. and Issar, S. 1994. Recent Improvements in the CMU Spoken Language Understanding System. In Proc. of the ARPA Workshop on Human Language Technology, pp. 213-216.
34. Williams, J. D. and Young, S. 2004. Characterising Task-oriented Dialog using a Simulated ASR Channel. In Proc. of ICSLP 2004, pp. 185-188.
35. Zollo, T. 1999. A study of human dialogue strategies in the presence of speech recognition errors. In Proc. of the AAAI Fall Symposium on Psychological Models of Communication, pp. 132-139.