Comparing spoken dialog corpora collected with recruited subjects versus real users

Proceedings of the 8th SIGdial Workshop on Discourse and Dialogue

Volumn , Issue , 2007, Pages 124-131

  Ai, Hua ^a   Raux, Antoine ^b   Bohus, Dan ^b,d   Eskenazi, Maxine ^b   Litman, Diane ^a,c  

^a UNIVERSITY OF PITTSBURGH   (United States)

^b Carnegie Mellon University   (United States)

^c University of Pittsburgh   (United States)

^d MICROSOFT RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

OPERATING HOURS;

SOFTWARE AGENTS;

EID: 67649536222     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (26)

1. J. F. Allen, B. W. Miller, E. K. Ringger, and T. Sikorski. 1996. A Robust System for Natural Spoken Dialogue. In Proceedings of the 34nd Annual Meeting of the Association for Computational Linguistics (ACL).
2. A. Batliner, K. Fischer, R. Huber, J. Spilker, and E. Noth. 2003. How to Find Trouble in Communication. Speech Communication, Vol. 40, No. 1-2, pp. 117-143.
3. A. W. Black and K. Lenzo. 2000. Building Voices in the Festival Speech System. http://festvox.org/bsv/
4. D. Bohus and A. Rudnicky. 2003. RavenClaw: Dialog Management Using Hierarchical Task Decomposition and an Expectation Agenda. In Proceedings of Eurospeech 2003, Geneva, Switzerland.
5. D. Bohus and A. Rudnicky. 2006. A K Hypotheses + Other Belief Updating Model. In AAAI Workshop on Statistical and Empirical Approaches to Spoken Dialogue Systems.
6. D. Bohus, A. Raux, T. K. Harris, M. Eskenazi, and A. Rudnicky. 2007. Olympus: an open-source framework for conversational spoken language interface research. In Proceedings of the HLT-NAACL 2007 workshop on Bridging the Gap: Academic and Industrial Research in Dialog Technology, Rochester, NY, USA.
7. Cepstral, LLC. 2005. SwiftTM: Small Footprint Text-to-Speech Synthesizer. http://www.cepstral.com
8. D. Huggins-Daines, M. Kumar, A. Chan, A. W Black, M. Ravishankar, and A. I. Rudnicky. 2006. Pocket-Sphinx: A Free, Real-Time Continuous Speech Recognition System for Hand-Held Devices. In Proc. of ICASSP 2006.
9. T. Giorgino, S. Quaglini, and M. Stefanelli. 2004. Evaluation and Usage Patterns in the Homey Hypertension Management Dialog System. Dialog Systems for Health Communication, AAAI Fall Symposium, Technical Report FS-04-04
10. A. Gruenstein, S. Seneff, and C. Wang. 2006. Scalable and Portable Web-Based Multimodal Dialogue Interaction with Geographical Databases. In Proc. of IC-SLP, 2006.
11. A. Hof, E. Hagen and A. Huber. 2006. Adaptive Help for Speech Dialogue Systems Based on Learning and Forgetting of Speech Commands. In Proc. of 7th SIGdial.
12. K. S. Hone and R. Graham. 2000. Towards a tool for the subjective assessment of speech system interfaces (SASSI). Natural Language Engineering, 6(3/4), 287-305.
13. O. Lemon, K. Georgila, J. Henderson. 2006. Evaluating Effectiveness and Portability of Reinforcement Learned Dialogue Strategies with real users: the TALK TownInfo Evaluation. In Proceedings of IEEE/ACL Spoken Language Technology.
14. D. J. Litman and S. Pan. 2002. Designing and Evaluating an Adaptive Spoken Dialogue System. User Modeling and User-Adapted Interaction. Vol. 12, No. 2/3, pp. 111-137 (Pubitemid 34491077)
15. S. Möller, R. Englert, K. Engelbrecht, V. Hafner, A. Jameson, A. Oulasvirta, A. Raake, and N. Reithinger. 2006. MeMo: Towards Automatic Usability Evaluation of Spoken Dialogue Services by User Error Simulations. In Proc. ICSLP 2006.
16. M. Okamoto, Y. Yang, and T. Ishida. 2001. Wizard of oz method for learning dialog agents. Cooperative Information Agents V, volume 2182 of LNAI, pages 20-25. (Pubitemid 33334627)
17. A. Raux, B. Langner, D. Bohus, A. W Black, M., Eskenazi. 2005. Let's Go Public! Taking a Spoken Dialog System to the Real World. In Proceedings of Interspeech 2005 (Eurospeech), Lisbon, Portugal.
18. A. Raux, D. Bohus, B. Langner, A. W Black, M., Eskenazi. 2006. Doing Research on a Deployed Spoken Dialogue System: One Year of Let's Go! Experience. In Proceedings of Interspeech 2006.
19. V. Rieser, I. Kruijff-Korbayova, and O. Lemon. 2005. A corpus collection and annotation framework for learning multimodal clarification strategies. In Proceedings of SIGdial 2005.
20. A. Roque, A. Leuski, V. Rangarajan, S. Robinson, A. Vaswani, S. Narayanan, and D. Traum. 2006. Radiobot-cff: A spoken dialogue system for military training. In Proceedings of International Conference on Spoken Language Processing 2006.
21. J. Schatzmann, K. Georgila, and S. Young. 2005. Quantitative Evaluation of User Simulation Techniques for Spoken Dialogue Systems. Proceedings of 6th SIGdial Workshop on Discourse and Dialogue.
22. S. P. Singh, M. J. Kearns, D. J. Litman, and M. A. Walker. 2000. Empirical Evaluation of a Reinforcement Learning Spoken Dialogue System. Proceedings of the Seventeenth National Conference on Artificial Intelligence and Twelfth Conference on Innovative Applications of Artificial Intelligence.
23. S. Tomko and R. Rosenfeld. 2006. Shaping user input in speech graffiti: a first pass. CHI Extended Abstracts.
24. M. Turunen, J. Hakulinen and A. Kainulainen. 2006. Evaluation of a Spoken Dialogue System with Usability Tests and Long-term Pilot Studies: Similarities and Differences. In Proceedings of Interspeech 2006.
25. M. Walker, J. Aberdeen, J. Boland, E. Bratt, J. Garofolo, L. Hirschman, A. Le, S. Lee, S. Narayanan, K. Papineni, B. Pellom, J. Polifroni, A. Potamianos, P. Prabhu, A. Rudnicky, G. Sanders, S. Seneff, D. Stallard, and S. Whittaker. 2001. DARPA Communicator dialog travel planning systems: The June 2000 data collection. In Proc. EUROSPEECH.
26. M. A. Walker, C. A. Kamm, and D. J. Litman. 2000. Towards Developing General Models of Usability with PARADISE. In Natural Language Engineering, Vol. 6, No. 3.