Learning the structure of task-driven human-human dialogs

IEEE Transactions on Audio, Speech and Language Processing

Volumn 16, Issue 7, 2008, Pages 1249-1259

  Bangalore, Srinivas ^a   Di Fabbrizio, Giuseppe ^a   Stent, Amanda ^a  

^a AT AND T LABS RESEARCH   (United States)

Author keywords

Dialog systems; Language generation; Language understanding; Prediction and classification

Indexed keywords

CATALOG SERVICES; CLASSIFICATION ,; DATA-DRIVEN; DIALOG MODELS; DIALOG SYSTEMS; HUMAN-COMPUTER; LANGUAGE GENERATION; LANGUAGE UNDERSTANDING; PREDICTION AND CLASSIFICATION; TASK STRUCTURE; TASK-DRIVEN; USE-MODEL;

COMPUTER APPLICATIONS; SOFTWARE AGENTS;

LINGUISTICS;

EID: 70350454879     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2008.2001102     Document Type: Article

References (62)

1. K. Lochbaum, "A collaborative planning model of intentional structure, " Comput. Linguist., vol. 24, no. 4, pp. 525-572, 1998.
2. B. Grosz and C. Sidner, "Attention, intentions and the structure of discoursep, " Comput. Linguist., vol. 12, no. 3, pp. 175-204, 1986.
3. C. Sidner, "Plan parsing for intended response recognition in discourse, " Comput. Intell., vol. 1, no. 1, pp. 1-10, 1985.
4. D. Litman and J. F. Allen, "A plan recognition model for subdialogs in conversations, " Cogn. Sci., vol. 11, no. 2, pp. 163-200, 1987.
5. C. Rich and C. Sidner, "COLLAGEN: When agents collaborate with people, " in Proc. 1st Int. Conf. Autonomous Agents, 1997, pp. 284-291.
6. C. Rich and C. Sidner, "COLLAGEN: When agents collaborate with people, " in Proc. 1st Int. Conf. Autonomous Agents, 1997, pp. 284-291.
7. S. Carberry, "Techniques for plan recognition, " User Modeling and User-Adapted Interaction, vol. 11, no. 1-2, pp. 31-48, 2001.
8. D. Bohus and A. Rudnicky, "RavenClaw: Dialog management using hierarchical task decomposition and an expectation agenda, " in Proc. Eurospeech, 2003, pp. 31-48.
9. H. Bui, "A general model for online probabalistic plan recognition, " in Proc. Int. Joint Conf. Artif. Intell., 2003.
10. N. Blaylock and J. F. Allen, "Hierarchical instantiated goal recognition, " in Proc. AAAI Workshop Modeling Others From Observations, 2006, pp. 1309-1318.
11. J. Alexandersson and N. Reithinger, "Learning dialogue structures from a corpus, " in Proc. Eurospeech, 1997, pp. 8-15.
12. D. Pynadath and M. Wellman, "Probabilistic state-dependent grammars for plan recognition, " in Proc. 16th Conf. Uncertainty Artif. Intell., 2000, pp. 2231-2234.
13. M. Purver, P. Ehlen, and J. Niekrasz, "Detecting action items in multi-party meetings: Annotation and initial experiments, " in Proc. Joint Workshop Multimodal Interaction Related Mach. Learn. Algorithms, 2006, pp. 507-514.
14. W. Morgan, P. Chang, S. Gupta, and J. Brenier, "Automatically detecting action items in audio meeting recordings, " in Proc. SIGdial Workshop Discourse Dialogue, 2006, pp. 200-211.
15. C. Lewis and G. Di Fabbrizio, "Prompt selection with reinforcement learning in an AT&T call routing application, " in Proc. 9th Int. Conf. Spoken Lang. Process., 2006, pp. 96-103.
16. C. Lewis and G. D. Fabbrizio, "Dialogue strategy optimization with reinforcement learning in an AT&T call routing application, " in Proc. AAAI Workshop Statist. Empirical Approaches Spoken Dialogue Syst., 2006, pp. 1770-1773.
17. S. Larsson and D. Traum, "Information state and dialogue management in the TRINDI dialogue move engine toolkit, " Natural Lang. Eng. Special Issue Best Practice Spoken Lang. Dialogue Syst. Eng., vol. 6, no. 3-4, pp. 323-340, 2000.
18. J. Bos, E. Klein, O. Lemon, and T. Oka, "DIPPER: Description and formalisation of an information-state update dialogue system architecture, " in Proc. SIGdial Workshop Discourse and Dialogue, 2003, pp. 232-340.
19. O. Lemon and A. Gruenstein, "Multithreaded context for robust conversational interfaces: Context-sensitive speech recognition and interpretation of corrective fragments, " ACMTrans. Comput.-Human Interaction, vol. 11, no. 3, pp. 115-124, 2004.
20. E. Levin and R. Pieraccini, "A stochastic model of computer-human interaction for learning dialogue strategies, " in Proc. Eurospeech, 1997, pp. 241-267.
21. K. Scheffler and S. Young, "Automatic learning of dialogue strategy using dialogue simulation and reinforcement learning, " in Proc. Human Lang. Technol. Conf., 2002, pp. 1883-1886.
22. S. Singh et al., "Optimizing dialogue management with reinforcement learning: Experiments with the NJFun system, " J. Artif. Intell. Res., vol. 16, pp. 105-133, 2002.
23. J. Williams, P. Poupart, and S. Young, "Partially observable Markov decision processes with continuous observations for dialogue management, " in Proc. SIGdial Workshop Discourse and Dialogue, 2005, pp. 105-133.
24. J. Williams and S. Young, "Partially observable Markov decision processes for spoken dialog systems, " Comput. Speech Lang., vol. 21, no. 2, pp. 393-422, 2007.
25. J. Henderson, O. Lemon, and K. Georgila, "Hybrid reinforcement/supervised learning for dialogue policies fromCOMMUNICATOR data, " in Proc. 4th IJCAI Workshop Knowledge and Reasoning in Practical Dialogue Syst., 2005, pp. 393-422.
26. K. Georgila, O. Lemon, and J. Henderson, "Automatic annotation of COMMUNICATOR dialogue data for learning dialogue strategies and user simulations, " in Proc. DIALOR, 2005, pp. 68-75.
27. M. Frampton and O. Lemon, "Reinforcement learning of dialogue strategies using the user's last dialogue act, " in Proc. 4th IJCAI Workshop Knowledge and Reasoning in Practical Dialogue Syst., 2005, pp. 61-68.
28. M. McTear, "Modelling spoken dialogues with state transition diagrams: Experiences with the CSLU toolkit, " in Proc. ICSLP, 1998, pp. 83-90.
29. M. Core, "Analyzing and predicting patterns of DAMSL utterance tags, " in Proc. AAAI Spring Symp. Applying Mach. Learn. Discourse Process., 1998, pp. 1223-1226.
30. J. Chu-Carroll, "A statistical model for discourse act recognition in dialogue interactions, " in Proc. AAAI Spring Symp. Applying Mach. Learn. Discourse Process., 1998, pp. 18-24.
31. N. Reithinger and M. Klesen, "Dialogue act classification using language models, " in Proc. Eurospeech, 1997, pp. 12-17.
32. K. Samuel, S. Carberry, and K. Vijay-Shanker, "Computing dialogue acts from features with transformation-based learning, " in Proc. AAAI Spring Symp. Applying Mach. Learn. Discourse Process., 1998, pp. 2235-2238.
33. M. Poesio and A. Mikheev, "The predictive power of game structure in dialogue act recognition: Experimental results using maximum entropy estimation, " in Proc. Int. Conf. Spoken Lang. Process., 1998, pp. 90-97.
34. H. W. Hastie, M. Poesio, and S. Isard, "Automatically predicting dialogue structure using prosodic features, " Speech Commun., vol. 36, no. 1-2, pp. 63-79, 2002.
35. R. Serafin and B. D. Eugenio, "FLSA: Extending latent semantic analysis with features for dialogue act classification, " in Proc. Meeting Assoc. Comput. Linguist.., 2004, pp. 63-79.
36. D. Surendran and G.-A. Levow, "Dialog act tagging with support vector machines and hidden Markov models, " in Proc. Int. Conf. Spoken Lang. Process., 2006, pp. 692-699.
37. D. Jurafsky et al., "SwitchBoard discourse language modeling project report, " Center for Speech and Lang. Process., Johns Hopkins Univ., Baltimore, MD, Tech. Rep. Res. Note 30, 1998.
38. A. Stolcke et al., "Dialogue act modeling for automatic tagging and recognition of conversational speech, " Comput. Linguist.., vol. 26, no. 3, pp. 339-373, 2000.
39. N. Webb, M. Hepple, and Y. Wilks, "Dialogue act classification based on intra-utterance features, " in Proc. AAAI 2005 Workshop Spoken Lang. Understanding, 2005, pp. 339-373.
40. J. Ang, Y. Liu, and E. Shriberg, "Automatic dialog act segmentation and classification in multiparty meetings, " in Proc. Int. Conf. Acoust., Speech, Signal Process., 2005, pp. 46-51.
41. G. Ji and J. Bilmes, "Backoff model training using partially observed data: Application to dialog act tagging, " in Proc. Joint Meeting North Amer. Chapt. Assoc. Comput. Linguist.. Human Lang. Technol. Conf., 2006, pp. 1061-1064.
42. D. Verbree, R. Rienks, and D. Heylen, "Dialogue-act tagging using smart feature selection: Results on multiple corpora, " in Proc. IEEE/ACL Workshop Spoken Lang. Technol., 2006, pp. 280-287.
43. R. Prasad and M. Walker, "Training a dialogue act tagger for human-human and human-computer travel dialogues, " in Proc. SIGdial Workshop Discourse and Dialogue, 2002, pp. 70-73.
44. M. A.Walker, R. Passonneau, and J. E. Boland, "Quantitative and qualitative evaluation of DARPACommunicator spoken dialogue systems, " in Proc. Meeting Assoc. Comput. Linguist., 2001.
45. H. W. Hastie, R. Prasad, and M.Walker, "Automatic evaluation: Using a DATE dialogue act tagger for user satisfaction and task completion prediction, " in Proc. Lang. Resources Eval. Conf., 2002, pp. 641-648.
46. H. Hardy et al., "Data-driven strategies for an automated dialogue system, " in Proc. Meeting of the Association for Comput. Linguist.., 2004, pp. 71-78.
47. A. Chotimongkol, "Learning the structure of task-oriented conversations from the corpus of in-domain dialogs, " Ph.D. dissertation, Carnegie Mellon Univ., Pittsburgh, PA, 2008.
48. J. Bear, J. Dowding, and E. Shriberg, "Integrating multiple knowledge sources for detection and correction of repairs in human-computer dialog, " in Proc. Meeting Assoc. Comput. Linguist., 1992, pp. 56-63.
49. S. Seneff, "A relaxation method for understanding spontaneous speech utterances, " in Proc. Speech Natural Lang. Workshop, San Mateo, CA, 1992, pp. 299-304.
50. E. Shriberg et al., "Prosody-based automatic segmentation of speech into sentences and topics, " Speech Commun., vol. 32, no. 1-2, pp. 127-154, 2000.
51. E. Charniak and M. Johnson, "Edit detection and parsing for transcribed speech, " in Proc. Conf. North Amer. Chapt. Assoc. Comput. Linguist., 2001, pp. 1-9.
52. S. Bangalore and N. Gupta, "Extracting clauses in dialogue corpora: Application to spoken language understanding, " J. Traitement Automatique des Langues (TAL), vol. 45, no. 2, pp. 159-181, 2004.
53. S. Bangalore and A. K. Joshi, "Supertagging: An approach to almost parsing, " Comput. Linguist.., vol. 25, no. 2, pp. 237-265, 1999.
54. A. K. Joshi, "An introduction to tree adjoining grammars, " in Math. Lang., A. Manaster-Ramer, Ed. Amsterdam, The Netherlands: John Benjamins, 1987.
55. J. Carletta et al., "The reliability of a dialog structure coding scheme, " Comput. Linguist.., vol. 23, no. 1, pp. 13-31, 1997.
56. A. Stent, S. Bangalore, and G. D. Fabrizzio, "Where do the words come from? Learning models for lexical selection and word ordering from spoken dialog corpora, " in Proc. Int. Conf. Acoust., Speech, Signal Process., 2008, pp. 5037-5040.
57. A. Berger, S. Pietra, and V. Pietra, "A maximum entropy approach to natural language processing, " Comput. Linguist.., vol. 22, no. 1, pp. 39-71, 1996.
58. P. Haffner, "Scaling large margin classifiers for spoken language understanding, " Speech Commun., vol. 48, no. IV, pp. 239-261, 2006.
59. J. Nivre and M. Scholz, "Deterministic dependency parsing of English text, " in Proc. COLING, 2004, pp. 64-70.
60. K. Sagae and A. Lavie, "A classifier-based parser with linear run-time complexity, " in Proc. Int. Workshop Parsing Technol., 2005, pp. 125-132.
61. H. Yamada and Y. Matsumoto, "Statistical dependency analysis with support vector machines, " in Proc. Int. Workshop Parsing Technol., 2003, pp. 195-206.
62. F. Keller, S. Clark, M. Crocker, and M. Steedman, in Proc. ACL Workshop Incremental Parsing: Bringing Eng. Cognition Together, 2004, Assoc. Comput. Linguist..