Multi-domain spoken language understanding with transfer learning

Speech Communication

Volumn 51, Issue 5, 2009, Pages 412-424

  Jeong, Minwoo ^a   Lee, Gary Geunbae ^a  

^a Pohang University of Science and Technology (POSTECH)   (South Korea)

Author keywords

Multi domain dialog system; Spoken language understanding; Transfer learning; Triangular chain structure model

Indexed keywords

EDUCATION; INFORMATION THEORY; LINGUISTICS;

BASELINE MODELS; DATA SOURCES; MULTI-DOMAIN DIALOG SYSTEM; MULTIPLE DOMAINS; SEMANTIC TAGGING; SPOKEN LANGUAGE UNDERSTANDING; STRUCTURED MODELS; TARGET DOMAINS; TRANSFER LEARNING; TRIANGULAR-CHAIN STRUCTURE MODEL;

SPEECH RECOGNITION;

EID: 61749090403     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2009.01.001     Document Type: Article

References (34)

1. Ammicht, E., Gorin, A., Alonso, T., 1999. Knowledge collection for natural language spoken dialog systems. In: Proc. European Conf. on Speech Communication and Technology (Eurospeech), Budapest, Hungary, pp. 1375-1378.
2. Caruana R. Multitask learning. Machine Learning 28 1 (1997) 41-75
3. Chung, G., Seneff, S., Hetherington, L., 1999. Towards multi-domain speech understanding using a two-stage recognizer. In: Proc. European Conf. on Speech Communication and Technology (Eurospeech), Budapest, Hungary, pp. 2655-2658.
4. Cohn, T., 2006. Efficient inference in large conditional random fields. In: Proc. European Conf. on Machine Learning (ECML), pp. 606-613.
5. Collins, M., 2002. Discriminative training methods for hidden markov models: theory and experiments with perceptron algorithms. In: Proc. Conf. on Empirical Methods in Natural Language Processing (EMNLP), pp. 1-8.
6. Crammer K., Dekel O., Keshet J., Shalev-Shwartz S., and Singer Y. Online passive-aggressive algorithms. J. Machine Learning Res. 7 (2006) 551-585
7. Daumé III, H., 2007. Frustratingly easy domain adaptation. In: Proc. Conf. on the Association for Computational Linguistics (ACL), Prague, Czech Republic, pp. 256-263.
8. Daumé III, H., Marcu, D., 2005. Learning as search optimization: approximate large margin methods for structured prediction. In: Proc. Internat. Conf. on Machine Learning (ICML), pp. 169-176.
9. Daumé III H., and Marcu D. Domain adaptation for statistical classifiers. J. Artif. Intell. Res. 26 (2006) 101-126
10. De Mori R., Béchet F., Hakkani-Tür D., McTear M., Riccardi G., and Tur G. Spoken language understanding for conversational systems. Signal Process. Magaz. Special Issue Spoken Language Technol. 25 3 (2008) 50-58
11. Dredze, M., Crammer, K., Pereira, F., 2008. Confidence-weighted linear classification. In: Proc. Internat. Conf. on Machine Learning (ICML), pp. 264-271.
12. Gildea D., and Jurafsky D. Automatic labeling of semantic roles. Comput. Linguist. 28 3 (2002) 245-288
13. Gillick, L., Cox, S., 1989. Some statistical issues in the comparison of speech recognition algorithms. In: Proc. IEEE Internat. Conf. on Acoustics, Speech and Signal Processing (ICASSP), pp. 532-535.
14. Gupta N., Tur G., Hakkani-Tür D., Bangalore S., Riccardi G., and Gilbert M. The AT&T spoken language understanding system. IEEE Trans. Audio Speech Language Process. 14 1 (2006) 213-222
15. Hardy H., Biermann A., Inouye R.B., McKenzie A., Strzalkowski T., Ursu C., Webb N., and Wu M. The Amitiés system: data-driven techniques for automated dialogue. Speech Comm. 48 3-4 (2006) 354-373
16. Jeong, M., Lee, G.G., 2006. Exploiting non-local features for spoken language understanding. In: Proc. Joint Internat. Conf. on Computational Linguistics and Association of Computational Linguistics (COLING/ACL), Sydney, Australia, pp. 412-419.
17. Jeong M., and Lee G.G. Triangular-chain conditional random fields. IEEE Trans. Audio Speech Language Process. 16 7 (2008) 1287-1302
18. Komatani K., Ikeda S., Ogata T., and Okuno H.G. Managing out-of-grammar utterances by topic estimation with domain extensibility in multi-domain spoken dialogue systems. Speech Comm. 50 10 (2008) 863-870
19. Lafferty, J., McCallum, A., Pereira, F., 2001. Conditional random fields: probabilistic models for segmenting and labeling sequence data. In: Proc. Internat. Conf. on Machine Learning (ICML), pp. 282-289.
20. Lee, C., Jung, S., Jeong, M., Lee, G.G., 2006. Chat and goal-oriented dialog together: a unified example-based architecture for multi-domain dialog management. In: Proc. IEEE/ACL 2006 Workshop on Spoken Language Technology, pp. 194-197.
21. Moschitti, A., Riccardi, G., Raymond, C., 2007. Spoken language understanding with kernels for syntactic/semantic structures. In: Proc. IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU), Kyoto, Japan.
22. Nocedal J., and Wright S.J. Numerical Optimization (1999), Springer, New York
23. Palmer M., Kingsbury P., and Gildea D. The proposition bank: an annotated corpus of semantic roles. Comput. Linguist. 31 1 (2005) 71-106
24. Peckham, J., 1991. Speech understanding and dialogue over the telephone: an overview of the ESPRIT SUNDIAL Project. In: Proc. Workshop on Speech and Natural Language, Pacific Grove, CA, pp. 14-27.
25. Price, P.J., 1990. Evaluation of spoken language systems: the ATIS domain. In: Proc. Workshop on Speech and Natural Language, Hidden Valley, PA, pp. 91-95.
26. Ramshaw, L.A., Marcus, M.P., 1995. Text chunking using transformation-based learning. In: Proc. of 3rd Workshop on Very Large Corpora, pp. 82-94.
27. Raymond, C., Riccardi, G., 2007. Generative and discriminative algorithms for spoken language understanding. In: Proc. Interspeech, Antwerp, Begium.
28. Sha, F., Pereira, F., 2003. Shallow parsing with conditional random fields. In: Proc. Conf. of the North American Chapter of the Association for Computational Linguistics and Human Language Technology (NAACL/HLT), pp. 134-141.
29. Sutton, C., McCallum, A., 2007. Piecewise pseudolikelihood for efficient CRF training. In: Proc. Internat. Conf. on Machine Learning (ICML), pp. 863-870.
30. Taskar, B., Guestrin, C., Koller, D., 2003. Max-margin markov networks. In: Proc. Advances in Neural Information Processing Systems (NIPS).
31. Tsochantaridis I., Joachims T., Hofmann T., and Altun Y. Large margin methods for structured and interdependent output variables. J. Machine Learning Res. 6 (2005) 1453-1484
32. Tur, G., 2006. Multitask learning for spoken language understanding. In: Proc. IEEE Internat. Conf. on Acoustics, Speech, and Signal Processing (ICASSP), Toulouse, France.
33. Walker, M., Rudnicky, A., Prasad, R., Aberdeen, J., Bratt, E., Garofolo, J., Hastie, H., Le, A., Pellom, B., Potamianos, A., Passonneau, R., Roukos, S., Sanders, G., Seneff, S., Stallard, D., 2002. DARPA communicator: cross-system results for the 2001 evaluation. In: Proc. Internat. Conf. on Spoken Language Processing (ICSLP), pp. 269-272.
34. Wang Y., Deng L., and Acero A. Spoken language understanding: an introduction to the statistical framework. IEEE Signal Process. Magaz. 22 5 (2005) 16-31