An active approach to spoken language processing

ACM Transactions on Speech and Language Processing

Volumn 3, Issue 3, 2006, Pages 1-31

  Hakkani Tür, Dilek ^a,b   Riccardi, Giuseppe ^a,c   Tur, Gokhan ^a,d  

^a AT AND T LABS RESEARCH   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c UNIVERSITY OF TRENTO   (Italy)

^d SRI INTERNATIONAL   (United States)

Author keywords

Active evaluation; Active learning; Adaptive learning; Automatic speech recognition; Passive learning; Speech and language processing; Spoken dialog systems; Spoken language understanding; Unsupervised learning

Indexed keywords

ADAPTIVE SYSTEMS; DATA ACQUISITION; EVALUATION; LEARNING SYSTEMS; SPEECH ANALYSIS; SPEECH RECOGNITION;

AUTOMATIC SPEECH RECOGNITION; PASSIVE LEARNING; SPOKEN DIALOG SYSTEMS; SPOKEN LANGUAGE UNDERSTANDING; UNSUPERVISED LEARNING;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 33750924974     PISSN: 15504875     EISSN: 15504883     Source Type: Journal    
DOI: 10.1145/1177055.1177056     Document Type: Article

References (56)

1. ABNEY, S., SCHAPIRE, R., AND SINGER, Y. 1999. Boosting applied to tagging and PP attachment. In Proceedings of the Joint SIGDAT Conference on Empirical Methods in Natural Language Processing (EMNLP) and Very Large Corpora (College Park, MD). ACM, New York.
2. ANOLUIN, D. 1988. Queries and concept learning. Mach. Learn. 2, 319-342.
3. ARGAMON-ENGELSON, S. AND DAGAN, I. 1999. Committee-based sample selection for probabilistic classifiers. J. Artif. Intel. Res. 11, 335-360.
4. BACCHIANI, M. AND ROARK, B. 2003. Unsupervised language model adaptation. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP) (Hong Kong).
5. BALDRIDGE, J. AND OSBORNE, M. 2003. Active learning for HPSG parse selection. In Proceedings of the Conference on Computational Natural Language Learning (CoNLL) (Edmonton, BC, Canada).
6. BLUM, A. AND MITCHELL, T. 1998. Combining labeled and unlabeled data with co-training. In Proceedings of the Workshop on Computational Learning Theory (COLT). Madison, WI.
7. COHN, D., ATLAS, L., AND LADNER, R. 1994. Improving generalization with active learning. Mach. Learn. 15, 201-221.
8. DIGALAKIS, V., RTISCHEV, D., AND NEUMEYEH, L. G. 1995. Speaker adaptation using constrained estimation of gaussian mixtures. IEEE Trans. Speech Audio Process. 3, 5, 357-366.
9. ESKIN, E. 2000. Detecting errors within a corpus using anomaly detection. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics (NAACL) (Seattle, WA).
10. FEDERICO, M. 1996. Bayesian estimation methods for n-gram language model adaptation. In Proceedings of the International Conference on Spoken Language Processing (ICSLP) (Philadelphia, PA).
11. FREUND, Y., SEUNG, H. S., SHAMIR, E., AND TISHBY, N. 1997. Selective sampling using the query by committee algorithm. Mach. Learn. 28, 133-168.
12. GHANI, R. 2002. Combining labeled and unlabeled data for multiclass text categorization. In Proceedings of the International Conference on Machine Learning (ICML) (Sydney, Australia).
13. GODFREY, J. J., HOLLIMAN, E. C., AND MCDANIEL, J. 1990. Switchboard: Telephone speech corpus for research and development. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP) (Albuquerque, NM).
14. GORIN, A. L., ABELLA, A., ALONSO, T., RICCARDI, G., AND WRIGHT, J. H. 2002. Automated natural spoken dialog. IEEE Comput. Mag. 35, 4 (Apr.), 51-56.
15. GRETTER, R. AND RICCARDI, G. 2001. On-line learning of language models with word error probability distributions. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP) (Salt Lake City, UT).
16. HAKKANI-TÜR, D. AND RICCARDI, G. 2003. A general algorithm for word graph matrix decomposition. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP) (Hong Kong).
17. HAKKANI-TÜR, D., RICCARDI, G., AND GORIN, A. 2002. Active learning for automatic speech recognition. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP) (Orlando, FL).
18. HAKKANI-TÜR, D., TUR, G., RAHIM, M., AND RICCARDI, G. 2004. Unsupervised and active learning in automatic speech recognition for call classification. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP) (Motreal, Ont., Canada).
19. HENDRICKX, I., VAN DER BOSCH, A., HOSTE, V., AND DAELEMANS, W. 2002. Dutch word sense disambiguation. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL) Workshop on Word Sense Disambiguation (Philadelphia, PA).
20. HUANG, X., ACEHO, A., AND HON, H.-W. 2001. Spoken Language Processing. Prentice-Hall, Upper Saddle River, NJ.
21. IYER, R., GISH, H., AND MCCARTHY, D. 2002. Unsupervised training techniques for natural language call routing. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP) (Orlando, FL).
22. JELINEK, F. 1997. Statistical Methods for Speech Recognition. MIT Press, Cambridge, MA.
23. KEARNS, M. 1993. Efficient noise-tolerant learning from statistical queries. In Proceedings of the ACM Symposium on Theory of Computing (San Diego, CA). ACM, New York.
24. KUO, J., LEE, C., ZITOUNI, I., FOSLER-LUSSER, E., AND AMMICHT, E. 2002. Discriminative training for call classification and routing. In Proceedings of the International Conference on Spoken Language Processing (ICSLP) (Denver, CO).
25. LEGGETTER, C. AND WOODLAND, P. 1995a. Maximum likelihood linear regression for speaker adaptation of continuous density hidden markov models. Comput. Speech Lang. 9, 2, 171-185.
26. LEGGETTER, M. AND WOODLAND, P. 1995b. Flexible speaker adaptation using maximum likelihood linear regression. In Proceedings of ARPA Spoken Language Technology Workshop (Austin, TX).
27. LEWIS, D. D. AND CATLETT, J. 1994. Heterogeneous uncertainty sampling for supervised learning. In Proceedings of the International Conference on Machine Learning (ICML) (New Brunswick, NJ).
28. LIBRE, R. AND TADEPALLI, P. 1997. Active learning with committees for text categorization. In Proceedings of the Conference of the American Association for Artificial Intelligence (AAAI) (Providence, RI).
29. MARCUS, M. P., SANTORINI, B., AND MARCINKIEWICZ, M. A. 1993. Building a large annotated corpus of English: The Penn Treebank. Computat. Ling. 19, 313-330.
30. MCCALLUM, A. K. AND NIGAM, K. 1998. Employing EM and pool-based active learning for text classification. In Proceedings of the International Conference on Machine Learning (ICML) (Madison, WI).
31. MURATA, M., UTIYAMA, M., UCHIMOTO, K., MA, Q., AND ISAHARA, H. 2002. Correction of errors in a modality corpus used for machine translation using machine-learning. In Proceedings of the TMI (Japan).
32. MUSLEA, I., MINTON, S., AND KNOBLOCK, C. A. 2002. Active + semi-supervised learning = robust multi-view learning. In Proceedings of the International Conference on Machine Learning (ICML) (Sydney, Australia).
33. NATARAJAN, P., PRASAD, R., SUHM, B., AND MCCARTHY, D. 2002. Speech enabled natural language call routing: BBN call director. In Proceedings of the International Conference on Spoken Language Processing (ICSLP) (Denver, CO).
34. NIGAM, K. AND GHANI, R. 2000. Analyzing the effectiveness and applicability of co-training. In Proceedings of the International Conference on Information and Knowledge Management (CIKM) (McLean, VA).
35. NIGAM, K., MCCALLUM, A., THRUN, S., AND MITCHELL, T. 2000. Text classification from labeled and unlabeled documents using EM. Mach. Lear. 39, 2/3, 103-134.
36. PRICE, P. J. 1990. Evaluation of spoken language systems: The ATIS domain. In Proceedings of the DARPA Workshop on Speech and Natural Language (Hidden Valley, PA).
37. REUTERS. 2004. http://www.daviddlewis.com/resources/testcollections/ reuters21578.
38. RICCARDI, G. AND GORIN, A. L. 2000. Stochastic language adaptation over time and state in a natural spoken dialog system. IEEE Trans. Speech and Audio Processing 8, 1, 3-9.
39. RICCARDI, G. AND HAKKANI-TÜR, D. 2003. Active and unsupervised learning for automatic speech recognition. In Proceedings of the European Conference on Speech Communication and Technology (EURO-SPEECH) (Geneva, Switzerland).
40. RICCARDI, G. AND HAKKANI-TÜR, D. 2005. Active learning: Theory and applications to automatic speech recognition. IEEE Trans. Speech Audio Process. 13, 4, 504-511.
41. SASSANO, M. 2002. An empirical study of active learning with support vector machines for Japanese word segmentation. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL). Philadelphia, PA.
42. SCHAPIRE, R. E. 2001. The boosting approach to machine learning: An overview. In Proceedings of the MSRI Workshop on Nonlinear Estimation and Classification (Berkeley, CA).
43. SCHAPIHE, R. E. AND SINGEE, Y. 1999. Improved boosting algorithms using confidence-rated predictions. Mach. Learn. 37, 3, 297-336.
44. SCHAPIRE, R. E. AND SINGER, Y. 2000. Boostexter: A boosting-based system for text categorization. Mach. Learn. 39, 2/3, 135-168.
45. SCHOHN, G. AND COHN, D. 2000. Less is more: Active learning with support vector machines. In Proceedings of the International Conference on Machine Learning (ICML) (Palo Alto, CA).
46. SEUNG, H. S., OPPER, M., AND SOMPOLINSKY, H. 1992. Query by committee. In Proceedings of the Workshop on Computational Learning Theory (COLT) (Pittsburgh, PA).
47. TANG, M., Luo, X., AND ROUKOS, S. 2002. Active learning for statistical natural language parsing. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL) (Philadelphia, PA).
48. THOMPSON, C., CALIFF, M. E., AND MOONEY, R. J. 1999. Active learning for natural language parsing and information extraction. In Proceedings of the International Conference on Machine Learning (ICML) (Bled, Slovenia).
49. TONG, S. AND KOLLER, D. 2001. Support vector machine active learning with applications to text classification. J. Mach. Learn. Res. 2, 45-66.
50. TUB, G. AND HAKKANI-TÜR, D. 2003. Exploiting unlabeled utterances for spoken language under-standing. In Proceedings of the European Conference on Speech Communication and Technology (EUROSPEECH) (Geneva, Switzerland).
51. TUB, G., HAKKANI-TÜR, D., AND SCHAPIRE, R. E. 2005. Combining active and semi-supervised learning for spoken language understanding. Speech Commun. 45, 2, 171-186.
52. TUB, G., RAHM, M., AND HAKKANI-TÜR, D. 2003a. Active labeling for spoken language under-standing. In Proceedings of the European Conference on Speech Communication and Technology (EUROSPEECH) (Geneva, Switzerland).
53. TUB, G., SCHAPIBE, R. E., AND HAKKANI-TÜR, D. 2003b. Active learning for spoken language understanding. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP) (Hong Kong).
54. TUR, G., WRIGHT, J., GORIN, A., RICCARDI, G., AND HAKKANI-TÜR, D. 2002. Improving spoken language understanding using word confusion networks. In Proceedings of the International Conference on Spoken Language Processing (ICSLP) (Denver, CO).
55. VAN HALTEREN, H. 2000. The detection of inconsistency in manually tagged text. In Proceedings of the Workshop on Linguistically Interpreted Corpora (Luxembourg).
56. ZAVALIAGKOS, G. AND COLTHUEST, T. 1998. Utilizing untranscribed training data to improve performance. In Proceedings of the Broadcast News Transcription and Understanding Workshop.