Practical use of non-local features for statistical spoken language understanding

Computer Speech and Language

Volumn 22, Issue 2, 2008, Pages 148-170

  Jeong, Minwoo ^a   Lee, Gary Geunbae ^a  

^a Pohang University of Science and Technology (POSTECH)   (South Korea)

Author keywords

Feature induction; Long distance dependency; Non local features; Spoken language understanding

Indexed keywords

ALGORITHMS; ENCODING (SYMBOLS); PARAMETER ESTIMATION; PROBLEM SOLVING; STATISTICAL METHODS;

FEATURE INDUCTION; LONG-DISTANCE DEPENDENCY; NON-LOCAL FEATURES; SPOKEN LANGUAGE UNDERSTANDING;

SPEECH RECOGNITION;

EID: 35548931640     PISSN: 08852308     EISSN: 10958363     Source Type: Journal    
DOI: 10.1016/j.csl.2007.07.001     Document Type: Article

References (51)

1. Bunescu, R., Mooney, R., 2004. Collective information extraction with relational markov networks. In: Proceedings of the Conference of the Association for Computational Linguistics (ACL), pp. 439-446.
2. Charniak, E., Johnson, M., 2005. Coarse-to-fine n-best parsing and maxent discriminative reranking. In: Proceedings of the Conference of the Association for Computational Linguistics (ACL), Ann Arbor, MI, pp. 363-370.
3. Chieu, H.L., Ng, H.T., 2002. Named entity recognition: a maximum entropy approach using global features. In: Proceedings of the International Conference on Computational Linguistics (COLING), pp. 190-196.
4. Cohen, W.W., de Carvalho, V.R., 2005. Stacked sequential learning. In: Proceedings of the International Joint Conference of Artificial Intelligence (IJCAI), pp. 671-676.
5. Collins, M., 1999. Head-driven statistical models for natural language parsing. Technical Report, University of Pennsylvania.
6. DauméIII, H., 2006. Practical structured learning techniques for natural language processing. Technical Report, Los Angeles, CA.
7. Della Pietra S., Della Pietra V., and Lafferty J. Inducing features of random fields. IEEE Transactions on Pattern Analysis and Machine Intelligence 19 4 (1997) 380-393
8. Dempster A.P., Laird N.M., and Rubin D.B. Maximum likelihood from incomplete data via the em algorithm (with discussion). Journal of the Royal Statistical Society B 39 (1977) 1-38
9. Dietterich, T.G., 2002. Machine learning for sequential data: a review. In: Caelli, T. (Ed.) Structural, Syntactic, and Statistical Pattern Recognition; Lecture Notes in Computer Science, vol. 2396, pp. 15-30.
10. Dowding, J., Gawron, J.M., Appelt, D.E., Bear, J., Cherny, L., Moore, R., Moran, D.B., 1993. Gemini: a natural language system for spoken-language understanding. In: Proceedings of the Conference of the Association for Computational Linguistics (ACL), pp. 54-61.
11. Fellbaum C. Wordnet: An Electronic Lexical Database (1998), MIT Press, Cambridge, MA
12. Fine S., Singer Y., and Tishby N. The hierarchical hidden markov model: analysis and applications. Machine Learning 32 1 (1998) 41-62
13. Finkel, J.R., Grenager, T., Manning, C., 2005. Incorporating non-local information into information extraction systems by gibbs sampling. In: Proceedings of the Conference of the Association for Computational Linguistics (ACL), Ann Arbor, MI, pp. 363-370.
14. Gildea D., and Jurafsky D. Automatic labeling of semantic roles. Computational Linguistics 28 3 (2002) 245-288
15. Gillick, L., Cox, S., 1989. Some statistical issues in the comparison of speech recognition algorithms. In: Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 532-535.
16. Hakkani-Tur D., Bechet F., Riccardi G., and Tur G. Beyond asr 1-best: using word confusion networks in spoken language understanding. Computer Speech & Language 20 4 (2006) 495-514
17. He Y., and Young S. Semantic processing using the hidden vector state model. Computer Speech & Language 19 1 (2005) 85-106
18. Jeong, M., Lee, G.G., 2006. Exploiting non-local features for spoken language understanding. In: Proceedings of the Joint International Conference on Computational Linguistics and Association of Computational Linguistics (COLING/ACL), Sydney, Australia, pp. 412-419.
19. Lafferty, J., McCallum, A., Pereira, F., 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In: Proceedings of the International Conference on Machine Learning (ICML), pp. 282-289.
20. Levin, E., Pieraccini, R., 1995. Chronus, the next generation. In: Proceedings of ARPA Spoken Language Systems Technical Workshop, Austin, TX, pp. 269-271.
21. Malouf, R., 2002. A comparison of algorithms for maximum entropy parameter estimation. In: Proceedings of the Conference on Natural Language Learning (CoNLL), pp. 49-55.
22. McCallum, A., 2003. Efficiently inducing features of conditional random fields. In: Proceedings of the Conference on Uncertainty in Artificial Intelligence (UAI), p. 403.
23. McDonald R., and Pereira F. Identifying gene and protein mentions in text using conditional random fields. BMC Bioinformatics 6 Suppl. 1 (2005)
24. MUC7, 1998. In: Proceedings of the 7th Message Understanding Conference (muc-7). Available from: .
25. Nocedal J., and Wright S.J. Numerical Optimization (1999), Springer, New York
26. Peckham, J., 1991. Speech understanding and dialogue over the telephone: an overview of the esprit sundial project. In: DARPA Speech and Natural Language Workshop, Pacific Grove, CA.
27. Pellom, B.L., Ward, W., Pradhan, S. S., 2000. The CU communicator: an architecture for dialogue systems. In: Proceedings of the International Conference on Spoken Language Processing (ICSLP).
28. Peng, F., McCallum, A., 2004. Accurate information extraction from research papers using conditional random fields. In: Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics and Human Language Technology (NAACL/HLT), pp. 329-336.
29. Pinto, D., McCallum, A., Lee, X., Croft, W., 2003. Table extraction using conditional random fields. In: Proceedings of the Conference on Research and Developments in Information Retrieval (SIGIR).
30. Price, P.J., 1990. Evaluation of spoken language systems: the atis domain. In: DARPA Speech and Natural Language Workshop, Hidden Valley, PA.
31. Rabiner L.R. A tutorial on hidden markov models and selected applications in speech recognition. Proceedings of the IEEE 77 2 (1989) 257-286
32. Ramshaw, L.A., Marcus, M.P., 1995. Text chunking using transformation-based learning. In: Proceedings of 3rd Workshop on Very Large Corpora, pp. 82-94.
33. Raymond R., Bechet F., Mori R.D., and Damnati G. On the use of finite state transducers for semantic interpresentation. Speech Communication 48 3-4 (2006) 288-304
34. Rosenfeld, R., 1994. Adaptive statistical language modeling: a maximum entropy approach.
35. Sarawagi, S., Cohen, W., 2004. Semi-markov conditional random fields for information extraction. In: Proceedings of the International Conference on Machine Learning (ICML).
36. Schapire, R., Rochery, M., Rahim, M., Gupta, N., 2002. Incorporating prior knowledge into boosting. In: Proceedings of the International Conference on Machine Learning (ICML).
37. Schwartz, R., Miller, S., Stallard, S., Makhoul, J., 1997. Hidden understanding models for statistical sentence understanding. In: Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Washington, DC, USA.
38. Seneff S. Tina: a natural language system for spoken language applications. Computational Linguistics 18 1 (1992) 61-86
39. Sha, F., Pereira, F., 2003. Shallow parsing with conditional random fields. In: Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics and Human Language Technology (NAACL/HLT).
40. Sutton, C., McCallum, A., 2004. Collective segmentation and labeling of distant entities in information extraction. In: Workshop on Statistical Relational Learning at ICML, Banff, Canada.
41. Sutton C., and McCallum A. An Introduction to Conditional Random Fields for Relational Learning (2006), MIT Press, Cambridge, MA
42. Taskar, B., Abbeel, P., Koller, D., 2002. Discriminative probabilistic models for relational data. In: Proceedings of the Conference on Uncertainty in Artificial Intelligence (UAI), Edmonton, Canada, pp. 485-494.
43. Taskar, B., Guestrin, C., Koller, D., 2003. Max-margin markov networks. In: Proceedings of the Advances in Neural Information Processing Systems (NIPS).
44. Tsochantaridis, I., Hofmann, T., Joachims, T., Altun, Y., 2004. Support vector learning for interdependent and structured output spaces. In: Proceedings of the International Conference on Machine Learning (ICML).
45. Tur G., Hakkani-Tur D., and Schapire R.E. Combining active and semi-supervised learning for spoken language understanding. Speech Communication 45 2 (2005) 171-186
46. Walker, M., Rudnicky, A., Prasad, R., Aberdeen, J., Bratt, E., Garofolo, J., Hastie, H., Le, A., Pellom, B., Potamianos, A., Passonneau, R., Roukos, S., Sanders, G., Seneff, S., Stallard, D., 2002. Darpa communicator: Cross-system results for the 2001 evaluation. In: Proceedings of the International Conference on Spoken Language Processing (ICSLP).
47. Wang Y., Deng L., and Acero A. Spoken language understanding: an introduction to the statistical framework. IEEE Signal Processing Magazine 22 5 (2005) 16-31
48. Wang, Y., Lee, J., Mahajan, M., Acero, A., December 2005b. Statistical spoken language understanding: from generative model to conditional model. In: Workshop on Advances in Structured Learning for Text and Speech Processing at NIPS.
49. Ward, W., 1990. The cmu air travel information service: understanding spontaneous speech. In: Proceedings of ARPA Spoken Language Systems Technical Workshop, pp. 127-129.
50. Ward, W., Pellom, B., 1999. The CU-communicator system. In: Proceedings of IEEE Workshop on Automatic Speech Recognition and Understanding.
51. Young, S., Evermann, G., Gales, M., Hain, T., Kershaw, D., Moore, G., Ollason, J.O. D., Povey, D., Valtchev, V., Woodland, P., 2005. The htk book: version 3.3. Technical Report, Cambridge University, UK. Avilable from: .