Discriminative reranking for spoken language understanding

IEEE Transactions on Audio, Speech and Language Processing

Volumn 20, Issue 2, 2012, Pages 526-539

  Dinarelli, Marco ^a,b   Moschitti, Alessandro ^a   Riccardi, Giuseppe ^a  

^a UNIVERSITY OF TRENTO   (Italy)

^b CNRS   (France)

Author keywords

Kernel methods; machine learning; natural language processing (NLP); spoken language understanding (SLU); stochastic language models; support vector machines (SVMs)

Indexed keywords

KERNEL METHODS; MACHINE-LEARNING; NATURAL LANGUAGE PROCESSING; SPOKEN LANGUAGE UNDERSTANDING; STOCHASTIC LANGUAGE MODELS; SUPPORT VECTOR;

COMPUTATIONAL LINGUISTICS; ENCODING (SYMBOLS); LEARNING ALGORITHMS; NATURAL LANGUAGE PROCESSING SYSTEMS; RANDOM PROCESSES; SPEECH RECOGNITION; STOCHASTIC SYSTEMS; SUPPORT VECTOR MACHINES;

STOCHASTIC MODELS;

EID: 83755174034     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2011.2162322     Document Type: Article

References (62)

1. R. De Mori, F. Bechet, D. Hakkani-Tur, M. McTear, G. Riccardi, and G. Tur, "Spoken language understanding," IEEE Signal Process. Mag., vol. 25, no. 3, pp. 50-58, May 2008. (Pubitemid 351695640)
2. J. Lafferty, A. McCallum, and F. Pereira, "Conditional random fields: Probabilistic models for segmenting and labeling sequence data," in Proc. ICML, 2001, pp. 282-289.
3. M. Jeong and G. G. Lee, "Multi-domain spoken language understanding with transfer learning," Speech Commun., pp. 412-424, 2009.
4. M. Jeong and G. G. Lee, "Exploiting non-local features for spoken language understanding," in Proc. COLING, 2006, pp. 412-419.
5. H. Chieu and H. Ng, "Named entity recognition: A maximum entropy approach using global features," in Proc. COLING, 2002, pp. 190-196.
6. J. Finkel, T. Grenager, and C. Manning, "Incorporating non-local information into information extraction systems by Gibbs sampling," in Proc. ACL, 2005, pp. 363-370.
7. C. Raymond, F. Béchet, R. De Mori, and G. Damnati, "On the use of finite state transducers for semantic interpretation," Speech Commun., pp. 288-304, 2006. (Pubitemid 43207402)
8. V. N. Vapnik, Statistical Learning Theory. New York: Wiley, 1998.
9. J. Shawe-Taylor and N. Cristianini, Kernel Methods for Pattern Analysis. Cambridge, U.K.: Cambridge Univ. Press, 2004.
10. M. Dinarelli, S. Quarteroni, S. Tonelli, A. Moschitti, and G. Riccardi, "Annotating spoken dialogs: From speech segments to dialog acts and frame semantics," in Proc. SRSL Workshop EACL, 2009.
11. M. Dinarelli, A. Moschitti, and G. Riccardi, "Reranking models based on small training data for spoken language understanding," in Proc. EMNLP, 2009, pp. 11-18.
12. M. Dinarelli, A. Moschitti, and G. Riccardi, "Reranking models for spoken language understanding," in Proc. EACL, 2009, pp. 202-210.
13. M. Dinarelli, A. Moschitti, and G. Riccardi, "Concept segmentation and labeling for conversational speech," in Proc. Interspeech, 2009.
14. A. Moschitti, "A study on convolution kernels for shallow semantic parsing," in Proc. ACL'04, 2004.
15. A. Moschitti, "Efficient convolution kernels for dependency and constituent syntactic trees," in Proc. ECML, 2006, pp. 318-329. (Pubitemid 44618842)
16. A. Moschitti, "Making tree kernels practical for natural language learning," in Proc. EACL 2006, 2006.
17. A. Moschitti, D. Pighin, and R. Basili, "Semantic role labeling via tree kernel joint inference," in Proc. CoNLL, 2006.
18. A. Moschitti, "Kernel methods, syntax and semantics for relational text categorization," in Proc. CIKM, 2008.
19. A. Moschitti, D. Pighin, and R. Basili, "Tree kernels for semantic role labeling," Comput. Linguist., pp. 193-224, 2008.
20. A. Moschitti, "Syntactic and semantic kernels for short text pair categorization," in Proc. EACL'09, 2009.
21. D. Dahl, M. Bates, M. Brown, W. Fisher, K. Hunicke-Smith, D. Pallett, C. Pao, A. Rudnicky, and E. Shriberg, "Expanding the scope of the atis task: The atis-3 corpus," in Proc. HLT, 1994, pp. 43-48.
22. H. Bonneau-Maynard, C. Ayache, F. Bechet, A. Denis, A. Kuhn, F. Lefèvre,D.Mostefa,M. Qugnard, S.Rosset, J.Servan, andS. Vilaneau, "Results of the french evalda-media evaluation campaign for literal understanding," in Proc. LREC, 2006, pp. 2054-2059.
23. S. Quarteroni, G. Riccardi, and M. Dinarelli, "What's in an ontology for spoken language understanding," in Proc. Interspeech, 2009.
24. C. Raymond and G. Riccardi, "Generative and discriminative algorithms for spoken language understanding," in Proc. Interspeech, 2007, pp. 1605-1608.
25. Y. Heand S.Young, "Semantic processing using the hidden vector state model," Computer Speech and Language, pp. 85-106, 2005.
26. L. Ramshaw and M. Marcus, "Text chunking using transformation-based learning," in Proc. VCL Workshop, 1995, pp. 84-94.
27. M. Jeong and G. G. Lee, "Practical use of non-local features for statistical spoken language understanding," Comput. Speech Lang., pp. 148-170, 2008. (Pubitemid 350016713)
28. I. Tsochantaridis, T. Hofmann, T. Joachims, and Y. Altun, "Support vector learning for interdependent and structured output spaces," in Proc. ICML, 2004.
29. L. Shen and A. Joshi, "An SVM based voting algorithm with application to parse reranking," in Proc. CoNLL, 2003, pp. 9-16.
30. R. Herbrich, T. Graepel, and K. Obermayer, Large Margin Rank Boundaries for Ordinal Regression. Cambridge, MA: MIT Press, 2000.
31. M. Collins and N. Duffy, "New ranking algorithms for parsing and tagging: Kernels over discrete structures, and the voted perceptron," in Proc. ACL, 2002, pp. 263-270.
32. S. Libin, A. Sarkar, and F. Och, "Discriminative reranking for machine translation," in Proc. HLT-NAACL, 2004, pp. 177-184.
33. A. Severyn and A.Moschitti, "Large-scale support vector learning with structural kernels," in Proc. ECML, 2010, pp. 229-244.
34. A. Severyn and A. Moschitti, "Fast support vector machines for structural kernels," in Proc. ECML, 2011.
35. D. Pighin and A. Moschitti, "Reverse engineering of tree kernel feature spaces," in Proc. EMNLP, 2009.
36. M. Collins and T. Koo, "Discriminative reranking for natural language parsing," Comput. Linguist. (CL), pp. 25-70, 2005.
37. A. Stolcke, "SRILM: An extensible language modeling toolkit," in Proc. SLP, 2002.
38. S. F. Chen and J. Goodman, "An empirical study of smoothing techniques for language modeling," Computer Science Group, Tech. Rep.
39. T. Kudo and Y. Matsumoto, "Chunking with support vector machines," in Proc. NAACL, 2001, pp. 1-8.
40. S. Hahn, P. Lehnen, and H. Ney, "System combination for spoken language understanding," in Proc. Interspeech, 2008, pp. 236-239.
41. A. Yeh and K. Church, "More accurate tests for the statistical significance of result differences," Proc. Coling, 2000.
42. T. Kudo, "CRF++ Toolkit," 2005 [Online]. Available: http://crfpp. sourceforge.net
43. T. Lavergne, O. Cappé, and F. Yvon, "Practical very large scale CRFs," in Proc. ACL, 2010, pp. 504-513.
44. C. Sutton and A. McCallum, "Collective segmentation and labeling of distant entities in information extraction," in Proc. ICML Workshop Statist. Relational Learn., 2004.
45. R. Kohavi and G. John, "Wrappers for feature subset selection," Artif. Intell., pp. 273-324, 1997. (Pubitemid 127401107)
46. A. McCallum, "Efficiently inducing features of conditional random fields," in Proc. Uncertainty in AI, 2003.
47. R. Klinger and C. Friedrich, "Feature subset selection in conditional random fields for named entity recognition," in Proc. RANLP, 2009, pp. 185-191.
48. J. Gao, G. Andrew, M. Johnson, and K. Toutanova, "A comparative study of parameter estimation methods for statistical natural language processing," in Proc. ACL, 2007, pp. 824-831.
49. Y. Tsuruoka, J. Tsujii, and S. Ananiadou, "Stochastic gradient descent training for l1-regularized log-linear models with cumulative penalty," in Proc. ACL IJCNLP, 2009, pp. 477-485.
50. S. Riezler and A. Vasserman, "Incremental feature selection and l1 reg-ularization for relaxed maximum-entropy modeling," in Proc. EMNLP, 2010.
51. X. Qian, X. Jiang, Q. Zhang, X. Huang, and L. Wu, "Sparse higher order conditional random fields for improved sequence labeling," in Proc. ICML, 2009, pp. 849-856.
52. T. Kudo, J. Suzuki, and H. Isozaki, "Boosting-based parse reranking with subtree features," in Proc. ACL, 2005.
53. T. Koo and M. Collins, "Hidden-variable models for discriminative reranking," in Proc. EMNLP, 2005, pp. 507-514.
54. R. Geand R. Mooney, "Discriminative reranking for semantic parsing," in Proc. COLING, 2006, pp. 263-270.
55. R. Kate and R. Mooney, "Using string-kernels for learning semantic parsers," in Proc. IJCNLP, 2006, pp. 913-920.
56. B. Roark, Y. Liu, M. Harper, R. Stewart, M. Lease, M. Snover, I. Shafran, B. Dorr, J. Hale, A. Krasnyanskaya, and L. Yung, "Reranking for sentence boundary detection in conversational speech," in Proc. ICASSP, 2006, pp. 545-548.
57. A. Moschitti, D. Pighin, and R. Basili, "Tree kernel engineering for proposition reranking," in Mining and Learning With Graphs (MLG), 2006.
58. J. G. Fiscus, "A post-processing system to yield reduced word error rates: Recogniser output voting error reduction (ROVER)," in Proc. ASRU, 1997, pp. 347-352.
59. L. Huang, "Forest reranking: Discriminative parsing with non-local features," in Proc. ACL, 2008, pp. 586-594.
60. S. Bloehdorn and A. Moschitti, "Structure and semantics for expressive text kernels," in Proc. CIKM, 2007, pp. 861-864.
61. J. Lafferty, X. Zhu, and Y. Liu, "Kernel conditional random fields: Representation and clique selection," in Proc. ICML, 2004.
62. L. Zettlemoyer and M. Collins, "Learning context-dependent mappings from sentences to logical form," in Proc. ACL and IJNLP, 2009, pp. 976-984.