Deep belief network based semantic taggers for spoken language understanding

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2013, Pages 2713-2717

  Deoras, Anoop ^a   Sarikaya, Ruhi ^a  

^a MICROSOFT   (United States)

Author keywords

ASR; CRF; DBN; SLU

Indexed keywords

BAYESIAN NETWORKS; INDUSTRIAL PLANTS; NEURAL NETWORKS; SEMANTICS; SPEECH RECOGNITION; SYNTACTICS;

ASR; CRF; DBN; DEEP BELIEF NETWORK (DBN); GENERALIZATION CAPABILITY; SLU; SPEECH RECOGNITION SYSTEMS; SPOKEN LANGUAGE UNDERSTANDING;

COMPUTATIONAL LINGUISTICS;

EID: 84906275467     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (26)

1. G. Tur, D. Hakkani-Tur, L. Heck, and S. Parthasarathy, "Sentence Simplification for Spoken Language Understanding, " in Proc. of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), May 2011, pp. 5628 -5631.
2. G. Tur and R. D. Mori, Eds., Spoken Language Understanding: Systems for Extracting Semantic Information from Speech. New York, NY: John Wiley and Sons, 2011.
3. P. J. Price, "Evaluation of spoken language systems: The ATIS domain, " in Proceedings of the DARPA Workshop on Speech and Natural Language, Hidden Valley, PA, June 1990.
4. R. Pieraccini, E. Tzoukermann, Z. Gorelov, J.-L. Gauvain, E. Levin, C.-H. Lee, and J. G. Wilpon, "A speech understanding system based on statistical representation of semantics, " in Pro- ceedings of the ICASSP, San Francisco, CA, March 1992.
5. S. Miller, R. Bobrow, R. Ingria, and R. Schwartz, "Hidden under- standing models of natural language, " in Proceedings of the ACL, Las Cruces, NM, June 1994.
6. W. Ward and S. Issar, "Recent improvements in the CMU spoken language understanding system, " in Proceedings of the ARPA HLT Workshop, March 1994, pp. 213-216.
7. S. Seneff, "TINA: A natural language system for spoken language applications, " Computational Linguistics, vol. 18, no. 1, pp. 61- 86, 1992.
8. J. Dowding, J. M. Gawron, D. Appelt, J. Bear, L. Cherny, R. Moore, and D. Moran, "Gemini: A natural language system for spoken language understanding, " in Proceedings of the ARPA Workshop on Human Language Technology, Princeton, NJ, March 1993.
9. Y.-Y.Wang and A. Acero, "Discriminative models for spoken lan- guage understanding, " in Proceedings of the ICSLP, Pittsburgh, PA, September 2006.
10. C. Raymond and G. Riccardi, "Generative and discriminative al- gorithms for spoken language understanding, " in Proceedings of the Interspeech, Antwerp, Belgium, 2007.
11. J. Lafferty, A. McCallum, and F. Pereira, "Conditional random fields: Probabilistic models for segmenting and labeling sequence data, " in Proceedings of the ICML, Williamstown, MA, 2001.
12. F. Jelinek, Statistical methods for speech recognition. Cam- bridge, MA, USA: MIT Press, 1997.
13. G. Tur, D. Hakkani-Tur, and L. Heck, "What is left to be under- stood in ATIS?" in Proc. of IEEE Spoken Language Technology Workshop (SLT), Dec 2010, pp. 19 -24.
14. G.E. Hinton, "Training Products of Experts by Minimizing Con- Trastive Divergence, " Neural Computation, vol. 14, pp. 1771- 1800, 2002.
15. G. E. Hinton, S. Osindero, and Y. W. Teh, "A fast learning al- gorithm for deep belief nets, " Advances in Neural Computation, vol. 18, no. 7, pp. 1527-1554, 2006.
16. G. Dahl, D. Yu, L. Deng, and A. Acero, "Context-dependent pre-trained dnns for large vocabulary speech recognition, " IEEE Trans. Audio, Speech, and Lang. Proc., Jan. 2012.
17. R. Sarikaya, G. E. Hinton, and B. Ramabhadran, "Deep belief nets for natural language call-routing, " in Proceedings of the ICASSP, Prague, Czech Republic, 2011.
18. J. Turian, L. Ratinov, and Y. Bengio, "Word representation: A simple and general method for semi-supervised learning, " in Pro- ceedings of the ACL, Uppsala, Sweden, July 2010.
19. D. E. Rumelhart, G. E. Hinton, and R. J. Williams, "Learning internal representations by error propagation, " MIT Press Compu- Tational Models of Cognition And Perception Series, pp. 318-362, 1986.
20. Y. Dauphin, X. Glorot, and Y. Bengio, "Large-scale learning of embeddings with reconstruction sampling, " in Proc. of IEEE Intl. Conf. on Acoustics, Speech, and Signal Processing, Kyoto, Japan, 2012.
21. G. Hinton, N. Srivastava, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, "Improving neural networks by preventing co- Adaptation of feature detectors, " ArXiv e-prints, July 2012.
22. Y. He and S. Young, "A data-driven spoken language understand- ing system, " in Proceedings of the IEEE ASRU Workshop, U.S. Virgin Islands, December 2003, pp. 583-588.
23. T. Kudo, "CRF++: Yet Another CRF toolkit, " http://crfpp.googlecode.com/svn/trunk/doc/index.html, 2009.
24. A. Deoras, R. Sarikaya, G. Tur, and D. Hakkani-Tur, "Joint De- coding for Speech Recognition and Semantic Tagging, " in Proc. of ISCA INTERSPEECH, Portland, Oregon, US, 2012.
25. A. Deoras, G. Tur, R. Sarikaya, and D. Hakkani-Tur, "Joint Dis- criminative Decoding of Words and Semantic Tags for Spoken Language Understanding, " IEEE Transactions on Audio, Speech and Language Processing, vol. 21, no. 8, pp. 1612-1621, 2013.
26. G. Tur, A. Deoras, and D. Hakkani-Tur, "Semantic Parsing Using Word Confusion Networks With Conditional Random Fields, " in Proc. of the INTERSPEECH, 2013.