Towards deeper understanding: Deep convex networks for semantic utterance classification

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2012, Pages 5045-5048

  Tur, Gokhan ^a,b   Deng, Li ^b   Hakkani Tür, Dilek ^a,b   He, Xiaodong ^b  

^a Microsoft Speech Labs   (United States)

^b MICROSOFT RESEARCH   (United States)

Author keywords

deep convex networks; deep learning; domain detection; semantic utterance classification; spoken language understanding

Indexed keywords

ACOUSTIC MODELING; CLASSIFICATION ACCURACY; CLASSIFICATION TASKS; DEEP BELIEF NETWORKS; DEEP LEARNING; DISCRIMINATIVE CLASSIFIERS; FEATURE SPACE; INPUT FEATURES; NON-TRIVIAL; SEMANTIC FEATURES; SPOKEN LANGUAGE UNDERSTANDING; TRAINING SAMPLE; UTTERANCE CLASSIFICATION; WORD TRIGRAMS;

SIGNAL PROCESSING;

SEMANTICS;

EID: 84867605416     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2012.6289054     Document Type: Conference Paper

References (23)

1. G. Tur and L. Deng, Intent Determination and Spoken Utterance Classification, Chpater 3 in Book: Spoken Language Understanding, John Wiley and Sons, New York, NY, 2011.
2. M. Gilbert, J. G. Wilpon, B. Stern, and G. Di Fabbrizio, "Intelligent virtual agents for contact center automation," IEEE Signal Processing Magazine, vol. 22, no. 5, pp. 32-41, September 2005.
3. R. E. Schapire and Y. Singer, "Boostexter: A boosting-based system for text categorization," Machine Learning, vol. 39, no. 2/3, pp. 135-168, 2000.
4. P. Haffner, G. Tur, and J. Wright, "Optimizing SVMs for complex call classification," in Proceedings of the ICASSP, Hong Kong, April 2003.
5. S. Yaman, L. Deng, D. Yu, Y.-Y. Wang, and A. Acero, "An integrative and discriminative technique for spoken utterance classification," IEEE Transactions on Audio, Speech, and Language Processing, vol. 16, no. 6, pp. 1207-1214, 2008.
6. R. Sarikaya, G. E. Hinton, and B. Ramabhadran, "Deep belief nets for natural language call-routing," in Proceedings of the ICASSP, Prague, Czech Republic, 2011.
7. G. E. Hinton, S. Osindero, and Y. W. Teh, "A fast learning algorithm for deep belief nets," Advances in Neural Computation, vol. 18, no. 7, pp. 1527-1554, 2006.
8. G. Dahl, D. Yu, L. Deng, and A. Acero, "Context-dependent pretrained dnns for large vocabulary speech recognition," IEEE Trans. Audio, Speech, and Lang. Proc., Jan. 2012.
9. D. Yu, L. Deng, and G. Dahl, "Roles of pre-training and fine-tuning in context-dependent dbn-hmms for real-world speech recognition," in NIPS Workshop on Deep Learning and Unsupervised Feature Learning, December 2010.
10. N. Jaitly and G. E. Hinton, "Learning a better representation of speech sound waves using restricted boltzmann machines," in Proceedings of the ICASSP, Prague, Czech Republic, 2011.
11. L. Deng and D. Yu, "Deep convex nets: A scalable architecture for speech pattern classification," in Proceedings of the Interspeech, Florence, Italy, 2011.
12. L. Deng, D. Yu, and J. Platt, "Scalable stacking and learning for building deep architectures," in Proc. ICASSP, Kyoto, Japan, 2012.
13. A. L. Gorin, G. Riccardi, and J. H. Wright, "How May I Help You?," Speech Communication, vol. 23, pp. 113-127, 1997.
14. J. Chu-Carroll and B. Carpenter, "Vector-based natural language call routing," Computational Linguistics, vol. 25, no. 3, pp. 361-388, 1999.
15. Y. Bengio, R. Ducharme, P. Vincent, and C. Jauvin, "A neural probabilistic language model," Journal of Machine Learning Research, vol. 4, no. 2, pp. 1137-1155, 2003.
16. Y. Yang and J. Pedersen, "A comparative study on feature selection in text categorization," in Proceedings of the ICML, 1997.
17. Y. Freund and R. E. Schapire, "A decision-theoretic generalization of on-line learning and an application to boosting," Journal of Computer and System Sciences, vol. 55, no. 1, pp. 119-139, 1997.
18. M. Karahan, D. Hakkani-Tur, G. Riccardi, and G. Tur, "Combining classifiers for spoken language understanding," in Proceedings of the IEEE ASRU Workshop, U.S. Virgin Islands, December 2003.
19. L. Deng, M. Seltzer, D. Yu, A. Acero, A. Mohamed, and G. Hinton, "Binary coding of speech spectrograms using a deep auto-encoder," in Proc. Interspeech, September 2010.
20. A. Mohamed, D. Yu, and L. Deng, "Investigation of full-sequence training of deep belief networks for speech recognition," in Proc. Interspeech, September 2010.
21. X.D. He and L. Deng, "Speech recognition, machine translation, and speech translation a unified discriminative learning paradigm," IEEE Signal Processing Magazine., 2011.
22. X.D. He, L. Deng, and A. Aceero, "Why word error rate is not a good metric for speech recognizer training for the speech translation task?," in Proc. ICASSP, Prague, 2011.
23. Y. Zhang, L. Deng, X. He, and A. Acero, "A novel decision function and the associated decision-feedback learning for speech translation," in Proc. ICASSP, Prague, 2011