MCE Training Techniques for Topic Identification of Spoken Audio Documents

IEEE Transactions on Audio, Speech and Language Processing

Volumn 19, Issue 8, 2011, Pages 2451-2460

  Hazen, Timothy J ^a  

^a MIT LINCOLN LABORATORY   (United States)

Author keywords

Discriminative training; machine learning; speech recognition; topic identification

Indexed keywords

EID: 84858978514     PISSN: 15587916     EISSN: 15587924     Source Type: Journal    
DOI: 10.1109/TASL.2011.2139207     Document Type: Article

References (30)

1. J. Arenas-García and F. Pérez-Cruz, “Multi-class support vector machines: A new approach,” in Proc. ICASSP, Hong Kong, China, Apr. 2003, pp. 781–784.
2. N. Brummer and D. van Leeuwan, “On calibration of language recognition scores,” in Proc. Speaker Lang. Recognition Workshop, San Juan, Puerto Rico, Jun. 2006.
3. W. Campbell et al., “Phonetic speaker recognition with support vector machines,” in Adv. Neural Inf. Process. Syst. 16, S. Thrun, L. Saul, and B. Scholköpf, Eds. Cambridge, MA: MIT Press, 2004.
4. C.-C. Chang and C.-J. Lin, “LIBSVM—A Library for Support Vector Machines,” [Online]. Available: http://www.csie.ntu.edu.tw/~cjlin/libsvm/
5. C. Cieri, D. Miller, and K. Walker, “The Fisher corpus: A resource for the next generation of speech-to-text,” in Proc. Int. Conf. Lang. Resources Eval., Lisbon, Portugal, May 2004, pp. 69–71.
6. R. Collobert and S. Bengio “SVMTorch: Support vector machines for large-scale regression problems,” J. Mach. Learn. Res., vol. 1, pp. 143–160, 2001.
7. K. Crammer and Y. Singer “On the algorithmic implementation of multi-class kernel-based vector machines,” J. Mach. Learn. Res., vol. 2, pp. 265–292, 2001.
8. S. Gao, W. Wu, C.-H. Lee, and T.-S. Chua, “A MFoM learning approach to robust multiclass multi-label text categorization,” in Proc. ICML, Banff, AB, Canada, Jul. 2004, pp. 42–49.
9. J. Glass “A probabilistic framework for segment-based speech recognition,” Comput. Speech Lang., vol. 17, no. 2–3, pp. 137–152, 2003.
10. P. Haffner, G. Tur, and J. Wright, “Optimizing SVMs for complex call classification,” in Proc. ICASSP, Hong Kong, China, Apr. 2003, pp. 632–635.
11. A. Hatch, A. Stolcke, and B. Peskin, “Combining feature sets with support vector machines: Application to speaker recognition,” in Proc. IEEE Workshop Autom. Speech Recognition Understand., San Juan, Puerto Rico, Nov. 2005, pp. 75–79.
12. T. Hazen, F. Richardson, and A. Margolis, “Topic identification from audio recordings using word and phone recognition lattices,” in Proc. IEEE Workshop Autom. Speech Recognition Understand., Kyoto, Japan, Dec. 2007, pp. 659–664.
13. T. Hazen and A. Margolis, “Discriminative feature weighting using MCE training for topic identification of spoken audio recordings,” in Proc. IEEE ICASSP, Las Vegas, NV, Apr. 2008, pp. 4965–4968.
14. T. Hazen and F. Richardson, “A hybrid SVM/MCE training approach for vector space topic identification of spoken audio recordings,” in Proc. Interspeech, Brisbane, Australia, Sep. 2008, pp. 2542–2545.
15. T. Hazen, “Multi-class SVM optimization using MCE training with application to topic identification,” in Proc. IEEE ICASSP, Dallas, TX, Mar. 2010, pp. 5350–5353.
16. T. Joachims, “Text categorization with support vector machines: Learning with many relevant features,” in Proc. Eur. Conf. Mach. Learn., Chemnitz, Germany, Apr. 1998, pp. 137–142.
17. B.-H. Juang and S. Katagiri “Discriminative learning for minimum error classification,” IEEE Trans. Signal Process., vol. 40, no. 12, pp. 3043–3054, Dec. 1992.
18. H.-K.J. Kuo and C.-H. Lee “Discriminative training of natural language call routers,” IEEE Trans. Speech Audio Process., vol. 11, no. 1, pp. 24–35, Jan. 2003.
19. D. Lewis, “Naive (Bayes) at forty: The independence assumption in information retrieval,” in Proc. Eur. Conf. Mach. Learn., Chemnitz, Germany, Apr. 1998, pp. 4–15.
20. P. Liu, H. Jiang, and I. Zitouni, “Discriminative training of naive Bayes classifiers for natural language call routing,” in Proc. Interspeech, Jeju Island, Korea, Oct. 2004, pp. 1589–1592.
21. J. McDonough et al., “Approaches to topic identification on the switchboard corpus,” in Proc. ICASSP, Adelaide, Australia, Apr. 1994, pp. 385–388.
22. C. Manning and H. Schiitze, “Text categorization,” in Foundations of Statistical Natural Language Processing. Cambridge, MA: MIT Press, 1999, ch. 16, pp. 575–608.
23. J. Platt, “Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods,” in Advances in Large Margin Classifiers. Cambridge, MA: MIT Press, 1999, pp. 61–74.
24. M. Riedmiller and H. Braun, “RPROP—A fast adaptive learning algorithm,” in Proc. Int. Symp. Comput. Inf., Antalya, Turkey, 1992, pp. 279–285.
25. R. Schwartz, T. Imai, L. Nguyen, and J. Makhoul, “A maximum likelihood model for topic classification of broadcast news,” in Proc. Eurospeech, Rhodes, Greece, Sep. 1997, pp. 1455–1458.
26. F. Sebastiani “Machine learning in automated text categorization,” ACM Comput. Surv., vol. 34, no. 1, pp. 1–47, 2002.
27. V. Vapnik, Statistical Learning Theory. New York: Wiley, 1998.
28. J. Wintrode and S. Kulp, “Techniques for rapid and robust topic identification of conversational telephone speech,” in Proc. Interspeech, Brighton, U.K., Sept. 2009, pp. 1471–1474.
29. Y. Yang and J. Pedersen, “A comparative study on feature selection in text categorization,” in Proc. Int. Conf. Mach. Learn. (ICML), Nashville, TN, Jul. 1997, pp. 412–420.
30. I. Zitouni “Constrained minimization and discriminative training for natural language call routing,” IEEE Trans. Speech Audio Process., vol. 16, no. 1, pp. 208–215, Jan. 2008.