Frame-level AnyBoost for LVCSR with the MMI criterion

2011 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2011, Proceedings

Volumn , Issue , 2011, Pages 12-17

  Tachibana, Ryuki ^a   Fukuda, Takashi ^a   Chaudhari, Upendra ^b   Ramabhadran, Bhuvana ^b   Zhan, Puming ^c  

^a IBM RESEARCH TOKYO   (Japan)

^b IBM T J WATSON RESEARCH CENTER   (United States)

^c NUANCE COMMUNICATIONS   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTIC MODEL; ADABOOST ALGORITHM; EFFICIENT ALGORITHM; GRADIENT DESCENT; LARGE VOCABULARY CONTINUOUS SPEECH RECOGNITION; MMI CRITERION; RUNTIMES; SEARCH TASKS; SYSTEM COMBINATION; TRAINING PROCEDURES; WEAK LEARNER; WEIGHTED SUMMATIONS;

ADAPTIVE BOOSTING; CONTINUOUS SPEECH RECOGNITION;

ALGORITHMS;

EID: 84858963004     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ASRU.2011.6163897     Document Type: Conference Paper

References (20)

1. T. G. Dietterich, "An experimental comparison of three methods for constructing ensembles of decision trees: Bagging, boosting, and randomization," in Bagging, boosting, and randomization. Machine Learning, 1998, pp. 139-157.
2. -, "Ensemble methods in machine learning," in Proc. First International Workshop on Multiple Classifier Systems, 2000, pp. 1-15.
3. L. Breiman and E. Schapire, "Random forests," in Machine Learning, vol. 45, no. 1, 2001, pp. 5-32. (Pubitemid 32933532)
4. O. Siohan, B. Ramabhadran, and B. Kingsbury, "Constructing ensembles of asr systems using randomized decision trees," in Proc. ICASSP, 2005, pp. 197-200.
5. B. Ramabhadran, O. Siohan, L. Mangu, G. Zweig, M. Westphal, H. Schulz, and A. Soneiro, "The IBM 2006 speech transcription system for European parliamentary speeches," in TC-STAR Workshop on Speech-to-Speech Translation, Barcelona, Spain, Jun. 2006, pp. 111-116.
6. L. Breiman, "Bagging predictors," Machine Learning, vol. 24, no. 2, pp. 123-140, 1996. (Pubitemid 126724382)
7. Y. Freund and R. E. Schapire, "Experiments with a new boosting algorithm," pp. 148-156, 1996.
8. G. Saon, H. Soltau, U. Chaudhari, S. Chu, and B. Kingsbury, "The IBM 2008 GALE arabic speech transcription system," in Proc. ICASSP, 2010, pp. 4378-4381.
9. Y. Freund and R. E. Schapire, "A decision-theoretic generalization of on-line learning and an application to boosting," Journal of Computer and System Sciences, vol. 55, pp. 119-139, August 1997. [Online]. Available: http://portal.acm.org/citation.cfm?id=261540.261549 (Pubitemid 127433398)
10. J. H. Friedman, "Greedy function approximation: A gradient boosting machine," Annals of Statistics, vol. 29, no. 5, pp. 1189-1232, 2001. (Pubitemid 33405972)
11. R. Zhang and A. I. Rudnicky, "Investigations of issues for using multiple acoustic models to improve continuous speech recognition," in Proc. Interspeech, 2006, pp. 529-533.
12. G. Saon and H. Soltau, "Boosting Systems for LVCSR," in Proc. Interspeech, 2010, pp. 1341-1344.
13. J. H. Friedman, "Stochastic gradient boosting," Computational Statistics & Data Analysis, vol. 38, no. 4, pp. 367-378, 2002. (Pubitemid 34197167)
14. L. Mason, J. Baxter, P. Bartlett, and M. Frean, "Boosting algorithms as gradient descent," in Advances in Neural Information Processing Systems 12. MIT Press, 2000, pp. 512-518.
15. D. Povey, D. Kanevsky, B. Kingsbury, B. Ramabhadran, G. Saon, and K. Visweswariah, "Boosted MMI for model and feature-space discriminative training," in ICASSP, 2008, pp. 4057-4060.
16. A. Stolcke, H. Bratt, J. Butzberger, H. Franco, V. R. R. Gadde, M. Plauche', C. Richey, E. Shriberg, K. Sonmez, F. Weng, and J. Zheng, "The SRI March 2000 Hub-5 conversational speech transcription system," in Proc. NIST Speech Transcription Workshop, 2000.
17. J. G. Fiscus, "A Post-Processing System To Yield Reduced Word Error Rates: Recognizer Output Voting Error Reduction (ROVER)," in Proc. IEEE ASRU Workshop, 1997, pp. 347-352.
18. C. Chelba, J. Schalkwyk, T. Brants, V. Ha, B. Harb, W. Neveitt, C. Parada, and P. Xu, "Query language modeling for voice search," in Proc. IEEE Workshop on Spoken Language Technology, 2010.
19. G. Dahl, D. Yu, L. Deng, and A. Acero, "Context-Dependent Pre-trained Deep Neural Networks for Large Vocabulary Speech Recognition," IEEE TSAP, 2011.
20. A. Stolcke, H. Bratt, J. Butzberger, H. Franco, V. R. R. Gadde, M. Plauche', C. Richey, E. Shriberg, K. Sonmez, F. Weng, and J. Zheng, "The SRI March 2000 Hub-5 conversational speech transcription system," in Proc. NIST Speech Transcription Workshop, 2000.