Empirical link between hypothesis diversity and fusion performance in an ensemble of automatic speech recognition systems

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2013, Pages 3082-3086

  Audhkhasi, Kartik ^a   Zavou, Andreas M ^a   Georgiou, Panayiotis G ^a   Narayanan, Shrikanth S ^a  

^a University of Southern California   (United States)

Author keywords

Automatic speech recognition; Diversity; Ensemble methods; ROVER; System combination

Indexed keywords

COMPUTER APPLICATIONS; COMPUTER SIMULATION;

AUTOMATIC SPEECH RECOGNITION; DIVERSITY; ENSEMBLE METHODS; ROVER; SYSTEM COMBINATION;

SPEECH RECOGNITION;

EID: 84906226217     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (43)

1. H. Soltau et al., "Advances in Arabic speech transcription at IBM under the DARPA GALE program, " IEEE Transactions on Audio, Speech, and Language Processing, vol. 17, no. 5, pp. 884-894, 2009.
2. D. Stallard et al., "The BBN 2007 Displayless English/Iraqi Speech-to-Speech Translation System, " in Proc. Interspeech, 2007.
3. S. F. Chen et al., "Advances in speech transcription at IBM under the DARPA EARS program, " IEEE Transactions on Audio, Speech, and Language Processing, vol. 14, no. 5, pp. 1596-1608, 2006.
4. G. Tur et al., "The CALO meeting speech recognition and understanding system, " in Proc. SLT. IEEE, 2008, pp. 69-72.
5. L. I. Kuncheva, Combining pattern classifiers: methods and algorithms, Wiley-Interscience, 2004.
6. T. Dietterich, "Ensemble methods in machine learning, " Multiple classifier systems, pp. 1-15, 2000.
7. A. Krogh and J. Vedelsby, "Neural network ensembles, cross validation, and active learning, " Advances in neural information processing systems, pp. 231-238, 1995.
8. N. Ueda and R. Nakano, "Generalization error of ensemble estimators, " in IEEE International Conference on Neural Networks, 1996, vol. 1, pp. 90-95.
9. K. Tumer and J. Ghosh, "Analysis of decision boundaries in linearly combined neural classifiers, " Pattern Recognition, vol. 29, no. 2, pp. 341-348, 1996.
10. H. Schwenk, "Using boosting to improve a hybrid HMM/neural network speech recognizer, " in Proc. ICASSP IEEE, 1999, vol. 2, pp. 1009-1012.
11. G. Cook and T. Robinson, "Boosting the performance of connectionist large vocabulary speech recognition, " in Proc. ICSLP IEEE, 1996, vol. 3, pp. 1305-1308.
12. C. Dimitrakakis and S. Bengio, "Boosting HMMs with an application to speech recognition, " in Proc. ICASSP. IEEE, 2004, vol. 5, pp. 618-621.
13. O. Siohan, B. Ramabhadran, and B. Kingsbury, "Contructing ensembles of ASR systems using randomized decision trees, " in Proc. ICASSP IEEE, 2005, vol. 1, pp. 197-200.
14. G. Saon and H. Soltau, "Boosting systems for large vocabulary continuous speech recognition, " Speech Communication, vol. 54, no. 2, pp. 212-218, 2012.
15. L. Breiman, "Bagging predictors, " Machine Learning, vol. 24, no. 2, pp. 123-140, 1996.
16. Y. Freund and R. Schapire, "A decision-theoretic generalization of on-line learning and an application to boosting, " in Computational learning theory. Springer, 1995, pp. 23-37.
17. J. H. Friedman, "Greedy function approximation: A gradient boosting machine, " Ann. Statistics, vol. 29, no. 5, pp. 1189-1232, 2001.
18. L. Breiman, "Random forests, " Machine learning, vol. 45, no. 1, pp. 5-32, 2001.
19. C. Breslin, Generation and combination of complementary systems for automatic speech recognition, Ph.D. thesis, Cambridge University Engineering Department and Darwin College, 2008.
20. K. Audhkhasi, P. G. Georgiou, and S.S. Narayanan, "Analyzing quality of crowd-sourced speech transcriptions of noisy audio for acoustic model adaptation, " in Proc. ICASSP, 2012.
21. K. Audhkhasi, P. G. Georgiou, and S. S. Narayanan, "Reliability weighted acoustic model adaptation using crowd-sourced transcriptions, " in Proc. Interspeech, 2011.
22. K. Audhkhasi, P. G. Georgiou, and S. S. Narayanan, "Accurate transcription of broadcast news speech using multiple noisy transcribers and unsupervised reliability metrics, " in Proc. ICASSP, 2011.
23. G. Parent and M. Eskenazi, "Speaking to the crowd: looking at past achievements in using crowdsourcing for speech and predicting future challenges, " in Proc. Interspeech, 2011.
24. B. C. Roy, S. Vasoughi, and D. Roy, "Automatic estimation of transcription accuracy and difficulty, " in Proc. Interspeech ISCA, 2010, pp. 1902-1905.
25. M. Marge, S. Banerjee, and A. I. Rudnicky, "Using the Amazon Mechanical Turk for transcription of spoken language, " in Proc. ICASSP, 2010.
26. S. Novotney and C. Callison-Burch, "Cheap, fast and good enough: Automatic speech recognition with non-expert transcription, " in Proc. NAACL-HLT, 2010.
27. D. Povey et al., "The Kaldi Speech Recognition Toolkit, " in Proc. ASRU. Dec. 2011, IEEE.
28. J. Fiscus, "A post processing system to yield reduced word error rates: Recognizer Output Voting Error Reduction (ROVER), " in Proc. ASRU. IEEE, 1997, pp. 347-354.
29. S. Young et al., "The HTK book, " Cambridge University Engineering Department, 2002.
30. K-F. Lee, H-W. Hon, and R. Reddy, "An overview of the SPHINX speech recognition system, " IEEE Transactions on Acoustics, Speech and Signal Processing, vol. 38, no. 1, pp. 35-45, 1990.
31. C. Allauzen et al., "Open Fst: A general and efficient weighted finite-state transducer library, " Implementation and Application of Automata, pp. 11-23, 2007.
32. D. B. Paul and J. M. Baker, "The design for the Wall Street Journal-based CSR corpus, " in Proc. Workshop on Speech and Natural Language. Association for Computational Linguistics, 1992, pp. 357-362.
33. J. Fiscus, J. Garofolo, M. Przybocki, W. Fisher, and D. Pallett, "English broadcast news speech (HUB4), " Linguistic Data Consortium, Philadelphia, 1997.
34. A. Janin et al., "The ICSI meeting corpus, " in Proc. ICASSP. IEEE, 2003, vol. 1, pp. 1-364.
35. D. Povey, Discriminative training for large vocabulary speech recognition, Ph.D. thesis, Cambridge University, 2003.
36. W. Wang, P. Lv, and Y. Yan, "An improved hierarchical speaker clustering, " Acta Acoustica, 2006.
37. A. Stolcke, "SRILM - An extensible language modeling toolkit, " in Proc. ICSLP, 2002, pp. 901-904.
38. F. Wessel, R. Schluter, K. Macherey, and H. Ney, "Confidence measures for large vocabulary continuous speech recognition, " IEEE Transactions on Speech and Audio Processing, vol. 9, no. 3, pp. 288-298, 2001.
39. H. Jiang, "Confidence measures for speech recognition: A survey, " Speech communication, vol. 45, no. 4, pp. 455-470, 2005.
40. C. Parada, M. Dredze, D. Filimonov, and F. Jelinek, "Contextual information improves OOV detection in speech, " in Proc. NAACL, 2010.
41. M. Siu and H. Gish, "Evaluation of word confidence for speech recognition systems, " Computer Speech and Language, vol. 13, no. 4, pp. 299-319, 1999.
42. K. Audhkhasi, A. Sethy, B. Ramabhadran, and S. S. Narayanan, "Creating ensemble of diverse maximum entropy models, " in Proc. ICASSP IEEE, 2012, pp. 4845-4848.
43. F. Diehl and P. C. Woodland, "Complementary phone error training, " in Interspeech, 2012.