Submodular subset selection for large-scale speech training data

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2014, Pages 3311-3315

  Wei, Kai ^a   Liu, Yuzong ^a   Kirchhoff, Katrin ^a   Bartels, Chris ^b   Bilmes, Jeff ^a  

^a University of Washington   (United States)

^b SRI INTERNATIONAL   (United States)

Author keywords

automatic speech recognition; large scale systems; machine learning; speech processing

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMBINATORIAL OPTIMIZATION; LEARNING SYSTEMS; OPTIMIZATION; SPEECH PROCESSING; SPEECH RECOGNITION;

AUTOMATIC SPEECH RECOGNITION; AUTOMATIC SPEECH RECOGNITION SYSTEM; COMBINATORIAL OPTIMIZATION PROBLEMS; DEEP NEURAL NETWORKS; GAUSSIAN MIXTURE MODEL; SELECTION METHODS; SPEECH RECOGNIZER; SUBMODULAR FUNCTIONS;

SIGNAL PROCESSING;

EID: 84905251799     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2014.6854213     Document Type: Conference Paper

References (19)

1. Hui Lin and Jeff A. Bilmes, "How to select a good trainingdata subset for transcription: Submodular active selection for sequences," in Proc. Annual Conference of the International Speech Communication Association (INTERSPEECH), Brighton, UK, September 2009.
2. Kai Wei, Yuzong Liu, Katrin Kirchhoff, and Jeff Bilmes, "Using document summarization techniques for speech data subset selection," in North American Chapter of the Association for Computational Linguistics/Human Language Technology Conference (NAACL/HLT-2013), Atlanta, GA, June 2013.
3. Kai Wei, Yuzong Liu, Katrin Kirchhoff, and Jeff Bilmes, "Unsupervised submodular subset selection for speech data," in IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Florence, Italy, 2014.
4. Dilek Hakkani-Tur, Giuseppe Riccardi, and Allen Gorin, "Active learning for automatic speech recognition," in IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2002, vol. 4, pp. IV-3904.
5. Lori Lamel, Jean-Luc Gauvain, and Gilles Adda, "Lightly supervised and unsupervised acoustic model training," Computer Speech & Language, vol. 16, no. 1, pp. 115-129, 2002.
6. Thomas Kemp and Alex Waibel, "Unsupervised training of a speech recognizer using TV broadcasts," in ICSLP, 1998, vol. 98, pp. 2207-2210.
7. Shih-Hung Liu, Fang-Hui Chu, Shih-Hsiang Lin, Hung-Shin Lee, and Berlin Chen, "Training data selection for improving discriminative training of acoustic models," in IEEE Workshop on Automatic Speech Recognition & Understanding (ASRU). IEEE, 2007, pp. 284-289.
8. Nobuyasu Itoh, Tara N Sainath, Dan Ning Jiang, Jie Zhou, and Bhuvana Ramabhadran, "N-best entropy based data selection for acoustic modeling," in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2012, pp. 4133-4136.
9. Yi Wu, Rong Zhang, and Alexander Rudnicky, "Data selection for speech recognition," in IEEE Workshop on Automatic Speech Recognition & Understanding (ASRU), 2007, pp. 562-565.
10. Satoru Fujishige, "Submodular systems and related topics," Mathematical Programming at Oberwolfach II, pp. 113-131, 1984.
11. G.L. Nemhauser, L.A.Wolsey, and M.L. Fisher, "An analysis of approximations for maximizing submodular set functions-I," Mathematical Programming, vol. 14, no. 1, pp. 265-294, 1978.
12. U. Feige, "A threshold of ln n for approximating set cover," Journal of the ACM (JACM), vol. 45, no. 4, pp. 634-652, 1998.
13. M. Minoux, "Accelerated greedy algorithms for maximizing submodular set functions," Optimization Techniques, pp. 234-243, 1978.
14. Hui Lin and Jeff Bilmes, "A class of submodular functions for document summarization," in The 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies (ACL/HLT-2011), Portland, OR, June 2011.
15. P. Stobbe and A. Krause, "Efficient minimization of decomposable submodular functions," in NIPS, 2010.
16. Nagendra Kumar and Andreas G Andreou, Investigation of silicon auditory models and generalization of linear discriminant analysis for improved speech recognition, Ph.D. thesis, Johns Hopkins University, 1997.
17. Daniel Povey, Brian Kingsbury, Lidia Mangu, George Saon, Hagen Soltau, and Geoffrey Zweig, "fMPE: Discriminatively trained features for speech recognition," in IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2005, vol. 1, pp. 961-964.
18. Daniel Povey and Philip C Woodland, "Minimum phone error and i-smoothing for improved discriminative training," in IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2002, vol. 1, pp. I-105.
19. Daniel Povey, Arnab Ghoshal, Gilles Boulianne, Lukas Burget, Ondrej Glembek, Nagendra Goel, Mirko Hannemann, Petr Motlicek, Yanmin Qian, Petr Schwarz, Jan Silovsky, Georg Stemmer, and Karel Vesely, "The Kaldi speech recognition toolkit," in IEEE 2011 Workshop on Automatic Speech Recognition and Understanding, 2011.