PAC-Bayesian approach for minimization of phoneme error rate

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2011, Pages 2224-2227

  Keshet, Joseph ^a   McAllester, David ^a   Hazan, Tamir ^a  

^a TOYOTA TECHNOLOGICAL INSTITUTE AT CHICAGO   (United States)

Author keywords

discriminative training; kernels; PAC Bayesian theorem; phoneme recognition; structured prediction

Indexed keywords

DISCRIMINATIVE TRAINING; KERNELS; PAC-BAYESIAN THEOREM; PHONEME RECOGNITION; STRUCTURED PREDICTION;

ALGORITHMS; BAYESIAN NETWORKS; SIGNAL PROCESSING; SPEECH COMMUNICATION;

SPEECH RECOGNITION;

EID: 80051614298     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2011.5946923     Document Type: Conference Paper

References (21)

1. L. Rabiner and B.H. Juang, Fundamentals of speech recognition, Prentice-Hall, Inc., 1993.
2. L.R. Bahl, P.F. Brown, P.V. de Souza, and R.L. Mercer, "Maximum mutual information estimation of hidden Markov model parameters for speech recognition," in Proc. ICASSP, 1986.
3. B.-H. Juang, W. Chou, and C.-H. Lee, "Minimum classification error rate methods for speech recognition," IEEE Trans. on Speech and Audio Processing, vol. 5, no. 3, pp. 257-265, 1997.
4. F. Sha and L. K. Saul, "Comparison of large margin training to other discriminative methods for phonetic recognition by hidden Markov models," in Proc. ICASSP, 2007.
5. D. Povey and P.C. Woodland, "Minimum phone error and I-Smoothing for improved discriminative training," in Proc. ICASSP, 2002.
6. M. Ostendorf, V.V. Digalakis, and O.A. Kimball, "From HMM's to segment models: A unified view of stochastic modeling for speech recognition," IEEE Trans. on Speech and Audio Processing, vol. 4, no. 5, 1996.
7. S. Young, "A review of large-vocabulary continuous speech recognition," IEEE Signal Processing Mag., pp. 45-57, 1996.
8. B. Taskar, C. Guestrin, and D. Koller, "Max-margin markov networks," in Proc. NIPS 17, 2003.
9. I. Tsochantaridis, T. Joachims, T. Hofmann, and Y. Altun, "Large margin methods for structured and interdependent output variables," Journal of Machine Learning Research, vol. 6, pp. 1453-1484, 2005.
10. J. Lafferty, A. McCallum, and F. Pereira, "Conditional random fields: Probabilistic models for segmenting and labeling sequence data," in Proc. ICML, 2001, pp. 282-289.
11. J. Keshet, S. Shalev-Shwartz, S. Bengio, Y. Singer, and D. Chazan, "Discriminative kernel-based phoneme sequence recognition," in Interspeech, 2006.
12. D. McAllester, "Simplified PAC-Bayesian margin bounds," in Proceedings of the Sixteenth Annual Conference on Computational Learning Theory, 2003.
13. L. Lamel, R. Kassel, and S. Seneff, "Speech database development: Design an analysis of the acoustic-phonetic corpus," in DARPA Speech Recognition Workshop, 1986.
14. K.-F. Lee and H.-W. Hon, "Speaker independent phone recognition using hidden markov models," IEEE Trans. Acoustic, Speech and Signal Proc., vol. 37, no. 2, pp. 1641-1648, 1989.
15. K. Crammer, O. Dekel, J. Keshet, S. Shalev-Shwartz, and Y. Singer, "Online passive aggressive algorithms," Journal of Machine Learning Research, vol. 7, 2006.
16. K. Crammer, "Efficient online learning with individual learning-rates for phoneme sequence recognition," in Proc. ICASSP, 2010.
17. A. Mohamed and G.E. Hinton, "Phone recognition using restricted boltzmann machines," in Proc. ICASSP, 2010.
18. Y.-H. Sung and D. Jurafsky, "Hidden conditional random fields for phone recognition," in Proc. ASRU, 2010.
19. P. Schwartz, P. Matejka, and J. Cernocky, "Hierarchical structures of neural networks for phoneme recognition," in Proc. ICASSP, 2006.
20. C.-C. Cheng, F. Sha, and L. K. Saul, "A fast online algorithm for large margin training of continuous-density hidden Markov models," in Interspeech, 2009.
21. J. Morris and E. Fosler-Lussier, "Conditional random fields for integrating local discriminative classifiers," IEEE Trans. on Acoustics, Speech, and Language Processing, vol. 16, no. 3, pp. 617-628, 2008.