Efficient online learning with individual learning-rates for phoneme sequence recognition

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2010, Pages 4878-4881

  Crammer, Koby ^a  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

Confidence weighted; Discriminative training; Large margin; Online learning; Speech recognition

Indexed keywords

E-LEARNING; LEARNING ALGORITHMS; SIGNAL PROCESSING;

CONFIDENCE WEIGHTED; CONFIDENCE-WEIGHTED LEARNING; DISCRIMINATIVE TRAINING; INDIVIDUAL LEARNING; LARGE MARGINS; LEARNING RATES; MODELING PARAMETERS; ON-LINE ALGORITHMS; ONLINE LEARNING; SEQUENCE RECOGNITION;

SPEECH RECOGNITION;

EID: 78049385574     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2010.5495119     Document Type: Conference Paper

References (15)

1. L. Rabiner and B.H. Juang, Fundamentals of Speech Recognition, Prentice Hall PTR, 1993.
2. A. Gunawardana, M. Mahajan, A. Acero, and J.C. Platt, "Hidden conditional random fields for phone classification," in INTERSPEECH, 2005, pp. 1117-1120.
3. E. McDermott, T.J. Hazen, J. Le Roux, A. Nakamura, and S. Katagiri, "Discriminative training for large vocabulary speech recognition using minimum classification error," IEEE Transactions on Audio, Speech and Language Processing, vol. 15, no. 1, 2007.
4. F. Sha and L. Saul, "Comparison of large margin training to other discriminative methods for phonetic recognition by hidden markov models," in ICASSP, 2007.
5. D. Yu, L. Deng, X. He, and A. Acero, "Large-margin minimum classification error training for large-scale speech recognition tasks," in ICASSP, 2007.
6. C.C. Cheng, F. Sha, and L. Saul, "A fast online algorithm for large margin training of continuous-density hidden markov models," in INTERSPEECH, 2009.
7. J. Keshet, S. Shalev-Shwartz, S. Bengio, Y. Singer, and D. Chazan, "Discriminative kernel-based phoneme sequence recognition," in INTERSPEECH, 2006.
8. K. Crammer, A. Kulesza, and M. Dredze, "Adaptive regularization of weight vectors," in NIPS 23, 2009, To Appear.
9. K. Crammer, M. Dredze, and A. Kulesza, "Multi-class confidence weighted algorithms," in EMNLP, 2009, To Appear.
10. B. Taskar, C. Guestrin, and D. Koller, "Max-margin markov networks," in NIPS. 2003, MIT Press.
11. Kaare Brandt Petersen and Michael Syskind Pedersen, The Matrix Cookbook, 2007.
12. N. Cesa-Bianchi, A. Conconi, and C. Gentile, "On the generalization ability of on-line learning algorithms," IEEE Tran. on Information Theory, vol. 50, no. 9, pp. 2050-2057, 2004.
13. L. Lamel, R. Kassel, and S. Seneff, "Speech database development: design and analysis of the acoustic-phonetic corpus," in Proc. DARPA Speech Recognition Workshop, 1986.
14. K. Crammer, O. Dekel, J. Keshet, S.Shalev-Shwartz, and Y. Singer, "Online passive-aggressive algorithms," JMLR, vol. 7, pp. 551-585, 2006.
15. K-F Lee and H-W Hon, "Speaker-independent phone recognition using hidden markov models," IEEE Transactions on Acoustics, Speech and Signal Processing, vol. 37, no. 2, pp. 1641-1648, 1989.