A derivation of minimum classification error from the theoretical classification risk using Parzen estimation

Computer Speech and Language

Volumn 18, Issue 2, 2004, Pages 107-122

  McDermott, Erik ^a   Katagiri, Shigeru ^a  

^a Japan   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION THEORY; COSTS; ESTIMATION; PATTERN RECOGNITION; PROBABILITY; SPEECH RECOGNITION;

GENERALIZED PROBABILISTIC DESCENT; MINIMUM CLASSIFICATION ERROR; PARZEN ESTIMATION; THEORETICAL CLASSIFICATION RISK;

RISK ASSESSMENT;

EID: 1642269041     PISSN: 08852308     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0885-2308(03)00037-8     Document Type: Article

References (29)

1. Applebaum, T., Hanson, B., 1989. Enhancing the discrimination of speaker independent hidden Markov models with corrective training. Proceedings of the IEEE, International Conference on Acoustics, Speech and Signal Processing, 302-305.
2. Bahl, L., Brown, P.F., de Souza, P.V., Mercer, K.L., 1986. Maximum mutual information estimation of hidden Markov parameters for speech recognition. Proceedings of the IEEE, International Conference on Acoustics, Speech and Signal Processing, 49-52.
3. Biem, A., Katagiri, S., McDermott, E., Juang, B.-H., 2001. An application of discriminative feature extraction to filter-bank-based speech recognition. IEEE Transactions on Speech and Audio Processing 9 (2), 96-110.
4. Brown, P.F., 1987. The acoustic-modeling problem in automatic speech recognition. PhD Thesis, Department of Computer Science, Carnegie Mellon University, CMU-CS-87-125.
5. Chou, W., Juang, B.-H., Lee, C.-H., 1992. Segmental GPD training of HMM based speech recognizer. Proceedings of the IEEE, International Conference on Acoustics, Speech and Signal Processing 1, 473-476.
6. Chou, W., Lee, C.-H., Juang, B.-H., 1993. Minimum error rate training based on N-best string models. Proceedings of the IEEE, International Conference on Acoustics, Speech and Signal Processing 2, 652-655.
7. Duda, R.O., Hart, P.E., 1973. Pattern Classification and Scene Analysis. Wiley USA.
8. Fahlman, S.E., 1988. An empirical study of learning speed in back-propagation networks, Technical Report CMU-CS-88-162, Carnegie Mellon University.
9. Franco, H., Serralheiro, A., 1990. Training HMMs using a minimum error approach. Proceedings of the IEEE, International Conference on Acoustics, Speech and Signal Processing 1, 357-360.
10. Gish, H., 1992. A minimum classification error, maximum likelihood, neural network. Proceedings of the IEEE, International Conference on Acoustics, Speech and Signal Processing 2, 289-292.
11. Gopalakrishnan, P.S., Kanevsky, D., Nadas, A., Nahamoo, D., Picheny, M., 1988. Decoder selection based on cross-entropies. Proceedings of the IEEE, International Conference on Acoustics, and Signal Processing 1, 20-23.
12. Gopalakrishnan, P.S., Kanevsky, D., Nadas, A., Nahamoo, D., 1991. An inequality for rational functions with applications to some statistical estimation problems. Transactions on Information Theory 37 (1), 107-113.
13. Hampshire, J., 1993. A differential theory of learning for efficient statistical pattern recognition. PhD Thesis, Department of Electrical and Computer Engineering, Carnegie Mellon University.
14. Juang, B.-H., Katagiri, S., 1992a. Discriminative learning for minimum error classification. IEEE Transactions on Signal Processing 40 (12), 3043-3053.
15. Juang, B.-H., Katagiri, S., 1992b. Discriminative training. Journal of the Acoustical Society of Japan, Special Issue 13 (6), 333-339.
16. Katagiri, S., Lee, C.-H., Juang, B.-H., 1990. A generalized probabilistic descent method. In: Proceedings of the Acoustical Society of Japan, Fall Meeting, pp. 141-142.
17. Katagiri, S., Lee, C.-H., Juang, B.-H., 1991a. New discriminative training algorithms based on the generalized probabilistic descent method. Proceedings of the 1991 IEEE Workshop on Neural Networks for Signal Processing. 299-308.
18. Katagiri, S., Lee, C.-H., Juang, B.-H., 1991b. Discriminative multilayer feed-forward networks. Proceedings of the 1991 IEEE Workshop on Neural Networks for Signal Processing, 309-318.
19. Katagari, S., Juang, B.-H., Lee, C.-H., 1998. Pattern recognition using a family of design algorithms based upon the generalized probabilistic descent method. Proceedings of the IEEE 86 (11), 2345-2373.
20. Komori, T., Katagiri, S., 1993. An optimal learning method for minimizing spotting errors. Proceedings of the IEEE, International Conference on Acoustics, Speech and Signal Processing 1, 271-274.
21. Ljolje, A., Ephraim, Y., Rabiner, L., 1990. Estimation of hidden Markov model parameters by minimizing empirical error rate. Proceedings of the IEEE, International Conference on Acoustics, Speech and Signal Processing 2, 709-712.
22. McDermott, E., Katagiri, S., 1994. Prototype based discriminative training for various speech units. Computer Speech and Language 8, 351-368.
23. McDermott, E., 1997. Discriminative training for speech recognition. Doctoral thesis, Waseda University, Tokyo.
24. McDermott, E., Biem, A., Tenpaku, S., Katagiri, S., 2000. Discriminative training for large vocabulary telephone-based name recognition. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing 6, 3739-3742.
25. McDermott, E., Katagiri, S., 2003. A new formalization of minimum classification error using a Parzen estimate of classification chance. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing 2, 713-716.
26. Nadas, A., Nahamoo, D., Picheny, M., 1988. On a model-robust training method for speech recognition. IEEE Transactions on Signal Processing 36 (9), 1432-1435.
27. Normandin, Y., 1991. Hidden Markov models, Maximum Mutual Information Estimation, and the speech recognition problem. PhD Thesis, Department of Electrical Engineering, McGill University, Montreal.
28. Valtchev, V., Odell, J.J., Woodland, P.C., Young, S.J., 1996. Lattice-based discriminative training for large vocabulary speech recognition. Proceedings of the IEEE, International Conference on Acoustics, Speech and Signal Processing 2, 605-609.
29. Woodland, P., Povey, D., 2002. Large scale discriminative training of hidden Markov models for speech recognition. Computer Speech and Language 16, 25-47.