A Bayesian Classification Approach with Application to Speech Recognition

IEEE Transactions on Signal Processing

Volumn 39, Issue 10, 1991, Pages 2157-2166

  Merhav, Neri ^a   Ephraim, Yariv ^a  

^a LUCENT TECHNOLOGIES   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DECISION THEORY AND ANALYSIS; INFORMATION THEORY; PROBABILITY - RANDOM PROCESSES;

ASYMPTOTIC OPTIMALITY; BAYESIAN CLASSIFICATION; HIDDEN MARKOV MODELS;

SPEECH;

EID: 0026239053     PISSN: 1053587X     EISSN: 19410476     Source Type: Journal    
DOI: 10.1109/78.91172     Document Type: Article

References (33)

1. L. R. Rabiner, “A tutorial on hidden Markov Models and selected applications in speech recognition,” Proc. IEEE, vol. 77, no. 2, pp. 257–286, Feb. 1989.
2. J. Ziv, “Universal decoding for finite-state channels,” IEEE Trans. Inform. Theory, vol. IT-31, no. 4, pp. 453–460, 1985.
3. S. U. H. Qureshi, “Adaptive equalization,” Proc. IEEE, vol. 73, no. 9, pp. 1349–1387, Sept. 1985.
4. A. Nadas, “Optimal solution of a training problem in speech recognition,” IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-33, no. 1, pp. 326–329, 1985.
5. L. E. Baum, T. Petrie, G. Soules, and N. Weiss, “A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains,” Ann. Math. Stat., vol. 41, no. 1, pp. 164–171, 1970.
6. L. E. Baum, “An inequality and associated maximization technique in statistical estimation of probabilistic functions of Markov processes,” Inequalities, vol. 3, no. 1, pp. 1–8, 1972.
7. L. A. Liporace, “Maximum likelihood estimation for multivariate observations of Markov sources,” IEEE Trans. Inform. Theory, vol. IT-28, no. 5, pp. 729–734, Sept. 1982.
8. S. Kullback, Information Theory and Statistics. New York: Dover, 1968.
9. Y. Ephraim, A. Dembo, and L. R. Rabiner, “A minimum discrimination information approach for hidden Markov modeling,” IEEE Trans. Inform. Theory, vol. 35, pp. 1001–1013, Sept. 1989.
10. P. F. Brown, “The acoustic-modeling problem in automatic speech recognition,” Ph.D. dissertation, Dep. Computer Sci., Camegie Mellon Univ., Pittsburgh, PA, 1987.
11. L. R. Bahl, P. F. Brown, P. V. de Souza, and R. L. Mercer, “Maximum mutual information estimation of hidden Markov model parameters for speech recognition,” in Proc. IEEE Int. Conf. Acoust., Speech, Signal Processing, Apr. 1986, pp. 49–52.
12. Y. Ephraim and L. R. Rabiner, “On the relations between modeling approaches for speech recognition,” IEEE Trans. Inform. Theory, vol. 36, 372–380, Mar. 1990.
13. J. Ziv, “On classification with empirically observed statistics and universal data compression,” IEEE Trans. Inform. Theory, vol. IT-34, no. 2, pp. 278–286, 1988.
14. M. Gutman, “Asymptotically optimal classification for multiple tests with empirically observed statistics,” IEEE Trans. Inform. Theory, vol. 35, no. 2, pp. 401–408, Mar. 1989.
15. C. E. Shannon, “A mathematical theory of communication,” Bell Syst. Tech., J., vol. 27, pp. 379–423, 623–656, 1948.
16. R. G. Gallager, Information Theory and Reliable Communications. New York: Wiley, 1968.
17. I. Csiszar, T. M. Cover, and B.-S. Choi, “Conditional limit theorems under Markov conditioning,” IEEE Trans. Inform. Theory, vol. IT-33, no. 6, pp. 788–801, May 1987.
18. G. D. Forney, Jr., “Exponential error bounds for erasure, list, and decision feedback schemes,” IEEE Trans. Inform. Theory, vol. IT-14, pp. 206–220, Mar. 1968.
19. Y. Ephraim, “Gain adapted hidden Markov models for recognition of clean and noisy speech,” Trans. Signal Processing, to be pub lished.
20. J. D. Markel and A. H. Gray, Jr., Linear Prediction of Speech. New York: Springer, 1976:
21. Y. Ephraim, D. Malah, and B.-H. Juang, “On the application of hidden Markov models for enhancing noisy speech,” IEEE Trans. Acoust., Speech, Signal Processing, vol. 37, no. 12, pp. 1846–1856, Dec. 1989.
22. B.-H. Juang and L. R. Rabiner, “The segmental K-means algorithm for estimating parameters of hidden Markov models,” IEEE Trans. Acoust., Speech, Signal Processing, vol. 38, no. 9, pp. 1639–1641, Sept. 1990.
23. A. P. Dempster, N. M. Laird, and D. B. Rubin, “Maximum likelihood from incomplete data,” J. Roy. Stat. Soc., vol. B-39, pp. 1–38, 1977.
24. N. Merhav and Y. Ephraim, “Maximum likelihood hidden Markov modeling using a dominant sequence of states,” vol. 39, no. 9, pp. 2111–2115, 1991.
25. R. M. Gray, A. H. Gray, Jr., G. Rebolledo, and J. E. Shore, “Rate distortion speech coding with a minimum discrimination information distortion measure,” IEEE Trans. Inform. Theory, vol. IT-27, no. 6, pp. 708–721, Nov. 1981.
26. R. Billi, “Vector quantization and Markov source models applied to speech recognition,” in Proc. IEEE Int. Conf. Acoust., Speech, Signal Processing, Apr. 1982, 574–577.
27. A. Buzo, A. H. Gray, Jr., R. M. Gray, and J. D. Markel, “Speech coding based on vector quantization,” IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-28, no. 5, pp. 562–574, Oct. 1980.
28. F. Itakura and S. Saito, “A statistical method for estimation of speech spectral density and formant frequencies,” Electron. Commun. Japan, vol. 53-A, no. 1, pp. 36–43, 1970.
29. K. Dzhaparidze, Parameter Estimation and Hypothesis Testing in Spectral Analysis of Stationary Time Series. New York: Springer, 1986.
30. R. M. Gray, A. Buzo, A. H. Gray, Jr., and Y. Matsuyama, “Distortion measures for speech processing,” IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-28, no. 4, pp. 367–376, Aug. 1980.
31. B. S. Atal, “Effectiveness of linear prediction characteristics of the speech wave for automatic speaker identification and verification,” J. Acoust. Soc. Amer., vol. 55, no. 6, 1304–1312, June 1974.
32. A. R. Barron, “The strong ergodic theorem for densities: Generalized Shannon-McMillan-Breiman theorem,” Ann. Probability, vol. 13, no. 4, pp. 1292–1303, 1985.
33. S. Natarajan, “Large deviation, hypothesis testing, and source coding for finite Markov chains,” IEEE Trans. Inform. Theory, vol. IT-13, no. 3, pp. 360–365, May 1985.