A Fused Hidden Markov Model with Application to Bimodal Speech Processing

IEEE Transactions on Signal Processing

Volumn 52, Issue 3, 2004, Pages 573-581

  Pan, Hao ^a   Levinson, Stephen E ^b   Huang, Thomas S ^b   Liang, Zhi Pei ^b  

^a SHARP LABORATORIES OF AMERICA   (United States)

^b UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

Bimodal speech processing; Hidden Markov model; Information fusion

Indexed keywords

ACOUSTIC SIGNAL PROCESSING; ERROR ANALYSIS; FUNCTION EVALUATION; INFORMATION ANALYSIS; INFORMATION THEORY; LEARNING ALGORITHMS; MARKOV PROCESSES; MATHEMATICAL MODELS; MODAL ANALYSIS; PARAMETER ESTIMATION; PROBABILISTIC LOGICS; SIGNAL THEORY; SPEECH RECOGNITION; TIME SERIES ANALYSIS;

BIMODAL SPEECH PROCESSING; HIDDEN MARKOV MODEL (HMM); INFORMATION FUSION;

SPEECH PROCESSING;

EID: 1542303714     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2003.822353     Document Type: Article

References (26)

1. J. Bigun and G. Chollet, "Special issue on audio- and video-based person authentication," Pattern Recogn. Lett., vol. 18, pp. 823-825, Sept. 1997.
2. U. Dieckmann, P. Plankenstener, R. Schamburger, B. Froba, and S. Meller, SEAM: A Biometric Person Identification System Using Sensor Fusion, no. 18, pp. 827-833, Sept. 1997.
3. J. Kittler, J. Matas, K. Jonsson, and M. U. R. Sanchez, "Combining evidence in personal identity verification systems," Pattern Recogn. Lett., pp. 845-852, Sept. 1997.
4. J. S. Mason, '"Watch these lips' - Add to acoustic signals to improve speaker recognition," in Audio- and Video-Based Biometric Person Authentication, J. Bigun, G. Chollet, and G. Borgefors, Eds. New York: Springer-Verlag, 1997, vol. 1206, Lecture Notes in Computer Science, pp. 289-290.
5. E. S. Bigun, J. Bigun, B. Duc, and S. Fischer, "Expert conciliation for multi modal person authentication systems by Bayesian statitics," in Audio- and Video-Based Biometric Person Authentication, J. Bigun, G. Chollet, and G. Borgefors, Eds. New York: Springer-Verlag, 1997, vol. 1206, Lecture Notes in Computer Science, pp. 291-300.
6. B. Duc, G. Maitre, S. Fischer, and J. Bigun, "Person authentication by fusing face and speech information," in Audio- and Video-Based Biometric Person Authentication, J. Bigun, G. Chollet, and G. Borgefors, Eds. New York: Springer-Verlag, 1997, vol. 1206, Lecture Notes in Computer Science, pp. 311-320.
7. P. Jourlin, J. Luettin, D. Genoud, and H. Wassner, "Acoustic-labial speaker verification," in Audio- and Video-Based Biometric Person Authentication, J. Bigun, G. Chollet, and G. Borgefors, Eds. New York: Springer-Verlag, 1997, vol. 1206, Lecture Notes in Computer Science, pp. 319-326.
8. L. Reveret and C. Benoit, "A viseme-based approach to labiometrics for automatic lipreading," in Audio- and Video-Based Biometric Person Authentication, J. Bigun, G. Chollet, and G. Borgefors, Eds. New York: Springer-Verlag, 1997, vol. 1206, Lecture Notes in Computer Science, pp. 335-342.
9. P. L. Silsbee and A. C. Bovik, "Computer lipreading for improved accuracy in automatic speech recognition," IEEE Trans. Speech Audio Processing, vol. 4, pp. 337-350, May 1996.
10. M. J. Tomlinson, M. J. Russell, and N. M. Brooke, "Integrating audio and visual information to provide highly robust speech recognition," in Proc. Int. Conf. Acoust., Speech, Signal Process., vol. 2, 1996, pp. 821-824.
11. P. Niyogi, E. Petajan, and J. Zhong, "Feature based representation for audio-visual speech recongition," in Proc. Int. Conf. Auditory-Visual Speech Process., 1999.
12. M. Brand, "Coupled hidden markov models for modeling interacting processes," Media Lab., Mass. Inst. Technol., Boston, MA, 405, 1997.
13. M. Brand and N. Oliver, "Coupled hidden Markov models for complex action recognition," in Proc. Computer Vision Pattern Recogn., 1997, pp. 201-206.
14. M. Brand, "A Bayesian Computer Vision System for Modeling Human Interaction," Media Lab., Mass. Inst. Technol., Boston, MA, 459, 1998.
15. L. K. Saul and M. I. Jordan, "Mixed memory Markov model: Decomposing complex stochastic processes as mixture of simpler ones," Machine Learning, vol. 37, pp. 75-88, Oct. 1999.
16. A. P. Dempster, N. M. Laird, and D. Rubin, "Maximum likelihood from incomplete data via EM algorithm," J. R. Statist. Soc., vol. 39, pp. 1-38, 1977.
17. A. J. Viterbi, "Error bounds for convolutional codes and an asymptotically optimal decoding algorithm," IEEE Trans. Inform. Theory, vol. IT-13, pp. 260-269, Apr. 1967.
18. G. D. Forney, "The Viterbi algorithm," Proc. IEEE, pp. 268-278, Mar. 1973.
19. S. P. Luttrell, "The use of Bayesian and entropic methods in neural network theory," in Maximum Entropy and Bayesian Methods. Boston, MA: Kluwer, 1989, pp. 363-370.
20. _, "A hierarchical network for clutter and texture modeling," in Proc. SPIE Conf. Adaptive Signal Process., 1991, pp. 518-528.
21. H. Pan, Z.-P. Liang, and T. S. Huang, "Estimation of the joint probability of multisensory signals," Pattern Recogn. Lett., vol. 22, pp. 1431-1437, Nov. 2001.
22. R. M. Gray, Entropy and Information Theory. New York: Springer-Verlag, 1990.
23. S. E. Levinson, L. R. Rabiner, and M. M. Soudhi, "An introduction to the application of the theory of probabilistic functions of a Markov process to automatic speech recognition," Bell Syst. Tech. J., vol. 62, pp. 1035-1074, Apr. 1983.
24. L. R. Rabiner and R. W. Schafer, Digital Processing of Speech Signals. Englewood Cliffs, NJ: Prentice-Hall, 1978.
25. L. Rabiner and B.-H. Juang, Fundamentals of Speech Recognition. Englewood Cliffs, NJ: Prentice-Hall, 1992.
26. A. Gersho and R. M. Gray, Vector Quantization and Signal Compression. Boston, MA: Kluwer, 1991.