SNR-adaptive stream weighting for audio-MES ASR

IEEE Transactions on Biomedical Engineering

Volumn 55, Issue 8, 2008, Pages 2001-2010

  Lee, Ki Seung ^a  

^a Konkuk University   (South Korea)

Author keywords

Automatic speech recognition; Decision fusion; Maximum mutualinformation (MMI) criterion; Myoelectric signals (MESs); Optimalweighting

Indexed keywords

ACOUSTIC INTENSITY; ACOUSTIC NOISE; ACOUSTICS; CLASSIFICATION (OF INFORMATION); FEATURE EXTRACTION; REMELTING; SIGNAL TO NOISE RATIO; SPEECH; SPEECH RECOGNITION; STEREOPHONIC BROADCASTING; UNDERWATER ACOUSTICS;

BABBLE NOISE; CLASSIFICATION ACCURACIES; CLEAN SPEECH; DECISION FUSION; LINEAR COMBINATION (LC); MAXIMUM MUTUAL INFORMATION (MMI); MYO ELECTRIC SIGNALS; NOISE ROBUSTNESS; OBSERVATION VECTORS; SPEECH RECOGNIZERS; WEIGHTING METHODS;

AUDIO ACOUSTICS;

AIRCRAFT; ARTICLE; AUTOMATIC SPEECH RECOGNITION; INFORMATION PROCESSING; MYOELECTRIC SIGNAL; SIGNAL NOISE RATIO; SIGNAL TRANSDUCTION; WHITE NOISE;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; ELECTROMYOGRAPHY; HUMANS; PATTERN RECOGNITION, AUTOMATED; SPEECH PRODUCTION MEASUREMENT; SPEECH RECOGNITION SOFTWARE;

EID: 47649106240     PISSN: 00189294     EISSN: None     Source Type: Journal    
DOI: 10.1109/TBME.2008.921094     Document Type: Article

References (33)

1. S. Kumar, D. K. Kumar, M. Alemu, and M. Burry, "EMG based voice recognition," in Proc. IEEE ISSNIP, 2004, pp. 597-596.
2. W. C. Yau, D. K. Kumar, S. P. Arjunan, and S. Kumar, "Visual speech recognition using image moments and multiresolution wavelet images," in Proc. Int. Conf. Comput. Graph., Imag. Vis., Jul., 2006, pp. 194-199.
3. H. Manabe and Z. Zhang, "Multi-stream HMM for EMG-based speech recognition," in Proc. 26th Annu. Int. Conf. IEEE EMBS, San Francisco, CA, 2004, pp. 4389-4392.
4. C. Jorgensen, D. D. Lee, and S. Agabon, "Sub auditory speech recognition based on EMG signals," in Proc. Int. Joint Conf. Neural Netw., 2003, vol. 4, pp. 3128-3133.
5. E. A. Goldstein, J. T. Heaton, J. B. Kobler, G. B. Stanley, and R. E. Hiiman, "Design and implementation of a hands-free electolarynx device controlled by neck strapmuscle electromyographic activity," IEEE Trans. Biomed. Eng., vol. 51, no. 2, pp. 325-332, Feb. 2004.
6. F. Grandori, P. Pinelli, P. Ravazzani, F. Ceriani, G. Miscio, F. Pisano, R. Colombo, S. Insalaco, and G. Tognola, "Multiparametric analysis of speech production mechanisms," IEEE Eng. Med. Biol. Mag., vol. 13, no. 2, pp. 203-209, Apr./May 1994.
7. H.-J. Park, S.-H. Kwon, H.-C. Kim, and K.-S. Park, "Adaptive EMG-driven communication for the disability," presented at the 1st Joint BMES/EMBS Conf. Serving Humanity, Advancing Technol., Atlanta, GA, 1999, vol. 1.
8. A. D. C. Chan, K. B. Englehart, B. Hudgins, and D. F. Lovely, "Hidden Markov model classification of myoelectics signals in speech," IEEE Eng. Med. Biol. Mag., vol. 21, no. 5, pp. 143-146, Sep./Oct. 2002. Available: http://ieeexplore.ieee.org/xpls/abs_all.jsp?isnumber= 22371&arnumber=1044184&count=31&index=18.
9. A. D. C. Chan, K. B. Englehart, B. Hudgins, and D. F. Lovely, "Myoelectric signals to augment speech recogntion," Med. Biol. Eng. Comput., vol. 39, no. 4, pp. 500-504, 2001.
10. A. D. C. Chan, K. B. Englehart, B. Hudgins, and D. F. Lovely, "Multiexpert automatic speech recognition using acoustic and myoelectric signals," IEEE Trans. Biomed. Eng., vol. 53, no. 4, pp. 676-685, Apr. 2006.
11. E. J. Scheme, B. Hudgins, and P. A. Parker, "Myoelectric signal classification for phoneme-based speech recognition," IEEE Trans. Biomed. Eng., vol. 54, no. 4, pp. 694-699, Apr. 2007.
12. J. Hernando, "Maximum likelihood weighting of dynamic speech features for CDHMM speech recognition," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Munich, Germany, 1997, pp. 1267-1270.
13. G. Gravier, S. Axelroad, G. Potamianos, and C. Neti, "Maximum entropy and MCE based HMM stream weight estimation for audio-visual ASR," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Orlando, FL, 2002, vol. 1, pp. 853-856.
14. M. Heckmann, F. Berthommier, and K. Kroschel, "Noise adaptive stream weighting in audio-visual speech recognition," EURASIP J. Appl. Signal Process., vol. 11, pp. 1260-1273, 2002.
15. G. Potamianos, C. Neti, G. Gravier, A. Garg, and A. W. Senior, "Recent advances in the automatic recognition of audiovisual speech," Proc. IEEE, vol. 91, no. 9, pp. 1306-1326, Sep. 2003.
16. K.-S. Lee, "HMM-based automatic speech recognition using EMG signals," J. Biomed. Eng. Res. (J-BME), vol. 27, no. 3, pp. 101-109, Jun. 2006.
17. K.-S. Lee, "EMG-based speech recognition using hidden Markov models with global control variables," IEEE Trans. Biomed. Eng., vol. 55, no. 3, pp. 930-940, Mar. 2008.
18. R. S. Kumaran, K. Narayanan, and J. N. Gowdy, "Myoelectric signals for multimodal speech recognition," in Proc. INTERPEECH (Eurospeech), Lisboa, Portugal, 2005, pp. 1189-1192.
19. A. Q. Summerfield, "Lipreading and audio-visual speech perception," Philos. Trans. R. Soc. London B, vol. 335, pp. 71-78, 1992.
20. L. R. Rabiner and R. W. Schafer, Digital Processing of Speech Signals. Englewood Cliffs, NJ: Prentice-Hall, 1978.
21. L. R. Rabiner and B. H. Juang, Fundamentals of Speech Recognition. Englewood Cliffs, NJ: Prentice-Hall, 1993.
22. G. M. White and R. B. Neely, "Speech recognition experiments with linear prediction, bandpass filtering, and dynamic programming," IEEE Trans. Acoust. Speech Signal Process., vol. ASSP-24, no. 2, pp. 183-188, Apr. 1976.
23. A. Dempster, N. Laird, and D. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. Royal Stat. Soc., vol. 39, pp. 1-38, 1977.
24. Y. Linde, A. Buzo, and R. M. Gray, "An algorithm for vector quantizer design," IEEE Trans. Commun., vol. 28, no. 1, pp. 84-95, Jan. 1980.
25. D. A. Reynolds and R. C. Rose, "Robust text-independent speaker identification using Gaussian mixture speaker models," IEEE Trans. Acoust. Speech Signal Process., vol. 3, no. 1, pp. 72-83, Jan. 1995.
26. B.-H. Juang and L. R. Rabiner, "The segmental k-means algorithm for estimating paramters of hidden Markov model," IEEE Trans. Acoust., Speech Signal Process., vol. 38, no. 9, pp. 1639-1641, Sep. 1990.
27. A. K. Jain, R. P. W. Duin, and J. Mao, "Statistical pattern recognition: A review," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 1, pp. 4-37, Jan. 2000.
28. K. Nandakumar, Y. Chen, S. C. Dass, and A. K. Jain, "Likelihood ratio-based biometric score fusion," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 2, pp. 342-347, Feb. 2008.
29. L. Nan, S. Dettmer, and M. Shah, "Lipreading using eigensequences," in Proc. Int. Workshop Face Gesture Recog., 1995, pp. 30-34.
30. L. R. Bahl, P. F. Brown, P. V. deSouza, and L. R. Mercer, "Maximum mutual information estimation of hidden Markov model parameters for speech recognition," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Tokyo, Japan, Apr.1986, pp. 49-52.
31. R. McAulay and M. Malpass, "Speech enhancement using a soft-decision noise suppression filter," IEEE Trans. Acoust., Speech Signal Process., vol. 28, no. 2, pp. 137-145, Apr. 1980.
32. J.-H. Chang, N. S. Kim, and S. K. Mitra, "Voice activity detection based on multiple statistical models," IEEE Trans. Signal Process., vol. 54, no. 6, pp. 1965-1976, Jun. 2006.
33. M. D. Skowronski and J. G. Harris, "Noise-robust automatic speech recognition using a predictive echo state network," IEEE Trans. Audio, Speech, Language Process., vol. 15, no. 5, pp. 1724-1730, Jul. 2007.