Automatic speech recognition improved by two-layered audio-visual integration for robot audition

9th IEEE-RAS International Conference on Humanoid Robots, HUMANOIDS09

Volumn , Issue , 2009, Pages 604-609

  Yoshida, Takami ^a   Nakadai, Kazuhiro ^a,b   Okuno, Hiroshi G ^c  

^a TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

^b HONDA RESEARCH INSTITUTE JAPAN CO LTD   (Japan)

^c KYOTO UNIVERSITY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTIC ENVIRONMENT; ACOUSTIC FEATURES; AUDIO FEATURES; AUDIO VISUAL SPEECH RECOGNITION; AUDIO-VISUAL; AUDIO-VISUAL INTEGRATION; AUTOMATIC SPEECH RECOGNITION; CHANGING ENVIRONMENT; EMPIRICAL RESULTS; ENVIRONMENTAL NOISE; MICROPHONE ARRAY PROCESSING; MICROPHONE ARRAYS; NOISE CONDITIONS; NOISY ENVIRONMENT; RELIABILITY ESTIMATION; ROBOT AUDITION; VISUAL FEATURE; VOICE ACTIVITY; VOICE ACTIVITY DETECTION;

ANTHROPOMORPHIC ROBOTS; ARRAY PROCESSING; AUDIO ACOUSTICS; AUDITION; BAYESIAN NETWORKS; INFERENCE ENGINES; MICROPHONES; RELIABILITY THEORY; REMELTING;

SPEECH RECOGNITION;

EID: 77950563943     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICHR.2009.5379586     Document Type: Conference Paper

References (17)

1. K. Nakadai, T. Lourens, H. G. Okuno, and H. Kitano, "Active audition for humanoid ," in Proc. of 17th National Conference on Artificial Intelligence (AAAI), pp. 832-839, 2000.
2. S. Yamamoto, K. Nakadai, M. Nakano, H. Tsujino , J.-M. Valin, K. Komatani, T. Ogata, and H. G. Okuno, "Real-time robot audition system that recognizes simultaneous speech in the real world," in Proc. ofIEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 5333-5338, 2006.
3. G. Potamianos , C. Neti, G. Iyengar, A. Senior, and A. Verma, "A cascade visual front end for speaker independent automatic speechreading," Speech Technology, Special Issue on Multimedia, Vol. 4, pp. 193-208,2001.
4. S. Tamura, K. Iwano, and S. Furui, "A stream-weight optimization method for multi-stream hmms based on likelihood value normalization," in Proc. of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), SP-P5.2, 2005.
5. J. Fiscus, "A post-processing systems to yield reduced word error rates : Recogniz er output voting error reduction (rover)," in Proc. of the Workshop on Automatic Speech Recognition and Understanding (ASRU). pp. 347-354, 1997.
6. T. Koiwa, K. Nakadai, and J. Irnura, "Coarse speech recognition by audio-visual integration based on missing feature theory," in Proc. of IEEE/RAS Int. Corf. on Intelligent Robots and Systems (IROS). pp. 1751-1756,2007.
7. K. Nakadai, H. Okuno, H. Nakajima, Y. Hasegawa, and H. Tsujino, "An open source software system for robot audition HARK and its evaluation," in Proc. of IEEE-RAS International Conference on Humanoid Robots (Humanoids). pp. 561-566, 2008.
8. "http://julius.sourceforge.jp/."
9. P. Liu and Z. Wang, "Voice activity detection using visual information," in Proc. of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 609-612, 2004.
10. B. Rivet, L. Girin, and C. Jutten, "Visual voice activity detection as a help for speech source separation from convolutive mixtures," Speech Communication, Vol. 49, no. 7-8, pp. 667-677, 2007.
11. K. Murai and S. Nakamura, "Face-to-talk: audio-visual speech detection for robust speech recognition in noisy environment," IEICE Trans. Inf. & Syst., vol.E86-D, no. 3, pp. 505-513, 2003.
12. F. Asano, Y.Motomura and S. Nakamura, "Fusion of audio and video information for detecting speech events," in Proc. International Conference on Information Fusion, pp. 386-393, 2003.
13. K. Nakadai, D. Matsuura, H. G. Okuno, and H. Tsujino, "Improvement of recognition of simultaneous speech signals using av integration and scattering theory for humanoid robots," Speech Communication, Vol. 44, pp. 97-112, 2004.
14. F. Asano, M. Goto, K. Itou, and H. Asoh, "Real-time sound source localization and separation system and its application to automatic speech recognition." in Proc. of International Conference on Speech Processing (Eurospeech). pp. 1013-1016, Sep. 2001.
15. J.-M. Valin, J. Rouat, and F.Michaud , "Enhanced robot audition based on microphone array source separation with post-filter," in Proc. of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). pp. 2123-2128, 2004.
16. Y. Nishimura, T. Shinozaki , K. Iwano, and S. Furui, "Noise-robust speech recognition using multi-band spectral features," in Proc. of 148th Acoustical Society ofAmerica Meetings, no. IaSC7, 2004.
17. Y. Nishimura, M. Ishizuka, K. Nakadai, M. Nakano, and H. Tsujino, "Speech recognition for a humanoid with motor noise utilizing missing feature theory," in Proc. of 6th IEEE-RAS International Conference on Humanoid Robots (Humanoids). pp. 26-33, 2006.