Coarse speech recognition by audio-visual integration based on missing feature theory

IEEE International Conference on Intelligent Robots and Systems

Volumn , Issue , 2007, Pages 1751-1756

  Koiwa, Tomoaki ^a,b   Nakadai, Kazuhiro ^a,b   Imura, Jun Ichi ^a  

^a TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

^b HONDA RESEARCH INSTITUTE JAPAN CO LTD   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

AUDIO-VISUAL; AUDIO-VISUAL SPEECH RECOGNITION; INTERNATIONAL CONFERENCES; MISSING FEATURE THEORY; REAL-WORLD;

ACOUSTIC NOISE; INTELLIGENT ROBOTS; INTELLIGENT SYSTEMS; ROBOTICS; SPEECH; SPEECH ANALYSIS;

SPEECH RECOGNITION;

EID: 51349110555     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IROS.2007.4399300     Document Type: Conference Paper

References (21)

1. K. Nakadai et al., "Improvement of recognition of simultaneous speech signals using AV integration and scattering theory for humanoid robots", Speech Communication, vol.44, 2004, pp.97-112.
2. C.J. Leggetter et al., "Maximum likelihood linear regression for speaker adaptation of continuous density hidden markov models", Computer Speech and Language, vol.9, 1995, pp. 171-185.
3. K. Nakadai et al., "Active audition for humanoid", in Proc. of 17th National Conference on Artificial Intelligence, 2000, pp.832-839.
4. S. Yamamoto et al., "Real-time robot audition system that recognizes simultaneous speech in the real world", IROS-2006, pp.5333-5338. IEEE.
5. I. Hara et al., "Robust speech interface based on audio and video information fusion for humanoid HRP-2", IROS-2004, pp.2404-2410. IEEE.
6. K. Nakadai et al., "Real-time auditory and visual multiple-object tracking for robots", IJCAI-2001, MIT Press, pp.1424-1432.
7. G. Potamianos et al., "A cascade visual front end for speaker independent automatic speechreading", Speech Technology, Special Issue on Multimedia, vol.4, 2001, pp.193-208.
8. S. Tamura et al., "A stream-weight optimization method for multi-stream hmms based on likelihood value normalization", Proc. of Int'l Conf. on Acoustics, Speech and Signal Processing, 2005, SP-P5.2.
9. J. Fiscus, "A post-processing systems to yield reduced word error rates: Recognizer output voting error reduction (ROVER)", in Proc. of the Workshop on Automatic Speech Recognition and Understanding, IEEE, 1997, pp.347-354.
10. J. Barker et al., "Robust ASR based on clean speech models: An evaluation of missing data techniques for connected digit recognition in noise", Proc. of 7fh European Conference on Speech Communication Technology, 2001, pp.213-216. ESCA.
11. A. Hagen et al., "Comparison of HMM experts with MLP experts in the full combination multi-band approach to robust ASR", Proc. of Int'l Conf. on Spoken Language Processing, 2000, pp.345-348.
12. H. Bourlard et al., "A new ASR approach based on independent processing and recombination of partial frequency bands", Proc. of Int'l Conf. on Spoken Language Processing, 1996, pp.426-429.
13. Y. Nishimura et al., "Speech recognition for a humanoid with motor noise utilizing missing feature theory", Proc. of Int'l Conf. on Humanoid Robots, 2006, pp.26-33. IEEE.
14. G. Miller et al., "An analysis of perceptual confusions among some english consonants", JASA, vol.27, 1955, pp.338-352.
15. B. Walden et al., "Effect of training on the visual recognition of consonants", J, of Speech and Hearing Research, vol.20, 1977, pp. 130-145.
16. D. Ringach, "Look at the big picture (details will follow)", Nature Neuroscience, vol.6, 2003, no.l, pp.7-8.
17. N. Sugamura et al., "Isolated word recognition using phoneme-like templates", Proc. of Int'l Conf. on Acoustics, Speech and Signal Processing, 1983, pp.723-726.
18. J.H.L. Hansen et al., "Markov model based phoneme class partitioning for improved constrained iterative speech enhancement", IEEE Trans. on Speech and Audio Processing, vol.3, 1995, no.l, pp.98-104.
19. L. Arslan et al., "Minimum cost based phoneme class detection for improved iterative speech enhancement", Proc. of Int'l Conf. on Acoustics, Speech and Signal Processing, vol.11, 1994, pp.45-48.
20. B. Beaumesnil et al., "Liptracking and mpeg4 animation with feed-back control", Proc. of Int'l Conf. on Acoustics, Speech and Signal Processing, vol.II, 2006, pp.677-680.
21. K. Palomaki et al., "Missing data speech recognition in reverberant conditions", Proc. of Int'l Conf. on Acoustics, Speech and Signal Processing, vol.I, 2002, pp.65-68.