Probabilistic speaker localization in noisy environments by audio-visual integration

IEEE International Conference on Intelligent Robots and Systems

Volumn , Issue , 2006, Pages 4704-4709

  Choi, Jong Suk ^a   Kim, Munsang ^a   Kim, Hyun Don ^b  

^a Korea Institute of Science and Technology   (South Korea)

^b KYOTO UNIVERSITY   (Japan)

Author keywords

Audio visual integration; Face tracking; Human robot interaction; Sound localization; Voice activity detection

Indexed keywords

CAMERAS; FACE RECOGNITION; INTELLIGENT ROBOTS; MICROPHONES; SPURIOUS SIGNAL NOISE;

AUDIO VISUAL INTEGRATION; FACE TRACKING; HUMAN ROBOT INTERACTION; SOUND LOCALIZATION; VOICE ACTIVITY DETECTION;

SPEECH ANALYSIS;

EID: 34250628527     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IROS.2006.282260     Document Type: Conference Paper

References (12)

1. J. Huang, N. Ohnishi, and N. Sugie, "A Biomimetio System for Localization and Separatioin of Multiple Sound Sources," in Proc. IEEE/IMTC Int. Conf. Intstrumentation and Measurement Technology, Hamaniatsu Japan, May 1994, pp. 967-970.
2. J. Huang, N. Ohnishi, and N. Sugie, "Sound Localization in Reverberant Environment Based on the Model of the Precedence Effect," IEEE Trans. an Instrumentation and Measurement, vol. 46, no 4, pp. 842-846, 1997.
3. J. Huang, T. Supaongprapa, I. Terakura, N. Ohnishi, and N. Sugie, "Mobile Robot and Sound Localization," in Proc. IEEE/RSJ Int. Conf. Intelligent Robots and Systems, Grenoble France, Sep. 1997, pp. 683-689.
4. J. Huang, N. Ohnishi, and N. Sugie, "Spatial localization of sound sources: azimuth and elevation estimation," in Proc. IEEE/IMTC Int. Conf. Instrumentation and Measurement Technology, St. Paul, MN USA, May 1998, pp. 330-333.
5. J. Huang, K. Kume, and A. Saji, "Robotics Spatial Sound Localization and its 3D Sound Human Interface," in Proc. IEEE Int. Sym. Cyber Worlds, pp. 191-197, 2002.
6. H. D. Kim, J. S. Choi, C. H. Lee, and M. S. Kim, "Reliable Detection of Sound's Direction for Human Robot Interaction," in Proc. IEEE/RSJ Int. Conf. Intelligent Robots and Systems, Sendai Japan, Sep. 2004, pp.2411-2416.
7. H. G. Okuno, K. Nakadai, K. Hidai, H. Mizoguchi, and H. Kitano, "Human-Robot Interaction through Real-Time Auditory and Visual Multiple-Talker Tracking," in Proc. IEEE/RSJ Int. Conf. Intelligent Robots and Systems, Hawaii USA, Oct. 2001, pp. 1402-1409.
8. K. Nakadai, K. Hidai, H. G. Okuno, and H. Kitano, "Real-Time Speaker Localization and Speech Separation by Audio-Visual Integration," in Proc. IEEE/RSJ Int. Conf. Intelligent Robots and Systems, Washington DC USA, May 2002, pp. 1043-1049.
9. H. Kobayashi, and T. Shimamura, "A Modified Cepstrum Method for Pitch Extraction," IEEE/APCCAS Int. Conf. Circuits and Systems, Nov. 1988, pp. 299-302.
10. S. Ahmadi, and A. S. Spanias, "Cepstrum-Based Detection Using a New Statistical V/UV Classification Algorithm," IEEE Trans. on Speech and Audio Processing, vol. 7, no 3, pp. 333-338, 1999.
11. R. Y. Tsai, "A Versatile Camera Calibration Technique for High-Accuracy 3D Machine Vision Metrology Using Off-the-Shelf TV Cameras and Lenses," IEEE Journal of Robotics and Automation, vol. 3, no 4, pp. 323-344, 1987.
12. I. Hara, F. Asano, Y. Kawai, F. Kanehiro and K. Yamamoto, "Robust Speech Interface Based on Audio and Video Information Fusion for Humanoid HRP-2," in Proc. IEEE/RSJ Int. Conf. Intelligent Robots and Systems, Sendai, Japan, Sep 2004, pp. 2404-2410.