Real-time tracking of multiple sound sources by integration of in-room and robot-embedded microphone arrays

IEEE International Conference on Intelligent Robots and Systems

Volumn , Issue , 2006, Pages 852-859

  Nakadai, Kazuhiro ^a   Nakajima, Hirofumi ^b   Murase, Masamitsu ^c   Okuno, Hiroshi G ^c   Hasegawa, Yuji ^a   Tsujino, Hiroshi ^a  

^a HONDA RESEARCH INSTITUTE JAPAN CO LTD   (Japan)

^b Nittobo Acoustic Engineering Co Ltd   (Japan)

^c KYOTO UNIVERSITY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

EMBEDDED SYSTEMS; MICROPHONES; PARAMETER ESTIMATION; REAL TIME SYSTEMS; ROBUSTNESS (CONTROL SYSTEMS); TRACKING (POSITION);

PARTICLE FILTER; ROBOT-EMBEDDED MICROPHONE ARRAY (REMA); SOUND SOURCES;

ROBOTIC ASSEMBLY;

EID: 34250684156     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IROS.2006.281737     Document Type: Conference Paper

References (25)

1. Y. Sugita and Y. Suzuki, "Audiovisual perception: Implicit estimation of sound-arrival time," Nature, vol. 421, p. 911, 2003.
2. H. McGurk and J. MacDonald, "Hearing lips and seeing voices," Nature, vol. 264, pp. 746-748, 1976.
3. D. H. Mershon et al., Mills, "Perceived loudness and visually-determined auditory distance," Perception, vol. 10, pp. 531-543, 1981.
4. L. Jeffress, "A place theory of sound localization," Journal of Comparative Physiology and Psychology, vol. 41, pp. 35-39, 1948.
5. G. Potamianos and C. Neti, "Stream confidence estimation for audio-visual speech recognition," in ICSLP 2000. ISCA, 2000, pp. 746-749.
6. J. Hershey et al., "Audio vision: Using audio-visual synchrony to locate sounds," NIPS 2000 , vol. 12. MIT Press, pp. 813 - 819.
7. I. Hara et al., "Robust speech interface based on audio and video information fusion for humanoid HRP-2," IROS-2004. pp. 2404-2410.
8. J.-M. Valin et al., "Localization of simultaneous moving sound sources for mobile robot using a frequency-domain steered beamformer approach," ICRA 2004.
9. K. Nakadai et al., "Improvement of recognition of simultaneous speech signals using av integration and scattering theory for humanoid robots," Speech Communication, vol. 44, pp. 97-112, 2004.
10. P. Aarabi and S. Zaky, "Robust sound localization using multi-source audiovisual information fusion," Information Fusion, vol. 2, no. 3, pp. 209-223, 2001.
11. H. Silverman et al., "The huge microphone array," LEMS, Brown University," Technical Report, 1996.
12. E. Weinstein et al., "Loud: A 1020-node modular microphone array and beamformer for intelligent computing spaces," MIT, M1T/LCS Technical Memo MIT-LCS-TM-642, 2004.
13. S. Yamamoto et al., "Improvement of robot audition by interfacing sound source separation and automatic speech recognition with missing feature theory," ICRA-2004, pp. 1517-1523.
14. F. Asano et al., "Real-time sound source localization and separation system and its application to automatic speech recognition," in Eurospeech 2001. ISCA, Ed., 2001, pp. 1013-1016.
15. K. Nakadai et al., "Sound source tracking with directivity pattern estimation using a 64 ch microphone array," IROS 2005, pp. 196-202.
16. S. Thrun et al., Probabilistic Robotics. The MIT Press, 2005.
17. M. S. Arulampalam et al., "A tutorial on particle filters for online nonlinear/non-gaussian bayesian tracking," IEEE Trans. on Signal Processing, vol. 50, no. 2, pp. 174-188, 2002.
18. D. B. Ward and R. C. Williamson, "Particle filtering beamforming for acoustic source localization in a reverberant environment," ICASSP 2002. vol. II, IEEE, pp. 1777-1780.
19. D. B. Ward et al., "Particle filtering algorithms for tracking an acoustic source in a reverberant environment," IEEE Trans. on Speech and Audio Processing, vol. 11, no. 6, pp. 826 - 836, 2003.
20. J. Vermaak and A. Blake, "Nonlinear filtering for speaker tracking in noisy and reverberant environments," ICASSP 2001, vol. 5, IEEE, pp. 3021-3024.
21. J.-M. Valin, "Auditory system for robot," Ph.D. dissertation, Universitè de Sherbrooke, 2005.
22. J. MacCormick and A. Blake, "A probabilistic exclusion principle for tracking multiple objects," Int'l Journal of Computer Vision, vol. 39, no. 1, pp. 57-71, 2000.
23. C. Hue et al., "A particle filter to track multiple objects," in IEEE Workshop on Multi-Object Tracking, IEEE, Ed., 2001, pp. 61-68.
24. H. Asoh et al., "An application of a particle filter to bayesian multiple sound source tracking with audio and video information fusion," in Int'l Conf. on Information Fusion, 2004, pp. 805-812.
25. H. Nakajima et al., "Minimum sidelobe beamforming based on minimax criterion," Journal of Acous. Sci. and Tech., pp. 486-488, 2004.