Robust sound localization using multi-source audiovisual information fusion

Information Fusion

Volumn 2, Issue 3, 2001, Pages 209-223

  Aarabi, Parham ^a   Zaky, Safwat ^b  

^a Stanford University   (United States)

^b UNIVERSITY OF TORONTO   (Canada)

Author keywords

Data integration; Microphone arrays; Multi sense multi source information fusion; Sound localization; Vision

Indexed keywords

EID: 0035458007     PISSN: 15662535     EISSN: None     Source Type: Journal    
DOI: 10.1016/S1566-2535(01)00035-5     Document Type: Article

References (33)

1. M. Coen, Design principles for intelligent environments, in: Proceedings of the 1998 National Conference on Artificial Intelligence, 1998.
2. Pentland A. Smart rooms. Scientific American. 274(4):1996;68-76.
3. R.A. Brooks, M. Coen, D. Dang, J. DeBonet, J. Kramer, T. Lozano-Perez, J. Mellor, P. Pook, C. Stauffer, L. Stein, M. Torrance, M. Wessler, The intelligent room project, in: Proceedings of the Second International Cognitive Technology Conference (CT'97), Aizu, Japan, August 1997.
4. M. Torrance, Advances in human-computer interaction: the intelligent room, in: Working Notes of the CHI 95 Research Symposium, Denver, CO, May 1995.
5. P. Aarabi, Multi-sense artificial awareness, M.A.Sc. Thesis, Department of Electrical and Computer of Engineering, University of Toronto, June 1999.
6. D. Rabinkin, A DSP implementation of source location using microphone arrays, in: Proceedings of the 131st meeting of the Acoustical Society of America, Indianapolis, Indiana, May 1996.
7. P.N. Bellhumeur, A binocular stereo algorithm for reconstructing sloping, creased, and broken surfaces in the presence of half-occlusion, in: Proceedings of the 4th International Conference on Computer Vision, Berlin, Germany, 1993.
8. Tomasi C., Kanade T. Shape and motion from image streams under orthography: a factorization method. International Journal of Computer Vision. 9:1992;137-154.
9. Wightman F.L., Kistler D. The dominant role of low-frequency interaural time differences in sound localization. Journal of the Acoustical Society of America. 91(3):1992;1648-1661.
10. Yost W.A., Gourevitch G. Directional Hearing. 1987;Springer, New York.
11. P. Aarabi, S. Zaky, Iterative spatial probability based sound localization, in: Proceedings of the 4th World Multiconference on Circuits, Systems, Computers, and Communications, Athens, Greece, July 2000.
12. K. Guentchev, J. Weng, Learning-based three dimensional sound localization using a compact non-coplanar array of microphones, in: 1998 AAAI Symposium on Intelligent Environments, 1998.
13. M.S. Brandstein, A framework for speech source localization using sensor arrays, Doctoral Dissertation, Department of Electrical Engineering, Brown University, May 1995.
14. Brandstein M.S., Silverman H. A practical methodology for speech source localization with microphone arrays. Computer, Speech, and Language. 11(2):1997;91-126.
15. M.S. Brandstein, H. Silverman, A robust method for speech signal time-delay estimation in reverberant rooms, in: Proceedings of the IEEE Conference on Acoustics, Speech, and Signal Processing, Atlanta, Georgia, May 1996.
16. Knapp C.H., Carter G. The generalized correlation method for estimation of time delay. IEEE Transactions on Acoustics, Speech, and Signal Processing. ASSP-24(4):1976;320-327.
17. Schmidt R.O. Multiple emitter location and signal parameter estimation. IEEE Transactions on Antennas and Propagation. AP-34(3):1986;276-280.
18. Watanabe H., Suzuki M., Nagai N., Miki N. A method for maximum likelihood bearing estimation without nonlinear maximization. Transactions of the Institute of Electronics, Information, and Communication Engineers. J72A(8):1989;303-308.
19. P. Aarabi, S. Zaky, Integrated vision and sound localization, in: Proceedings of the 3rd International Conference on Information Fusion, Paris, France, July 2000.
20. Huang J., Ohnishi N., Sugie N. Sound localization in reverberant environment based on the model of the Precedence effect. IEEE Transactions on Instrumentation and Measurement. 46(4):1997;842-846.
21. R.E. Irie, Multimodal sensory integration for localization in a humanoid robot, in: Proceedings Of the Second IJCAI Workshop of Computational Auditory Scene Analysis, 1997, pp. 54-58.
22. J. Huang, T. Supaongprapa, I. Terakura, F. Wang, N. Ohnishi, N., Sugie, A model based sound localization system and its application to robot navigation, robotics and autonomous systems 27(4) (1999) 199-209.
23. I. Fermin, H. Ishiguro, H.G. Okuno, H. Kitano, A framework for integrating sensory information in a humanoid robot, in: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS-2000), Takamatsu, November 2000, pp. 1748-1753.
24. J. Backman, M. Karjalainen, Modelling of human directional and spatial hearing using neural networks, in: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, Minneapolis, MN, April 1993, pp. 125-128.
25. N. Bhadkamkar, B. Fowler, A sound localization system based on biological analogy, in: Proceedings of the IEEE International Conference on Neural Networks, San Francisco, CA, March 1993, pp. 1902-1907.
26. W. Chau, R.O. Duda, Combined monaural and binaural localization of sound sources, in: Proceedings of the Twenty-Ninth Annual Asilomar Conference on Signals, Systems and Computers, Asilomar, CA, October 1995.
27. Datum M.S., Palmieri F., Moise A. An artificial neural network for sound localization using binaural cues. Journal of the Acoustical Society of America. 100(1):1996;372-383.
28. Huang J., Ohnishi N., Guo X., Sugie N. Echo avoidance in a computational model of the precedence effect. Speech Communication. 27:1999;223-233.
29. Huang J., Ohnishi N., Sugie N. A biomimetic system for localization and separation of multiple sound sources. IEEE Transactions on Instrumentation and Measurement. 44(3):1995;733-738.
30. P. Aarabi, S. Zaky, Iterative spatial probability based sound localization, in: Proceedings of the 4th World Multi-conference on Circuits, Systems, Computers, and Communications, Athens, Greece, July 2000.
31. P. Aarabi, Robust multi-source sound localization using temporal power fusion, in: Proceedings of Sensor Fusion: Architectures, Algorithms, and Applications V (AeroSense'01), Orlando, FL, April 2001.
32. P. Aarabi, The application of spatial likelihood functions to multi-camera object localization, in: Proceedings of Sensor Fusion: Architectures, Algorithms, and Applications V (AeroSense'01), Orlando, FL, April 2001.
33. P. Aarabi, The equivalence of Bayesian multi-sensor information fusion and neural networks, in: Proceedings of Sensor Fusion: Architectures, Algorithms, and Applications V (AeroSense'01), Orlando, FL, April 2001.