Real-time acoustic source localization in noisy environments for human-robot multimodal interaction

Proceedings - IEEE International Workshop on Robot and Human Interactive Communication

Volumn , Issue , 2007, Pages 393-398

  Trifa, Vlad M ^a,b   Koene, Ansgar ^b,c   Morén, Jan ^b   Cheng, Gordon ^b,d  

^a ETH ZURICH   (Switzerland)

^b ATR CNS Humanoid Robotics and Computational Neuroscience

^c NATIONAL INSTITUTE OF INFORMATION AND COMMUNICATIONS TECHNOLOGY   (Japan)

^d JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTICS; AUDIO ACOUSTICS; BEHAVIORAL RESEARCH; EYE MOVEMENTS; FLOW INTERACTIONS; INTELLIGENT ROBOTS; METROPOLITAN AREA NETWORKS; OBJECT RECOGNITION; REVERSE OSMOSIS; ROBOTS; SPEECH RECOGNITION;

ACOUSTIC SOURCE LOCALIZATION; DISTRIBUTED CONTROLS; EXPLICIT COMMUNICATION; HEAD MOVEMENTS; HUMAN BEHAVIORS; HUMAN-ROBOT-INTERACTION (HRI); HUMANOID ROBOT (FHR-1); INTERACTIVE COMMUNICATIONS; INTERNATIONAL CONFERENCES; MULTIMODAL INTERACTION (MMI); MULTIPLE MODALITIES; NOISY ENVIRONMENTS; REAL TIME INTERACTIONS; SENSORY INFORMATION; SOUND LOCALIZATION; SOUND SOURCE LOCALIZATION (SSL); VIDEO INFORMATION; VISUAL TRACKING;

ROBOTICS;

EID: 48749105042     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ROMAN.2007.4415116     Document Type: Conference Paper

References (35)

1. R. Cole, J. Mariani, H. Uszkoreit, A. Zaenen, and V. Zue, "Survey of the state of the art in human language technology," 1997.
2. A. Ude, C. Gaskett, and G. Cheng, "Foveated vision systems with two cameras per eye," in Proc. IEEE Int. Conf. Robotics and Automation, Orlando, Florida,, May 2006, pp. 3457-3462.
3. K. Welke, E. Oztop, A. Ude, R. Dillmann, and G. Cheng, "Learning feature representations for an object recognition system," in IEEE-RAS/RSJ International Conference on Humanoid Robots (Humanoids 2006), December 2006.
4. P. Fitzpatrick, "From first contact to close encounters: A developmentally deep perceptual system for a humanoid robot." Ph.D. dissertation, Massachussets Institute of Technology, 2003.
5. S. Schaal, A. Ijspeert, and A. Billard, "Computational approaches to motor learning by imitation," In Frith, C. D.;Wolpert, D. (eds.), The Neuroscience of Social Interaction, Oxford University Press, pp. 199-218, 2005.
6. J. Blauert, Spatial Hearing: The psyhcophysics of Human Sound Localization. MIT Press, 1996.
7. G. Cheng, A. Nagakubo, and Y. Kuniyoshi, "Continuous humanoid interaction: An integrated perspective - gaining adaptivity, redundancy, flexibility - in one," Robotics and Autonomous Systems, vol. 37, pp. 161-183, 2001.
8. C. Benoit, J.-C. Martin, C. Pelachaud, L. Schomaker, and B. Suhm, Audio-visual and Multimodal Speech Systems. In D. Gibbon (Ed.) Handbook of Standards and Resources for Spoken Language Systems - Supplement Volume, to appear., 1998.
9. R. Bischoff and V. Graefe, "Integrating vision, touch and natural language in the control of a situation-oriented behavior-based humanoid robot," in IEEE International Conference on Systems, Man, and Cybernetics, 1999.
10. R. Brooks, C. Breazeal, M. Marjanovic, B. Scassellati, and M. Williamson, "The cog project: Building a humanoid robot," in Computation for Metaphors, Analogy and Agents, Springer Lecture Notes in Artificial Intelligence, C. Nehaniv, Ed., vol. 1562, 1998.
11. P. McGuire, J. Fritsch, J. J. Steil, F. Roethling, G. A. Fink, S. Wachsmuth, G. Sagerer, and H. Ritter, "Multi-modal human-machine communication for instructing robot grasping tasks," in Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Lausanne, Switzerland, 2002, pp. 1082-1089.
12. M. Shiomi, T. Kanda, N. Miralles, T. Miyashita, I. Fasel, J. Movellan, and H. Ishiguro, "Face-to-face interactive humanoid robot," in Proceedings of 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2004)., 2004.
13. Y. Matsusaka, T. Tojo, S. Kuota, K. Furukawa, D. Tamiya, K. Hayata, Y. Nakano, and T. Kobayashi, "Multi-person conversation via multimodal interface - a robot who communicates with multi-user," in Proceeding of Eurospeech, 1999, pp. 1723-1726.
14. K. Nakadai, K. Hidai, H. G. Okuno, and H. Kitano, "Real-time active human tracking by hierarchical integration of audition and vision," in Proceedings of 2001 IEEE-RAS International Conference on Humanoid Robots, 2001.
15. S. Shimojo and L. Shams, "Sensory modalities are not separate modalities: plasticity and interactions," Current opinion in Neurobiology, vol. 11, pp. 505-509, 2001.
16. E. Macaluso, "Multisensory processing in sensory-specific cortical areas," Neuroscientist, vol. 12, no. 4, pp. 327-338, 2006.
17. A. Koene, J. Moren, V. Trifa, and G. Cheng, "Gaze shift reflex in a humanoid active vision system," in International Computer Vision Systems (ICVS 2007)., 2007.
18. G. Cheng, S.-H. Hyon, J. Morimoto, A. Ude, and S. C. Jacobsen, "Cb: A humanoid research platform for exploring neuroscience," in IEEE-RAS/RSJ International Conference on Humanoid Robots (Humanoids 2006), 2006.
19. L. Jeffress, "A place theory of sound localization," J. Comp. Physiol. Psychol., vol. 41, pp. 35-39, 1948.
20. M. Rucci, J. Wray, and G. Edelman, "Robust localization of auditory and visual targets in a robotic barn owl," Journal of Robotics and Autonomous Systems, vol. 30, no. 1-2, pp. 181-194, 2000.
21. L. Natale, G. Metta, and G. Sandini, "Development of auditory-evoked reflexes: Visuo-acoustic cues integration in a binocular head," Robotics and Autonomous Systems, vol. 39, no. 2, pp. 87-106, 2002.
22. C. Schauer and P. Paschke, "A spike-based model of binaural sound localization." International Journal of Neural Systems, vol. 9, no. 5, pp. 447-452, 1999.
23. C. Schauer, "Modellierung primärer multisensorischer mechanismen der räumlichen wahrnehmung," Ph.D. dissertation, Fakultät für Informatik und Automatisierung der Technischen Universität Ilmenau, 2006.
24. L. Itti and C. Koch, "A saliency-based search mechanism for overt and covert shifts of visual attention," Vision Research, vol. 40, no. 10-12, pp. 1489-1506, 2002.
25. A. Ude, V. Wyart, L.-H. Lin, and G. Cheng, "Distributed visual attention on a humanoid robot," in Proceedings of 2005 IEEE-RAS International Conference on Humanoid Robots, 2005.
26. G. Cheng, K. Welke, L.-H. Lin, P. Azad, and A. Ude, "A concurrent architecture for humanoid robots to emulate biological processes," Robotics and Autonomous Systems, 2007.
27. J. Chen, J. Benesty, and Y. A. Huang, "Time delay estimation in room acoustic environments: an overwiev," EURASIP Journal on applied signal processing, vol. 2006, pp. 1-19, 2006.
28. C. Knapp and G. Carter, "The generalized correlation method for estimation of time delay," IEEE Transactions on Acoustics, Speech, and Signal Processing, 1976.
29. R. Moddemeijer, "An information theoretical delay estimator," Univ. of Twente, Enschende (NL), Tech. Rep. Report: 080.87.45, 1987.
30. M. A. Akeroyd, "Binaural toolbox." [Online]. Available: http://www.biols.susx.ac.uk/Home/Michael_Akeroyd/
31. M. Slaney, "Auditory toolbox," Interval Research Corporation, Tech. Rep. 1998-010, 1998.
32. M. Slaney and F. R. Lyon, "On the importance of time - a temporal representation of sound," Visual representations of speech signals, 1993.
33. S. N. Wrigley and G. J. Brown, "A model of auditory attention," University of Sheffield, Tech. Rep., 2000.
34. C. Chen, A. Ali, H. Wang, S. Asgari, H. Park, R. Hudson, K. Yao, and C. E. Taylor, "Design and testing of robust acoustic arrays for localization and beamforming," in IEEE IPSN, 2006.
35. K. E.I. and M. Konishi, "A neural map of auditory space in the owl," Science, vol. 200, no. 4343, pp. 795-797, 1978.