Real-time speaker localization and speech separation by audio-visual integration

Proceedings - IEEE International Conference on Robotics and Automation

Volumn 1, Issue , 2002, Pages 1043-1049

  Nakadai, Kazuhiro ^a   Hidai, Ken Ichi ^a   Okuno, Hiroshi G ^a   Kitano, Hiroaki ^a  

^a JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

Author keywords

Audio visual integration; Multiple speaker tracking; Robot audition; Sound source localization; Sound source separation

Indexed keywords

ADAPTIVE FILTERING; AUDIO SYSTEMS; AUDITION; COMPUTER VISION; DISTRIBUTED COMPUTER SYSTEMS; FEATURE EXTRACTION; GEOMETRY; REAL TIME SYSTEMS; ROBUSTNESS (CONTROL SYSTEMS); SPEECH RECOGNITION;

AUDIO VISUAL INTEGRATION; EPIPOLAR GEOMETRY; GIGABIT ETHERNET; MULTIPLE SPEAKER TRACKING; ROBOT AUDITION; SOUND SOURCE LOCALIZATION; SOUND SOURCE SEPARATION; SPEECH EXTRACTS; SPEECH SEPARATION;

INTELLIGENT ROBOTS;

EID: 0036058193     PISSN: 10504729     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (16)

1. Active vision
2. Active audition system and humanoid exterior design
3. The cog project: Building a humanoid robot
4. A context-dependent attention system for a social robot
5. Multi-person conversation via multi-modal interface - A robot who communicates with multi-user
6. A multiresolution approach to blind separation of speech signals in a reverberant environment
7. Computational auditory scene analysis: Listening to several things at once
8. Harmonic sound stream segregation using localization and its application to speech stream segregation
9. Human-robot interaction through real-time auditory and visual multiple-talker tracking
10. Active audition for humanoid
11. Robust face detection against brightness fluctuation and size variation
12. Convergence analysis of online linear discriminant analysis
13. Real-time 3d optical flow generation system
14. Separating three simultaneous speeches with two microphones by integrating auditory and visual processing