Separating three simultaneous speeches with two microphones by integrating auditory and visual processing

EUROSPEECH 2001 - SCANDINAVIA - 7th European Conference on Speech Communication and Technology

Volumn , Issue , 2001, Pages 2643-2646

  Okuno, Hiroshi G ^a,b   Nakadai, Kazuhiro ^a   Lourens, Tino ^a   Kitano, Hiroaki ^a,c  

^a JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

^b KYOTO UNIVERSITY   (Japan)

^c SONY COMPUTER SCIENCE LABORATORIES INC   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTIC GENERATORS; FORMAL LOGIC; MICROPHONES; SPEECH COMMUNICATION;

AUDITORY PROCESSING; AUTOMATIC RECOGNITION; DEMPSTER-SHAFER THEORY; HYPOTHETICAL REASONING; INTERAURAL INTENSITY DIFFERENCES; INTERAURAL PHASE DIFFERENCES; SOUND SOURCE SEPARATION; VISUAL-PROCESSING;

SOURCE SEPARATION;

EID: 85009151501     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (18)

1. M. P. Cooke, G. J. Brown, M. Crawford, and P. Green, "Computational auditory scene analysis: Listening to several things at once, " Endeavour, 17(4): 186-190, 1993.
2. D. Rosenthal and H. G. Okuno, Eds., Computational Auditory Scene Analysis, Lawrence Erlbaum Associates, Mahwah, New Jersey, 1998.
3. V. K. Madisetti and D. B. Williams, Eds., The Digital Signal Processing Handbook, IEEE Press, 1997.
4. S. Makeig, S. Enghoff, T-P Jung, and T.J. Sejnowski, "A natural basis for efficient brain-Actuated control, " IEEE Trans. on Rehabi. Eng., vol. 8, 208-211, 2000.
5. N. Murata and S. Ikeda, "An on-line algorithm for blind source separation on speech signals, " in Proc. of 1998 International Symposium on Nonlinear Theory and its Applications, 1998, 923-927.
6. A. P. Varga and R. K. Moore, "Simultaneous recognition of concurrent speech signals using hidden markov model decomposition, " in Proc. of European Conference on Speech Communcation and Technology (EUROSPEECH- 91). 1991, 1175-1178, ESCA.
7. T. Nakatani and H. G. Okuno, "Harmonic sound stream segregation using localization and its application to speech stream segregation, " Speech Communication, vol. 27, no. 3-4, 209-222, 1999.
8. H. G. Okuno, T. Nakatani, and T. Kawabata, "Listening to two simultaneous speeches, " Speech Communication, vol. 27, no. 3-4, 281-298, 1999.
9. Y. Nakagawa, H. G. Okuno, and H. Kitano, "Using vision to improve sound source separation, " in Proc. of 16th National Conference on Artificial Intelligence (AAAI-99). 1999, 768-775, AAAI.
10. S. Ando, "An autonomous three-dimensional vision sensor with ears, " IEICE Transactions on Information and Systems, vol. E78-D, no. 12, 1621-1629, 1995.
11. G. J. Wolff, "Sensory fusion: integrating visual and auditory information for recognizing speech, " in Proc. of IEEE International Conference on Neural Networks, March 1993, vol. 2, 672-677.
12. C. Bregler, S. M. Omohundro, and Y. Konig, "A hybrid approach to bimodal speech recognition, " in Proc. of 28th Annual Asilomar Conference on Signals, Systems, and Computers, 1994, 556-560.
13. T. Lourens, K. Nakadai, H. G. Okuno, and H. Kitano, "Selective attention by integration of vision and audition, " in Proc. of First IEEE-RAS International Conference on Humanoid Robot (Humanoid-2000). 2000, IEEE/RSJ.
14. K. Kita, T. Kawabata, and K. Shikano, "HMM continuous speech recognition using generalized LR parsing, " Transactions of Information Processing Society of Japan, vol. 31, no. 3, 472-480, 1990.
15. T. Nakatani, T. Kawabata, and H. G. Okuno, "A computational model of sound stream segregation with the multi-Agent paradigm, " in Proc. of 1995 International Conference on Acoustics, Speech and Signal Processing (ICASSP-95). 1995, vol. 4, 2671-2674, IEEE.
16. T. Nakatani, M. Goto, and H. G. Okuno, "Localization by harmonic structure and its application to harmonic sound stream segregation., " in Proc. of 1996 International Conference on Acoustics, Speech and Signal Processing (ICASSP-96). 1996, vol. II, 653-656, IEEE.
17. H.G. Okuno, S. Ikeda, and T. Nakatani, "Combining independent component analysis and sound stream segregation, " in Proc. of IJCAI-99 Workshop on Computational Auditory Scene Analysis (CASA'99). 1999, 92-98, IJCAI.
18. K. Nakadai, K. Hidai, H. Mizoguchi, H. G. Okuno, and H. Kitano, "Real-Time auditory and visual multiple-object tracking for robots, " in Proc. of 17th International Joint Conference on Artificial Intelligence (IJCAI-01). to appear, 2001, IJCAI.