Computational auditory scene analysis and its application to robot audition: Five years experience

Proceedings - Second International Conference on Informatics Research for Development of Knowledge Society Infrastructure, ICKS 2007

Volumn , Issue , 2007, Pages 69-76

  Okuno, Hiroshi G ^a   Ogata, Tetsuya ^a   Komatani, Kazunori ^a  

^a KYOTO UNIVERSITY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTIC SIGNAL PROCESSING; HUMAN COMPUTER INTERACTION; MICROPHONES; ROBOTICS; SPEECH ANALYSIS; SPEECH RECOGNITION;

AUDITORY SCENE ANALYSIS; POLYPHONIC MUSIC SIGNALS; SOUND SIGNALS; SOUND SOURCE LOCALIZATION;

SPEECH COMMUNICATION;

EID: 34548809160     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICKS.2007.7     Document Type: Conference Paper

References (42)

1. E. C. Cherry, "Some experiments on the recognition of speech, with one and with two ears," J. of ASA, vol. 25, 975-979, 1953.
2. D. Rosenthal and H. G. Okuno, eds., Computational Auditory Scene Analysis. Mahwah, New Jersey: Lawrence Erlbaum Associates, 1998.
3. S. Yamamoto, J.-M. Valin, K. Nakadai, T. Ogata, and H. G. Okuno, "Enhanced robot speech recognition based on microphone array source separation and missing feature theory," Proc. of IEEE ICRA 2005, 1489-1494.
4. S. Yamamoto, R. Takeda, K. Nakadai, M. Nakano, H. Tsujino, J.-M. Valin, K. Komatani, T. Ogata, and H. G. Okuno, "Recognition of simultaneous speech by estimating reliability of separated signals for robot audition," PRICAI 2006: Trends in Artificial Intelligence, LNCS 4099, 484-494, 2006.
5. R. Takeda, S. Yamamoto, K. Komatani, T. Ogata, and H. G. Okuno, "Missing-feature based speech recognition for two simultaneous speech signals separated by ica with a pair of humanoid ears," Proc. of IEEE/RSJIROS 2006, 878-885.
6. S. Yamamoto, K. Nakadai, M. Nakano, H. Tsujino, J.-M. Valin, R. Takeda, K. Komatani, T. Ogata, and H. G. Okuno, "Genetic algorithm-based improvement of robot hearing capabilities in separating and recognizing simultaneous speech signals," Advances in Applied Artificial Intelligence, LNAI 4031, 207-217, 2006.
7. S. Yamamoto, R. Takeda, K. Nakadai, M. Nakano, H. Tsujino, J.-M. Valin, K. Komatani, T. Ogata, and H. G. Okuno, "Real-time robot audition system that recognizes simultaneous speech in the real world," Proc. of IEEE/RSJ IROS 2006, 5333-5338.
8. M. Murase, S. Yamamoto, J.-M. Valin, K. Nakadai, K. Yamada, K. Komatani, T. Ogata, and H. G. Okuno, "Multiple moving speaker tracking by microphone array on mobile robot," Eurospeech-2005), 249-252.
9. K. Nakadai, H. Nakajima, M. Murase, S. Kaijiri, K. Yamada, Y Hasegawa, H. G. Okuno, and H. Tsujino, "Real-time tracking of multiple sound sources by integration of in-room and robot-embedded microphone arrays," Proc. of IROS 2006, 852-859.
10. K. Yoshii, M. Goto, K. Komatani, T. Ogata, and H. G. Okuno, "Drum sound recognition for polyphonic audio signals by adaptation and matching of spectral templates with harmonic harmonic structure suppression," IEEE Trans. on Audio, Speech and Language Processing, vol. 15, in print, 2007.
11. K. Yoshii, M. Goto, K. Komatani, T. Ogata, and H. G. Okuno, "Drumix: An audio player with functions of real-time drum-part rearrangement for active music listening," J. of IPSJ, vol. 48, no. 3, accepted, 2007.
12. K. Itoyama, M. Goto, K. Komatani, T. Ogata, and H. G. Okuno, "Integration and adaptation of harmonic and inharmonic models for separating polyphonic musical signals," Proc. of IEEE ICASSP'2007, accepted.
13. T. Kitahara, M. Goto, K. Komatani, T. Ogata, and H. G. Okuno, "Instrument identification in polyphonic music: Feature weighting to minimize influence of sound overlaps," EURASIP J on Advances in Signal Processing, vol. 2007, Article ID 51979, p. 15, 2007.
14. T. Kitahara, M. Goto, K. Komatani, T. Ogata, and H. G. Okuno, "Instrogram: Probabilistic representation of instrument existence for polyphonic music," J of IPSJ, vol. 48, 2007, accepted.
15. K. Fujihara, M. Goto, K. Komatani, T. Ogata, and H. G. Okuno, "F0 estimation method for singing voice in polyphonic audio signal based on statistical vocal model and viterbi search," Proc. of IEEE ICASSP'2006, vol. V, 253-256.
16. K. Fujihara, M. Goto, K. Komatani, T. Ogata, and H. G. Okuno, "Automatic synchronization between lyrics and music cd recordings based on viterbi alignment of segregated vocal signals," Proc. of IEEE ISM 2006, 257-264.
17. T. Yoshioka, T. Hikichi, M. Miyoshi, and H. G. Okuno, "Common acoustical pole estimation from multi-channel musical audio signals," IEICE Trans. on Fundamentals of Electronics, Communications, and Computer Sciences, vol. E89-A, no. 1, 240-247, 2006.
18. T. Kitahara, M. Goto, and H. G. Okuno, "Musical instrument identification based on F0-dependent multivariate normal distribution.," ICASSP-2003, 421-424.
19. T. Kitahara, M. Goto, and H. G. Okuno, "Category-level identification of non-registered musical instrument sounds," Proc. ofICASSP-2004, p. 253-256.
20. Y. Sakuraba, T. Kitahara, and H. G. Okuno, "Comparing features for forming music streams in automatic music transcription," Proc. of ICASSP-2004, 273-276.
21. Y. Fukubayashi, K. Komatani, T. Ogata, and H. G. Okuno, "Dynamic help generation by estimating user's mental model in spoken dialogue systems," Proc. of Interspeech-2006, 1946-1949.
22. K. Komatani, N. Kanda, M. Nakano, K. Nakadai, H. Tsujino, T. Ogata, H. G. Okuno, "Multi-domain spoken dialogue system with extensibility and robustness against speech recognition errors," Proc. of SIGdial Workshop on Discourse and Dialogue, 9-17, 2006.
23. K. Komatani, S. Ueno, T. Kawahara, and H. G. Okuno, "User modeling in spoken dialogue systems to generate flexible guidance," User Model. User-Adapt. Interact, vol. 15, no. 1-2, 169-183, 2005.
24. K. Ishihara, T. Nakatani, T. Ogata, and H. G. Okuno, "Automatic sound-imitation word recognition from environmental sounds focusing on ambiguity problem in determining phonemes," PRICAI2004: Trends in Artificial Intelligence, LNCS 3157, 909-918, 2004.
25. T. Ogata, H. Ohba, J. Tani, K. Komatani, and H. G. Okuno, "Extracting multi-modal dynamics of objects using rnnpb," J of Robotics and Mechatronics, vol. 17, no. 6, 681-688, 2007.
26. T. Ogata, Y. Hattori, H. Kozima, K. Komatani, and H. G. Okuno, "Generation of robot motions from environmental sounds using inter-modality mapping by rnnpb," Proc. of EpiRobo-2006, 95-102.
27. T. Tasaki, S. Matsumoto, H. Ohba, M. Toda, K. Komatani, T. Ogata, and H. Okuno, "Distance based dynamic interaction of humanoid robot with multiple people," Innovations in Applied Artificial Intelligence, LNAI 3533, 111-120, 2005.
28. H. G. Okuno, T. Ogata, K. Komatani, and K. Nakadai, "Computational auditory scene analysis and its application to robot audition," Proc. of ICKS 2004, 73-80, IEEE.
29. J.-M. Valin, J. Rouat, and F. Michaud, "Enhanced robot audition based on microphone array source separation with postfilter," IROS 2004, 2123-2128.
30. B. Raj and R. M. Stern, "Missing-feature approaches in speech recognition," Signal Processing Magazine, vol. 22, no. 5, 101-116, IEEE, 2005.
31. J. Barker, M. Cooke, and P. Green, "Robust asr based on clean speech models: An evaluation of missing data techniques for connected digit recognition in noise," Proc. of Eurospeech-2001, 213-216, ESCA, 2001.
32. M. Cooke, P. Green, L. Josifovski, and A. Vizinho, "Robust automatic speech recognition with missing and unreliable acoustic data," Speech Communication, vol. 34, 267-285, May 2001.
33. C. Côté, D. Létourneau, F. Michaud, J.-M. Valin, Y Brosseau, C. Raievsky, M. Lemay, and V. Tran, "Code reusability tools for programming mobile robots," Proc. of IEEE/RSJ IROS 2004, 1820-1825.
34. Y. Nishimura and S. Furui, "Multiband julius." http://www.furui.cs.titech.ac.jp/mband.julius/, 2005.
35. J.-M. Valin, F. Michaud, B. Hadjou, and J. Rouat, "Localization of simultaneous moving sound sources for mobile robot using a frequency-domain steered beamformer approach," ICRA 2004, 1033-1038.
36. L. C. Parra and C. V. Alvino, "Geometric source separation: Mergin convolutive source separation with geometric beamforming," IEEE Trans. on Speech and Audio Processing, vol. 10, no. 6, 352-362, 2002.
37. I. Cohen and B. Berdugo, "Microphone array post-filtering for non-stationary noise suppression," Proc. of ICASSP-2002, 901-904.
38. T. Kawahara and A. Lee, "Free software toolkit for Japanese large vocabulary continuous speech recognition," Proc. of ICSLP-2000, 476-479.
39. K. Yoshii, M. Goto, and H. G. Okuno, "Automatic drum sound description for real-world music using template adaptation and matching methods," Proc. of ISMIR-2004, 184-191.
40. M. Goto, "An audio-based real-time beat tracking system for music with or without drum-sounds," J. of New Music Research, vol. 30, no. 2, 159-171, 2001.
41. E. Pampalk, S. Dixon, and G. Widmer, "Exploring music collections by browsing different views," Proc. of ISMIR-2003, 201-208.
42. M. Goto, T. Hashiguchi, and R. Oka, "RWC music database: Popular, classical, and jazz music databases," Proc. of ISMIR-2002, 287-288.