Design and implementation of 3d auditory scene visualizer towards auditory awarenesswith face tracking

Proceedings - 10th IEEE International Symposium on Multimedia, ISM 2008

Volumn , Issue , 2008, Pages 468-476

  Kubota, Yuji ^a   Yoshida, Masatoshi ^a   Komatani, Kazunori ^a   Ogata, Tetsuya ^a   Okuno, Hiroshi G ^a  

^a KYOTO UNIVERSITY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

3D SOUNDS; AUDITION SYSTEMS; AUTOMATIC SPEECH RECOGNITION; FACE TRACKING; FOCUS OF ATTENTIONS; HIGH FIDELITIES; JAVA-3D; KARAOKE; MICROPHONE ARRAYS; ON DEMANDS; SOUND STREAMS; TRACKING SYSTEMS; VISUAL INFORMATION SEEKING; VISUALIZER;

ACOUSTIC STREAMING; AUDITION; MICROPHONES; REMELTING; SPEECH RECOGNITION; VISUAL COMMUNICATION;

PATIENT REHABILITATION;

EID: 62949223092     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISM.2008.107     Document Type: Conference Paper

References (15)

1. E. Corteel. On the use of irregularly spaced loudspeaker arrays for wave field synthesis, potential impact on spatial aliasing frequency. Proceeding of the 9th International Conference on Digital Audio Effects, ppp.209-214, 2006.
2. M. Kashino and T. Hirahara. One, two, many - judging the number of concurrent talkers. Journal of Acoustic Society of America, 99(4):2596, 1996.
3. K. Ishihara, T. Nakatani, T. Ogata, and H. G. Okuno. Automatic sound-imitation word recognition from environmental sounds focusing on ambiguity problem in determining phonemes. PRICAI 2004: Trends in Artificial Intelligence, LNCS 3157, pp.909-918. Springer Verlag, 2004.
4. D. P. Ellis. Extracting information from music audio. Communication of the Association for Computing Machinery, 49(8):32-37, 2006.
5. D. Rosenthal and H. G. Okuno, Eds. Computational Auditory Scene Analysis. Lawrence Erlbaum Associates, 1988.
6. J.-M. Valin, S. Yamamoto, J. Rouat, F. Michaud, K. Nakadai, and H. G. Okuno. Robust recognition of simultaneous speech by a mobile robot. IEEE Transactions on Robotics, 23(4):742-752, 2007.
7. K. Yoshii, K. Nakadai, T. Torii, Y. Hasegawa, H. Tsujino, K. Komatani, T. Ogata, and H. G. Okuno. A biped robot that keeps steps in time with musical beats while listening to music with its own ears. Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems, pp.1743-1750. 2007.
8. E. C. Cherry. Some experiments on the recognition of speech, with one and with two ears. Journal of Acoustic Society of America, 25:975-979, 1953.
9. S. Yamamoto, K. Nakadai, M. Nakano, H. Tsujino, J.-M. Valin, K. Komatani, T. Ogata, and H. G. Okuno. Design and implementation of a robot audition system for automatic speech recognition of simultaneous speech. Proceedings of the Workshop on Automatic Speech Recognition and Understanding, pp.111-116. 2007.
10. B. Shneiderman. Designing the User Interface (3rd Ed). Addison-Wesley Pub., 2003.
11. J.-M. Valin, J. Rouat, and F. Michaud. Enhanced robot audition based on microphone array source separation with post-filter. Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems, pp.2123-2128. 2004. http://manyears.sourceforge.net/.
12. M. Murase, S. Yamamoto, J.-M. Valin, K. Nakadai, K. Yamada, K. Komatani, T. Ogata, and H. G. Okuno. Multiple moving speaker tracking by microphone array on mobile robot. Proceedings of the Nineth European Conference on Speech Communication and Technology, pp.249-252, 2005.
13. Nishimura, Y. and Furui, S. Multiband Julius. http://www.furui.cs.titech. ac.jp/mband julius/.
14. C. Hua, H. Wu, Q. Chen, and T. Wada. A pixel-wise object tracking algorithm with target and background sample. Proceedings of the 18th International Conference on Pattern Recognition, pp.739-742, 2006.
15. K. Tokuda, K. Komatani, T. Ogata, and H. G. Okuno. Hearing-Impaired- Supporting System in Understanding Auditory Scenes by Presenting Sound Source Localization and Speech Recognition Results in Integrated Manner on HMD, (written in Japanese). Proceedings of the 70th Information Processing Society of Japan, 5ZD-7, 2008.