Improving detection of acoustic events using audiovisual data and feature level fusion

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2009, Pages 1147-1150

  Butko, T ^a   Canton Ferrer, C ^a   Segura, C ^a   Giro X ^a   Nadeu, C ^a   Hernando, J ^a   Casas, J R ^a  

^a UNIVERSITAT POLITÈCNICA DE CATALUNYA   (Spain)

Author keywords

Acoustic event detection; Acoustic localization; Hidden Markov models; Multimodal fusion; Multimodality

Indexed keywords

ACOUSTIC EVENTS; ACOUSTIC LOCALIZATION; AUDIO AND VIDEO; AUDIO INFORMATION; AUDIO-VISUAL DATA; DATA SETS; FEATURE LEVEL; FEATURE LEVEL FUSION; MULTI-MODAL FUSION; MULTI-MODALITY; SOCIAL ACTIVITIES;

HIDDEN MARKOV MODELS; SPEECH COMMUNICATION; SPEECH RECOGNITION;

AUDIO ACOUSTICS;

EID: 70450202244     PISSN: None     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (14)

1. L. Lu, H. Zhang, and H. Jiang, "Content analysis for audio classification and segmentation", IEEE Trans. on Speech and Audio Processing, vol. 10, pp. 504-516, 2002.
2. T. Nishiura, S. Nakamura, K. Miki, and K. Shikano, "Environmental sound source identification based on hidden Markov models for robust speech recognition", in Proc. Eurospeech, pp. 2157-2160, 2003.
3. A. Temko. "Acoustic event detection and classification", PhD thesis, Technical University of Catalonia, 2007.
4. CHIL - Computers in the Human Interaction Loop - EU project. http://chil.server.de, 2004-2007.
5. A. Temko, R. Malkin, C. Zieger, D. Macho, C. Nadeu, M. Omologo, "CLEAR Evaluation of Acoustic Event Detection and Classification systems", in Multimodal Technologies for Perception of Humans, LNCS, vol. 4122, Springer, 2007.
6. T. Butko, A. Temko, C. Nadeu and C. Canton, "Fusion of Audio and Video Modalities for Detection of Acoustic Events", in Proc. Interspeech, pp. 123-126, 2008.
7. C. Canton-Ferrer, T. Butko, C. Segura, X. Giró, C. Nadeu, J. Hernando, J.R. Casas, "Audiovisual Event Detection Towards Scene Understanding", in Proc. IEEE Int. Conference on Computer Vision and Pattern Recognition, 2009.
8. C. Nadeu, J. Hernando, and M. Gorricho, "On the decorrelation of filter-bank energies in speech recognition", in Proc. European Speech Processing Conference, pp. 1381-1384, 1995.
9. R. Rifkin, A. Klautau, "In defense of One-Vs-All Classification", Journal of Machine learning Research, vol. 5, pp.101-141, 2004.
10. J. DiBiase, H. Silverman, and M. Brandstein, " Microphone Arrays: Techniques and Applications", M. S. Brandstein and D. B. Ward, Eds, pp. 157-180, Springer-Verlag, 2001.
11. C. Canton-Ferrer, R. Sblendido, J. R. Casas, and M. Pardas, "Particle filtering and sparse sampling for multi-person 3D tracking", in Proc. IEEE Int. Conf. on Image Processing, pp. 2644-2647, 2008.
12. C. Stauffer and W. Grimson, "Adaptive background mixture models for real-time tracking", in Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pp. 252-259, 1999.
13. X. Giró and F. Marqués, "Composite object detection in video sequences: Applications to controlled environments", in Proc. Int. Workshop on Image Analysis for Multimedia Interactive Services, pp. 1-4, 2007.
14. M. T. Chan, Y. Zhang, and T. S. Huang, "Real-time lip tracking and bi-modal continuous speech recognition", in Proc. IEEE Workshop on Multimedia Signal Processing, pp. 65-70, 1998.