Acoustic event detection based on feature-level fusion of audio and video modalities

Eurasip Journal on Advances in Signal Processing

Volumn 2011, Issue , 2011, Pages

  Butko, Taras ^a   Canton Ferrer, Cristian ^a   Segura, Carlos ^a   Gir, Xavier ^a   Nadeu, Climent ^a   Hernando, Javier ^a   Casas, Josep R ^a  

^a UNIVERSITAT POLITÈCNICA DE CATALUNYA   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

3D LOCALIZATION; ACOUSTIC DATA; ACOUSTIC EVENTS; AUDIO AND VIDEO; AUDIO INFORMATION; AUDIO SIGNAL; DETECTION RATES; FEATURE LEVEL; MICROPHONE ARRAYS; MOTION ANALYSIS; MULTI-CAMERAS; OBJECT DETECTION; PARALLEL STRUCTURES; PERSON TRACKING; REAL-WORLD; RECOGNITION RATES; SOUND SOURCE; TEMPORAL OVERLAP; TEMPORAL POSITION;

DETECTORS; ERRORS; OBJECT RECOGNITION; VIDEO CAMERAS; VIDEO RECORDING;

AUDIO ACOUSTICS;

EID: 79955003732     PISSN: 16876172     EISSN: 16876180     Source Type: Journal    
DOI: 10.1155/2011/485738     Document Type: Article

References (25)

1. Waibel A., Stiefelhagen R., Computers in the Human Interaction Loop 2009 New York, NY, USA Springer
2. Vacher M., Istrate D., Besacier L., Castelli E., Serignat J., Smart audio sensor for telemedicina Proceedings of the Smart Object Conference 2003
3. Stger M., Lukowicz P., Perera N., Von Bren T., Trster G., Starner T., Sound Button: design of a low power wearable audio classification system Proceedings of the International Symposium on Wearable Computers (ISWC '03) 2003 12 17
4. Jianfeng C., Jianmin Z., Kam A. H., Shue L., An automatic acoustic bathroom monitoring system Proceedings of the IEEE International Symposium on Circuits and Systems (ISCAS '05) May 2005 1750 1753
5. CLEAR, Classification of Events, Activities and Relationships. Evaluation and Workshop. 2006, http://isl.ira.uka.de/clear06
6. CLEAR, Classification of Events, Activities and Relationships. Evaluation and Workshop. 2007, http://www.clear-evaluation.org
7. Temko A., Nadeu C., Biel J.-I., Acoustic event detection: SVM-based system and evaluation setup in CLEAR Multimodal Technologies for Perception of Humans 2008 4625 New York, NY, USA Springer 354 363 LNCS
8. Hyvrinen A., Karhunen J., Oja E., Independent Component Analysis 2001 New York, NY, USA John Wiley Sons
9. Wrigley S. N., Brown G. J., Wan V., Renals S., Speech and crosstalk detection in multichannel audio IEEE Transactions on Speech and Audio Processing 2005 13 1 84 91 (Pubitemid 40049942)
10. Temko A., Nadeu C., Acoustic event detection in meeting-room environments Pattern Recognition Letters 2009 30 14 1281 1288
11. Butko T., Temko A., Nadeu C., Canton C., Fusion of audio and video modalities for detection of acoustic events Proceedings of the 9th Annual Conference of the International Speech Communication Association (INTERSPEECH '08) 2008 123 126
12. Canton-Ferrer C., Butko T., Segura C., Gir X., Nadeu C., Hernando J., Casas J. R., Audiovisual event detection towards scene understanding Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR '09) June 2009 81 88
13. Butko T., Canton-Ferrer C., Segura C., Gir X., Nadeu C., Hernando J., Casas J. R., Improving detection of acoustic events using audiovisual data and feature level fusion Proceedings of the 10th Annual Conference of the International Speech Communication Association (INTERSPEECH '09) September 2009 1147 1150
14. Nadeu C., Macho D., Hernando J., Time and frequency filtering of filter-bank energies for robust HMM speech recognition Speech Communication 2001 34 1-2 93 114 (Pubitemid 32874677)
15. Luque J., Hernando J., Robust speaker identification for meetings: UPC CLEAR-07 meeting room evaluation system Multimodal Technologies for Perception of Humans 2008 4625 266 275 LNCS
16. Dibiase J., Silverman H., Brandstein M., Microphone Arrays. Robust Localization in Reverberant Rooms 2001 New York, NY, USA Springer
17. Omologo M., Svaizer P., Use of the crosspower-spectrum phase in acoustic event location IEEE Transactions on Speech and Audio Processing 1997 5 3 288 292 (Pubitemid 127746001)
18. Canton-Ferrer C., Casas J. R., Pards M., Sblendido R., Particle filtering and sparse sampling for multi-person 3D tracking Proceedings of the IEEE International Conference on Image Processing (ICIP '08) October 2008 2644 2647
19. Bobick A. F., Davis J. W., The recognition of human movement using temporal templates IEEE Transactions on Pattern Analysis and Machine Intelligence 2001 23 3 257 267 (Pubitemid 32286632)
20. Salembier P., Garrido L., Binary partition tree as an efficient representation for image processing, segmentation, and information retrieval IEEE Transactions on Image Processing 2000 9 4 561 576 (Pubitemid 30594737)
21. Giro X., Marques F., Composite object detection in video sequences: application to controlled environments Proceedings of the 8th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS '07) June 2007 1 4
22. Stauffer C., Grimson W. E. L., Adaptive background mixture models for real-time tracking Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '99) June 1999 246 252
23. Rifkin R., Klautau A., In defense of One-Vs-All Classification The Journal of Machine Learning Research 2004 5 101 141
24. Chan M., Zhang Y., Huang T., Real-time lip tracking and bi-modal continuous speech recognition Proceedings of the IEEE Workshop on Multimedia Signal Processing 1998
25. Raj B., Stern R. M., Missing-feature approaches in speech recognition Proceedings of the IEEE Signal Processing Magazine 2005 22 5 101 116 (Pubitemid 41488524)