Robust audio-codebooks for Large-Scale Event Detection in consumer videos

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2013, Pages 2929-2933

  Rawat, Shourabh ^a   Schulam, Peter F ^a   Burger, Susanne ^a   Ding, Duo ^a   Wang, Yipei ^a   Metze, Florian ^a  

^a Carnegie Mellon University   (United States)

Author keywords

Audio codebook models; Multimedia Event Detection; Video retrieval

Indexed keywords

SPEECH RECOGNITION; STATISTICS;

BAG-OF-WORDS MODELS; CLUSTERING APPROACH; COMPACT REPRESENTATION; LATENT DIRICHLET ALLOCATIONS; MULTIMEDIA EVENT DETECTIONS; OVERALL EFFECTIVENESS; TEMPORAL INFORMATION; VIDEO RETRIEVAL;

IMAGE RETRIEVAL;

EID: 84906214187     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. "Trecvid multimedia event detection, evaluation 2012, " 2012, http://www.nist.gov/itl/iad/mig/med12.cfm.
2. S. Burger, Q. Jin, P. Schulam, and F. Metze, "Manual annotation of environmental noise in audio streams, " Carnegie Mellon University, Language Technologies Institute, Technical Report CMU-LTI-12-017, Pittsburgh, 2012.
3. L. Cao, S. Chang, N. Codella, C. Cotton, D. Ellis, L. Gong, M. Hill, G. Hua, J. Kender, M. Merler et al., "Ibm research and columbia university trecvid-2011 multimedia event detection (med) system, " TRECVID Multimedia Event Detection Task (MED), 2011.
4. Q. Jin, P. Schulam, S. Rawat, S. Burger, D. Ding, and F. Metze, "Event-based video retrieval using audio, " in Proc. of Interspeech, 2012.
5. S. Pancoasta and M. Akbacak, "Bag-of-audio-words approach for multimedia event classification, " in Proc. of Interspeech, 2012.
6. W. Campbell, D. Sturim, and D. Reynolds, "Support vector machines using gmm supervectors for speaker verification, " Signal Processing Letters, IEEE, vol. 13, no. 5, pp. 308-311, 2006.
7. X. Zhuang, S. Tsakalidis, S. Wu, P. Natarajan, R. Prasad, and P. Natarajan, "Compact audio representation for event detection in consumer media, " in Proc. of Interspeech, 2012.
8. B. Byun, I. Kim, S. M. Siniscalchi, and C.-H. Lee, "Consumer-level multimedia event detection through unsupervised audio signal modeling, " in Proc. of Interspeech, 2012.
9. S. Chaudhuri, M. Harvilla, and B. Raj, "Unsupervised learning of acoustic unit descriptors for audio content representation and classification, " in Proc. of Interspeech, 2011.
10. J. van Gemert, C. Veenman, A. Smeulders, and J. Geusebroek, "Visual word ambiguity, " Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 32, no. 7, pp. 1271-1283, 2010.
11. J. van Gemert, C. Snoek, C. Veenman, A. Smeulders, and J. Geusebroek, "Comparing compact codebooks for visual categorization, " Computer Vision and Image Understanding, vol. 114, no. 4, pp. 450-462, 2010.
12. J. Yang, Y. Jiang, A. Hauptmann, and C. Ngo, "Evaluating bag-of-visual-words representations in scene classification, " in Proceedings of the international workshop on Workshop on multimedia information retrieval. ACM, 2007, pp. 197-206.
13. F. Jurie and B. Triggs, "Creating efficient codebooks for visual recognition, " in Computer Vision, 2005. ICCV 2005. Tenth IEEE International Conference on, vol. 1. IEEE, 2005, pp. 604-610.
14. K. Lee and D. Ellis, "Audio-based semantic concept classification for consumer video, " Audio, Speech, and Language Processing, IEEE Transactions on, vol. 18, no. 6, pp. 1406-1416, 2010.
15. B. Milner, "Inclusion of temporal information into features for speech recognition, " in Spoken Language, 1996. ICSLP 96. Proceedings., Fourth International Conference on, vol. 1. IEEE, 1996, pp. 256-259.
16. P. Hamel, S. Lemieux, Y. Bengio, and D. Eck, "Temporal pooling and multiscale learning for automatic annotation and ranking of music audio, " in In Proceedings of the 12th International Conference on Music Information Retrieval (ISMIR11), 2011.
17. Z. Zhang and B. Schuller, "Semi-supervised learning helps in sound event classification, " in Acoustics, Speech and Signal Processing (ICASSP), 2012 IEEE International Conference on. IEEE, 2012, pp. 333-336.
18. F. Eyben, M. Wollmer, and B. Schuller, "Opensmile: the munich versatile and fast open-source audio feature extractor, " in Proceedings of the international conference on Multimedia. ACM, 2010, pp. 1459-1462.
19. S. Kim, S. Sundaram, P. Georgiou, and S. Narayanan, "An n-gram model for unstructured audio signals toward information retrieval, " in Multimedia Signal Processing (MMSP), 2010 IEEE International Workshop on. IEEE, 2010, pp. 477-480.
20. D. Blei, A. Ng, and M. Jordan, "Latent dirichlet allocation, " the Journal of machine Learning research, vol. 3, pp. 993-1022, 2003.
21. A. K. McCallum, "Mallet: A machine learning for language toolkit, " 2002, http://mallet.cs.umass.edu.