Improved audio features for large-scale multimedia event detection

Proceedings - IEEE International Conference on Multimedia and Expo

Volumn 2014-September, Issue Septmber, 2014, Pages

  Metze, Florian ^a   Rawat, Shourabh ^a   Wang, Yipei ^a  

^a Carnegie Mellon University   (United States)

Author keywords

acoustic event detection; computational acoustic scene analysis; multimedia retrieval

Indexed keywords

IMAGE RETRIEVAL; NEURAL NETWORKS; SEMANTICS;

ACOUSTIC EVENT DETECTIONS; ALGORITHMIC APPROACH; COMPUTATIONAL ACOUSTICS; MULTIMEDIA EVENT DETECTIONS; MULTIMEDIA RETRIEVAL; RELATIVE CONTRIBUTION; SEMANTIC DESCRIPTIONS; TEMPORAL RESOLUTION;

FEATURE EXTRACTION;

EID: 84937509499     PISSN: 19457871     EISSN: 1945788X     Source Type: Conference Proceeding    
DOI: 10.1109/ICME.2014.6890234     Document Type: Conference Paper

References (28)

1. Paul Over, Jon Fiscus, and Greg Sanders, "TRECVID 2013-An introduction to the goals, tasks, data, evaluation mechanisms, and metrics, " in Proc. TRECVID, Gaithersburg, MD; U.S.A., Nov. 2013, National Institute of Standards and Technology, http://wwwnlpir. nist.gov/projects/tv2013/.
2. Stephanie Strassel, Amanda Morris, Jonathan Fiscus, Christopher Caruso, Haejoong Lee, Paul Over, James Fiumara, Barbara Shaw, Brian Antonishek, and Martial Michel, "Creating HAVIC: Heterogeneous audio visual internet collection, " in Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC'12), Istanbul, Turkey, May 2012, European Language Resources Association (ELRA).
3. Geoffrey E. Hinton, Li Deng, Dong Yu, George E. Dahl, Abdelrahman Mohamed, Navdeep Jaitly, Andrew Senior, Vincent Vanhoucke, Patrick Nguyen, Tara N. Sainath, and Brian Kingsbury, " Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups," IEEE Signal Process. Mag., vol. 29, no. 6, pp. 82-97, 2012.
4. Susanne Burger, Qin Jin, Peter F. Schulam, and Florian Metze, " Noisemes: Manual annotation of environmental noise in audio streams," Tech. Rep. CMU-LTI-12-07, Carnegie Mellon University, Pittsburgh, PA; U.S.A., 2012.
5. Qin Jin, Peter F. Schulam, Shourabh Rawat, Susanne Burger, Duo Ding, and Florian Metze, " Event-based video retrieval using audio," In Proc. INTERSPEECH
6. Benjamin Elizalde,Mirco Ravanelli,Gerald Friedland Audio concept ranking for video event detection on user-generated content in Proceedings of the First Workshop on Speech, Language and Audio in Multimedia (SLAM), Marseille, France, Aug. 2013, ISCA.
7. Stephanie Pancoast, Murat Akbacak, and Michelle Sanchez, "Supervised acoustic concept extraction for multimedia event detection, " in ACM Multimedia Workshop on Audi o and Multimedia Methods for Large-Scale Video Analysis (AMVA), Nara; Japan, Oct. 2012, ACM.
8. Liangliang Cao, Shih-Fu Chang, Noel Codella, Courtenay Cotton, Dan Ellis, Leiguang Gong, Matthew Hill, Gang Hua, John Kender, Michele Merler, Yadong Mu, Apostol Natseve, and John R. Smith, " IBM Research and Columbia University TRECVID-2011 Multimedia Event Detection (MED) System," in Proc. TRECVID, Gaithersburg, MD; U.S.A. , Nov. 2011, National Institute of Standards and Technology, http://wwwnlpir. nist.gov/projects/tv2011/.
9. Shourabh Rawat, Peter Schulam, Susanne Burger, Duo Ding, Yipei Wang, and Florian Metze, " Robust audio codebooks for large scale event detection in consumer videos," in Proc. INTERSPEECH, Lyon; France, Aug. 2013, ISCA.
10. Stephanie Pancoast and Murat Akbacak, "Bag-of-Audiowords approach for multimedia event classification," In Proc. INTERSPEECH [27].
11. Xiaodan Zhuang, Stavros Tsakalidis, Shuang Wu, Pradeep Natarajan, Rohit Prasad, and Prem Natarajan, " Compact audio representation for event detection in consumer media," In Proc. INTERSPEECH [27].
12. Stavros Tsakalidis, Xiaodan Zhuang, Roger Hsiao, ShuangWu, Pradeep Natarajan, Rohit Prasad, and Prem Natarajan, " Robust event detection from spoken content in consumer domain videos, " In Proc. INTERSPEECH [27].
13. Vasant Manohar, Stavros Tsakalidis, Pradeep Natarajan, Rohit Prasad, and Prem Natarajan, " Audio-visual fusion using Bayesian model combination for web video retrieval," in Proceedings of the 19th ACM International Conference on Multimedia, New York, NY, USA, 2011, MM '11, pp. 1537-1540, ACM.
14. National Institute of Standards of Technology, " 2013 TRECVID Multimedia Event Detection Track," http://www.nist.gov/itl/iad/mig/med13.cfm, Aug. 2013, Last acccessed: April 15, 2014.
15. FFmpeg, " A complete, cross-platform solution to record, convert and stream audio and video," http://www.ffmpeg.org/, Sept. 2013.
16. Hagen Soltau, Florian Metze, Christian Fügen, and Alex Waibel, " A One-pass Decoder based on Polymorphic Linguistic Context Assignment," in Proc. Automatic Speech Recognition and Understanding (ASRU), Madonna di Campiglio, Italy, Dec. 2001, IEEE.
17. Karen Sparck Jones, " A statistical interpretation of term specificity and its application in retrieval," Journal of Documentation, 1972.
18. Jonas Gehring, Yajie Miao, Florian Metze, and Alex Waibel, " Extracting deep bottleneck features using stacked auto-encoders," In Proc. ICASSP [28].
19. Sourish Chaudhuri and Bhiksha Raj, "Unsupervised hierarchical structure induction for deeper semantic analysis of audio, " In Proc. ICASSP [28], pp. 833-837.
20. Frantisek Grézl and Petr Fousek, "Optimizing bottleneck features for LVCSR, " in Proc. ICASSP, Las Vegas, NV; U.S.A., Apr. 2008, IEEE.
21. Stanley S. Stevens, John Volkman, and Edwin B. Newman, " A scale for the measurement of the psychological magnitude pitch," The Journal of the Acoustical Society of America, vol. 8, no. 3, pp. 185-190, 1937.
22. 22] Jonas Gehring, Yajie Miao, Florian Metze, and Alex Waibel, " Extracting Deep Bottleneck Features Using Stacked Auto-Encoders," In Proc. ICASSP [28].
23. James Bergstra, Olivier Breuleux, Frédéric Bastien, Pascal Lamblin, Razvan Pascanu, Guillaume Desjardins, Joseph Turian, David Warde-Farley, and Yoshua Bengio, "Theano: a CPU and GPU math expression compiler, " in Proceedings of the Python for Scientific Com puting Conference (SciPy), June 2010, Oral Presentation.
24. Geoffroy Peeters, " A large set of audio features for sound description (similarity and classification) in the CUIDADO project," Tech. Rep., IRCAM, 2004, http://recherche.ircam.fr/anasyn/peeters/ARTICLES-/Peeters 2003 cuidadoaudiofeatures.pdf.
25. Florian Eyben, Martin Wöllmer, and Björn Schuller, " Opensmile: the Munich versatile and fast open-source audio feature extractor," in Proceedings of the International Conference on Multimedia, New York, NY; USA, 2010, MM '10, pp. 1459-1462, ACM.
26. Courtenay V. Cotton and Dan P.W. Ellis, " Subband autocorrelation features for video soundtrack classification," In Proc. ICASSP [28], pp. 8663-8666.
27. INTERSPEECH 2012, 13th Annual Conference of the International Speech Communication Association, Portland, OR; U.S.A., Sept. 2012. ISCA.
28. IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2013, Vancouver, BC; Canada, May 2013. IEEE.