Detection and Classification of Acoustic Scenes and Events

IEEE Transactions on Multimedia

Volumn 17, Issue 10, 2015, Pages 1733-1746

  Stowell, Dan ^a   Giannoulis, Dimitrios ^a   Benetos, Emmanouil ^a,b   Lagrange, Mathieu ^c   Plumbley, Mark D ^a,d  

^a QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

^b CITY UNIVERSITY   (United Kingdom)

^c ECOLE CENTRALE DE NANTES   (France)

^d UNIVERSITY OF SURREY   (United Kingdom)

Author keywords

Audio databases; event detection; machine intelligence; pattern recognition

Indexed keywords

ACOUSTIC SIGNAL PROCESSING; ARTIFICIAL INTELLIGENCE; AUDIO ACOUSTICS; AUDIO SYSTEMS; INTELLIGENT SYSTEMS; PATTERN RECOGNITION; SIGNAL PROCESSING;

ACOUSTIC SIGNALS; AUDIO DATABASE; BASELINE SYSTEMS; EVENT DETECTION; MACHINE INTELLIGENCE; MACHINE LISTENING; PUBLIC RESEARCH; STATE OF THE ART;

AUDIO SIGNAL PROCESSING;

EID: 84960474809     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2015.2428998     Document Type: Article

References (66)

1. L. Rabiner and B.-H. Juang, Fundamentals of Speech Recognition. Upper Saddle River, NJ, USA: Prentice-Hall, 1993.
2. J. Barker, E. Vincent, N. Ma, H. Christensen, and P. Green, "The PASCAL CHiME speech separation and recognition challenge," Comput. Speech Language, vol. 27, no. 3, pp. 621-633, 2012.
3. E. Benetos and S. Dixon, "Multiple-instrument polyphonic music transcription using a temporally constrained shift-invariant model," J. Acoust. Soc. America, vol. 133, pp. 1727-1741, 2013.
4. A. Wang, "An industrial strength audio search algorithm," in Proc. 4th Int. Conf. Music Inf. Retrieval, Oct. 2003, pp. 7-13.
5. J.-M. Valin, F. Michaud, B. Hadjou, and J. Rouat, "Localization of simultaneous moving sound sources for mobile robot using a frequencydomain steered beamformer approach," in Proc. 2004 IEEE Int. Conf. Robot. Automat., Apr.-May 2004, vol. 1, pp. 1033-1038.
6. R. Ranft, "Natural sound archives: Past, present and future," Anais da Academia Brasileira de Ciências, vol. 76, no. 2, pp. 456-460, 2004.
7. D. L. Wang and G. J. Brown, Computational Auditory Scene Analysis: Principles, Algorithms, and Applications. Piscataway, NJ, USA: IEEE Press, 2006.
8. A. S. Bregman, Auditory Scene Analysis: The Perceptual Organization of Sound. Cambridge, MA, USA: MIT Press, 1994.
9. D. Giannoulis, E. Benetos, D. Stowell, M. Rossignol, M. Lagrange, and M. D. Plumbley, "Detection and classification of acoustic scenes and events: An IEEE AASP challenge," in Proc. IEEE Workshop Appl. Signal Process. Audio Acoust., Oct. 2013, pp. 1-4.
10. J.-J. Aucouturier, B. Defreville, and F. Pachet, "The bag-of-frames approach to audio pattern recognition: A sufficient model for urban soundscapes but not for polyphonic music," J. Acoust. Soc. America, vol. 122, no. 2, pp. 881-891, 2007.
11. I. H. Witten and E. Frank, Data Mining: Practical Machine Learning Tools and Techniques, 2nd ed. San Francisco, CA, USA: Morgan Kaufmann, 2005.
12. N. Scaringella, G. Zoia, and D. Mlynek, "Automatic genre classification of music content: A survey," IEEE Signal Process. Mag., vol. 23, no. 2, pp. 133-141, Mar. 2006.
13. J. J. Wolf, "Efficient acoustic parameters for speaker recognition," J. Acoust. Soc. America, vol. 51, pp. 2044-2056, Jun. 1972.
14. J. Foote, "Content-based retrieval of music and audio," in Proc. SPIE, Multimedia Storage Archiving Syst. II, 1997, vol. 3229, pp. 138-147.
15. B. Cauchi, "Non-negative matrix factorisation applied to auditory scenes classification," M.S. thesis, ATIAM, ParisTech, Paris, France, Aug. 2011.
16. E. Benetos, "Automatic transcription of polyphonic music exploiting temporal evolution," Ph.D. dissertation, School of Electron. Eng. and Comput. Sci., Queen Mary University of London, London, U.K., Dec. 2012.
17. S. Chu, S. Narayanan, and C.-C. Jay Kuo, "Environmental sound recognition with time-frequency audio features," IEEE Trans. Audio, Speech Language Process., vol. 17, no. 6, pp. 1142-1158, Aug. 2009.
18. S. E. Tranter and D. A. Reynolds, "An overview of automatic speaker diarization systems," IEEE Trans. Audio, Speech, Language Process., vol. 14, no. 5, pp. 1557-1565, Sep. 2006.
19. A. Mesaros, T. Heittola, A. Eronen, and T. Virtanen, "Acoustic event detection in real life recordings," in Proc. Eur. Signal Process. Conf., Aug. 2010, pp. 1267-1271.
20. C. V. Cotton and D. P. W. Ellis, "Spectral vs. spectro-temporal features for acoustic event detection," in Proc. IEEE Workshop Appl. of Signal Process. Audio Acoust., Oct. 2011, pp. 69-72.
21. T. Heittola, A. Mesaros, T. Virtanen, and A. Eronen, "Sound event detection in multisource environments using source separation," in Proc. Workshop Mach. Listening Multisource Environ., 2011, pp. 36-40.
22. T. Heittola, A. Mesaros, A. Eronen, and T. Virtanen, "Context-dependent sound event detection," EURASIP J. Audio, Speech, Music Process., vol. 2013, no. 1, 2013, Art. ID 1.
23. A. Mesaros, T. Heittola, and A. Klapuri, "Latent semantic analysis in sound event detection," in Proc. Eur. Signal Process. Conf., 2011, pp. 1307-1311.
24. J. P. Barker, M. P. Cooke, and D. P. W. Ellis, "Decoding speech in the presence of other sources," Speech Commun., vol. 45, no. 1, pp. 5-25, 2005.
25. F. Briggs and B. Lakshminarayanan et al., "Acoustic classification of multiple simultaneous bird species: A multi-instance multi-label approach," J. Acoust. Soc. America, vol. 131, pp. 4640-4650, 2012.
26. D. Giannoulis, A. Klapuri, and M. D. Plumbley, "Recognition of harmonic sounds in polyphonic audio using a missing feature approach," in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., May 2013, pp. 8658-8662.
27. M. J. Kim and H. Kim, "Automatic extraction of pornographic contents using radon transform based audio features," in Proc. 9th Int.Workshop Content-Based Multimedia Indexing, Jun. 2011, pp. 205-210.
28. S. Ntalampiras, I. Potamitis, and N. Fakotakis, "An adaptive framework for acoustic monitoring of potential hazards," EURASIP J. Audio, Speech Music Process., vol. 2009, 2009, Art. ID 13.
29. H. G. Okuno, T. Ogata, and K. Komatani, "Computational auditory scene analysis and its application to robot audition: Five years experience," in Proc. 2nd Int. Conf. Informat. Res. Develop. Knowledge Soc. Infrastructure, Jan. 2007, pp. 69-76.
30. D. Stowell and M. D. Plumbley, "Segregating event streams and noise with a Markov renewal process model," J. Mach. Learning Res., vol. 14, pp. 1891-1916, 2013.
31. E. Vincent, S. Araki, F. Theis, G. Nolte, P. Bofill, H. Sawada, A. Ozerov, V. Gowreesunker, D. Lutter, and N. Duong, "The signal separation evaluation campaign (2007-2010): Achievements and remaining challenges," Signal Process., vol. 92, no. 8, pp. 1928-1936, 2012.
32. E. Vincent, J. Barker, S. Watanabe, J. Le Roux, F. Nesta, and M. Matassoni, "The second 'CHiME' speech separation and recognition challenge: An overview of challenge systems and outcomes," in Proc. IEEE Workshop Automat. Speech Recog. Understand., Dec. 2013, pp. 162-167.
33. J. S. Downie, A. F. Ehmann, M. Bay, and M. C. Jones, "The music information retrieval evaluation eXchange: Some observations and insights," in Advances in Music Information Retrieval, ser. Studies in Computational Intelligence. New York, NY, USA: Springer, 2010, vol. 274, pp. 93-115.
34. R. Stiefelhagen, K. Bernardin, R. Bowers, J. Garofolo, D. Mostefa, and P. Soundararajan, "The CLEAR 2006 evaluation," in Multimodal Technologies for Perception of Humans. Berlin, Germany: Springer-Verlag, 2007, pp. 1-44.
35. A. F. Smeaton, P. Over, and W. Kraaij, "Evaluation campaigns and TRECVID," in Proc. 8th ACM Int. Workshop Multimedia Inf. Retrieval, 2006, pp. 321-330.
36. B. L. Sturm, "A simple method to determine if a music information retrieval system is a 'horse'," IEEE Trans. Multimedia, vol. 16, no. 6, pp. 1636-1644, Oct. 2014.
37. D. Stowell and M. D. Plumbley, "An open dataset for research on audio field recording archives: Freefield1010," in Proc. Audio Eng. Soc. 53rd Conf. Semantic Audio (AES53), 2014, pp. 1-7.
38. A. J. Eronen, V. T. Peltonen, J. T. Tuomi, A. P. Klapuri, S. Fagerlund, T. Sorsa, G. Lorho, and J. Huopaniemi, "Audio-based context recognition," IEEE Trans. Audio, Speech, Language Process., vol. 14, no. 1, pp. 321-329, Jan. 2006.
39. K. Ellis, E. Coviello, and G. Lanckriet, "Semantic annotation and retrieval of music using a bag of systems representation," in Proc. 12th Int. Conf. Music Inf. Retrieval, Oct. 2011, pp. 723-728.
40. T. Fawcett, "An introduction to ROC analysis," Pattern Recog. Lett., vol. 27, no. 8, pp. 861-874, 2006.
41. J.-J. Aucouturier and F. Pachet, "Improving timbre similarity: How high's the sky?," J. Negative Results Speech Audio Sci., vol. 1, no. 1, pp. 1-13, 2004.
42. D. Giannoulis, D. Stowell, E. Benetos, M. Rossignol, M. Lagrange, and M. D. Plumbley, "A database and challenge for acoustic scene classification and event detection," in Proc. Eur. Signal Process. Conf., 2013, pp. 1-5.
43. A. Temko, R. Malkin, C. Zieger, D. Macho, C. Nadeu, and M. Omologo, "CLEAR evaluation of acoustic event detection and classification systems," in Proc CLEAR, 2007, pp. 311-322.
44. R. Kompass, "A generalized divergence measure for nonnegative matrix factorization," Neural Comput., vol. 19, no. 3, pp. 780-791, 2007.
45. C. Schörkhuber and A. Klapuri, "Constant-Q transform toolbox for music processing," in Proc. Sound Music Comput. Conf., Jul. 2010, pp. 3-64.
46. M. Chum, A. Habshush, A. Rahman, and C. Sang, "IEEE AASP scene classification challenge using hidden Markov models and frame based classification," Tech. Rep., 2013 [Online]. Available: http://c4dm.eecs. qmul.ac.uk/sceneseventschallenge/abstracts/SC/CHR.pdf
47. B. Elizalde, H. Lei, F. G., and N. Peters, "An I-vector based approach for audio scene detection," Tech. Rep., 2013 [Online]. Available: http://c4dm.eecs.qmul.ac.uk/sceneseventschallenge/abstracts/SC/ELF.pdf
48. J. T. Geiger, B. Schuller, and G. Rigoll, "Recognising acoustic scenes with large-scale audio feature extraction and SVM," 2013 [Online]. Available: http://c4dm.eecs.qmul.ac.uk/sceneseventschallenge/abstracts/SC/GSR.pdf
49. J. D. Krijnders and G. A. ten Holt, "A tone-fit feature representation for scene classification," 2013 [Online]. Available: http://c4dm.eecs.qmul. ac.uk/sceneseventschallenge/abstracts/SC/KH.pdf
50. D. Li, J. Tam, and D. Toub, "Auditory scene classification using machine learning techniques," Tech. Rep., 2013 [Online]. Available: http://c4dm.eecs.qmul.ac.uk/sceneseventschallenge/abstracts/SC/LTT.pdf
51. J. Nam, Z. Hyung, and K. Lee, "Acoustic scene classification using sparse feature learning and selective max-pooling by event detection," Tech. Rep., 2013 [Online]. Available: http://c4dm.eecs.qmul.ac.uk/sceneseventschallenge/abstracts/SC/NHL.pdf
52. W. Nogueira, G. Roma, and P. Herrera, "Sound scene identification based on MFCC, binaural features and a support vector machine classifier," Tech. Rep., 2013 [Online]. Available: http://c4dm.eecs.qmul.ac. uk/sceneseventschallenge/abstracts/SC/NR1.pdf
53. E. Olivetti, "The wonders of the normalized compression dissimilarity representation," Tech. Rep., 2013 [Online]. Available: http://c4dm. eecs.qmul.ac.uk/sceneseventschallenge/abstracts/SC/OE.pdf
54. K. Patil and M. Elhilali, "Multiresolution auditory representations for scene classification," Tech. Rep., 2013 [Online]. Available: http://c4dm.eecs.qmul.ac.uk/sceneseventschallenge/abstracts/SC/PE.pdf
55. A. Rakotomamonjy and G. Gasso, "Histogram of gradients of time-frequency representations for audio scene classification," Tech. Rep., 2013 [Online]. Available: http://c4dm.eecs.qmul.ac.uk/sceneseventschallenge/abstracts/SC/RG.pdf
56. G. Roma, W. Nogueira, and P. Herrera, "Recurrence quantification analysis features for auditory scene classification," Tech. Rep., 2013 [Online]. Available: http://c4dm.eecs.qmul.ac.uk/sceneseventschallenge/abstracts/SC/RNH.pdf
57. S. Chauhan, S. Phadke, and C. Sherland, "Event detection and classification," Tech. Rep., 2013 [Online]. Available: http://c4dm.eecs.qmul. ac.uk/sceneseventschallenge/abstracts/OL/CPS.pdf
58. A. Diment, T. Heittola, and T. Virtanen, "Sound event detection for office live and office synthetic AASP challenge," Tech. Rep., 2013 [Online]. Available: http://c4dm.eecs.qmul.ac.uk/sceneseventschallenge/abstracts/OL/DHV.pdf
59. J. F. Gemmeke, L. Vuegen, B. Vanrumste, and H. Van hamme, "An exemplar-based NMF approach for audio event detection," Tech. Rep., 2013 [Online]. Available: http://c4dm.eecs.qmul.ac.uk/sceneseventschallenge/abstracts/OL/GVV.pdf
60. W. Nogueira, G. Roma, and P. Herrera, "Automatic event classification using front end single channel noise reduction, MFCC features and a support vector machine classifier," Tech. Rep., 2013 [Online]. Available: http://c4dm.eecs.qmul.ac.uk/sceneseventschallenge/abstracts/OL/NVM.pdf
61. M. E. Niessen, T. L. M. Van Kasteren, and A. Merentitis, "Hierarchical sound event detection," Tech. Rep., 2013 [Online]. Available: http://c4dm.eecs.qmul.ac.uk/sceneseventschallenge/abstracts/OL/NR2.pdf
62. J. Schröder, B. Cauchi, M. R. Schädler, N. Moritz, K. Adiloglu, J. Anemüller, S. Doclo, B. Kollmeier, and S. Goetze, "Acoustic event detection using signal enhancement and spectro-temporal feature extraction," Tech. Rep., 2013 [Online]. Available: http://c4dm.eecs.qmul.ac. uk/sceneseventschallenge/abstracts/OL/SCS.pdf
63. L. Vuegen, B. Van Den Broeck, P. Karsmakers, J. F. Gemmeke, B. Vanrumste, and H. Van hamme, "An MFCC-GMM approach for event detection and classification," Tech. Rep., 2013 [Online]. Available: http://c4dm.eecs.qmul.ac.uk/sceneseventschallenge/abstracts/OL/VVK.pdf
64. D. Barchiesi, D. Giannoulis, D. Stowell, and M. D. Plumbley, "Acoustic scene classification: Classifying environments from the sounds they produce," IEEE Signal Process. Magazine vol. 32, no. 3, pp. 16-34, May 2015.
65. J. D. Gibbons and S. Chakraborti, Nonparametric Statistical Inference, 5th ed. London, U.K.: Chapman & Hall, 2010.
66. P. Sprent and N. C. Smeeton, Applied Nonparametric Statistical Methods, 3rd ed. Boca Raton, FL, USA: CRC Press, 2001.