Deep Convolutional Neural Networks and Data Augmentation for Environmental Sound Classification

IEEE Signal Processing Letters

Volumn 24, Issue 3, 2017, Pages 279-283

  Salamon, Justin ^a   Bello, Juan Pablo ^b  

^a NEW YORK UNIVERSITY   (United States)

^b NEW YORK UNIVERSITY   (United States)

Author keywords

Deep convolutional neural networks (CNNs); deep learning; environmental sound classification; urban sound dataset

Indexed keywords

ACOUSTIC SIGNAL PROCESSING; CLASSIFICATION (OF INFORMATION); CONVOLUTION; DEEP LEARNING; NETWORK ARCHITECTURE; NEURAL NETWORKS;

CLASSIFICATION ACCURACY; CONVOLUTIONAL NEURAL NETWORK; DATA AUGMENTATION; DICTIONARY LEARNING; ENVIRONMENTAL SOUND CLASSIFICATIONS; PRIMARY CONTRIBUTION; TEMPORAL PATTERN; URBAN SOUND DATASET;

DEEP NEURAL NETWORKS;

EID: 85015238568     PISSN: 10709908     EISSN: None     Source Type: Journal    
DOI: 10.1109/LSP.2017.2657381     Document Type: Article

References (32)

1. S. Chu, S. Narayanan, and C.-C. Kuo, "Environmental sound recognition with time-frequency audio features," IEEE Trans. Audio, Speech, Language Process., vol. 17, no. 6, pp. 1142-1158, Aug. 2009
2. R. Radhakrishnan, A. Divakaran, and P. Smaragdis, "Audio analysis for surveillance applications," in Proc. IEEE Workshop Appl. Signal Process. Audio Acoust., New Paltz, NY, USA, Oct. 2005, pp. 158-161
3. C. Mydlarz, J. Salamon, and J. P. Bello, "The implementation of low-cost urban acoustic monitoring devices," Appl. Acoust., vol. 117, pp. 207-218, 2016
4. A. Mesaros, T. Heittola, O. Dikmen, and T. Virtanen, "Sound event detection in real life recordings using coupled matrix factorization of spectral representations and class activity annotations," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Brisbane, Australia, Apr. 2015, pp. 151-155
5. E. Benetos, G. Lafay, M. Lagrange, and M. D. Plumbley, "Detection of overlapping acoustic events using a temporally-constrained probabilistic model," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Shanghai, China, Mar. 2016, pp. 6450-6454
6. V. Bisot, R. Serizel, S. Essid, and G. Richard, "Acoustic scene classification with matrix factorization for unsupervised feature learning," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Shanghai, China, Mar. 2016, pp. 6445-6449
7. J. Salamon and J. P. Bello, "Unsupervised feature learning for urban sound classification," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Brisbane, Australia, Apr. 2015, pp. 171-175
8. J. Salamon and J. P. Bello, "Feature learning with deep scattering for urban sound analysis," in Proc. 2015 23rd Eur. Signal Process. Conf., Nice, France, Aug. 2015, pp. 724-728
9. J. T. Geiger and K. Helwani, "Improving event detection for audio surveillance using gabor filterbank features," in Proc. 23rd Eur. Signal Process. Conf., Nice, France, Aug. 2015, pp. 714-718
10. E. Cakir, T. Heittola, H. Huttunen, and T. Virtanen, "Polyphonic sound event detection using multi label deep neural networks," in Proc. 2015 Int. Joint Conf. Neural Netw., Jul. 2015, pp. 1-7
11. K. J. Piczak, "Environmental sound classification with convolutional neural networks," in Proc. 25th Int. Workshop Mach. Learning Signal Process., Boston, MA, USA, Sep. 2015, pp. 1-6
12. D. Giannoulis, E. Benetos, D. Stowell, M. Rossignol, M. Lagrange, and M. D. Plumbley, "Detection and classification of acoustic scenes and events: An IEEE AASP challenge," in Proc. IEEE Workshop Appl. Signal Process. Audio Acoust., New Paltz, NY, USA, Oct. 2013, pp. 1-4
13. D. Stowell, D. Giannoulis, E. Benetos, M. Lagrange, and M. D. Plumbley, "Detection and classification of acoustic scenes and events," IEEE Trans. Multimedia, vol. 17, no. 10, pp. 1733-1746, Oct. 2015
14. S. Sigtia, A. Stark, S. Krstulovic, and M. Plumbley, "Automatic environmental sound recognition: Performance versus computational cost," IEEE/ACM Trans. Audio, Speech, Language Process., vol. 24, no. 11, pp. 2096-2107, Nov. 2016
15. Y. Lecun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-based learning applied to document recognition," Proc. IEEE, vol. 86, no. 11, pp. 2278-2324, Nov. 1998
16. C. V. Cotton and D. P.W. Ellis, "Spectral vs. spectro-temporal features for acoustic event detection," in Proc. IEEE Workshop Appl. Signal Process. Audio Acoust., New Paltz, NY, USA, Oct. 2011, pp. 69-72
17. J. Salamon, C. Jacoby, and J. P. Bello, "A dataset and taxonomy for urban sound research," in Proc. 22nd ACM Int. Conf. Multimedia, Orlando, FL, USA, Nov. 2014, pp. 1041-1044
18. K. J. Piczak, "ESC: Dataset for environmental sound classification," in Proc. 23rd ACM Int. Conf. Multimedia, Brisbane, Australia, Oct. 2015, pp. 1015-1018
19. A. Mesaros, E. Fagerlund, A. Hiltunen, T. Heittola, and T. Virtanen, "TUT sound events 2016, development dataset," 2016. [Online]. Available: http://dx.doi.org/10.5281/zenodo.45759. Accessed on: Aug. 10, 2016
20. A. Krizhevsky, I. Sutskever, and G. Hinton, "ImageNet classification with deep convolutional neural networks," in Proc. Adv. Neural Inform. Process. Syst., 2012, pp. 1097-1105
21. P. Y. Simard, D. Steinkraus, and J. C. Platt, "Best practices for convolutional neural networks applied to visual document analysis," in Proc. Int. Conf. Document Anal. Recognit., Edinburgh, U.K., Aug. 2003, vol. 3, pp. 958-962
22. B. McFee, E. Humphrey, and J. Bello, "A software framework for musical data augmentation," in Proc. 16th Int. Soc. Music Inf. Retrieval Conf., Malaga, Spain, Oct. 2015, pp. 248-254
23. G. Parascandolo, H. Huttunen, and T. Virtanen, "Recurrent neural networks for polyphonic sound event detection in real life recordings," in Proc. Int. Conf. Acoust., Speech, Signal Process., Shanghai, China, Mar. 2016, pp. 6440-6444
24. D. Bogdanov et al. "ESSENTIA: An audio analysis library for music information retrieval," in Proc. 14th Int. Soc. Music Inf. Retrieval Conf., Curitiba, Brazil, Nov. 2013, pp. 493-498
25. L. Bottou, "Large-scale machine learning with stochastic gradient descent," in Proc. 19th Int. Conf. Comput. Statist., Paris, France, Aug. 2010, pp. 177-186. [Online]. Available: http://dx.doi.org/10.1007/978-3-7908-2604-3-16
26. N. Srivastava, G. E. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, "Dropout: A simple way to prevent neural networks from overfitting," J. Mach. Learning Res., vol. 15, no. 1, pp. 1929-1958, 2014
27. S. Dieleman et al. "Lasagne: First release," 2015. [Online]. Available: https://github.com/Lasagne/Lasagne
28. B. McFee and E. J. Humphrey, "Pescador: 0.1.0," 2015. [Online]. Available: http://dx.doi.org/10.5281/zenodo.32468
29. Dolby Labortories, Inc., "Standards and practices for authoring Dolby Digital and Dolby E bitstreams," 2002
30. "Icecast streaming media server forum," [Online]. Available: http://icecast.imux.net/viewtopic.phpt=3462. Accessed on: Aug. 12, 2016
31. E. J. Humphrey, J. Salamon, O. Nieto, J. Forsyth, R. Bittner, and J. P. Bello, "JAMS: A JSON annotated music specification for reproducible MIR research," in Proc. 15th Int. Soc. Music Inf. Retrieval Conf., Taipei, Taiwan, Oct. 2014, pp. 591-596
32. B. McFee et al., "Pump up the JAMS: V0.2 and beyond," Music and Audio Research Laboratory, New York University, New York, NY, USA, Oct. 2015, unpublished.