Recurrent neural networks for polyphonic sound event detection in real life recordings

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn 2016-May, Issue , 2016, Pages 6440-6444

  Parascandolo, Giambattista ^a   Huttunen, Heikki ^a   Virtanen, Tuomas ^a  

^a TAMPERE UNIVERSITY OF TECHNOLOGY   (Finland)

Author keywords

bidirectional LSTM; deep learning; polyphonic sound event detection; Recurrent neural network

Indexed keywords

EID: 84973278436     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2016.7472917     Document Type: Conference Paper

References (27)

1. Aki Härmä, Martin F McKinney, and Janto Skowronek, "Automatic surveillance of the acoustic activity in our living environment, " in IEEE International Conference on Multimedia and Expo (ICME), 2005.
2. Selina Chu, Shrikanth Narayanan, and CC Jay Kuo, "Environmental sound recognition with time-frequency audio features, " IEEE Transactions on Audio, Speech, and Language Processing, vol. 17, no. 6, pp. 1142-1158, 2009.
3. Min Xu, Changsheng Xu, Lingyu Duan, Jesse S Jin, and Suhuai Luo, "Audio keywords generation for sports video analysis, " ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), vol. 4, no. 2, pp. 11, 2008.
4. Toni Heittola, Annamaria Mesaros, Antti Eronen, and Tuomas Virtanen, "Context-dependent sound event detection, " EURASIP Journal on Audio, Speech, and Music Processing, vol. 2013, no. 1, pp. 1-13, 2013.
5. Annamaria Mesaros, Toni Heittola, Antti Eronen, and Tuomas Virtanen, "Acoustic event detection in real life recordings, " in 18th European Signal Processing Conference, 2010, pp. 1267-1271.
6. Toni Heittola, Annamaria Mesaros, Tuomas Virtanen, and Moncef Gabbouj, "Supervised model training for overlapping sound events based on unsupervised source separation, " in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2013, pp. 8677-8681.
7. Satoshi Innami and Hiroyuki Kasai, "NMF-based environmental sound source separation using time-variant gain features, " Computers & Mathematics with Applications, vol. 64, no. 5, pp. 1333-1342, 2012.
8. Arnaud Dessein, Arshia Cont, and Guillaume Lemaitre, "Realtime detection of overlapping sound events with non-negative matrix factorization, " in Matrix Information Geometry, pp. 341-371. Springer, 2013.
9. Onur Dikmen and Annamaria Mesaros, "Sound event detection using non-negative dictionaries learned from annotated overlapping events, " in IEEEWorkshop on Applications of Signal Processing to Audio and Acoustics (WASPAA), 2013.
10. Annamaria Mesaros, Toni Heittola, Onur Dikmen, and Tuomas Virtanen, "Sound event detection in real life recordings using coupled matrix factorization of spectral representations and class activity annotations, " in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2015, pp. 606-618.
11. Jonathan Dennis, Huy Dat Tran, and Eng Siong Chng, "Overlapping sound event recognition using local spectrogram features and the generalised hough transform, " Pattern Recognition Letters, vol. 34, no. 9, pp. 1085-1093, 2013.
12. Emre Cakir, Toni Heittola, Heikki Huttunen, and Tuomas Virtanen, "Polyphonic sound event detection using multi label deep neural networks, " in IEEE International Joint Conference on Neural Networks (IJCNN), 2015.
13. Sepp Hochreiter and Jürgen Schmidhuber, "Long short-term memory, " Neural computation, vol. 9, no. 8, pp. 1735-1780, 1997.
14. Alex Graves and Jürgen Schmidhuber, "Framewise phoneme classification with bidirectional LSTM and other neural network architectures, " Neural Networks, vol. 18, no. 5, pp. 602-610, 2005.
15. Alex Graves, Abdel-rahman Mohamed, and Geoffrey Hinton, "Speech recognition with deep recurrent neural networks, " in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2013, pp. 6645-6649.
16. Florian Eyben, Sebastian Böck, Björn Schuller, and Alex Graves, "Universal onset detection with bidirectional long short-term memory neural networks., " in International Society for Music Information Retrieval Conference (ISMIR), 2010, pp. 589-594.
17. Sebastian Böck and Markus Schedl, "Polyphonic piano note transcription with recurrent neural networks, " in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2012, pp. 121-124.
18. Mike Schuster and Kuldip K Paliwal, "Bidirectional recurrent neural networks, " IEEE Transactions on Signal Processing, vol. 45, no. 11, pp. 2673-2681, 1997.
19. Yoshua Bengio, Patrice Simard, and Paolo Frasconi, "Learning long-term dependencies with gradient descent is difficult, " IEEE Transactions on Neural Networks, vol. 5, no. 2, pp. 157-166, 1994.
20. Alex Graves, Marcus Liwicki, Santiago Fernández, Roman Bertolami, Horst Bunke, and Jürgen Schmidhuber, "A novel connectionist system for unconstrained handwriting recognition, " IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 31, no. 5, pp. 855-868, 2009.
21. Arthur Nádas, David Nahamoo, Michael Picheny, et al., "Speech recognition using noise-adaptive prototypes, " IEEE Transactions on Acoustics, Speech and Signal Processing, vol. 37, no. 10, pp. 1495-1503, 1989.
22. Jan Schlüter and Thomas Grill, "Exploring data augmentation for improved singing voice detection with neural networks, " in International Society for Music Information Retrieval Conference (ISMIR), 2015.
23. Brian McFee, Eric J. Humphrey, and Juan P. Bello, "A software framework for musical data augmentation, " in International Society for Music Information Retrieval Conference (ISMIR), 2015.
24. Toni Heittola, Annamaria Mesaros, Antti Eronen, and Tuomas Virtanen, "Audio context recognition using audio event histograms, " in Proc. of the 18th European Signal Processing Conference (EUSIPCO), 2010, pp. 1272-1276.
25. Paul J Werbos, "Backpropagation through time: what it does and how to do it, " Proceedings of the IEEE, vol. 78, no. 10, pp. 1550-1560, 1990.
26. Tijmen Tieleman and Geoffrey Hinton, "Lecture 6. 5-rmsprop: Divide the gradient by a running average of its recent magnitude, " COURSERA: Neural Networks for Machine Learning, vol. 4, 2012.
27. Felix Weninger, "Introducing currennt: The Munich opensource CUDA recurrent neural network toolkit, " Journal of Machine Learning Research, vol. 16, pp. 547-551, 2015.