Non-linear prediction with LSTM recurrent neural networks for acoustic novelty detection

Proceedings of the International Joint Conference on Neural Networks

Volumn 2015-September, Issue , 2015, Pages

  Marchi, Erik ^a   Vesperini, Fabio ^b   Weninger, Felix ^a   Eyben, Florian ^a   Squartini, Stefano ^b   Schuller, Björn ^c,d  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^b UNIVERSITÀ POLITECNICA DELLE MARCHE   (Italy)

^c UNIVERSITY OF PASSAU   (Germany)

^d IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

LEARNING SYSTEMS; SIGNAL DETECTION;

ACOUSTIC SIGNALS; GENERATIVE MODEL; LONG SHORT TERM MEMORY; NON-LINEAR PREDICTIONS; NOVELTY DETECTION; RECONSTRUCTION ERROR; SPECTRAL FEATURE; STATE-OF-THE-ART METHODS;

RECURRENT NEURAL NETWORKS;

EID: 84950971755     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2015.7280757     Document Type: Conference Paper

References (36)

1. L. Tarassenko, P. Hayton, N. Cerneaz, and M. Brady, "Novelty detection for the identification of masses in mammograms, " in Proceedings Fourth International Conference on Artificial Neural Networks, 1995. IET, 1995, pp. 442-447.
2. K. Worden, G. Manson, and D. Allman, "Experimental validation of a structural health monitoring methodology: Part i. novelty detection on a laboratory structure, " Journal of Sound and Vibration, vol. 259, no. 2, pp. 323-343, 2003.
3. J. Foote, "Automatic audio segmentation using a measure of audio novelty, " in Proceedings IEEE International Coriference on Multimedia and Expo, ICME 2000., vol. 1. IEEE, 2000, pp. 452-455.
4. C. M. Bishop, "Novelty detection and neural network validation, " IEEE Vision, Image and Signal Processing, vol. 141, no. 4, pp. 217-222, Aug 1994.
5. N. Japkowicz, C. Myers, M. Gluck et al., "A novelty detection approach to classification, " in Proceedings International Joint Conference on Artificial Intelligence, IJCAI 1995, 1995, pp. 518-523.
6. B. B. Thompson, R. J. Marks, J. J. Choi, M. A. El-Sharkawi, M. Y. Huang, and C. Bunje, "Implicit learning in autoencoder novelty assessment, " in Neural Networks, 2002. IJCNN'02. Proceedings of the 2002 International foint Coriference on, vol. 3. IEEE, 2002, pp. 2878-2883.
7. S. Hawkins, H. He, G. Williams, and R. Baxter, "Outlier detection using replicator neural networks, " in Data Warehousing and Knowledge Discovery. Springer, 2002, pp. 170-180.
8. N. Japkowicz, "Supervised versus unsupervised binary-learning by feedforward neural networks, " Machine Learning, vol. 42, no. 1-2, pp. 97-122, 2001.
9. L. Manevitz and M. Yousef, "One-class document classification via neural networks, " Neurocomputing, vol. 70, no. 79, pp. 1466-1481, 2007.
10. G. Williams, R. Baxter, H. He, S. Hawkins, and L. Gu, "A comparative study of rnn for outlier detection in data mining, " in Proceedings IEEE 13th International Coriference on Data Mining, 2002. IEEE Computer Society, 2002, pp. 709-709.
11. H. Sohn, K. Worden, and C. R. Farrar, "Statistical damage classification under changing environmental and operational conditions, " Journal of Intelligent Material Systems and Structures, vol. 13, no. 9, pp. 561-574, 2002.
12. G. Linares, P. Nocera, and H. Meloni, "Mixed acoustic events classification using ica and subspace classifier, " in IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 1997., vol. 4, Apr 1997, pp. 3365-3368 vol. 4.
13. P. Atrey, M. Maddage, and M. Kankanhalli, "Audio based event detection for multimedia surveillance, " in IEEE International Coriference on Acoustics, Speech and Signal Processing, ICASSP 2006., vol. 5, May 2006, pp. v-v.
14. A. Harma, M. F. McKinney, and J. Skowronek, "Automatic surveillance of the acoustic activity in our living environment, " in IEEE International Conference on Multimedia and Expo, ICME 2005. IEEE, 2005, p. 4.
15. C. Clavel, T. Ehrette, and G. Richard, "Events detection for an audiobased surveillance system, " in Multimedia and Expo, 2005. ICME 2005. IEEE International Coriference on, July 2005, pp. 1306-1309.
16. S. Ntalampiras, I. Potamitis, and N. Fakotakis, "Probabilistic novelty detection for acoustic surveillance under real-world conditions, " IEEE Transactions on Multimedia, vol. 13, no. 4, pp. 713-719, 2011.
17. E. Principi, S. Squartini, R. Bonfigli, G. Ferroni, and F. Piazza, "An integrated system for voice command recognition and emergency detection based on audio signals, " Expert Systems with Applications, 2015.
18. S. Ntalampiras, I. Potamitis, and N. Fakotakis, "On acoustic surveillance of hazardous situations, " in IEEE International Coriference on Acoustics, Speech and Signal Processing, ICASSP 2009. IEEE, 2009, pp. 165-168.
19. E. Marchi, F. Vesperini, F. Eyben, S. Squartini, and B. Schuller, "A Novel Approach for Automatic Acoustic Novelty Detection Using a Denoising Autoencoder with Bidirectional LSTM Neural Networks, " in Proceedings 40th IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2015, IEEE. Brisbane, Australia: IEEE, April 2015, (5 pages), to appear.
20. F. A. Gers, N. N. Schraudolph, and J. Schmidhuber, "Learning precise timing with lstm recurrent networks, " The Journal of Machine Learning Research, vol. 3, pp. 115-143, 2003.
21. A. Graves, "Generating sequences with recurrent neural networks, " CoRR, vol. abs/1308. 0850, 2013.
22. D. Eck and J. Schmidhuber, "Finding temporal structure in music: Blues improvisation with lstm recurrent networks, " in 12th IEEE Workshop on Neural Networks for Signal Processing, 2002. IEEE, 2002, pp. 747-756.
23. J. Goodfellow, H. Lee, Q. v. Le, A. Saxe, and A. Y. Ng, "Measuring invariances in deep networks, " in Advances in Neural Information Processing Systems 22, Y. Bengio, D. Schuurmans, J. Lafferty, C. Williams, and A. Culotta, Eds. Curran Associates, Inc., 2009, pp. 646-654.
24. Y. Bengio, P. Lamblin, D. Popovici, and H. Larochelle, "Greedy layerwise training of deep networks, " in Advances in Neural Information Processing Systems 19, B. Scholkopf, J. Platt, and T. Hoffman, Eds. MIT Press, 2007, pp. 153-160.
25. P. Vincent, H. Larochelle, I. Lajoie, Y. Bengio, and P'-A. Manzagol, "Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion, " Journal of Machine Learning Research, vol. 11, pp. 3371-3408, Dec. 2010.
26. S. Hochreiter and J. Schmidhuber, "Long short-term memory, " Neural Computation, vol. 9, no. 8, pp. 1735-1780, 1997.
27. M. Schuster and K. K. Paliwal, "Bidirectional recurrent neural networks, " IEEE Transactions on Signal Processing, vol. 45, no. II, pp. 2673-2681, Nov 1997.
28. A. Graves and J. Schmidhuber, "Framewise phoneme classification with bidirectional {LSTM} and other neural network architectures, " Neural Networks, vol. 18, no. 56, pp. 602-610, 2005, {IJCNN} 2005.
29. G. Hinton, L. Deng, D. Yu, G. E. Dahl, A.-r. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T. N. Sainath, and B. Kingsbury, "Deep neural ynetworks for acoustic modeling in speech recognition: The shared views of four research groups, " IEEE Signal Processing Magazine, vol. 29, no. 6, pp. 82-97, 2012.
30. F. Eyben, S. Bock, B. Schuller, and A. Graves, "Universal onset detection with bidirectional long short-term memory neural networks. " in ISMIR, 2010, pp. 589-594.
31. F. Eyben, M. Wiillmer, and B. Schuller, "openSMlLE-The Munich Versatile and Fast Open-Source Audio Feature Extractor, " in Proceedings of the 18th ACM International Coriference on Multimedia, MM 2010, ACM. Florence, Italy: ACM, October 2010, pp. 1459-1462.
32. J. Barker, E. Vincent, N. Ma, H. Christensen, and P. Green, "The pascal chime speech separation and recognition challenge, " Computer Speech & Language, vol. 27, no. 3, pp. 621-633, 2013.
33. F. Weninger, J. Bergmann, and B. Schuller, "Introducing CURRENNT, the Munich open-source CUDA RecurREnt Neural Network Toolkit, " Journal of Machine Learning Research, 2014, in press.
34. R. Collobert, K. Kavukcuoglu, and C. Farabet, "Torch7: A matlab-like environment for machine learning, " in BigLearn, NIPS Workshop, no. EPFL-CONF-192376, 2011.
35. M. Smucker, J. Allan, and B. Carterette, "A comparison of statistical significance tests for information retrieval evaluation, " in Proceedings of the sixteenth ACM conference on Conference on information and knowledge management. ACM, 2007, pp. 623-632.
36. E. Marchi, G. Ferroni, F. Eyben, L. Gabrielli, S. Squartini, and B. Schuller, "Multi-resolution linear prediction based features for audio onset detection with bidirectional lstm neural networks, " in Acoustics, Speech and Signal Processing (ICASSP), 2014 IEEE International Coriference on, May 2014, pp. 2164-2168.