End-to-end learning for music audio

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2014, Pages 6964-6968

  Dieleman, Sander ^a   Schrauwen, Benjamin ^a  

^a GHENT UNIVERSITY   (Belgium)

Author keywords

automatic tagging; convolutional neural networks; end to end learning; feature learning; music information retrieval

Indexed keywords

INFORMATION RETRIEVAL; NEURAL NETWORKS; SIGNAL PROCESSING; SPECTROGRAPHS;

AUTOMATIC TAGGING; CONVOLUTIONAL NEURAL NETWORK; END-TO-END LEARNING; FEATURE LEARNING; MUSIC INFORMATION RETRIEVAL;

AUDIO ACOUSTICS;

EID: 84905248193     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2014.6854950     Document Type: Conference Paper

References (29)

1. Geoffrey Hinton, Li Deng, Dong Yu, George E Dahl, Abdelrahman Mohamed, Navdeep Jaitly, Andrew Senior, Vincent Vanhoucke, Patrick Nguyen, Tara N Sainath, et al., "Deep neural networks for acoustic modeling in speech recognition: the shared views of four research groups," Signal Processing Magazine, IEEE, vol. 29, no. 6, pp. 82-97, 2012.
2. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "Imagenet classification with deep convolutional neural networks," in Advances in Neural Information Processing Systems 25, 2012.
3. Eric J. Humphrey, Juan P. Bello, and Yann LeCun, "Moving beyond feature design: Deep architectures and automatic feature learning in music informatics," in Proceedings of the 13th International Conference on Music Information Retrieval (ISMIR), 2012.
4. Quoc V. Le, Marc'Aurelio Ranzato, Rajat Monga, Matthieu Devin, Kai Chen, Greg S. Corrado, Jeff Dean, and Andrew Y. Ng, "Building high-level features using large scale unsupervised learning," in Proceedings of the 29th International Conference on Machine Learning (ICML-12), 2012.
5. Honglak Lee, Peter Pham, Yan Largman, and Andrew Ng, "Unsupervised feature learning for audio classification using convolutional deep belief networks," in Advances in Neural Information Processing Systems 22. 2009.
6. Mikael Henaff, Kevin Jarrett, Koray Kavukcuoglu, and Yann LeCun, "Unsupervised learning of sparse features for scalable audio classification," in Proceedings of the 12th International Conference on Music Information Retrieval (ISMIR), 2011.
7. J. Wulfing and M. Riedmiller, "Unsupervised learning of local features for music classification," in Proceedings of the 13th International Society for Music Information Retrieval Conference (ISMIR), 2012.
8. Sander Dieleman and Benjamin Schrauwen, "Multiscale approaches to music audio feature learning," in Proceedings of the 14th International Conference on Music Information Retrieval (ISMIR), 2013.
9. Jong-Hwan Lee, Ho-Young Jung, Te-Won Lee, and Soo-Young Lee, "Speech feature extraction using independent component analysis," in Acoustics, Speech, and Signal Processing, 2000. ICASSP'00. Proceedings. 2000 IEEE International Conference on. IEEE, 2000, vol. 3, pp. 1631-1634.
10. Michael S Lewicki, "Efficient coding of natural sounds," Nature neuroscience, vol. 5, no. 4, pp. 356-363, 2002.
11. Navdeep Jaitly and Geoffrey E. Hinton, "Learning a better representation of speech soundwaves using restricted boltzmann machines," in Proceedings of ICASSP 2011, 2011, pp. 5884-5887.
12. Urs Muller, Jan Ben, Eric Cosatto, Beat Flepp, and Yann L Cun, "Off-road obstacle avoidance through end-to-end learning," in Advances in neural information processing systems, 2005, pp. 739-746.
13. J Bergstra, D Yamins, and DD Cox, "Making a science of model search: Hyperparameter optimization in hundreds of dimensions for vision architectures," in Proceedings of the 30th International Conference on Machine Learning (ICML-13), 2013, vol. 28, pp. 115-123.
14. Yann LeCun, Lé on Bottou, Yoshua Bengio, and Patrick Haffner, "Gradient-based learning applied to document recognition," Proceedings of the IEEE, vol. 86, no. 11, pp. 2278-2324, 1998.
15. Honglak Lee, Roger Grosse, Rajesh Ranganath, and Andrew Y. Ng, "Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations," in Proceedings of the 26th Annual International Conference on Machine Learning, New York, NY, USA, 2009, ICML '09, pp. 609-616, ACM.
16. P. W. Mirowski, Y. LeCun, D. Madhavan, and R. Kuzniecky, "Comparing svm and convolutional networks for epileptic seizure prediction from intracranial eeg," Machine Learning for Signal Processing, 2008. MLSP 2008. IEEE Workshop on, pp. 244-249, 2008.
17. Alexandre Lacoste and Douglas Eck, "A supervised classification algorithm for note onset detection," in EURASIP Journal on Applied Signal Processing, 2007.
18. TL Li, Antoni B Chan, and AH Chun, "Automatic musical pattern feature extraction using convolutional neural network," in Proc. Int. Conf. Data Mining and Applications, 2010.
19. Sander Dieleman, Philé mon Brakel, and Benjamin Schrauwen, "Audio-based music classification with a pretrained convolutional network," in Proceedings of the 12th International Conference on Music Information Retrieval (ISMIR), 2011.
20. Eric J. Humphrey, Aron P. Glennon, and Juan Pablo Bello, "Non-linear semantic embedding for organizing large instrument sample libraries.," in ICMLA (2), Xue wen Chen, Tharam S. Dillon, Hisao Ishbuchi, Jian Pei, Haixun Wang, and M. Arif Wani, Eds. 2011, pp. 142-147, IEEE Computer Society.
21. Aaron van den Oord, Sander Dieleman, and Benjamin Schrauwen, "Deep content-based music recommendation," in Advances in Neural Information Processing Systems 26, 2013.
22. Edith Law and Luis von Ahn, "Input-agreement: a new mechanism for collecting data using human computation games," in Proceedings of the 27th international conference on Human factors in computing systems, 2009.
23. Vinod Nair and Geoffrey E. Hinton, "Rectified linear units improve restricted boltzmann machines," in Proceedings of the 27th International Conference on Machine Learning (ICML-10), 2010.
24. Ossama Abdel-Hamid, Abdel-rahman Mohamed, Hui Jiang, and Gerald Penn, "Applying convolutional neural networks concepts to hybrid nn-hmm model for speech recognition," in Acoustics, Speech and Signal Processing (ICASSP), 2012 IEEE International Conference on. IEEE, 2012, pp. 4277-4280.
25. G. E. Hinton, N. Srivastava, A. Krizhevsky, I. Sutskever, and R. R. Salakhutdinov, "Improving neural networks by preventing co-adaptation of feature detectors," Tech. Rep., University of Toronto, 2012.
26. James Bergstra, Olivier Breuleux, Fré dé ric Bastien, Pascal Lamblin, Razvan Pascanu, Guillaume Desjardins, Joseph Turian, David Warde-Farley, and Yoshua Bengio, "Theano: a CPU and GPU math expression compiler," in Proceedings of the Python for Scientific Computing Conference (SciPy), June 2010.
27. M. Muller, D. P. W. Ellis, A. Klapuri, and G. Richard, "Signal processing for music analysis," Selected Topics in Signal Processing, IEEE Journal of, vol. 5, no. 6, pp. 1088-1110, 2011.
28. Aapo Hyvarinen and Patrik Hoyer, "Emergence of phaseand shift-invariant features by decomposition of natural images into independent feature subspaces," Neural Comput., vol. 12, no. 7, pp. 1705-1720, July 2000.
29. Ian J Goodfellow, David Warde-Farley, Mehdi Mirza, Aaron Courville, and Yoshua Bengio, "Maxout networks," arXiv preprint arXiv:1302. 4389, 2013.