Deep Learning and Music Adversaries

IEEE Transactions on Multimedia

Volumn 17, Issue 11, 2015, Pages 2059-2071

  Kereliuk, Corey ^a   Sturm, Bob L ^b   Larsen, Jan ^a  

^a TECHNICAL UNIVERSITY OF DENMARK   (Denmark)

^b QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

AEA MIR content based processing and music information retrieval; deep learning

Indexed keywords

LEARNING SYSTEMS; NETWORK ARCHITECTURE; OBJECT RECOGNITION;

BENCHMARK DATASETS; CLASSIFICATION SYSTEM; DEEP LEARNING; FALSE NEGATIVES; HIGH CONFIDENCE; IMAGE OBJECT RECOGNITION; MUSIC CONTENT ANALYSIS; MUSIC INFORMATION RETRIEVAL;

AUDIO SYSTEMS;

EID: 84946221961     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2015.2478068     Document Type: Article

References (65)

1. H. Lee, Y. Largman, P. Pham, and A. Y. Ng, "Unsupervised feature learning for audio classification using convolutional deep belief networks," in Proc. NIPS, Dec. 2009, pp. 1096-1104.
2. P. Hamel and D. Eck, "Learning features from music audio with deep belief networks," in Proc. ISMIR, 2010, pp. 339-344.
3. X. Yang, Q. Chen, S. Zhou, and X. Wang, "Deep belief networks for automatic music genre classification," in Proc. Interspeech, 2011, pp. 2433-2436.
4. E. J. Humphrey, J. P. Bello, and Y. LeCun, "Feature learning and deep architectures: New directions for music informatics," J. Intell. Inf. Syst., vol. 41, no. 3, pp. 461-481, 2013.
5. A. van den Oord, S. Dieleman, and B. Schrauwen, "Deep content-based music recommendation," in Proc. NIPS, 2013, pp. 2643-2651.
6. A. Pikrakis, "A deep learning approach to rhythm modeling with applications," in Proc. Int. Workshop Mach. Learn. Music, 2013, pp. 1-4.
7. S. Sigtia and S. Dixon, "Improved music feature learning with deep neural networks," in Proc. ICASSP, May 2014, pp. 6959-6963.
8. S. Dieleman and B. Schrauwen, "End-to-end learning for music audio," in Proc. ICASSP, May 2014, pp. 6964-6968.
9. C. Zhang, G. Evangelopoulos, S. Voinea, L. Rosasco, and T. Poggio, "A deep representation for invariance and music classification," in Proc. ICASSP, May 2014, pp. 6984-6988.
10. C. Szegedy et al., "Intriguing properties of neural networks," in Proc. ICLR, 2014, pp. 1-9.
11. B. L. Sturm, "Making explicit the formalism underlying evaluation in music information retrieval research: A look at the {MIREX} automatic mood classification task," in Proc. Comput. Music Modeling Res., 2014, pp. 89-104.
12. B. L. Sturm, "The state of the art ten years after a state of the art: Future research in music information retrieval," J. New Music Res., vol. 43, no. 2, pp. 147-172, 2014.
13. B. L. Sturm, C. Kereliuk, and J. Larsen, "¿El Caballo Viejo? Latin genre recognition with deep learning and spectral periodicity," in Proc. Int. Conf. Math. Comput. Music, 2015, pp. 335-346.
14. C. Kereliuk, B. L. Sturm, and J. Larsen, "Deep learning, audio adversaries, and music content analysis," in Proc. WASPAA, 2015, pp. 1-10.
15. I. J. Goodfellow, J. Shlens, and C. Szegedy, "Explaining and harnessing adversarial examples," in Proc. ICLR, 2015, pp. 1-11.
16. S. Gu and L. Rigazio, "Towards deep neural network architectures robust to adversarial examples," CoRR, Dec. 2014 [Online]. Available: http://arxiv.org/abs/1412.5068
17. M. Casey et al., "Content-based music information retrieval: Current directions and future challenges," Proc. IEEE, vol. 96, no. 4, pp. 668-696, Apr. 2008.
18. A. Wang, "An industrial strength audio search algorithm," in Proc. Int. Soc. Music Info. Retrieval, Oct. 2003, pp. 1-7.
19. M. Casey, C. Rhodes, and M. Slaney, "Analysis of minimum distances in high-dimensional musical spaces," IEEE Trans. Audio, Speech, Lang. Process., vol. 16, no. 5, pp. 1015-1028, Jul. 2008.
20. S. Ewert, B. Pardo, M. Muller, and M. Plumbley, "Score-informed source separation for musical audio recordings: An overview," IEEE Signal Process. Mag., vol. 31, no. 3, pp. 116-124, May 2014.
21. J.-J. Aucouturier and F. Pachet, "Scaling up music playlist generation," in Proc. IEEE Int. Conf. Multimedia Expo., Aug. 2002, vol. 1, pp. 105-108.
22. T. Bertin-Mahieux, D. Eck, and M. Mandel, "Automatic tagging of audio: The state-of-the-art," in Machine Audition: Principles, Algorithms and Systems, W. Wang, Ed. Hershey, PA, USA: IGI Global, 2010.
23. Y.-H. Yang and H. H. Chen, Music Emotion Recognition. Boca Raton, FL, USA: CRC, 2011.
24. N. Collins, "Computational analysis of musical influence: A musicological case study using mir tools," in Proc. ISMIR, 2010, pp. 177-182.
25. D. Schwarz, "Concatenative sound synthesis: The early years," J. New Music Res., vol. 35, no. 1, pp. 3-22, Mar. 2006.
26. L. Deng and D. Yu, Deep Learning:Methods and Applications. Delft, The Netherlands: Now, 2014.
27. Y. Bengio, I. Goodfellow, and A. Courville, Deep Learning. Cambridge, MA, USA: MIT Press, 2015.
28. F. Bastien et al., "Theano: New features and speed improvements," in Proc. Deep Learn. Unsupervised Feature Learn. NIPS 2012Workshop, 2012, pp. 1-10.
29. J. Bergstra et al., "Theano: A CPU and GPU math expression compiler," presented at the Python Sci. Comput. Conf., Austin, TX, USA, Jun. 2010.
30. G. Montavon, G. B. Orr, and K.-R. Müller, Neural Networks, Tricks of the Trade, Reloaded, ser. Lecture Notes Comput. Sci. (LNCS 7700). New York, NY, USA: Springer, 2012.
31. T. L. Li, A. B. Chan, and A. H. Chun, "Automatic musical pattern feature extraction using convolutional neural network," in Proc. Int. Conf. Data Mining Appl., 2010, pp. 546-550.
32. G. A. Wiggins, "Semantic gap Schemantic schmap!! Methodological considerations in the scientific study of music," in Proc. IEEE Int. Symp. Mulitmedia, Dec. 2009, pp. 477-482.
33. J.-J. Aucouturier and F. Pachet, "Improving timbre similarity: How high is the sky?," J. Negative Results Speech Audio Sci., vol. 1, no. 1, pp. 1-13, 2004.
34. E. Pampalk, A. Flexer, and G. Widmer, "Improvements of audio-based music similarity and genre classification," in Proc. Int. Soc.Music Info. Retrieval, Sep. 2005, pp. 628-233.
35. A. Flexer, "A closer look on artist filters for musical genre classification," in Proc. ISMIR, Sep. 2007, pp. 341-344.
36. A. Flexer, D. Schnitzer, M. Gasser, and T. Pohle, "Combining features reduces hubness in audio similarity," in Proc. Int. Symp. Music Info. Retrieval, 2010, pp. 171-176.
37. B. L. Sturm, "Classification accuracy is not enough: On the evaluation of music genre recognition systems," J. Intell. Inf. Syst., vol. 41, no. 3, pp. 371-406, 2013.
38. J. Urbano, M. Schedl, and X. Serra, "Evaluation in music information retrieval," J. Intell. Inf. Syst., vol. 41, no. 3, pp. 345-369, Dec. 2013.
39. B. L. Sturm, ""Horse" inside: Seeking causes of the behaviours of music content analysis systems," in Proc. ACM Comput. Entertainment, accepted for publication.
40. B. L. Sturm, C. Kereliuk, and A. Pikrakis, "A closer look at deep learning neural networks with low-level spectral periodicity features," in Proc. Int. Workshop Cognitive Inf. Process, 2014, pp. 1-6.
41. A. Nguyen, J. Yosinski, and J. Clune, "Deep neural networks are easily fooled: High confidence predictions for unrecognizable images," in Proc. CVPR, 2015, pp. 427-436.
42. N. Dalvi, P. Domingos, S. Mausam, Sanghai, and D. Verma, "Adversarial classification," in Proc. KDD, 2004, pp. 99-108.
43. N. Griffith and P. M. Todd, Musical Networks: Parallel Distributed Perception and Performance. Cambridge, MA, USA: MIT Press, 1999.
44. C. J. C. Burges, J. C. Platt, and S. Jana, "Distortion discriminant analysis for audio fingerprinting," IEEE Trans. Speech Audio Process., vol. 11, no. 3, pp. 165-174, May 2003.
45. B. Matityaho and M. Furst, "Neural network based model for classification of music type," in Proc. Conv. Elect. Electron. Eng. Israel, Mar. 1995, pp. 1-5.
46. N. Vempala and F. Russo, "Predicting emotion from music audio features using neural networks," in Proc. CMMR, 2012, pp. 336-343.
47. B. Whitman, G. Flake, and S. Lawrence, "Artist detection in music with Minnowmatch," in Proc. IEEE Workshop Neural Netw. Signal Process., Sep. 2001, pp. 559-568.
48. G. Papadopoulos and G. Wiggins, "AI methods for algorithmic composition: A survey, a critical view and future prospects," in Proc. AISB Symp. Musical Creativity, 1999, pp. 110-117.
49. G. Tzanetakis and P. Cook, "Musical genre classification of audio signals," IEEE Trans. Speech Audio Process., vol. 10, no. 5, pp. 293-302, Jul. 2002.
50. S. Dieleman, P. Brakel, and B. Schrauwen, "Audio-based music classification with a pretrained convolutional network," in Proc. ISMIR, 2011, pp. 669-674.
51. T. Bertin-Mahieux, D. P. Ellis, B. Whitman, and P. Lamere, "The million song dataset," in Proc. ISMIR, 2011, pp. 591-596.
52. F. Weninger, F. Eyben, and B. Schuller, "On-line continuous-time music mood regression with deep recurrent neural networks," in Proc. ICASSP, May 2014, pp. 5412-5416.
53. E. Battenberg and D. Wessel, "Analyzing drum patterns using conditional deep belief networks," in Proc. ISMIR, 2012, pp. 37-42.
54. N. Boulanger-Lewandowski, Y. Bengio, and P. Vincent, "Audio chord recognition with recurrent neural networks," in Proc. ISMIR, 2013, pp. 335-340.
55. E. Humphrey and J. Bello, "From music audio to chord tablature: Teaching deep convolutional networks toplay guitar," in Proc. ICASSP, May 2014, pp. 6974-6978.
56. Y. Bengio, "Learning deep architectures for AI," Found. Trends Mach. Learn., vol. 2, no. 1, pp. 1-127, 2009.
57. C. N. Silla, A. L. Koerich, and C. A. A. Kaestner, "The Latin music database," in Proc. ISMIR, 2008, pp. 451-456.
58. B. L. Sturm, "A survey of evaluation in music genre recognition," in Adaptive Multimedia Retrieval: Semantics, Context, and Adaptation, A. Nürnberger, S. Stober, B. Larsen, and M. Detyniecki, Eds. Zug, Switzerland: Springer, Oct. 2014, vol. LNCS 8382, pp. 29-66.
59. J. B. Allen and L. Rabiner, "A unified approach to short-time Fourier analysis and synthesis," Proc. IEEE, vol. 65, no. 11, pp. 1558-1564, Nov. 1977.
60. T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd ed. Berlin, Germany: Springer-Verlag, 2009.
61. D. Griffin and J. S. Lim, "Signal estimation from modified short-time Fourier transform," IEEE Trans. Acoust., Speech, Signal Process., vol. ASSP-32, no. 2, pp. 236-243, Apr. 1984.
62. M. Henaff, K. Jarrett, K. Kavukcuoglu, and Y. LeCun, "Unsupervised learning of sparse features for scalable audio classification," in Proc. Int. Soc. Music Inf. Retrieval, Oct. 2011, pp. 681-686.
63. B. L. Sturm, "An analysis of the GTZAN music genre dataset," in Proc. ACM MIRUM Workshop, Nov. 2012, pp. 7-12.
64. M. Schedl, A. Flexer, and J. Urbano, "The neglected user in music information retrieval research," J. Intell. Inf. Syst., vol. 41, no. 3, pp. 523-539, 2013.
65. S. Dixon, F. Gouyon, and G. Widmer, "Towards characterisation of music via rhythmic patterns," in Proc. ISMIR, 2004, pp. 509-517.