On-line continuous-time music mood regression with deep recurrent neural networks

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2014, Pages 5412-5416

  Weninger, Felix ^a   Eyben, Florian ^a   Schuller, Björn ^a,b  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^b IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

emotion recognition; music information retrieval; recurrent neural networks

Indexed keywords

ARTIFICIAL INTELLIGENCE; CONTINUOUS TIME SYSTEMS; FEEDFORWARD NEURAL NETWORKS; RECURRENT NEURAL NETWORKS; SIGNAL PROCESSING;

ACOUSTIC FEATURES; CONTINOUS TIME; CONTINUOUS-TIME; EMOTION RECOGNITION; MACHINE LEARNING APPROACHES; MUSIC INFORMATION RETRIEVAL; MUSICAL PIECES; SHORT-TERM VARIATIONS;

REGRESSION ANALYSIS;

EID: 84905226811     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2014.6854637     Document Type: Conference Paper

References (21)

1. Y. Feng, Y. Zhuang, and Y. Pan, "Popular music retrieval by detecting mood," in Proc. of SIGIR, 2003, pp. 375-376.
2. Y.H. Yang, Y.C. Lin, Y.F. Su, and H. Chen, "A regression approach to music emotion recognition," IEEE Transactions on Audio, Speech and Language Processing, vol. 16, no. 2, pp. 448-457, 2008.
3. S. Rho, B.J. Han, and E. Hwang, "SVR-based music mood classification and context-based music recommendation," in Proc. ACM Multimedia, Beijing, China, 2009, pp. 713-716.
4. B. Schuller, F. Weninger, and J. Dorfner, "Multi-Modal Non-Prototypical Music Mood Analysis in Continuous Space: Reliability and Performances," in Proceedings 12th International Society for Music Information Retrieval Conference, ISMIR 2011, Miami, FL, October 2011, ISMIR, pp. 759-764, ISMIR, (acceptance rate: 59 %).
5. E.M. Schmidt and Y.E. Kim, "Prediction of time-varying musical mood distributions from audio," in Proc. of ISMIR, 2010, pp. 465-470.
6. E. Coutinho and A. Cangelosi, "A neural network model for the prediction of musical emotions," in Advances in Cognitive Systems, S. Nefti-Meziani and J. Grey, Eds., pp. 331-368. IET Publisher, London, UK, 2010, ISBN: 978-1849190756.
7. J.A. Russell, "A circumplex model of affect," Journal of Personality and Social Psychology, vol. 39, no. 6, pp. 1161-1178, 1980.
8. E.M. Schmidt and Y.E. Kim, "Modeling musical emotion dynamics with conditional random fields," in Proc. of ISMIR, Miami, FL, USA, 2011, pp. 777-782.
9. F. Eyben, S. Bock, B. Schuller, and A. Graves, "Universal Onset Detection with Bidirectional Long-Short Term Memory Neural Networks," in Proceedings 11th International Society for Music Information Retrieval Conference, ISMIR 2010, Utrecht, The Netherlands, 2010, pp. 589-594, ISMIR.
10. S. Bock and M. Schedl, "Polyphonic piano note transcription with recurrent neural networks," in Proc. of ICASSP, Kyoto, Japan, 2012, pp. 121-124.
11. F. Weninger, F. Eyben, B.W. Schuller, M. Mortillaro, and K.R. Scherer, "On the Acoustics of Emotion in Audio: What Speech, Music and Sound have in Common," Frontiers in Emotion Science, vol. 4, no. Article ID 292, pp. 1-12, May 2013.
12. F. Eyben, M. Wollmer, and B. Schuller, "A Multi-Task Approach to Continuous Five-Dimensional Affect Sensing in Natural Speech," ACM Transactions on Interactive Intelligent Systems, Special Issue on Affective Interaction in Natural Environments, vol. 2, no. 1, March 2012, 29 pages.
13. N.N. Vempala and F.A. Russo, "Predicting emotion from music audio features using neural networks," in Proc. of 9th International Symposium on Computer Music Modelling and Retrieval (CMMR), London, UK, 2012, pp. 336-343.
14. E.M. Schmidt, J. Scott, and Y.E. Kim, "Feature learning in dynamic environments: Modeling the acoustic structure of musical emotion," in Proc. of ISMIR, 2012, pp. 325-330.
15. B. Schuller, S. Steidl, A. Batliner, A. Vinciarelli, K. Scherer, F. Ringeval, M. Chetouani, et al., "The INTERSPEECH 2013 Computational Paralinguistics Challenge: Social Signals, Conflict, Emotion, Autism," in Proc. of INTERSPEECH, Lyon, France, 2013, pp. 148-152, ISCA.
16. A. Graves, Supervised sequence labelling with recurrent neural networks, Ph.D. thesis, Technische Universitat Munchen, 2008.
17. F. Gers, J. Schmidhuber, and F. Cummins, "Learning to forget: Continual prediction with LSTM," Neural Computation, vol. 12, no. 10, pp. 2451-2471, 2000.
18. P. Vincent, H. Larochelle, Y. Bengio, and P. Manzagol, "Extracting and composing robust features with denoising autoencoders," in Proc. of ICML, 2008, pp. 1096-1103.
19. M. Soleymani, M. Caro, E.M. Schmidt, C.Y. Sha, and Y.H. Yang, "1000 songs for emotional analysis of music," in Proc. of CrowdMM (held in conjunction with ACM MM), Barcelona, Spain, 2013, ACM, to appear.
20. F. Weninger, F. Eyben, and B. Schuller, "The TUM approach to the MediaEval music emotion task using generic affective audio features," in Proc. of MediaEval 2013 held in conjunction with ACM MM, Barcelona, Spain, October 2013.
21. M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I.H. Witten, "The WEKA data mining software: an update," ACM SIGKDD Explorations Newsletter, vol. 11, no. 1, pp. 10-18, 2009.