Automatic detection of emotion in music: Interaction with emotionally sensitive machines

Handbook of Research on Synthetic Emotions and Sociable Robotics: New Applications in Affective Computing and Artificial Intelligence

Volumn , Issue , 2009, Pages 9-33

  Laurier, Cyril ^a   Herrera, Perfecto ^a  

^a UNIVERSITAT POMPEU FABRA   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 77950187300     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4018/978-1-60566-354-8.ch002     Document Type: Chapter

References (75)

1. Besson, M., Faita, F., Peretz, I., Bonnel, A. M., & Requin, J. (1998). Singing in the brain: Independence of lyrics and tunes. Psychological Science, 9(6), 494-498.
2. Bigand, E., Vieillard, S., Madurell, F., Marozeau, J., & Dacquet, A. (2005). Multidimensional scaling of emotional responses to music: The effect of musical expertise and of the duration of the excerpts. Cognition & Emotion, 19(8), 1113-1139.
3. Blood, A. J., & Zatorre, R. J. (2001). Intensely pleasurable responses to music correlate with activity in brain regions implicated in reward and emotion. Proceedings of the National Academy of Sciences of the United States of America, 98(20), 11818-11823.
4. Bonny, H. L. (2002). Music consciousness: The evolution of guided imagery and music (L. Summer, Ed.). Barcelona Publishers.
5. Casacuberta, D. (2004). Dj el niño: expressing synthetic emotions with music. AI & Society, 18(3), 257-263.
6. Clark, D. M., & Teasdale, J. D. (1985). Constraints on the effect of mood on memory. Journal of Personality and Social Psychology, 48, 1595-1608.
7. Dalla Bella, Peretz, I., Rousseau, L., & Gosselin, N. (2001). A developmental study of the affective value of tempo and mode in music. Cognition, 80(3), 1-10.
8. Damasio, A. (1994). Descartes' error: Emotion, reason, and the human brain. New York: Harper Perennial.
9. Davies, S. (2001). Philosophical perspectives on music's expressiveness. In P. N. Juslin & J. A. Sloboda (Eds.), Music and emotion: Theory and research. Oxford: Oxford University Press.
10. Downie, J. S. (2006). The music information retrieval evaluation exchange (MIREX). D-Lib Magazine, 12(12).
11. Ekman, P. (1992). An argument for basic emotions. Cognition & Emotion, 6(3), 169-200.
12. Farnsworth, P. R. (1954). A study of the hevner adjective list. The Journal of Aesthetics and Art Criticism, 13(1), 97-103.
13. Fehr, B., & Russell, J. A. (1984). Concept of emotion viewed from a prototype perspective. Journal of Experimental Psychology: General, 113(3), 464-486.
14. Friberg, A., Bresin, R., & Sundberg, J. (2006). Overview of the KTH rule system for musical performance. Advances in Cognitive Psychology, 2(2-3), 145-161.
15. Frijda, N. H. (1987). The emotions (studies in emotion and social interaction). Cambridge University Press.
16. Gómez, E. (2006). Tonal description of music audio signals. Doctoral dissertation, Universitat Pompeu Fabra.
17. Gosselin, N., Peretz, I., Noulhiane, M., Hasboun, D., Beckett, C., Baulac, M., et al. (2005). Impaired recognition of scary music following unilateral temporal lobe excision. Brain, 128(3), 628-640.
18. Gouyon, F., Herrera, P., Gómez, E., Cano, P., Bonada, J., Loscos, A., et al. (2008). Content processing of music audio signals. In P. Polotti & D. Rocchesso (Eds.), Sound to sense, sense to sound: A state of the art in sound and music computing (pp. 83-160). Berlin: Logos Verlag Berlin GmbH.
19. Grewe, O., Nagel, F., Kopiez, R., & Altenmüller, E. (2007). Emotions over time: synchronicity and development of subjective, physiological, and facial affective reactions to music. Emotion, 7(4), 774-788.
20. Guaus, E., & Herrera, P. (2006). Music genre categorization in humans and machines. In Proceedings of the 121st Convention of the Audio Engineering Society.
21. Herrera, P., Bello, J., Widmer, G., Sandler, M., Celma, O., Vignoli, F., et al. (2005). SIMAC: Semantic interaction with music audio contents. In Proceedings of the 2nd European Workshop on the Integration of Knowledge, Semantics and Digital Media Technologies (pp. 399-406). London, UK.
22. Hevner, K. (1936). Experimental studies of the elements of expression in music. The American Journal of Psychology, 48(2), 246-268.
23. Honing, H., & Ladinig, O. (2008). The potential of the internet for music perception research: A comment on lab-based versus web-based studies. Empirical Musicology Review, 3(1), 4-7.
24. Hu, X., Downie, S. J., Laurier, C., Bay, M., & Ehmann, A. F. (2008). The 2007 MIREX audio mood classification task: Lessons learned. In Proceedings of the 9th International Conference on Music Information Retrieval (pp. 462-467). Philadelphia, PA, USA.
25. Huron, D. (2006). Sweet anticipation: Music and the psychology of expectation. Cambridge: The MIT Press.
26. Juslin, P., & Laukka, P. (2004). Expression, perception, and induction of musical emotions: A review and a questionnaire study of everyday listening. Journal of New Music Research, 33(3), 217-238.
27. Juslin, P. N., & Västfjäll, D. (2008). Emotional responses to music: The need to consider underlying mechanisms. Behavioral and Brain Sciences, 31(5).
28. Kenealy, P. (1988). Validation of a music mood induction procedure: Some preliminary findings. Cognition & Emotion, 2(1), 41-48.
29. Kim, Y., Schmidt, E., & Emelle, L. (2008). Moodswings: A collaborative game for music mood label collection. In Proceedings of the 9th International Conference on Music Information Retrieval (pp. 231-236). Philadelphia, PA, USA.
30. Kivy, P. (1989). Sound sentiment: An essay on the musical emotions. Temple University Press.
31. Koelsch, S., Fritz, T., Cramon, D. Y. V., Müller, K., & Friederici, A. D. (2006). Investigating emotion with music: an fmri study. Human Brain Mapping, 27(3), 239-250.
32. Krumhansl, C. L. (1997). An exploratory study of musical emotions and psychophysiology. Canadian Journal of Experimental Psychology, 51(4), 336-353.
33. Laurier, C., Grivolla, J., & Herrera, P. (2008). Multimodal music mood classification using audio and lyrics. In Proceedings of the International Conference on Machine Learning And Applications. San Diego, CA, USA.
34. Laurier, C., & Herrera, P. (2007). Audio music mood classification using support vector machine. In Proceedings of the 8th International Conference on Music Information Retrieval. Vienna, Austria.
35. Laurier, C., & Herrera, P. (2008). Mood cloud: A real-time music mood visualization tool. In Proceedings of the 2008 Computers in Music Modeling and Retrieval Conference (pp. 163-167). Copenhagen, Danemark.
36. Lazarus, R. S. (1991). Emotion and adaptation. Oxford: Oxford University Press.
37. Levitin, D. (2007). Life soundtracks: The uses of music in everyday life. Report prepared for the exclusive use of Philips Consumer Electronics B.V., Eindhoven, The Netherlands, http://www.yourbrainonmusic.com.
38. Li, T., & Ogihara, M. (2003). Detecting emotion in music. In Proceedings of the 4th International Conference on Music Information Retrieval (pp. 239-240). Baltimore, MD, USA.
39. Logan, B. (2000). Mel frequency cepstral coefficients for music modeling. In Proceeding of the 1st International Symposium on Music Information Retrieval. Plymouth, MA, USA.
40. Lu, D., Liu, L., & Zhang, H. (2006). Automatic mood detection and tracking of music audio signals. IEEE Transactions on Audio, Speech, and Language Processing, 14(1), 5-18.
41. Luck, G., Riikkilä, K., Lartillot, O., Erkkilä, J., & Toiviainen, P. (2006). Exploring relationships between level of mental retardation and features of music therapy improvisations: a computational approach. Nordic Journal of Music Therapy, 15(1), 30-48.
42. Mandel, M., Poliner, G., & Ellis, D. (2006). Support vector machine active learning for music retrieval. Multimedia Systems, 12(1), 3-13.
43. Mandel, M. I., & Ellis, D. P. (2007). A web-based game for collecting music metadata. In Proceedings of the 8th International Conference on Music Information Retrieval (pp. 365-366). Vienna, Austria.
44. McKinney, C. H., Antoni, M. H., Kumar, M., Tims, F. C., & Mccabe, P. M. (1997). Effects of guided imagery and music (gim) therapy on mood and cortisol in healthy adults. Health Psychology, 16(4), 390-400.
45. Menon, V., & Levitin, D. J. (2005). The rewards of music listening: response and physiological connectivity of the mesolimbic system. Neuroimage, 28(1), 175-184.
46. Meyer, L. B. (1956). Emotion and meaning in music. Chicago: University Of Chicago Press.
47. North, A. C., & Hargreaves, D. J. (1997). Music and consumer behaviour. In D. J. Hargreaves & A. C. North (Eds.), The social psychology of music (pp.268-289). Oxford: Oxford University Press.
48. North, A. C., Hargreaves, D. J., & O'Neill, S. A. (2000). The importance of music to adolescents. British Journal of Educational Psychology, 255-272.
49. Nussbaum, C. O. (2007). The musical representation: Meaning, ontology, and emotion (1st ed.). Cambridge: The MIT Press.
50. Panksepp, J., & Bernatzky, G. (2002). Emotional sounds and the brain: the neuro-affective foun foundations of musical appreciation. Behavioural Processes, 133-155.
51. Patel, A. D. (2007). Music, language, and the brain. Oxford: Oxford University Press.
52. Peretz, I., Gagnon, L., & Bouchard, B. (1998). Music and emotion: perceptual determinants, immediacy, and isolation after brain damage. Cognition, 68(2), 111-141.
53. Pignatiello, M. F., Camp, C. J., & Rasar, L. (1986). Musical mood induction: An alternative to the velten technique. Journal of Abnormal Pychology, 95(3), 295-297.
54. Russell, J. A. (1980). A circumplex model of affect. Journal of Personality and Social Psychology, 39(6), 1161-1178.
55. Sacks, O. (2007). Musicophilia: Tales of music and the brain. New York: Knopf Publishing Group.
56. Sacks, O., & Freeman, A. (1994). An anthropologist on mars. Journal of Consciousness Studies, 1(2), 234-240.
57. Scherer, K. R. (1991). Emotion expression in speech and music. In J. Sundberg, L. Nord, & R. Carlson (Eds.), (pp. 146-156). London: MacMillian.
58. Scherer, K. R., & Zentner, M. R. (2001). Emotional effects of music: Production rules. In P. N. Juslin & J. A. Sloboda (Eds.), Music and emotion: Theory and research (pp. 361-392). Oxford: Oxford University Press.
59. Schubert, E. (1999). Measurement and time series analysis of emotion in music. Doctoral dissertation, University of New South Wales.
60. Serrà, J., Gomez, E., Herrera, P., & Serra, X. (2008). Chroma binary similarity and local alignment applied to cover song identification. IEEE Transactions on Audio, Speech, and Language Processing, 16(6), 1138-1151.
61. Shi, Y.-Y., Zhu, X., Kim, H.-G., & Eom, K.-W. (2006). A tempo feature via modulation spectrum analysis and its application to music emotion classification. In Proceedings of the IEEE International Conference on Multimedia And Expo (pp. 1085-1088). Toronto, Canada.
62. Skowronek, J., McKinney, M., & Van de Par, S. (2007). A demonstrator for automatic music mood estimation. In Proceedings of the 8th International Conference on Music Information Retrieval (pp. 345-346). Vienna, Austria.
63. Sloboda, J. (1999). Everyday uses of music listening: A preliminary study. In S. W. Yi (Ed.), Music, mind and science (pp. 354-369). Seoul National University Press.
64. Sordo, M., Laurier, C., & Celma, O. (2007). Annotating music collections: How content-based similarity helps to propagate labels. In Proceedings of the 8th International Conference on Music Information Retrieval (pp. 531-534). Vienna, Austria.
65. Thayer, R. E. (1989). The biopsychology of mood and arousal. Oxford: Oxford University Press.
66. Thayer, R. E. (1996). The origin of everyday moods: Managing energy, tension, and stress. Oxford: Oxford University Press.
67. Tomkins, S. S. (1980). Affect as amplification: some modifications in theory. In R. Plutchik & H. Kellerman (Eds.), Emotion: Theory, research and experience. New York: Academic Press.
68. Trainor, L. J., Tsang, C. D., & Cheung, V. H. (2002). Preference for sensory consonance in 2- and 4-month-old infants. Music Perception, 20(2), 187-194.
69. Tzanetakis, G., & Cook, P. (2002). Musical genre classification of audio signals. IEEE Transactions on Audio, Speech and Language Processing, 10(5), 293-302.
70. Vieillard, S., Peretz, I., Gosselin, N., Khalfa, S., Gagnon, L., & Bouchard, B. (2008). Happy, sad, scary and peaceful musical excerpts for research on emotions. Cognition & Emotion, 22(4), 720-752.
71. Wieczorkowska, A., Synak, P., Lewis, R., & Ras. (2005). Extracting emotions from music data. In Foundations of intelligent systems (pp. 456-465). Springer-Verlag.
72. Witten, I. H., & Frank, E. (1999). Data Mining: Practical Machine Learning Tools and Techniques with Java Implementations. Morgan Kaufmann.
73. Wood, J. V., Saltzberg, J. A., & Goldsamt, L. A. (1990). Does affect induce self-focused attention? Journal of Personality and Social Psychology, 58(5), 899-908.
74. Yang, Y. H., Lin, Y. C., Su, Y. F., & Chen, H. H. (2008a). A regression approach to music emotion recognition. IEEE Transactions on Audio, Speech, and Language Processing, 16(2), 448-457.
75. Yang, Y. H., Lin, Y. C., Cheng, H. T., & Chen, H. H. (2008b). Mr.emo: Music retrieval in the emotion plane. In Proceedings of the ACM International Conference on Multimedia. Vancouver, BC, Canada.