Prediction of musical affect using a combination of acoustic structural cues

Journal of New Music Research

Volumn 34, Issue 1, 2005, Pages 39-67

  Leman, Marc ^a   Vermeulen, Valery ^a   De Voogdt, Liesbeth ^a   Moelants, Dirk ^a   Lesaffre, Micheline ^a  

^a GHENT UNIVERSITY   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 33745763122     PISSN: 09298215     EISSN: 17445027     Source Type: Journal    
DOI: 10.1080/09298210500123978     Document Type: Review

References (71)

1. Aucouturier, J.J. & Pachet, F. (2002). Music similarity measures: What's the use? Paper presented at the International Symposium on Music Information Retrieval 2002 (ISMIR 2002), Paris.
2. Aures, W. (1985). Ein Berechnungsverfahren der Rauhigkeit. Acustica, 58, 268-281.
3. Balkwill, L.-L. & Thompson, W.F. (1999). A cross-cultural investigation of the perception of emotion in music: Psychophysical and cultural cues. Music Perception, 17, 43-64.
4. Bartsch, M. & Wakefield, G. (2001). To catch a chorus: Using chroma-based representations for audio thumbnailing. Paper presented at the IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, New Paltz, NY.
5. Berlyne, D.E. (1971). Aesthetics and psychobiology. New York: Appleton-Century-Crofts.
6. Blood, A.J., Zatorre, R.J., Bermudez, P., & Evans, A.C. (1999). Emotional responses to pleasant and unpleasant music correlate with activity in paralimbic brain regions. Nature Neuroscience, 2(4), 382-387.
7. Bresin, R. & Friberg, A. (2000). Emotional coloring of comuter-controlled music performance. Computer Music Journal, 24, 44-62.
8. Broeckx, J. (1981). Muziek, ratio en affect: Over de wisselwerking van rationeel denken en affectief beleven bij voortbrengst en ontvangst van muziek. Antwerp: Metropolis.
9. Budd, M. (1985). Music and the emotions. The philosophical theories. London: Routledge.
10. Camurri, A. (1999). Music content processing and multimedia: Case studies and emerging applications of intelligent interactive systems. Journal of New Music Research, 28(4), 351-363.
11. Camurri, A. (2003). Machine musicianship. Music Perception, 20(3), 323-327.
12. Camurri, A. & Leman, M. (1997). Based music signal applications: A hybrid approach. In C. Roads, G. De Poli & S. Pope (Eds.), Musical signal processing. Lisse: Swets & Zeitlinger.
13. Camurri, A., De Poli, G., Leman, M. & Volpe, G. (2001). A multi-layered conceptual framework for expressive gesture applications. Paper presented at the International Workshop Music Orchestration Systems in Algorythmic Research & Technology (MOSART), Barcelona.
14. Clarisse, L., Martens, J.P., Lesaffre, M., Leman, M., De Baets, B. & De Meyer, H. (2002). An auditory model based transcriber of singing sequences. Paper presented at the International Symposium on Music Information Retrieval (ISMIR), Paris.
15. Clynes, M. (1977). Sentics: The touch of emotions, 1st edn. Garden City, NY: Anchor Press.
16. Cosi, P., De Poli, G. & Lauzzana, G. (1994). Auditory modelling and self-organizing neural networks for timbre classification. Journal of New Music Research, 23, 71-98.
17. Daniel, P. & Weber, R. (1997). Psychoacoustical roughness: Implementation of an optimized model. Acustica, 83, 113-123.
18. Dannenberg, R. & Hu, N. (2002). Pattern discovery techniques for music audio. Paper presented at the International Symposium on Music Information Retrieval 2002 (ISMIR 2002), Paris.
19. De Mulder, T., Martens, J.P., Lesaffre, M., Leman, M., De Baets, B. & De Meyer, H. (2004). Recent improvements of an auditory model based front-end for the transcription of vocal queries. Paper presented at the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2004), Montreal.
20. De Poli, G. & Prandoni, P. (1997). Sonological models for timbre characterization. Journal of New Music Research, 25(2), 170-197.
21. Dibben, N. (2004). The role of peripheral feedback in emotional experience with music. Music Perception, 22(1), 79-115.
22. Faith, M. & Thayer, J.F. (2001). A dynamical systems interpretation of a dimensional model of emotion. Scandinavian Journal of Psychology, 42(2), 121-133.
23. Gabrielsson, A. & Juslin, P. N. (2003). Emotional expression in music. In: R.J. Davidson, H.H. Goldsmith & K.R. Scherer (Eds.), Handbook of affective sciences. New York: Oxford University Press, pp. 503-534.
24. Gagnon, L. & Peretz, I. (2003). Mode and tempo relative contributions to "happy-sad" judgements in equitone melodies. Cognition and Emotion, 17(1), 25-40.
25. Gomez, P. & Danuser, B. (2004). Affective and physiological responses to environmental noises and music. International Journal of Psychophysiology, 53(2), 91-103.
26. Hevner, K. (1936). Experimental studies of the elements of expression in music. American Journal of Psychology, 48, 246-268.
27. Imberty, M. (1981). Les écritures du temps: sémantique psychologique de la musique. Vol. 2. Paris: Dunod.
28. Janata, P., Birk, J.L., Van Horn, J.D., Leman, M., Tillmann, B. & Bharucha, J.J. (2002). The cortical topography of tonal structures underlying Western music. Science, 295(5601), 2167-2170.
29. Juslin, P.N. (1997). Perceived emotional expression in synthesized performances of a short melody: Capturing the listener's judgment policy. Musica Scientiae, 1, 225-256.
30. Juslin, P.N. & Laukka, P. (2003). Communication of emotions in vocal expression and music performance: Different channels, same code? Psychological Bulletin, 129(5), 770-814.
31. Kim, J. & Belkin, N. (2002). Categories of music description and search terms and phrases used by non-music experts. In: Proceedings of ISMIR 02 International Conference on Music Information Retrieval. Paris: IRCAM.
32. Kivy, P. (2001). New essays on musical understanding. Oxford: Clarendon Press.
33. Klapuri, A. (1999). Sound onset detection by applying psychoacoustic knowledge. Paper presented at the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 1999), Phoenix, Arizona.
34. Konecni, V. (2003). Music and emotion: Theory and research. Music Perception, 20(3), 332-341.
35. Krumhansl, C.L. (1997). An exploratory study of musical emotions and psychophysiology. Canadian Journal of Experimental Psychology/Revue Canadienne De Psychologie Experimentale, 57(4), 336-353.
36. Large, E. & Kolen, J. (1994). Resonance and the perception of musical meter. Connection Science, 6, 177-208.
37. Laroche, J. (2003). Efficient tempo and beat tracking in audio recordings. Journal of the Audio Engineering Society, 51(4), 226-233.
38. Leman, M. (1995). A model of retroactive tone center perception. Music Perception, 12, 439-471.
39. Leman, M. (2000a). Visualization and calculation of the roughness of acoustical musical signals using the synchronization index model (SIM). Paper presented at the COST-G6 Conference Digital Audio Effects (DAFx-00), Verona.
40. Leman, M. (2000b). An auditory model of the role of shortterm memory in probe-tone ratings. Music Perception, 17(4), 481-509.
41. Leman, M., Clarisse, L., De Baets, B., De Meyer, H., Lesaffre, M., Martens, G. et al. (2002). Tendencies, perspectives and opportunities of musical audio-mining. Paper presented at the Forum Acusticum Sevilla 2002, Sevilla.
42. Leman, M., Vermeulen, V., De Voogdt, L., Taelman, J., Moelants, D. & Lesaffre, M. (2004). Correlation of gestural musical audio cues and perceived expressive qualities. In: A. Camurri & G. Volpe (Eds.), Gesture-based communication in human-computer interaction: Selected revised papers of the 5th International Gesture Workshop (GW2003). Berlin/Heidelberg: Springer-Verlag.
43. Lesaffre, M., Leman, M., Tanghe, K., De Baets, B., De Meyer, H. & Martens, J.-P. (2003). User-dependent taxonomy of musical features as a conceptual framework for musical audio-mining technology. In: Proceedings of the Stockholm Music Acoustics Conference (SMAC 03). Stockholm: KTH.
44. Lindström, E. (1997). Impact of melodic structure on emotional expression. Paper presented at the Third Triennal European Society for the Cognitive Sciences of Music (ESCOM3) Conference, Uppsala.
45. Lindström, E., Juslin, P.N., Bresin, R. & Williamon, A. (2002). Expressivity comes from within. Unpublished manuscript.
46. Matravers, D. (1998). Art and emotion. Oxford: Clarendon Press.
47. Nielzén, S. & Cesarec, Z. (1981). On the perception of emotional meaning in music. Psychology of Music, 9, 17-31.
48. Nielzén, S. & Cesarec, Z. (1982). Emotional experience of music as a function of musical structure. Psychology of Music, 70, 7-17.
49. Panksepp, J. & Bernatzky, G. (2002). Emotional sounds and the brain: the neuroaffective foundations of musical appreciation. Behavioural Processes, 60, 133-155.
50. Parncutt, R. (1989). Harmony: A psycho-acoustical approach. Berlin: Springer-Verlag.
51. Pratt, C.C. (1968). The meaning of music: A study in psychological aesthetics. New York: Johnson Reprint Corp.
52. Rauber, A. & Pampalk, E. (2002). Using psychoacoustic models and self-organizing maps to create a hierarchical structuring of music by sound similarity. Paper presented at the International Symposium on Music Information Retrieval 2002 (ISMIR 2002), Paris.
53. Rigg, M.G. (1939). What features of a musical phrase have emotional suggestiveness? Publications of the Social Science Research Council of the Oklahoma Agricultural and Mechanical College, 1.
54. Rigg, M.G. (1964). The mood effects of music: A comparison of data from four investigators. Journal of Psychology, 58, 427-438.
55. Rowe, R. (2001). Machine musicianship. Cambridge, MA: MIT Press.
56. Scheirer, E.D. (1998). Tempo and beat analysis of acoustic musical signals. Journal of the Acoustical Society of America, 103(1), 588-601.
57. Scheirer, E.D., Watson, R.B. & Vercoe, B.L. (2000). On the perceived complexity of short musical segments. Paper presented at the International Conference on Music Perception and Cognition, Keele, UK.
58. Scherer, K.R. & Zentner, M.R. (2001). Emotional effects of music: Production rules. In: P.N. Juslin & J.A. Sloboda (Eds.), Music and emotion: Theory and research. New York: Oxford University Press, pp. 361-392.
59. Schmidt, L.A. & Trainor, L.J. (2001). Frontal brain electrical activity (EEG) distinguishes valence and intensity of musical emotions. Cognition & Emotion, 75(4), 487-500.
60. Schubert, E. (2004). Modeling perceived emotion with continuous musical features. Music Perception, 21(4), 561-585.
61. Schwartz, D. & Rodet, X. (1999). Spectral estimation and representation for sound analysis-synthesis. Paper presented at the International Computer Music Conference (ICMC), Beijing.
62. Slaney, M. (1993). An efficient implementation of the Paaterson-Holdsworth auditory filterbank (Apple Computer Technical Report 35) Apple Computer Inc.
63. Smith, L.S. (1994). Sound segmentation using onsets and offsets. Journal of New Music Research, 23(1), 11-23.
64. Terhardt, E. (1974). Pitch, consonance and harmony. Journal of the Acoustical Society of America, 55, 1061-1069.
65. Thompson, W.F. & Robintaille, B. (1992). Can composers express emotions through music? Empirical Studies of the Arts, 10, 79-89.
66. Toiviainen, P. (1996). Optimizing auditory images and distance metrics for self-organizing timbre maps. Journal of New Music Research, 25, 1-30.
67. Toiviainen, P. (2001). Real-time recognition of improvisations with adaptive oscillators and a recursive Bayesian classifier. Journal of New Music Research, 30(2), 137-147.
68. Ungvary, T. & Vertegaal, R. (2000). Designing musical Cyberinstruments with body and soul in mind. Journal of New Music Research, 29(3), 245-255.
69. Vaidyanathan, P.P. (1993). Multirate systems and filter banks. Englewood Cliffs, NJ: Prentice Hall.
70. Watson, K.B. (1942). The nature and measurement of musical meanings. Psychological Monographs, 54, 1-43.
71. Wedin, L. (1972). Multidimensional study of perceptualemotional qualities in music. Swedish Journal of Musicalogy, 73, 241-257.