Timbre and affect dimensions: Evidence from affect and similarity ratings and acoustic correlates of isolated instrument sounds

Music Perception

Volumn 30, Issue 1, 2012, Pages 49-70

  Eerola, Tuomas ^a   Ferrer, Rafael ^a   Alluri, Vinoo ^a  

^a UNIVERSITY OF JYVÄSKYLÄ   (Finland)

Author keywords

Affect; Emotion; Instrument; Monophonic; Timbre

Indexed keywords

EID: 84865763466     PISSN: 07307829     EISSN: 15338312     Source Type: Journal    
DOI: 10.1525/mp.2012.30.1.49     Document Type: Article

References (83)

1. Al-Kandari, N., & Jolliffe, I. (2001). Variable selection and interpretation of covariance principal components. Communications in Statistics-Simulation and Computation, 30, 339-354.
2. Alluri, V., & Toiviainen, P. (2010). Exploring perceptual and acoustical correlates of polyphonic timbre. Music Perception, 27, 223-242.
3. Balkwill, L.-L., & Thompson, W. F. (1999). A cross-cultural investigation of the perception of emotion in music: Psychophysical and cultural cues. Music Perception, 17, 43-64.
4. Banse, R., & Scherer, K. R. (1996). Acoustic profiles in vocal emotion expression. Journal of Personality and Social Psychology, 70, 614-636. (Pubitemid 126420699)
5. Baraldi, F. B., De Poli, G., & Roda, A. (2006). Communicating expressive intentions with a single piano note. Journal of New Music Research, 35, 197-210. (Pubitemid 44950912)
6. Barrett, L., & Fossum, T. (2001). Mental representations of affect knowledge. Cognition and Emotion, 15, 333-363. (Pubitemid 32396587)
7. Belin, P., Fillion-Bilodeau, S., & Gosselin, F. (2008). The Montreal Affective Voices: A validated set of nonverbal affect bursts for research on auditory affective processing. Behavior Research Methods, 40, 531-539.
8. Bigand, E., Vieillard, S., Madurell, F., Marozeau, J., & Dacquet, A. (2005). Multidimensional scaling of emotional responses to music: The effect of musical expertise and of the duration of the excerpts. Cognition and Emotion, 19, 1113-1139. (Pubitemid 43123498)
9. Box, G., & Cox, D. (1964). An analysis of transformations. Journal of the Royal Statistical Society, 26, 211-252.
10. Bradley, M. M. (2000). Affective reactions to acoustic stimuli. Psychophysiology, 37, 204-215. (Pubitemid 30140285)
11. Bresin, R., & Friberg, A. (2000). Emotional coloring of computer-controlled music performances. Computer Music Journal, 24, 44-63.
12. Burgoyne, J., & McAdams, S. (2008). A meta-analysis of timbre perception using nonlinear extensions to CLASCAL. In R. Kronland-Martinet, S. Ystad, & K. Jensen (Eds.), Computer music modeling and retrieval: Sense of sounds (Volume 4969, pp. 181-202). Berlin: Springer.
13. Caclin, A., Brattico, E., Tervaniemi, M., Näätänen, R., Morlet, D., Giard, M., et al. (2006). Separate neural processing of timbre dimensions in auditory sensory memory. Journal of Cognitive Neuroscience, 18, 1959-1972. (Pubitemid 44913353)
14. Caclin, A., McAdams, S., Smith, B., & Giard, M. (2008). Interactive processing of timbre dimensions: An exploration with event-related potentials. Journal of Cognitive Neuroscience, 20, 49-64.
15. Caclin, A., McAdams, S., Smith, B. K., & Winsberg, S. (2005). Acoustic correlates of timbre space dimensions: A confirmatory study using synthetic tones. Journal of the Acoustical Society of America, 118, 471-482. (Pubitemid 40981501)
16. Cox, T. F., & Cox, M. A. A. (2001). Multidimensional scaling. New York: Chapman and Hall.
17. De Leeuw, J., & Mair, P. (2009). Multidimensional scaling using majorization: SMACOF in R. Journal of Statistical Software, 31, 1-30.
18. Eerola, T., & Ferrer, R. (2008). Instrument library (MUMS) revised. Music Perception, 25, 253-255.
19. Eerola, T., & Vuoskoski, J. K. (2011). A comparison of the discrete and dimensional models of emotion in music. Psychology of Music, 39, 18-49.
20. Filipic, S., Tillmann, B., & Bigand, E. (2010). Judging familiarity and emotion from very brief musical excerpts. Psychonomic Bulletin and Review, 17, 335-341.
21. Fletcher, N. H., & Tarnopolsky, A. (1999). Blowing pressure, power, and spectrum in trumpet playing. Journal of the Acoustical Society of America, 105, 874-881.
22. Gabrielsson, A., & Lindström, E. (1995). Emotional expression in synthesizer and sentograph performance. Psychomusicology, 14, 94-116.
23. Gabrielsson, A., & Lindström, E. (2010). The influence of musical structure on emotional expression. In P. N. Juslin & J. A. Sloboda (Eds.), Handbook of music and emotion: Theory, research, application (pp. 367-400). New York: Oxford University Press.
24. Gjerdingen, R. O., & Perrott, D. (2008). Scanning the dial: The rapid recognition of music genres. Journal of New Music Research, 37, 93-100.
25. Goydke, K., Altenmüller, E., Möller, J., & Münte, T. (2004). Changes in emotional tone and instrumental timbre are reflected by the mismatch negativity. Cognitive Brain Research, 21, 351-359. (Pubitemid 39423637)
26. Grey, J. M. (1977). Multidimensional perceptual scaling of musical timbres. Journal of the Acoustical Society of America, 61, 1270-1277. (Pubitemid 8086808)
27. Grey, J. M., & Moorer, J. A. (1977). Perceptual evaluation of synthesized musical instrument tones. Journal of the Acoustical Society of America, 62, 454-462. (Pubitemid 8156897)
28. Hair, J., Black, W., Babin, B., Anderson, R., & Tatham, R. (2006). Multivariate data analysis. Englewood Cliffs, NJ: Prentice-Hall.
29. Hajda, J. M., Kendall, R. A., Carterette, E. C., & Harschberger, M. L. (1997). Methodological issues in timbre research. In I. Deliege & J. A. Sloboda (Eds.), Perception and cognition of music (pp. 253-307). Hove, UK: Psychology Press.
30. Haken, L., Fitz, K., & Christensen, P. (2007). Beyond traditional sampling synthesis: Real-time timbre morphing using additive synthesis. In J. Beauchamp (Ed.), Analysis, synthesis, and perception of musical sounds: The sound of music (pp. 122-144). New York: Springer.
31. Hamann, S., & Adolphs, R. (1999). Normal recognition of emotional similarity between facial expressions following bilateral amygdala damage. Neuropsychologia, 37, 1135-1141. (Pubitemid 29376471)
32. Huron, D. (2001). Tone and voice: A derivation of the rules of voiceleading from perceptual principles. Music Perception, 19, 1-64.
33. Ilie, G., & Thompson, W. F. (2006). A comparison of acoustic cues in music and speech for three dimensions of affect. Music Perception, 23, 319-329.
34. Jensen, K. (1999). Timbre models of musical sounds. Unpublished doctoral dissertation, University of Copenhagen, Copenhagen, Denmark.
35. Johnstone, T., & Scherer, K. R. (2000). Vocal communication of emotion. In R. J. Davidson, K. R. Scherer, & H. H. Goldsmith (Eds.), Handbook of emotions (Vol. 2, pp. 220-235). New York: Guilford Press.
36. Juslin, P. N. (1997). Emotional communication in music performance: A functionalist perspective and some data. Music Perception, 14, 383-418.
37. Juslin, P. N. (2000). Cue utilization in communication of emotion in music performance: Relating performance to perception. Journal of Experimental Psychology: Human Perception and Performance, 26, 1797-1813.
38. Juslin, P. N., & Laukka, P. (2003). Communication of emotions in vocal expression and music performance: Different channels, same code? Psychological Bulletin, 129, 770-814. (Pubitemid 37394950)
39. Juslin, P. N., & Sloboda, J. A. (2010). Handbook of music and emotion: Theory, research, applications. New York: Oxford University Press.
40. Kendall, R., & Carterette, E. (1993). Verbal attributes of simultaneous wind instrument timbres: II. Adjectives induced from Piston's "Orchestration." Music Perception, 10, 469-501.
41. Kidd, G. R., & Watson, C. S. (2003). The perceptual dimensionality of environmental sounds. Noise Control Engineering Journal, 51, 216-231.
42. Kreutz, G., Ott, U., Teichmann, D., Osawa, P., & Vaitl, D. (2008). Using music to induce emotions: Influences of musical preference and absorption. Psychology of Music, 36, 101-126.
43. Krumhansl, C. L. (2010). Plink: "Thin slices" of music. Music Perception, 27, 337-354.
44. Lakatos, S. (2000). A common perceptual space for harmonic and percussive timbres. Perception and Psychophysics, 62, 1426-1439.
45. Lartillot, O., & Toiviainen, P. (2007). MIR in Matlab (II): A toolbox for musical feature extraction from audio. In S. Dixon, D. Bainbridge, & R. Typke (Eds.), Proceedings of the 8th International Conference on Music Information Retrieval (pp. 237-244). Vienna, Austria: Österreichische Computer Gesellschaft.
46. Laukka, P., Juslin, P. N., & Bresin, R. (2005). A dimensional approach to vocal expression of emotion. Cognition and Emotion, 19, 633-653. (Pubitemid 41136574)
47. Laukka, P., Neiberg, D., Forsell, M., Karlsson, I., & Elenius, K. (2011). Expression of affect in spontaneous speech: Acoustic correlates and automatic detection of irritation and resignation. Computer Speech and Language, 25, 84-104.
48. Leman, M., Vermeulen, V., De Voogdt, L., Moelants, D., & Lesaffre, M. (2005). Prediction of musical affect using a combination of acoustic structural cues. Journal of New Music Research, 34, 39-67. (Pubitemid 44011888)
49. Maffiolo, V., Castellengo, M., & Dubois, D. (1999). Is pleasantness for soundscapes dimensional or categorical? Journal of the Acoustical Society of America, 105, 943-943.
50. McAdams, S., Beauchamp, J., & Meneguzzi, S. (1999). Discrimination of musical instrument sounds resynthesized with simplified spectrotemporal parameters. Journal of the Acoustical Society of America, 105, 882.
51. McAdams, S., Winsberg, S., Donnadieu, S., De Soete, G., & Krimphoff, J. (1995). Perceptual scaling of synthesized musical timbres: Common dimensions, specificities and latent subject classes. Psychological Research, 58, 177-192.
52. McGraw, K., & Wong, S. P. (1996). Forming inferences about some intraclass correlation coefficients. Psychological Methods, 1, 30-46. (Pubitemid 126421252)
53. Menon, V., Levitin, D., Smith, B., Lembke, A., Krasnow, B., Glazer, D., et al. (2002). Neural correlates of timbre change in harmonic sounds. Neuroimage, 17, 1742-1754. (Pubitemid 36062765)
54. Middlebrooks, J., & Greenhaw, D. (1991). Sound localization by human listeners. Annual Review of Psychology, 42, 135-159.
55. Ohta, K., Kuwano, S., & Namba, S. (1999). Sound quality of impulsive sounds in relation to their physical properties. Technology reports of the Osaka University, 49, 189-199. (Pubitemid 30530214)
56. Opolko, F., & Wapnick, J. (2006). The McGill University Master Samples Collection on DVD (3 DVDs). Quebec, Canada: McGill University.
57. Peretz, I., Gagnon, L., & Bouchard, B. (1998). Music and emotion: Perceptual determinants, immediacy, and isolation after brain damage. Cognition, 68, 111-141. (Pubitemid 128426934)
58. Piston, W. (1955). Orchestration. New York: Norton.
59. Pitt, M., & Crowder, R. (1992). The role of spectral and dynamic cues in imagery for musical timbre. Journal of Experimental Psychology: Human Perception and Performance, 18, 728-738.
60. Rawlings, D., & Leow, S. H. (2008). Investigating the role of psychoticism and sensation seeking in predicting emotional reactions to music. Psychology of Music, 36, 269-287.
61. Read, G. (2004). Orchestral combinations: The science and art of instrumental tone-color. Lanham, MD: Scarecrow.
62. Redondo, J., Fraga, I., Padrón, I., & Piñeiro, A. (2008). Affective ratings of sound stimuli. Behavior Research Methods, 40, 784-790.
63. Rocchesso, D. (2004). Introduction to sound processing. University of Verona, Italy.
64. Russell, J. A. (1980). A circumplex model of affect. Journal of Personality and Social Psychology, 39, 1161-1178.
65. Schellenberg, E., Iverson, P., & McKinnon, M. (1999). Name that tune: Identifying popular recordings from brief excerpts. Psychonomic Bulletin and Review, 6, 641-646.
66. Scherer, K. R. (1986). Vocal affect expression: A review and a model for future research. Psychological Bulletin, 99, 143-165.
67. Scherer, K. R. (1995). Expression of emotion in voice and music. Journal of Voice, 9, 235-248.
68. Scherer, K. R., Johnstone, T., & Klasmeyer, G. (2003). Vocal expression of emotion. In R. Davidson, K. Scherer, & H. Goldsmith (Eds.), Handbook of affective sciences (pp. 433-456). New York: Oxford University Press.
69. Scherer, K. R., & Oshinsky, J. S. (1977). Cue utilization in emotion attribution from auditory stimuli. Motivation and Emotion, 1, 331-346.
70. Schimmack, U., & Grob, A. (2000). Dimensional models of core affect: A quantitative comparison by means of structural equation modeling. European Journal of Personality, 14, 325-345.
71. Schimmack, U., & Reisenzein, R. (2002). Experiencing activation: Energetic arousal and tense arousal are not mixtures of valence and activation. Emotion, 2, 412-417.
72. Schutz, M., Huron, D., Keeton, K., & Loewer, G. (2008). The happy xylophone: Acoustics affordances restrict an emotional palate. Empirical Musicology Review, 3, 126-135.
73. Sethares, W. (1998). Tuning, timbre, spectrum, scale. Berlin, Germany: Springer-Verlag.
74. Sloboda, J. A., & Juslin, P. N. (2010). At the interface between the inner and outer world: Psychological perspectives. In P. N. Juslin & J. A. Sloboda (Eds.), Handbook of music and emotion: Theory, research, applications (pp. 73-97). New York: Oxford University Press.
75. Street, J. O., Carroll, R. J., & Ruppert, R. J. (1988). A note on computing robust regression estimates via iteratively reweighted least squares. The American Statistician, 42, 152-154.
76. Strong, W., & Clark, M. (1976). Synthesis of wind-instrument tones. Journal of the Acoustical Society of America, 41, 39-52.
77. Thayer, R. E. (1989). The biopsychology of mood and arousal. Oxford, UK: Oxford University Press.
78. Trainor, L., Clark, E., Huntley, A., & Adams, B. (1997). The acoustic basis of preferences for infant-directed singing. Infant Behavior and Development, 20, 383-396. (Pubitemid 127171431)
79. Tsang, C. D., & Trainor, L. J. (2002). Spectral scope discrimination in infancy: Sensitivity to socially important timbres. Infant Behavior and Development, 25, 183-194.
80. Tzanetakis, G., & Cook, P. (2002). Musical genre classification of audio signals. IEEE Transactions on Speech and Audio Processing, 10, 293-302. (Pubitemid 34950067)
81. Vieillard, S., Peretz, I., Gosselin, N., Khalfa, S., Gagnon, L., & Bouchard, B. (2008). Happy, sad, scary and peaceful musical excerpts for research on emotions. Cognition and Emotion, 22, 720-752.
82. Von Bismarck, G. (1974). Sharpness as an attribute of the timbre of steady sounds. Acustica, 30, 159-172.
83. Zentner, M. R., & Eerola, T. (2010). Self-report measures and models of musical emotions. In P. N. Juslin & J. A. Sloboda (Eds.), Handbook of music and emotion: Theory, research, applications (pp. 187-221). New York: Oxford University Press.