Preattentive processing of emotional musical tones: A multidimensional scaling and ERP study

Frontiers in Psychology

Volumn 4, Issue SEP, 2013, Pages

  Spreckelmeyer, Katja N ^a   Altenmüller, Eckart ^b   Colonius, Hans ^c   Münte, Thomas F ^d  

^a STANFORD UNIVERSITY   (United States)

^b Drama and Media   (Germany)

^c UNIVERSITY OF OLDENBURG   (Germany)

^d UNIVERSITY OF LÜBECK   (Germany)

Author keywords

Event related potential; Mismatch negativity; Multidimensional scaling; Musical emotion; Preattentive processing; Timbre

Indexed keywords

EID: 84885365769     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2013.00656     Document Type: Article

References (59)

1. Banse, R., and Scherer, K. R. (1996). Acoustic profiles in vocal emotion expression. J. Pers. Soc. Psychol. 70, 614-636. doi:10.1037/0022-3514.70.3.614.
2. Boersma, P. (2001). Praat, a system for doing phonetics by computer. Glot Int. 5, 341-345.
3. Bostanov, V., and Kotchoubey, B. (2004). Recognition of affective prosody:continuous wavelet measures of event-related brain potentials to emotional exclamations. Psychophysiology 41, 259-268. doi:10.1111/j.1469-8986.2003.00142.x.
4. Caclin, A., Brattico, E., Tervaniemi, M., Näätänen, R., Morlet, D., Giard, M. H., et al. (2006). Separate neural processing of timbre dimensions in auditory sensory memory. J. Cogn. Neurosci. 18, 1959-1972. doi:10.1162/jocn.2006.18.12.1959.
5. Caclin, A., McAdams, S., Smith, B. K., and Giard, M. H. (2008). Interactive processing of timbre dimensions:an exploration with event-related potentials. J. Cogn. Neurosci. 20, 49-64. doi:10.1162/jocn.2008.20001.
6. Dzhafarov, E., and Colonius, H. (2006). "Generalized fechnerian scaling," in Measurement and Representation of Sensations, eds H. Colonius and E. Dzhafarov (Mahwah, NJ:Erlbaum), 47-87.
7. Dzhafarov, E. N., and Colonius, H. (1999). Fechnerian metrics in unidimensional and multidimensional stimulus spaces. Psychon. Bull. Rev. 6, 239-268. doi:10.3758/BF03212329.
8. Dzhafarov, E. N., and Colonius, H. (2001). Multidimensional fechnerian scaling:basics. J. Math. Psychol. 45, 670-719. doi:10.1006/jmps.2000.1341.
9. Eerola, T., Ferrer, R., and Alluri, V. (2012). Timbre and affect dimensions:evidence from affect and similarity ratings and acoustic correlates of isolated instrument sounds. Music Percept. 30, 49-70. doi:10.1525/mp.2012.30.1.49.
10. Ekman, P. (1999). "Basic emotions," in Handbook of Cognition and Emotion, eds T. Dalgleish and M. Power (Sussex:John Wiley and Sons Ltd.). 45-60.
11. Elfenbein, H. A., and Ambady, N. (2002). On the universality and cultural specificity of emotion recognition:a meta-analysis. Psychol. Bull. 128, 203-235. doi:10.1037/0033-2909.128.2.203.
12. Fechner, G. (1860). Elemente der Psychophysik. Leipzig:Breitkopf und Härtel.
13. Gomes, H., Bernstein, R., Ritter, W., Vaughan, H. G., and Miller, J. (1997). Storage of feature conjunctions in transient auditory memory. Psychophysiology 34, 712-716. doi:10.1111/j.1469-8986.1997.tb02146.x.
14. Goydke, K. N., Altenmüller, E., Möller, J., and Münte, T. F. (2004). Changes in emotional tone and instrumental timbre are reflected by the mismatch negativity. Brain Res. Cogn. Brain Res. 21, 351-359. doi:10.1016/j.cogbrainres.2004.06.009.
15. Grey, J. (1977). Multidimensional perceptual scaling. J. Acoust. Soc. Am. 61, 1270-1277. doi:10.1121/1.381428.
16. Grey, J., and Moorer, J. A. (1977). Perceptual evaluation of synthetic music instrument tones. J. Acoust. Soc. Am. 62, 454-462. doi:10.1121/1.381508.
17. Heilman, K. M., Scholes, R., and Watson, R. T. (1975). Auditory affective agnosia. J. Neurol. Neurosurg. Psychiatry 38, 69-72. doi:10.1136/jnnp.38.1.69.
18. Helmholtz, H. (1885/1954). On the Sensations of Tone. New York, NY:Dover Publications.
19. Hevner, K. (1935). The affective character of the major and minor modes in music. Am. J. Psychol. 47, 103-118. doi:10.2307/1416710.
20. Hevner, K. (1936). Experimental studies of the elements of expression in music. Am. J. Psychol. 48, 246-268. doi:10.2307/1415746.
21. Hevner, K. (1937). The affective value of pitch and tempo in music. Am. J. Psychol. 49, 621-630. doi:10.2307/1416385.
22. Huynh, H., and Feldt, L. (1980). Conditions under which mean square ratios in repeated measure designs have excact f-distributions. J. Am. Stat. Assoc. 65, 1582-1589. doi:10.1080/01621459.1970.10481187.
23. Jääskeläinen, I. P., Ahveninen, J., Bonmassar, G., Dale, A. M., Ilmoniemi, R. J., Levanen, S., et al. (2004). Human posterior auditory cortex gates novel sounds to consciousness. Proc. Natl. Acad. Sci. U.S.A. 101, 6809-6814. doi:10.1073/pnas.0303760101.
24. Johnstone, T., and Scherer, K. R. (2000). "Vocal communication of emotion," in Handbook of Emotions, eds M. Lewis and J. Haviland-Jones (New York, NY:Guilford Press), 220-235.
25. Juslin, P. (1997a). Perceived emotional expression in synthesized performances of a short melody:capturing the listener's judgment policy. Musicae Scientiae 1, 225-256.
26. Juslin, P. (1997b). Emotional communication in music performance:a functionalist perspective and some data. Music Percept. 14, 383-418. doi:10.2307/40285731.
27. Juslin, P. (2001). "Communicating emotion in music performance:a review and theoretical framework," in Music and Emotion, eds P. Juslin and J. Sloboda (Oxford:Oxford University Press), 309-337.
28. Juslin, P., and Laukka, P. (2003). Communication of emotions in vocal expression and music performance:different channels, same code? Psychol. Bull. 129, 770-814. doi:10.1037/0033-2909.129.5.770.
29. Kruskal, J. (1964a). Multidimensional scaling by optimizing goodness of fit to a non-metric hypothesis. Psychometrika 29, 1-27. doi:10.1007/BF02289565.
30. Kruskal, J. (1964b). Non-metric multidimensional scaling:a numerical method. Psychometrika 29, 115-129. doi:10.1007/BF02289694.
31. Lang, P. J., Bradley, M. M., and Cuthbert, B. N. (2008). International affective picture system (IAPS):Affective Ratings of Pictures and Instruction Manual. Technical Report A-8. University of Florida, Gainesville, FL.
32. Lattner, S., Meyer, M. E., and Friederici, A. D. (2005). Voice perception:sex, pitch, and the right hemisphere. Hum. Brain Mapp. 24, 11-20. doi:10.1002/hbm.20065.
33. Lazarus, R. (1991). Emotion and Adaptation. New York, NY:Oxford University Press.
34. LeDoux, J. E. (1991). Emotion and the brain. J. NIH Res. 3, 49-51.
35. McAdams, S., Winsberg, S., Donnadieu, S., De Soete, G., and Krimphoff, J. (1995). Perceptual scaling of synthesized musical timbres:common dimensions, specificities, and latent subject classes. Psychol. Res. 58, 177-192. doi:10.1007/BF00419633.
36. Näätänen, R. (1992). Attention and Brain Function. Hillsdale, NJ:Erlbaum.
37. Näätänen, R., Jacobsen, T., and Winkler, I. (2005). Memory-based or afferent processes in mismatch negativity (MMN):a review of the evidence. Psychophysiology 42, 25-32. doi:10.1111/j.1469-8986.2005.00256.x.
38. Näätänen, R., Sams, M., Alho, K., Paavilainen, P., Reinikainen, K., and Sokolov, E. N. (1988). Frequency and location specificity of the human vertex n1 wave. Electroencephalogr. Clin. Neurophysiol. 69, 523-531. doi:10.1016/0013-4694(88)90164-2.
39. Näätänen, R., Tervaniemi, M., Sussman, E., Paavilainen, P., and Winkler, I. (2001). "Primitive intelligence" in the auditory cortex. Trends Neurosci. 24, 283-288. doi:10.1016/S0166-2236(00)01790-2.
40. Näätänen, R., and Winkler, I. (1999). The concept of auditory stimulus presentation in cognitive neuroscience. Psychol. Bull. 6, 826-859. doi:10.1037/0033-2909.125.6.826.
41. Opitz, B., Schröger, E., and von Cramon, D. Y. (2005). Sensory and cognitive mechanisms for preattentive change detection in auditory cortex. Eur. J. Neurosci. 21, 531-535. doi:10.1111/j.1460-9568.2005.03839.x.
42. Owings, D., and Morton, E. (1998). Animal Vocal Communication:A New Approach. Cambridge:Cambridge University Press. doi:10.1017/CBO9781139167901.
43. Peretz, I., Blood, A. J., Penhune, V., and Zatorre, R. (2001). Cortical deafness to dissonance. Brain 124, 928-940. doi:10.1093/brain/124.5.928.
44. Phillips, C., Pellathy, T., Marantz, A., Yellin, E., Wexler, K., Poeppel, D., et al. (2000). Auditory cortex accesses phonological categories:an MEG mismatch study. J. Cogn. Neurosci. 12, 1038-1055. doi:10.1162/08989290051137567.
45. Picton, T. W., Alain, C., Otten, L., Ritter, W., and Achim, A. (2000). Mismatch negativity:different water in the same river. Audiol. Neurootol. 5, 111-139. doi:10.1159/000013875.
46. Pihan, H., Altenmüller, E., Hertrich, I., and Ackermann, H. (2000). Cortical activation patterns of affective speech processing depend on concurrent demands on the subvocal rehearsal system. A DC-potential study. Brain 123, 2338-2349. doi:10.1093/brain/123.11.2338.
47. Rothkopf, E. Z. (1957). A measure of stimulus similarity and errors in some paired-associate learning tasks. J. Exp. Psychol. 53, 94-101. doi:10.1037/h0041867.
48. Russell, J., and Barrett, L. (1999). Core affect, prototypical emotional episodes, and other things called emotion:dissecting the elephant. J. Pers. Soc. Psychol. 76, 805-819. doi:10.1037/0022-3514.76.5.805.
49. Scherer, K. R. (1988). On the symbolic function of vocal affect expression. J. Lang. Soc. Psychol. 7, 79-100. doi:10.1177/0261927X8800700201.
50. Scherer, K. R. (2001). "The nature and study of appraisal:a review of the issue," in Appraisal Processes in Emotion:Theory, Methods, Research, eds K. R. Scherer, A. Schorr, and T. Johnstone (Oxford:Oxford University Press), 369-391.
51. Schirmer, A., and Kotz, S. A. (2006). Beyond the right hemisphere:brain mechanisms mediating vocal emotional processing. Trends Cogn. Sci. 10, 24-30. doi:10.1016/j.tics.2005.11.009.
52. Schirmer, A., Striano, T., and Friederici, A. D. (2005). Sex differences in the preattentive processing of vocal emotional expressions. Neuroreport 16, 635-639. doi:10.1097/00001756-200504250-00024.
53. Schröder, C., Möbes, J., Schütze, M., Szymanowski, F., Nager, W., Bangert, M., et al. (2006). Perception of emotional speech in Parkinson's disease. Mov. Disord. 21, 1774-1778. doi:10.1002/mds.21038.
54. Schröger, E., and Wolff, C. (1996). Mismatch response of the human brain to changes in sound location. Neuroreport 7, 3005-3008. doi:10.1097/00001756-199611250-00041.
55. Sloboda, J. (1990). "Empirical studies of the emotional response to music," in Cognitive Bases of Musical Communication, eds M. Jones and S. Holleran (Washington, DC:American Psychological Association), 33-46.
56. Sussman, E., Gomes, H., Nousak, J. M., Ritter, W., and Vaughan, H. G. (1998). Feature conjunctions and auditory sensory memory. Brain Res. 793, 95-102. doi:10.1016/S0006-8993(98)00164-4.
57. Tervaniemi, M., Maury, S., and Näätänen, R. (1994). Neural representations of abstract stimulus features in the human brain as reflected by the mismatch negativity. Neuroreport 5, 844-846. doi:10.1097/00001756-199403000-00027.
58. Tervaniemi, M., Winkler, I., and Näätänen, R. (1997). Pre-attentive categorization of sounds by timbre as revealed by event-related potentials. Neuroreport 8, 2571-2574. doi:10.1097/00001756-199707280-00030.
59. Williams, C. E., and Stevens, K. N. (1972). Emotions and speech:some acoustical correlates. J. Acoust. Soc. Am. 52, 1238-1250. doi:10.1121/1.1913238.