When voices get emotional: A corpus of nonverbal vocalizations for research on emotion processing

Behavior Research Methods

Volumn 45, Issue 4, 2013, Pages 1234-1245

  Lima, César F ^a,b   Castro, São Luís ^a   Scott, Sophie K ^b  

^a UNIVERSITY OF PORTO   (Portugal)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

Acoustic cues; Auditory processing; Emotion recognition; Expression corpus; Nonverbal vocalizations

Indexed keywords

ADULT; ARTICLE; ASSOCIATION; CLINICAL TRIAL; DECISION MAKING; EMOTION; FEMALE; HEARING; HUMAN; HUMAN RELATION; MALE; NONVERBAL COMMUNICATION; PHYSIOLOGY; PSYCHOLOGICAL ASPECT; RECOGNITION; REGRESSION ANALYSIS; VALIDATION STUDY; VOICE; YOUNG ADULT;

ADULT; AUDITORY PERCEPTION; CUES; EMOTIONS; FEMALE; HUMANS; INTERPERSONAL RELATIONS; JUDGMENT; MALE; NONVERBAL COMMUNICATION; RECOGNITION (PSYCHOLOGY); REGRESSION ANALYSIS; VOICE QUALITY; YOUNG ADULT;

EID: 84882784583     PISSN: 1554351X     EISSN: 15543528     Source Type: Journal    
DOI: 10.3758/s13428-013-0324-3     Document Type: Article

References (57)

1. Abboud, H., Schultz, W. H., & Zeitlin, V. (2006). SuperLab, stimulus presentation software (Version 4. 0). San Pedro, California: Cedrus Corporation.
2. Adolphs, R., Damasio, H., & Tranel, D. (2002). Neural systems for recognition of emotional prosody: A 3-D lesion study. Emotion, 2, 23-51. doi: 10. 1037/1528-3542. 2. 1. 23.
3. Bach, D. R., Grandjean, D., Sander, D., Herdener, M., Strik, W. K., & Seifritz, E. (2008). The effect of appraisal level on processing of emotional prosody in meaningless speech. NeuroImage, 42, 919-927. doi: 10. 1016/j. neuroimage. 2008. 05. 034.
4. Banissy, M. J., Sauter, D., Ward, J., Warren, J. E., Walsh, V., & Scott, S. K. (2010). Supressing sensorimotor activity modulates the discrimination of auditory emotions but not speaker identity. The Journal of Neuroscience, 30, 13552-13557. doi: 10. 1523/JNEUROSCI. 0786-10. 2010.
5. Banse, R., & Scherer, K. R. (1996). Acoustic profiles in vocal emotion expression. Journal of Personality and Social Psychology, 70, 614-636. doi: 10. 1037/0022-3514. 70. 3. 614.
6. Bänziger, T., Mortillaro, M., & Scherer, K. R. (2012). Introducing the Geneva Multimodal Expression corpus for experimental research on emotion perception. Emotion, 12, 1161-1179. doi: 10. 1037/a0025827.
7. Bänziger, T., & Scherer, K. R. (2010). Introducing the Geneva Multimodal Emotion Portrayal (GEMEP) corpus. In K. R. Scherer, T. Bänziger, & E. B. Roesch (Eds.), Blueprint for affective computing: A sourcebook (pp. 271-294). Oxford: Oxford University Press.
8. Belin, P., Fecteau, S., & Bédard, C. (2004). Thinking the voice: Neural correlates of voice perception. Trends in Cognitive Sciences, 8, 129-135. doi: 10. 1016/j. tics. 2004. 01. 008.
9. Belin, P., Fillion-Bilodeau, S., & Gosselin, F. (2008). The Montreal affective voices: A validated set of nonverbal affect bursts for research on auditory affective processing. Behavior Research Methods, 40, 531-539. doi: 10. 3758/BRM. 40. 2. 531.
10. Bestelmeyer, P. E. G., Rouger, J., DeBruine, L. M., & Belin, P. (2010). Auditory adaptation in vocal affect perception. Cognition, 117, 217-223. doi: 10. 1016/j. cognition. 2010. 08. 008.
11. Blasi, A., Mercure, E., Lloyd-Fox, S., Thomson, A., Brammer, M., Sauter, D., Murphy, D. G. M. (2011). Early specialization for voice and emotion processing in the infant brain. Current Biology, 21, 1-5. doi: 10. 1016/j. cub. 2011. 06. 009.
12. Boersma, P., & Weenink, D. (2009). Praat: Doing phonetics by computer (Version 5. 1. 05). Retrieved May 1, 2009, from http://www. praat. org/.
13. Burkhardt, F., Paeschke, A., Rolfes, M., Sendlmeier, W., & Weiss, B. (2005). A database of German emotional speech. Paper presented at the 9th European Conference on Speech Communication and Technology, Lisbon, Portugal.
14. Castro, S. L., & Lima, C. F. (2010). Recognizing emotions in spoken language: A validated set of Portuguese sentences and pseudo-sentences for research on emotional prosody. Behavior Research Methods, 42, 74-81. doi: 10. 3758/BRM. 42. 1. 74.
15. Cummins, F., & Port, R. (1998). Rhythmic constraints on stress timing in English. Journal of Phonetics, 26, 145-171. doi: 10. 1. 1. 47. 7942.
16. de Gelder, B., & van den Stock, J. (2011). The bodily expressive action stimulus test (BEAST). Construction and validation of a stimulus basis for measuring perception of whole body expression of emotions. Frontiers in Psychology, 2, 181. doi: 10. 3389/fpsyg. 2010. 00187.
17. Dellacherie, D., Hasboun, D., Baulac, M., Belin, P., & Samson, S. (2011). Impaired recognition of fear in voices and reduced anxiety after unilateral temporal lobe resection. Neuropsychologia, 49, 618-629. doi: 10. 1111/j. 1469-8986. 2010. 01075. x.
18. Ekman, P. (1992). An argument for basic emotions. Cognition and Emotion, 6, 169-200. doi: 10. 1080/02699939208411068.
19. Ekman, P., & Friesen, W. V. (1976). Pictures of facial affect. Palo Alto, CA: Consulting Psychologists Press.
20. Gosselin, N., Peretz, I., Noulhiane, M., Hasboun, D., Beckett, C., Baulac, M., et al. (2005). Impaired recognition of scary music following unilateral temporal lobe excision. Brain, 128, 628-640. doi: 10. 1093/brain/awh420.
21. Grandjean, D., Sander, D., Pourtois, G., Schwartz, S., Seghier, M. L., Scherer, K. R., et al. (2005). The voices of wrath: Brain responses to angry prosody in meaningless speech. Nature Neuroscience, 8, 145-146. doi: 10. 1038/nn1392.
22. Hall, J. A., Andrzejewski, S. A., & Yopchick, J. E. (2009). Psychosocial correlates of interpersonal sensitivity: A meta-analysis. Journal of Nonverbal Behavior, 33, 149-180. doi: 10. 1007/s10919-009-0070-5.
23. Hawk, S. T., Kleef, G. A. v., Fischer, A. H., & Schalk, J. v. d. (2009). "Worth a thousand words": Absolute and relative decoding of nonlinguistic affect vocalizations. Emotion, 9, 293-305. doi: 10. 1037/a0015178.
24. Hunter, E. M., Phillips, L. H., & MacPherson, S. E. (2010). Effects of age on cross-modal emotion perception. Psychology and Aging, 25, 779-787. doi: 10. 1037/a0020528.
25. Jessen, S., & Kotz, S. A. (2011). The temporal dynamics of processing emotions from vocal, facial, and bodily expressions. NeuroImage, 58, 665-674. doi: 10. 1016/j. neuroimage. 2011. 06. 035.
26. Jones, C. R. G., Pickles, A., Falcaro, M., Marsden, A. J. S., Happé, F., Scott, S. K., Charman, T. (2011). A multimodal approach to emotion recognition ability in autism spectrum disorders. The Journal of Child Psychology and Psychiatry, 52, 275-285. doi: 10. 1111/j. 1469-7610. 2010. 02328. x.
27. Juslin, P. N., & Laukka, P. (2001). Impact of intended emotion intensity on cue utilization and decoding accuracy in vocal expression of emotion. Emotion, 1, 381-412. doi: 10. 1037/1528-3542. 1. 4. 381.
28. Juslin, P. N., & Laukka, P. (2003). Communication of emotions in vocal expression and music performance: Different channels, same code? Psychological Bulletin, 129, 770-814. doi: 10. 1037/0033-2909. 129. 5. 770.
29. Lima, C. F., Alves, T., Scott, S. K., & Castro, S. L. (2013). In the hear of the beholder: Age shapes emotion recognition in positive and negative nonverbal vocalizations.
30. Lima, C. F., & Castro, S. L. (2011). Emotion recognition in music changes across the adult life span. Cognition and Emotion, 25, 585-598. doi: 10. 1080/02699931. 2010. 502449.
31. Lima, C. F., Garrett, C., & Castro, S. L. (2013). Not all sounds sound the same: Parkinson's disease affects differently emotion processing in music and in speech prosody. Journal of Clinical and Experimental Neuropsychology.
32. Liu, P., & Pell, M. D. (2012). Recognizing vocal emotions in Mandarin Chinese: A validated database of Chinese vocal emotional stimuli. Behavior Research Methods. doi: 10. 3758/s13428-012-0203-3.
33. Lundqvist, D., Flykt, A., & Öhman, A. (1998). The Karolinska directed emotional faces - KDEF. Stockholm: Karolinska Institute, Department of Clinical Neuroscience, Psychology section.
34. Morton, J., Marcus, S. M., & Frankish, C. (1976). Perceptual centres (P-centres). Psychological Review, 8, 405-408.
35. Omar, R., Henley, S., Bartlett, J., Hailstone, J., Gordon, E., Sauter, D., Warren, J. D. (2011). The structural neuroanatomy of music emotion recognition: Evidence from frontotemporal lobar degeneration. NeuroImage, 56, 1814-1821. doi: 10. 1016/j. neuroimage. 2011. 03. 002.
36. Paulmann, S., Pell, M. D., & Kotz, S. A. (2008). How aging affects the recognition of emotional speech. Brain and Language, 104, 262-269. doi: 10. 1016/j. bandl. 2007. 03. 002.
37. Peelen, M. V., Atkinson, A. P., & Vuilleumier, P. (2010). Supramodal representations of perceived emotions in the human brain. The Journal of Neuroscience, 28, 10127-10134. doi: 10. 1523/JNEUROSCI. 2161-10. 2010.
38. Pell, M. D., & Leonard, C. L. (2003). Processing emotional tone from speech in Parkinson's disease: A role for the basal ganglia. Cognitive, Affective, & Behavioral Neuroscience, 3, 275-288. doi: 10. 3758/CABN. 3. 4. 275.
39. Russell, J. A. (1994). Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies. Psychological Bulletin, 115, 102-141. doi: 10. 1037/0033-2909. 115. 1. 102.
40. Sauter, D. (2006). An investigation into vocal expressions of emotions: The roles of valence, culture, and acoustic factors (Unpublished doctoral dissertation). University College London, London.
41. Sauter, D., & Eimer, M. (2009). Rapid detection of emotion from human vocalizations. Journal of Cognitive Neuroscience, 22, 474-481. doi: 10. 1162/jocn. 2009. 21215.
42. Sauter, D. A., Eisner, F., Calder, A. J., & Scott, S. K. (2010a). Perceptual cues in nonverbal vocal expressions of emotion. The Quarterly Journal of Experimental Psychology, 63, 2251-2272. doi: 10. 1080/17470211003721642.
43. Sauter, D. A., Eisner, F., Ekman, P., & Scott, S. K. (2010b). Cross-cultural recognition of basic emotions through nonverbal emotional vocalizations. Proceedings of the National Academy of Sciences, 107, 2408-2412. doi: 10. 1073/pnas. 0908239106.
44. Sauter, D., Panattoni, C., & Happé, F. (2012). Children's recognition of emotions from vocal cues. British Journal of Developmental Psychology. Advance online publication. doi: 10. 1111/j. 2044-835X. 2012. 02081. x.
45. Sauter, D. A., & Scott, S. K. (2007). More than one kind of happiness: Can we recognize vocal expressions of different positive states? Motivation and Emotion, 31, 192-199. doi: 10. 1007/s11031-007-9065-x.
46. Scherer, K. R. (1994). Affect bursts. In S. van Goozen, N. E. van de Poll, & J. A. Sergeant (Eds.), Emotions: essays on emotion theory (pp. 161-196). Hillsdale, NH: Erlbaum.
47. Scherer, K. R. (1995). Expression of emotion in voice and music. Journal of Voice, 9, 235-248. doi: 10. 1016/S0892-1997(05)80231-0.
48. Scherer, K. R. (2003). Vocal communication of emotion: A review of research paradigms. Speech Communication, 40, 227-256. doi: 10. 1016/S0167-6393(02)00084-5.
49. Scherer, K. R., Banse, R., Wallbott, H. G., & Goldbeck, T. (1991). Vocal cues in emotion encoding and decoding. Motivation and Emotion, 15, 123-148. doi: 10. 1007/BF00995674.
50. Scherer, K. R., Johnstone, T., & Klasmeyer, G. (2003). Vocal expression of emotion. In R. Davidson, K. R. Scherer, & H. Goldsmith (Eds.), Handbook of the affective sciences (pp. 433-456). New York: Oxford University Press.
51. Scherer, K. R., & Scherer, U. (2011). Assessing the ability to recognize facial and vocal expressions of emotion: Construction and validation of the emotion recognition index. Journal of Nonverbal Behavior, 4, 305-326. doi: 10. 1007/s10919-011-0115-4.
52. Schirmer, A., & Kotz, S. A. (2006). Beyond the right hemisphere: Brain mechanisms mediating vocal emotional processing. Trends in Cognitive Sciences, 10, 24-30. doi: 10. 1016/j. tics. 2005. 11. 009.
53. Schröder, M. (2003). Experimental study of affect bursts. Speech Communication, 40, 99-116. doi: 10. 1016/S0167-6393(02)0078-X.
54. Scott, S. K. (1993). P-centers in speech: An acoustic analysis. Unpublished doctoral dissertation, University College London, London, UK.
55. Scott, S. K., Sauter, D., & McGettigan, C. (2010). Brain mechanisms for processing perceived emotional vocalizations in humans. In M. B. Stefan (Ed.), Handbook of behavioral neuroscience (pp. 187-197). London: Academic Press.
56. Vieillard, S., Peretz, I., Gosselin, N., Khalfa, S., Gagnon, L., & Bouchard, B. (2008). Happy, sad, scary and peaceful musical excerpts for research on emotions. Cognition and Emotion, 22, 720-752. doi: 10. 1080/02699930701503567.
57. Warren, J. E., Sauter, D. A., Eisner, F., Wiland, J., Dresner, M. A., Wise, R. J. S., Scott, S. K. (2006). Positive emotions preferentially engage an auditory-motor "mirror" system. The Journal of Neuroscience, 26, 13067-13075. doi: 10. 1523/JNEUROSCI. 3907-06. 2006.