Introducing the Geneva Multimodal expression corpus for experimental research on emotion perception

Emotion

Volumn 12, Issue 5, 2012, Pages 1161-1179

  Bänziger, Tanja ^a,b   Mortillaro, Marcello ^a   Scherer, Klaus R ^a  

^a UNIVERSITY OF GENEVA   (Switzerland)

^b UPPSALA UNIVERSITY   (Sweden)

Author keywords

Emotion expression; Emotion perception; Expression corpora; Face; Multimodal communication; Stimulus validation; Voice

Indexed keywords

ACCURACY; ADULT; ANGER; ARTICLE; CAMERA; DATA BASE; DISGUST; EMOTION; EMOTION EXPRESSION; EMPIRICAL RESEARCH; EXPERIENCE; FACIAL EXPRESSION; FEAR; FEMALE; GENEVA MULTIMODAL EMOTION PORTRAYALS CORE SET; GESTURE; HAPPINESS; HOPELESSNESS; HUMAN; HUMAN EXPERIMENT; INTERPERSONAL COMMUNICATION; IRRITABILITY; LANGUAGE; MAJOR CLINICAL STUDY; MALE; PANIC; PERCEPTION; PHOTOGRAPHY; PLEASURE; RELIABILITY; SHAME; SOUND; STUDY DESIGN; VALIDATION STUDY; VIDEORECORDING; VOCALIZATION; VOICE;

EMOTIONS; FACIAL EXPRESSION; HUMANS; RESEARCH; VOICE;

EID: 84874471178     PISSN: 15283542     EISSN: 19311516     Source Type: Journal    
DOI: 10.1037/a0025827     Document Type: Article

References (66)

1. Banse, R., & Scherer, K. R. (1996). Acoustic profiles in vocal emotion expression. Journal of Personality and Social Psychology, 70, 614-636. doi:10.1037/0022-3514.70.3.614
2. Bänziger, T., Grandjean, D., & Scherer, K. R. (2009). Emotion recognition from expressions in face, voice, and body: The Multimodal Emotion Recognition Test (MERT). Emotion, 9, 691-704. doi:10.1037/a0017088
3. Bänziger, T., & Scherer, K. R. (2010). Introducing the Geneva Multimodal Emotion Portrayal (GEMEP) Corpus. In K. R. Scherer, T. Bänziger, & E. B. Roesch (Eds.), Blueprint for affective computing: A sourcebook (pp. 271-294). Oxford, England: Oxford University Press.
4. Beaupré, M. G., & Hess, U. (2005). Cross-cultural emotion recognition among Canadian ethnic groups. Journal of Cross-Cultural Psychology, 36, 355-370. doi:10.1177/0022022104273656
5. Belin, P., Fillion-Bilodeau, S., & Gosselin, F. (2008). The Montreal Affective Voices: A validated set of nonverbal affect bursts for research on auditory affective processing. Behavior Research Methods, 40, 531-539. doi:10.3758/BRM.40.2.531
6. Biehl, M., Matsumoto, D., Ekman, P., Hearn, V., Heider, K., Kudoh, T., & Ton, V. (1997). Matsumoto and Ekman's Japanese and Caucasian Facial Expressions of Emotion (JACFEE): Reliability data and cross-national differences. Journal of Nonverbal Behavior, 21, 3-21. doi:10.1023/A: 1024902500935
7. Brunswik, E. (1952). Perception and the representative design of psychological experiments. Berkley: University of California Press.
8. Cooksey, R. W. (1996). Judgment analysis. Theory methods, and applications. New York, NY: Academic Press.
9. Cowie, R., Douglas-Cowie, E., & Cox, C. (2005). Beyond emotion archetypes: Databases for emotion modeling using neural networks. Neural Networks, 18, 371-388. doi:10.1016/j.neunet.2005.03.002
10. Dael, N., Mortillaro, M., & Scherer, K. R. (in press a). Emotion expression in body action and posture. Emotion.
11. Dael, N., Mortillaro, M., & Scherer, K. R. (in press b). Introducing the body action and posture coding system (BAP): Development and reliability. Journal of Nonverbal Behavior.
12. Dael, N., & Scherer, K. R. (2011). Expression of emotion in gesture dynamics. Manuscript in preparation.
13. Douglas-Cowie, E., Campbell, N., Cowie, R., & Roach, P. (2003). Emotional speech: Towards a new generation of databases. Speech Communication, 40, 33-60. doi:10.1016/S0167-6393(02)00070-5
14. Ekman, P. (1992a). Facial expressions of emotion: New findings, new questions. Psychological Science, 3, 34-38. doi:10.1111/j.1467- 9280.1992.tb00253.x
15. Ekman, P. (1992b). An argument for basic emotions. Cognition & Emotion, 6, 169-200. doi:10.1080/02699939208411068
16. Ekman, P. (1999). Basic emotions. In T. Dalgleish & M. Power (Eds.), Handbook of Cognition and Emotion (pp. 301-320). New York: Wiley
17. Ekman, P. (2003). Emotions revealed. New York: Henry Holt and Company.
18. Ekman, P., & Friesen, W. V. (1976). Pictures of Facial Affect. Palo Alto, CA: Consulting Psychologists Press.
19. Ekman, P., & Friesen, W. V. (1978). The Facial Action Coding System. Palo Alto, CA: Consulting Psychologist Press.
20. Ekman, P., Friesen, W. V., & Hager, J. C. (2002). Facial Action Coding System (2nd ed.) Salt Lake City, UT: Research Nexus).
21. Ethofer, T., van De Ville, D., Scherer, K. R., & Vuilleumier, P. (2009). Decoding of emotional information in voice-sensitive cortices. Current Biology, 19, 1028-1033. doi:10.1016/j.cub.2009.04.054
22. Fontaine, J. R. J., Scherer, K. R., Roesch, E. B., & Ellsworth, P. C. (2007). The world of emotions is not two-dimensional. Psychological Science, 18, 1050-1057. doi:10.1111/j.1467-9280.2007.02024.x
23. Gosselin, P., Kirouac, G., & Doré, F. Y. (1995). Components and recognition of facial expression in the communication of emotion by actors.
24. Journal of Personality and Social Psychology, 68, 83-96. doi:10.1037/ 0022-3514.68.1.83
25. Goudbeek, M., & Scherer, K. R. (2010). Beyond arousal: Valence and potency/control in the vocal expression of emotion. Journal of the Acoustical Society of America, 128, 1332-1336. doi:10.1121/1.3466853
26. Hall, J. A., Andrzejewski, S. A., Murphy, N. A., Schmid Mast, M., & Feinstein, B. A. (2008). Accuracy of judging other's traits and states: Comparing mean levels across tests. Journal of Research in Personality, 42, 1476-1489. doi:10.1016/j.jrp.2008.06.013
27. Hammond, K. R., & Stewart, T. R. (Eds.). (2001). The essential Brunswik: Beginnings, explications, applications. New York, NY: Oxford University Press.
28. Hawk, S. T., van Kleef, G. A., Fischer, A. H., & van der Schalk, J. (2009). "Worth a thousand words": Absolute and relative decoding of nonlin- guistic affect vocalizations. Emotion, 9, 293-305. doi:10.1037/a0015178
29. Juslin, P. N., & Laukka, P. (2003). Communication of emotions in vocal expression and music performance: Different channels, same code? Psychological Bulletin, 129, 770-814. doi:10.1037/0033-2909.129 .5.770
30. Kanade, T., Cohn, J. F., & Tian, Y. (2000). Comprehensive database for facial expression analysis. Paper presented at the Fourth IEEE International Conference on Automatic Face and Gesture Recognition, Grenoble, France.
31. Kenealy, P. M. (1986). The Velten mood induction procedure: A methodological review. Motivation and Emotion, 10, 315-335. doi:10.1007/ BF00992107
32. Krumhuber, E., & Scherer, K. R. (in press). Affect bursts: Dynamic patterns of facial expression. Emotion.
33. Langner, O., Dotsch, R., Bijlstra, G., Wigboldus, D. H. J., Hawk, S. T., & van Knippenberg, A. (2010). Presentation and validation of the Radboud Faces Database. Cognition and Emotion, 24, 1377-1388. doi:10.1080/ 02699930903485076
34. Leinonen, L., Hiltunen, T., Linnankoski, I., & Laakso, M. (1997). Expression of emotional-motivational connotations with a one-word utterance. The Journal of the Acoustical Society of America, 102, 1853-1863. doi:10.1121/1.420109
35. Lundqvist, D., Flykt, A., & Öhman, A. (1998). The Karolinska Directed Emotional Faces. Stockholm: Karolinska Institute, Department of Clinical Neuroscience, Psychology section.
36. Matsumoto, D. (1992). American-Japanese cultural differences in the rec- ognition of universal facial expressions. Journal of Cross Cultural Psychology, 23, 72-84. doi:10.1177/0022022192231005
37. Matsumoto, D., & Ekman, P. (1989). American-Japanese cultural differences in intensity ratings of facial expressions of emotion. Motivation and Emotion, 13, 143-157. doi:10.1007/BF00992959
38. Mehu, M., Mortillaro, M., Bänziger, T., & Scherer, K. R. (2011). Reliable facial muscles activation enhances the impact of emotional expression. Manuscript submitted for publication.
39. Mortillaro, M., Mehu, M., Bänziger, T., & Scherer, K. R. (2011). A dimensional account of the perception of multimodal expressions of emotion. Manuscript in preparation.
40. Mortillaro, M., Mehu, M., & Scherer, K. R. (2011). Subtly different positive emotions can be distinguished by their facial expressions. Social Psychological & Personality Science, 2, 262-271. doi:10.1177/ 1948550610389080
41. Pelachaud, C. (2009). Studies on gesture expressivity for a virtual agent. Speech Communication, 51, 630-639. doi:10.1016/j.spe-com.2008.04.009
42. Rosenthal, R., & Rubin, D. B. (1989). Effect size estimation for one- sample multiple-choice-type data: Design, analysis, and meta-analysis. Psychological Bulletin, 106, 332-337. doi:10.1037/0033- 2909.106.2.332
43. Scherer, K. R. (1972). Judging personality from voice: A cross-cultural approach to an old issue in interpersonal perception. Journal of Personality, 40, 191-210. doi:10.1111/j.1467-6494.1972.tb00998.x
44. Scherer, K. R. (1978). Personality inference from voice quality: The loud voice of extraversion. European Journal of Social Psychology, 8, 467- 487. doi:10.1002/ejsp.2420080405
45. Scherer, K. R. (1986). Vocal affect expression: A review and a model for future research. Psychological Bulletin, 99, 143-165. doi:10.1037/0033- 2909.99.2.143
46. Scherer, K. R. (1992). What does facial expression express? In K. Strong- man (Ed.), International Review of Studies on Emotion: Vol. 2 (pp. 139-165). Chichester, England: Wiley.
47. Scherer, K. R. (1994a). Affect bursts. In S. van Goozen, N. E. van de Poll, & J. A. Sergeant (Eds.), Emotions: Essays on emotion theory (pp. 161-196). Hillsdale, NJ: Erlbaum.
48. Scherer, K. R. (1994b). Toward a concept of "modal emotions." In P. Ekman & R. J. Davidson (Eds.), The nature of emotion: Fundamental questions (pp. 25-31). New York: Oxford University Press.
49. Scherer, K. R. (2001). Appraisal considered as a process of multi-level sequential checking. In K. R. Scherer, A. Schorr, & T. Johnstone (Eds.), Appraisal processes in emotion: Theory, methods, research (pp. 92- 120). New York: Oxford University Press.
50. Scherer, K. R. (2005). What are emotions? And how can they be measured. Social Science Information, 44, 695-729. doi:10.1177/ 0539018405058216
51. Scherer, K. R. (2009). Emotions are emergent processes: They require a dynamic computational architecture. Philosophical Transactions of the Royal Society, Series B, 364, 3459-3474. doi:10.1098/rstb.2009.0141
52. Scherer, K. R., Banse, R., & Wallbott, H. G. (2001). Emotion inferences from vocal expression correlate across languages and cultures. Journal of Cross-Cultural Psychology, 32, 76-92. doi:10.1177/ 0022022101032001009
53. Scherer, K. R., Banse, R., Wallbott, H. G., & Goldbeck, T. (1991). Vocal cues in emotion encoding and decoding. Motivation and Emotion, 15, 123-148. doi:10.1007/BF00995674
54. Scherer, K. R., & Bänziger, T. (2010). On the use of actor portrayals in research on emotional expression. In K. R. Scherer, T. Bänziger, & E. Roesch (Eds.), Blueprint for affective computing: A sourcebook. Oxford, England: Oxford University Press.
55. Scherer, K. R., Clark-Polner, E., & Mortillaro, M. (in press). In the eye of the beholder? Universality and cultural specificity in the expression and perception of emotion. International Journal of Psychology.
56. Scherer, K. R., & Ellgring, H. (2007a). Are facial expressions of emotion produced by categorical affect programs or dynamically driven by appraisal? Emotion, 7, 113-130. doi:10.1037/1528-3542.7.1.113
57. Scherer, K. R., & Ellgring, H. (2007b). Multimodal expression of emotion: Affect programs or componential appraisal patterns? Emotion, 7, 158- 171. doi:10.1037/1528-3542.7.1.158
58. Scherer, K. R., Johnstone, T., & Klasmeyer, G. (2003). Vocal expression of emotion. In R. J. Davidson, K. R. Scherer, H. Goldsmith (Eds.). Handbook of the Affective Sciences (pp. 433-456). New York and Oxford: Oxford University Press.
59. Scherer, K. R., Wranik, T., Sangsue, J., Tran, V., & Scherer, U. (2004). Emotions in everyday life: Probability of occurrence, risk factors, appraisal and reaction pattern. Social Science Information, 43, 499-570. doi:10.1177/0539018404047701
60. Schröder, M. (2003). Experimental study of affect bursts. Speech Communication, 40, 99-116. doi:10.1016/S0167-6393(02)00078-X
61. Simon, D., Craig, K. D., Gosselin, F., Belin, P., & Rainville, P. (2008). Recognition and discrimination of prototypical dynamic expressions of pain and emotions. Pain, 135, 55-64. doi:10.1016/j.pain.2007.05.008
62. Tracy, J. L., Robins, R. W., & Schriber, R. A. (2009). Development of a FACS-verified set of basic and self-conscious emotion expressions. Emotion, 9, 554-559. doi:10.1037/a0015766
63. Valstar, M. F., Jiang, B., Mehu, M., Pantic, M., & Scherer, K. R. (2011). The First Facial Expression Recognition and Analysis Challenge. Proceedings of the IEEE International Conference on Face and Gesture Recognition (FG'11). March 2011, Santa Barbara, CA.
64. Vieillard, S., & Guidetti, M. (2009). Children's perception and understanding of (dis)similarities among dynamic bodily/facial expressions of happiness, pleasure, anger, and irritation. Journal of Experimental Child Psychology, 102, 78-95. doi:10.1016/j.jecp.2008.04.005
65. Wagner, H. L. (1993). On measuring performance in category judgment studies of nonverbal behavior. Journal of Nonverbal Behavior, 17, 3-28. doi:10.1007/BF00987006
66. Wallbott, H. G. (1998). Bodily expression of emotion. European Journal of Social Psychology, 28, 879-896. doi:10.1002/(SICI)1099-0992 (1998110)28:6<879::AID-EJSP901>3.0.CO;2-W