Introducing the RECOLA multimodal corpus of remote collaborative and affective interactions

2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2013

Volumn , Issue , 2013, Pages

  Ringeval, Fabien ^a   Sonderegger, Andreas ^a   Sauer, Juergen ^a   Lalanne, Denis ^a  

^a UNIVERSITY OF FRIBOURG   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

AFFECTIVE INTERACTION; CORPUS CONSTRUCTION; MULTI-MODAL; MULTI-MODAL DATA; RESEARCH COMMUNITIES; SOCIAL BEHAVIOR; TWO-DIMENSION;

EID: 84881512394     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/FG.2013.6553805     Document Type: Conference Paper

References (40)

1. M. Grimm, K. Kroschel, and S. Narayanan, "The vera am mittag German audio-visual emotional speech database," in Int. Conf. on Multimedia and Expo, Hannover, Germany, 2008, pp. 865-868.
2. A. Vinciarelli, M. Pantic, and H. Bourlard, "Social signal processing: survey of an emerging domain," Image and Vision Computing, vol. 27, no. 2, pp. 1743-1759, 2009.
3. C.-C. Lee, A. Katsamanis, M. Black, B. Baucom, A. Christensen, P. Georgiou, and S. Narayanan, "Computing vocal entrainment: A signal-derived PCA-based quantification scheme with application to affect analysis in married couple interactions," Computer Speech and Language, 2012.
4. M. Stewart, C. McAdam, M. Ota, S. Peppe, and J. Cleland, "Emotional recognition in autism spectrum conditions from voices and faces," Autism, 2012.
5. E. Douglas-Cowie and al., "The HUMAINE database: addressing the collection and annotation of naturalistic and induced emotional data," in 2nd In t. Conf. on Affective Computing and Intelligent Interaction, Lisbon, Portugal, 2007, pp. 488-500.
6. D. Gatica-Perez, "Automatic nonverbal analysis of social interaction in small groups: A review," Visual and multimodal analysis of human spontaneous behaviour, Image and Vision Computing, vol. 27, no. 12, pp. 1775-1787, 2009.
7. H. Gunes and B. Schuller, "Categorical and dimensional affect analysis in continuous input: current trends and future directions," Image and Vision Computing, 2012.
8. J. Kim, "Robust speech recognition and understanding," Vienna: I-Tech Education and Publishing, 2007, Bimodal Emotion Recognition using Speech and Physiological Changes, pp. 265-280, 2007.
9. M.-Z. Poh, D. McDuff, and R. Picard, "Advancements in noncontact, multiparameter physiological measurements using a webcam," IEEE Transactions on Biomedical Engineering, vol. 58, no. 1, pp. 253-263, 2010.
10. J. Forgas, "The influence of mood on perceptions of social interactions," J. of Experimental Social Psychology, vol. 20, no. 6, pp. 497-513, 1984.
11. G. McKeown, M. Valstar, R. Cowie, M. Pantic, and M. Schroder, "The SEMAINE database: annotated multimodal records of emotionally colored conversations between a person and a limited agent," IEEE Transactions on Affective Computing, vol. 3, no. 1, pp. 5-17, 2012.
12. A. Tversky, "Intransitivity of preferences," Psychological Review, vol. 76, pp. 31-48, 1969.
13. E. Douglas-Cowie, N. Campbell, R. Cowie, and P. Roach, "Emotional speech: towards a new generation of databases," Speech Communication, vol. 40, pp. 33-60, 2003.
14. E. Delaherche, M. Chetouani, A. Mahdhaoui, C. Saint-Georges, S. Viaux, and D. Cohen, "Interpersonal synchrony : A survey of evaluation methods across disciplines," IEEE Transactions on Affective Computing, vol. 3, no. 3, pp. 349-365, 2012.
15. T. Banziger and K. Scherer, "Using actor portrayals to systematically study multimodal emotion expression: the GEMEP corpus," in A. Paiva, R. Prada, and R. W. Picard, Int. Conf. on Affective Computing and Intelligent Interaction, Lisbon, Portugal, 2007, pp. 476-487.
16. B. Schuller, A. Batliner, S. Steidl, and D. Seppi, "Recognising realistic emotions and affect in speech: state of the art and lessons learnt from the first challenge," Sensing Emotion and Affect-Facing Realism in Speech Processing, Speech Communication, pp. 1062-1087, 2011.
17. M. Soleymani, J. Lichtenauer, T. Pun, and M. Pantic, "A multimodal database for affect recognition and implicit tagging," IEEE Transactions on Affective Computing, vol. 3, no. 1, pp. 42-55, 2012.
18. P. Ekman, Emotion in the human face. Cambridge, UK: Cambridge University Press, 1982.
19. J. Russel, "A circumplex model of affect," Journal of Personality and Social Psychology, pp. 1161-1178, 1980.
20. R. Cowie, E. Douglas-Cowie, S. Savvidou, E. McMahon, M. Sawey, and M. Schroder, "'FEELTRACE': an instrument for recording perceived emotion in real time," in Douglas-Cowie, E., Cowie, R., Schroder, M., Eds.: ISCA Workshop on Speech and Emotion: A Conceptual Framework for Research, Belfast, UK, 2000, pp. 19-24.
21. D. Grandjean, D. Sander, and K. Scherer, "Conscious emotional experience emerges as a function of multilevel, appraisal-driven response synchronization," Consciousness and Cognition, vol. 17, pp. 484-495, 2008.
22. M. Nicolaou, H. Gunes, and M. Pantic, "Continuous prediction of spontaneous affect from multiple cues and modalities in valencearousal space," IEEE Transactions on Affective Computing, vol. 2, no. 2, pp. 92-105, 2011.
23. S. Kitayama, M. Karasawa, and B. Mesquita, "Cultural affordances and emotional experience: Socially engaging and disengaging emotions in Japan and the United States," Journal of Personality and Social Psychology, vol. 91, no. 5, pp. 890-903, 2006.
24. J. Fontaine, E. Roesch, and P. Ellsworth, "The world of emotions is not two-dimensional," Psychological science, vol. 18, no. 2, pp. 1050-1057, 2007.
25. A. Metallinou, A. Katsamanis, and S. Narayanan, "Tracking continuous emotional trends of participants during affective dyadic interactions using body language and speech information," Image and Vision Computing, 2012.
26. S. Gilroy, M. O. Cavazza, and V. Vervondel, "Evaluating multimodal affective fusion using physiological signals," in Int. Conf. on Intelligent User Interfaces, Palo Alto (CA), USA, 2011, pp. 53-62.
27. J. Kelly and S. Barsade, "Mood and emotions in small groups and work teams," Organizational Behavior and Human Decision Processes, vol. 86, no. 1, pp. 99-130, 2001.
28. M. Bradley and P. Lang, "Measuring emotion: the self-assessment manikin and the semantic differential," J. of Behavior Therapy and Experimental Pscychiatry, vol. 25, no. 1, pp. 49-59, 1994.
29. J. Rottenberg, R. D. Ray, and J. Gross, "Emotion elicitation using films," The handbook of emotion elicitation and assessment, pp. 9-28, 2007.
30. A. Goritz and K. Moser, "Web-based mood induction," Cognition and Emotion, vol. 20, no. 6, pp. 887-896, 2006.
31. J. Hall and W. Watson, "The effects of a normative intervention on group decision-making performance," Human Relations, vol. 23, no. 4, pp. 299-317, 1970.
32. J. R. Crawford and J. D. Henry, "The positive and negative affect schedule (PANAS): construct validity, measurement properties and normative data in a large non-clinical sample," British J. of Clinical Psychology, vol. 43, no. 3, pp. 245-265, 2004.
33. N. Anderson and M. West, "Measuring climate for work group innovation: development and validation of the team climate inventory," J. of Organizational Behavior, vol. 19, no. 3, pp. 235-258, 1998.
34. S. Hart and L. Staveland, "Development of NASA-TLX (Task Load Index): results of empirical and theoretical research," Human Mental Workload, pp. 139-183, 1988.
35. J. Lichtenauer, J. Shen, M. Valstar, and M. Pantic, "Cost-effective solution to synchronised audio-visual data capture using multiple sensors," in Int. Conf. on Advanced Video and Signal Based Surveillance, Boston (MA), USA, 2010, pp. 324-329.
36. R. Cowie and M. Sawey. (2011) Gtrace General trace program from Queen's, Belfast. Online Available: https://sites.google.com/site/roddycowie/work- resources
37. R. Cowie and G. McKeown. (2010) Statistical analysis of data from initial labelled database and recommendations for an economical coding scheme. Online Available: http://www.semaine-project.eu/
38. M. Nicolaou, H. Gunes, and M. Pantic, "Automatic segmentation of spontaneous data using dimensional labels from multiple coders," in LREC Int. Workshop on Multimodal Corpora: Advances in Capturing, Coding and Analyzing, Istambul, Turkey, 2010, pp. 43-48.
39. F. Eyben, M. Wollmer, and B. Schuller, "The Munich versatile and fast open-source audio feature extractor," in ACM Multimedia (MM), Florence, Italy, 2010, pp. 1459-1462.
40. F. Ringeval, M. Chetouani, and B. Schuller, "Novel metrics of speech rhythm for the assessment of emotion," in Interspeech, Portland (OR), USA, 2008, pp. 2763-2766.