Analyzing empathetic interactions based on the probabilistic modeling of the co-occurrence patterns of facial expressions in group meetings

2011 IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, FG 2011

Volumn , Issue , 2011, Pages 43-50

  Kumano, Shiro ^a   Otsuka, Kazuhiro ^a   Mikami, Dan ^a   Yamato, Junji ^a  

^a NTT Communication Science Laboratories   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN APPROACHES; CO-OCCURRENCE PATTERN; FACIAL EXPRESSIONS; GAZE DIRECTION; HIERARCHICAL STRUCTURES; MARKOV CHAIN MONTE CARLO METHOD; MODEL PARAMETERS; NONVERBAL BEHAVIOR; OBSERVED DATA; PROBABILISTIC MODELING; PROBABILISTIC MODELS; STRONG LINK;

BAYESIAN NETWORKS; GESTURE RECOGNITION; IMAGE SEGMENTATION; MARKOV PROCESSES; MONTE CARLO METHODS; PROBABILITY DISTRIBUTIONS; SPEECH; SPEECH RECOGNITION;

FACE RECOGNITION;

EID: 79958724217     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/FG.2011.5771440     Document Type: Conference Paper

References (30)

1. D. Gatica-Perez. Analyzing group interactions in conversations: a review. In Proc. IEEE Int'l Conf. Multisensor Fusion and Integration for Intelligent Systems, pages 41-46, 2006. (Pubitemid 351409405)
2. L. Chen and M. P. Harper. Multimodal floor control shift detection. In Proc. Int'l Conf. Multimodal Interfaces and Workshop on Machine Learning for Multimodal Interaction (ICMI-MLMI 2009), 2009.
3. D. Jayagopi, H. Hung, C. Yeo, and D. Gatica-Perez. Modeling dominance in group conversations from nonverbal activity cues. IEEE Trans. Audio, Speech, and Language Processing, 17(3):501-513, 2009.
4. T. Chartrand and J. Bargh. The chameleon effect: the perceptionbehavior link and social interaction. Journal of Personality and Social Psychology, 76(6):893-910, 1999.
5. J. B. Bavelas, A. Black, C. R. Lemery, and J. Mullett. "I show how you feel": Motor mimicry as a communicative act. J. Personality and Social Psychology, 50:322-329, 1986.
6. N. Chovil. Discourse-oriented facial displays in conversation. Research on Language and Social Interaction, 25:163-194, 1991.
7. N. Ambady and R. Rosenthal. Thin slices of expressive behavior as predictors of interpersonal consequences: a meta-analysis. Psychological Bulletin, 111(2):256-274, 1992.
8. M. Mehu and R. I. M. Dunbar. Naturalistic observations of smiling and laughter in human group interactions. Behaviour, 145, 2008.
9. R. E. Kraut and R. E. Johnston. Social and emotional messages of smiling: An ethological approach. J. Personality and Social Psychology, 37(9):1539-1553, 1979.
10. J. N. Cappella. Behavioral and judged coordination in adult informal social interactions: vocal and kinesic indicators. J. Personality and Social Psychology, 72(1):119-131, 1997.
11. M. Argyle and J. Dean. Eye contact, distance and affiliation. Socimetry, 28:289-304, 1965.
12. A. Kendon. Some functions of gaze-direction in social interaction. Acta Psychologica, 26:22-63, 1967.
13. S. Geman and D. Geman. Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Trans. Pattern Analysis and Machine Intelligence, 6(1):721-741, 1984. (Pubitemid 15453722)
14. Z. Zeng, M. Pantic, G. I. Roisman, and T. S. Huang. A survey of affect recognition methods: Audio, visual, and spontaneous expressions. IEEE Trans. Pattern Analysis and Machine Intelligence, 31(1):39-58, 2009.
15. A. Vinciarelli, M. Pantic, and H. Bourlard. Social signal processing: Survey of an emerging domain. Image and Vision Computing, 27(12):1743-1759, 2009.
16. Y. L. Tian, T. Kanade, and J. Cohn. Facial expression analysis. In Handbook of face recognition. Springer, 2005.
17. M. Pantic and M.S. Bartlett. Machine Analysis of Facial Expressions. I-Tech Education and Publishing, 2007.
18. J. Cohn, L. Reed, T. Moriyama, J. Xiao, K. Schmidt, and Z. Ambadar. Multimodal coordination of facial action, head rotation, and eye motion during spontaneous smiles. In In Proc. IEEE Int'l Conf. Automatic Face and Gesture Recognition (FG 2004), pages 129-138, 2004.
19. M. S. Bartlett, G. Littlewort, M. G. Frank, C. Lainscsek, I. R. Fasel, and J. R. Movellan. Automatic recognition of facial actions in spontaneous expressions. J. Multimedia, 1(6):22-35, 2006.
20. M. F. Valstar, H. Gunes, and M. Pantic. How to distinguish posed from spontaneous smiles using geometric features. In In Proc. Int'l Conf. Multimodal Interfaces (ICMI 2007), pages 38-45, 2007.
21. S. Kumano, K. Otsuka, D. Mikami, and J. Yamato. Recognizing communicative facial expressions for discovering interpersonal emotions in group meetings. In Proc. Int'l Conf. Multimodal Interfaces and Workshop on Machine Learning for Multimodal Interaction (ICMIMLMI 2009), 2009.
22. K. Otsuka, Hiroshi Sawada, and J. Yamato. Automatic inference of cross-modal nonverbal interactions in multiparty conversations. In In Proc. Int'l Conf. Multimodal Interfaces (ICMI 2007), pages 255-262, 2007.
23. N. Eagle, A. Pentland, and D. Lazer. Inferring social network structure using mobile phone data. In Proc. the National Academy of Sciences (PNAS), volume 106, pages 15274-15278, 2009.
24. L. Ding and A. Yilmaz. Learning relations among movie characters: A social network perspective. In In Proc. European Conference on Computer Vision (ECCV2010), volume IV, pages 410-423, 2010.
25. J. M. Bernardo and A. F. M. Smith. Bayesian Theory. John Wiley & Sons, Ltd., 1994.
26. K. Otsuka, S. Araki, K. Ishizuka, M. Fujimoto, M. Heinrich, and J. Yamato. A realtime multimodal system for analyzing group meetings by combining face pose tracking and speaker diarization. In In Proc. Int'l Conf. Multimodal Interfaces (ICMI 2008), pages 257-264, 2008.
27. S. Gorga and K. Otsuka. Conversation scene analysis based on dynamic Bayesian network and image-based gaze detection. In Int'l Conf. Multimodal Interfaces and Workshop on Machine Learning for Multimodal Interaction (ICMI-MLMI 2010), 2010.
28. M. Fujimoto, K. Ishizuka, and T. Nakatani. A voice activity detection based on the adaptive integration of multiple speech features and a signal decision scheme. In In Proc. Int'l Conf. Acoustics, Speech and Signal Processing (ICASSP2008), pages 4441-4444, 2008.
29. M. Pantic and L. Rothkrantz. Expert system for automatic analysis of facial expression. J. Image and Vision Computing, 18(11):881-905, 2000.
30. R. Kaliouby and P. Robinson. Real-time inference of complex mental states from facial expressions and head gestures. In In Proc. IEEE Int'l W. Real Time Computer Vision for Human Computer Interaction at CVPR, pages 181-200, 2004.