Recognizing communicative facial expressions for discovering interpersonal emotions in group meetings

ICMI-MLMI'09 - Proceedings of the International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interfaces

Volumn , Issue , 2009, Pages 99-106

  Kumano, Shiro ^a   Otsuka, Kazuhiro ^a   Mikami, Dan ^a   Yamato, Junji ^a  

^a NTT Communication Science Laboratories   (Japan)

Author keywords

Direction of facial expression; Facial expression; Interpersonal emotion; Meeting analysis

Indexed keywords

AUTOMATIC SELECTION; FACIAL EXPRESSIONS; GRAPH STRUCTURES; HEAD POSE; HEAD ROTATION; HUMAN RELATIONSHIPS; INTEREST POINTS; MEETING ANALYSIS; PARTICLE FILTER; VIDEO SYSTEMS;

GRAPHIC METHODS; INTERACTIVE COMPUTER SYSTEMS; LEARNING SYSTEMS;

FACE RECOGNITION;

EID: 74049132307     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1647314.1647333     Document Type: Conference Paper

References (25)

1. M. Argyle. Bodily Communication - 2nd ed. Routledge, London and New York, 1988.
2. M. S. Bartlett, G. Littlewort, M. G. Frank, C. Lainscsek, I. R. Fasel, and J. R. Movellan. Automatic recognition of facial actions in spontaneous expressions. J. Multimedia, 1(6):22-35, 2006.
3. J. N. Cappella. Behavioral and judged coordination in adult informal social interactions: vocal and kinesic indicators. J. Personality and Social Psychology, 72(1):119-131, 1997.
4. J. Cohn, L. Reed, T. Moriyama, J. Xiao, K. Schmidt, and Z. Ambadar. Multimodal coordination of facial action, head rotation, and eye motion during spontaneous smiles. In Proc. IEEE Int'l Conf. Automatic Face and Gesture Recognition, pages 129-138, 2004.
5. F. Dornaika and F. Davoine. Simultaneous facial action tracking and expression recognition in the presence of head motion. Int'l J. Computer Vision, 76(3):257-281, 2008.
6. B. Fasel and J. Luettin. Automatic facial expression analysis: Survey. Pattern Recognition, 36:259-275, 2003.
7. D. Gatica-Perez. Analyzing group interactions in conversations: a review. In Proc. IEEE Int'l Conf. Multisensor Fusion and Integration for Intelligent Systems, pages 41-46, 2006.
8. R. Gross, I. Matthews, and S. Baker. Generic vs. person specific Active Appearance Models. Image and Vision Computing, 23(11):1080-1093, 2005.
9. A. Ito, X. Wang, M. Suzuki, and S. Makino. Smile and laughter recognition using speech processing and face recognition from conversation video. In Proc. Int'l Conf. Cyberworlds, pages 437-444, 2005.
10. D. Jayagopi, H. Hung, C. Yeo, and D. Gatica-Perez. Modeling dominance in group conversations from nonverbal activity cues. IEEE Trans. Audio, Speech, and Language Processing, 17(3):501-513, 2009.
11. S. Kumano, K. Otsuka, J. Yamato, E. Maeda, and Y. Sato. Pose-invariant facial expression recognition using variable-intensity templates. Int'l J. Computer Vision, 83:178-194, 2009.
12. D. Mikami, K. Otsuka, and J. Yamato. Memory-based particle filter for face pose tracking robust under complex dynamics. In Proc. IEEE Conf. Computer Vision and Pattern Recognition, pages 999-1006, 2009.
13. K. Otsuka, S. Araki, K. Ishizuka, M. Fujimoto, M. Heinrich, and J. Yamato. A realtime multimodal system for analyzing group meetings by combining face pose tracking and speaker diarization. In Proc. ICMI, pages 257-264, 2008.
14. K. Otsuka, H. Sawada, and J. Yamato. Automatic inference of cross-modal nonverbal interactions in multiparty conversations. In Proc. ICMI, pages 255-262, 2007.
15. K. Otsuka, J. Yamato, Y. Takemae, and H. Murase. Quantifying interpersonal influence in face-to-face conversations based on visual attention patterns. In Proc. CHI, pages 1175-1180, 2006.
16. M. Pantic and M. Bartlett. Machine Analysis of Facial Expressions. I-Tech Education and Publishing, 2007.
17. S. Petridis and M. Pantic. Audiovisual laughter detection based on temporal features. In Proc. ICMI, pages 37-44, 2008.
18. J. Russell, J. Bachorowski, and J. Fernandez-Dols. Facial and vocal expressions of emotion. Annual Review of Psychology, 54:329-349, 2002.
19. B. Schuller, R. Muller, B. Hornler, A. Hothker, H. Konosu, and G. Rigoll. Audiovisual recognition of spontaneous interest within conversations. In Proc. ICMI, pages 30-37, 2007.
20. R. Stiefelhagen. Tracking focus of attention in meetings. In Proc. ICMI, pages 273-280, 2002.
21. Y. L. Tian, T. Kanade, and J. Cohn. Facial expression analysis. Springer, 2005.
22. M. F. Valstar, H. Gunes, and M. Pantic. How to distinguish posed from spontaneous smiles using geometric features. In Proc. ICMI, pages 38-45, 2007.
23. J. A. R. A. M. van Hooff and S. Preuschoft. Animal social complexity: Intelligence, culture, and individualized societies, chapter Laughter and smiling:The intertwining of nature and culture, pages 260-287. Harvard University Press, 2003.
24. P. Viola and M. Jones. Rapid object detection using a boosted cascade of simple features. In Proc. IEEE Conf. Computer Vision and Pattern Recognition, pages 511-518, 2001.
25. Z. Zeng, M. Pantic, G. I. Roisman, and T. S. Huang. A survey of affect recognition methods: Audio, visual, and spontaneous expressions. IEEE Trans. Pattern Anal. Mach. Intell., 31(1):39-58, 2009.