Visual inference of human emotion and behaviour

Proceedings of the 9th International Conference on Multimodal Interfaces, ICMI'07

Volumn , Issue , 2007, Pages 22-29

  Gong, Shaogang ^a   Shan, Caifeng ^a   Xiang, Tao ^a  

^a QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

Anomaly detection; Behaviour profiling; Body language recognition; Human emotion recognition; Intention inference

Indexed keywords

FACE RECOGNITION; HIDDEN MARKOV MODELS; INTERACTIVE COMPUTER SYSTEMS; LINGUISTICS; MAN MACHINE SYSTEMS; MARKOV PROCESSES;

ANOMALY DETECTION; BEHAVIOUR PROFILING; BODY LANGUAGE RECOGNITION; HUMAN EMOTION RECOGNITION; INTENTION INFERENCE;

CORRELATION METHODS;

EID: 57649223848     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1322192.1322199     Document Type: Conference Paper

References (32)

1. N. Ambady and R. Rosenthal. Thin slices of expressive behaviour as predictors of interpersonal consequences: A meta-analysis. Psychological Bulletin, 111(2):256-274, February 1992.
2. T. Balomenos, A. Raouzaiou, S. Ioannou, A. Drosopoulos, K. Karpouzis, and S. Kollias. Emotion analysis in man-machine interaction systems. In Machine Learning for Multimodal. Interaction, LNCS 3361, pages 318-328, 2005.
3. O. Boiman and M. Irani. Detecting irregularities in images and video. In IEEE International Conference on Computer Vision, pages 462-469, 2005.
4. M. Borga. Learning Multidimensional Signal Processing. PhD thesis, Linkoping University, SE-581 83 Linkoping, Sweden, 1998. Dissertation No 531.
5. I. Cohen, N. Sebe, A. Garg, L. Chen, and T. S. Huang. Facial expression recognition from video sequences: Temporal and static modeling. Computer Vision and Image Understanding, 91:160-187, 2003.
6. H. Dee and D. Hogg. Detecting inexplicable behaviour. In British Machine Vision Conference, pages 477-486, 2004.
7. P. Dollár, V. Rabaud, G. Cottrell, and S. Belongie. Behaviour recognition via sparse spatio-temporal features. In IEEE W. on Visual Surveillance, pages 65-72, 2005.
8. R. Donner, M. Reiter, G. Langs, P. Peloscheck, and H. Bischof. Fast active appearance model search using canonical correlation analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(10):1690-1694, October 2006.
9. T. Duong, H. Bui, D. Phung, and S. Venkatesh. Activity recognition and abnormality detection with the switching hidden semi-markov model. In IEEE Conf. on Computer Vision and Pattern Recognition, pages 838-845, 2005.
10. G. H. Golub and H. Zha. The canonical correlations of matrix pairs and their numerical computation. Technical report, Stanford University, 1992.
11. S. Gong and T. Xiang. Recognition of group activities using dynamic probabilistic networks. In IEEE International Conference on Computer Vision, pages 742-749, 2003.
12. H. Gunes and M. Piccardi. A bimodal face and body gesture database for automatic analysis of human nonverbal affective behaviour. In International Conference on Pattern Recognition, volume 1, pages 1148-1153, 2006.
13. H. Gunes and M. Piccardi. Bi-modal emotion recognition from expressive face and body gestures. Journal of Network and Computer Applications, 2007.
14. R. Hamid, A. Johnson, S. Batta, A. Bobick, C. Isbell, and G. Coleman. Detection and explanation of anomalous activities: Representing activities as bags of event n-grams. In IEEE Conference on Computer Vision and Pattern Recognition, pages 1031-1038, 2005.
15. D. Hardoon, S. Szedmak, and J. Shawe-Taylor. Canonical correlation analysis; an overview with application to learning methods. Neural Computation, 16(12):2639-2664, 2004.
16. H. Hotelling. Relations between two sets of variates. Biometrika, 8:321-377, 1936.
17. T. Kanade, J. Cohn, and Y. Tian. Comprehensive database for facial expression analysis. In IEEE Conference on Automatic Face & Gesture Recognition, 2000.
18. A. Kapoor and R. W. Picard. Multimodal affect recognition in learning environments. In ACM International Conference on Multimedia, 2005.
19. T.-K. Kim, J. Kittler, and R. Cipolla. Learning discriminative canonical correlations for object recognition with image sets. In European Conference on Computer Vision, pages 251-262, 2006.
20. J. Kruskal and M. Liberman. The symmetric time-warping problem: From continuous to discrete. Addison-Wesley, 1983.
21. G. Littlewort, M. Bartlett, I. Fasel, J. Susskind, and J. Movellan. Dynamics of facial expression extracted automatically from video. Image and Vision Computing, 24(6):615-625, June 2006.
22. L.R.Rabiner. A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of the IEEE, 77(2):257-286, 1989.
23. H. Meeren, C. Heijnsbergen, and B. Gelder. Rapid perceptual integration of facial expression and emotional body language. Procedings of the National Academy of Sciences of USA, 102(45): 16518-16523, November 2005.
24. R. J. Morris and D. C. Hogg. Statistical models of object interaction. International Journal of Computer Vision, 37(2):209-215, 2000.
25. N. Oliver, B. Rosario, and A. Pentland. A bayesian computer vision system for modelling human interactions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(8):831-843, August 2000.
26. M. Pantic and M. S. Bartlett. Machine analysis of facial expressions. In K. Kurihara, editor, Face Recognition, pages 377-416. Advanced Robotics Systems, Vienna, 2007.
27. M. Pantic and L. Rothkrantz. Toward an affect-sensitive multimodal human-computer interaction. In Proceeding of the IEEE, volume 91, pages 1370-1390, 2003.
28. M. Pantic, N. Sebe, J. Cohn, and T. Huang. Affective multimodal human-computer interaction. In ACM Int. Conf. on Multimedia, pages 669-676, 2005.
29. Y. Shan, H. S. Sawhney, and A. Pope. Measuring the similarity of two image sequence. In Asian Conference on Computer Vision, 2004.
30. Y. Tian, T. Kanade, and J. Cohn. Recognizing action units for facial expression analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(2):97-115, February 2001.
31. J. Wilpon, L. Rabiner, C. Lee, and E. Goldman. Automatic recognition of keywords in unconstrained speech using hidden markov models. IEEE Trans. Acoustic, Speech and Signal Processing, pages 1870-1878, 1990.
32. T. Xiang and S. Gong. Video behaviour profiling and abnormality detection without manual labelling. In IEEE International Conference on Computer Vision, pages 1238-1245, 2005.