Task oriented facial behavior recognition with selective sensing

Computer Vision and Image Understanding

Volumn 100, Issue 3, 2005, Pages 385-415

  Gu, Haisong ^a   Zhang, Yongmian ^a   Ji, Qiang ^b  

^a University of Nevada   (United States)

^b RENSSELAER POLYTECHNIC INSTITUTE   (United States)

Author keywords

Dynamic Bayesian networks; Facial action coding system; Facial behavior recognition; Selective sensing; Task oriented approach

Indexed keywords

BEHAVIORAL RESEARCH; IMAGE ANALYSIS; IMAGE PROCESSING; KNOWLEDGE ACQUISITION;

DYNAMIC BAYESIAN NETWORKS; FACIAL ACTION CODING SYSTEM; FACIAL BEHAVIOR RECOGNITION; SELECTIVE SENSING; TASK ORIENTED APPROACH;

FACE RECOGNITION;

EID: 27744458750     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2005.05.004     Document Type: Article

References (46)

1. M.S. Bartlett, B. Braathen, G.L. Littlewort-Ford, J. Hershey, J. Fasel, T. Mark, E. Smith, T.J. Sejnowski, J.R. Movellan, Automatic Analysis of Spontaneous Facial Behavior: A final Project Report. Technical Report MPLab-TR2001.08, University of California San Diego, Dec. 2001.
2. J.N. Bassili Emotion recognition: the role of facial movement and the relative importance of upper and lower area of the face J. Pers. Soc. Psychol. 37 1979 2049 2059
3. M.J. Black, and Y. Yacoob Recognizing facial expression in image sequences using local parameterized models of image motion Internat. J. Comput. Vis. 25 1 1997 23 48
4. A. Bobick, Y. Ivanov, Action recognition using probabilistic parsing, in: Proc. IEEE Internat. Conf, Computer Vision Pattern Recognition 1998, pp. 196-202.
5. C. Bregler, Learning and recognizing human dynamics in video sequences, in: Proc. IEEE Internat. Conf. Computer Vision Pattern Recognition, 1997, pp. 568-574.
6. I. Cohen, N. Sebe, F. Cozman, M. Cirelo, T. Huang. Learning bayesian network classifiers for facial expression recognition using both labeled and unlabeled data. IEEE Conf. Computer Vision Pattern Recognition, 2003.
7. I. Cohen, N. Sebe, A. Garg, L.S. Chen, and T.S. Huang Facial expression recognition from video sequences: temporal and static modeling Comput. Vis. Image Und. 911 2003 60 187
8. J.F. cohn, A.J. Zlochower, J.J. Lien, T. Kanade, Feature-point tracking by optical flow discriminates subtle difference in face expression, in: IEEE Internat. Conf. Automatic Face Gesture Recognition, pp. 396-401, 1998.
9. G.W. Cottrell, J. Metcalfe. EMPATH: face, emotion, gender recognition using holos, in: R.P. Lippman (Ed.), Advances in Neural Information Processing Systems 3, 1991, 564-571.
10. J. Denzler, and C.M. Brown Information theoretic sensor data selection for active object recognition and state estimation IEEE Trans. Pattern Anal. Mach. Intell. 24 2 2002 145 157
11. P. Ekman, and W.V. Friesen Facial Action Coding System (FACS): Manual 1978 Consulting Psychologists Press Palo Alto, CA
12. P. Ekman, W.V. Friesen, and J.C. Hager Facial Action Coding System (FACS): Manual 2002 CD Rom San Francisco, CA
13. I.A. Essa, and A.P. Pentland Coding, analysis, interpretation, recognition of facial expressions IEEE Trans. Pattern Anal. Mach. Intell. 19 7 1997 757 763
14. M. Gladwell The naked face:can you read people's thoughts just by looking at them? The New Yorker magazine 5 2002 38 49
15. H. Gu, and Q. Ji Information extraction from image sequences of real-world facial expressions Mach. Vis. Appl. 16 2 2005 105 115
16. J. Hoey, J. Little. Decision theoretic modeling of human facial displays, in: Proc. Eur. Conf. Comput. Vis. 2004.
17. J. Hoey, J. Little. Value directed learning of gestures and faial displays, in: Proc. IEEE Internat. Conf. Computer Vision Pattern Recognition 2004.
18. F.V. Jensen Bayesian Networks and Decision Graphs 2001 Springer-Verlag New York
19. Q. Ji, X. Yang. Real-time 3D face pose discrimination based on active ir illumination, in: Internat. Conf. Pattern Recognition 2002.
20. Q. Ji, and Z. Zhu Eye and gaze tracking for interactive graphic display Smart Graphics 2002 Hawthorne NY, USA
21. R. Kaliouby, P. Robinson. Real-time inference of complex mental states from facial expressions and head gestures, in: Proc. in CVPR Workshop on Real-Time Computer Vision for Human Computer Interaction, 2004. p. 154.
22. M. Kato, I. So, Y. Hishnuma, O. Nakamura, T. Minami. Description and synthesis of facial expressions based on isodensity maps, in: T. Kunii (Ed.), Visual Computing, 1991, pp. 39-56.
23. G.D. Kearney, and S. Mckenzie Machine interpretation of emotion: design of memory-based expert system for interpreting facial expressions in terms of signaled emotions (JANUS) Cogn. Sci. 17 4 1993 589 622
24. S. Kimura, M. Yachida. Facial expression recognition and its degree estimation, in: Proc. IEEE Internat. Conf. Computer Vision Pattern Recognition. 1997, pp. 295-300.
25. H. Kobayashi, F. Hara, Recognition of six basic facial expressions and their strength by Neural Network, in: Proc. Internat. Workshop Robot and Human Communication, 1992, pp. 381-386.
26. H. Kobayashi, F. Hara, Facial interaction between animated 3D face robot and human beings, in: Internat. Conf. Syst., Man, Cybern. 1997, pp. 3732-3737.
27. J.J. Lien, T. Kanade, J.F. Cohn, and C. Li Detection, tracking, and classification of action units in facial expression Internat. J. Robot. and Autonomous Syst. 31 1997 131 146
28. K. Mase Recognition of facial expression from optical flow IEICE Trans. E 74 10 1991 3474 3483
29. C. Morimoto, M. Flickner, Real-time multiple face detection using active illumination, in: Proc. Fourth IEEE Internat. Conf. on Automatic Face and Gesture Recognition, 2000, pp. 8-13.
30. N. Oliver, E. Horvitz, A. Garg. Layered representations for human activity recognition, in: Proc. IEEE Internat. Conf. on Multimodal Interfaces, 2002, pp. 3-8.
31. L. Paletta, and A. Pinz Active object recognition by view integration and reinforcement learning Robot. Autonomous Syst. 31 2000 71 86
32. M. Pantic, and L. Rothkrantz Automatic analysis of facial expressions: the state of the art IEEE Trans. Pattern Anal. Mach. Intell. 22 12 2002 1424 1445
33. M. Pantic, and L. Rothkrantz Expert system for automatic analysis of facial expression J. Image Vis. Comput. 18 11 2000 881 905
34. V. Pavlovic, A. Garg, M. Rehg. Multimodal speaker detection using error feedback dynamic Bayesian networks, in: Proc. IEEE Internat. Conf. Computer Vision and Pattern Recognition, 2000.
35. A. Rahardja, A. Sowmya, and W.H. Wilson A Neural Network approach to component versus holistic recognition of facial expressions in images SPIE, Intelligent Robots and Computer Vision X: Algorithms and Techniques 1607 1991 62 70
36. M. Rosenblum, Y. Yacoob, L. Davis. Human emotion recognition from motion using a radial basis function network architecture, in: Proc. IEEE Workshop on Motion of Non-Rigid and Articulated Objects, 1994, pp. 43-49.
37. N. Sebe, M.S. Lew, I. Cohen, A. Garg, T.S. Huang, Emotion recognition using a cauchy naive bayes classifier, in: Internat. Conf. on Pattern Recognition, 2002.
38. Y. Tian, T. Kanade, and J.F. Cohn Recognizing action units for facial expression analysis IEEE Trans. Pattern Anal. Mach. Intell. 23 2 2001 97 115
39. Y. Tian, T. Kanade, J.F. Cohn. Recognizing Facial Actions by Combining Geometric Features and Regional Appearance Patterns Robust lip tracking by combining shape, color and motion. Technical Report Technical Report CMU-RI-TR-01-01, Robotics Institute, Carnegie Mellon University, 2001.
40. H. Ushida, T. Takagi, T. Yamaguchi. Recognition of facial expressions using conceptual fuzzy sets, in: Proc. Conf. Fuzzy Systems, 1993, pp. 594-599.
41. L. Wiskott, J. Fellous, N. Kr ger, C.V. der Malsburg, Face recognition by elastic bunch graph matching, in: IEEE Trans. on Pattern Analysis Machine Intelligence, 1997, pp. 775-779.
42. Y. Yacoob, L. Davis. Recognition facial expressions by spatio-temporal analysis, in: Proc. Internat. Conf. Pattern Recognition, 1994, pp. 747-749.
43. Y. Yacoob, and L.S. Davis Recognizing human facial expressions from long image sequences using optical flow IEEE Trans. Pattern Anal. Mach. Intell. 18 6 1996 636 642
44. Z. Zhang, M. Lyons, M. Schuster, S. Akamastsu. Comparison between geometry-based and gabor wavelets-based facial expression recognition using multi-layer perception, in: Proc. Internat. Conf. Automatic Face and Gesture Recognition, 1998, pp. 454-459.
45. J. Zhao, G. Kearney. Classifying facial emotions by backpropagation neural networks with fuzzy inputs, in: Proc. Internat. Conf. Neural Information Processing, 1996, pp. 454-457.
46. Z. Zhu, Q. Ji, K. Fujimura, K. Lee. Combining Kalman filtering and mean shift for real time eye tracking under active ir illumination, in: Proc. Internat. Conf. Pattern Recognition, 2002.