Emotion recognition based on 2D-3D facial feature extraction from color image sequences

Journal of Multimedia

Volumn 5, Issue 5, 2010, Pages 488-500

  Niese, Robert ^a   Al Hamadi, Ayoub ^a   Panning, Axel ^a   Michaelis, Bernd ^a  

^a OTTO VON GUERICKE UNIVERSITY   (Germany)

Author keywords

Computer vision; Emotion recognition; Feature extraction; Human computer interaction

Indexed keywords

3-D PROCESSING; 3D COMPUTER VISION; ARTIFICIAL NEURAL NETWORK; AUTOMATIC RECOGNITION; BASIC EMOTIONS; CAMERA MODEL; CLASSIFICATION RESULTS; COLOR IMAGE SEQUENCES; EMOTION RECOGNITION; FACE MODELS; FACIAL EXPRESSIONS; FACIAL FEATURE EXTRACTION; GEOMETRIC FEATURE; GRADIENT INFORMATIONS; HEAD POSE; HUMAN-COMPUTER INTERACTION SYSTEM; IMAGE DATA; IMAGE FEATURE EXTRACTIONS; IMPERATIVE FEATURES; LOW LEVEL; PATTERN RECOGNITION TECHNIQUES; PHOTOGRAMMETRIC TECHNIQUE;

COMPUTER VISION; HUMAN COMPUTER INTERACTION; NEURAL NETWORKS; PHOTOGRAMMETRY; THREE DIMENSIONAL;

FEATURE EXTRACTION;

EID: 78651596449     PISSN: 17962048     EISSN: None     Source Type: Journal    
DOI: 10.4304/jmm.5.5.488-500     Document Type: Article

References (28)

1. Pantic, M., Pentland, A., Nijholt, A., Huang, T.S.: Human Computing and Machine Understanding of Human Behavior: A Survey, in Artificial Intelligence for Human Computing, 2007.
2. Li, S.Z., Jain, A.K.: Handbook of Face Recognition, ISBN: 0-387-40595-X, 2005.
3. Ekman, P.: Strong evidence for universals in facial expressions: a reply to Russell's mistaken critique. Psychol. Bull. 115(2), 268-287, 1994.
4. Black, M. J., Yacoob, Y.: Recognizing facial expressions in image sequences using local parameterized models of image motion. Inter. Journal of CV, 25(1), pp. 23-48, 1997.
5. Hu, C., Chang, Y., Feris, R., Turk. M.: Manifold based analysis of facial expression, Image and Vision Computing 24, pp. 60-614, 2006.
6. Valstar, M.F., Pantic, M.: Fully automatic facial action unit detection and temporal analysis. Proceedings of IEEE Int'l Conf. Computer Vision and Pattern Recognition, 2006.
7. Kumano, S., Otsuka, K., Yamato, J., Eisaku, S., Sata, Y.: Pose-Invariant facial expression recognition using variable intensity templates. Asian Conf. on Computer Vision, 2007.
8. Bartlett, S., Littlewort, G., Frank, G., Lainscsek, C., Fasel, I., Movellan, J.: Fully automatic facial action recognition in spontaneous behavior. In Proc. Conf. Automatic Face & Gesture Recognition, pp. 223-230, 2006.
9. Torre, F., Campoy, J., Ambadar, Z., Cohn, J.F.: Temporal Segmentation of Facial Behavior, International Conference on Computer Vision, October, 2007.
10. Zeng, Z., Fu, Y., Roisman, G.I., Zhen, W.: Spontaneous emotional facial expression detection. Journal of Multimedia, 2006.
11. Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features, Proceedings IEEE Conf. on Computer Vision and Pattern Recognition, 2001.
12. Al-Hamadi, A., Niese, R., Michaelis, B.: A robust approach for contour extraction and tracking of moving objects in video sequences, Signal processing, pattern recognition, and applications (Greece June 30 - July 2, 2003) proceedings: Acta Press, pp. 336-341, 2003.
13. Albertz, J., Kreiling, W.: Photogrammetric Guide, Herbert Wichmann Verlag GmbH, Karlsruhe, 1989.
14. McGlone, C., Mikhail, E., Bethel, J.: Manual of Photogrammetry, 5th Edition, ISBN 1-57083-071-1, 2004.
15. Blanz, V., Vetter, T.: A Morphable Model for the Synthesis of 3D Faces, SIGGRAPH, Conference Proceedings, 187-194, 1999.
16. Albrecht, P., Michaelis, B., Stereo Photogrammetry with Improved Spatial Resolution, ICPR, pp. 845, 1998.
17. Niese, R., Al-Hamadi, A., Michaelis, B.: A Stereo and Color-based Method for Face Pose Estimation and Facial Feature Extraction. ICPR 2006 (IEEE), The 18th International Conference on Pattern Recognition, 2006, Hong Kong, Volume: 1, pp. 299-302, 2006.
18. Rusinkiewicz, S., Levoy, M.: Efficient variants of the ICP algorithm, Proc. of the 3rd Int. Conf. on 3D Digital Imaging & Modeling, pp. 145-152, 2001.
19. Calow, R., Michaelis, B.: Markerless Analysis of Human Gait with a Multi-Camera-System. Proceedings of IASTED International Conference Biomedical Engineering (BioMED), Innsbruck, pp. 270-275, 2005.
20. Lucas, B., Kanade, T.: An Iterative Image Registration Technique with an Application to Stereo Vision, Proc. Of 7th International Joint Conference on Artificial Intelligence (IJCAI), pp. 674-679, 1981.
21. Bentley, J.L.: Multidimensional binary search trees used for associative searching, ACM, 18, pp. 509-517, 1975.
22. Haykin, S.: Neural Networks: A Comprehensive Foundation, Prentice Hall, ISBN: 978-01327-33502, 1998.
23. Nissen, S., Nemerson, E.: Fast Artifical Neural Network (FANN), Available at http://leenissen.dk/fann/, 2009.
24. Kohavi, R., Foster, P.: Glossary of terms, Special Issue on Appl. of Machine Learning and the Knowledge Discovery Processing, 30 (23), pp. 271-274, 1998.
25. Moore, D. S.: The Basic Practice of Statistics, W.H. Freeman & Company; 4th Edition, ISBN-13 978-0716774631, 2006.
26. th Intl. Conf. on Automatic Face and Gesture Recognition (FGR08), 17-19 September 2008, (Tracking Number: 66).
27. Fraunhofer-Institut fur Integrierte Schaltungen IIS, Schaltungen IIS, Erlangen, Germany, Biometrics Demo, http://www.iis.fraunhofer.de/EN/bf/bv/kognitiv/biom/dd.jsp, 2008.
28. Cohen, I., Sebe, N., Garg, A., Chen, L., Huang, T.S.: Facial expression recognition from video sequences: Temporal and static modeling, Computer Vision and Image Understanding, 91(1-2):160-187, 2003.