Robust classification of face and head gestures in video

Image and Vision Computing

Volumn 29, Issue 7, 2011, Pages 470-483

  Akakin, Hatice Çinar ^a   Sankur, Bülent ^a  

^a BOGAZICI UNIVERSITY   (Turkey)

Author keywords

Face and head gesture classification; Facial landmark tracking; Fusion of classifiers; Time series analysis

Indexed keywords

BLIND SOURCE SEPARATION; FACE RECOGNITION; FACTORIZATION; HIDDEN MARKOV MODELS; INDEPENDENT COMPONENT ANALYSIS; INTERFACES (COMPUTER); MATRIX ALGEBRA; TIME SERIES; TIME SERIES ANALYSIS;

ADAPTIVE TEMPLATE; AUTOMATIC ANALYSIS; DISCRIMINATIVE FEATURES; FACE AND HEAD GESTURE CLASSIFICATION; FACE LANDMARKS; FACIAL EXPRESSIONS; FACIAL LANDMARK; FEATURE SEQUENCE; FEATURE SUBSPACE; FUSION OF CLASSIFIERS; GEOMETRIC FEATURE; HIDDEN CONDITIONAL RANDOM FIELDS; HUMAN COMPUTER INTERFACES; KALMAN PREDICTOR; NATURALLY OCCURRING; NONNEGATIVE MATRIX FACTORIZATION; RESEARCH AREAS; ROBUST CLASSIFICATION; SPATIO-TEMPORAL DATA; VIDEO STREAMS;

TEACHING;

EID: 79957753517     PISSN: 02628856     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.imavis.2011.03.001     Document Type: Article

References (56)

1. M.L. Knapp, and J.A. Hall Nonverbal communication in human interaction, 6th Edition 2006 Wadsworth/Thomson Learning Belmont, CA
2. A. Mehrabian, and S.R. Ferris Inference of attitude from nonverbal communication in two channels Journal of Counseling Psychology 31 3 1967 248 252
3. A. Vinciarelli, M. Pantic, and H. Bourlard Social signal processing: survey of an emerging domain Image and Vision Computing 27 12 2009 1743 1759
4. D. Gatica-Perez Automatic nonverbal analysis of social interaction in small groups: a review Image and Vision Computing 27 12 2009 1775 1787
5. N. Sebe, M. Lew, Y. Sun, I. Cohen, T. Gevers, and T. Huang Authentic facial expression analysis 25 12 2007 1856 1863
6. Z. Zeng, M. Pantic, G. Roisman, and T. Huang A survey of affect recognition methods: audio, visual, and spontaneous expressions Pattern Analysis and Machine Intelligence 31 1 2009 39 58
7. C. Tomasi, and T. Kanade Detection and tracking of point features, Tech. rep., International Journal of Computer Vision 1991
8. R.S. Feris, and R.M. Cesar Jr. Tracking facial features using gabor wavelet networks Proc. IEEE Sibgrapi 2000 22 27
9. D. Cristinacce, and T.F. Cootes Facial feature detection and tracking with automatic template selection Int. Conf. On Automatic Face and Gesture Recognition (FGR) 2006
10. D.F., and F. Davoine Online appearance-based face and facial feature tracking Proc. of the 17th Int. Conf. on Pattern Recognition 2004
11. A. Kanaujia, Y. Huang, and D. Metaxas Emblem detections by tracking facial features CVPRW '06: Proceedings of the 2006 Conference on Computer Vision and Pattern Recognition Workshop 2006 108
12. T. Cootes, C. Taylor, D. Cooper, and J. Graham Active shape models - their training and application Computer Vision Image Understanding 61 1 1995 38 59
13. T. Cootes, G.J. Edwards, and C.J. Taylor Active appearance models IEEE Transactions on Pattern Analysis and Machine Intelligence 23 6 2001 681 684
14. Y. Tong, Y. Wang, Z. Zhu, and Q. Ji Robust facial feature tracking under varying face pose Pattern Recognition 40 2007 3195 3208 (Pubitemid 46990444)
15. F. Tsalakanidou, and S. Malassiotis Real-time 2d + 3d facial action and expression recognition Pattern Recognition 43 5 2010 1763 1775
16. I. Ari, A. Uyar, and L. Akarun Facial feature tracking and expression recognition for sign language 2008 1 6
17. Bogazici University Head Motion Analysis Project Database 2007 Perceptual Intelligence Laborator http://www.cmpe.boun.edu.tr/pilab/pilabfiles/databases/ buhmap
18. Y. Zhang, and Q. Ji Active and dynamic information fusion for facial expression understanding from image sequences IEEE Transactions on Pattern Analysis and Machine Intelligence 27 5 2005 699 714 (Pubitemid 40608403)
19. I. Hupont, E. Cerezo, and S. Baldassarri Facial emotional classifier for natural interaction Electronic Letters on Computer Vision and Image Analysis 7 4 2008 1 12
20. F. Dornaika, and F. Davoine Simultaneous facial action tracking and expression recognition in the presence of head motion International Journal of Computer Vision 76 3 2008 257 281
21. C. Shan, S. Gong, and P. McOwan Facial expression recognition based on local binary patterns: a comprehensive study Image and Vision Computing 27 6 2009 803 816
22. T. Wang, and J.J. James Lien Facial expression recognition system based on rigid and non-rigid motion separation and 3d pose estimation Pattern Recognition 42 2009 962 977
23. R.A. Kaliouby Mind-reading machines: automated inference of complex mental states, Tech. rep., UCAM-CL-TR-636 2005
24. Y. Tong, W. Liao, and Q. Ji Facial action unit recognition by exploiting their dynamic and semantic relationships IEEE Transactions on Pattern Analysis and Machine Intelligence 29 2007 1683 1699
25. M. Pantic, and L. Rothkrantz Facial action recognition for facial expression analysis from static face images IEEE Transactions on Systems, Man, and Cybernetics - Part B: Cybernetics 34 3 2004 1449 1461
26. P. Ekman, and W. Friesen Facial Action Coding System: A Technique for the Measurement of Facial Movement 1978 Consulting Psychologists Press Palo Alto
27. A. Kapoor, and R.W. Picard A real-time head nod and shake detector Proceedings from the Workshop on Perspective User Interfaces 2001
28. Y.G. Kang, H.J. Joo, and P.K. Rhee Real time head nod and shake detection using hmms Knowledge-Based Intelligent Information and Engineering Systems vol. 4253 2006 Springer Berlin Heidelberg 707 714 (Pubitemid 44700507)
29. L.-P. Morency, C. Sidner, C. Lee, C. Lee, and T. Darrell Contextual recognition of head gestures Proceedings of the Seventh International Conference on Multimodal Interfaces 2005 18 24 (Pubitemid 43218858)
30. A. Kapoor, W. Burleson, and R.W. Picard Automatic prediction of frustration International Journal of Human-Computer Studies 65 8 2007 724 736 (Pubitemid 46810294)
31. Q. Ji, P. Lan, and C. Looney A probabilistic framework for modeling and real-time monitoring human fatigue IEEE Transactions on Systems, Man, and Cybernetics, Part A 36 5 2006 862 875
32. J.H. Yang, Z.-H. Mao, L. Tijerina, T. Pilutti, J.F. Coughlin, and E. Feron Detection of driver fatigue caused by sleep deprivation IEEE Transactions on Systems, Man and Cybernetics, Part A 39 4 2009 694 705
33. O. Aran, and L. Akarun A multi-class classification strategy for fisher scores: Application to signer independent sign language recognition Pattern Recognition 43 5 2010 1776 1788
34. H. Cinar Akakin, L. Akarun, and B. Sankur Robust 2d/3d landmarking 3DTV Conference, Kos Island, Greece 2007 1 4
35. A.A. Salah, H. Cinar, L. Akarun, and B. Sankur Robust facial landmarking for registration Annals of Telecommunications 62 1-2 2007 1608 1633
36. H. Cinar Akakin, A. Salah, L. Akarun, and B. Sankur 2d/3d facial feature extraction Proceedings of the SPIE 2006 441 452
37. C. Demirkir, and B. Sankur Face detection using look-up table based gentle adaboost Audio and Video-based Biometric Person Authentication (AVBPA) 2005
38. P.J. Flynn, K.W. Bowyer, and P.J. Phillips Assessment of time dependency in face recognition: an initial study Proceedings of the 4th Int. Conf. on Audio and video based biometric person authentication 2003 Springer-Verlag Berlin, Heidelberg 44 51
39. A. Savran, N. Alyuz, H. Dibeklioglu, O. Celiktutan, B. Gokberk, B. Sankur, and L. Akarun Bosphorus database for 3d face analysis The First COST 2101 Workshop on Biometrics and Identity Management 2008
40. G. Welch, G. Bishop, An introduction to the kalman filter, 1995, http://www.cs.unc.edu/welch/kalman/kalmanIntro.html.
41. C. Seong, B. Kang, J. Kim, and S. Kim Effective detector and kalman filter based robust face tracking system PSIVT06 2006 453 462
42. K. Murphy, Kalman filter toolbox for Matlab, 1998, http://www.cs.ubc.ca/ murphyk/Software/Kalman/kalman.html.
43. T. Sheerman-Chase, E.-J. Ong, and R. Bowden Feature selection of facial displays for detection of non verbal communication in natural conversation IEEE International Workshop on Human-Computer Interaction, Kyoto 2009
44. A. Quattoni, S. Wang, L.-P. Morency, M. Collins, and T. Darrell Hidden conditional random fields IEEE Transactions on Pattern Analysis and Machine Intelligence 29 10 2007 1848 1852
45. C. Morimoto, Y. Yacoob, and L. Davis Recognition of head gestures using hidden markov models In Proceeding of ICPR 1996 461 465
46. J.D. Lafferty, A. McCallum, and F.C.N. Pereira Conditional random fields: Probabilistic models for segmenting and labeling sequence data Proceedings of the 18. International Conference on Machine Learning 2001 282 289
47. H.M. Wallach, Conditional random fields: An introduction, Tech. Rep. MS-CIS-04-21, University of Pennsylvania, 2004.
48. L.P. Morency HCRF Library 2007 http://sourceforge.net/projects/hcrf/
49. E. Oja Independent component analysis: algorithms and applications Neural Networks 13 2000 411 430 (Pubitemid 30447427)
50. D.D. Lee, and H.S. Seung Algorithms for non-negative matrix factorization NIPS 2000 556 562
51. C.-J. Lin Projected gradient methods for non-negative matrix factorization Neural Computation 19 2007 2756 2779
52. M. Hollander, and D.A. Wolfe Nonparametric Statistical Methods 2nd Edition 1999 Wiley-Interscience 2nd Edition
53. R. Bowden LILir Twotalk Corpus 2010 University of Surrey http://www.ee.surrey.ac.uk/Projects/LILiR/twotalk-corpus
54. P. Robinson, and R. el Kaliouby Computation of emotions in man and machines Philosophical Transactions of the Royal Society B: Biological Sciences 364 1535 2009 3441 3447
55. M. Pantic Machine analysis of facial behaviour: naturalistic and dynamic behaviour Philosophical Transactions of the Royal Society B: Biological Sciences 364 1535 2009 3505 3513
56. S.M. Boker, J.F. Cohn, B.-J. Theobald, I. Matthews, T.R. Brick, and J.R. Spies Effects of damping head movement and facial expression in dyadic conversation using real-time facial expression tracking and synthesized avatars Philosophical Transactions of the Royal Society B: Biological Sciences 364 1535 2009 3485 3495