Head pose estimation on top of haar-like face detection: A study using the Kinect sensor

Sensors (Switzerland)

Volumn 15, Issue 9, 2015, Pages 20945-20966

  Saeed, Anwar ^a   Al Hamadi, Ayoub ^a   Ghoneim, Ahmed ^b,c  

^a OTTO VON GUERICKE UNIVERSITY   (Germany)

^b KING SAUD UNIVERSITY   (Saudi Arabia)

^c MENOUFIA UNIVERSITY   (Egypt)

Author keywords

Gabor filter; Head pose; Histogram of gradient; Kinect sensor; Local binary pattern; Regression; Support vector machine

Indexed keywords

COMPUTER VISION; GABOR FILTERS; GESTURE RECOGNITION; GRAPHIC METHODS; IMAGE RECOGNITION; MOTION ESTIMATION; SUPPORT VECTOR MACHINES;

HEAD POSE; HISTOGRAM OF GRADIENTS; KINECT SENSORS; LOCAL BINARY PATTERNS; REGRESSION;

FACE RECOGNITION;

ALGORITHM; ANATOMY AND HISTOLOGY; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BIOMETRY; BODY POSTURE; FACE; HEAD; HUMAN; IMAGE PROCESSING; PHYSIOLOGY; PROCEDURES;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BIOMETRY; FACE; HEAD; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; POSTURE;

EID: 84940689191     PISSN: 14248220     EISSN: None     Source Type: Journal    
DOI: 10.3390/s150920945     Document Type: Article

References (36)

1. Niese, R.; Al-Hamadi, A.; Farag, A.; Neumann, H.; Michaelis, B. Facial expression recognition based on geometric and optical flow features in colour image sequences. IET Comput. Vis. 2012, 6, 79-89.
2. Moore, S.; Bowden, R. Local binary patterns for multi-view facial expression recognition. Comput. Vis. Image Underst. 2011, 115, 541-558.
3. Rudovic, O.; Member, S.; Pantic, M.; Patras, I.; Member, S. Coupled Gaussian processes for pose-invariant facial expression recognition. IEEE Trans. Pattern Anal. Mach. Intell. 2013, 35, 1357-1369.
4. Zhang, X.; Gao, Y. Face recognition across pose: A review. Pattern Recognit. 2009, 42, 2876-2896.
5. Morency, L. P.; Darrell, T. Head Gesture Recognition in Intelligent Interfaces: The role of Context in Improving Recognition. In Proceedings of the 11th International Conference on Intelligent User Interfaces, Sydney, Australia, 29 January-1 February 2006; pp. 32-38.
6. Sidner, C. L.; Lee, C.; Morency, L. P.; Forlines, C. The Effect of Head-nod Recognition in Human-robot Conversation. In Proceedings of the 1st ACM SIGCHI/SIGART Conference on Human-robot Interaction, Salt Lake City, UT, USA, 2-3 March 2006; pp. 290-296.
7. Kaliouby, R. E.; Robinson, P. Real-Time Inference of Complex Mental States from Facial Expressions and Head Gestures; Springer US: New York, NY, USA, 2005.
8. Baltrusaitis, T.; McDuff, D.; Banda, N.; Mahmoud, M.; El Kaliouby, R.; Robinson, P.; Picard, R. Real-Time Inference of Mental States from Facial Expressions and Upper Body Gestures. In Proceedings of the IEEE International Conference on Automatic Face Gesture Recognition and Workshops, Santa Barbara, CA, USA, 21-25 March 2011; pp. 909-914.
9. Cazzato, D.; Leo, M.; Distante, C. An investigation on the feasibility of uncalibrated and unconstrained gaze tracking for human assistive applications by using head pose estimation. Sensors 2014, 14, 8363-8379.
10. McMurrough, C.; Metsis, V.; Kosmopoulos, D.; Maglogiannis, I.; Makedon, F. A dataset for point of gaze detection using head poses and eye images. J. Multimodal User Interfaces 2013, 7, 207-215.
11. Ba, S.; Odobez, J. M. Recognizing visual focus of attention from head pose in natural meetings. IEEE Trans. Syst. Man Cybern. B Cybern. 2009, 39, 16-33.
12. Murphy-Chutorian, E.; Doshi, A.; Trivedi, M. Head pose estimation for driver assistance systems: A robust algorithm and experimental evaluation. In Proceedings of the IEEE Intelligent Transportation Systems Conference, Seattle, Washington, DC, USA, 30 September-3 October 2007; pp. 709-714.
13. Jimenez-Pinto, J.; Torres-Torriti, M. Optical flow and driver's kinematics analysis for state of alert sensing. Sensors 2013, 13, 4225.
14. Ma, B.; Zhang, W.; Shan, S.; Chen, X.; Gao, W. Robust head pose estimation using LGBP. Int. Conf. Pattern Recognit. 2006, 2, 512-515.
15. Wu, J.; Trivedi, M. M. A Two-stage head pose estimation framework and evaluation. Pattern Recognit. 2008, 41, 1138-1158.
16. Zhu, X.; Ramanan, D. Face Detection, Pose Estimation, and Landmark Localization in the Wild. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA, 16-21 June 2012; pp. 2879-2886.
17. Gurbuz, S.; Oztop, E.; Inoue, N. Model free head pose estimation using stereovision. Pattern Recognit. 2012, 45, 33-42.
18. Jimenez, P.; Nuevo, J.; Bergasa, L. Face Pose Estimation and Tracking Using Automatic 3D Model Construction. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Anchorage, AK, USA, 23-28 June 2008; pp. 1-7.
19. Tu, J.; Huang, T.; Tao, H. Accurate Head Pose Tracking in Low Resolution Video. In Proceedings of the International Conference on Automatic Face and Gesture Recognition, Southampton, AK, USA, 23-28 April 2006; pp. 573-578.
20. Ruddarraju, R.; Haro, A.; Essa, I. A. Fast Multiple Camera Head Pose Tracking. In Proceedings of the 11th International Conference on Intelligent User Interfaces, Vision Interface, Halifax, NS, Canada, 11-13 June 2003.
21. Niese, R.; Werner, P.; Al-Hamadi, A. Accurate, Fast and Robust Realtime Face Pose Estimation Using Kinect Camera. In Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, Manchester, UK, 13-16 October 2013; pp. 487-490.
22. Fanelli, G.; Weise, T.; Gall, J.; Gool, L. V. Real Time Head Pose Estimation from Consumer Depth Cameras; Springer Berlin, Heidelberg: Berlin, Gemany, 2011.
23. Yang, J.; Liang, W.; Jia, Y. Face Pose Estimation with Combined 2D and 3D HOG Features. In Proceedings of the International Conference on Pattern Recognition, Tsukuba, Japan, 11-15 November 2012; pp. 2492-2495.
24. Buddharaju, P.; Pavlidis, I.; Tsiamyrtzis, P. Pose-Invariant Physiological Face Recognition in the Thermal Infrared Spectrum. In Proceedings of the Conference on Computer Vision and Pattern Recognition Workshop, New York, NY, USA, 17-22 June 2006; p. 53.
25. Dahmane, A.; Larabi, S.; Djeraba, C.; Bilasco, I. Learning Symmetrical Model for Head Pose Estimation. In Proceedings of the International Conference on Pattern Recognition, Tsukuba, Japan, 11-15 November 2012; pp. 3614-3617.
26. Viola, P.; Jones, M. Rapid object detection using a boosted cascade of simple features. Comput. Vis. Pattern Recognit. 2001, 1, 511-518.
27. Fossati, A.; Gall, J.; Grabner, H.; Ren, X.; Konolige, K. Consumer Depth Cameras for Computer Vision; Springer-Verlag London: London, UK, 2013.
28. Bradski, G. The OpenCV Library. Available online: http: //sourceforge. net/projects/ opencvlibrary/ (accessed on 20 August 2015).
29. Cruz, A.; Bhanu, B.; Thakoor, N. Facial Emotion Recognition in Continuous Video. In Proceedings of the International Conference on Pattern Recognition, Tsukuba, Japan, 11-15 November 2012; pp. 1880-1883.
30. Saeed, A.; Al-Hamadi, A.; Niese, R.; Elzobi, M. Frame-based facial expression recognition using geometrical features. Adv. Human Comput. Interact. 2014, 4, 1-13.
31. Guo, G.; Wang, X. A Study on Human Age Estimation under Facial Expression Changes. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA, 16-21 June 2012, pp. 2547-2553.
32. Sharma, B.; Thota, R.; Vydyanathan, N.; Kale, A. Towards a Robust, Real-Time Face Processing System Using CUDA-Enabled GPUs. In Proceedings of International Conference on the High Performance Computing, Kochi, India, 16-19 December 2009; pp. 368-377.
33. Ojala, T.; Pietikäinen, M.; Harwood, D. A comparative study of texture measures with classification based on featured distributions. Pattern Recognit. 1996, 29, 51-59.
34. Dalal, N.; Triggs, B. Histograms of oriented gradients for human detection. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA, 25 June 2005; pp. 886-893
35. Abe, S. Support Vector Machines for Pattern Classification; Springer: London, UK, 2010.
36. Chang, C. C.; Lin, C. J. LIBSVM: A library for support vector machines. ACM Trans. Intell. Syst. Technol. 2011, 2, doi: 10. 1145/1961189. 1961199.