A feature-based detection and tracking system for gaze and smiling behaviours

Computer Systems Science and Engineering

Volumn 26, Issue 3, 2011, Pages 207-214

  Chen, Jingying ^a   Chen, Dan ^b,c   Lemon, Oliver ^d  

^a CENTRAL CHINA NORMAL UNIVERSITY   (China)

^b YANSHAN UNIVERSITY   (China)

^c UNIVERSITY OF BIRMINGHAM   (United Kingdom)

^d HERIOT WATT UNIVERSITY   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

AUTO-REGRESSIVE; COMMUNICATION SKILLS; DETECTION AND TRACKING; FACIAL FEATURE; FACIAL FEATURE POINTS; FEATURE POINT; FEATURE-BASED; HEAD POSE ESTIMATION; HUMAN FACES; MODEL-BASED PREDICTION; MOTION DETECTORS; TRACKING PROCESS;

NAVIGATION; OPTICAL FLOWS; TRACKING (POSITION);

DETECTORS;

EID: 80051725436     PISSN: 02676192     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (41)

1. U. Weidenbacher, G. Layher, P. Bayerl, and H. Neumann, "Detection of head pose and gaze direction for human-computer interaction," Perception and Interactive Technologies, Vol. 4021/2006, pp. 9-19, Springer, Berlin, Heidelberg, 2006. (Pubitemid 44072267)
2. R. Stiefelhagen, Y. Jie, and A.Waibel, "Simultaneous tracking of head poses in a panoramic view," in Proc. of the 15th International Conference on Pattern Recognition, Vol. 3, Barcelona, Spain, Sep. 2000, pp. 722-725.
3. N. Gourier, J. Maisonnasse, D. Hall and J.L. Crowley, "Head pose estimation on low resolution images," Lecture Notes in Computer Science, Vol. 4122/2007, Springer, Berlin, Heidelberg, 2007, pp. 270-280.
4. A. Rajwade and M. Levine, "Facial pose from 3D data," Image and Vision Computing, Vol. 24, No. 8, pp. 849-856,2006. (Pubitemid 44188982)
5. Y. Hu, L. Chen, Y. Zhou, and H. Zhang, "Estimating face pose by facial asymmetry and geometry," in Proc. of the 6th IEEE International Conference on Automatic Face and Gesture Recognition, Seoul, Korea, May 2004, pp. 651-656.
6. Y. Matsumoto and A. Zelinsky, "An algorithm for real time stereo vision implementation of head pose and gaze direction measurement," in Proc. of the 4th IEEE International Conference on Automatic Face and Gesture Recognition, France, 2000, pp.499-505.
7. J. Ko, K. Kim, S. Choi, J. Kim, K. Kim and J. Kim, "Facial feature tracking and head orientation-based gaze tracking," in Proc. of the International Technical Conference on Circuits/Systems, Computers and Communications (ITC-CSCC) 2000, Pusan, Korea, Jul. 2000.
8. Q. Ji. And X. Yang, "Real time 3D face pose discrimination based on active IR illumination," in Proc. of the 16th International Conference on Pattern Recognition (ICPR), Vol. 4, 2002, pp. 40310-40313.
9. D. F. DeMenthon and L. S. Davis, "Model based object pose in 25 lines of code," in Pmc of 2nd European Conference on Computer Vision, Santa Margherita Ligure, May 1992, pp. 335-343.
10. M.A. Fischler and R.C. Bolles, "Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography," Comm. of the ACM, Vol. 24, 1981. pp. 381-395.
11. (2008) Smile detection technology in camera. [Online]. Available: entertainment.millionface.com
12. B. asel and J. Luettin "Automatic facial expression analysis: a survey" Pattern Recognition, Vol. 36, pp. 259-275,2003
13. M.S. Ratliff and E. Patterson, "Emotion recognition using facial expressions with active appearance models," in Pmc. of the IASTED on Human Computer Interaction 2008, Innsbruck, Austria, March 17-19,2008.
14. S. Al Moubayed , M. Baklouti , M. Chetouani , T. Dutoit , A. Mahdhaoui, J. Martin, S. Ondas , C. Pelachaud , J. Urbain and M. Yilmaz, "Multimodal feedback from robots and agents in a storytelling experiment," QPSR of the numediart research program. Vol. 1, No. 3, September 2008, pp. 109-118.
15. (2002) The Smile detection. [Online]. Available: http://courses.media. mit.edu/2002spring/mas630/02.projects/Taly/
16. A. Ito, X. Wang, M. Suzuki and S. Makino, "Smile and laughter recognition using speech processing and face recognition from conversation video" in Proc. of the 2005 IEEE Int. Conf. on Cyberworlds, 2005, pp. 437-444 (Pubitemid 43897956)
17. U. Kowalik, T. Aoki and H. Yasuda, "Broaference - a next generation multimedia terminal providing direct feedback on audience's satisfaction level" in Proc. of INTERACT, 2005 pp. 974-977
18. O. Deniz, M. Castrillon, J. Lorenzo, L. Anton, and G. Bueno "Smile detection for user interfaces," Lecture Notes in Computer Science 5359,2008, pp. 602-611.
19. P. Viola and M. Jones, "Robust real time object detection," in Proc. of the 2nd International Workshop on Statistical and Computational Theories of Vision-Modeling, Learning, Computing and Sampling, Vancouver, Canada, July 2001.
20. J. Chen and O. Lemon, "Facial Feature Detection and Tracking in a New Multimodal Technology-Enhanced Learning Environment for Social Communication", in Proc. of the IEEE International Conference on Signal and Image Processing Applications (ICSIPA 2009), KL, Malaysia, 2009, pp. 279-284.
21. B. Lucas and T. Kanade, "An interactive image registration technique with an application in stereovision," in Proc. of the 7th International Joint Conference on Artificial Intelligence, 1981, pp. 674-679. (Pubitemid 14478744)
22. K. Porayska-Pomsta, S. Bernardini and G. Rajendran, "Embodiment as a means for scaffolding young children's social skill acquisition," in Proc. of the Workshop on Children and Embodied Interaction: Seeking Common Ground, 8th International Conference on Interaction Design and Children (IDC'09), Como, Italy, 2009.
23. L. Gralewski, N. Campbell, B. Thomas & C. Dalton: Statistical synthesis of facial expressions for the portrayal of emotion. Proc. of the 2nd international conference on Computer graphics and interactive techniques in Australasia and South East Asia, Singapore (2004) 190-198. (Pubitemid 40120543)
24. L. Huang & C. Su: Bayesian network enhanced prediction for multiple facial feature tracking. Electronic letters on Computer Vision and Image Analysis, Vol. 5, No. 3 (2005) 157-169
25. S. McKenna, G. McAllister & I. Ricketts: Hand tracking for behavior understanding. Image and Vision Computing, Vol. 20 (2002) 827-840
26. A. Neumaier & T. Schneider: Estimation of parameters and eigenmodes of multivariate autoregressive models. ACM Trans. Math. Softw., Vol. 27 (2001) 27-57 (Pubitemid 33609114)
27. E. Trucco and A. Verri: Introductory techniques for 3-d computer vision. Prentice-Hall, New Jersey (1998)
28. Z. Zhu & Q. Ji: 3D Face Pose Tracking From an Uncalibrated Monocular Camera. Proc. of the 17th International Conference on Pattern Recognition, UK (2004) 400-403
29. P. Yao, G. Evans & A. Calway: Using affine correspondence to estimate 3-D facial pose. Proc. of the International Conference on Image Processing, Greece (2001) 919-922 (Pubitemid 33058137)
30. J. Bouguet: Pyramidal Implementation of the Lucas Kanade Feature Tracker Description of the algorithm. Intel Corporation, Microprocessor Research Labs, OpenCV document (1999)
31. Teyseyre, A. R., Campo, M. 2005. Early requirements validation with 3D worlds. International Journal of Computer Systems Science and Engineering 20 (1), pp. 63-74. (Pubitemid 40191865)
32. A. Perini and A. Susi. 2005. Agent-Oriented Visual Modeling and Model Validation for Engineering Distributed Systems. International Journal of Computer Systems Science & Engineering, 20 (4):319-329. (Pubitemid 41561789)
33. Fu, C, Falkowski BJ. 2007. Ternary recursive fast transforms: Properties, mutual relations, and circuit realization. Journal Of Circuits Systems And Computers 16(2), pp. 155-168. (Pubitemid 47153350)
34. Fu, C, Falkowski BJ. 2006. Linearly independent ternary arithmetic helix transforms, their properties and relations. IEE Proceedings-Vision Image And Signal Processing 153(2), pp. 87-94.
35. Wang, L., Gregor von Laszewski, Marcel Kunze, Jie Tao. 2010. Schedule Distributed Virtual Machines in a Service Oriented Environment. AINA 2010: 230-236
36. Wang, L., Gregor von Laszewski, Marcel Kunze, Jie Tao, Jai Dayal. 2010. Provide Virtual Distributed Environments for Grid computing on demand. Advances in Engineering Software 41(2): 213-219.
37. Chen D., D. Li, M. Xiong, H. Bao, X. Li. 2010. GPGPU-Aided Ensemble Empirical Mode Decomposition for EEG Analysis during Anaesthesia, IEEE Transactions on Information Technology in BioMedicine 14(6), pp. 1417-1427.
38. Chen D., Turner S.J., Cai W, Theodoropoulos G.K., Xiong M., Lees M. 2010. Synchronization in federation community networks. Journal of Parallel and Distributed Computing 70 (2), pp. 144-159.
39. Chen, D., S. J. Turner,W. Cai, M. Xiong. 2008.A Decoupled Federate Architecture for High Level Architecture-based Distributed Simulation. Journal of Parallel and Distributed Computing 68(11), pp. 1487-1503.
40. Chen, D. S. J. Turner,W. Cai. 2008. Towards Fault-tolerant HLA-based Distributed Simulations. Simulation: Transactions of the Society for Modelling and Simulation International 84( 10/11), pp. 493-509.
41. YANG, M. 2009. Face Detection. In Encyclopedia of Biometrics, STAN Z. LI Eds. Springer.