Human-computer interaction for smart environment applications using hand gestures and facial expressions

International Journal of Advanced Media and Communication

Volumn 3, Issue 1-2, 2009, Pages 95-109

  Chen, Qing ^a   Cordea, Marius D ^a   Petriu, Emil M ^a   Varkonyi Koczy, Annamaria R ^b   Whalen, Thomas E ^c  

^a UNIVERSITY OF OTTAWA   (Canada)

^b BUDAPEST UNIVERSITY OF TECHNOLOGY AND ECONOMICS   (Hungary)

^c Industry Canada   (Canada)

Author keywords

Face expression; Hand gesture; Healthcare; Human computer interface; Smart environment

Indexed keywords

HEALTH CARE; MEDICAL COMPUTING; USER INTERFACES;

BODY LANGUAGE; FACE EXPRESSIONS; FACIAL EXPRESSIONS; HAND GESTURE; HUMAN COMPUTER INTERACTION (HCI); HUMAN COMPUTER INTERFACES; SMART ENVIRONMENT;

HUMAN COMPUTER INTERACTION;

EID: 67650136358     PISSN: 14624613     EISSN: 17418003     Source Type: Journal    
DOI: 10.1504/IJAMC.2009.026854     Document Type: Article

References (32)

1. Chen, F., Fu, C. and Huang, C. (2003) 'Hand gesture recognition using a real-time tracking method and Hidden Markov models', Image and Vision Computing, Vol. 21, No. 8, pp.745-758.
2. Chen, Q., El-Sawah, A., Joslin, C. and Georganas, N.D. (2005) 'A dynamic gesture interface for virtual environments based on Hidden Markov Models', Proc. IEEE Int. Workshop on Haptic, Audio and Visual Environments and their Applications, pp.110-115.
3. Chen, Q., Georganas, N.D. and Petriu, E.M. (2007) 'Real-time vision-based hand gesture recognition with haar-like features and grammars', Proc. IMTC/2007, IEEE Instrum. Meas. Technol. Conf., May, Warsaw, Poland, 6 pages.
4. Cordea, M.D. (2007) A 3D Anthropometric Muscle-Based Active Appearance Model for Model-Based Video Coding, PhD Thesis, University of Ottawa, Ottawa, ON, Canada.
5. Cordea, M.D. and Petriu, E.M. (2006) 'A 3-D anthropometric muscle-based active appearance model', IEEE Trans. Instrum. Meas., Vol. 55, No. 1, pp.91-98.
6. Cordea, M.D., Petriu, D.C., Petriu, E.M., Georganas, N.D. and Whalen, T.E. (2002) '3-D head pose recovery for interactive virtual reality avatars', IEEE Trans. Instr. Meas., Vol. 51, No. 4, pp.640-644.
7. Cordea, M.D., Petriu, E.M. and Petriu, D.C. (2007) '3D head tracking and facial expression recovery using an anthropometric muscle-based active appearance model', Proc. IMTC/2007, IEEE Instrum. Meas. Technol. Conf., May, Warsaw, Poland, 6 pages.
8. Corradini, A. (2001) 'Real-time gesture recognition by means of hybrid recognizers', Revised Papers from the Int. Gesture Workshop on Gesture and Sign Languages in Human-Computer Interaction, LNCS-2298, Springer, pp.34-46.
9. Darwin, C.R. (1896) The Expression of Emotions in Man and Animals, Appleton, New York.
10. Ekman, P. and Friesen, W. (1977) Facial Action Coding System: A Technique for the Measurement of the Facial Movement, Consulting Psychologists Press, Palo Alto.
11. Ekman, P. and Friesen, W. (1986) Manual for the Facial Action Coding System, Consulting Psychologists Press, Palo Alto.
12. Gonzalez, R.C. and Thomason, M.G. (1978) Syntactic Pattern Recognition: An Introduction, Addison-Wesley Publishing Co., Reading, MA.
13. Green, R.D. and Guan, L. (2004) 'Quantifying and recognizing human movement patterns form monocular video images', IEEE CSVT Trans, Vol. 13, No. 2, pp.154-165.
14. Hu, W., Tan, T. and Maybank, L.W.S. (2004) 'A survey on visual surveillance of object motion and behaviours', IEEE Trans. SMC, Part C, Vol. 34, No. 3, pp.334-352.
15. Imagawa, K., Matsuo, H., Taniguchi, R., Arita, D., Lu, S. and Igi, S. (2000) 'Recognition of local features for camera-based sign language recognition system', Proc. Int. Conf. Pattern Recognition, Vol. 4, Barcelona, Spain, pp.849-853.
16. Liang, R.H. and Ouhyoung, M. (1998) 'A real-time continuous gesture recognition system for sign language', Proc. 3rd Int. Conf. on Automatic Face and Gesture Recognition, pp.558-565.
17. Lienhart, R. and Maydt, J. (2002) 'An extended set of Haar-like features for rapid object detection', Proc. IEEE Int. Conf. Image Processing Rochester, New York, Vol. 1, pp.900-903.
18. Lin, J., Wu, Y. and Huang, T.S. (2000) 'Modeling the constraints of human hand motion', Proc. IEEE Workshop on Human Motion, pp.121-126.
19. Malik, S., McDonald, C. and Roth, G. (2002) 'Hand tracking for interactive pattern-based augmented reality', Proc. Int. Symposium on Mixed and Augmented Reality, Darmstadt, Germany, pp.117-126.
20. Marchesotti, L., Bonamico, C., Regazzoni, C. and Lavagetto, F. (2005) 'Video processing and understanding tools for augmented multisensor perception and mobile user interaction in smart spaces', Int. J. Image and Graphics, Vol. 5, No. 3, July, pp.679-698.
21. Pantic, M., Valstar, M.F., Rademaker, R. and Maat, L. (2005) 'Web-based database for facial expression analysis', Proc. IEEE Conf. Multimedia and Expo, Amsterdam, The Netherlands, pp.317-321.
22. Pavlovic, V.I., Sharma, R. and Huang, T.S. (1997) 'Visual interpretation of hand gestures for human-computer interaction: A review', IEEE Tr. Patern Analysis and Machine Intell., Vol. 19, No. 7, July, pp.677-695.
23. Pedrycz, W. (2002) 'Computational intelligence and visual computing: An emerging technology for software engineering', Soft Computing - A Fusion of Foundations, Methodologies and Applications, Vol. 7, No. 1, November, pp.1432-7643.
24. Petriu, E.M. and Whalen, T.E. (2002) 'Computer-controlled human operators', IEEE Instrum. Meas. Mag., Vol. 5, No. 1, pp.35-38.
25. Särelä, A., Korhonen, I. and Lötjönen, J. (2003) 'IST Vivago® - an intelligent social and remote wellness monitoring system for the elderly', Proc. 4th Annual IEEE Conf. Inf. Tech. App. Biomed Birmingham, UK, pp.362-365.
26. Schmidt, A., Strohbach, M., Kristof van Laerhoven, K. and Gellersen, H-W. (2003) 'Ubiquitous interaction - using surfaces in everyday environments as pointing devices', in Carbonell, N. and Stephanidis, C. (Eds.): User Interfaces for All, Springer-Verlag, Berlin, Heidelberg, LNCS 2615, pp.263-279.
27. Sclaroff, S. and Isidoro, J. (1998) 'Active blobs', Intl. Conf. on Computer Vision, Mumbai, India, pp. 1146-1153.
28. Viola, P. and Jones, M. (2001) Robust Real-Time Object Detection, Cambridge Research Laboratory Technical Report Series, CRL2001/01, pp.1-24.
29. Waters, K. (1987) 'A muscle model for animating 3D facial expressions', Computer Graphics, Vol. 21, No. 4, July, pp.17-24.
30. Whalen, T.E., Petriu, D.C., Yang, L., Petriu, E.M. and Cordea, M.D. (2003) 'Capturing behaviour for the use of avatars in virtual environments', CyberPsychology and Behavior, Vol. 6, No. 5, pp.537-544.
31. Wu, Y. and Huang, T.S. (2001) 'Hand modeling analysis and recognition for vision-based human computer interaction', IEEE Signal Processing Magazine, Special Issue on Immersive Interactive Technology, Vol. 18, No. 3, pp.51-60.
32. Zhang, Z., Wu, Y., Shan, Y. and Shafer, S. (2001) 'Visual panel: Virtual mouse keyboard and 3D controller with an ordinary piece of paper', Proc. Workshop on Perceptive User Interfaces, Orlando, Florida, pp.1-8.