Automated classification and recognition of facial expressions using infrared thermal imaging

2004 IEEE Conference on Cybernetics and Intelligent Systems

Volumn , Issue , 2004, Pages 202-206

  Khan, Masood Mehmood ^a   Ward, Robert D ^b   Ingleby, Michael ^b  

^a AMERICAN UNIVERSITY OF SHARJAH   (United Arab Emirates)

^b UNIVERSITY OF HUDDERSFIELD   (United Kingdom)

Author keywords

Facial expression classification; Facial thermal feature points; Image processing; Infrared thermal imaging; Machine vision

Indexed keywords

AUTOMATION; COMPUTER VISION; HUMAN ENGINEERING; IMAGE PROCESSING; IMAGE QUALITY; MACHINE DESIGN; MEDICAL IMAGING;

FACIAL EXPRESSION CLASSIFICATION; FACIAL THERMAL FEATURE POINTS; HAPPINESS; INFRARED THERMAL IMAGING;

FACE RECOGNITION;

EID: 11244344777     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (39)

1. J. N. Bassili, "Emotion recognition: The role of facial movement and relative importance of upper and lower areas of the face," J. Personality and Social Psychology, vol. 37, pp. 2049-2059, 1979.
2. M. Pantic and L. J. M. Rothkrantz, "Automatic Analysis of Facial Expressions: The State of the Art," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, no. 12, 2000.
3. B. Fasel and J. Luettin, "Automatic facial expression analysis: a survey," Pattern Recognition, vol. 36, no. 1, 2003.
4. Y-l Tian, T. Kanade, J. F. Cohn, "Recognizing Action Units for Facial Expression Analysis," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 23, no. 2, 2001.
5. Y. Gao, M. K. H. Leung, S. C. Hui and M. W. Tananda, "Facial Expression Recognition from Line-Based Caricatures," IEEE Transactions on Systems, Man and Cybernetics, vol. 33, no. 3, 2003.
6. I. Cohen, N. Sebe, A. Garg, L. S. Chen and T. S. Huang, "Facial expression recognition from video sequence: temporal and static modeling," Computer Vision and Image Understanding, vol. 91, no. 1-2, 2003.
7. Y. Du and X. Lin, "Emotional facial expression model building," Pattern Recognition Letters, vol. 24, no. 16, pp. 2923-2934, 2003.
8. S. Dubuisson, F. Davoine and M. Masson, "A solution for facial expression representation and recognition," Signal Processing: Image Communication " vol. 17, no. 9, 2002.
9. C-L Huang and Y-M Huang, "Facial Expression Recognition Using Model-Based Feature Extraction and Action Parameters Classification," Visual Communication and Image Representation J., vol. 8, no. 3, 1997.
10. Y. Sugimoto, Y. Yoshitomi and S. Tomita, "A method for detecting transitions of emotional states using a thermal facial image based on a synthesis of facial expressions," Robotics and Autonomous Systems, vol. 31, no. 3, 2000.
11. Y. Yoshitomi, S-I Kim, T. Kawano and T. Kitazoe, "Effects of sensor fusion for recognition of emotional states using voice, face images and thermal image of face, proc. IEEE international workshop on Robot and Human Interactive Communication, pp. 178-183, Osaka, Japan Sept. 27-29, 2000
12. M. T. Posamentier and H. Abdi, "Processing faces and facial expressions," Neuropsychology Review, vol. 13, no. 3, 2003.
13. D. Pizzagalli, T. Koenig, M. Regard and D. Lehmann, "Faces and emotions: brain electric field sources during covert emotional processing," Neuropsychohgia, vol. 36, no, 4, 1998.
14. Y. Adini, Y. Moses and S. Ullman, "Face Recognition: The problem of compensating for changes in illumination direction," IEEE Transactions on Pattern Analysts and Machine Intelligence, vol. 19, no. 7, 1997.
15. D. Socolinsky, A. Selinger and J. D. Neuheisel, "Face recognition with visible and thermal infrared imagery," Computer Vision and Image Understanding," vol. 91, no 1-2, 2003.
16. A. H. Hariri, A. Tessitore, V. S. Mattay, F. Fera and D. R. Weinberger, "The amygdala response to emotional stimuli: A comparison of faces and scenes," J. NeuroImaging, vol. 17, no. 1, 2002.
17. M. Iwase, Y. Ouchi, H. Okada, C. Yokoyama, S. Nobezawa, E. Yoshikawa, H. Tsukada, M. Takeda, K. Yamashita, M. Takeda, K. Yamaguti, H. Kuratsune, A. Shimizu and Y. Watanabe, "Neural substrates of human facial expression of pleasant emotion induced by comic films: A PET study," J. NeuroImaging, vol. 17, no.2, 2002.
18. I. Pavlidis, "Thermal facial screening," available on http://www.cse.ogi.edu/colloquia/212.html, posted Feb. 28, 2002, last visited Sep. 2003.
19. T. Ogasawara, Y. Kitagawa, T. Ogawa, T. Yamada, Y. Kawamura and K. Sano, "MR Imaging and Thermography of facial angioedema: A case report," J. Oral Surgery Oral Medicine Oral Pathology, vol. 92, no. 4, 2001.
20. J.G. McGimpsey, A. Vaidya, P.A. Biagioni and P-J. Lamey, "Role of thermography in the assessment of infraorbital nerve injury after malar fractures," British J. Oral and Maxillofacial Surgery," vol. 38, no.6, 2000.
21. A. Srivasta and X. Liu, "Statistical hypothesis pruning for identifying faces from infrared images," Image and Vision Computing, vol. 21, no. 7, 2003.
22. C. Eveland, D. Socolinsky and L. B. Wolff, "Tracking human faces in infrared video," Image and Vision Computing, vol. 21, no. 7, 2003.
23. T.J. Phillips, "High performance thermal imaging technology," The advanced semiconductor magazine, vol. 15, no. 7, pp. 32-36, 2002.
24. N.A. Diakides, "Infrared Imaging: An emerging technology in medicine," IEEE Engineering in Medicine and Biology, vol. 17, no. 4, pp. 17-18, 1998.
25. M. Head and S. Dyson, "Talking temperature of equine thermography," The Veterinary J., no. 162, no. 3, pp. 166-167, 2001.
26. N. Koyama, K. Hirata, K. Hori, K. Dan and T. Yokota, "Computer assisted infrared thermographic study of axon reflexes induced by intradermal melittin," Pain: J. Int. Association for the study of Pain, vol. 84, no.2-3, 2000.
27. M. Dabrowski, R. Dulski, S. Zmuda, P. Zaborowski and C. Pogorzelski, "The use of thermovision camera to observe physiological and pathological conditions of oral cavity mucous membrane," Infrared Physics and Technology, no. 43, pp. 265-269, 2002.
28. CANTRONIX Systems Inc., IR 860 User Manual, version 1.02, BC, Canada, 2001.
29. M.A. Sayette, F. C. Cohn, J. M. Wertz, M. A. Perott and D. J. Parrott, "A psychometric evaluation of the facial action coding systems for assessing spontaneous expressions," J. Nonverbal Behavior, vol. 25, no. 3, 2001.
30. G. Donato, M. S. Bartlett, J. C. Hager, P. Ekman and T. Sejnowski, "Classifying Facial Actions," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 21, no. 10, 1999.
31. C. L. Lisetti and D. J. Schiano, "Automatic Facial Expression Interpretation: Where Human-Computer Interaction, Artificial Intelligence and Cognitive Science Intersect," J. Pragmatics and Cognition, vol. 8, no. 1, 2000.
32. M. S. Bartlett, J. C. Hager, P. Ekman and T. J. Sejnowski, "Measuring Facial Expressions by Computer Image Analysis," J. Psychophysiology, vol. 36, no. 2, 1999.
33. P. Ekman, G. Roper and J. C. Hager, "Deliberate Facial Movement," Child Development, Vol. 51, no. 3 1980.
34. A. Field, Discovering Statistics using SPSS for Windows. London: Sage Publications, 2000.
35. S. Sharma, Applied Multivariate Techniques. New York: Wiley, 1996.
36. D. George and P. Mallery, SPSS/PC+ Step by Step: A simple guide and reference. London: Wadsworth Publishing Co., 1995.
37. J. R. Turner and J. F. Thayer, Introduction to Variance Analysis. London: Sage Publications, 2001.
38. B. S. Everitt and G. Dunn, Applied Multivariate Data Analysis. London: John Wiley and Sons, 1991
39. B.F.J. Manly, Multivariate Statistical Methods. London: Chapman and Hall, 1994.