Infrared thermal sensing of positive and negative affective states

2006 IEEE Conference on Robotics, Automation and Mechatronics

Volumn , Issue , 2006, Pages

  Khan, Masood Mehmood ^a   Ward, Robert D ^b   Ingleby, Michael ^b  

^a AMERICAN UNIVERSITY OF SHARJAH   (United Arab Emirates)

^b UNIVERSITY OF HUDDERSFIELD   (United Kingdom)

Author keywords

Affective computing; Automated affect recognition; Facial expression classification; Human machine interaction

Indexed keywords

BIT ERROR RATE; EIGENVALUES AND EIGENFUNCTIONS; HUMAN COMPUTER INTERACTION; LINEAR SYSTEMS; PATTERN RECOGNITION; PHYSIOLOGY; SIGNAL PROCESSING;

AFFECTIVE COMPUTING; AUTOMATED AFFECT RECOGNITION; FACIAL EXPRESSION CLASSIFICATION; HUMAN MACHINE INTERACTION;

THERMOGRAPHY (IMAGING);

EID: 34547249932     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/RAMECH.2006.252608     Document Type: Conference Paper

References (38)

1. R.D. Ward, D. Bell and P. Marsden, "An exploration of facial expression tracking in affective HCI," In P Palanque, P Johnson and E O'Neill (Eds.), People and Computers XVII: Designing for Society, proceedings of HCI 2003, University of Bath, UK, pp. 383-399, 2003.
2. T. Fong, I. Nourbaksh and K. Dautenhahn, "A survey of socially interactive robots," Robotics and Autonomous Systems, vol. 42, pp. 143-166, 2003.
3. R. Henderson, J. Podd, M. Smith and H. Varela-Alvarez, "An examination of four used-based software evaluation methods," Interacting with Computers, vol. 7, no. 4, 1995.
4. N. Ohnishi and N. Sugie, "Visual-auditory interfaces for machines that serve humans," Robotics and Autonomous Systems, vol. 18, pp. 243-249, 1996.
5. F. Paterno, "Model-based tools for pervasive usability," Interacting with computers, vol. 17, pp. 291-315, 2005.
6. J.D. Wilfong, "Computer anxiety and anger: the impact of computer use, computer experience, and self-efficacy beliefs," Computers in Human Behaviors, in press, available online since April 2004.
7. A. Zaatri and M. Oussalah, "Integration and design of multimodal interfaces for supervisory control systems," Information Fusion, vol. 4, pp. 135-150, 2003.
8. J.F. Baldwin, S.J. Case and T.P. Martin, "Machine interpretation of facial expressions," BT technology Journal, vol. 16, no. 3, 1998.
9. B. Fasel and J. Luettin, "Automatic facial expression analysis: a survey," Pattern Recognition, vol. 36, pp. 259-275, 2003.
10. M. Pantic and L.J.M. Rothkrantz, "Automatic analysis of facial expressions: The state of the art," IEEE Transactions on Pattern analysis and Machine Understanding, vol. 22, no. 12, pp. 1424-1445, 2000.
11. R.C. Arkin, M. Fujita, T. Takagi and R. Hasegawa, "An ethological and emotional basis for human-computer interaction," Robotics and Autonomous Systems, vol. 42, pp. 191-201, 2003.
12. V. Surakka, M. Illi and P. Isokoski, "Gazing and frowning as a new human-computer interaction technique," ACM Transaction on Applied Perception, vol. 1, no. 1, pp. 40-56, 2004.
13. J. Zhai, A.B. Barreto,C. Chin and C. Li, "User stress detection in human-computer interaction," Journal of Biomedical Sciences Instrumentation, vol. 41, pp. 277-282, 2005.
14. B. Olivier, T. Zethof, T. Pattij, M. van Boogaert, R. Oorshot, C. van, Leahy, R. Oosting, A. Bouwknecht, J. Veening, Gugten Van Der and L. Groenink, "Stress-induced hypothermia and anxiety: pharmacological validation," European Journal of Pharmacology, vol. 28, no. 463(1-3), pp. 117-132, 2003.
15. K. Nakayama, S. Goto, K. Kuraoka and K. Nakamura, "Decrease in nasal temperature of rhesus monkeys (Macaca mulatta) in negative emotional state," Journal of Physiology and Behavior, vol. 84, pp. 783-790, 2005
16. D.M. Vianna and P. Carrive, "Changes in cutaneous and body temperature during and after conditioned fear to context in the rat," European Journal of Neuroscince, vol. 21, no. 9, pp. 2505-25012, 2005.
17. Y. Sugimoto, Y. Yoshitomi and S. Tomita, "A method of detecting transitions of emotional states using a thermal facial image based on a synthesis of facial expressions," Robotics and Autonomous Systems, no. 31, pp. 147-160, 2000.
18. Y. Yoshitomi, S-I. Kim, T. Kawano and T. Kitazoe, "Effects of sensor fusion for recognition of emotional states using voice, face image and thermal image of face," in the proceedings of the IEEE International workshop on Robotics and Human Interactive Communication, pp. 178-183, Osaka, Japan, Sept. 2000.
19. I. Pavlidis, "Lie detection using thermal imaging," Thermal facial screening," in the Proceedings of SPIE - Thermosense XXVI, Annual conference of the International Society for Optical Engineering, Bellingham, USA, April 2004, pp. 270-279.
20. M.M. Khan, R.D. Ward and M. Ingleby, "Automated classification and recognition of facial expressions using infrared thermal imaging," in the Proceedings of 2004 IEEE Conference on Cybernetics and Intelligent Systems, Singapore, December 2004, pp. 202-206.
21. th British HCI Group Annual Conference HCI 2005, Edinburgh, Scotland, vol. 02, pp. 10-14, September 2005.
22. C. Puri, L. Olson, I. Pavlidis, J. Levine, and J. Starren, "StressCam: Non-contact measurement of users' emotional states through thermal imaging," in the proceedings of the CHI 2005, pp. 1725-1728, Portland, Oregon, April 2005.
23. C.H. Jones, E.F.J. Ring and R.P. Clark, "Medical Thermography" in Applications of Thermal Imaging eds. S. G. Burnay, T. L. Williams and C. H. N. Jones, Adam Hilger, Bristol, 1988.
24. R.W. Picard, and J. Klein, "Computers that recognize and response to user emotion: theoretical and practical implications," Interacting with computers, vol. 14, pp. 141-169, 2002.
25. M.T. Posamentier, and H. Abdi, "Processing faces and facial expressions," Neuropsychology Review, no. 13, pp. 113-143,2003.
26. CANTRONIC Systems Inc., IR 860 User Manual, Cantronic Systems Inc., Coquitlam, 2001.
27. M.S. Bartlett, J.C. Hager, P. Ekman and T.J. Sejnowski, "Measuring Facial Expressions by Computer Image Analysis," Journal of Psychophysiology, vol. 36, no. 2, 1999.
28. C. Huang, and Y. Huang, "Facial expression recognition using model-based feature extraction and action parameters classification," Journal of Visual Communication and Image Representation, vol. 8, no. 3, pp. 278-290, 1997.
29. H-C. Kim, D. Kim, S.Y. Bang, "An efficient model order for PCA mixture model," Pattern Recognition Letters, vol. 24, pp. 1385-809, 1393, 2003.
30. X. Chen, and T. Huang, "Facial expression recognition: A clustering-based approach," Pattern Recognition Letters, vol. 24, pp. 1295-1302, 2003.
31. H.K. Kim, S.Y. Bang and S.R. Kim, "Emotion recognition system using short term monitoring of physiological signals," Medical and Biological Engineering and Computing, vol. 42, no. 3, pp. 419-427, 2004.
32. S. Dubuisson, F. Davoine, and M. Masson, "A solution for facial expression representation and recognition," Signal Processing: Image Communication," vol. 17, pp. 657-673, 2002.
33. M. Lyons, J. Budynek, and S. Akamatsu, "Classifying images of facial expression using a Gabor wavelet representation," in the Proceedings of 2 International Conference on Cognitive Science, pp. 113-118, Tokyo, Japan, 1999.
34. H. Liu, and H. Motoda, "Less is more," in H. Liu and H. Motoda (Eds.), Feature Extraction, Construction and Selection: A data mining perspective, Kluwer Academic Publisher, London, 1998.
35. H. Vafaie, and K.D. Jong, "Evolutionary feature space transformation," in H. Liu and H. Motoda (Eds.), Feature Extraction, Construction and Selection: A data mining perspective, Kluwer Academic Publisher, London, 1998.
36. R.O. Duda, P.E. Hart, D.G Stork, Pattern Classification, New York, Wiley Interscience, 2001.
37. J. Pessa, V. Zadoo, P. Gerza, E.J. Adrian, A. Dewitt, and J. Garza, 1998. "Double or bifid zygomatcius major muscle: anatomy, incidence and clinical correlation, Journal of Clinical Anatomy, vol. 11, pp. 310-313, 1998.
38. U. Kunzmann and D. Gruhn, "Age differences in emotional reactivity: the sample case of sadness," Psychology and Aging, vol. 20, no. 1, pp. 47-59, 2005.