Thermal infrared imaging in psychophysiology: Potentialities and limits

Psychophysiology

Volumn 51, Issue 10, 2014, Pages 951-963

  Ioannou, Stephanos ^a,b   Gallese, Vittorio ^a   Merla, Arcangelo ^b  

^a UNIVERSITY OF PARMA   (Italy)

^b UNIVERSITY OF CHIETI   (Italy)

Author keywords

Arousal; Autonomic nervous system; Emotions; Psychophysiology; Thermal infrared imaging

Indexed keywords

AROUSAL; AUTONOMIC NERVOUS SYSTEM; EMOTION; HUMAN; PHYSIOLOGY; PSYCHOPHYSIOLOGY; SKIN TEMPERATURE;

AROUSAL; AUTONOMIC NERVOUS SYSTEM; EMOTIONS; HUMANS; PSYCHOPHYSIOLOGY; SKIN TEMPERATURE;

EID: 84906338682     PISSN: 00485772     EISSN: 14698986     Source Type: Journal    
DOI: 10.1111/psyp.12243     Document Type: Review

References (76)

1. Alexander, F. (1950). Psychosomatic medicine, its principles and applications. New York, NY: Norton.
2. Amiez, C., Procyk, E., Honore, J., Sequeira, H., & Joseph, J. P. (2003). Reward anticipation, cognition, and electrodermal activity in the conditioned monkey. Experimental Brain Research, 149, 257-275.
3. Anbar, M. (2002). Assessment of physiologic and pathologic radiative heat dissipation using dynamic infrared imaging. Annals of the New York Academy of Sciences, 972, 111-118.
4. Bagshaw, M. H., & Coppock, H. W. (1968). Galvanic skin response conditioning deficit in amygdalectomized monkeys. Experimental Neurology, 20, 188-196.
5. Berkovitz, B. (Producer), Kirsch, C. (Producer), Moxham, J. B. (Producer), Alusi, G. (Producer), & Cheesman, T. (Producer). (2013). 3D Head and Neck Anatomy with Special Senses and Basic Neuroanatomy. [DVD-ROM]. United Kingdom: Primal Pictures.
6. Calvin, K. L., & Duffy, V. G. (2007). Development of a facial skin temperature-based methodology for non-intrusive mental workload measurement. Occupational Ergonomics, 7, 83-94.
7. Cannon, W. B. (1929). Organization for physiological homeostasis. Physiological Reviews, 9, 399-431.
8. Chien, S. (1967). Role of the sympathetic nervous system in hemorrhage. Physiological Reviews, 47, 214-288.
9. Coli, M., Fontanella, L., Ippoliti, L., & Merla . A. (2007). Multiresolution KLE of psycho-physiological signals. Proceedings of Fifth Conference on Complex Models and Computational Intensive Methods for Estimation and Prediction, Book of Short Papers, 116-121.
10. Dowdall, J., Pavlidis T. I., & Tsiamyrtzis, P. (2006). Coalition tracking in facial infrared imaging and beyond. IEEE Conference on Computer Vision and Pattern Recognition, 134-144. doi: 10.1109/CVPRW.2006.55
11. Ebisch, S. J., Aureli, T., Bafunno, D., Cardone, D., Manini, B., Ioannou, S., ...Merla, A. (2012). Mother and child in synchrony: Thermal facial imprints of autonomic contagion. Thermology International, 22, 121-129.
12. Gane, L., Power, S., Kushki, A., & Chau, T. (2011). Thermal imaging of the periorbital regions during the presentation of an auditory startle stimulus. PLoS One, 6, 1-8. e27268. doi: 10.1371/journal.pone.0027268
13. Garbey, M., Sun, N., Merla, A., & Pavlidis, I. (2007). Contact-free measurement of cardiac pulse base on the analyses of thermal imagery. IEEE Transactions on Biomedical Engineering, 54, 1418-1426.
14. Haddy, F. J., Overbeck, H. W., & Daugherty, R. M. (1968). Peripheral vascular resistance. Annual Review of Medicine, 19, 167-194.
15. Hahn, A. C., Whitehead R. D., Albrecht, M., Lefevre, C. E., & Perret, D. I. (2012). Hot or not? Thermal reactions to social contact. Biology Letters, Physiology, 8, 1-4. doi: 10.1098/rsbl.2012.0338
16. Hales, J. R. S. (1985). Skin arteriovenous anastomoses, their control and role in thermoregulation. In K. Johansen & W. W. Burggren (Eds.), Cardiovascular shunts (pp. 433-451). Copenhagen, Denmark: Munksgaard.
17. Head, J. F. & Elliott, R. L. (2002). Infrared imaging: making progress in fulfilling its medical promise. IEEE Engineering Medical Biology Magazine, 21, 80-85.
18. Ioannou, S., Ebisch, S. J., Aureli, T., Bafunno, D., Ioannides, H. A., Cardone, D., ... Merla A. (2013). The autonomic signature of guilt in children: A thermal infrared imaging study. PloS One, 8, 1-11. doi: 10.1371/journal.pone.0079440
19. Kallat, J. W. (2007). Biological Psychology. Belmont, CA: Thomson Higher Education.
20. Kamei, T., Tsuda, T., Kitagawa, S., Naitoh, K., Nakashima, K., & Ohhashi, T., (1998). Physical stimuli and emotional stress-induced sweat secretions in the human palm and forehead. Analytica Chimica Acta, 365, 319-326.
21. Kang, J., McGinley, J. A., McFadyen, G., & Babski-Reeves, K. (2006). Determining learning level and effective training times. Proceedings of the 25th Army Science Conference, November 27-30, Orlando, FL.
22. Kastberger, G. & Stachl, R. (2003). Infrared imaging technology and biological applications. Behavioral Research Methods Instruments & Computers, 35, 429-439.
23. Kawasaki, H., Adolphs, R., Kaufman, O., Damasio, H., Damasio, A. R., Granner, M., ... Adolphs, R. (2001). Single-neuron responses to emotional visual stimuli recorded in human ventral prefrontal cortex. Nature Neuroscience, 4, 15-16.
24. Kistler, A., Mariazouls, C., & Berlepsch, V. K. (1998). Fingertip temperature as an indicator for sympathetic responses. International Journal of Psychophysiology, 29, 35-41.
25. Kistler, A., Mariauzouls, C., Kuhr, C., Simmen, D., Maranta, C. A., Stratil, J., ... Suter, B. (1996). Acute sympathetic responses elicited by acupuncture are pain related and nonspecific. Forsch Komplemetärmed, 3, 269-278.
26. Kistler, A., Mariauzouls, C., Link, H., & von Berlepsch, K. (1997). Does fragrance exposure affect autonomic responses or salivary IgA and cortisol levels? Forsch Komplemetärmed, 4, 270-274.
27. Kräuchi, K., & Wirz-Justice, A. (1994). Circadian rhythm of heat production, heart rate, and skin and core temperature under unmasking conditions in men. American Journal of Physiology, 267, R819-R829.
28. Kreibig, S. D. (2010). Autonomic nervous activity in emotion: A review. Biological Psychology, 84, 394-421. doi: 10.1016/j.biopsycho.2010.03.010
29. Kuraoka, K., & Nakamura, K. (2011). The use of nasal skin temperature measurements in studying emotion in macaque monkeys. Physiology and Behavior, 102, 347-355. doi: 10.1016/j.physbeh.2010.11.029
30. Lacroix, L., Spinelli, S., Heidbreder, C. A., & Feldon, J. (2000). Differential role of the medial and lateral prefrontal cortices in fear and anxiety. Behavioral Neuroscience, 114, 1119-1130.
31. Laine, C. M., Spitler, K. M., Mosher, C. P., & Gothard, K. M. (2009). Behavioral triggers of skin conductance responses and their neural correlates in the primate amygdala. Journal of Neurophysiology, 101, 1749-1754.
32. Levenson, R. W. (1988). Emotion and the autonomic nervous system: A prospectus for research on autonomic specificity. In H. Wagner (Ed.), Social psychophysiology and emotion: Theory and clinical applications (pp. 17-42). London: Wiley.
33. Levine, J. A., Pavlidis, I., & Cooper, M. (2001). The face of fear. Lancet, 357, 1757.
34. Lutz, T. (1999). Crying. The natural and cultural history of tears. New York, NY: Norton.
35. Mandler, G. (1975). Mind and emotion. New York, NY: Wiley.
36. Manini, B., Cardone, D., Ebisch, S. J. H., Bafunno, D., Aureli, T., & Merla, A. (2013). Mom feels what her child feels: Thermal signatures of vicarious autonomic response while watching children in a stressful situation. Frontiers in Human Neuroscience, 7, 1-10. doi: 10.3389/fnhum.2013.00299
37. Merla, A., Di Donato, L., & Romani, G. L. (2002). ImagePro: Software for infrared functional imaging. International Federation for Medical and Biological Engineering, 2, 1612-1613.
38. Merla, A., Di Donato, L., Rossini, P. M., & Romani, G. L. (2004). Emotion detection through functional infrared imaging: Preliminary results. Biomedizinische Technick, 48, 284-286.
39. Merla, A., & Romani, G. L. (2006). Functional infrared imaging in medicine: A quantitative diagnostic approach. Conference Proceedings: Engineering in Medicine & Biology Society, 1, 224-227.
40. Merla, A., & Romani, G. L. (2007). Thermal signatures of emotional arousal: A functional infrared imaging study. 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Lyon, France. doi: 10.1109/IEMBS.2007.4352270
41. Mizukami, K., Kobayashi, N., Ishii, T., & Iwata, H. (1990). First selective attachment begins in early infancy: A study using telethermography. Infant Behavior and Development, 13, 257-271.
42. Morris, J. S., deBonis, M., & Dolan, R. J. (2002). Human amygdala responses to fearful eyes. NeuroImage, 17, 214-222.
43. Naemura, A., Tsuda, K., & Suzuki, N. (1993). Effects of loud noise on nasal skin temperature [in Japanese]. Shinrigaku Kenkyu, 64, 51-54.
44. Nakanishi, R., & Imai-Matsumura, K. (2008). Facial skin temperature decreases in infants with joyful expression. Infant Behavior and Development, 31, 137-144. doi: 10.1016/j.infbeh.2007.09.001
45. Nakayama, K., Goto, S., Kuraoka, K., & Nakamura, K. (2005). Decrease in nasal temperature of rhesus monkeys (Macaca mulatta) in negative emotional state. Journal of Physiology and Behavior, 84, 783-790. doi: 10.1016/j.physbeh.2005.03.009
46. Nhan, B. R., & Chau, T. (2010). Classifying affective states using thermal infrared imaging of the human face. IEEE Transaction on Biomedical Engineeiring, 57, 979-987.
47. Nummenmaa, L., Glerean, E., Hari, R., & Hietanen, J. K. (2013). Bodily maps of emotions. Proceedings of the National Academy of Sciences, 111, 646-651. doi: 10.1073/pnas.1321664111
48. Owen, A. M., Coleman, M. R., Boly, M., Davis, M. H., Laureys, S., & Pickard, J. D. (2006). Detecting awareness in the vegetative state. Science, 313, 1402.
49. Pavlidis, I., Dowdall, J., Sun, N., Puri, C., Fei, J., & Garbey, M. (2007). Interacting with human physiology. Computer Vision and Image Understanding, 108, 150-170.
50. Pavlidis, I., Eberhardt, N. L., & Levine, J. (2002). Human behavior: Seeing through the face of deception. Nature, 415, 35.
51. Pavlidis, I., Levine, J., & Baukol, P. (2001). Thermal imaging for anxiety detection. IEEE, 2, 315-318. doi: 10.1109/ICIP.2001.958491
52. Pavlidis, I., Tsiamyrtzis, P., Shastri, D., Wesley, A., Zhou, Y., Lindner, P., ... Bas, B. (2012) Fast by nature-How stress patterns define human experience and performance in dexterous tasks. Scientific Reports, 2, 1-9.
53. Pearce, W. J., & D'Alecy, L. G. (1980). Hemorrhage-induced cerebral vasoconstriction in dogs. Stroke, 11, 190-196.
54. Porges, S. W. (1992). Vagal tone: A physiologic marker of stress vulnerability. Pediatrics, 90, 498-504.
55. Porges, S. W. (2001). The polyvagal theory: Phylogenetic substrates of a social nervous system. International Journal of Psychophysiology, 42, 123-146.
56. Porges, S. W. (2009). The polyvagal theory: New insights into adaptive reactions of the autonomic nervous system [Supplement 2]. Cleveland Clinic Journal of Medicine, 76, S86-S90. doi: 10.3949/ccjm.76.s2.17
57. Potegal, M., Hebert, M., DeCoster, M., & Meyerhoff, J. L. (1996). Brief, high-frequency stimulation of the corticomedial amygdala induces a delayed and prolonged increase of aggressiveness in male Syrian golden hamsters. Behavioral Neuroscience, 110, 401-412.
58. Puri, C., Olson, L., Pavlidis, I., Levine, J., & Starren, J. (2005). Stress-cam: Non-contact measurement of users' emotional states through thermal imaging. Proceedings of the 2005 ACM Conference on Human Factors in Computing Systems, 2, 1725-1728.
59. Ring, E. F. J. (2000). The discovery of infrared radiation in 1800. Imaging Science Journal, 48, 1-8.
60. Ring, E. F. J. (2004). The historical development of thermal imaging in medicine. Rheumatology, 43, 800-802. doi: 10.1093/rheumatology/keg009
61. Ring, E. F., & Ammer, K. (2006) The Biomedical Engineering Handbook (3rd ed.). Boca Raton, FL: CRC Press.
62. Ring, E. F., & Ammer, K. (2012). Infrared thermal imaging in medicine. Physiology Measures, 33, 33-46. doi: 10.1088/0967-3334/33/3/R33
63. Schachter, S., & Singer, J. E. (1962). Cognitive, social, and physiological determinants of emotional state. Psychological Review, 69, 379-399.
64. Shastri, D., Merla, A., Tsiamyrtzis, P., & Pavlidis, I. (2009). Imaging facial signs of neurophysiological responses. IEEE Transactions on Biomedical Engineering, 56, 477-484.
65. Shastri, D., Papadakis, M., Tsiamyrtzis, P., Bass, B., & Pavlidis, I. (2012). Perinasal imaging of physiological stress and its affective potential. IEEE Transactions on Affective Computing, 3, 366-378.
66. Skitzki, J. J., Chen, Q., Wang, W. C., & Evans, S. S. (2007). Primary immune surveillance: Some like it hot. Journal of Molecular Medicine, 85, 1361-1367.
67. Stoll, A. M. (1964). Techniques and uses of skin temperature measurements. Annals of the New York Academy of Sciences, Thermography and Its Clinical Applications, 121, 49-56.
68. Tsiamyrtzis, P., Dowdall, J., Shastri, D., Pavlidis, I., Frank, M., & Ekman, P. (2006). Imaging facial physiology for the detection of deceit. International Journal of Computer Vision, 71, 197-214.
69. Uwano, T., Nishijo, H., Ono, T., & Tamura, R. (1995). Neuronal responsiveness to various sensory stimuli, and associative learning in the rat amygdala. Neuroscience, 68, 339-361.
70. Vatner, S. F. (1974). Effects of hemorrhage on regional blood flow distribution in dogs and primates. Journal of Clinical Investigation, 54, 225-235.
71. Vetrugno, R., Liguori, R., Cortelli, P., & Montagna, P. (2003). Sympathetic skin response: Basic mechanisms and clinical applications. Clinical Autonomic Research, 13, 256-270.
72. Vianna, D. M. L., & Carrive, P. (2005). Changes in cutaneous and body temperature during and after conditioned fear to context in the rat. European Journal of Neuroscience, 21, 2505-2512.
73. Winkielman, P., & Berridge, K. C. (2003). What is an unconscious emotion? (The case of unconscious "liking"). Cognition and Emotion, 17, 181-211.
74. Winkielman, P., & Berridge, K. C. (2004). Unconscious emotion. Current Directions in Psychological Science, 13, 120-123.
75. Zhao, Z., & Davis, M. (2004) Fear-potentiated startle in rats is mediated by neurons in the deep layers of the superior colliculus/deep mesencephalic nucleus of the rostral midbrain through the glutamate non-NMDA receptors. Journal of Neuroscience, 24, 10326-10334.
76. Zhu, Z., Tsiamyrtzis, P., & Pavlidis, I. (2007). Forehead thermal signature extraction in lie detection. IEEE Engineering in Medicine and Biological Society, 243-246. doi: 10.1109/IEMBS.2007.4352269