Interacting with human physiology

Computer Vision and Image Understanding

Volumn 108, Issue 1-2, 2007, Pages 150-170

  Pavlidis, I ^a   Dowdall, J ^a   Sun, N ^a   Puri, C ^a   Fei, J ^a   Garbey, M ^a  

^a University of Houston   (United States)

Author keywords

Blood flow; Breath rate; Cardiac pulse; Facial tracking; Human computer interaction; Sleep apnea; Stress; Thermal imaging

Indexed keywords

COMPUTER PERIPHERAL EQUIPMENT; FACE RECOGNITION; INFRARED IMAGING; INTERFACES (COMPUTER); MATHEMATICAL MODELS; PHYSIOLOGY;

BLOOD FLOW; BREATH RATE; CARDIAC PULSE; FACIAL TRACKING; SLEEP APNEA;

HUMAN COMPUTER INTERACTION;

EID: 34548282008     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2006.11.018     Document Type: Article

References (53)

1. FLIR Systems, 70 Castilian Dr., Goleta, California 93117. Available from: .
2. I. Pavlidis, J. Levine, Monitoring of periorbital blood flow rate through thermal image analysis and its application to polygraph testing, in: Proceedings of the 23rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society, vol. 3, Istanbul, Turkey, 2001, pp. 2826-2829.
3. M. Garbey, A. Merla, I. Pavlidis, Estimation of blood flow speed and vessel location from thermal video, in: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, Washington D.C., 2004, pp. 356-363.
4. N. Sun, M. Garbey, A. Merla, I. Pavlidis, Imaging the cardiovascular pulse, in: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, CA, 2005.
5. 2 absorption band, in: Proceedings of the 27th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Shanghai, China, 2005.
6. P. Tsiamyrtzis, J. Dowdall, D. Shastri, I. Pavlidis, M. Frank, P. Ekman, Lie detection-recovery of the periorbital signal through tandem tracking and noise suppression in thermal facial video, in: E. Carapezza (ed.), Proceedings of SPIE Sensors, and Command, Control, Communications, and Intelligence (C3I) Technologies for Homeland Security and Homeland Defense IV, vol. 5778, Orlando, FL, 2005.
7. I. Pavlidis, Continuous physiological monitoring, in: Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, vol. 2, Cancun, Mexico, 2003, pp. 1084-1087.
8. I. Pavlidis, J. Levine, P. Baukol, Thermal image analysis for anxiety detection, in: Proceedings of the 2001 IEEE International Conference on Image Processing, vol. 2, Thessaloniki, Greece, 2001, pp. 315-318.
9. Levine J., Pavlidis I., and Cooper M. The face of fear. The Lancet 357 9270 (2001) 1757
10. Pavlidis I., Eberhardt N., and Levine J. Human behavior: seeing through the face of deception. Nature 415 6867 (2002) 35
11. C. Puri, L. Olson, I. Pavlidis, J. Levine, J. Starren, Stresscam: non-contact measurement of users' emotional states through thermal imaging, in: Proceedings of the 2005 ACM Conference on Human Factors in Computing Systems (CHI), Portland, OR, 2005, pp. 1725-1728.
12. Yang M., Kriegman D., and Ahuja N. Detecting faces in images: a survey. IEEE Transactions on Pattern Analysis and Machine Intelligence 24 1 (2002) 34-58
13. C. Eveland, D. Socolinsky, L. Wolff, Tracking human faces in infrared video, in: Proceedings 2001 IEEEWorkshop on Computer Vision Beyond the Visible Spectrum: Methods and Applications, Kauai, HI, 2001.
14. Fujimasa I., Chinzei T., and Saito I. Converting far infrared image information to other physiological data. IEEE Engineering in Medicine and Biology Magazine 19 (2000) 71-76
15. Keyserlingk J., Ahlgren P., Yu E., Belliveau N., and Yassa M. Functional infrared imaging of the breast. IEEE Engineering in Medicine and Biology Magazine 19 (2000) 30-41
16. Head J., Wang F., Lipari C., and Elliot R. The important role of infrared imaging in breast cancer. IEEE Engineering in Medicine and Biology Magazine 19 (2000) 52-57
17. J. Keyserlingk, P. Ahlgren, M. Yassa, N. Belliveau, Functional infrared imaging as part of a multi-imaging strategy for breast cancer detection and therapeutic monitoring, in: The Second Joint EMBS-BMES Conference, Houston, TX, 2002.
18. A. Boyd, S. Maloney, Digital infrared thermal imaging as biofeedback tool: Monitoring chemotherapy response in a young female with breast cancer mediastinal secondaries, in: The Second Joint EMBS-BMES Conference, Houston, TX, 2002.
19. M. Frize, C. Herry, R. Roberge, Processing of thermal images to detect breast cancer: Comparison with previous work, in: The Second Joint EMBS-BMES Conference, Houston, TX, 2002.
20. Anbar M., Brown C., Milescu L., Babalola J., and Gentner L. The potential of dynamic area telethermometry in assisting breast cancer. IEEE Engineering in Medicine and Biology Magazine 19 (2000) 58-62
21. H. Qi, P. Kuraganti, Z. Liu, Early detection of breast cancer using thermal texture maps, in: 2002 IEEE International Symposium on Biomedical Imaging: Macro to Nano, Washington D.C., 2002.
22. M. Partinen, J. Alihanka, J. Hasan, Detection of sleep apneas by the static chargesensitive bed, in: Proceedings of the 6th European Congress on Sleep Research, Zurich, Switzerland, 1982.
23. K. Nepal, E. Biegeleisen, T. Ning, Apnea detection and respiration rate estimation through parametric modeling, in: Proceedings of the 28th IEEE Annual Northeast Bioengineering Conference, Philadelphia, PA, 2002.
24. Shukla H., James E., and Schutz J. Window to the heart: the value of a native and paced qrs duration. current perspective and review. Journal of Interventional Cardiac Electrophysiology: An International Journal of Arrhythmias and Pacing 9 3 (2003) 333-342
25. Schulze-Bahr E., Mnnig G., and Eckardt L. The long qt syndrome: considerations in the athletic population. Current Sports Medicine Reports 2 2 (2003) 72-78
26. Sybrandy K., Cramer M., and Burgersdijk C. Diagnosing cardiac contusion: old wisdom and new insights. Heart 89 5 (2003) 485-489
27. Shneiderman B. Leonardo's Laptop (2002), The MIT Press, Cambridge, MA
28. Hayes-Roth B., Ball G., Lisetti C., Picard R., and Stern A. Panel on affect and emotion in the user interface. Proceedings of the 3rd International Conference on Intelligent User Interfaces (1998), ACM Press, NY, UsSA 91-94
29. Marcus A. The emotion commotion. Interactions 10 6 (2003) 28-34
30. Picard R. Perceptual user interfaces: affective perception. Communications of ACM 43 3 (2000) 50-51
31. Klein J., Moon Y., and Picard R. This computer responds to user frustration. Interacting with Computers 14 (2002) 119-140
32. Picard R., and Klein J. Computers that recognise and respond to user emotion: Theoretical and practical implications. Interacting with Computers 14 (2002) 141-169
33. Artz J.M. The role of emotion in reason: and its implications for computer ethics. SIGCAS Computer Society 30 1 (2000) 14-16
34. Norman D. Emotion & design: attractive things work better. Interactions 9 4 (2002) 36-42
35. Picard R.W. Affective medicine: Technology with emotional intelligence. In: Bushko R.G. (Ed). Future of Health Technology, vol. 80 of Studies in Health Technology and Informatics (2002), IOS Press, Amsterdam, The Netherlands
36. Nakatsu R., Nicholson J., and Tosa N. Emotion recognition and its application to computer agents with spontaneous interactive capabilities. Proceedings of the Seventh ACM International Conference on Multimedia (Part 1) (1999), ACM Press, NY, USA 343-351
37. Lisetti C., and Nasoz F. Maui: a multimodal affective user interface. Proceedings of the 10th ACM International Conference on Multimedia (2002), ACM Press, NY, USA 161-170
38. Scheirer J., Fernandez R., Klein J., and Picard R. Frustrating the user on purpose: a step toward building an affective computer. Interacting with Computers 14 (2002) 93-118
39. Project Cyborg. Available from: .
40. Pavlidis I., and Levine J. Thermal image analysis for polygraph testing. IEEE Engineering in Medicine and Biology Magazine 21 6 (2002) 56-64
41. Werner J., and Buse M. Temperature profiles with respect to inhomogeneity and geometry of the human body. Journal of Applied Physiology 65 3 (1988) 1110-1118
42. Vasamed, 7615 Golden Triangle Drive, Eden Prairie, Minnesota 55344. Available from: .
43. Press W., Teukolsky S., Vetterling W., and Flannery B. Numerical Recipes in C. second ed. (1992), Cambridge University Press, New York pp. 504-521
44. Charkoudian N. Skin blood flow in adult human thermoregulation. Mayo Clinic Proceedings 78 (2003) 603-612
45. ADInstruments, 2205 Executive Circle, Colorado Springs, Colorado 80906. Available from: .
46. Pearson K. Mathematical contributions to the theory of evolution. III. Regression, heredity and panmixia. Philosophical Transactions of the Royal Society of London. Series A 187 (1896) 253-318
47. Lindemann J., Leiacker R., Rettinger G., and Keck T. Nasal mucosal temperature during respiration. Clinical Otolaryngology 27 (2002) 135-139
48. Zhang Y. Quantitative measurement of radiation properties for opaque and semitransparent greybodies. Infrared Physics 30 2 (1990) 149-153
49. D. Olson, Computerized stroop ver. 1.0, Rochester, Minnesota (2004).
50. Stroop J. Studies of interference in serial verbal reactions. Journal of Experimental Psychology 18 (1935) 643-662
51. Seematter G., Dirlewanger M., Rey V., Schneiter P., and Tappy L. Metabolic effects of mental stress during over and underfeeding in healthy women. Obesity Research 10 (2002) 49-55
52. Ekman P. The face of man. Expressions of universal emotions in a New Guinea village (1980), Garland STMP Press, New York and London
53. C. Reynolds, R. Picard, Affective sensors, privacy, and ethical concerns, in: CHI2004, Vienna, Austria, 2004.