Optical computer recognition of facial expressions associated with stress induced by performance demands

Aviation Space and Environmental Medicine

Volumn 76, Issue 6 SUPPL., 2005, Pages

  Dinges, David F ^a   Rider, Robert L ^a   Dorrian, Jillian ^a   McGlinchey, Eleanor L ^a   Rogers, Naomi L ^a   Cizman, Ziga ^a   Goldenstein, Siome K ^b   Vogler, Christian ^b   Venkataraman, Sundara ^b   Metaxas, Dimitris N ^b  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

^b Rutgers University School of Medicine   (United States)

Author keywords

Astronauts; Computer vision; Cortisol; Heart rate; Human face; Markov models; Optical computer recognition; Performance; Stress; Workload

Indexed keywords

HYDROCORTISONE;

ALEXITHYMIA; ALGORITHM; AUTOMATION; COMPUTER ANALYSIS; COMPUTER MODEL; CONFERENCE PAPER; EYEBROW; FACIAL EXPRESSION; HEAD MOVEMENT; HEART RATE; HUMAN; MOOD; PERSONALITY TEST; PROBABILITY; QUESTIONNAIRE; SALIVA ANALYSIS; SELF REPORT; SOCIAL ASPECT; STRESS; TASK PERFORMANCE; VIDEORECORDING; WORKLOAD;

NASA DISCIPLINE SPACE HUMAN FACTORS; NON-NASA CENTER;

ADULT; ALGORITHMS; ASTRONAUTS; BEHAVIORAL RESEARCH; DIAGNOSIS, COMPUTER-ASSISTED; EMOTIONS; FACIAL EXPRESSION; FEEDBACK; FEMALE; HUMANS; MALE; MENTAL HEALTH; PATTERN RECOGNITION, AUTOMATED; QUESTIONNAIRES; STRESS, PSYCHOLOGICAL; TASK PERFORMANCE AND ANALYSIS; TIME FACTORS;

EID: 20144374663     PISSN: 00956562     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (78)

1. Baddeley A. A 3-min reasoning task based on grammatical transformation. Psychonomic Science 1968; 10:341-2.
2. Bartlett MS, Hager JC, Ekman P, Sejnowski TJ. Measuring facial expressions by computer image analysis. Psychophysiology 1999; 36:253-63.
3. Beck AT, Steer RA. Internal consistencies of the original and revised Beck Depression Inventory. J Clin Psychol 1984; 40: 1365-7.
4. Bharatkumar AG, Daigle KE, Pandy MF, et al. Lower limb kinematics of human walking with the medial axis transformation. Proceedings of the IEEE Workshop on Motion of Non-Rigid and Articulated Objects; 11-12 Nov 1994; Austin, TX. New York: IEEE; 1994.
5. Bregler C, Malik J. (1998) Tracking people with twists and exponential maps. In: Proceedings of the IEEE Computer Society on Computer Vision and Pattern Recognition CVPR'98; 23-25 January 1998; Santa Barbara, CA. Washington, DC: IEEE Computer Society; 1998.
6. Burgess PW, Shallice T. Response suppression, initiation and strategy use following frontal lobe lesions. Neuropsychologia 1996; 34:263-73.
7. Burrough B. Dragonfly: NASA and the crisis aboard Mir. New York: Harper Collins; 1998.
8. Buysse DJ, Reynolds CF 3rd, Monk TH, et al. The Pittsburgh sleep quality index: a new instrument for psychiatric practice and research. Psychiatry Res 1989; 28:193-213.
9. Carver CS, Scheier MF, Weintraub JK. Assessing coping strategies: a theoretically based approach. J Pers Soc Psychol 1989; 56:267-83.
10. Cohen S, Williamson GM. Perceived stress in a probability sample of the United States. Beverly Hills, CA: Sage; 1988.
11. Coss RG. The cut-off hypothesis: its relevance to the design of public places. Man-Environment Systems 1973; 3:417-40.
12. Crowne DP, Marlowe D. A new scale of social desirability independent of psychopathology. J Consult Psychol 1960; 24:349-54.
13. Culbertson F. Testimony before the Committee on Science, U.S. House of Representatives; September 1997; 18:1997.
14. Darwin C. The expression of emotions in man and animals. New York: Oxford University Press; 1872/1998.
15. DeCarlo D, Meataxas D, Stone M. An anthropometric face model using variational techniques. Proceedings of ACM SIG-GRAPH; 19-24 Jul 1998; Orlando, FL. New York: ACM; 1998.
16. DeCarlo D, Metaxas D. The integration of optical flow and deformable models with applications to human face shape and motion estimation. Proceedings of the IEEE Computer Society on Computer Vision and Pattern Recognition, CVPR'96; 18-20 June 1996; San Francisco, CA. Washington, DC: IEEE Computer Society; 1996.
17. DeCarlo D, Metaxas D. Deformable model-based shape and motion analysis from images using motion residual error. Proceedings of the IEEE Sixth International Conference on Computer Vision; 4-7 Jan 1998; Bombay, India. New York: IEEE; 1998.
18. DeCarlo D, Metaxas D. Combining information using hard constraints. Proceedings of the IEEE Computer Society on Computer Vision and Pattern Recognition, CVPR'99; 23-25 January 1999; Ft. Collins, CO. Washington, DC: IEEE Computer Society; 1999.
19. DeCarlo D, Metaxas, D. Optical flow constraints on deformable models with applications to face tracking. International Journal of Computer Vision 2000; 32:99-127.
20. Dinges DF, Kribbs NB, Bates BL, Carlin MM. A very brief probed-recall memory task: Sensitivity to sleep loss. Sleep Res 1993; 22:330.
21. Dinges DF, Orne EC, Evans FJ, Orne MT. Performance after naps in sleep conducive and alerting environments. In: Johnson LC, Tepas DI, Colquhoun WP, Colligan MJ, eds. Biological rhythms, sleep and shift work. Advances in sleep research. New York: Spectrum Publications 1981; 7:539-52.
22. Dinges DF, Kribbs NB. Performing while sleepy: effects of experimentally-induced sleepiness. In: Monk TH, ed. Sleep, sleepiness and performance. Chichester: John Wiley & Sons; 1991: 97-128.
23. Dinges DF, Powell JW. Microcomputer analyses of performance on a portable, simple visual RT task during sustained operations. Behav Res Methods Instrum Comput 1985; 17:652-5.
24. Dinges DF. Probing the limits of functional capability: the effects of sleep loss on short-duration tasks. In: Broughton RJ, Ogilvie RD, eds. Sleep, arousal, and performance. Boston: Birkhäuser; 1992:177-88.
25. Ekman P, Davidson RJ, Friesen WV. The Duchenne smile: emotional expression and brain physiology II. J Pers Soc Psychol 1990; 58:342-53.
26. Ekman P, Friesen W. Facial action coding system (investigator's guide). Palo Alto, CA: Consulting Psychologists Press, Inc.; 1978.
27. Ekman P. Facial expressions of emotion: an old controversy and new findings. Philos Trans R Soc Lond B Biol Sci 1992; 335: 63-9.
28. Ellis SR. Collision in space. Ergon Des 2000; 8:4-9.
29. Elsmore TF. Synwork1: a PC-based tool for assessment of performance in a simulated work environment. Behav Res Methods Instrum Comput 1994; 26:421-6.
30. Essa I, Pentland AP. Facial expression recognition using a dynamic model and motion energy. Proceedings of the IEEE Fifth International Conference on Computer Vision, ICCV'95; 20-23 June 1995; Boston, MA. New York: IEEE; 1995.
31. Essa I, Pentland AP. Coding, analysis, interpretation and recognition of facial expressions. IEEE PAMI 1997; 19:757-63.
32. Fua PV, Ledere YG. Object-centered surface reconstruction: combining multi-image stereo and shading. IJCV 1995; 16:35-56.
33. Gavrilla DM, Davis LS. Towards 3-D model-based tracking and recognition of human movement. Proceedings of the IEEE International Workshop on Face and Gesture Recognition; June 1994; Zurich, Switzerland. New York: IEEE; 1995.
34. Goldenstein S, Vogler C, Metaxas D. Statistical cue integration in DAG deformable models. IEEE Transactions on Pattern Analysis and Machine Intelligence 2003; 25:801-13.
35. Horne JA, Ostberg O. A self-assessment questionnaire to determine morningness-eveningness in human circadian rhythms. Int J Chronobiol 1976; 4:97-110.
36. Jebara T, Pentland AP. Parametrized structure from motion for 3D adaptive feedback tracking of faces. Proceedings of the IEEE Fifth International Conference on Computer Vision CVPR'97; 17-19 June 1997; San Juan, Puerto Rico. New York: IEEE; 1997.
37. Kakadiaris IA, Metaxas D. 3D human body model acquisition from multiple views. The IEEE Fifth International Conference on Computer Vision; 20-23 June 1995; Boston, MA. New York: IEEE; 1995.
38. Kakadiaris IA, Metaxas D. Model-based estimation of 3D human motion with occlusion based on active multi-viewpoint selection. The IEEE Computer Society Conference on Computer Vision and Pattern Recognition; 18-20 June 1996; San Francisco, CA. Washington, DC: IEEE Computer Society; 1996.
39. Kakadiaris IA, Metaxas D, Bajcsy R. Inferring object structure in 2D from the deformation of apparent contours. Journal of Computer Vision and Image Understanding 1997; 65:129-47.
40. Kakadiaris IA, Metaxas D. Model based estimation of 3D human motion with occlusion based on active multi-viewpoint selection. IEEE Transactions on Pattern Analysis and Machine Intelligence 2000; 22:1453-9.
41. Kanade T, Cohn JF, Tian Y. Comprehensive database for facial expression analysis. The 4th IEEE International Conference on Automatic Face and Gesture Recognition (FG'00); 28-30 Mar 2000; Grenoble, France. New York: IEEE; 2000.
42. Kanas N, Salnitskiy V, Grund E, et al. Social and cultural issues during Shuttle/MIR space missions. 50th International Astronautical Congress; 4-8 Oct 1999; Amsterdam, The Netherlands. Paris, France: IAF; 1999.
43. Kanas N. Psychiatric issues affecting long duration space missions. Aviat Space Environ Med 1998; 69:1211-6.
44. Kano M, Fukudo S, Gyoba J, et al. Specific brain processing of facial expressions in people with alexithymia: an H2 15O-PET study. Brain 2003; 126:1474-84.
45. Keltner D, Eckman P, Gonzaga GC, Beer J. Facial expression of emotion. In: Davidson RJ, Scherer KR, Goldsmith HH, eds. Handbook of affective sciences. New York: Oxford University Press; 2003:415-32.
46. Keltner D, Ekman P. Introduction: expression of emotion. In: Davidson RJ, Scherer KR, Goldsmith HH, eds. Handbook of affective sciences. New York: Oxford University Press; 2003: 411-4.
47. Lane RD, Reiman EM, Bradley MM, et al. Neuroanatomical correlates of pleasant and unpleasant emotion. Neuropsychologia 1997; 35:1437-44.
48. Lanitis A, Taylor CJ, Cootes TF. A unified approach for coding and interpreting face images. Proceedings of the IEEE Fifth International Conference on Computer Vision, ICCV '95; 20-23 June 1995; Boston, MA. New York: IEEE; 1995.
49. Lanitis A, Taylor CJ, Cootes TF. Automatic interpretation and coding of face images using flexible models. IEEE Transactions on Pattern Analysis and Machine Intelligence 1997; 19:743-56.
50. Leung MK, Yang YH. An empirical approach to human body analysis. Technical Report. Saskatoon, Saskatchewan, Canada: University of Sasketchewan; 1994.
51. Li H, Roivanen P, Forchheimer R. 3-D motion estimation in model-based facial image coding. IEEE Transactions on Pattern Analysis and Machine Intelligence 1993; 15:545-56.
52. Linenger JM. Off the planet. New York: McGraw Hill; 2000.
53. Marsh AA, Elfenbein HA, Ambady N. Nonverbal "accents": cultural differences in facial expressions of emotion. Psychol Sci 2003; 14:373-6.
54. McNair DM, Lorr M, Droppleman LF. EITS manual for the profile of mood states. San Diego: Educational and Industrial Testing Service; 1971.
55. Meyer TJ, Miller ML, Metzger RL, Borkovec TD. Development and validation of the Perm State worry questionnaire. Behav Res Ther 1990; 28:487-95.
56. Millon T. A theoretical derivation of pathological personalities. In: Millon T, Klerman G, eds. Contemporary directions in psychopathology. New York: Guilford; 1986.
57. Niller E. "The right stuff" may no longer be the best stuff for inhabitants of new space station. The Boston Globe; April 4, 2000:E4.
58. Rehg JM, Kanade T. Visual tracking of high DOF articulated structures: an application to human hand tracking. Third European Conference on Computer Vision; 2-6 May 1994; Stockholm, Sweden. New York: Springer-Verlag; 1994.
59. Rehg JM, Kanade T. Model-based tracking of self-occluding articulated objects. Proceedings of the Fifth IEEE International Conference on Computer Vision ICCV'95; 20-23 June 1995; Boston, MA. New York: IEEE; 1995.
60. Reiman EM, Lane RD, Ahern GL, et al. Neuroanatomical correlates of externally and internally generated human emotion. Am J Psychiatry 1997; 154:918-25.
61. Rohr K. Towards model-based recognition of human movements in image sequences. Computer Vision, Graphics, and Image Processing: Image Understanding 1994; 59:94-115.
62. Rotter JB. Generalized expectancies for internal versus external control of reinforcement. Psychol Monogr 1966; 80:609.
63. Samaras D, Metaxas D, Fua P, Leclerc YG. Variable albedo surface reconstruction from stereo and shape from shading. Proceedings of the IEEE Computer Society on Computer Vision and Pattern Recognition CVPR'00; 13-15 June 2000; Hilton Head, SC. Washington, DC: IEEE Computer Society; 2000.
64. Scheier MF, Carver CS. Optimism, coping, and health: assessment and implications of generalized outcome expectancies. Health Psychol 1985; 4:219-47.
65. Schmidt K, Cohn JF, Tian YL. Signal characteristics of spontaneous facial expressions: automatic movement in solitary and social smiles. Biological Psychology; 2003;65:49-66.
66. Simpson S. Staying sane in space. Sci Am 2000; 282:61-2.
67. Sminchisescu C, Metaxas D, Dickinson S. Improving the scope of deformable model shape and motion estimation. Proceedings of the IEEE Computer Society on Computer Vision and Pattern Recognition CVPR'01; 10-14 Dec 2001; Lihue, HI. Washington, DC: IEEE Computer Society; 2001.
68. Spielberg CD, Gorsuch RL, Lushene RE. Manual for the state-trait anxiety inventory. Palo Alto, CA: Consulting Psychologists Press; 1970.
69. Stroop JR. Studies of interference in serial verbal reactions. J Exp Psychol 1935; 18:643-62.
70. Sutton SK, Davidson RJ, Donzella B, et al. Manipulating affective state using extended picture presentations. Psychophysiology 1997; 34:217-26.
71. Taylor GJ, Ryan D, Bagby RM. Toward the development of a new self-report alexithymia scale. Psychother Psychosom 1985; 44: 191-9.
72. Thorne DR, Genser SG, Sing GC, Hegge FW. The Walter Reed: performance assessment battery. Neurobehav Toxicol Teratol 1985; 7:415-8.
73. Turk M, Pentland AP. Eigenfaces for recognition. J Cogn Neurosci 1991; 3:71-86.
74. Vogler C, Metaxas D. ASL recognition based on a coupling between HMMs and 3D motion analysis. Proceedings of the IEEE International Conference on Computer Vision, ICCV'98; 4-7 Jan 1998; Bombay, India. New York: IEEE; 1998.
75. Vogler C, Metaxas D. Parallel hidden Markov models for American sign language recognition. Proceedings of the IEEE International Conference on Computer Vision, ICCV'99; 20-25 Sept 1999; Kerkyra, Greece. New York: IEEE; 1999.
76. Vogler C, Metaxas D. Toward scalability in ASL recognition: breaking down signs into phonemes. Proceedings of the International Gesture Workshop, GW'99; 17-19 Mar 1999; Gif-sur-Yvette, France. Paris, France: Springer-Verlag; 1999.
77. Vogler C, Metaxas D. Adapting hidden Markov models for ASL recognition by using three-dimensional computer vision methods. Proceedings of the IEEE Conference on Systems, Man and Cybernetics, 12-15 October 1997; Orlando, FL. New York: IEEE; 1997:156-61.
78. Yacoob Y, Davis LS. Recognizing human facial expressions from, long image sequences using optical flow. IEEE Transactions on Pattern Analysis and Machine Intelligence 1996; 18:638-42.