Automatic recognition of eye blinking in spontaneously occurring behavior

Behavior Research Methods, Instruments, and Computers

Volumn 35, Issue 3, 2003, Pages 420-428

  Cohn, Jeffrey F ^a,c   Xiao, Jing ^b   Moriyama, Tsuyoshi ^b   Ambadar, Zara ^a   Kanade, Takeo ^b  

^a UNIVERSITY OF PITTSBURGH   (United States)

^b CARNEGIE MELLON UNIVERSITY   (United States)

^c UNIVERSITY OF PITTSBURGH SCHOOL OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0346271798     PISSN: 07433808     EISSN: None     Source Type: Journal    
DOI: 10.3758/BF03195519     Document Type: Conference Paper

References (52)

1. BAKEMAN, R., & GOTTMAN, J. M. (1986). Observing behavior: An introduction to sequential analysis. Cambridge: Cambridge University Press.
2. BARTLETT, M. S., BRAATHEN, B., LITTLEWORT, G., SEJNOWSKI, T. J., & MOVELLAN, J. R. (2001). A comparative study of alternative FACS coding algorithms (Tech Rep. MPLAB-TR-2001-06). La Jolla: University of California at San Diego, Institute for Neural Computation.
3. BARTLETT, M. S., HAGER, J. C., EKMAN, P., & SEJNOWSKI, T. J. (1999). Measuring facial expressions by computer image analysis. Psychophysiology, 36, 253-263.
4. BLACK, M. (1992). Robust incremental optical flow. Unpublished doctoral dissertation, Yale University.
5. BRUCE, V., & YOUNG, A. ( 1998). In the eye of the beholder: The science of face perception. Oxford: Oxford University Press.
6. CAMPOS, J., BERTENTHAL, B., & KERMOIAN, R. (1992). Early experience and emotional development: The emergence of wariness of heights. Psychological Science, 3, 61-64.
7. CAMRAS, L. A., LAMBRECHT, L., & MICHEL, G. F. ( 1996). Infant "surprise" expressions as coordinative motor structures. Infant Behavior & Development, 20, 183-195.
8. COHN, J. P., & ELMORE, M. (1988). Effect of contingent changes in mothers' affective expression on the organization of behavior in 3-month-old infants. Infant Behavior & Development, 11, 493-505.
9. COHN, J. F., & SCHMIDT, K. (2003). The timing of facial motion in posed and spontaneous smiles. In Proceedings of the International Conference on Active Media Technology, 2, 57-72.
10. COHN, J. F., SCHMIDT, K., GROSS, R., & EKMAN, P. (2002). Individual differences in facial expression: Stability over time, relation to self-reported emotion, and ability to inform person identification. Proceedings of the International Conference on Multimodal User Interfaces, 4, 491-496.
11. COHN, J. F., TIAN, Y. L., & FORBES, E. (2000). Detection, tracking, and classification of facial action units in infant and caregiver facial expression [Abstract]. In Proceedings of the International Conference on Infant Studies.
12. COHN, J. F., ZLOCHOWER, A., LIEN, J., & KANADE, T. (1999). Automated face analysis by feature point tracking has high concurrent validity with manual FACS coding. Psychophysiology, 36, 35-43.
13. CRAIG, K. D., HYDE, S. A., & PATRICK, C. J. (1991). Genuine, suppressed and faked facial behavior during exacerbation of chronic low back pain. Pain, 46, 161-171.
14. DECARLO, D., & METAXAS, D. [N.] (1996). The integration of optical flow and deformable models with applications to human face shape and motion estimation. Proceedings of the IEEE Conference on Computer Vision & Pattern Recognition, 15, 189-195.
15. DONATO, G. L., BARTLETT, M. S., HAGER, J. C., EKMAN, P., & SEJNOWSKI, T. J. (1999). Classifying facial actions. IEEE Transactions on Pattern Analysis & Machine Intelligence, 21, 974-989.
16. EIBL-EIBESFELDT, I. (1989). Human ethology. Hawthorne, NY: Aldine de Gruyter.
17. EKMAN, P. (1982). Methods for measuring facial action. In K. R. Scherer & P. Ekman (Eds.), Handbook of methods in nonverbal behavior research (pp. 45-90). Cambridge: Cambridge University Press.
18. EKMAN, P. (1993). Facial expression and emotion. American Psychologist, 48, 384-392.
19. EKMAN, P. (2001). Telling lies. New York: Norton.
20. EKMAN, P., DAVIDSON, R. J., & FRIESEN, W. V. (1990). The Duchenne smile: Emotional expression and brain physiology II. Journal of Personality & Social Psychology, 58, 342-353.
21. EKMAN, P., & FRIESEN, W. (1978). Facial action coding system. Palo Alto, CA: Consulting Psychologists Press.
22. EMDE, R. N., GAENSBAUER, T. J., & HARMON, R. J. (1976). Emotional expression in infancy: A biobehavioral study (Psychological Issues, Vol. 10, No. 1). New York: International Universities Press.
23. ESSA, I., & PENTLAND, A. (1997). Coding, analysis, interpretation and recognition of facial expressions. IEEE Transactions on Pattern Analysis & Machine Intelligence, 7, 757-763.
24. Fox, N., & DAVIDSON, R. J. (1988). Patterns of brain electrical activity during facial signs of emotion in ten-month-old infants. Developmental Psychology, 24, 230-236.
25. FRANK, M., & EKMAN, P. ( 1997). The ability to detect deceit generalizes across different types of high-stake lies. Journal of Personality & Social Psychology, 72, 1429-1439.
26. FRIDLUND, A. J. (1994). Human facial expression: An evolutionary view. San Diego: Academic Press.
27. HOLLAND, M. K., & TARLOW, G. (1972). Blinking and mental load. Psychological Reports, 31, 119-127.
28. KANADE, T., COHN, J. F., & TIAN, Y. (2000). Comprehensive database for facial expression analysis. Proceedings of the IEEE Conference on Automatic Face and Gesture Recognition, 4, 46-53.
29. KARSON, C. N. (1988). Physiology of normal and abnormal blinking. Advances in Neurology, 49, 25-37.
30. KATSIKITIS, M., & PILOWSKY, I. (1988). A study of facial expression in Parkinson's disease using a novel microcomputer-based method. Journal of Neurology, Neurosurgery, & Psychiatry, 51, 362-366.
31. KRAUT. R. E., & JOHNSON, R. (1979). Social and emotional messages of smiling: An ethological approach. Journal of Personality & Social Psychology, 37, 1539-1553.
32. LIEN, J. J. J., KANADE, T., COHN, J. F., & LI, C. C. (2000). Detection, tracking, and classification of subtle changes in facial expression. Journal of Robotics & Autonomous Systems, 31, 131-146.
33. LIU, Y., SCHMIDT, K., COHN, J. F., & WEAVER, R. L. (2002). Human facial asymmetry for expression-invariant facial identification. Proceedings of the IEEE International Conference on Automatic Face & Gesture Recognition, 5, 208-214.
34. LUCAS, B. D., & KANADE, T. (1981). An iterative image registration technique with an application in stereovision. Proceedings of the International Joint Conference on Artificial Intelligence, 1, 674-679.
35. MARTIN, P., & BATESON, P. (1986). Measuring behavior: An introductory guide. Cambridge: Cambridge University Press.
36. MATIAS, R., COHN, J. F., & Ross, S. (1989). A comparison of two systems to code infants' affective expression. Developmental Psychology, 25, 483-489.
37. MOORE, G. A., COHN, J. F., & CAMPBELL, S. B. (1997). Mothers' affective behavior with infant siblings: Stability and change. Developmental Psychology, 33, 856-860.
38. PADGETT, C., COTTRELL, G. W., & ADOLPHS, B. (1996). Categorical perception in facial emotion classification. Proceedings of the Cognitive Science Conference, 18, 249-253.
39. PANTIC, M. (2002). Facial gesture recognition from static dual-view face images. Proceedings of the International Conference on Measuring Behavior, 4, 195-197.
40. POELMAN, C. J. (1995). The paraperspective and protective factorization methods for recovering shape and motion (Tech. Rep. CMU-CS-95-173). Pittsburgh: Carnegie Mellon University, Robotics Institute.
41. RINN, W. E. (1984). The neuropsychology of facial expression: A review of the neurological and psychological mechanisms for producing facial expressions. Psychological Bulletin, 95, 52-77.
42. ROWLEY, H. A., BALUJA, S., & KANADE, T. (1998). Neural network-based face detection. IEEE Transactions on Pattern Recognition & Machine Intelligence, 20, 23-38.
43. SAYETTE, M. A., COHN, J. F., WERTZ, J. M., PERROTT, M. A., & PARROTT, D. J. (2001). A psychometric evaluation of the facial action coding system for assessing spontaneous expression. Journal of Nonverbal Behavior, 25, 167-185.
44. SCHMIDT, K. L., & COHN, J. F. (2001). Human facial expressions as adaptations: Evolutionary questions in facial expression. Yearbook of Physical Anthropology, 44, 3-24.
45. SCHMIDT, K. L., & COHN, J. F. (in press). Signal characteristics of spontaneous facial expression: Automatic movement in solitary and social smiles. Biological Psychology.
46. TIAN, Y. L., KANADE, T., & COHN, J. F. (2000). Eye-state detection by local regional information. In T. Tan, Y. Shi, & W. Gao (Eds.), Advances in multimodal Interfaces: ICMI 2000 (pp. 143-150). New York: Springer-Verlag.
47. TIAN, Y. L, KANADE, T., & COHN, J. F. (2001). Recognizing action units for facial expression analysis. IEEE Transactions on Pattern Analysis & Machine Intelligence, 23, 97-116.
48. TIAN, Y. L., KANADE, T., & COHN, J. F. (2002), Evaluation of Gabor-wavelet-based facial action unit recognition in image sequences of increasing complexity. Proceedings of the IEEE International Conference on Automatic Face & Gesture Recognition, 5, 229-234.
49. VAN SWEARINGEN, J. M., COHN, J. F., & BAJAJ-LUTHRA, A. (1999). Specific impairment of smiling increases severity of depressive symptoms in patients with facial neuromuscular disorders. Journal of Aesthetic Plastic Surgery, 23, 416-423.
50. XIAO, J., KANADE, T., & COHN, J. F. (2002). Robust full motion recovery of head by dynamic templates and re-registration techniques. Proceedings of the IEEE International Conference on Automatic Face & Gesture Recognition, 5, 163-169.
51. YACOOB, Y., & DAVIS, L. (1997). Recognizing human facial expression from long image sequence using optical flow. IEEE Transactions on Pattern Recognition & Machine Intelligence, 18, 636-642.
52. ZLOCHOWER, A. (2001). Automated face analysis distinguishes deliberate from spontaneous smiles on the basis of quantitative differences in intensity and asymmetry. Unpublished doctoral dissertation, University of Pittsburgh.