Facial expression classification using PCA and hierarchical radial basis function network

Journal of Information Science and Engineering

Volumn 22, Issue 5, 2006, Pages 1033-1046

  Lin, Daw Tung ^a  

^a NATIONAL TAIPEI UNIVERSITY   (Taiwan)

Author keywords

Facial expression classification; Hierarchical radial basis function network; Intelligent human computer interaction; Local features; Principal component analysis

Indexed keywords

FACIAL EXPRESSION CLASSIFICATION; HIERARCHICAL RADIAL BASIS FUNCTION NETWORKS; INTELLIGENT HUMAN-COMPUTER INTERACTION; LOCAL FEATURES;

CLASSIFICATION (OF INFORMATION); COGNITIVE SYSTEMS; FEATURE EXTRACTION; HUMAN COMPUTER INTERACTION; PRINCIPAL COMPONENT ANALYSIS; RADIAL BASIS FUNCTION NETWORKS;

FACE RECOGNITION;

EID: 33749575351     PISSN: 10162364     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (40)

1. Z. Duric, W. Gray, R. Heishman, F. Li, A. Rosenfeld, M. Scholles, C. Schunn, and H. Wechsler, "Integrating perceptual and cognitive modeling for adaptive and intelligent human computer interaction," in Proceedings of the IEEE, Vol. 90, 2002, pp. 1272-1289.
2. M. Bartlett, P. Viola, T. Sejowski, L. Larsen, J. Hager, and P. Ekman, "Classifying facial action," in M. Mozer, D. S. Touretzky, and M. Hasselmo, (eds.), Advances in Neural Information Processing Systems, Vol. 8, The MIP Press, 1996, pp. 823-829.
3. A. Colmenarez, B. Frey, and T. S. Huang, "Embedded face and facial expression recognition," in Proceedings of the International Conference on Image Processing, Vol. 1, 1999, pp. 633-637.
4. I. Essa and A. Pentland, "Coding, analysis, interpretation, and recognition for facial expressions," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 19, 1997, pp. 757-763.
5. T. Kurozumi, Y. Shinza, Y. Kenmochi, and K. Kotani, "Facial individuality and expression analysis by eigenspace method based on class features or multiple discriminant analysis," in Proceedings of the International Conference on Image Processing, Vol. 1, 1999, pp. 648-652.
6. K. Mase, "Recognition of facial expression from optical flow," IEICE Transactions, Vol. E74, 1991, pp. 3474-3483.
7. K. Mase, "Recognizing multiple persons' facial expressions using HMM based on automatic extraction of significant frames from image sequences," in Proceedings of the International Conference on Image Processing, Vol. 2, 1997, pp. 546-549.
8. M. Rosenblum, Y. Yacoob, and L. Davis, "Human emotion recognition from motion using a radial basis function network architecture," in Proceedings of the IEEE Workshop on Motion of Non-Rigid and Articulated Objects, 1994, pp. 43-49.
9. M. Rosenblum, Y. Yacoob, and L. Davis, "Human expression recognition from motion using a radial basis function network architecture," IEEE Transactions on Neural Networks, Vol. 7, 1996, pp. 1121-1138.
10. Y. L. Tian, T. Kanade, and J. Conn, "Recognizing action units for facial expression analysis," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 23, 2001, pp. 97-115.
11. Y. Yacoob and L. Davis, "Recognizing human facial expression from long image sequences using optical flow," IEEE Transactions on Annual Machine Intelligence, Vol. 16, 1994, pp. 636-642.
12. Y. Yacoob, H. M. Lam, and L. S. Davis, "Recognizing faces showing expressions," in Proceedings of the International Workshop on Automatic Face and Gesture Recognition, 1995, pp. 278-283.
13. D. Yang, T. Kunkhiro, H. Shimoda, and H. Yoshikawa, "A study of real-time image processing method for treating human emotion by facial expression," in Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, Vol. 2, 1999, pp. 360-364.
14. P. Ekman and W. Friesen, The Facial Action Coding System, Consulting Psychologists Press, Palo Alto, CA, 1965.
15. G. Donato, M. Bartlett, J. Hager, P. Ekman, and T. Sejnowski, "Classifying facial actions," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 21, 1999, pp. 974-989.
16. X. W. Chen and T. Huang, "Facial expression recognition: a clustering-based approach," Pattern Recognition Letter, Vol. 24, 2003, pp. 1295-1302.
17. G. Cottrell and J. Metcalfe, "EMPATH: face, gender, and emotion recognition using noons," in J. Moddy, R. P. Lippman, and D. S. Touretzky, (eds.), Advances in Neural Information Processing Systems, Vol. 3, 1991, pp. 564-571.
18. C. Padgett and G. Cottrel, "Identifying emotion in static face images," in The Second Joint Symposium of Neural Computation, Vol. 5, 1995, pp. 91-101.
19. K. Matsuno, C. Lee, and S. Tsuji, "Recognition of human facial expressions without feature extraction," in Proceedings of the European Conference on Computer Vision, 1994, pp. 513-520.
20. L. Ma and K. Khorasani, "Facial expression recognition using constructive feedforward neural network," IEEE Transactions on Systems, Man, and Cybernetics - Part B: Cybernetics, Vol. 34, 2004, pp. 1588-1559.
21. M. Lyons, J. Budynek, and S. Akamatsu, "Automatic classification of single facial images," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 21, 1999. pp. 1357-1362.
22. K. Matsuno and S. Tsuji, "Recognizing human facial expressions in a potential field," in Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 2, 1994, pp. 44-49.
23. Y. Shinza, Y. Saito, Y. Kenmochi, and K. Kotani, "Facial expression analysis by integrating information of feature-point positions and gray levels of facial images," in Proceedings of the IEEE International Conference on Image Processing, Vol. 1, 2000. pp. 466-469.
24. S. Carey and R. Dimond, "From piecemeal to configurational representation of faces," Science, Vol. 195, 1997, pp. 312-313.
25. A. Lanitis, C. Taylor, and T. Cootes, "Automatic interpretation and coding of face images using flexible models," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 19, 1997, pp. 743-756.
26. M. Turk and A. Pentland, "Eigenfaces for recognition," Journal of Cognitive Neuroscience, Vol. 19, 1997, pp. 743-756.
27. P. Belhumeur, J. Hespanha, and D. Kriegman, "Eigenfaces vs. fisherface: recognition using class specific linear projection," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 19, 1997, pp. 711-720.
28. S. Haykin, Neural Networks: A Comprehensive Foundation, Macmillan College Publishing Company, New York, 1994.
29. H. Abdi, D. Valentin, and A. J. O'Toole, "A generalized auto-associator model for face processing and sex categorization: from principal components to multivariate analysis," in D. Levine, (ed.), Optimality in Biological and Artificial Networks, 1996, pp. 317-337.
30. M. Turk and A. Pentland, "Eigenfaces for recognition," Journal of Cognitive Neuroscience, Vol. 3, 1991, pp. 71-86.
31. M. Fleming and G. Cottrell, "Categorization of faces using unsupervised feature extraction," in Proceedings of the International Joint Conference on Neural Networks, Vol. 2, 1990, pp. 65-70.
32. T. Kohonen, E. Oja, and P. Lehtio, "Storage and processing of information in distributed associative memory systems," in G. E. Hinton and J. A. Anderson, (eds.), Parallel Models of Associative Memory, 1981, pp. 105-143.
33. S. Lawrence, C. L. Giles, A. C. Tsoi, and A. D. Back, "Face recognition: a hybrid neural network approach," Technical Report, No. UMIACS-TR-96-16, Institute for Advanced Computer Studies, University of Maryland, College Park, 1996.
34. M. Er, S. Wu, J. Lu, and H. Toh, "Face recognition with radial basis function neural networks," IEEE Transactions on Neural Networks, Vol. 13, 2002, pp. 697-710.
35. T. J. Stonham, "Practical face recognition and verification with WIZARD," in H. Ellis, M. Jeevs, F. Newcombe, and A. Young, (eds.), Aspects of Face Processing, 1986, pp. 426-441.
36. M. Yoneyama, A. Ohtake, Y. Iwano, and K. Shirai, "Facial expressions recognition using discrete Hopfield neural network," in Proceedings of the International Conference on Image Processing, Vol. 1, 1997, pp. 117-120.
37. M. Knapp and J. Hall, Nonverbal Communication in Human Interaction, Harcourt Brace Jovanovich, New York, 1997.
38. P. Ekman and W. Friesen, Unmaking the Face, Prentice-Hall, Englewood Clifs, New Jersey, 1975.
39. Advanced Multimedia Processing Lab., Carnegie Mellon University, http://amp.ece.cmu.edu/projcets/faceauthentication/download.htm.
40. P. Ekman and W. V. Friesen, "Pictures of facial affect," Human Interaction Laboratory, University of California Medical Center, San Francisco, 1976.