Empath: A neural network that categorizes facial expressions

Journal of Cognitive Neuroscience

Volumn 14, Issue 8, 2002, Pages 1158-1173

  Dailey, Matthew N ^a   Cottrell, Garrison W ^a   Padgett, Curtis ^b   Adolphs, Ralph ^c  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

^c UNIVERSITY OF IOWA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; EMOTION; FACIAL EXPRESSION; HUMAN; MODEL; NERVE CELL NETWORK; PRIORITY JOURNAL; REACTION TIME; SCORING SYSTEM; THEORY; VISUAL SYSTEM;

DISCRIMINATION (PSYCHOLOGY); EMOTIONS; FACIAL EXPRESSION; FEAR; HAPPINESS; HUMANS; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER); RECOGNITION (PSYCHOLOGY);

EID: 0037111647     PISSN: 0898929X     EISSN: None     Source Type: Journal    
DOI: 10.1162/089892902760807177     Document Type: Article

References (53)

1. Beale, J., & Keil, F. (1995). Categorical effects in the perception of faces. Cognition, 57, 217-239.
2. Bell, A. J., & Sejnowski, T. J. (1995). An information-maximization approach to blind separation and blind deconvolution. Neural Computation, 7, 1129-1159.
3. Bishop, C. M. (1995). Neural Networks for Pattern Recognition. Oxford: Oxford University Press.
4. Borg, I., & Lingoes, J. (1987). Multidimensional Similarity Structure Analysis. New York: Springer.
5. Calder, A., Young, A., Perrett, D., Etcoff, N., & Rowland, D. (1996). Categorical perception of morphed facial expressions. Visual Cognition, 3, 81-117.
6. Calder, A. J., Burton, A. M., Miller, P., Young, A. W., & Akamatsu, S. (2001). A principal component analysis of facial expressions. Vision Research, 41, 1179-1208.
7. Calder, A. J., Young, A. W., Keane, J., & Dean, M. (2000). Configural information in facial expression perception. Journal of Experimental Psychology: Human Perception and Performance, 26, 526-551.
8. Carroll, J. M., & Russell, J. A. (1996). Do facial expressions signal specific emotions? Judging emotion from the face in context. Journal of Personality and Social Psychology, 70, 205-218.
9. Cottrell, G. W., Dailey, M. N., Padgett, C., & Adolphs, R. (2000). Is all face processing holistic? The view from UCSD. In M. Wenger & J. Townsend (Eds.), Computational, Geometric, and Process Perspectives on Facial Cognition: Context and Challenges (pp. 347-395). Mahwah, NJ: Erlbaum.
10. Cottrell, G. W., & Metcalfe, J. (1991). EMPATH: Face, gender and emotion recognition using holons. In R. P. Lippman, J. Moody, & D. S. Touretzky (Eds.), Advances in Neural Information Processing Systems 3 (pp. 564-571). San Mateo: Morgan Kaufmann.
11. Cottrell, G. W., Munro, P., & Zipser, D. (1989). Image compression by back propagation: An example of extensional programming. In N. E. Sharkey (Ed.), Models of Cognition: A Review of Cognitive Sciences. New Jersey: Norwood.
12. Craw, I., & Cameron, P. (1991). Parameterising images for recognition and reconstruction. In Proceedings of the British Machine Vision Conference (pp. 367-370). Berlin: Springer.
13. Daugman, J. G. (1985). Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cotrical filters. Journal of the Optical Society of America A, 2, 1160-1169.
14. Donato, G., Barlett, M. S., Hager, J. C. Ekman, P., & Sejnowsky, T. J. (1999). Classifying facial actions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 21, 974-989.
15. Ekman, P. (1999). Basic emotions. In T. Dagleish & M. Power (Eds.), Handbook of Cognition and Emotion (Chap. 3, pp. 45-60). New York: Wiley.
16. Ekman, P., & Friesen, W. (1976). Pictures of Facial Affect. Palo Alto, CA: Consulting Psychologist Press.
17. Ellison, J. W., & Massaro, D. W. (1997). Featural evaluation, integration, and judgement of facial affect. Journal of Experimental Psychology: Human Perception and Performance, 23, 213-226.
18. Etcoff, N. L., & Magee, J. J. (1992). Categorical perception of facial expressions. Cognition, 44, 227-240.
19. Goldstone, R. L. (2000). A neural network model of concept-influenced segmentation. In Proceedings of the 22nd Annual Conference of the Cognitive Science Society. Mahwah, NJ: Erlbaum.
20. Goldstone, R. L., Lippa, Y., & Shiffrin, R. M. (2001). Altering object representation through category learning. Cognition, 78, 27-43.
21. Hancock, P. J. B., Bruce, V., & Burton, A. M. (1998). A comparison of two computer-based face recognition systems with human perception of faces. Vision Research, 38, 2277-2288.
22. Hancock, P. J. B., Burton, A. M., & Bruce, V. (1996). Face processing: Human perception and principal components analysis. Memory and Cognition, 24, 26-40.
23. Harnad, S. R. (1987). Categorial Perception: The Groundwork of Cognition. Cambridge: Cambridge University Press.
24. Hinton, G. E., McClelland, J. L., & Rumelhart, D. E. (1986). Distributed representations. Parallel Distributed Processing: Explorations in the Microstructure of Cognition (vol. 1, chap. 3, pp. 77-109). Cambridge: MIT Press.
25. Jansari, A., Tranel, D., & Adolphs, R. (2000). A valence-specific lateral bias for discriminating emotional facial expressions in free field. Cognition and Emotion, 14, 341-353.
26. Katsikitis, M. (1997). The classification of facial expressions of emotion: A multidimensional scaling approach. Perception, 26, 613-626.
27. Lades, M., Vorbrüggen, J. C., Buhmann, J., Lange, J., von der Malsburg, C., Würtz, R. P., & Konen, W. (1993). Distortion invariant object recognition in the dynamic link architecture. IEEE Transactions on Computers, 42, 300-311.
28. Lee, D. D., & Seung, H. S. (1999). Learning the parts of objects by non-negative matrix factorization. Nature. 401, 788-791.
29. Lee, T.-W., Lewicki, M. S., & Sejnowski, T. J. (2000). ICA mixture models for unsupervised classification of non-Gaussian sources and automatic context switching in blind signal separation. IEEE Transactions on Pattern Recognition and Machine Intelligence, 22, 1-12.
30. Lien, J. J.-J., Kanade, T., Cohn, J. F., & Li, C.-C. (2000). Detection, tracking, and classification of action units in facial expression. Robotics and Autonomous Systems, 31, 131-146.
31. Logothetis, N. K., & Sheinberg, D. L. (1996). Visual object recognition. Annual Review of Neuroscience, 19, 577-621.
32. Lyons, M. J., Akamatsu, S., Kamachi, M., & Gyoba, J. (1998). Coding facial expressions with Gabor wavelets. Proceedings of the Third IEEE International Conference on Automatic Face and Gesture Recognition (pp. 200-205). Los Alamitos, CA: IEEE Computer Society.
33. Lyons, M. J., Budynek, J., & Akamatsu, S. (1999). Automatic classification of single facial images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 21, 1357-1362.
34. Marr, D. (1982). Vision: A computational investigation into the human representation and processing of visual information. San Francisco: Freeman.
35. Matsumoto, D. (1992). American-Japanese cultural differences in the recognition of universal facial expressions. Journal of Cross-Cultural Psychology, 23, 72-84.
36. Padgett, C., Cottrell, G., & Adolphs, R. (1996). Categorical perception in facial emotion classification. Proceedings of the 18th Annual Conference of the Cognitive Science Society. Hillsdale, NJ: Erlbaum.
37. Padgett, C., & Cottrell, G. W. (1998). A simple neural network models categorical perception of facial expressions. Proceedings of the 20th Annual Conference of the Cognitive Science Society (pp. 806-807). Mahwah, NJ: Erlbaum.
38. Perrett, D., Hietanen, J., Oram, M., & Benson, P. (1992). Organization and functions of cells responsive to faces in the temporal cortex. Philosophical Transactions of the Royal Society of London, B: Biological Sciences, 335, 23-30.
39. Pevtzow, R., & Harnad, S. R. (1997). Warping similarity space in category learning by human subjects: The role of task difficulty. In M. Ramscar, U. Hahn, E. Cambouropolos, & H. Pain (Eds.), Proceedings of SimCat 1997: Interdisciplinary Workshop on Similarity and Categorization (pp. 189-195). Edinburgh, Scotland: Department of Artificial Intelligence, Edinburgh University.
40. Riesenhuber, M., & Poggio, T. (2000). Models of object recognition. Nature Neuroscience, 3, 1199-1204.
41. Rosenblum, M., Yacoob, Y., & Davis, L. S. (1996). Human expression recognition from motion using a radial basis function network architecture. IEEE Transactions on Neural Networks, 7, 1121-1138.
42. Russell, J. A. (1980). A circumplex model of affect. Journal of Personality and Social Psychology, 39, 1161-1178.
43. Russell, J. A., & Bullock, M. (1986). Fuzzy concepts and the perception of emotion in facial expressions. Social Cognition, 4, 309-341.
44. Russell, J. A., Lewicka, M., & Niit, T. (1989). A cross-cultural study of circumplex model of affect. Journal of Personality and Social Psychology, 57, 848-856.
45. Sanger, T. (1989). An optimality principle for unsupervised learning. In D. Touretzky (Ed.), Advances in Neural Information Processing Systems (vol. 1, pp. 11-19). San Mateo: Morgan Kaufmann.
46. Schiano, D. J., Ehrlich, S. M., Sheridan, K. M., Beck, D. M. (2000). Evidence for Continuous Rather than Categorical Perception of Facial Affect. Abstract presented at The 40th Annual Meeting of the Psychonomic Society.
47. Schlosberg, H. (1952). The description of facial expressions in terms of two dimensions. Journal of Experimental Psychology, 44, 229-237.
48. Seidenberg, M. S., & McClelland, J. L. (1989). A distributed, developmental model of word recognition and naming. Psychological Review, 96, 523-568.
49. Tijsseling, A., & Harnad, S. R. (1997). Warping similarity space in category learning by backprop nets. In M. Ramscar, U. Hahn, E. Cambouropolos, & H. Pain (Eds.), Proceedings of SimCat 1997: Interdisciplinary Workshop on Similarity and Categorization (pp. 263-269). Edinburgh, Scotland: Department of Artificial Intelligence, Edinburgh University.
50. Turk, M., & Pentland, A. (1991). Eigenfaces for recognition. Journal of Cognitive Neuroscience, 3, 71-86.
51. Vapnik, V. N. (1995). The Nature of Statistical Learning Theory. New York: Springer.
52. Woodworth, R. S. (1938). Experimental Psychology. New York: Holt.
53. Young, A. W., Rowland, D., Calder, A. J., Etcoff, N. L., Seth, A., & Perrett, D. I. (1997). Facial expression megamix: Tests of dimensional and category accounts of emotion recognition. Cognition, 63, 271-313.