Category processing and the human likeness dimension of the uncanny valley hypothesis: Eye-tracking data

Frontiers in Psychology

Volumn 4, Issue MAR, 2013, Pages

  Cheetham, Marcus ^a   Pavlovic, Ivana ^a   Jordan, Nicola ^a   Suter, Pascal ^a   Jancke, Lutz ^a  

^a UNIVERSITY OF ZURICH   (Switzerland)

Author keywords

Categorization; Eye movement; Human likeness; Sex differences; Uncanny valley hypothesis

Indexed keywords

EID: 84878782813     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2013.00108     Document Type: Article

References (112)

1. Althoff, R. R., and Cohen, N. J. (1999). Eye-movement-based memory effect: a reprocessing effect in face perception. J. Exp. Psychol. Learn. Mem. Cogn. 25, 997-1010.
2. Annett, M. (1970). A classification of hand preference by association analysis. Br. J. Psychol. 61, 303-321.
3. Balas, B., and Nelson, C. A. (2010). The role of face shape and pigmentation in other-race face perception: an electrophysiological study. Neuropsychologia 48, 498-506.
4. Bartneck, C., Kanda, T., Ishiguro, H., and Hagita, N. (2007). "Is the Uncanny Valley an Uncanny Cliff?," in Proceedings of the 16th IEEE, RO-MAN, Jeju, 368-373.
5. Barton, J. J. S., Radcliffe, N., Cherkasova, M. V., Edelman, J., and Intriligator, J. M. (2006). Information processing during face recognition: the effects of familiarity, inversion, and morphing on scanning fixations. Perception 35, 1089-1105.
6. Beale, J. M., and Keil, F. C. (1995). Categorical effects in the perception of faces. Cognition 57, 217-219.
7. Becker, S. I. (2011). Determinants of dwell time in visual search: similarity or perceptual difficulty?. PLoS ONE 6:e17740.
8. Biele, C., and Grabowska, A. (2006). Sex differences in perception of emotion intensity in dynamic and static facial expressions. Exp. Brain Res. 171, 1-6.
9. Bindemann, M., Scheepers, C., and Burton, A. M. (2009). Viewpoint and center of gravity affect eye movements to human faces. J. Vis. 9, 1-16.
10. Bülthoff, I., and Newell, F. N. (2000). Investigating categorical perception of gender with 3-D morphs of familiar faces. Perception 29, 57.
11. Buswell, G. T. (1935). How People Look at Pictures. Chicago: University of Chicago Press.
12. Campbell, R., Pascalis, O., Coleman, M., Wallace, S. B., and Benson, P. J. (1997). Are faces of different species perceived categorically by human observers?. Proc. R. Soc. Lond. B Biol. Sci. 264, 1429-1434.
13. Cheetham, M., Suter, P., and Jancke, L. (2011). The human likeness dimension of the "uncanny valley hypothesis": behavioral and functional MRI findings. Front. Hum. Neurosci. 5:126.
14. Cheetham, M., and Jancke, L. (2013). Perceptual and category processing of the Uncanny Valley Hypothesis' dimension of human likeness: some methodological issues. J. Vis. Exp. e4375..
15. Chelnokova, O., and Laeng, B. (2011). Three-dimensional information in face recognition: an eye-tracking study. J. Vis. 11, 27.
16. Chen, H., Russell, R., Nakayama, K., and Livingstone, M. (2010). Crossing the "uncanny valley": adaptation to cartoon faces can influence perception of human faces. Perception 39, 378-386.
17. Cook, M. (1978). "Eye movements during recognition of faces," in Practical Aspects of Memory, eds M. M. Gruneberg, P. E. Morris, and R. N. Sykes (New York: Academic Press). 286-292.
18. Deaner, R. O., and Platt, M. L. (2003). Reflexive social attention in monkeys and humans. Curr. Biol. 13, 1609-1613.
19. Desimone, R., and Duncan, J. (1995). "Neural mechanisms of selective visual attention." Annu. Rev. Neurosci. 18, 193-222.
20. Diamond, R., and Carey, S. (1977). Development changes in the representation of faces. J. Exp. Child. Psychol. 23, 1-22.
21. Dill, V., Flach, L., Hocevar, R., Lykawka, C., Musse, S., and Pinho, M. (2012). "Evaluation of the uncanny valley in CG characters," in Intelligent Virtual Agents Lecture Notes in Computer Science, eds N. Yukiko, M. Neff, A. Paiva, and M. Walker (Berlin: Springer), 511-513.
22. Duncan, J., and Humphreys, G. W. (1989). Visual search and stimulus similarity. Psychol. Rev. 96, 433-458.
23. Ectoff, N. L., and Magee, J. J. (1992). Categorical perception of facial expressions. Cognition 44, 227-240.
24. Egeth, H. E., and Yantis, S. (1997). Visual attention: control, representation, and time course. Annu. Rev. Psychol. 48, 269-297.
25. Ellis, H. D., Shepherd, J. W., and Davis, G. M. (1979). Identification of familiar and unfamiliar faces from internal and external features: some implications for theories of face recognition. Perception 8, 431-439.
26. Fabri, M., Moore, D. J., and Hobbs, D. J. (2004). "Mediating the expression of emotion in educational collaborative virtual environments: an experimental study," in International Journal of Virtual Reality, London: Springer Verlag.
27. Fisher, G. H., and Cox, R. L. (1975). Recognizing human faces. Appl. Ergon. 6, 104-109.
28. Fitts, P. M., Jones, R. E., and Milton, J. L. (1950). Eye movements of aircraft pilots during instrument-landing approaches. Aeronaut. Eng. Rev. 9, 24-29.
29. Fraser, I. H., and Parker, D. M. (1986). "Reaction time measures of feature saliency in a perceptual integration task," in Aspects of face processing, eds H. D. Ellis, M. A. Jeeves, F. Newcombe, and A. Young (Dordecht: Martinus Nijhoff), 45-58.
30. Goldberg, J. H., and Kotval, X. P. (1999). Computer interface evaluation using eye movements: methods and constructs. Int. J. Ind. Ergon. 24, 631-645.
31. Goldberg, J. H., and Wichansky, A. M. (2003). "Eye tracking in usability evaluation: a practitioner's guide," in The Mind's Eye: Cognitive and Applied Aspects of Eye Movement Research, eds J. Hyönä, R. Radach, and H. Deubel (Amsterdam: Elsevier), 493-516.
32. Grosbras, M.-H., Laird, A., and Paus, T. (2005). Human cortical regions involved in gaze production, attention shifts and gaze perception: a brain imaging meta-analysis. Hum. Brain Mapp. 25, 140-154.
33. Haith, M. M., Bergman, T., and Moore, M. J. (1977). Eye contact and face scanning in early infancy. Science 198, 853-855.
34. Hall, E. T. (1966). The Hidden Dimension. Garden City, NY: Doubleday.
35. Hall, J. A., and Matsumoto, D. (2004). Gender differences in judgments of multiple emotions from facial expressions. Emotion 4, 201-206.
36. Hall, J. K., Hutton, S. B., and Morgan, M. J. (2010). Sex differences in scanning faces: does attention to the eyes explain female superiority in facial expression recognition?. Cogn. Emot. 24, 629-637.
37. Hanson, D. (2006). "Exploring the aesthetic range for humanoid robots", in Proceedings of the ICCS/CogSci-2006 Long Symposium: Toward Social Mechanisms of Android Science, Vancouver, 39-42.
38. Harnad, S. R. (1987). "Introduction: psychological and cognitive aspects of categorical perception: a critical overview," in Categorical Perception: The Groundwork of Cognition, ed. S. R. Harnad (New York: Cambridge University Press), 1-25.
39. Heekeren, H. R., Marrett, S., and Ungerleider, L. G. (2008). The neural systems that mediate human perceptual decision making. Nat. Rev. Neurosci. 9, 467-479.
40. Henderson, J. M. (2003). Human gaze control during real-world scene perception. Trends Cogn. Sci. (Regul. Ed.) 7, 498-504.
41. Henderson, J. M. (2007). Regarding scenes. Curr. Dir. Psychol. Sci. 16, 219-222.
42. Henderson, J. M., Williams, C. C., and Falk, R. J. (2005). Eye movements are functional during face learning. Mem. Cognit. 33, 98-106.
43. Herlitz, A., and Rehnman, J. (2008). Sex differences in episodic memory. Curr. Dir. Psychol. Sci. 17, 52-56.
44. Hietanen, J. K. (1999). Does your gaze direction and head orientation shift my visual attention?. Neuroreport 10, 3443-3447.
45. Hietanen, J. K. (2002). Social attention orienting integrates visual information from head and body orientation. Psychol. Res. 66, 174-179.
46. Ho, C.-C., and MacDorman, K. F. (2010). Revisiting the uncanny valley theory: developing and validating an alternative to the Godspeed indices. Comput. Hum. Behav. 26, 1508-1151.
47. Ho, C.-C., MacDorman, K. F., and Pramono, Z. A. D. (2008). "Human emotion and the uncanny valley: a GLM, MDS, and isomap analysis of robot video ratings," in ACM/IEEE International Conference on Human-Robot Interaction, Amsterdam, 169-176.
48. Hsiao, J. H., and Cottrell, G. (2008). Two fixations suffice in face recognition. Psychol. Sci. 19, 998-1006.
49. Itier, R. J., and Batty, M. (2009). Neural bases of eye and gaze processing: the core of social cognition. Neurosci. Biobehav. Rev. 33, 843-863.
50. Itier, R. J., Villate, C., and Ryan, J. D. (2007). Eyes always attract attention but gaze orienting is task-dependent: evidence from eye movement monitoring. Neuropsychologia 45, 1019-1028.
51. Janik, S. W., Wellens, A. R., Goldberg, M. L., and Dell'Osso, L. F. (1978). Eyes as the center of focus in the visual examination of human faces. Percept. Mot. Skills 47, 857-858.
52. Johansen, M. K., and Palmeri, T. J. (2002). Are there representational shifts during category learning?. Cogn. Psychol. 45, 482-553.
53. Just, M. A., and Carpenter, P. A. (1980). A theory of reading: from eye fixations to comprehension. Psychol. Rev. 87, 329-354.
54. Kimchi, R., Amishav, R., and Sulitzeanu-Kenan, A. (2008). Gender differences in global-local perception?. Evidence from orientation and shape judgments. Acta Psychol. (Amst.) 130, 64-71.
55. Kirouac, G., and Doré, F. Y. (1985). Accuracy of the judgement of facial expression of emotions as a function of sex and level of education. J. Nonverbal Behav. 91, 3-7.
56. Lamberts, K. (1998). The time course of categorization. J. Exp. Psychol. Learn. Mem. Cogn. 24, 695-711.
57. Langdell, T. (1978). Recognition of faces: an approach to the study of autism. J. Child Psychol. Psyc. 19, 255-268.
58. Langton, S. R. H. (2000). The mutual influence of gaze and head orientation in the analysis of social attention direction. Q. J. Exp. Psychol. 53A, 825-845.
59. Levin, D. T. (2000). Race as a visual feature: using visual search and perceptual discrimination tasks to understand face categories and the cross race recognition deficit. J. Exp. Psychol. Gen. 129, 559-574.
60. Lewin, C., and Herlitz, A. (2002). Sex differences in face recognition-women's faces make the difference. Brain Cogn. 50, 121-128.
61. Liu, C. H., and Ward, J. (2006). The use of 3D information in face recognition. Vision Res. 46, 768-773.
62. Loftus, G. R., and Mackworth, N. H. (1978). Cognitive determinants of fixation location during picture viewing. J. Exp. Psychol. Hum. Percept. Perform. 4, 565-572.
63. Looser, C. E., and Wheatley, T. (2010). The tipping point of animacy: how, when, and where we perceive life in a face. Psychol. Sci. 21, 1854-1862.
64. MacDorman, K. (2005). "Androids as an experimental apparatus: why is there an uncanny valley and can we exploit it?.," in Toward Social Mechanisms of Android Science: A CogSci 2005 Workshop, Stresa, 106-118.
65. MacDorman, K. F. (2006). "Subjective ratings of robot video clips for human likeness, familiarity, and eeriness: an exploration of the uncanny valley [electronic resource]," in ICCS/CogSci-2006 Long Symposium: Toward Social Mechanisms of Android Science. Vancouver.
66. MacDorman, K., Green, R., Ho, C.-C., and Koch, C. (2009a). Too real for comfort?. Uncanny responses to computer generated faces. Comput. Hum. Behav. 25, 695-710.
67. MacDorman, K. F., Vasudevan, S. K., and Ho, C.-C. (2009b). Does Japan really have robot mania?. Comparing attitudes by implicit and explicit measures. AI Soc. 23, 485-510.
68. McBain, R., Norton, D., and Chen, Y. (2009). Females excel at basic face perception. Acta Psychol. (Amst.) 130, 168-173.
69. McGivern, R. F., Mutter, K. L., Anderson, J., Wideman, G., Bodnar, M., and Huston, P. J. (1998). Gender differences in incidental learning and visual recognition memory: support for a sex difference in unconscious environmental awareness. Pers. Individ. Dif. 25, 223-232.
70. Minato, T., Shimada, M., Itakura, S., Lee, K., and Ishiguro, H. (2006). Evaluating human likeness of an android by comparing gaze behaviors elicited. Adv. Robot. 20, 1147-1163.
71. Minut, S., Mahadevan, S., Henderson, J. M., and Dyer, F. C. (2000). "Face recognition using foveal vision," in Biologically Motivated Computer Vision Lecture Notes in Computer Science, eds S.-W. Lee, H. H. Bülthoff, and T. Poggio (Berlin: Springer), 424-433.
72. Miyahira, A., Morita, K., Yamaguchi, H., Morita, Y., and Maeda, H. (2000a). Gender differences and reproducibility in exploratory eye movements of normal subjects. Psychiatry Clin. Neurosci. 54, 31-36.
73. Miyahira, A., Morita, K., Yamaguchi, H., Nonaka, K., and Maeda, H. (2000b). Gender differences of exploratory eye movements: a life span study. Life Sci. 68, 569-577.
74. Montagne, B., Kessels, R. P., Frigerio, E., de Haan, E. H., and Perrett, D. I. (2005). Sex differences in the perception of affective facial expressions: do men really lack sensitivity?. Cogn. Process. 6, 136-141.
75. Mori, M. (1970). "Bukimi no tani: the uncanny valley. Energy 7(4):33-35 (in Japanese)," in English translation provided at CogSci '05 workshop: toward social mechanisms of android science, views of the Uncanny Valley. Available at: http://www.androidscience.com/theuncannyvalley/proceedings2005/uncannyvalley.html.
76. Nowicki, S. Jr., and Hartigan, M. (1988). Accuracy of facial affect recognition as a function of locus of control orientation and anticipated interpersonal interaction. J. Soc. Psychol. 128, 363-372.
77. Oliva, A., and Schyns, P. G. (1997). Coarse blobs or fine edges?. Evidence that information diagnosticity changes the perception of complex visual stimuli. Cogn. Psychol. 34, 72-107.
78. Pearson, A., Henderson, J., Schyns, P. G., and Gosselin, F. (2003). Task dependent eye movements during face recognition. Abstr. Psychon. Soc. 8, 84.
79. Pollick, F. E. (2010). "In search of the uncanny valley," in User Centric Media, eds P. Daras, and O. M. Ibarra (Berlin: Springer), 69-78.
80. Pomianowska, I., Germeys, F., Verfaillie, K., and Newell, F. N. (2011). The role of social cues in the deployment of spatial attention: head-body relationships automatically activate directional spatial codes in a Simon task. Front. Integr. Neurosci. 6:4.
81. Posner, M. I. (1980). Orienting of attention. Q. J. Exp. Psychol. 32, 3-25.
82. Ramey, C. H. (2005). The uncanny valley of similarities concerning abortion, baldness, heaps of sand, and humanlike robots. Paper Presented at the Proceedings of Views of the Uncanny Valley Workshop: IEEE-RAS International Conference on Humanoid Robots, Tsukuba.
83. Rayner, K. (1987). Eye movements in reading and information processing. Psychol. Bull. 85, 618-660.
84. Rayner, K. (1998). Eye movements in reading and information processing: 20 years of research. Psychol. Bull. 124, 372-422.
85. Rayner, K., and Fischer, D. L. (1987). Letter processing during eye fixations in visual search. Percept. Psychophys. 42, 87-100.
86. Rehnman, J., and Herlitz, A. (2007). Women remember more faces than men do. Acta Psychol. (Amst.) 124, 344-355.
87. Remington, R. W., and Folk, C. L. (2001). A dissociation between attention and selection. Psychol. Sci. 12, 511-515.
88. Robinson, D. A. (1964). The mechanics of human saccadic eye movement. J. Physiol. 174, 245-264.
89. Saether, L., Belle, W. V., Laeng, B., Brennen, T., and Overvoll, M. (2009). Anchoring gaze when categorizing faces' sex: evidence from eye-tracking data. Vision Res. 49, 2870-2880.
90. Saygin, A. P., Chaminade, T., Ishiguro, H., Driver, J., and Frith, C. (2012). The thing that should not be: predictive coding and the uncanny valley in perceiving human and humanoid robot actions. Soc. Cogn. Affect. Neurosci. 7, 413-422.
91. Scholten, M. R., Aleman, A., Montagne, B., and Kahn, R. S. (2005). Schizophrenia and processing of facial emotions: sex matters. Schizophr. Res. 78, 61-67.
92. Schwarzer, G., Huber, S., and Dümmler, T. (2005). Gaze behavior in analytical and holistic face processing. Mem. Cognit. 33, 344-354.
93. Schyns, P. G. (1991). A modular neural network of concept acquisition. Cogn. Sci. 15, 461-508.
94. Schyns, P. G., Bonnar, L., and Gosselin, F. (2002). Show me the features! Understanding recognition from the use of visual information. Psychol. Sci. 13, 402-409.
95. Schyns, P. G., and Gosselin, F. (2003). "Diagnostic use of scale information for componential and holistic recognition," in Perception of Faces, Objects, and Scenes. Analytic and Holistic Processes, eds M. A. Peterson, and G. Rhodes (Oxford: Oxford University Press), 120-145.
96. Schyns, P. G., and Murphy, G. L. (1994). "The ontogeny of part representation in object concepts," in The Psychology of Learning and Motivation, ed. D. L. Medin (New York: Academic Press), 305-349.
97. Schyns, P. G., and Oliva, A. (1994). From blobs to boundary edges: evidence for time and spatial scale dependent scene recognition. Psychol. Sci. 5, 195-200.
98. Sergent, J. (1986). "Microgenesis of face perception," in Aspects of Face Processing, eds H. D. Ellis, M. A. Jeeves, F. Newcombe, and A. M. Young (Dordrecht: Martinus Nijhoff), 17-33.
99. Seyama, J., and Nagayama, R. S. (2007). The uncanny valley: the effect of realism on the impression of artificial human faces. Presence (Camb.) 16, 337-351.
100. Shen, J., Reingold, E. M., Pomplun, M., and Williams, D. E. (2003). "Saccadic selectivity during visual search: the influence of central processing difficulty," in The Mind's Eyes: Cognitive and Applied Aspects of Eye Movement Research, eds J. Hyona, R. Radach, and H. Deubel (Amsterdam: Elsevier Science Publishers), 65-88.
101. Stacey, P. C., Walker, S., and Underwood, J. D. (2005). Face processing and familiarity: evidence from eye-movement data. Br. J. Psychol. 96(Pt 4), 407-422.
102. Tanaka, J. W., and Curran, T. (2001). A neural basis for expert object recognition. Psychol. Sci. 12, 43-47.
103. Tavassoli, A., Linde, I., Bovik, A. C., and Cormack, L. K. (2009). Eye movements selective for spatial frequency and orientation during active visual search. Vision Res. 49, 173-181.
104. Thayer, J. F., and Johnsen, B. H. (2000). Sex differences in judgement of facial affect: a multivariate analysis of recognition errors. Scand. J. Psychol. 41, 243-246.
105. Tinwell, A., and Grimshaw, M. (2009). "Bridging the uncanny: an impossible traverse?.," in Proceedings of the 13th International MindTrek Conference: Everyday Life in the Ubiquitous Era, eds O. Sotamaa, A. Lugmayr, H. Franssila, P. Näränen, and J. Vanhala (Tampere: ACM), 66-73.
106. Tinwell, A., Grimshaw, M., and Williams, A. (2010). Uncanny behaviour in survival horror games. J. Gaming Virtual World. 2, 3-25.
107. Tyler, C. W., and Chen, C. C. (2006). Spatial summation of face information. J. Vis. 6, 1117-1125.
108. van Belle, G., Ramon, M., Lefèvre, P., and Rossion, B. (2010). Fixation patterns during recognition of personally familiar and unfamiliar faces. Front. Psychol. 1:20.
109. Vuong, Q. C., Peissig, J. J., Harrison, M. C., and Tarr, M. J. (2005). The role of surface pigmentation for recognition revealed by contrast reversal in faces and Greebles. Vision Res. 45, 1213-1223.
110. Walker-Smith, G. J., Gale, A. G., and Findlay, J. M. (1977). Eye-movement strategies involved in face perception. Perception 6, 313-326.
111. Walters, M. L., Syrdal, D. S., Dautenhaun, K., Boekhorst, R., and Koay, K. L. (2008). Avoiding the uncanny valley: robot appearance, personality and consistency of behavior in an attention-seeking home scenario for a robot companion. Auton. Robots 24, 159-178.
112. Yarbus, A. L. (1967). Eye movements and Vision. New York: Plenum Press