You look human, but act like a machine: Agent appearance and behavior modulate different aspects of human-robot interaction

Frontiers in Psychology

Volumn 8, Issue AUG, 2017, Pages

  Abubshait, Abdulaziz ^a   Wiese, Eva ^a  

^a GEORGE MASON UNIVERSITY   (United States)

Author keywords

Human robot interaction; Intentionality; Mind perception; Social cognition; Social robotics

Indexed keywords

EID: 85028087757     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2017.01393     Document Type: Article

References (94)

1. Abell, F., Happé, F., and Frith, U. (2000). Do triangles play tricks? Attribution of mental states to animated shapes in normal and abnormal development. Cogn. Dev. 15, 1-16. doi: 10.1016/S0885-2014(00) 00014-9
2. Admoni, H., Bank, C., Tan, J., Toneva, M., and Scassellati, B. (2011). "Robot gaze does not reflexively cue human attention," in Proceedings of the 33rd Annual Conference of the Cognitive Science Society, eds L. Carlson, C. Hölscher, and T. Shipley (Austin, TX: Cognitive Science Society), 1983-1988.
3. Adolphs, R. (1999). Social cognition and the human brain. Trends Cogn. Sci. 3, 469-479. doi: 10.1016/s1364-6613(99)01399-6
4. Baron-Cohen, S. (1995). Mindblindness: An Essay on Autism and Theory of Mind. Cambridge: MIT Press.
5. Bartneck, C. (2003). "Interacting with an embodied emotional character," in Proceedings of the Design for Pleasurable Products Conference, Pittsburgh, PA, 55-60.
6. Bayliss, A. P., Frischen, A., Fenske, M. J., and Tipper, S. P. (2007). Affective evaluations of objects are influenced by observed gaze direction and emotional expression. Cognition 104, 644-653. doi: 10.1016/j.cognition.2006.07.012
7. Bayliss, A. P., and Tipper, S. P. (2006). Predictive gaze cues and personality judgments: should eye trust you? Psychol. Sci. 17, 514-520. doi: 10.1111/j.1467- 9280.2006.01737.x
8. Bennewitz, M., Faber, F., Joho, D., Schreiber, M., and Behnke, S. (2005). "Towards a humanoid museum guide robot that interacts with multiple persons," in Proceedings of 2005 5th IEEE-RAS International Conference on Humanoid Robots (Piscataway, NJ: IEEE), 418-423.
9. Bonifacci, P., Ricciardelli, P., Lugli, L., and Pellicano, A. (2008). Emotional attention: effects of emotion and gaze direction on overt orienting of visual attention. Cogn. Process. 9, 127-135. doi: 10.1007/s10339-007- 0198-3
10. Breazeal, C., Kidd, C., Thomaz, A., Hoffman, G., and Berlin, M. (2005). "Effects of nonverbal communication on efficiency and robustness in human-robot teamwork," in Proceedings of International Conference on Intelligent Robots and Systems, (Piscataway, NJ: IEEE), 708-713.
11. Carter, E. J., Mistry, M. N., Carr, G. P. K., Kelly, B. A., and Hodgins, J. K. (2014). "Playing catch with robots: Incorporating social gestures into physical interactions," in Proceedings of the IEEE International Symposium on Robot and Human Interactive Communication Edinburgh, 231-236.
12. Castelli, F., Happé, F., Frith, U., and Frith, C. (2000). Movement and mind: a functional imaging study of perception and interpretation of complex intentional movement patterns. Neuroimage 12, 314-325. doi: 10.1006/nimg. 2000.0612
13. Caruana, N., de Lissa, P., and McArthur, G. (2016). Beliefs about human agency influence the neural processing of gaze during joint attention. Soc. Neurosci. 12, 194-206. doi: 10.1080/17470919.2016.1160953
14. Cazzato, V., Liuzza, M. T., Caprara, G. V., Macaluso, E., and Aglioti, S. M. (2015). The attracting power of the gaze of politicians is modulated by the personality and ideological attitude of their voters: a functional magnetic resonance imaging study. Eur. J. Neurosci. 42, 1-12. doi: 10.1111/ejn.13038
15. Cheetham, M., Suter, P., and Jancke, L. (2014). Perceptual discrimination difficulty and familiarity in the uncanny valley: more like a "Happy Valley". Front. Psychol. 5:1219. doi: 10.3389/fpsyg.2014.01219
16. Ciardo, F., Marino, B. F. M., Actis-Grosso, R., Rossetti, A., and Ricciardelli, P. (2014). Face age modulates gaze following in young adults. Sci. Rep. 4:4746. doi: 10.1038/srep04746
17. Cushman, F. (2008). Crime and punishment: distinguishing the roles of causal and intentional analyses in moral judgment. Cognition 108, 353-380. doi: 10.1016/j. cognition.2008.03.006
18. Dalmaso, M., Edwards, S. G., and Bayliss, A. P. (2016). Re-encountering individuals who previously engaged in joint gaze modulates subsequent gaze cueing. J. Exp. Psychol. 42, 271. doi: 10.1037/xlm0000159
19. Dalmaso, M., Galfano, G., and Castelli, L. (2015). The impact of same- and otherrace gaze distractors on the control of saccadic eye movements. Perception 44, 1020-1028. doi: 10.1177/0301006615594936
20. Dalmaso, M., Galfano, G., Coricelli, C., and Castelli, L. (2014). Temporal dynamics underlying the modulation of social status on social attention. PLoS ONE 9:e93139. doi: 10.1371/journal.pone.0093139
21. Dalmaso, M., Pavan, G., Castelli, L., and Galfano, G. (2012). Social status gates social attention in humans. Biol. Lett. 8, 450-452. doi: 10.1098/rsbl.2011. 0881
22. Deaner, R. O., Shepherd, S. V., and Platt, M. L. (2007). Familiarity accentuates gaze cuing in women but not men. Biol. Lett. 3, 64-67. doi: 10.1098/rsbl.2006. 0564
23. DiSalvo, C., Gemperle, F., Forlizzi, J., and Kiesler, S. (2002). "All robots are not created equal: the design and perception of humanoid robots," in Proceedings of the 4th Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (New York, NY: Association for Computing Machinery), 321-326. doi: 10.1145/778712.778756
24. Dodd, M. D., Hibbing, J. R., and Smith, K. B. (2011). The politics of attention: gaze-cuing effects are moderated by political temperament. Attent. Percept. Psychophys. 73, 24-29. doi: 10.3758/s13414-010-0001-x
25. Dodd, M. D., Hibbing, J. R., and Smith, K. B. (2016). "The politics of attention: differences in visual cognition between liberals and conservatives," in Psychology of Learning and Motivation, Vol. 65, ed. R. Brian (Cambridge, MA: Academic Press), 277-309.
26. Emery, N. J. (2000). The eyes have it: the neuroethology, function and evolution of social gaze. Neurosci. Biobehav. Rev. 24, 581-604. doi: 10.1016/S0149-7634(00) 00025-7
27. Fong, T., Nourbakhsh, I., and Dautenhahn, K. (2003). A survey of socially interactive robots: concepts, design, and applications. Rob. Auton. Syst. 42, 143-166. doi: 10.1016/S0921-8890(02)00372-X
28. Fox, E., Calder, A. J., and Yiend, J. (2007). Anxiety and sensitivity to gaze direction in emotionally expressive faces. Emotion 7, 478-486. doi: 10.1037/1528-3542.7. 3.478
29. Friesen, C. K., and Kingstone, A. (1998). The eyes have it! Reflexive orienting is triggered by nonpredictive gaze. Psychon. Bull. Rev. 5, 490-495. doi: 10.3758/ BF03208827
30. Friesen, C. K., Ristic, J., and Kingstone, A. (2004). Attentional effects of counterpredictive gaze and arrow cues. J. Exp. Psychol. 30, 319-329. doi: 10.1037/0096-1523.30.2.319
31. Frischen, A., Bayliss, A. P., and Tipper, S. P. (2007). Gaze cueing of attention: Visual attention, social cognition, and individual differences. Psychol. Bull. 133, 694-724. doi: 10.1037/0033-2909.133.4.694
32. Frischen, A., and Tipper, S. P. (2004). Orienting attention via observed gaze shift evokes longer term inhibitory effects: implications for social interactions, attention, and memory. J. Exp. Psychol. 133, 516-533. doi: 10.1037/0096-3445. 133.4.516
33. Frischen, A., and Tipper, S. P. (2006). Long-term gaze cueing effects: evidence for retrieval of prior states of attention from memory. Vis. Cogn. 14, 351-364. doi: 10.1080/13506280544000192
34. Frith, C. D., and Frith, U. (2006). How we predict what other people are going to do. Brain Res. 1079, 36-46. doi: 10.1016/j.brainres.2005.12.126
35. Fussell, S. R., Kiesler, S., Setlock, L. D., and Yew, V. (2008). "How people anthropomorphize robots," in Proceedings of the 3rd ACM/IEEE International Conference on Human Robot Interaction (New York, NY: ACM), 145-152.
36. Gallagher, H. L., and Frith, C. D. (2003). Functional imaging of "theory of mind." Trends Cogn. Sci. 7, 77-83. doi: 10.1016/S1364-6613(02) 00025-6
37. Gilbert, D. T., Lieberman, M. D., Morewedge, C. K., andWilson, T. D. (2004). The peculiar longevity of things not so bad. Psychol. Sci. 15, 14-19. doi: 10.1111/j. 0963-7214.2004.01501003.x
38. Graham, R., Friesen, C. K., Fichtenholtz, H. M., and LaBar, K. S. (2010). Modulation of reflexive orienting to gaze direction by facial expressions. Vis. Cogn. 18, 331-368. doi: 10.1080/13506280802689281
39. Gray, H. M., Gray, K., and Wegner, D. M. (2007). Dimensions of mind perception. Science 315:619. doi: 10.1126/science.1134475
40. Gray, K., and Wegner, D. M. (2008). The sting of intentional pain. Psychol. Sci. 19, 1260-1262. doi: 10.1111/j.1467-9280.2008.02208.x
41. Hackel, L. M., Looser, C. E., and Van Bavel, J. J. (2014). Group membership alters the threshold for mind perception: the role of social identity, collective identification, and intergroup threat. J. Exp. Soc. Psychol. 52, 15-23. doi: 10.1016/j.jesp.2013.12.001
42. Heider, F., and Simmel, M. (1944). An experimental study of apparent behavior. Am. J. Psychol. 57, 243-259. doi: 10.2307/1416950
43. Hietanen, J. K., and Leppänen, J. M. (2003). Does facial expression affect attention orienting by gaze direction cues? J. Exp. Psychol. 29:1228-1243. doi: 10.1037/ 0096-1523.29.6.1228
44. Hood, B. M., Willen, J., and Driver, J. (1998). Adult's eyes trigger shifts of visual attention in human infants. Psychol. Sci. 9, 131-134. doi: 10.1111/1467-9280. 00024
45. Hori, E., Tazumi, T., Umeno, K., and Kamachi, M. (2005). Effects of facial expression on shared attention mechanisms. Physiol. Behav. 84, 397-405. doi: 10.1016/j.physbeh.2005.01.002
46. Huang, C., and Thomaz, A. L. (2011). "Effects of responding to, initiating and ensuring joint attention in human-robot interaction," in Proceedings of the 20th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN '11), Atlanta, GA, 65-71.
47. Hungr, C. J., and Hunt, A. R. (2012). Physical self-similarity enhances the gazecueing effect. Q. J. Exp. Psychol. 65, 1250-1259. doi: 10.1080/17470218.2012. 690769
48. Jones, B. C., DeBruine, L. M., Main, J. C., Little, A. C., Welling, L. L. M., Feinberg, D. R., et al. (2010). Facial cues of dominance modulate the short-term gazecuing effect in human observers. Proc. R. Soc. B 277, 617-624. doi: 10.1098/ rspb.2009.1575
49. Kanda, T., Ishiguro, H., and Ishida, T. (2001). "Psychological analysis on humanrobot interaction," in Proceedings of the 2001 IEEE International Conference on Robotics and Automation, Seoul, 4166-4173.
50. Kätsyri, J., Förger, K., Mäkäräinen, M., and Takala, T. (2015). A review of empirical evidence on different uncanny valley hypotheses: support for perceptual mismatch as one road to the valley of eeriness. Front. Psychol. 6:390. doi: 10.3389/fpsyg.2015.00390
51. Kawai, N. (2011). Attentional shift by eye gaze requires joint attention: eye gaze cues are unique to shift attention. Jpn. Psychol. Res. 53, 292-301. doi: 10.1111/j. 1468-5884.2011.00470.x
52. Kiesler, S., Powers, A., Fussell, S. R., and Torrey, C. (2008). Anthropomorphic interactions with a robot and robot-like agent. Soc. Cogn. 26, 169-181. doi: 10.1521/soco.2008.26.2.169
53. Langton, S. R. H., and Bruce, V. (1999). Reflexive visual orienting in response to the social attention of others. Vis. Cogn. 6, 541-567. doi: 10.1080/13506289939 4939
54. Liuzza, M. T., Cazzato, V., Vecchione, M., Crostella, F., Caprara, G. V., and Aglioti, S. M. (2011). Follow my eyes: the gaze of politicians reflexively captures the gaze of ingroup voters. PLoS ONE 6:9. doi: 10.1371/journal.pone.002 5117
55. Looije, R., Neerincx, M. A., and Cnossen, F. (2010). Persuasive robotic assistant for health self-management of older adults: design and evaluation of social behaviors. Int. J. Hum. Comput. Stud. 68, 386-397. doi: 10.1016/j.ijhcs.2009. 08.007
56. Looser, C. E., and Wheatley, T. (2010). The tipping point of animacy. How, when, and where we perceive life in a face. Psychol. Sci. 21, 1854-1862. doi: 10.1177/ 0956797610388044
57. Lundqvist, D., Flykt, A., and öhman, A. (1998). The Karolinska Directed Emotional Faces (KDEF). Stockholm: Karolinska Institute.
58. MacDorman, K. F., and Ishiguro, H. (2006). The uncanny advantage of using androids in social and cognitive science research. Interact. Stud. 7, 361-368. doi: 10.1075/is.7.3.10
59. Mandell, A. R., Smith, M. A., Martini, M. C., Shaw, T. H., and Wiese, E. (2015). "Does the presence of social agents improve cognitive performance on a vigilance task?," in Social Robotics. Lecture Notes in Computer Science, eds A. Tapus, E. André, J. C. Martin, F. Ferland, and M. Ammi (Cham: Springer), 421-430.
60. Mandell, A., Smith, M., and Wiese, E. (2017). "Mind Perception in humanoid agents has negative effects on cognitive processing," in Proceedings of Human Factors and Ergonomics Society, Santa Monica, CA.
61. Martini, M., Buzzell, G., Wiese, E. (2015). "Agent appearance modulates mind attribution and social attention in human-robot interaction," in Social Robotics. Lecture Notes in Computer Science, Vol. 9388, eds A. Tapus, E. André, J. C. Martin, F. Ferland, and M. Ammi (Cham: Springer), 431-439.
62. Martini, M. C., Gonzalez, C. A., and Wiese, E. (2016). Seeing minds in others - Can agents with robotic appearance have human-like preferences? PLoS ONE 11:e0146310. doi: 10.1371/journal.pone.0146310
63. Morewedge, C. K. (2009). Negativity bias in attribution of external agency. J. Exp. Psychol. Gen. 138, 535-545. doi: 10.1037/a0016796
64. Mutlu, B., Forlizzi, J., and Hodgins, J. (2006). "A storytelling robot: Modeling and evaluation of human-like gaze behavior," in Proceedings of the 2006 6th IEEE-RAS International Conference on Humanoid Robots (Genova: IEEE), 1-6.
65. Mutlu, B., Kanda, T., Forlizzi, J., and Ishiguro, H. (2012). Conversational gaze mechanisms for human-like robots. ACM Trans. Interact. Intell. Syst. 1, 12. doi: 10.1145/2070719.2070725
66. Mutlu, B., Yamaoka, F., Kanda, T., Ishiguro, H., and Hagita, N. (2009). "Nonverbal leakage in robots: Communication of intentions through seemingly unintentional behavior," in Proceedings of the 4th ACM/IEEE International Conference on Human Robot Interaction, La Jolla, CA, 69-76. doi: 10.1145/ 1514095.1514110
67. Ohlsen, G., van Zoest, W., and van Vugt, M. (2013). Gender and facial dominance in gaze cuing: emotional context matters in the eyes that we follow. PLoS ONE 8:4. doi: 10.1371/journal.pone.0059471
68. Ohtsubo, Y. (2007). Perceived intentionality intensifies blameworthiness of negative behaviors: blame-praise asymmetry in intensification effect 1. Jpn. Psychol. Res. 49, 100-110. doi: 10.1111/j.1468-5884.2007. 00337.x
69. özdem, C., Wiese, E., Wykowska, A., Müller, H. J., Brass, M., and Van Overwalle, F. (2016). Believing androids-fMRI activation in the right temporo-parietal junction is modulated by ascribing intentions to nonhuman agents. Soc. Neurosci. 2, 1-12. doi: 10.1080/17470919.2016.120 7702
70. Pak, R., Fink, N., Price, M., Bass, B., and Sturre, L. (2012). Decision support aids with anthropomorphic characteristics influence trust and performance in younger and older adults. Ergonomics 55, 1059-1072. doi: 10.1080/00140139. 2012.691554
71. Park, S., and Catrambone, R. (2007). Social facilitation effects of virtual humans. Hum. Fact. 49, 1054-1060. doi: 10.1518/001872007X249910
72. Pavan, G., Dalmaso, M., Galfano, G., and Castelli, L. (2011). Racial group membership is associated to gaze-mediated orienting in Italy. PLoS ONE 6:10. doi: 10.1371/journal.pone.0025608
73. Pfeiffer, U. J., Timmermans, B., Bente, G., Vogeley, K., and Schilbach, L. (2011). A non-verbal turing test: differentiating mind from machine in gaze-based social interaction. PLoS ONE 6:11. doi: 10.1371/journal.pone.002 7591
74. Pfeiffer-Lessmann, N., Pfeiffer, T., and Wachsmuth, I. (2012). "An operational model of joint attention-Timing of gaze patterns in interactions between humans and a virtual human," in Proceedings of the 34th Annual Conference of the Cognitive Science Society, eds N. Miyake, D. Peebles, and R. P. Cooper (Austin, TX: Cognitive Science Society).
75. Porciello, G., Holmes, B. S., Liuzza, M. T., Crostella, F., Aglioti, S. M., and Bufalari, I. (2014). Interpersonal multisensory stimulation reduces the overwhelming distracting power of self-gaze: psychophysical evidence for "engazement." Sci. Rep. 4:6669. doi: 10.1038/srep06669
76. Quadflieg, S., Mason, M. F., and Macrae, C. N. (2004). The owl and the pussycat: gaze cues and visuospatial orienting. Psychon. Bull. Rev. 11, 826-831. doi: 10.3758/BF03196708
77. Riether, N., Hegel, F., Wrede, B., and Horstmann, G. (2012). "Social facilitation with social robots?," in Proceedings of the Seventh Annual ACM/IEEE International Conference on Human-Robot Interaction, Boston, MA, 41-47.
78. Saygin, A. P., Chaminade, T., Ishiguro, H., Driver, J., and Frith, C. (2012). The thing that should not be: predictive coding and the uncanny valley in perceiving human and humanoid robot actions. Soc. Cogn. Affect. Neurosci. 7, 413-422. doi: 10.1093/scan/nsr025
79. Sidner, C. L., Kidd, C. D., Lee, C., and Lesh, N. (2004). "Where to look: a study of human-robot engagement," in Proceedings of the 9th International Conference on Intelligent User Interfaces, (New York, NY: ACM Press), 78-84.
80. Staudte, M., and Crocker, M. W. (2011). Investigating joint attention mechanisms through spoken human-robot interaction. Cognition 120, 268-291. doi: 10.1016/j.cognition.2011.05.005
81. Süßenbach, F., and Schönbrodt, F. (2014). Not afraid to trust you: trustworthiness moderates gaze cueing but not in highly anxious participants. J. Cogn. Psychol. 26, 670-678. doi: 10.1080/20445911.2014.945457
82. Teufel, C., Alexis, D. M., Todd, H., Lawrance-Owen, A. J., Clayton, N. S., and Davis, G. (2009). Social cognition modulates the sensory coding of observed gaze direction. Curr. Biol. 19, 1274-1277. doi: 10.1016/j.cub.2009. 05.069
83. Tipples, J. (2006). Fear and fearfulness potentiate automatic orienting to eye gaze. Cogn. Emot. 20, 309-320. doi: 10.1080/02699930500405550
84. Tung, F. (2011). "Influence of gender and age on the attitudes of children towards humanoid robots," in Proceedings of the 14th International Conference on Human-Computer Interaction: Users and Applications, Orlando, FL, 637-646. doi: 10.1007/978-3-642-21619-0_76
85. Vecera, S. P., and Rizzo, M. (2006). Eye gaze does not produce reflexive shifts of attention: evidence from frontal-lobe damage. Neuropsychologia 44, 150-159. doi: 10.1016/j.neuropsychologia.2005.04.010
86. Waytz, A., Heafner, J., and Epley, N. (2014). The mind in the machine: Anthropomorphism increases trust in an autonomous vehicle. J. Exp. Soc. Psychol. 52, 113-117. doi: 10.1016/j.jesp.2014.01.005
87. Waytz, A., Morewedge, C. K., Epley, N., Monteleone, G., Gao, J.-H., and Cacioppo, J. T. (2010). Making sense by making sentient: effectance motivation increases anthropomorphism. J. Pers. Soc. Psychol. 99, 410-435. doi: 10.1037/a0020240
88. Weis, P., and Wiese, E. (2017). "Cognitive conflict as possible origin of the uncanny valley," in Proceedings of Human Factors and Ergonomics Society, Santa Monica, CA.
89. Wiese, E., Wykowska, A., and Müller, H. J. (2014). What we observe is biased by what other people tell us: beliefs about the reliability of gaze behavior modulate attentional orienting to gaze cues. PLoS ONE 9:4. doi: 10.1371/journal.pone. 0094529
90. Wiese, E., Wykowska, A., Zwickel, J., and Müller, H. J. (2012). I see what you mean: how attentional selection is shaped by ascribing intentions to others. PLoS ONE 7:e45391. doi: 10.1371/journal.pone.0045391
91. Woods, S., Dautenhahn, K., and Kaouri, C. (2005). "Is someone watching me? Consideration of social facilitation effects in human-robot interaction experiments," in Proceedings of 2015 IEEE International Symposium on Computational Intelligence in Robotics and Automation, Espoo, 53-60.
92. Wykowska, A., Kajopoulos, J., Obando-Leitón, M., Chauhan, S. S., Cabibihan, J. J., and Cheng, G. (2017). Humans are well tuned to detecting agents among non-agents: examining the sensitivity of human perception to behavioral characteristics of intentional systems. Int. J. Soc. Robot. 7, 767-781. doi: 10.1007/ s12369-015-0299-6
93. Wykowska, A., Wiese, E., Prosser, A., and Müller, H. J. (2014). Beliefs about the minds of others influence how we process sensory information. PLoS ONE 9:4. doi: 10.1371/journal.pone.0094339
94. Yamazaki, A., Yamazaki, K., Burdelski, M., and Kuno, Y. (2010). Coordination of verbal and non-verbal actions in human-robot interaction at museums and exhibitions. J. Pragmat. 42, 2398-2414. doi: 10.1016/j.pragma.2009. 12.023