Investigating alterations of social interaction in psychiatric disorders with dual interactive eye tracking and virtual faces

Frontiers in Human Neuroscience

Volumn 8, Issue , 2014, Pages

  Timmermans, Bert ^a   Schilbach, Leonhard ^b  

^a UNIVERSITY OF ABERDEEN   (United Kingdom)

^b UNIVERSITY HOSPITAL OF COLOGNE   (Germany)

Author keywords

Anthropomorphic avatars; Autism; Eye tracking; Schizophrenia; Social interaction

Indexed keywords

ARTICLE; ASSOCIATION; ATTENTION DEFICIT DISORDER; AUTISM; BORDERLINE STATE; COMPUTER SIMULATION; DISEASE ASSOCIATION; EYE TRACKING; FACE PROFILE; FEEDBACK SYSTEM; GAZE; HUMAN; MEDICAL RESEARCH; MENTAL DISEASE; MENTAL TASK; PSYCHOSOCIAL ENVIRONMENT; SCHIZOPHRENIA; SOCIAL BEHAVIOR; SOCIAL COGNITION; SOCIAL INTERACTION; TASK PERFORMANCE; VIRTUAL REALITY; VISUAL STIMULATION;

EID: 84933672131     PISSN: None     EISSN: 16625161     Source Type: Journal    
DOI: 10.3389/fnhum.2014.00758     Document Type: Article

References (34)

1. American Psychiatric Association. (2013). Diagnostic and Statistical Manual of Mental Disorders, 5th Edn. Arlington, VA: America Psychiatric Publishing.
2. Armstrong, T., and Olatunji, B. O. (2012). Eye tracking of attention in the affective disorders: a metaanalytic review and synthesis. Clin. Psychol. Rev. 32, 704-723. doi:10.1016/j.cpr.2012.09.004
3. Bailenson, J. N., Blascovich, J., Beall, A. C., and Loomis, J. M. (2003). Interpersonal distance in immersive virtual environments. Pers. Soc. Psychol. Bull. 29, 819-833. doi:10.1177/0146167203029007002
4. Barišic, I., Timmermans, B., Pfeiffer, U. J., Bente, G., Vogeley, K., and Schilbach, L. (2013). "Using dual eye-tracking to investigate real time social interactions," in Proceedings of the "Gaze Interaction in the Post-WIMP World" Workshop at CHI2013. Available from: http://gaze-interaction.net/wp-system/wp-content/uploads/2013/04/BTP+13.pdf
5. Bell, V. (2013). A community of one: social cognition and auditory verbal hallucinations. PLoS Biol. 11:e1001732. doi:10.1371/journal.pbio.1001723
6. Benson, P. J., Beedie, S. A., Shephard, E., Giegling, I., Rujescu, D., and St Clair, D. (2012). Simple viewing tests can detect eye movement abnormalities that distinguish schizophrenia cases from controls with exceptional accuracy. Biol. Psychiatry 72, 716-724. doi:10.1016/j.biopsych.2012.04.019
7. Bente, G., Eschenburg, F., and Krämer, N. C. (2007). "Virtual gaze. A pilot study on the effects of computer simulated gaze in avatar-based conversations," in Virtual Reality, ed. R. Shumaker (Berlin: Springer), 185-194.
8. Carletta, J., Hill, R. L., Nicol, C., Taylor, T., de Ruiter, J. P., and Bard, E. G. (2010). Eyetracking for two-person tasks with manipulation of a virtual world. Behav. Res. Methods 42, 254-265. doi:10.3758/BRM.42.1.254
9. Cohen, J. D., Barch, D. M., Carter, C., and Servan-Schreiber, D. (1999). Context-processing deficits in schizophrenia: converging evidence from three theoretically motivated cognitive tasks. J. Abnorm. Psychol. 108, 120-133. doi:10.1037/0021-843X.108.1.120
10. Dalmaso, M., Galfano, G., Tarqui, L., Forti, B., and Castelli, L. (2013). Is social attention impaired in schizophrenia? Gaze, but not pointing gestures, is associated with spatial attention deficits. Neuropsychology 27, 608-613. doi:10.1037/a0033518
11. Fitzpatrick, P., Richardson, M. J., and Schmidt, R. C. (2013). Dynamical methods for evaluating the time-dependent unfolding of social coordination in children with autism. Front. Integr. Neurosci. 7:21. doi:10.3389/fnint.2013.00021
12. Gergely, G. (2001). The obscure object of desire: "nearly, but clearly not, like me": contingency preference in normal children versus children with autism. Bull. Menninger Clin. 65, 411-426. doi:10.1521/bumc.65.3.411.19853
13. Gillath, O., McCall, C., Shaver, P. R., and Blascovich, J. (2008). What can virtual reality teach us about prosocial tendencies in real and virtual environments? Med. Psychol. 11, 259-282. doi:10.1080/15213260801906489
14. Hoyt, C. L., Blascovich, J., and Swinth, K. R. (2003). Social inhibition in immersive virtual environments. Psychon. Bull. Rev. 12, 183-195. doi:10.1162/105474603321640932
15. Klin, A., Lin, D. J., Gorrindo, P., Ramsay, G., and Jones, W. (2009). Two-year-olds with autism orient to non-social contingencies rather than biological motion. Nature 459, 257-261. doi:10.1038/nature07868
16. Kohls, G., Chevallier, C., Troiani, V., and Schultz, R. T. (2012). Social "wanting" dysfunction in autism: neurobiological underpinnings and treatment implications. J. Neurodev. Disord. 4, 10. doi: 10.1186/1866-1955-4-10
17. Lahiri, U., Trewyn, A., Warren, Z., and Sarkar, N. (2011a). Dynamic eye gaze and its potential in virtual reality based applications for children with autism spectrum disorders. Autism Open Access 1, 1000101. doi:10.4172/2165-7890.1000101
18. Lahiri, U., Warren, Z., and Sarkar, N. (2011b). Design of a gaze-sensitive virtual social interactive system for children with autism. IEEE Trans. Neural Syst. Rehabil. Eng. 19, 443-452. doi:10.1109/TNSRE.2011.2153874
19. Lumsden, J., Miles, L. K., Richardson, M. J., Smith, C. A., and Macrae, C. N. (2012). Who syncs? Social motives and interpersonal coordination. J. Exp. Soc. Psychol. 48, 746-751. doi:10.1016/j.jesp.2011.12.007
20. Miles, L. K., Nind, L. K., and Macrae, C. N. (2009). The rhythm of rapport: interpersonal synchrony and social perception. J. Exp. Soc. Psychol. 45, 585-589. doi:10.1016/j.jesp.2009.02.002
21. Neider, M. B., Chen, X., Dickinson, C. A., Brennan, S. E., and Zelinsky, G. J. (2010). Coordinating spatial referencing using shared gaze. Psychon. Bull. Rev. 17, 718-724. doi:10.3758/PBR.17.5.718
22. Pfeiffer, U. J., Schilbach, L., Timmermans, B., Kuzmanovic, B., Georgescu, A. L., Bente, G., et al. (2014). Why we interact: activation of the ventral striatum during real-time social interaction. Neuroimage 101, 124-137. doi:10.1016/j.neuroimage.2014.06.061
23. Pfeiffer, U. J., Timmermans, B., Bente, G., Vogeley, K., and Schilbach, L. A. (2011). Non-verbal turing test: differentiating mind from machine in gaze-based social interaction. PLoS ONE 6:e27591. doi:10.1371/journal.pone.0027591
24. Redcay, E., Dodell-Feder, D., Pearrow, M. J., Mavros, P. L., Kleiner, M., Gabrieli, J. D., et al. (2010). Live face-to-face interaction during fMRI: a new tool for social cognitive neuroscience. Neuroimage 50, 1639-1647. doi:10.1016/j.neuroimage.2010.01.052
25. Richardson, D. C., and Dale, R. (2005). Looking to understand: the coupling between speakers’ and listeners’ eye movements and its relationship to discourse comprehension. Cogn. Sci. 29, 1045-1060. doi:10.1207/s15516709cog0000_29
26. Sangin, M., Molinari, G., Nüssli, M.-A., and Dillenbourg, P. (2008). "How learners use awareness cues about their peer’s knowledge? Insights from synchronized eye-tracking data," in Proceedings of the Eight International Conference for the Learning Sciences, eds G. Kanselaar, J. van Merriënboer, P. Kirschner, and T. de Jong (Utrecht: International Conference of the Learning Sciences), 287-294.
27. Schilbach, L., Eickhoff, S. B., Cieslik, E., Kuzmanovic, B., and Vogeley, K. (2012). Shall we do this together? Social gaze influences action control in a comparison group, but not in individuals with high-functioning autism. Autism 16, 151-162. doi: 10.1177/1362361311409258
28. Schilbach, L., Timmermans, B., Reddy, V., Costall, A., Bente, G., Schlicht, T., et al. (2013). Toward a second-person neuroscience. Behav. Brain Sci. 36, 393-414; discussion 414-41; response 441-62. doi:10.1017/S0140525X12000660
29. Schmitz, N., Rubia, K., van Amelsvoort, T., Daly, E., Smith, A., and Murphy, D. G. (2008). Neural correlates of reward in autism. Br. J. Psychiatry 192, 19-24. doi:10.1192/bjp.bp.107.036921
30. Slater, M., Lotto, B., Arnold, M. M., and Sanchez-Vives, M. V. (2009). How we experience immersive virtual environments: the concept of presence and its measurement. Annu. Psicol. 40, 193-210.
31. Sweeney, J. A., Strojwas, M. H., Mann, J. J., and Thase, M. E. (1998). Prefrontal and cerebellar abnormalities in major depression. Evidence from oculomotor studies. Biol. Psychiatry 43, 584-594. doi:10.1016/S0006-3223(97)00485-X
32. Tso, I. F., Mui, M. L., Taylor, S. F., and Deldin, P. J. (2012). Eye-contact perception in schizophrenia: relationship with symptoms and socioemotional functioning. J. Abnorm. Psychol. 121, 616-627. doi:10.1037/a0026596
33. Wilms, M., Schilbach, L., Pfeiffer, U., Bente, G., Fink, G. R., and Vogeley, K. (2010). It’s in your eyesusing gaze contingent stimuli to create truly interactive paradigms for social cognitive and affective neuroscience. Soc. Cogn. Affect. Neurosci. 5, 98-107. doi:10.1093/scan/nsq024
34. Wright, A. G. C., Hallquist, M. N., Beeney, J. E., and Pilkonis, P. A. (2013). Borderline personality pathology and the stability of interpersonal problems. J. Abnorm. Psychol. 122, 1094-1100. doi:10.1037/a0034658