Virtual reality for enhanced ecological validity and experimental control in the clinical, affective and social neurosciences

Frontiers in Human Neuroscience

Volumn 9, Issue DEC, 2015, Pages

  Parsons, Thomas D ^a  

^a UNIVERSITY OF NORTH TEXAS   (United States)

Author keywords

Ecological validity; Neuropsychological tests; Neuropsychology; Social neuroscience; Virtual reality

Indexed keywords

ECOLOGICAL VALIDITY; HUMAN; HUMAN EXPERIMENT; NARRATIVE; NEUROSCIENCE; SCIENTIST; SOCIAL INTERACTION; STIMULUS; VIRTUAL REALITY;

EID: 84954052814     PISSN: None     EISSN: 16625161     Source Type: Journal    
DOI: 10.3389/fnhum.2015.00660     Document Type: Article

References (197)

1. Adams, R., Finn, P., Moes, E., Flannery, K., and Rizzo, A. S. (2009). Distractibility in attention/deficit/hyperactivity disorder (ADHD): the virtual reality classroom. Child Neuropsychol. 15, 120–135. doi: 10.1080/09297040802169077
2. Adolphs, R. (2003). Cognitive neuroscience: cognitive neuroscience of human social behavior. Nat. Rev. Neurosci. 4, 165–178. doi: 10.1038/nrn1056
3. Adolphs, R. (2009). The social brain: neural basis of social knowledge. Annu. Rev. Psychol. 60:693. doi: 10.1146/annurev.psych.60.110707.163514
4. Adolphs, R. (2010). Conceptual challenges and directions for social neuroscience. Neuron 65, 752–767. doi: 10.1016/j.neuron.2010.03.006
5. Alderman, N., Burgess, P. W., Knight, C., and Henman, C. (2003). Ecological validity of a simplified version of the multiple errands shopping test. J. Int. Neuropsychol. Soc. 9, 31–44. doi: 10.1017/s1355617703910046
6. Alvarez, R. P., Biggs, A., Chen, G., Pine, D. S., and Grillon, C. (2008). Contextual fear conditioning in humans: cortical-hippocampal and amygdala contributions. J. Neurosci. 28, 6211–6219. doi: 10.1523/JNEUROSCI.1246-08.2008
7. Alvarez, R. P., Johnson, L., and Grillon, C. (2007). Contextual-specificity of short-delay extinction in humans: renewal of fear-potentiated startle in a virtual environment. Learn. Mem. 14, 247–253. doi: 10.1101/lm.493707
8. Armstrong, C., Reger, G., Edwards, J., Rizzo, A., Courtney, C., and Parsons, T. D. (2013). Validity of the virtual reality stroop task (VRST) in active duty military. J. Clin. Exp. Neuropsychol. 35, 113–123. doi: 10.1080/13803395.2012.740002
9. Asimakopulos, J., Boychuck, Z., Sondergaard, D., Poulin, V., Ménard, I., and Korner-Bitensky, N. (2012). Assessing executive function in relation to fitness to drive: a review of tools and their ability to predict safe driving. Aust. Occup. Ther. J. 59, 402–427. doi: 10.1111/j.1440-1630.2011.00963.x
10. Baas, J. M. P., van Ooijen, L., Goudriaan, A., and Kenemans, J. L. (2008). Failure to condition to a cue is associated with sustained contextual fear. Acta Psychol. (Amst) 127, 581–592. doi: 10.1016/j.actpsy.2007.09.009
11. Baddeley, A. (1981). The cognitive psychology of everyday life. Br. J. Psychol. 72, 257–269. doi: 10.1111/j.2044-8295.1981.tb02184.x
12. Baddeley, A. (2012). “How does emotion influence working memory?” in Attention, Representation, and Human Performance: Integration of Cognition, Emotion, and Motivation, eds S. di Masmou, D. Y. Dai, and A. Naceur (New York, NY: Psychology Press), 3–18.
13. Banaji, M. R., and Crowder, R. G. (1989). The bankruptcy of everyday memory. Am. Psychol. 44, 1185–1193. doi: 10.1037/0003-066x.44.9.1185
14. Banakou, D., Groten, R., and Slater, M. (2013). Illusory ownership of a virtual child body causes overestimation of object sizes and implicit attitude changes. Proc. Natl. Acad. Sci. U S A 110, 12846–12851. doi: 10.1073/pnas.1306779110
15. Bauer, R. M., Iverson, G. L., Cernich, A. N., Binder, L. M., Ruff, R. M., and Naugle, R. I. (2012). Computerized neuropsychological assessment devices: joint position paper of the american academy of clinical neuropsychology and the national academy of neuropsychology. Clin. Neuropsychol. 26, 177–196. doi: 10.1080/13854046.2012.663001
16. Bayless, J. D., Varney, N. R., and Roberts, R. J. (1989). Tinker toy test performance and vocational outcome in patients with closed-head injuries. J. Clin. Exp. Neuropsychol. 11, 913–917. doi: 10.1080/01688638908400944
17. Becchio, C., Sartori, L., and Castiello, U. (2010). Toward you: the social side of actions. Curr. Dir. Psychol. Sci. 19, 183–188. doi: 10.1177/0963721410370131
18. Bechara, A. (2007). Iowa Gambling Task Professional Manual. Lutz, FL: Psychological Assessment Resources, Inc.
19. Bechara, A., and Damasio, A. R. (2005). The somatic marker hypothesis: a neural theory of economic decision. Games Econ. Behav. 52, 336–372. doi: 10.1016/j.geb.2004.06.010
20. Bechara, A., Damasio, A. R., Damasio, H., and Anderson, S. W. (1994). Insensitivity to future consequences following damage to human prefrontal cortex. Cognition 50, 7–15. doi: 10.1016/0010-0277(94)90018-3
21. Bechara, A., Damasio, H., Damasio, A. R., and Lee, G. P. (1999). Different contributions of the human amygdala and ventromedial prefrontal cortex to decision-making. J. Neurosci. 19, 5473–5481.
22. Bechara, A., Damasio, H., Tranel, D., and Anderson, S. W. (1998). Dissociation of working memory from decision making within the human prefrontal cortex. J. Neurosci. 18, 428–437.
23. Bechara, A., Damasio, H., Tranel, D., and Damasio, A. R. (1997). Deciding advantageously before knowing the advantageous strategy. Science 275, 1293–1295. doi: 10.1126/science.275.5304.1293
24. Bechara, A., Tranel, D., and Damasio, H. (2000). Characterization of the decision-making deficit of patients with ventromedial prefrontal cortex lesions. Brain 123, 2189–2202. doi: 10.1093/brain/123.11.2189
25. Bechara, A., Tranel, D., Damasio, H., and Damasio, A. R. (1996). Failure to respond autonomically to anticipated future outcomes following damage to prefrontal cortex. Cereb. Cortex 6, 215–225. doi: 10.1093/cercor/6.2.215
26. Berthoz, S., Armony, J. L., Blair, R. J. R., and Dolan, R. J. (2002). An fMRI study of intentional and unintentional (embarrassing) violations of social norms. Brain 125, 1696–1708. doi: 10.1093/brain/awf190
27. Betella, A., Zucca, R., Cetnarski, R., Greco, A., Lanatà, A., Mazzei, D., et al. (2014). Inference of human affective states from psychophysiological measurements extracted under ecologically valid conditions. Front. Neurosci. 8:286. doi: 10.3389/fnins.2014.00286
28. Bioulac, S., Lallemand, S., Rizzo, A., Philip, P., Fabrigoule, C., and Bouvard, M. P. (2012). Impact of time on task on ADHD patient’s performances in a virtual classroom. Eur. J. Paediatr. Neurol. 16, 514–521. doi: 10.1016/j.ejpn.2012.01.006
29. Blair, R. J., Morris, J. S., Frith, C. D., Perrett, D. I., and Dolan, R. J. (1999). Dissociable neural responses to facial expressions of sadness and anger. Brain 122, 883–893. doi: 10.1093/brain/122.5.883
30. Bohil, C. J., Alicea, B., and Biocca, F. A. (2011). Virtual reality in neuroscience research and therapy. Nat. Rev. Neurosci. 12, 752–762. doi: 10.1038/nrn3122
31. Bottari, C., Dassa, C., Rainville, C., and Dutil, E. (2009). The criterion-related validity of the IADL Profile with measures of executive functions, indices of trauma severity and sociodemographic characteristics. Brain Inj. 23, 322–335. doi: 10.1080/02699050902788436
32. Brock, L. L., Rimm-Kaufman, S. E., Nathanson, L., and Grimm, K. J. (2009). The contributions of “hot” and “cool” executive function to children’s academic achievement, learning-related behaviors and engagement in kindergarten. Early Child. Res. Q. 24, 337–349. doi: 10.1016/j.ecresq.2009.06.001
33. Buelow, M. T., and Suhr, J. A. (2009). Construct validity of the iowa gambling task. Neuropsychol. Rev. 19, 102–114. doi: 10.1007/s11065-009-9083-4
34. Burgess, P. W., Alderman, N., Forbes, C., Costello, A., Coates, L., Dawson, D. R., et al. (2006). The case for the development and use of “ecologically valid” measures of executive function in experimental and clinical neuropsychology. J. Int. Neuropsychol. Soc. 12, 194–209. doi: 10.1017/s1355617706060310
35. Buxbaum, L., Dawson, A., and Linsley, D. (2012). Reliability and validity of the virtual reality lateralized attention test in assessing hemispatial neglect in right-hemisphere stroke. Neuropsychology 26, 430–441. doi: 10.1037/a0028674
36. Bzdok, D., Schilbach, L., Vogeley, K., Schneider, K., Laird, A. R., Langner, R., et al. (2012). Parsing the neural correlates of moral cognition: ALE meta-analysis on morality, theory of mind and empathy. Brain Struct. Funct. 217, 783–796. doi: 10.1007/s00429-012-0380-y
37. Cacioppo, S., Frum, C., Asp, E., Weiss, R. M., Lewis, J. W., and Cacioppo, J. T. (2013). A quantitative meta-analysis of functional imaging studies of social rejection. Sci. Rep. 3:2027. doi: 10.1038/srep02027
38. Calhoun, V. D., and Pearlson, G. D. (2012). A selective review of simulated driving studies: combining naturalistic and hybrid paradigms, analysis approaches and future directions. Neuroimage 59, 25–35. doi: 10.1016/j.neuroimage.2011.06.037
39. Campbell, Z., Zakzanis, K. K., Jovanovski, D., Joordens, S., Mraz, R., and Graham, S. J. (2009). Utilizing virtual reality to improve the ecological validity of clinical neuropsychology: an FMRI case study elucidating the neural basis of planning by comparing the Tower of London with a three-dimensional navigation task. Appl. Neuropsychol. 16, 295–306. doi: 10.1080/09084280903297891
40. Cao, X., Douguet, A. S., Fuchs, P., and Klinger, E. (2010). Designing an ecological virtual task in the context of executive functions: a preliminary study. Proceedings of the 8th International Conference on Disability, Virtual Reality and Associated Technologies 31, 71–78.
41. Carter, E. J., and Pelphrey, K. A. (2008). Friend or foe? Brain systems involved in the perception of dynamic signals of menacing and friendly social approaches. Soc. Neurosci. 3, 151–163. doi: 10.1080/17470910801903431
42. Chakrabarti, B. (2013). Parameterising ecological validity and integrating individual differences within second-person neuroscience.Behav. Brain Sci. 36, 414–415. doi: 10.1017/s0140525x12002099
43. Chan, R. C. K., Shum, D., Toulopoulou, T., and Chen, E. Y. H. (2008). Assessment of executive functions: review of instruments and identification of critical issues. Arch. Clin. Neuropsychol. 23, 201–216. doi: 10.1016/j.acn.2007.08.010
44. Chaytor, N., and Schmitter-Edgecombe, M. (2003). The ecological validity of neuropsychological tests: a review of the literature on everyday cognitive skills. Neuropsychol. Rev. 13, 181–197. doi: 10.1023/b:nerv.0000009483.91468.fb
45. Chaytor, N., Schmitter-Edgecombe, M., and Burr, R. (2006). Improving the ecological validity of executive functioning assessment. Arch. Clin. Neuropsychol. 21, 217–227. doi: 10.1016/j.acn.2005.12.002
46. Chelune, G. J., and Moehle, K. A. (1986). “Neuropsychological assessment and everyday functioning,” in The neuropsychology handbook, eds D. Wedding, A. M. Horton and J. Webster (New York, NY: Springer), 489–525.
47. Ciaramelli, E., Muccioli, M., Làdavas, E., and di Pellegrino, G. (2007). Selective deficit in personal moral judgment following damage to ventromedial prefrontal cortex. Soc. Cogn. Affect. Neurosci. 2, 84–92. doi: 10.1093/scan/nsm001
48. Clancy, T. A., Rucklidge, J. J., and Owen, D. (2010). Road-crossing safety in virtual reality: a comparison of adolescents with and without ADHD. J. Clin. Child Adolesc. Psychol. 35, 203–215. doi: 10.1207/s15374424jccp3502_4
49. Climent, G., and Bánterla, F. (2011). Nesplora Classroom, Ecological Assessment of Attentional Processes. Theoretical Manual.Donostia, Spain: Nesplora.
50. Conway, M. A. (1991). In defense of everyday memory. Am. Psychol. 46, 19–26. doi: 10.1037/0003-066x.46.1.19
51. Cook, L., Hanten, G., Orsten, K., Chapman, S., Li, X., Wilde, E., et al. (2013). Effects of moderate to severe traumatic brain injury on anticipating consequences of actions in adults: a preliminary study. J. Int. Neuropsychol. Soc. 19, 508–517. doi: 10.1017/s1355617712001452
52. Courtney, C., Dawson, M., Rizzo, A., Arizmendi, B., and Parsons, T. D. (2013). Predicting navigation performance with psychophysiological responses to threat in a virtual environment. Lecture Notes in Computer Science 8021, 129–138. doi: 10.1007/978-3-642-39405-8_16
53. Cromwell, H. C., and Panksepp, J. (2011). Rethinking the cognitive revolution from a neural perspective: how overuse/misuse of the term ‘cognition’and the neglect of affective controls in behavioral neuroscience could be delaying progress in understanding the BrainMind.Neurosci. Biobehav. Rev. 35, 2026–2035. doi: 10.1016/j.neubiorev.2011.02.008
54. Dawson, D. R., Anderson, N. D., Burgess, P., Cooper, E., Krpan, K. M., and Stuss, D. T. (2009). Further development of the Multiple Errands Test: standardized scoring, reliability and ecological validity for the baycrest version. Arch. Phys. Med. Rehabil. 90, S41–S51. doi: 10.1016/j.apmr.2009.07.012
55. de Wall, C., Wilson, B. A., and Baddeley, A. D. (1994). The extended rivermead behavioral memory test: a measure of everyday memory performance in normal adults. Memory 2, 149–166. doi: 10.1080/09658219408258942
56. Díaz-Orueta, U., Garcia-López, C., Crespo-Eguílaz, N., Sánchez-Carpintero, R., Climent, G., and Narbona, J. (2014). AULA virtual reality test as an attention measure: convergent validity with conners’ continuous performance test. Child Neuropsychol. 20, 328–342. doi: 10.1080/09297049.2013.792332
57. Diemer, J. E., Alpers, G. W., Peperkorn, H. M., Shiban, Y., and Mühlberger, A. (2015). The impact of perception and presence on emotional reactions: a review of research in virtual reality. Front. Psychol. 6:26. doi: 10.3389/fpsyg.2015.00026
58. Dotsch, R., and Wigboldus, D. H. J. (2008). Virtual prejudice. J. Exp. Soc. Psychol. 44, 1194–1198. doi: 10.1016/j.jesp.2008.03.003
59. Dunn, E. J., Searight, H. R., Grisso, T., Margolis, R. B., and Gibbons, J. L. (1990). The relation of the halstead-reitan neuropsychological battery to functional daily living skills in geriatric patients. Arch. Clin. Neuropsychol. 5, 103–117. doi: 10.1016/0887-6177(90)90032-k
60. Eisenberger, N. I. (2012). The neural bases of social pain: evidence for shared representations with physical pain. Psychosom. Med. 74, 126–135. doi: 10.1097/PSY.0b013e3182464dd1
61. Eisenberger, N. I. (2015). Meta-analytic evidence for the role of the anterior cingulate cortex in social pain. Soc. Cogn. Affect. Neurosci.10, 1–2. doi: 10.1093/scan/nsu120
62. Elkind, J. S., Rubin, E., Rosenthal, S., Skoff, B., and Prather, P. (2001). A simulated reality scenario compared with the computerized wisconsin card sorting test: an analysis of preliminary results. Cyberpsychol. Behav. 4, 489–496. doi: 10.1089/109493101750527042
63. Ernst, M., Bolla, K., Mouratidis, M., Contoreggi, C., Matochik, J. A., Kurian, V., et al. (2002). Decision-making in a risk-taking task: a PET study. Neuropsychopharmacology 26, 682–691. doi: 10.1016/s0893-133x(01)00414-6
64. Fahrenberg, J., Myrtek, M., Pawlik, K., and Perrez, M. (2007). Ambulatory assessment-monitoring behavior in daily life settings. Eur. J. Psychol. Assess. 23, 206–213. doi: 10.1027/1015-5759.23.4.206
65. Faur, C., Clavel, C., Pesty, S., and Martin, J.-C. (2013). “PERSEED: a self-based model of personality for virtual agents inspired by socio-cognitive theories,” in Human Association Conference on Affective Computing and Intelligent Interaction, (Geneva: IEEE), 467–472.
66. Franzen, M. D., and Wilhelm, K. L. (1996). “Conceptual foundations of ecological validity in neuropsychological assessment,” in Ecological Validity of Neuropsychological Testing, eds R. J. Sbordone and C. J. Long (Boca Raton, FL: St Lucie Press), 91–112.
67. Freeman, D., Pugh, K., Antley, A., Slater, M., Bebbington, P., Gittins, M., et al. (2008). Virtual reality study of paranoid thinking in the general population. Br. J. Psychiatry 192, 258–263. doi: 10.1192/bjp.bp.107.044677
68. Geniole, S. N., Carré, J. M., and McCormick, C. M. (2011). State, not trait, neuroendocrine function predicts costly reactive aggression in men after social exclusion and inclusion. Biol. Psychol. 87, 137–145. doi: 10.1016/j.biopsycho.2011.02.020
69. Glotzbach, E., Ewald, H., Andreatta, M., Pauli, P., and Mühlberger, A. (2012). Contextual fear conditioning predicts subsequent avoidance behavior in a virtual reality environment. Cogn. Emot. 26, 1256–1272. doi: 10.1080/02699931.2012.656581
70. Glotzbach-Schoon, E., Andreatta, M., Reif, A., Ewald, H., Tröger, C., Baumann, C., et al. (2013). Contextual fear conditioning in virtual reality is affected by 5HTTLPR and NPSR1 polymorphisms: effects on fear-potentiated startle. Front. Behav. Neurosci. 7:31. doi: 10.3389/fnbeh.2013.00031
71. Goel, V., and Dolan, R. J. (2003). Reciprocal neural response within lateral and ventral medial prefrontal cortex during hot and cold reasoning. Neuroimage 20, 2314–2321. doi: 10.1016/j.neuroimage.2003.07.027
72. Goldstein, G. (1996). “Functional considerations in neuropsychology,” in Ecological Validity of Neuropsychological Testing, eds R. J. Sbordone and C. J. Long (Delray Beach, FL: GR Press/St. Lucie Press), 75–89.
73. Gorini, A., Capideville, C. S., DeLeo, G., Mantovani, F., and Riva, G. (2011). The role of immersion and narrative in mediated presence: the virtual hospital experience. Cyberpsychol. Behav. Soc. Netw. 14, 99–105. doi: 10.1089/cyber.2010.0100
74. Grant, S., Bonson, K. R., Contoreggi, C., and London, E. D. (1999). Activation of the ventromedial prefrontal cortex correlates with gambling task performance: a FDG-PET study. Soc. Neurosci. Abstr. 25:1551.
75. Greene, J. D., Morelli, S. A., Lowenberg, K., Nystrom, L. E., and Cohen, J. D. (2008). Cognitive load selectively interferes with utilitarian moral judgment. Cognition 107, 1144–1154. doi: 10.1016/j.cognition.2007.11.004
76. Greene, J. D., Nystrom, L. E., Engell, A. D., Darley, J. M., and Cohen, J. D. (2004). The neural bases of cognitive conflict and control in moral judgment. Neuron 44, 389–400. doi: 10.1016/j.neuron.2004.09.027
77. Greene, J. D., Sommerville, R. B., Nystrom, L. E., Darley, J. M., and Cohen, J. D. (2001). An fMRI investigation of emotional engagement in moral judgment. Science 293, 2105–2108. doi: 10.1126/science.1062872
78. Gunther Moor, B., Crone, E. A., and van der Molen, M. W. (2010). The heartbrake of social rejection heart rate deceleration in response to unexpected peer rejection. Psychol. Sci. 21, 1326–1333. doi: 10.1177/0956797610379236
79. Hari, R., and Kujala, M. V. (2009). Brain basis of human social interaction: from concepts to brain imaging. Physiol. Rev. 89, 453–479. doi: 10.1152/physrev.00041.2007
80. Heaton, R. K., Chelune, G. J., Talley, J. L., Kay, G. G., and Curtiss, G. (1993). Wisconsin Card Sorting Test Manual. Revised and Expanded. Odessa, FL: Psychological Assessment Resources.
81. Henry, M., Joyal, C. C., and Nolin, P. (2012). Development and initial assessment of a new paradigm for assessing cognitive and motor inhibition: the bimodal virtual-reality Stroop. J. Neurosci. Methods 210, 125–131. doi: 10.1016/j.jneumeth.2012.07.025
82. Hinson, J. M., Jameson, T. L., and Whitney, P. (2002). Somatic markers, working memory and decision making. Cogn. Affect. Behav. Neurosci. 2, 341–353. doi: 10.3758/cabn.2.4.341
83. Hinson, J. M., Jameson, T. L., and Whitney, P. (2003). Impulsive decision making and working memory. J. Exp. Psychol. Learn. Mem. Cogn. 29, 298–306. doi: 10.1037/0278-7393.29.2.298
84. Iacoboni, M., Lieberman, M. D., Knowlton, B. J., Molnar-Szakacs, I., Moritz, M., Throop, C. J., et al. (2004). Watching social interactions produces dorsomedial prefrontal and medial parietal BOLD fMRI signal increases compared to a resting baseline. Neuroimage 21, 1167–1173. doi: 10.1016/j.neuroimage.2003.11.013
85. Iriarte, Y., Diaz-Orueta, U., Cueto, E., Irazustabarrena, P., Banterla, F., and Climent, G. (2012). AULA-advanced virtual reality tool for the assessment of attention: normative study in Spain. J. Atten. Disord. doi: 10.1177/1087054712465335 [Epub ahead of print].
86. Jansari, A. S., Froggatt, D., Edginton, T., and Dawkins, L. (2013). Investigating the impact of nicotine on executive functions using a novel virtual reality assessment. Addiction 108, 977–984. doi: 10.1111/add.12082
87. Jovanovski, D., Zakzanis, K., Campbell, Z., Erb, S., and Nussbaum, D. (2012a). Development of a novel, ecologically oriented virtual reality measure of executive function: the multitasking in the city test. Appl. Neuropsychol. Adult 19, 171–182. doi: 10.1080/09084282.2011.643955
88. Jovanovski, D., Zakzanis, K., Ruttan, L., Campbell, Z., Erb, S., and Nussbaum, D. (2012b). Ecologically valid assessment of executive dysfunction using a novel virtual reality task in patients with acquired brain injury. Appl. Neuropsychol. Adult 19, 207–220. doi: 10.1080/09084282.2011.643956
89. Kallinen, K., Salminen, M., Ravaja, N., Kedzior, R., and Sääksjärvi, M. (2007). “Presence and emotion in computer game players during 1st person vs. 3rd person playing view: evidence from self-report, eye-tracking and facial muscle activity data,” in Proceedings of the PRESENCE, (Barcelona), 187–190.187–190.
90. Kassner, M. P., Wesselmann, E. D., Law, A. T., and Williams, K. D. (2012). Virtually ostracized: studying ostracism in immersive virtual environments. Cyberpsychol. Behav. Soc. Netw. 15, 399–403. doi: 10.1089/cyber.2012.0113
91. Kennedy, R. S., Stanney, K. M., and Dunlap, W. P. (2000). Duration and exposure to virtual environments: sickness curves during and across sessions. Presence Teleoperators Virtual Environ. 9, 463–472. doi: 10.1162/105474600566952
92. Kerr, A., and Zelazo, P. D. (2004). Development of hot executive function: the children’s gambling task. Brain Cogn. 55, 148–157. doi: 10.1016/s0278-2626(03)00275-6
93. Keshavarz, B., and Hecht, H. (2011). Validating an efficient method to quantify motion sickness. Hum. Factors 53, 415–426. doi: 10.1177/0018720811403736
94. Klinger, E., Bouchard, S., Légeron, P., Roy, S., Lauer, F., Chemin, I., et al. (2005). Virtual reality therapy versus cognitive behavior therapy for social phobia: a preliminary controlled study. Cyberpsychol. Behav. 8, 76–88. doi: 10.1089/cpb.2005.8.76
95. Knight, C., Alderman, N., and Burgess, P. W. (2002). Development of a simplified version of the multiple errands test for use in hospital settings. Neuropsychol. Rehabil. 12, 231–255. doi: 10.1080/09602010244000039
96. Koenigs, M., Young, L., Adolphs, R., Tranel, D., Cushman, F. A., Hauser, M. D., et al. (2007). Damage to the prefrontal cortex increases utilitarian moral judgments. Nature 446, 908–911. doi: 10.1038/nature05631
97. Kohler, C. G., Walker, J. B., Martin, E. A., Healey, K. M., and Moberg, P. J. (2010). Facial emotion perception in schizophrenia: a meta-analytic review. Schizophr. Bull. 36, 1009–1019. doi: 10.1093/schbul/sbn192
98. Kokal, I., Gazzola, V., and Keysers, C. (2009). Acting together in and beyond the mirror neuron system. Neuroimage 47, 2046–2056. doi: 10.1016/j.neuroimage.2009.06.010
99. Lalonde, G., Henry, M., Drouin-Germain, A., Nolin, P., and Beauchamp, M. H. (2013). Assessment of executive function in adolescence: a comparison of traditional and virtual reality tools. J. Neurosci. Methods 219, 76–82. doi: 10.1016/j.jneumeth.2013.07.005
100. Lamberts, K., Evans, J., and Spikman, J. (2009). A real-life, ecologically valid test of executive functioning: the executive secretarial task.J. Clin. Exp. Neuropsychol. 32, 56–65. doi: 10.1080/13803390902806550
101. Lieberman, M. D., and Eisenberger, N. I. (2009). Neuroscience. Pains and pleasures of social life. Science 323, 890–891. doi: 10.1126/science.1170008
102. Lieberman, M. D., Eisenberger, N. I., Crockett, M. J., Tom, S. M., Pfeifer, J. H., and Way, B. M. (2007). Putting feelings into words: affect labeling disrupts amygdala activity in response to affective stimuli. Psychol. Sci. 18, 421–428. doi: 10.1111/j.1467-9280.2007.01916.x
103. Logie, R. H., Trawley, S., and Law, A. (2011). Multitasking: multiple, domain-specific cognitive functions in a virtual environment. Mem. Cognit. 39, 1561–1574. doi: 10.3758/s13421-011-0120-1
104. Lysaker, P., Bell, M., and Bean-Goulet, J. (1995). Wisconsin Card Sorting Test and work performance in schizophrenia. Psychiatry Res.56, 45–51. doi: 10.1016/0165-1781(94)02641-u
105. Macedonio, M., Parsons, T. D., DiGiuseppe, R. A., Weiderhold, B. K., and Rizzo, A. A. (2007). Immersiveness and physiological arousal within panoramic video-based virtual reality. Cyberpsychol. Behav. 10, 508–516. doi: 10.1089/cpb.2007.9997
106. Maister, L., Sebanz, N., Knoblich, G., and Tsakiris, M. (2013). Experiencing ownership over a dark-skinned body reduces implicit racial bias. Cognition 128, 170–178. doi: 10.1016/j.cognition.2013.04.002
107. Maister, L., Slater, M., Sanchez-Vives, M. V., and Tsakiris, M. (2015). Changing bodies changes minds: owning another body affects social cognition. Trends Cogn. Sci. 19, 6–12. doi: 10.1016/j.tics.2014.11.001
108. Manchester, D., Priestley, N., and Howard, J. (2004). The assessment of executive functions: coming out of the office. Brain Inj. 18, 1067–1081. doi: 10.1080/02699050410001672387
109. Marcotte, T. D., and Grant, I. eds. (2009). Neuropsychology of Everyday Functioning. New York, NY: Guilford Press.
110. Masmoudi, S., Dai, D. Y., and Naceur, A. (2012). Attention, Representation and Human Performance: Integration of Cognition, Emotion and Motivation. New York, NY: Psychology Press.
111. Matheis, R. J., Schultheis, M. T., Tiersky, L. A., DeLuca, J., Millis, S. R., and Rizzo, A. (2007). Is learning and memory different in a virtual environment? Clin. Neuropsychol. 21, 146–161. doi: 10.1080/13854040601100668
112. McGeorge, P., Phillips, L. H., Crawford, J. R., Garden, S. E., Sala, S. D., and Milne, A. B. (2001). Using virtual environments in the assessment of executive dysfunction. Presence Teleoperators Virtual Environ. 10, 375–383. doi: 10.1162/1054746011470235
113. Milner, B. (1963). Effects of different brain lesions on card sorting: the role of the frontal lobes. Arch. Nurol. 9, 90–100. doi: 10.1001/archneur.1963.00460070100010
114. Montague, P. R., Berns, G. S., Cohen, J. D., McClure, S. M., Pagnoni, G., Dhamala, M., et al. (2002). Hyperscanning: simultaneous fMRI during linked social interactions. Neuroimage 16, 1159–1164. doi: 10.1006/nimg.2002.1150
115. Montgomery, C., Ashmore, K., and Jansari, A. (2011). The effects of a modest dose of alcohol on executive functioning and prospective memory. Hum. Psychopharmacol. 26, 208–215. doi: 10.1002/hup.1194
116. Morris, J. S., Frith, C. D., Perrett, D. I., Rowland, D., Young, A. W., Calder, A. J., et al. (1996). A differential neural response in the human amygdala to fearful and happy facial expressions. Nature 383, 812–815. doi: 10.1038/383812a0
117. Morris, R. G., Kotitsa, M., Bramham, J., Brooks, B. M., and Rose, F. D. (2002). “Virtual reality investigation of strategy formation, rule breaking and prospective memory in patients with focal prefrontal neurosurgical lesions,” in Proceedings of the 4th International Conference on Disability, Virtual Reality and Associated Technologies, Veszprém.
118. Mühlberger, A., Bülthoff, H., Wiedemann, G., and Pauli, P. (2007). Virtual reality for the psychophysiological assessment of phobic fear: responses during virtual tunnel driving. Psychol. Assess. 19, 340–346. doi: 10.1037/1040-3590.19.3.340
119. Mühlberger, A., Wieser, M. J., and Pauli, P. (2008). Darkness-enhanced startle responses in ecologically valid environments: a virtual tunnel driving experiment. Biol. Psychol. 77, 47–52. doi: 10.1016/j.biopsycho.2007.09.004
120. Navarrete, C. D., McDonald, M. M., Mott, M. L. and Asher, B. (2012). Virtual morality: emotion and action in a simulated three-dimensional “trolley problem”. Emotion 12, 364–370. doi: 10.1037/a0025561
121. Neisser, U. (1980). On “social knowing”. Pers. Soc. Psychol. Bull. 6, 601–605. doi: 10.1177/014616728064012
122. Neisser, U. (1982). “Memory: what are the important questions,” in Memory Observed: Remembering in Natural Contexts, eds U. Neisser (San Francisco: Freeman), 3–19.
123. Newman-Norlund, R. D., Bosga, J., Meulenbroek, R. G., and Bekkering, H. (2008). Anatomical substrates of cooperative joint-action in a continuous motor task: virtual lifting and balancing. Neuroimage 41, 169–177. doi: 10.1016/j.neuroimage.2008.02.026
124. Nigg, J. T. (2000). On inhibition/Disinhibition in developmental psychopathology: views from cognitive and personality psychology and a working inhibition taxonomy. Psychol. Bull. 126, 220–246. doi: 10.1037/0033-2909.126.2.220
125. Nigg, J. T. (2003). Response inhibition and disruptive behaviors. Ann. N Y Acad. Sci. 1008, 170–182. doi: 10.1196/annals.1301.018
126. Nigg, J. T. (2006). Temperament and developmental psychopathology. J. Child Psychol. Psychiatry 47, 395–422. doi: 10.1111/j.1469-7610.2006.01612.x
127. Normand, J. M., Giannopoulos, E., Spanlang, B., and Slater, M. (2011). Multisensory stimulation can induce an illusion of larger belly size in immersive virtual reality. PLoS One 6:e16128. doi: 10.1371/journal.pone.0016128
128. Nyhus, E., and Barceló, F. (2009). The Wisconsin card sorting test and the cognitive assessment of prefrontal executive functions: a critical update. Brain Cogn. 71, 437–451. doi: 10.1016/j.bandc.2009.03.005
129. Ochsner, K. N. (2004). Current directions in social cognitive neuroscience. Curr. Opin. Neurobiol. 14, 254–258. doi: 10.1016/j.conb.2004.03.011
130. Ord, J. S., Greve, K. W., Bianchini, K. J., and Aguerrevere, L. E. (2010). Executive dysfunction in traumatic brain injury: the effects of injury severity and effort on the Wisconsin card sorting test. J. Clin. Exp. Neuropsychol. 32, 132–140. doi: 10.1080/13803390902858874
131. Panksepp, J. (2005). On the embodied neural nature of core emotional affects. J. Conscious. Stud. 12, 158–184.
132. Panksepp, J. (2007). “Affective consciousness,” in The blackwell Companion to Consciousness, eds Velmans M. and Schneider S. (Malden, MA: Wiley-Blackwell), 114–129.
133. Panksepp, J. (2009). Primary process affects and brain oxytocin. Biol. Psychiatry 65, 725–727. doi: 10.1016/j.biopsych.2009.02.004
134. Panksepp, J. (2010). Affective neuroscience of the emotional brainmind: evolutionary perspectives and implications for understanding depression. Dialogues Clin. Neurosci. 12, 533–545.
135. Pan, X., and Slater, M. (2011). “Confronting a moral dilemma in virtual reality: a pilot study,” in Proceedings of the 25th BCS Conference on Human-Computer Interaction, (Swinton: British Computer Society), 46–51
136. Parsey, C. M., and Schmitter-Edgecombe, M. (2013). Applications of technology in neuropsychological assessment. Clin. Neuropsychol.27, 1328–1361. doi: 10.1080/13854046.2013.834971
137. Parsons, T. D., Bowerly, T., Buckwalter, J. G., and Rizzo, A. A. (2007). A controlled clinical comparison of attention performance in children with ADHD in a virtual reality classroom compared to standard neuropsychological methods. Child Neuropsychol. 13, 363–381. doi: 10.1080/13825580600943473
138. Parsons, T. D., and Courtney, C. (2014). An initial validation of the virtual reality paced auditory serial addition test in a college sample. J. Neurosci. Methods 222, 15–23. doi: 10.1016/j.jneumeth.2013.10.006
139. Parsons, T. D., Courtney, C., and Dawson, M. (2013). Virtual reality stroop task for assessment of supervisory attentional processing. J. Clin. Exp. Neuropsychol. 35, 812–826. doi: 10.1080/13803395.2013.824556
140. Parsons, T. D., Courtney, C., Rizzo, A. A., Armstrong, C., Edwards, J., and Reger, G. (2012). Virtual reality paced serial assessment tests for neuropsychological assessment of a military cohort. Stud. Health Technol. Inform. 173, 331–337.
141. Parsons, T. D., and Rizzo, A. A. (2008). Affective outcomes of virtual reality exposure therapy for anxiety and specific phobias: a meta-analysis. J. Behav. Ther. Exp. Psychiatry 39, 250–261. doi: 10.1016/j.jbtep.2007.07.007
142. Patil, I., Cogoni, C., Zangrando, N., Chittaro, L., and Silani, G. (2014). Affective basis of judgment-behavior discrepancy in virtual experiences of moral dilemmas. Soc. Neurosci. 9, 94–107. doi: 10.1080/17470919.2013.870091
143. Peck, T. C., Seinfeld, S., Aglioti, S. M., and Slater, M. (2013). Putting yourself in the skin of a black avatar reduces implicit racial bias.Conscious. Cogn. 22, 779–787. doi: 10.1016/j.concog.2013.04.016
144. Pelphrey, K. A., Singerman, J. D., Allison, T., and McCarthy, G. (2003). Brain activation evoked by perception of gaze shifts: the influence of context. Neuropsychologia 41, 156–170. doi: 10.1016/s0028-3932(03)00111-8
145. Pelphrey, K. A., Viola, R. J., and McCarthy, G. (2004). When strangers pass: processing of mutual and averted social gaze in the superior temporal sulcus. Psychol. Sci. 15, 598–603. doi: 10.1111/j.0956-7976.2004.00726.x
146. Pfeiffer, U. J., Vogeley, K., and Schilbach, L. (2013). From gaze cueing to dual eye-tracking: novel approaches to investigate the neural correlates of gaze in social interaction. Neurosci. Biobehav. Rev. 37, 2516–2528. doi: 10.1016/j.neubiorev.2013.07.017
147. Pollak, Y., Shomaly, H. B., Weiss, P. L., Rizzo, A. A., and Gross-Tsur, V. (2010). Methylphenidate effect in children with ADHD can be measured by an ecologically valid continuous performance test embedded in virtual reality. CNS Spectr. 15, 125–130.
148. Potenza, M., and de Wit, H. (2010). Control yourself: alcohol and impulsivity. Alcohol. Clin. Exp. Res. 34, 1303–1305. doi: 10.1111/j.1530-0277.2010.01214.x
149. Preston, C., and Ehrsson, H. H. (2014). Illusory changes in body size modulate body satisfaction in a way that is related to non-clinical eating disorder psychopathology. PLoS One 9:e85773. doi: 10.1371/journal.pone.0085773
150. Pugnetti, L., Mendozzi, L., Attree, E. A., Barbieri, E., Brooks, B. M., Cazzullo, C. L., et al. (1998). Probing memory and executive functions with virtual reality: past and present studies. Cyberpsychol. Behav. 1, 151–161. doi: 10.1089/cpb.1998.1.151
151. Pugnetti, L., Mendozzi, L., Motta, A., Cattaneo, A., Barbieri, E., and Brancotti, S. (1995). Evaluation and retraining of adults’ cognitive impairments: which role for virtual reality technology? Comput. Biol. Med. 25, 213–227. doi: 10.1016/0010-4825(94)00040-w
152. Rabin, L. A., Burton, L. A., and Barr, W. B. (2007). Utilization rates of ecologically oriented instruments among clinical neuropsychologists. Clin. Neuropsychol. 5, 727–743. doi: 10.1080/13854040600888776
153. Rand, D., Basha-Abu Rukan, S., Weiss, P. L., and Katz, N. (2009). Validation of the Virtual MET as an assessment tool for executive functions. Neuropsychol. Rehabil. 19, 583–602. doi: 10.1080/09602010802469074
154. Rebelo, F., Noriega, P., Duarte, E., and Soares, M. (2012). Using virtual reality to assess user experience. Hum. Factors 54, 964–982. doi: 10.1177/0018720812465006
155. Renison, B., Ponsford, J., Testa, R., Richardson, B., and Brownfield, K. (2012). The ecological and construct validity of a newly developed measure of executive function: the virtual library task. J. Int. Neuropsychol. Soc. 18, 440–450. doi: 10.1017/s1355617711001883
156. Risko, E. F., Laidlaw, K. E., Freeth, M., Foulsham, T., and Kingstone, A. (2012). Social attention with real versus reel stimuli: toward an empirical approach to concerns about ecological validity. Front. Hum. Neurosci. 6:143. doi: 10.3389/fnhum.2012.00143
157. Riva, G., Mantovani, F., Capideville, C. S., Preziosa, A., Morganti, F., Villani, D., et al. (2007). Affective interactions using virtual reality: the link between presence and emotions. Cyberpsychol. Behav. 10, 45–56. doi: 10.1089/cpb.2006.9993
158. Rotge, J. Y., Lemogne, C., Hinfray, S., Huguet, P., Grynszpan, O., Tartour, E., et al. (2014). A meta-analysis of the anterior cingulate contribution to social pain. Soc. Cogn. Affect. Neurosci. 10, 19–27. doi: 10.1093/scan/nsu110
159. Roy, S., Klinger, E., Légeron, P., Lauer, F., Chemin, I., and Nugues, P. (2003). Definition of a VR-based protocol to treat social phobia.Cyberpsychol. Behav. 6, 411–420. doi: 10.1089/109493103322278808
160. Rubia, K. (2011). “Cool” inferior frontostriatal dysfunction in attention-deficit/hyperactivity disorder versus “hot” ventromedial orbitofrontal-limbic dysfunction in conduct disorder: a review. Biol. Psychiatry 69, e69–e87. doi: 10.1016/j.biopsych.2010.09.023
161. Sbordone, R. J. (2008). Ecological validity of neuropsychological testing: critical issues. Neuropsychol. Handbook 367:394.
162. Sbordone, R. J., and Long, C. eds. (1996). Ecological Validity of Neuropsychological Testing. Boca Raton, FL: CRC Press.
163. Schilbach, L. (2015). Eye to eye, face to face and brain to brain: novel approaches to study the behavioral dynamics and neural mechanisms of social interactions. Curr. Opin. Behav. Sci. 3, 130–135. doi: 10.1016/j.cobeha.2015.03.006
164. Schilbach, L., Eickhoff, S. B., Rotarska-Jagiela, A., Fink, G. R., and Vogeley, K. (2008). Minds at rest? Social cognition as the default mode of cognizing and its putative relationship to the “default system” of the brain. Conscious. Cogn. 17, 457–467. doi: 10.1016/j.concog.2008.03.013
165. Schilbach, L., Timmermans, B., Reddy, V., Costall, A., Bente, G., Schlicht, T., et al. (2013). Toward a second-person neuroscience. Behav. Brain Sci. 36, 393–414. doi: 10.1017/S0140525X12000660
166. Schilbach, L., Wilms, M., Eickhoff, S. B., Romanzetti, S., Tepest, R., Bente, G. B., et al. (2010). Minds made for sharing. Initiating joint attention recruits reward-related neurocircuitry. J. Cogn. Neurosci. 22, 2702–2715. doi: 10.1162/jocn.2009.21401
167. Schilbach, L., Wohlschläger, A. M., Newen, A., Krämer, N., Shah, N. J., Fink, G. R., et al. (2006). Being with others: neural correlates of social interaction. Neuropsychologia 44, 718–730. doi: 10.1016/j.neuropsychologia.2005.07.017
168. Schoenbaum, G., Takahashi, Y., Liu, T., and McDannald, M. (2011). Does the orbitofrontal cortex signal value? Ann. N Y Acad. Sci. 1239, 87–99. doi: 10.1111/j.1749-6632.2011.06210.x
169. Schultheis, M. T., Rebimbas, J., Mourant, R., and Millis, S. R. (2007). Examining the usability of a virtual reality driving simulator. Assist. Technol. 19, 1–8. doi: 10.1080/10400435.2007.10131860
170. Sebanz, N., Bekkering, H., and Knoblich, G. (2006). Joint action: bodies and minds moving together. Trends Cogn. Sci. 10, 70–76. doi: 10.1016/j.tics.2005.12.009
171. Seguin, J. R., Arseneault, L., and Tremblay, R. E. (2007). The contribution of “cool” and “hot” components of decision-making in adolescence: implications for developmental psychopathology. Cogn. Dev. 22, 530–543. doi: 10.1016/j.cogdev.2007.08.006
172. Shallice, T. I. M., and Burgess, P. W. (1991). Deficits in strategy application following frontal lobe damage in man. Brain 114, 727–741. doi: 10.1093/brain/114.2.727
173. Sijtsema, J. J., Shoulberg, E. K., and Murray-Close, D. (2011). Physiological reactivity and different forms of aggression in girls: moderating roles of rejection sensitivity and peer rejection. Biol. Psychol. 86, 181–192. doi: 10.1016/j.biopsycho.2010.11.007
174. Skulmowski, A., Bunge, A., Kaspar, K., and Pipa, G. (2014). Forced-choice decision-making in modified trolley dilemma situations: a virtual reality and eye tracking study. Front. Behav. Neurosci. 8:426. doi: 10.3389/fnbeh.2014.00426
175. Slater, M., and Sanchez-Vives, M. V. (2014). Transcending the self in immersive virtual reality. Computer 47, 24–30. doi: 10.1109/mc.2014.198
176. Slater, M., Spanlang, B., Sanchez-Vives, M. V., and Blanke, O. (2010). First person experience of body transfer in virtual reality. PloS One5:e10564. doi: 10.1371/journal.pone.0010564
177. Spooner, D. M., and Pachana, N. A. (2006). Ecological validity in neuropsychological assessment: a case for greater consideration in research with neurologically intact populations. Arch. Clin. Neuropsychol. 21, 327–337. doi: 10.1016/j.acn.2006.04.004
178. Stuss, D. T., Benson, D. F., Kaplan, E. F., Weir, W. S., Naeser, M. A., Lieberman, I., et al. (1983). The involvement of orbitofrontal cerebrum in cognitive tasks. Neuropsychologia 21, 235–248. doi: 10.1016/0028-3932(83)90040-4
179. Stuss, D. T., and Levine, B. (2002). Adult clinical neuropsychology: lessons from studies of the frontal lobes. Annu. Rev. Psychol. 53, 401–433. doi: 10.1146/annurev.psych.53.100901.135220
180. Sweeney, S., Kersel, D., Morris, R. G., Manly, T., and Evans, J. J. (2010). The sensitivity of a virtual reality task to planning and prospective memory impairments: group differences and the efficacy of periodic alerts on performance. Neuropsychol. Rehabil. 20, 239–263. doi: 10.1080/09602010903080531
181. Takahashi, H., Yahata, N., Koeda, M., Matsuda, T., Asai, K., and Okubo, Y. (2004). Brain activation associated with evaluative processes of guilt and embarrassment: an fMRI study. Neuroimage 23, 967–974. doi: 10.1016/j.neuroimage.2004.07.054
182. Tanabek, H. C., Kosaka, H., Saito, D. N., Koike, T., Hayashi, M. J., Izuma, K., et al. (2012). Hard to “tune in”: neural mechanisms of live face-to-face interaction with high-functioning autistic spectrum disorder. Front. Hum. Neurosci. 6:268. doi: 10.3389/fnhum.2012.00268
183. Thomson, J. J. (1985). The trolley problem. Yale Law J. 94, 1395–1415. doi: 10.2307/796133
184. van der Hoort, B., Guterstam, A., and Ehrsson, H. H. (2011). Being barbie: the size of one’s own body determines the perceived size of the world. PLoS One 6:e20195. doi: 10.1371/journal.pone.0020195
185. Walter, H., Adenzato, M., Ciaramidaro, A., Enrici, I., Pia, L., and Bara, B. G. (2004). Understanding intentions in social interaction: the role of the anterior paracingulate cortex. J. Cogn. Neurosci. 16, 1854–1863. doi: 10.1162/0898929042947838
186. Weigl, E. (1927). Zur Psychologie Sogenannter Abstraktionsprozesse. I. Untersuchungen über das “Ordnen”. Zeitschrift für Psychologie und Physiologie der Sinnesorgane. Abt. 1. Zeitschrift für Psychologie.
187. Wesselmann, E. D., Wirth, J. H., Mroczek, D. K., and Williams, K. D. (2012). Dial a feeling: detecting moderation of affect decline during ostracism. Pers. Individ. Dif. 53, 580–586. doi: 10.1016/j.paid.2012.04.039
188. Williams, K. D. (2007). Ostracism. Annu. Rev. Psychol. 58, 425–452. doi: 10.1146/annurev.psych.58.110405.085641
189. Wilms, M., Schilbach, L., Pfeiffer, U., Bente, G., Fink, G. R., and Vogeley, K. (2010). It’s in your eyes-using gaze-contingent stimuli to create truly interactive paradigms for social cognitive and affective neuroscience. Soc. Cogn. Affect. Neurosci. 5, 98–107. doi: 10.1093/scan/nsq024
190. Wilson, B. A. (1993). Ecological validity of neuropsychological assessment: do neuropsychological indexes predict performance in everyday activities? Appl. Prev. Psychol. 2, 209–215. doi: 10.1016/s0962-1849(05)80091-5
191. Windmann, S., Kirsch, P., Mier, D., Stark, R., Walter, B., Güntürkün, O., et al. (2006). On framing effects in decision making: linking lateral versus medial orbitofrontal cortex activation to choice outcome processing. J. Cogn. Neurosci. 18, 1198–1211. doi: 10.1162/jocn.2006.18.7.1198
192. Wirth, J., Feldberg, F., Schouten, A. P., Hooff, B., and Williams, K. D. (2011). “Using virtual game environments to study group behavior,” in Research Methods for Studying Groups and Teams: A Guide to Approaches, Tools and Technologies, eds A. Hollingshead and M. Scott Poole (New York, NY: Routledge), 1–24.
193. Wirth, J. H., Sacco, D. F., Hugenberg, K., and Williams, K. D. (2010). Eye gaze as relational evaluation: averted eye gaze leads to feelings of ostracism and relational devaluation. Pers. Soc. Psychol. Bull. 36, 869–882. doi: 10.1177/0146167210370032
194. Zadro, L., Williams, K. D., and Richardson, R. (2004). How low can you go? Ostracism by a computer lowers belonging, control, self-esteem and meaningful existence. J. Exp. Soc. Psychol. 40, 560–567. doi: 10.1016/j.jesp.2003.11.006
195. Zaki, J., and Ochsner, K. (2009). The need for a cognitive neuroscience of naturalistic social cognition. Ann. N Y Acad. Sci. 1167, 16–30. doi: 10.1111/j.1749-6632.2009.04601.x
196. Zelazo, P. D., Müller, U., Frye, D., Marcovitch, S., Argitis, G., Boseovski, J., et al. (2003). The development of executive function in early childhood. Monogr. Soc. Res. Child Dev. i–151.
197. Zwolinski, J. (2012). Psychological and neuroendocrine reactivity to ostracism. Aggress. Behav. 38, 108–125. doi: 10.1002/ab.21411