Understanding how adolescents with autism respond to facial expressions in virtual reality environments

IEEE Transactions on Visualization and Computer Graphics

Volumn 19, Issue 4, 2013, Pages 711-720

  Bekele, Esubalew ^a   Zheng, Zhi ^a   Swanson, Amy ^a   Crittendon, Julie ^a   Warren, Zachary ^a   Sarkar, Nilanjan ^a  

^a VANDERBILT UNIVERSITY   (United States)

Author keywords

3D Interaction; Multimodal interaction; Psychology; Usability; Vr based response systems

Indexed keywords

3D INTERACTIONS; MULTI-MODAL INTERACTIONS; PSYCHOLOGY; RESPONSE SYSTEMS; USABILITY;

DISEASES; VIRTUAL REALITY;

PHYSIOLOGY;

ADOLESCENT; ARTICLE; AUTISM; COMPUTER ASSISTED DIAGNOSIS; COMPUTER GRAPHICS; COMPUTER INTERFACE; FACIAL EXPRESSION; FEMALE; HUMAN; MALE; METHODOLOGY; PATHOPHYSIOLOGY; THREE DIMENSIONAL IMAGING; VISION;

ADOLESCENT; AUTISTIC DISORDER; COMPUTER GRAPHICS; DIAGNOSIS, COMPUTER-ASSISTED; FACIAL EXPRESSION; FEMALE; HUMANS; IMAGING, THREE-DIMENSIONAL; MALE; USER-COMPUTER INTERFACE; VISUAL PERCEPTION;

EID: 84883470666     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVCG.2013.42     Document Type: Article

References (44)

1. Diagnostic and Statistical Manual of Mental Disorders: Quick reference to the diagnostic criteria from DSM-IV-TR, Washington, DC: American Psychiatric Association, Amer Psychiatric Pub Incorporated, 2000.
2. J. Baio, Autism, D. D. M. Network, C. f. D. Control, and Prevention, Prevalence of Autism Spectrum Disorders - Autism and Developmental Disabilities Monitoring Network, 14 Sites, United States, 2008: National Center on Birth Defects and Developmental Disabilities, Centers for Disease Control and Prevention (CDC), US Department of Health and Human Services, 2012.
3. G. S. Chasson, G. E. Harris, and W. J. Neely, "Cost comparison of early intensive behavioral intervention and special education for children with autism," Journal of Child and Family Studies, vol. 16, no. 3, pp. 401-413, 2007.
4. M. L. Ganz, "The lifetime distribution of the incremental societal costs of autism," Archives of Pediatrics and Adolescent Medicine, Am Med Assoc, vol. 161, no. 4, pp. 343-349, 2007. (Pubitemid 46556364)
5. C. J. Newschaffer, and L. K. Curran, "Autism: an emerging public health problem," Public Health Reports, vol. 118, no. 5, pp. 393-399, 2003. (Pubitemid 37059473)
6. R. Adolphs, L. Sears, and J. Piven, "Abnormal processing of social information from faces in autism," Journal of Cognitive neuroscience, vol. 13, no. 2, pp. 232-240, 2001. (Pubitemid 32209765)
7. F. Castelli, "Understanding emotions from standardized facial expressions in autism and normal development," Autism, vol. 9, no. 4, pp. 428-449, 2005. (Pubitemid 41489549)
8. G. Dawson, S. J. Webb, and J. McPartland, "Understanding the nature of face processing impairment in autism: Insights from behavioral and electrophysiological studies," Developmental neuropsychology, vol. 27, no. 3, pp. 403-424, 2005. (Pubitemid 40712809)
9. L. Capps, N. Yirmiya, and M. Sigman, "Understanding of Simple and Complex Emotions in Non-retarded Children with Autism," Journal of Child Psychology and Psychiatry, vol. 33, no. 7, pp. 1169-1182, 1992.
10. S. J. Weeks, and R. P. Hobson, "The salience of facial expression for autistic children," Journal of Child Psychology and Psychiatry, vol. 28, no. 1, pp. 137-152, 1987. (Pubitemid 17024905)
11. R. P. Hobson, "The autistic child's appraisal of expressions of emotion," Journal of Child Psychology and Psychiatry, vol. 27, no. 3, pp. 321-342, 1986. (Pubitemid 16091302)
12. N. Bauminger, "The facilitation of social-emotional understanding and social interaction in high-functioning children with autism: Intervention outcomes," Journal of autism and developmental disorders, vol. 32, no. 4, pp. 283-298, 2002. (Pubitemid 37490178)
13. M. S. Goodwin, "Enhancing and Accelerating the Pace of Autism Research and Treatment," Focus on Autism and Other Developmental Disabilities, vol. 23, no. 2, pp. 125-128, 2008.
14. U. Lahiri, E. Bekele, E. Dohrmann, Z. Warren, and N. Sarkar, "Design of a Virtual Reality based Adaptive Response Technology for Children with Autism," IEEE transactions on neural systems and rehabilitation engineering: a publication of the IEEE Engineering in Medicine and Biology Society, vol. PP (early access), no. 99, pp. 1, 2012.
15. P. J. Standen, Brown, D.J., "Virtual reality in the rehabilitation of people with intellectual disabilities: review," Cyberpsychology & behavior, vol. 8, no. 3, pp. 272-282, 2005. (Pubitemid 40847803)
16. A. Tartaro, Cassell, J., "Using virtual peer technology as an intervention for children with autism," in Towards Universal Usability: Designing Computer Interfaces for Diverse User Populations. , Chichester, UK, , 2006, pp. 231-262.
17. P. Kenny, T. Parsons, J. Gratch, A. Leuski, and A. Rizzo, "Virtual patients for clinical therapist skills training," in Intelligent Virtual Agents, 2007, pp. 197-210. (Pubitemid 350271487)
18. P. Mitchell, Parsons, S., Leonard, A., "Using virtual environments for teaching social understanding to 6 adolescents with autistic spectrum disorders," Journal of autism and developmental disorders, vol. 37, no. 3, pp. 589-600, 2007. (Pubitemid 46355993)
19. C. Liu, Conn, K., Sarkar, N., Stone, W., "Physiology-based affect recognition for computer-assisted intervention of children with Autism Spectrum Disorder," International Journal of Human-Computer Studies, Elsevier, vol. 66, no. 9, pp. 662-677, 2008.
20. C. Liu, K. Conn, N. Sarkar, and W. Stone, "Online affect detection and robot behavior adaptation for intervention of children with autism," Robotics, IEEE Transactions on, vol. 24, no. 4, pp. 883-896, 2008.
21. U. Lahiri, Warren, Z., Sarkar, N., "Design of a Gaze-Sensitive Virtual Social Interactive System for Children With Autism," IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 19, no. 4, pp. 443-452, 2011.
22. S. Parsons, and S. Cobb, "State-of-the-art of Virtual Reality technologies for children on the autism spectrum," European Journal of Special Needs Education, vol. 26, no. 3, pp. 355-366, 2011.
23. N. Josman, H. M. Ben-Chaim, S. Friedrich, and P. L. Weiss, "Effectiveness of virtual reality for teaching street-crossing skills to children and adolescents with autism," International Journal on Disability and Human Development, vol. 7, no. 1, pp. 49-56, 2011. (Pubitemid 351644701)
24. C. Schmidt, and M. Schmidt, "Three-dimensional virtual learning environments for mediating social skills acquisition among individuals with autism spectrum disorders," in Proceedings of the 7th international conference on Interaction design and children, 2008, pp. 85-88.
25. M. Wang, and D. Reid, "Virtual Reality in Pediatric Neurorehabilitation: Attention Deficit Hyperactivity Disorder, Autism and Cerebral Palsy," Neuroepidemiology, vol. 36, no. 1, pp. 2-18, 2011.
26. M. Fabri, S. Y. A. Elzouki, and D. Moore, "Emotionally expressive avatars for chatting, learning and therapeutic intervention," in Human-Computer Interaction. HCI Intelligent Multimodal Interaction Environments, 2007, pp. 275-285.
27. E. Gal, N. Bauminger, D. Goren-Bar, F. Pianesi, O. Stock, M. Zancanaro, and P. L. Weiss, "Enhancing social communication of children with high-functioning autism through a co-located interface," AI & Society, vol. 24, no. 1, pp. 75-84, 2009.
28. N. Bauminger, D. Goren-Bar, E. Gal, P. Weiss, J. Kupersmitt, F. Pianesi, O. Stock, and M. Zancanaro, "Enhancing social communication in high-functioning children with autism through a co-located interface," in Multimedia Signal Processing. IEEE 9th Workshop on, 2007, pp. 18-21.
29. L. A. Ruble, and D. M. Robson, "Individual and environmental determinants of engagement in autism," Journal of autism and developmental disorders, vol. 37, no. 8, pp. 1457-1468, 2007. (Pubitemid 47255713)
30. K. C. Welch, Lahiri, U., Warren, Z., Sarkar, N., "An approach to the design of socially acceptable robots for children with autism spectrum disorders," International Journal of Social Robotics, vol. 2, no. 4, pp. 391-403, 2010.
31. C. J. Anderson, J. Colombo, and D. J. Shaddy, "Visual scanning and pupillary responses in young children with autism spectrum disorder," Journal of Clinical and Experimental Neuropsychology, vol. 28, no. 7, pp. 1238-1256, 2006. (Pubitemid 44091938)
32. D. D. Salvucci, and J. H. Goldberg, "Identifying fixations and saccades in eye-tracking protocols," in Proceedings of the 2000 symposium on Eye tracking research & applications, 2000, pp. 71-78.
33. J. Groden, M. S. Goodwin, M. G. Baron, G. Groden, W. F. Velicer, L. P. Lipsitt, S. G. Hofmann, and B. Plummer, "Assessing cardiovascular responses to stressors in individuals with autism spectrum disorders," Focus on Autism and Other Developmental Disabilities, vol. 20, no. 4, pp. 244-252, 2005.
34. J. T. Cacioppo, L. G. Tassinary, and G. G. Berntson, Handbook of psychophysiology: Cambridge Univ Pr, 2007.
35. P. Ekman, "Facial expression and emotion," American Psychologist, vol. 48, no. 4, pp. 384, 1993.
36. H. Shiffman, "Fundamental visual functions and phenomena " sensation and perception: An Integrated Approach, pp. 89-115: John Welsly and Sons, New York, 2001.
37. K. Gotham, S. Risi, A. Pickles, and C. Lord, "The Autism Diagnostic Observation Schedule: revised algorithms for improved diagnostic validity," Journal of Autism and Developmental Disorders, vol. 37, no. 4, pp. 613-627, 2007. (Pubitemid 46571734)
38. J. Constantino, and C. Gruber, "The social responsiveness scale," Los Angeles: Western Psychological Services, 2002.
39. M. Rutter, A. Bailey, C. Lord, and S. Berument, "Social communication questionnaire," Los Angeles, CA: Western Psychological Services, 2003.
40. D. Wechsler, Wechsler Abbreviated Scale of Intelligence® - Fourth Edition (WASI®-IV), San Antonio, TX: Harcourt Assessment, The Psychological Corporation, 2008.
41. A. Klin, W. Jones, R. Schultz, F. Volkmar, and D. Cohen, "Visual fixation patterns during viewing of naturalistic social situations as predictors of social competence in individuals with autism," Archives of general psychiatry, vol. 59, no. 9, pp. 809, 2002.
42. L. L. Sears, P. R. Finn, and J. E. Steinmetz, "Abnormal classical eyeblink conditioning in autism," Journal of autism and developmental disorders, vol. 24, no. 6, pp. 737-751, 1994. (Pubitemid 24346386)
43. R. Landry, and S. E. Bryson, "Impaired disengagement of attention in young children with autism," Journal of Child Psychology and Psychiatry, vol. 45, no. 6, pp. 1115-1122, 2004. (Pubitemid 39173576)
44. K. Harris, and D. Reid, "The influence of virtual reality play on children's motivation," Canadian Journal of Occupational Therapy, vol. 72, no. 1, pp. 21-30, 2005.