Design of a gaze-sensitive virtual social interactive system for children with autism

IEEE Transactions on Neural Systems and Rehabilitation Engineering

Volumn 19, Issue 4, 2011, Pages 443-452

  Lahiri, Uttama ^a   Warren, Zachary ^b   Sarkar, Nilanjan ^a  

^a VANDERBILT UNIVERSITY   (United States)

^b VANDERBILT UNIVERSITY   (United States)

Author keywords

Autism spectrum disorder (ASD); blink rate; eye tracking; fixation duration; pupil diameter; virtual reality (VR)

Indexed keywords

AUTISM SPECTRUM DISORDERS; BLINK RATES; EYE-TRACKING; FIXATION DURATION; PUPIL DIAMETER;

BEHAVIORAL RESEARCH; DISEASES; REAL TIME SYSTEMS; SOCIAL SCIENCES; TECHNOLOGY; USER INTERFACES; VIRTUAL REALITY;

EDUCATION;

ADAPTIVE BEHAVIOR; ADOLESCENT; ALGORITHM; ARTICLE; AUTISM; BLINKING; COMPUTER INTERFACE; EMOTION; EQUIPMENT DESIGN; EYE FIXATION; EYE MOVEMENT; FEMALE; HUMAN; HUMAN RELATION; MALE; PHOTOSTIMULATION; PHYSIOLOGY; PSYCHOLOGICAL ASPECT; PSYCHOMOTOR PERFORMANCE; PUPIL; RECOGNITION; SOCIAL BEHAVIOR;

ADOLESCENT; ALGORITHMS; AUTISTIC DISORDER; BLINKING; EMOTIONS; EQUIPMENT DESIGN; EYE MOVEMENTS; FEEDBACK, PSYCHOLOGICAL; FEMALE; FIXATION, OCULAR; HUMANS; INTERPERSONAL RELATIONS; MALE; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; PUPIL; RECOGNITION (PSYCHOLOGY); SOCIAL BEHAVIOR; USER-COMPUTER INTERFACE;

EID: 80051716153     PISSN: 15344320     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNSRE.2011.2153874     Document Type: Article

References (43)

1. "CDC, prevalence of autism spectrum disorders-ADDM network," MMWR Surveill. Summ. U.S., 2006, vol. 58, pp. 1-20, 2009.
2. "APA, diagnostic and statistical manual of mental disorders: DSM-IVTR," in Am. Psychiatric Assoc., Washington, DC, 2000.
3. S. Baron-Cohen, Mindblindness: An Essay on Autism and Theory of Mind. Cambridge, MA: MIT Press, 1997.
4. M. D. Rutherford and M. T. Towns, "Scan path differences and similarities during emotion perception in those with and without autism spectrum disorders," J. Aut. Dev. Disord., vol. 38, pp. 1371-1381, 2008.
5. C. Y. Trepagnier, M. M. Sebrechts, A. Finkelmeyer, W. Stewart, J. Woodford, and M. Coleman, "Simulating social interaction to address deficits of autistic spectrum disorder in children," Cyberpsychol. Behav., vol. 9, no. 2, pp. 213-217, 2006.
6. K. A. Pelphrey, N. J. Sasson, J. S. Reznick, G. Paul, B. D. Goldman, and J. Piven, "Visual scanning of faces in autism," J. Autism Develop. Disorders, vol. 32, pp. 249-261, 2002. (Pubitemid 37490176)
7. NRC, Educating Children With Autism Washington, DC, Nat. Acad. Press, 2001.
8. R. W. Picard, "Future Affective Technology for Autism and Emotion Communication," Philos. Trans. R. Soc. B, vol. 364, no. 1535, pp. 3575-3584, 2009.
9. S. Parsons, P. Mitchell, and A. Leonard, "The use and understanding of virtual environments by adolescents with autistic spectrum disorders," J. Autism Dev. Disord., vol. 34, no. 4, pp. 449-466, 2004. (Pubitemid 39127720)
10. A. Tartaro and J. Cassell, Using Virtual Peer Technology as an Intervention for Children with Autism, Towards Universal Usability: Designing Computer Interfaces for Diverse User Populations, J. Lazar, Ed. Chichester, U.K.: Wiley.
11. G. Pioggia, R. Igliozzi, M. Ferro, A. Ahluwalia, F. Muratori, and D. De Rossi, "An android for enhancing social skills and emotion recognition in people with autism," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 13, no. 4, pp. 507-515, Dec. 2005. (Pubitemid 43015557)
12. M. S. Goodwin, "Enhancing and accelerating the pace of autism research and treatment: The promise of developing innovative technology," Focus Autism Other Dev. Dis., vol. 23, no. 2, pp. 125-128, 2008.
13. S. Parsons and P. Mitchell, "The potential of virtual reality in social skills training for people with autistic spectrum disorders," J. Intell. Disabil. Res., vol. 46, pp. 430-443, 2002. (Pubitemid 34830947)
14. D. Strickland, "Virtual reality for the treatment of autism," in Virtual Reality in Neuropsychophysiology, G. Riva, Ed. Fairfax, VA: IOS Press, 1997, pp. 81-86. (Pubitemid 128028377)
15. M. Wilms, L. Schilbach, U. Pfeiffer, G. Bente, G. R Fink, and K. Vogeley, "It's in your eyes using gaze-contingent stimuli to create truly interactive paradigms for social cognitive and affective neuroscience," Social Cognitive Affective Neurosci., vol. 5, no. 1, pp. 98-107, 2010.
16. S.Weider and S. Greenspan, "Can children with autism master the core deficits and become empathetic, creative, and reflective?," J. Develop. Learn. Disorders, vol. 9, 2005.
17. C. Y. Pan, "Age, social engagement, and physical activity in children with autism spectrum disorder," Res. Autism Spectrum Disorders, vol. 3, pp. 22-31, 2009.
18. D. B. Shalom, S. H. Mostofsky, R. L. Hazlett, M. C. Goldberg, R. J. Landa, Y. Faran, D. R McLeod, and R. Hoehn-Saric, "Normal physiological emotions but differences in expression of conscious feelings in children with high-functioning autism," J. Autism Develop. Disorders, vol. 36, no. 3, pp. 395-400, 2006. (Pubitemid 43828663)
19. C. J. Anderson, J. Colombo, and D. J. Shaddy, "Visual scanning and pupillary responses in young children with autism spectrum disorder," J. Clin. Exp. Neuropsy., vol. 28, pp. 1238-1256, 2006. (Pubitemid 44091938)
20. J. W. Denver, "The social engagement system: Functional differences in individuals with autism," Ph.D. dissertation, Dept. Human Develop., Univ. Maryland, College Park, 2004.
21. J. H. Hsiao and G. Cottrell, "Two fixations suffice in face recognition," Psychol. Sci., vol. 19, no. 10, pp. 998-1006, 2008.
22. W. L. Libby, B. C. Lacey, and J. I. Lacey, "Pupillary and cardiac activity during visual attention," Psychophysiology, vol. 10, no. 3, pp. 270-294, 1973.
23. S. Ozdemir, G. Universitesi, G. E. Fakultesi, and O. E. Bolumu, "Using multimedia social stories to increase appropriate social engagement in young children with autism," Turk. J. Edu. Tech, vol. 7, no. 3, pp. 80-88, 2008.
24. L. Itti, N. Dhavale, and F. Pighin, "Realistic avatar eye and head animation using a neurobiological model of visual attention," in Proc. Int. Symp. Opt. Sci. Technol., 2003, vol. 5200, pp. 64-78.
25. E. T. Hall, The Hidden Dimension. New York: Doubleday, 1966.
26. Dynamic indicators of basic early literacy skills 2007 [Online]. Available: dibels.uoregon.edu/measures/
27. Eye-Tracker goggles, Arrington Res. [Online]. Available: http://www. arringtonresearch.com/
28. L. A. Ruble and D. M. Robson, "Individual and environmental determinants of engagement in autism," J. Autism Develop. Disorders , vol. 37, no. 8, pp. 1457-1468, 2006.
29. T. Partala, M. Jokiniemi, and V. Surakka, "Pupillary responses to emotionally provocative stimuli," Eye Track. Res. Appl., pp. 123-129, 2000.
30. C. J. Anderson and J. Colombo, "Larger tonic pupil size in young children with autism spectrum disorder," Develop. Psychobiol., vol. 51, no. 2, pp. 207-211, 2009.
31. Data Collection. ViewPoint EyeTracker: PC-60 Software User Guide Arrington Res., 2002, p. 47.
32. R. J. K. Jacob, Eye Tracking in Advanced Interface Design, in Advanced Interface Design and Virtual Environments, W. Barfield and T. Furness, Eds. Oxford, U.K.: Oxford Univ., 1994.
33. H. Z. Li, "Culture and gaze direction in conversation," RASK, vol. 20, pp. 3-26, 2004.
34. M. Argyle and M. Cook, Gaze and Mutual Gaze. Cambridge, MA: Cambridge Univ. Press, 1976.
35. A. Colburn, S. Drucker, and M. Cohen, "The role of eye-gaze in avatar-mediated conversational interfaces," in SIGGRAPH Sketches Appl., New Orleans, LA, 2000.
36. M. J. Wieser, P. Pauli, G. W. Alpers, and A. Muhlberger, "Is eye to eye contact really threatening and avoided in social anxiety?-An eyetracking & psychophysio. Study," J. Anxiety Disorders, vol. 23, pp. 93-103, 2009.
37. L. M. Dunn and L. M. Dunn, PPVT-III: Peabody Picture Vocabulary Test, 3rd ed. Circle Pines, MN: Am. Guidance Ser., 1997.
38. J. N. Constantino, The Social Responsiveness Scale. Los Angeles, CA: Western Psych. Services, 2002.
39. M. Rutter,A. Bailey, S. Berument, C. Lord, and A. Pickles, Social Communication Questionnaire. Los Angeles, CA: Western Psych. Services, 2003.
40. C. Lord, S. Risi, L. Lambrecht, E. H. Cook, Jr, B. L. Leventhal, P. C. DiLavore, A. Pickles, and M. Rutter, "The autism diagnostic observation schedule-generic: A standard measure of social and communication deficits associated with the spectrum of autism," J. Autism Develop. Disorders, vol. 30, no. 3, pp. 205-23, 2000.
41. J. D. Buckner, J. K.Maner, and N. B. Schmidt, "Difficulty disengaging attention from social threat in social anxiety," Cognitive Therapy Res., vol. 34, no. 1, pp. 99-105, 2010.
42. J. L. Wilbarger, D. N. Mclntoshb, and P. Winkielmanc, "Startle modulation in autism: Positive affective stimuli enhance startle response," Neuropsychologia, vol. 47, pp. 1323-1331, 2009.
43. M. B. Bradley, L. Miccoli, M. A. Escrig, and P. J. Lang, "The pupil as a measure of emotional arousal and autonomic activation," Psychophysiology, vol. 45, no. 4, pp. 602-607, 2008. (Pubitemid 351832085)