Adaptive eye-gaze tracking using neural-network-based user profiles to assist people with motor disability

Journal of Rehabilitation Research and Development

Volumn 45, Issue 6, 2008, Pages 801-818

  Sesin, Anaelis ^a   Adjouadi, Malek ^a   Cabrerizo, Mercedes ^a   Ayala, Melvin ^a   Barreto, Armando ^a  

^a The Department of Electrical and Computer Engineering   (United States)

Author keywords

Artificial neural network; Assistive technology; Eye gaze tracking; Human computer interface; Jitter reduction; Mouse cursor trajectory; Rehabilitation; Saccadic eye movement; Severe motor disabilities; User profile

Indexed keywords

ARTIFICIAL NEURAL NETWORK; ASSISTIVE TECHNOLOGY; EYE-GAZE TRACKING; HUMAN-COMPUTER INTERFACE; MOUSE CURSOR TRAJECTORY; REHABILITATION; SACCADIC EYE MOVEMENT; SEVERE MOTOR DISABILITIES; USER PROFILE;

BACKPROPAGATION; COMPUTER NETWORKS; ELECTRIC CURRENTS; INTERFACES (COMPUTER); JITTER; MOTORS; NEURAL NETWORKS; PATIENT REHABILITATION; TARGET TRACKING; TRAJECTORIES;

EYE MOVEMENTS;

ACCURACY; ADULT; ARTICLE; ARTIFICIAL NEURAL NETWORK; ASSISTIVE TECHNOLOGY; CLINICAL ARTICLE; COMPUTER INPUT DEVICE; COMPUTER INTERFACE; CONTROLLED STUDY; DISEASE SEVERITY; FEMALE; GAZE; HUMAN; MALE; MOTOR DYSFUNCTION; PERCEPTRON; PRIORITY JOURNAL; SACCADIC EYE MOVEMENT; TRAINING; EYE FIXATION; EYE MOVEMENT; HEAD MOVEMENT; INSTRUMENTATION; MIDDLE AGED; OCULOGRAPHY; PATHOPHYSIOLOGY; PHYSIOLOGY; SPINAL CORD INJURY;

ADULT; EYE MOVEMENT MEASUREMENTS; EYE MOVEMENTS; FEMALE; FIXATION, OCULAR; HEAD MOVEMENTS; HUMANS; MALE; MIDDLE AGED; NEURAL NETWORKS (COMPUTER); SPINAL CORD INJURIES; USER-COMPUTER INTERFACE;

EID: 63249105498     PISSN: 07487711     EISSN: 07487711     Source Type: Journal    
DOI: 10.1682/JRRD.2007.05.0075     Document Type: Article

References (26)

1. Hong P, Huang T. Natural mouse - A novel human computer interface. In: Proceedings of the IEEE International Conference on Image Processing; 1999 Oct 24-28; Kobe, Japan. p. 653-656
2. Hutchinson TE, White KP Jr, Martin WN, Reichert KC, Frey LA. Human-computer interaction using eye gaze input. IEEE Trans Syst Man Cybern. 1989;19(6):1527-1534
3. Adjouadi M, Sesin A, Ayala M, Cabrerizo M. Remote eye gaze tracking system as a computer interface for persons with severe motor disability. In: Lecture notes in computer science. Vol.3118. Berlin (Germany): Springer; 2004. p. 761-769 (Pubitemid 39737852)
4. Barreto AB, Scargle SD, Adjouadi M. A real-time assistive computer interface for users with motor disabilities. ACM SIGCAPH Comp Phys Handicap. 1999;64:6-16.
5. Duchowski AT. Eye tracking methodology: Theory and practice. New York (NY): Springer; 2003.
6. Glenstrup AJ, Engell-Nielsen T. Eye controlled media: Present and future state [thesis]. Copenhagen, Denmark: University of Copenhagen; 1995.
7. Pantic M, Sebe N, Cohn JF, Huang T. Affective multimodal human-computer interaction. In: Proceedings of the 13th Annual ACM International Conference on Multimedia; 2005 Nov 6-11; Singapore. p. 669-676
8. Ovita SL. Multimodal interfaces. In: Jacko J, Sears A, editors. The human-computer interaction handbook: Fundamentals, evolving technologies and emerging applications. Mahway (NJ): Lawrence Erlbaum Associates; 2002. p. 286-304.
9. Barreto AB, Scargle SD, Adjouadi M. A practical EGM-based human-computer interface for users with motor disabilities. J Rehabil Res Dev. 2000;37(1):53-63.
10. Chin CA, Barreto A, Adjouadi M. Enhanced real-time cursor control algorithm, based on the spectral analysis of electromyograms. Biomed Sci Instrum. 2006;42:249-254 [PMID: 16817616] (Pubitemid 43911263)
11. Chin C, Barreto A, Alonso M Jr. Electromyogram-based cursor control system for users with motor disabilities. In: Lecture notes on computer science. Vol.4061. Berlin (Germany): Springer; 2006. p. 905-912 (Pubitemid 44365189)
12. Špakov O, Miniotas D. Gaze-based selection of standard-size menu items. In: Proceedings of the 7th International Conference on Multimodal Interfaces; 2005 Oct 4-6; Torento, Italy. p. 124-128
13. Bates R, Istance H. Zooming interfaces!: Enhancing the performance of eye controlled pointing devices. In: Proceedings of the 5th International ACM Conference on Assistive Technologies; 2002 Jul 8-10; Edinburgh, Scotland. p. 119-126
14. Ashmore M, Duchowski AT, Shoemaker G. Efficient eye pointing with a fisheye lens. In: Proceedings of the ACM International Conference of Graphics Interface; Canadian Human-Computer Communications Society; 2005 May 9-11; Victoria (Canada). p. 203-210
15. Kumar M, Paepcke A, Winograd T. EyePoint: Practical pointing and selection using gaze and keyboard. In: Proceedings of ACM CHI 2007 Conference on Human Factors in Computing Systems; 2007 Apr 28-May 3; San Jose, California. p. 421-430
16. Baluja S, Pomerleau D. Non-intrusive gaze tracking using artificial neural networks. Adv Neural Inform Proc Syst. 1994;6:753.
17. Piratla NM, Jayasumana AP. A neural network based real-time gaze tracker. J Network Comp Appl. 2002;25(3):179-196
18. ISCAN Inc. Raw eye movement data acquisition software: Instruction manual. Burlington (MA): ISCAN Inc; 1997.
19. Guestrin ED, Eizenman M. General theory of remote gaze estimation using the pupil center and corneal reflections. IEEE Trans Biomed Eng. 2006;53(6):1124-33. Erratum in: IEEE Trans Biomed Eng. 2006;53(8):1728.
20. Ohno T, Mukawa N. A free-head, simple calibration, gaze tracking system that enables gaze-based interaction. In: Proceedings of the 2004 Symposium on Eye Tracking Research and Applications; 2004 Mar 22-24; San Antonio, Texas. p. 115-122
21. Morimoto CH, Koons D, Amir A, Flickner M. Pupil detection and tracking using multiple light sources. Image Vision Comput. 2000;18(4);331-35.
22. Sesin A, Adjouadi M, Ayala M, Barreto A, Rishe N. A real-time vision based human computer interface as an assistive technology for persons with motor disability. WSEAS Trans Comp Res. 2007;2(2):115-121
23. Hertz J, Krogh A, Palmer RG. Introduction to the theory of neural computation. Redwood City (CA): Addison-Wesley; 1991.
24. Ayala M, Adjouadi M. (2004). Eye-gaze tracking system evaluator programming tool. Miami (FL): Center for Advanced Technology and Education. Available from: /www.cate.fiu.edu/soft.html/.
25. Kim Y, Varshney A. Saliency-guided enhancement for volume visualization. IEEE Trans Vis Comput Graph. 2006; 12(5):925-932
26. Hedrick B, Pape TL, Heinemann AW, Ruddell JL, Reis J. Employment issues and assistive technology use for persons with spinal cord injury. J Rehabil Res Dev. 2006;43(2):185-198