Low cost remote gaze gesture recognition in real time

Applied Soft Computing Journal

Volumn 12, Issue 8, 2012, Pages 2072-2084

  Rozado, David ^a   Rodriguez, Francisco B ^a   Varona, Pablo ^a  

^a UNIVERSIDAD AUTÓNOMA DE MADRID   (Spain)

Author keywords

Encoding; Gaze tracking; Human computer interaction; Motion analysis; Multidimensional sequences; Multidimensional signal processing; Neural network architecture; Patternrecognition

Indexed keywords

BIO-INSPIRED; DATA SETS; FALSE POSITIVE; GAZE INTERACTION; GAZE TRACKING; HUMAN-MACHINE; INPUT DATAS; LOW COST HARDWARE; LOW COSTS; LOW RATES; MOTION ANALYSIS; MULTIDIMENSIONAL SEQUENCES; MULTIDIMENSIONAL SIGNAL PROCESSING; PATTERN RECOGNITION ALGORITHMS; POTENTIAL USERS; PROJECTED DISPLAYS; REAL TIME; REAL TIME RECOGNITION; RECOGNITION ACCURACY; REMOTE VIDEO; SEQUENCE ALIGNMENTS; SPATIO-TEMPORAL; SPATIO-TEMPORAL STRUCTURES; TEMPORAL EVOLUTION; TEMPORAL MEMORY; TEMPORAL STRUCTURES; USER STUDY;

ENCODING (SYMBOLS); EYE MOVEMENTS; GESTURE RECOGNITION; LEARNING ALGORITHMS; NETWORK ARCHITECTURE; NEURAL NETWORKS; PATTERN RECOGNITION; PERSONAL COMPUTERS; SIGNAL PROCESSING;

HUMAN COMPUTER INTERACTION;

EID: 84861885926     PISSN: 15684946     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.asoc.2012.02.023     Document Type: Article

References (40)

1. H. Drewes, and A. Schmidt Interacting with the computer using gaze gestures Proceedings of the 11th IFIP TC 13 International Conference on Human-Computer Interaction - Volume Part II, INTERACT'07 2007 Springer-Verlag Berlin, Heidelberg 475 488
2. T. Kapuscinski, and M. Wysocki Using hierarchical temporal memory for recognition of signed polish words M. Kurzynski, M. Wozniak, Computer Recognition Systems: Advances in Intelligent and Soft Computing 2009 Springer-Verlag Berlin/Heidelberg 355 362
3. W. Zheng, Z.-z. Cui, Z. Zheng, and Y. Zhang Remote monitoring of human hand motion using induced electrostatic signals Journal of Electrostatics 69 6 2011 571 577
4. N.H. Dardas, and N.D. Georganas Real-time hand gesture detection and recognition using bag-of-features and support vector machine techniques IEEE Transactions on Instrumentation and Measurement 60 11 2011 3592 3607
5. E. Mollenbach, Selection Strategies in Gaze Interaction, PhD Thesis, Loughborough University, 2010.
6. J. San Agustin, H. Skovsgaard, E. Mollenbach, M. Barret, M. Tall, D.W. Hansen, and J.P. Hansen Evaluation of a low-cost open-source gaze tracker ETRA '10: Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications 2010 ACM New York, NY, USA 77 80
7. A.T. Duchowski Eye Tracking Methodology: Theory and Practice 2007 Springer-Verlag New York, Inc. Secaucus, NJ, USA
8. C. Hennessey, B. Noureddin, and P. Lawrence Fixation precision in high-speed noncontact eye-gaze tracking IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 38 2 2008 289 298 (Pubitemid 351479552)
9. R.J.K. Jacob The use of eye movements in human-computer interaction techniques: what you look at is what you get ACM Transactions on Information Systems 9 2 1991 152 169
10. E. Mollenbach, J.P. Hansen, M. Lillholm, and A.G. Gale Single stroke gaze gestures Proceedings of the 27th International Conference Extended Abstracts on Human Factors in Computing Systems, CHI '09 2009 ACM New York, NY, USA 4555 4560
11. P. Qvarfordt, and S. Zhai Conversing with the user based on eye-gaze patterns CHI '05: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems 2005 ACM New York, NY, USA 221 230 (Pubitemid 41809059)
12. J.O. Wobbrock, J. Rubinstein, M. Sawyer, A.T. Duchowski, and L. Uk Gaze-based creativity not typing but writing: eye-based text entry using letter-like gestures The 3rd Conference on Communication by Gaze Interaction - COGAIN 2007 2007
13. N. Bee, and E. André Writing with your eye: a dwell time free writing system adapted to the nature of human eye gaze Proceedings of the 4th IEEE Tutorial and Research Workshop on Perception and Interactive Technologies for Speech-Based Systems 2008 Springer-Verlag 111 122
14. P. Isokoski Text input methods for eye trackers using off-screen targets ETRA '00: Proceedings of the 2000 Symposium on Eye Tracking Research & Applications 2000 ACM New York, NY, USA 15 21
15. H. Drewes, Eye Gaze Tracking for Human Computer Interaction, PhD Thesis, Ludwig-Maximilians-Universität München, 2010.
16. J.O. Wobbrock, J. Rubinstein, M.W. Sawyer, and A.T. Duchowski Longitudinal evaluation of discrete consecutive gaze gestures for text entry Proceedings of the 2008 Symposium on Eye Tracking Research & Applications 2008 ACM Savannah, Georgia 11 18
17. S. Vickers, H. Istance, A. Hyrskykari, L. Immonen, and S. Mansikkamaa Designing gaze gestures for gaming: an investigation of performance Proceedings of the 2010 Symposium on Eye Tracking Research & Applications; ETRA 2010 2010 ACM Press Austin, TX
18. B. Srinath Reddy, and O.A. Basir Concept-based evidential reasoning for multimodal fusion in human-computer interaction Applied Soft Computing 10 2 2010 567 577
19. G. Fang, and W. Gao A srn/hmm system for signer-independent continuous sign language recognition Fifth IEEE International Conference on Automatic Face and Gesture Recognition, 2002. Proceedings. May 2002 312 317
20. T.-J. Hsieh, H.-F. Hsiao, and W.-C. Yeh Forecasting stock markets using wavelet transforms and recurrent neural networks: an integrated system based on artificial bee colony algorithm Applied Soft Computing 11 March (2) 2011 2510 2525
21. R.-H. Liang, and M. Ouhyoung A real-time continuous gesture recognition system for sign language. Third IEEE International Conference on Automatic Face and Gesture Recognition, 1998. Proceedings. April 1998 558 567
22. D. George, J. Hawkins, Towards a mathematical theory of cortical micro-circuits, PLoS Computational Biology 5 (10) (2009) e1000532, 10.
23. J. Hawkins, Hierarchical temporal memory, concepts, theory, and terminology, Technical report, Numenta, 2006.
24. M.I. Rabinovich, P. Varona, A.I. Selverston, and H.D.I. Abarbanel Dynamical principles in neuroscience Reviews of Modern Physics 78 4 2006
25. F.B. Rodríguez, and R. Huerta Analysis of perfect mappings of the stimuli through neural temporal sequences Neural Networks 17 7 2004 963 973 (Pubitemid 39093816)
26. D. George, and J. Hawkins A hierarchical Bayesian model of invariant pattern recognition in the visual cortex 2005 IEEE International Joint Conference on Neural Networks, 2005. IJCNN '05. Proceedings vol. 3, July-4 August 2005 1812 1817 (Pubitemid 44591475)
27. Numenta, Problems that fit htm. Technical report, Numenta, 2006.
28. D. Rozado, F.B. Rodriguez, and P. Varona Extending the bioinspired hierarchical temporal memory paradigm for sign language recognition Neurocomputing 79 0 2012 75 86
29. D. Rozado, Remote gaze gestures. http://www.youtube.com/watch?v= BaZx2aKoxDI, November 2011.
30. J. San Agustin, Off-the-Shelf Gaze Interaction, PhD Thesis, IT University of Copenhagen, 2010.
31. E. Mollenbach, M. Lillholm, A. Gail, and J.P. Hansen Single gaze gestures Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications, ETRA '10 2010 177 180
32. D. George, J. Hawkins, Belief propagation and wiring length optimization as organizing principles for cortical microcircuits, Technical report, Numenta, http://www.numenta.com, 2006.
33. S.B. Needleman, and C.D. Wunsch A general method applicable to the search for similarities in the amino acid sequence of two proteins Journal of Molecular Biology 48 3 1970 443 453
34. R. Giegerich A systematic approach to dynamic programming in bioinformatics Bioinformatics 16 8 2000 665 677
35. D. George, B. Jarosy, The HTM learning algorithms, Technical report, Numenta, 2007.
36. M. AL-Rousan, K. Assaleh, and A. Tala'a Video-based signer-independent arabic sign language recognition using hidden markov models Applied Soft Computing 9 3 2009 990 999
37. X. Zhang, X. Chen, Y. Li, V. Lantz, K. Wang, and J. Yang A framework for hand gesture recognition based on accelerometer and EMG sensors IEEE Transactions on Systems Man and Cybernetics Part A-Systems and Humans 41 6 2011 1064 1076
38. M.P. Cuéllar, M. Delgado, and M.C. Pegalajar An application of non-linear programming to train recurrent neural networks in time series prediction problems C.-S. Chen, J. Filipe, I. Seruca, J. Cordeiro, Enterprise Information Systems VII 2006 Springer Netherlands 95 102
39. D. Rozado, F. Rodriguez, P. Varona, Optimizing hierarchical temporal memory for multivariable time series, in: K. Diamantaras, W. Duch, L. Iliadis (Eds.), Artificial Neural Networks - ICANN 2010, volume 6353 of Lecture Notes in Computer Science, Springer, Berlin/Heidelberg, 2010, pp. 506-518. doi:10.1007/978-3-642-15822-3-62.
40. D. Rozado, F. Rodriguez, and P. Varona Gaze gesture recognition with hierarchical temporal memory networks International Work Conference on Artificial Neural Networks 2011 - Lecture Notes in Computer Science 2011