Hand gestures for intelligent tutoring systems: Dataset, techniques & evaluation

Proceedings of the IEEE International Conference on Computer Vision

Volumn , Issue , 2013, Pages 769-776

  Sathyanarayana, Suchitra ^a   Littlewort, Gwen ^a   Bartlett, Marnie ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Bag of words; Gesture recognition; Motion history image; SIFT; Tutoring

Indexed keywords

GESTURE RECOGNITION;

APPEARANCE BASED; BAG OF WORDS; DETECTION ACCURACY; INTELLIGENT TUTORING SYSTEM; MOTION HISTORY IMAGES; SIFT; SOCIAL INTERACTIONS; TUTORING;

COMPUTER AIDED INSTRUCTION;

EID: 84897551574     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICCVW.2013.105     Document Type: Conference Paper

References (31)

1. M. A. R. Ahad, J. K. Tan, H. Kim, and S. Ishikawa. Motion history image: its variants and applications. Mach. Vision Appl., 23(2):255-281, Mar. 2012.
2. B. Bloom. The 2 sigma problem: The search for methods of group instruction as effective as one-to-one tutoring. In Educational Researcher, volume 13, page 416, 1984.
3. A. F. Bobick, J. W. Davis, I. C. Society, and I. C. Society. The recognition of human movement using temporal templates. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23:257-267, 2001.
4. L. Bretzner, I. Laptev, and T. Lindeberg. Hand gesture recognition using multi-scale colour features, hierarchical models and particle filtering. In Automatic Face and Gesture Recognition, 2002. Proceedings. Fifth IEEE International Conference on, pages 423-428, 2002.
5. V. K. Conati. C, Gertner. A. Using bayesian networks to manage uncertainty in student modeling. In User modeling and user-adapted interaction, volume 12, page 371417, 2002.
6. K. K. Corbett. A and A. J. R. Intelligent tutoring systems. In Handbook of humancomputer interaction, page 849874, 1997.
7. A. Elgammal, V. Shet, Y. Yacoob, and L. S. Davis. Learning dynamics for exemplar-based gesture recognition. In IEEE Conference on Computer Vision and Pattern Recognition, pages 571-578, 2003.
8. B. F. J. Coordinated movement and rapport in teacherstudent interactions. Journal of Nonverbal behavior, 12(2):120-138, 1988.
9. M. Kaaniche and F. Bremond. Gesture recognition by learning local motion signatures. In Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on, pages 2745-2752, 2010.
10. M. Kaaniche and F. Bremond. Recognizing gestures by learning local motion signatures of hog descriptors. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 34(11):2247-2258, 2012.
11. D. Kelly, J. McDonald, and C. Markham. Continuous recognition of motion based gestures in sign language. In Computer Vision Workshops (ICCV Workshops), 2009 IEEE 12th International Conference on, pages 1073-1080, 2009.
12. S. Lazebnik, C. Schmid, and J. Ponce. Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Volume 2, CVPR '06, pages 2169-2178, Washington, DC, USA, 2006. IEEE Computer Society.
13. M. M. Louwerse and A. Bangerter. Focusing attention with deictic gestures and linguistic expressions. 2005.
14. D. G. Lowe. Object recognition from local scale-invariant features. In In Computer vision, 1999. The proceedings of the seventh IEEE international conference on, Volume 2, page 11501157, 1999.
15. D. McNeill. Gesture: A psycholinguistic approach.
16. D. McNeill. Hand and mind. 1992.
17. L. Morency, A. Quattoni, and T. Darrell. Latent-dynamic discriminative models for continuous gesture recognition. In Computer Vision and Pattern Recognition, 2007. CVPR '07. IEEE Conference on, pages 1-8, 2007.
18. E. Ohn-Bar and M. M. Trivedi. The power is in your hands: 3d analysis of hand gestures in naturalistic video. In Computer Vision and Pattern Recognition Workshops, 2013.
19. S. Padam Priyal and P. K. Bora. A robust static hand gesture recognition system using geometry based normalizations and krawtchouk moments. Pattern Recogn., 46(8):2202-2219, Aug. 2013.
20. V. I. Pavlovic, R. Sharma, and T. S. Huang. Visual interpretation of hand gestures for human-computer interaction: A review. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19:677-695, 1997.
21. J. M. Rehg and T. Kanade. Model-based tracking of selfoccluding articulated objects. In In ICCV, pages 612-617, 1995.
22. C. P. Rośe, D. Litman, D. Bhembe, K. Forbes, S. Silliman, R. Srivastava, and K. VanLehn. A comparison of tutor and student behavior in speech versus text based tutoring. In Proceedings of the HLT-NAACL 03 workshop on Building educational applications using natural language processing-Volume 2, HLT-NAACL-EDUC '03, pages 30-37, Stroudsburg, PA, USA, 2003. Association for Computational Linguistics.
23. I. Rosenfelder. A short introduction to transcribing with elan. Technical report, University of Pennsylvania, 2011.
24. A. Sarrafzadeh, S. Alexander, F. Dadgostar, C. Fan, and A. Bigdeli. See Me, Teach Me: Facial Expression and Gesture Recognition for Intelligent Tutoring Systems. 2006 Innovations in Information Technology, pages 1-5, Nov. 2006.
25. X. Shen, G. Hua, L. Williams, and Y. Wu. Dynamic hand gesture recognition: An exemplar-based approach from motion divergence fields. Image and Vision Computing, 30(3):227-235, Mar. 2012.
26. T. Starner, J. Weaver, and A. Pentland. Real-time american sign language recognition using desk and wearable computer based video. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(12):1371-1375, 1998.
27. A. Vedaldi and B. Fulkerson. Vlfeat: an open and portable library of computer vision algorithms. In Proceedings of the international conference on Multimedia, MM '10, pages 1469-1472, New York, NY, USA, 2010. ACM.
28. J. Wang, J. Yang, K. Yu, F. Lv, T. Huang, and Y. Gong. Locality-constrained linear coding for image classification. In IN: IEEE Conference on Computer Vision and Pattern Classification, 2010.
29. S. B. Wang, A. Quattoni, L. Morency, D. Demirdjian, and T. Darrell. Hidden conditional random fields for gesture recognition. In Computer Vision and Pattern Recognition, 2006 IEEE Computer Society Conference on, volume 2, pages 1521-1527, 2006.
30. B.Williams, C.Williams, N. Volgas, B. Yuan, and N. Person. Examining the role of gestures in expert tutoring. In Proceedings of the 10th international conference on Intelligent Tutoring Systems-Volume Part I, ITS'10, pages 235-244, Berlin, Heidelberg, 2010. Springer-Verlag.
31. J. R. Zhang, K. Guo, C. Herwana, and J. R. Kender. Annotation and taxonomy of gestures in lecture videos. 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops, pages 1-8, June 2010.