Real-time hand gesture detection and recognition using bag-of-features and support vector machine techniques

IEEE Transactions on Instrumentation and Measurement

Volumn 60, Issue 11, 2011, Pages 3592-3607

  Dardas, Nasser H ^a   Georganas, Nicolas D ^a  

^a UNIVERSITY OF OTTAWA   (Canada)

Author keywords

Bag of features; grammar; hand gesture; hand posture; human computer interaction; K means; object detection; object recognition; scale invariant feature transform (SIFT); support vector machine (SVM)

Indexed keywords

BAG-OF-FEATURES; GRAMMAR; HAND GESTURE; HAND POSTURE; HUMAN-COMPUTER; K-MEANS; OBJECT DETECTION; SCALE INVARIANT FEATURE TRANSFORMS; SUPPORT VECTOR;

ALGORITHMS; FEATURE EXTRACTION; GESTURE RECOGNITION; GRAPHIC METHODS; HUMAN COMPUTER INTERACTION; OBJECT RECOGNITION; REAL TIME SYSTEMS; SUPPORT VECTOR MACHINES; VECTOR QUANTIZATION;

VECTORS;

EID: 80054078077     PISSN: 00189456     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIM.2011.2161140     Document Type: Article

References (66)

1. A. El-Sawah, N. Georganas, and E. Petriu, "A prototype for 3-D hand tracking and gesture estimation," IEEE Trans. Instrum. Meas., vol. 57, no. 8, pp. 1627-1636, Aug. 2008.
2. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, Nov. 2004.
3. A. Bosch, X. Munoz, and R. Marti, "Which is the best way to organize/classify images by content?" Image Vis. Comput., vol. 25, no. 6, pp. 778-791, Jun. 2007.
4. H. Zhou and T. Huang, "Tracking articulated hand motion with Eigen dynamics analysis," in Proc. Int. Conf. Comput. Vis., 2003, vol. 2, pp. 1102-1109.
5. B. Stenger, "Template based hand pose recognition using multiple cues," in Proc. 7th ACCV, 2006, pp. 551-560.
6. L. Bretzner, I. Laptev, and T. Lindeberg, "Hand gesture recognition using multiscale color features, hieracrchichal models and particle filtering," in Proc. Int. Conf. Autom. Face Gesture Recog., Washington, DC, May 2002.
7. A. Argyros and M. Lourakis, "Vision-based interpretation of hand gestures for remote control of a computer mouse," in Proc. Workshop Comput. Human Interact., 2006, pp. 40-51.
8. C. Wang and K. Wang, Hand Gesture Recognition Using Adaboost With SIFT for Human Robot Interaction, vol. 370. Berlin, Germany: Springer-Verlag, 2008.
9. A. Barczak and F. Dadgostar, "Real-time hand tracking using a set of co-operative classifiers based on Haar-like features," Res. Lett. Inf. Math. Sci., vol. 7, pp. 29-42, 2005.
10. Q. Chen, N. Georganas, and E. Petriu, "Real-time vision-based hand gesture recognition using Haar-like features," in Proc. IEEE IMTC, 2007, pp. 1-6.
11. P. Viola and M. Jones, "Robust real-time object detection," Int. J. Comput. Vis., vol. 2, no. 57, pp. 137-154, 2004.
12. S. Wagner, B. Alefs, and C. Picus, "Framework for a portable gesture interface," in Proc. Int. Conf. Autom. Face Gesture Recog., 2006, pp. 275-280.
13. M. Kolsch and M. Turk, "Analysis of rotational robustness of hand detection with a Viola-Jones detector," in Proc. 17th ICPR, 2004, pp. 107-110.
14. Y. Ke and R. Sukthankar, "PCA-SIFT: A more distinctive representation for local image descriptors," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2004, pp. II-506-II-513.
15. H. Bay, A. Ess, T. Tuytelaars, and L. Gool, "SURF: Speeded up robust features," Comput. Vis. Image Understand. (CVIU), vol. 110, no. 3, pp. 346-359, 2008.
16. W. Zhao, Y. Jiang, and C. Ngo, "Keyframe retrieval by keypoints: Can point-to-point matching help?" in Proc. 5th Int. Conf. Image Video Retrieval, 2006, pp. 72-81.
17. S. Lazebnik, C. Schmid, and J. Ponce, "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2006, pp. 2169-2178.
18. Y. Jiang, C. Ngo, and J. Yang, "Towards optimal bag-of-features for object categorization and semantic video retrieval," in Proc. ACM Int. Conf. Image Video Retrieval, 2007, pp. 494-501.
19. L. Juan and O. Gwun, "A comparison of SIFT, PCA-SIFT and SURF," Int. J. Image Process. (IJIP), vol. 3, no. 4, pp. 143-152, 2009.
20. D. J. C. MacKay, Information Theory, Inference, and Learning Algorithms. Cambridge, U.K.: Cambridge Univ. Press, 2003.
21. J.Weston and C.Watkins, "Multi-class support vector machines," in Proc. ESANN, M. Verleysen, Ed., Brussels, Belgium, 1999.
22. C.-C. Chang and C.-J. Lin, LIBSVM: A Library for Support Vector Machines, 2001. [Online]. Available: http://www.csie.ntu.edu.tw/~cjlin/libsvm
23. C.-W. Hsu and C.-J. Lin, "A comparison of methods for multi-class support vector machines," IEEE Trans. Neural Netw., vol. 13, no. 2, pp. 415-425, Mar. 2002.
24. J. H. Friedman, "Another approach to polychotomous classification," Dept. Statist., Stanford Univ., Stanford, CA, 1997.
25. N. Dardas, Q. Chen, N. Georganas, and E. Petriu, "Hand gesture recognition using bag-of-features and multi-class support vector machine," in Proc. 9th IEEE Int. Workshop HAVE, Phoenix, AZ, Oct. 16-17, 2010, pp. 1-5.
26. J. M. Rehg and T. Kanade, "Visual tracking of high DOF articulated structures: An application to human hand tracking," in Proc. Eur. Conf. Comput. Vis., 1994, pp. 35-46.
27. J. Yang, W. Lu, and A. Waibel, "Skin-color modeling and adaptation," in Proc. ACCV, 1998, pp. 687-694.
28. B. Zarit, B. Super, and F. Quek, "Comparison of five color models in skin pixel classification," in Proc. ICCV Int. Workshop Recog., Anal. Tracking Faces Gestures Real-Time Syst., 1999, pp. 58-63.
29. A. Ford and A. Roberts, "Color space conversions," Westminster Univ., London, U.K., Aug. 11, 1998.
30. R. Gonzalez, R. Woods, and S. Eddins, Digital Image Processing Using MATLAB. Englewood Cliffs, NJ: Prentice-Hall, 2004.
31. H. Jun and Z. Hua, "A real time face detection method in human-machine interaction," in Proc. ICBBE, 2008, pp. 1975-1978.
32. W. Kelly, A. Donnellan, and D. Molloy, "Screening for objectionable images: A review of skin detection techniques," in Proc. IMVIP, 2008, pp. 151-158.
33. Q. Zhu, C.-T. Wu, K.-T. Cheng, and Y.-L. Wu, "An adaptive skin model and its application to objectionable image filtering," in Proc. ACM Multimedia, 2004, pp. 56-63.
34. K. Nallaperumal, S. Ravi, C. N. K. Babu, R. K. Selvakumar, A. L. Fred, C. Seldev, and S. S. Vinsley, "Skin detection using color pixel classification with application to face detection: A comparative study," in Proc. IEEE Int. Conf. Comput. Intell. Multimedia Appl., 2007, vol. 3, pp. 436-441.
35. A. J. Heap and D. C. Hogg, "Towards 3-D hand tracking using a deformable model," in Proc. 2nd Int. Face Gesture Recog. Conf., Killington, VT, Oct. 1996, pp. 140-145.
36. Y. Wu, J. Y. Lin, and T. S. Huang, "Capturing natural hand articulation," in Proc. 8th Int. Conf. Comput. Vis., Vancouver, BC, Canada, Jul. 2001, vol. II, pp. 426-432.
37. B. Stenger, P. R. S. Mendonça, and R. Cipolla, "Model-based 3D tracking of an articulated hand," in Proc. Brit. Mach. Vis. Conf., Manchester, U.K., Sep. 2001, vol. I, pp. 63-72.
38. Q. Chen, N. Georganas, and E. Petriu, "Hand gesture recognition using Haar-like features and a stochastic context-free grammar," IEEE Trans. Instrum. Meas., vol. 57, no. 8, pp. 1562-1571, Aug. 2008.
39. L. Bretzner, I. Laptev, and T. Lindeberg, "Hand gesture recognition using multi-scale colour features, hierarchical models and particle filtering," in Proc. 5th IEEE Int. Conf. Autom. Face Gesture Recog., 2002, pp. 405-410.
40. S. McKenna and K. Morrison, "A comparison of skin history and trajectory-based representation schemes for the recognition of userspecific gestures," Pattern Recognit., vol. 37, no. 5, pp. 999-1009, May 2004.
41. K. Imagawa, H. Matsuo, R. Taniguchi, D. Arita, S. Lu, and S. Igi, "Recognition of local features for camera-based sign language recognition system," in Proc. Int. Conf. Pattern Recog., 2000, vol. 4, pp. 849-853.
42. H. Jhuang, T. Serre, L. Wolf, and T. Poggio, "A biologically inspired system for action recognition," in Proc. IEEE ICCV, 2007, pp. 1-8.
43. J. Niebles, H.Wang, and L. Fei-Fei, "Unsupervised learning of human action categories using spatial-temporal words," Int. J. Comput. Vis., vol. 79, no. 3, pp. 299-318, Sep. 2008.
44. C. SchÜldt, I. Laptev, and B. Caputo, "Recognizing human actions: A local SVM approach," in Proc. ICPR, 2004, pp. 32-36.
45. A. Gilbert, J. Illingworth, and R. Bowden, "Fast realistic multi-action recognition using mined dense spatio-temporal features," in Proc. IEEE ICCV, 2009, pp. 925-931.
46. I. Laptev, M. Marszalek, C. Schmid, and B. Rozenfeld, "Learning realistic human actions from movies," in Proc. IEEE Conf. CVPR, 2008, pp. 1-8.
47. M. Marszalek, I. Laptev, and C. Schmid, "Actions in context," in Proc. IEEE Conf. CVPR, 2009, pp. 2929-2936.
48. L. Yeffet and L. Wolf, "Local trinary patterns for human action recognition," in Proc. IEEE ICCV, 2009, pp. 492-497.
49. S. Savarese, J. Winn, and A. Criminisi, "Discriminative object class models of appearance and shape by correlations," in Proc. IEEE Conf. CVPR, 2006, pp. 2033-2040.
50. A. Agarwal and B. Triggs, "Hyperfeatures: Multilevel local coding for visual recognition," in Proc. ECCV, 2006, pp. 30-43.
51. M. Marszalek and C. Schmid, "Spatial weighting for bag-of-features," in Proc. IEEE Conf. CVPR, 2006, pp. 2118-2125.
52. K. Grauman and T. Darrell, "The pyramid match kernel: Discriminative classification with sets of image features," in Proc. IEEE ICCV, 2005, pp. 1458-1465.
53. Z. Zhao and A. Elgammal, "Spatiotemporal pyramid representation for recognition of facial expressions and hand gestures," in Proc. IEEE Int. Conf. Autom. Face Gesture Recog., 2008, pp. 1-6.
54. P. Dollár, V. Rabaud, G. Cottrell, and S. Belongie, "Behavior recognition via sparse spatio-temporal features," in Proc. IEEE Int. Workshop Visual Surveillance Perform. Eval. Tracking Surveillance, 2005, pp. 65-72.
55. G. Willems, T. Tuytelaars, and L. Van Gool, "An efficient dense and scale invariant spatio-temporal interest point detector," in Proc. ECCV, 2008, pp. 650-663.
56. I. Junejo, E. Dexter, I. Laptev, and P. Pérez, "Cross-view action recognition from temporal self-similarities," in Proc. ECCV, 2008, pp. 293-306.
57. A. Kläser, M. Marszalek, and C. Schmid, "A spatio-temporal descriptor based on 3D-gradients," in Proc. BMVC, 2008, pp. 995-1004.
58. S. Marcel, "Hand posture recognition in a body-face centered space," in Proc. Conf. Human Factors Comput. Syst. (CHI), 1999, pp. 302-303.
59. W. Chung, X. Wu, and Y. Xu, "A real time hand gesture recognition based on Haar wavelet representation," in Proc. IEEE Int. Conf. Robot. Biomimetics, 2009, pp. 336-341.
60. Y. Fang, K. Wang, J. Cheng, and H. Lu, "A real-time hand gesture recognition method," in Proc. IEEE Int. Conf. Multimedia Expo, 2007, pp. 995-998.
61. L. Yun and Z. Peng, "An automatic hand gesture recognition system based on Viola-Jones method and SVMs," in Proc. 2nd Int. Workshop Comput. Sci. Eng., 2009, pp. 72-76.
62. Y. Ren and C. Gu, "Real-time hand gesture recognition based on vision," in Proc. Edutainment, 2010, pp. 468-475.
63. A. L. C. Barczak, F. Dadgostar, and C. H. Messom, "Real-time hand tracking based on non-invariant features," in Proc. IEEE Instrum. Meas. Technol. Conf., Ottawa, ON, Canada, 2005, pp. 2192-2197.
64. A. Micilotta and R. Bowden, "View-based location and tracking of body parts for visual interaction," in Proc. BMVC, 2004, pp. 849-858.
65. C. Messom and A. Barczak, "Fast and efficient rotated haar-like features using rotated integral images," in Proc. ACRA, 2006, pp. 1-6.
66. L. Shi, Y. Wang, and J. Li, "A real time vision-based hand gestures recognition system," in Proc. 5th ISICA, 2010, pp. 349-358.