One-shot learning gesture recognition from RGB-D data using bag of features

Journal of Machine Learning Research

Volumn 14, Issue , 2013, Pages 2549-2582

  Wan, Jun ^a   Ruan, Qiuqi ^a   Li, Wei ^a   Deng, Shuang ^b  

^a BEIJING JIAOTONG UNIVERSITY   (China)

^b Chinese Academy of Agricultural Mechanization Sciences   (China)

Author keywords

3D enhanced motion scale invariant feature transform (3D EMoSIFT); Bag of features (BoF) model; Gesture recognition; One shot learning; Simulation Orthogonal Matching Pursuit (SOMP)

Indexed keywords

BAG OF FEATURES; DISCRIMINATIVE MODELS; ONE-SHOT LEARNING; ORTHOGONAL MATCHING PURSUIT; RECONSTRUCTION ERROR; SCALE INVARIANT FEATURE TRANSFORMS; SPATIO-TEMPORAL FEATURES; VISUAL REPRESENTATIONS;

FEATURE EXTRACTION; IMAGE MATCHING; SAMPLING; THREE DIMENSIONAL; VECTOR QUANTIZATION;

GESTURE RECOGNITION;

EID: 84883271877     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (56)

1. G. Bradski. The OpenCV Library. Dr. Dobb's Journal of Software Tools, 2000.
2. M. Brand, N. Oliver, and A. Pentland. Coupled hidden markov models for complex action recognition. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pages 994-999, 1997.
3. C.C. Chang and C.J. Lin. Libsvm: A library for support vector machines. ACM Transactions on Intelligent Systems and Technology, 2(3):27:1-27:27, 2011.
4. F.S. Chen, C.M. Fu, and C.L. Huang. Hand gesture recognition using a real-time tracking method and hidden markov models. Image and Vision Computing, 21:745-758, 2003.
5. M. Chen and A. Hauptmann. Mosift: Recognizing human actions in surveillance videos. Technical Report, 2009.
6. H. Cooper, E.J. Ong, N. Pugeault, and R. Bowden. Sign language recognition using sub-units. Journal of Machine Learning Research, 13:2205-2231, 2012.
7. A. Corradini. Dynamic time warping for off-line recognition of a small gesture vocabulary. In Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems, IEEE ICCV Workshop on, pages 82-89, 2001.
8. N.H. Dardas and N.D. Georganas. Real-time hand gesture detection and recognition using bagof- features and support vector machine techniques. IEEE Transactions on Instrumentation and Measurement, 60(11):3592-3607, 2011.
9. P. Dollár, V. Rabaud, G. Cottrell, and S. Belongie. Behavior recognition via sparse spatio-temporal features. In Proceedings of IEEE International Workshop on Visual Surveillance and Perfor- mance Evaluation of Tracking and Surveillance, pages 65-72, 2005. (Pubitemid 46178025)
10. H.J. Escalante and I. Guyon. Principal motion: Pca-based reconstruction of motion histograms. Technical Memorandum, 2012.
11. L. Fei-Fei and P. Perona. A bayesian hierarchical model for learning natural scene categories. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, volume 2, pages 524-531, 2005.
12. F. Fl órez, J.M. Garćia, J. Garćia, and A. Hernández. Hand gesture recognition following the dynamics of a topology-preserving network. In Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition, pages 318-323, 2002.
13. P.-E. Forssen and D.G. Lowe. Shape descriptors for maximally stable extremal regions. In Computer Vision, IEEE 11th International Conference on, pages 1-8, 2007.
14. W.T. Freeman and M. Roth. Orientation histograms for hand gesture recognition. In Proceedings of IEEE International Workshop on Automatic Face and Gesture Recognition, volume 12, pages 296-301, 1995.
15. W. Gao, G. Fang, D. Zhao, and Y. Chen. A chinese sign language recognition system based on sofm/srn/hmm. Pattern Recognition, 37(12):2389-2402, 2004. (Pubitemid 40134543)
16. T. Guha and R.K. Ward. Learning sparse representations for human action recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 34(8):1576-1588, 2012.
17. S. Guo, Z. Wang, and Q. Ruan. Enhancing sparsity via lp (0
18. I. Guyon, V. Athitsos, P. Jangyodsuk, B. Hamner, and H.J. Escalante. Chalearn gesture challenge: Design and first results. In Computer Vision and Pattern Recognition Workshops, IEEE Confer- ence on, pages 1-6, 2012.
19. I. Guyon, V. Athitsos, P. Jangyodsuk, H.J. Escalante, and B. Hamner. Results and analysis of the chalearn gesture challenge 2012. Technical Report, 2013.
20. C. Harris and M. Stephens. A combined corner and edge detector. In Proceedings of Alvey Vision Conference, volume 15, page 50, 1988.
21. A. Hernández-Vela, M. A. Bautista, X. Perez-Sala, V. Ponce, X. Bar ó, O. Pujol, C. Angulo, and S. Escalera. Bovdw: Bag-of-visual-and-depth- words for gesture recognition. Pattern Recognition (ICPR), 21st International Conference on, 2012.
22. D. Kim, J. Song, and D. Kim. Simultaneous gesture segmentation and recognition based on forward spotting accumulative hmms. Pattern Recognition, 40(11):3012-3026, 2007. (Pubitemid 46990423)
23. I. Laptev. On space-time interest points. International Journal of Computer Vision, 64(2):107-123, 2005. (Pubitemid 41314645)
24. J.F. Lichtenauer, E.A. Hendriks, and M. J T Reinders. Sign language recognition by combining statistical dtw and independent classification. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 30(11):2040-2046, 2008.
25. Y. Linde, A. Buzo, and R. Gray. An algorithm for vector quantizer design. Communications, IEEE Transactions on, 28(1):84-95, 1980.
26. D.G. Lowe. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2):91-110, 2004.
27. B.D. Lucas, T. Kanade, et al. An iterative image registration technique with an application to stereo vision. In Proceedings of the 7th International Joint Conference on Artificial Intelligence, 1981.
28. Yui Man Lui. Human gesture recognition on product manifolds. Journal of Machine Learning Research, 13:3297-3321, 2012.
29. M.R. Malgireddy, I. Inwogu, and V. Govindaraju. A temporal bayesian model for classifying, detecting and localizing activities in video sequences. In Computer Vision and Pattern Recognition Workshops, IEEE Conference on, pages 43-48, 2012.
30. A. Malima, E. Ozgur, and M. Ç etin. A fast algorithm for vision-based hand gesture recognition for robot control. In Proceedings of IEEE Signal Processing and Communications Applications, pages 1-4, 2006.
31. Y. Ming, Q. Ruan, and A.G. Hauptmann. Activity recognition from rgb-d camera with 3d local spatio-temporal features. In Proceedings of IEEE International Conference on Multimedia and Expo, pages 344-349, 2012.
32. L.P. Morency, A. Quattoni, and T. Darrell. Latent-dynamic discriminative models for continuous gesture recognition. In Proceedings of IEEE Conference on Computer Vision and Pattern Recog- nition, pages 1-8, 2007.
33. B.A. Olshausen, D.J. Field, et al. Sparse coding with an overcomplete basis set: A strategy employed by vi? Vision Research, 37(23):3311-3326, 1997.
34. V.I. Pavlovic, R. Sharma, and T.S. Huang. Visual interpretation of hand gestures for humancomputer interaction: a review. IEEE Transactions on Pattern Analysis andMachine Intelligence, 19:677-695, 1997. (Pubitemid 127762261)
35. A. Rakotomamonjy. Surveying and comparing simultaneous sparse approximation (or group-lasso) algorithms. Signal Processing, 91(7):1505-1526, 2011.
36. S. Reifinger, F. Wallhoff, M. Ablassmeier, T. Poitschke, and G. Rigoll. Static and dynamic handgesture recognition for augmented reality applications. In Proceedings of the 12th International Conference on Human-computer Interaction: Intelligent Multimodal Interaction Environments, pages 728-737, 2007.
37. Y. Ruiduo, S. Sarkar, and B. Loeding. Enhanced level building algorithm for the movement epenthesis problemin sign language recognition. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pages 1-8, 2007.
38. C. Shan, T. Tan, and Y. Wei. Real-time hand tracking using a mean shift embedded particle filter. Pattern Recognition, 40(7):1958-1970, 2007. (Pubitemid 46497247)
39. X. Shen, G. Hua, L. Williams, and Y. Wu. Dynamic hand gesture recognition: An exemplar-based approach from motion divergence fields. Image and Vision Computing, 30(3):227-235, 2012.
40. C. Sminchisescu, A. Kanaujia, Zhiguo Li, and D. Metaxas. Conditional models for contextual human motion recognition. In Computer Vision, Tenth IEEE International Conference on, volume 2, pages 1808-1815, 2005. (Pubitemid 44042396)
41. H.I. Suk, B.K. Sin, and S.W. Lee. Hand gesture recognition based on dynamic bayesian network framework. Pattern Recognition, 43(9):3059-3072, 2010.
42. J. Weaver T. Starner and A. Pentland. Real-time american sign language recognition using desk and wearable computer based video. IEEE Transactions on Pattern Analysis and Machine Intel- ligence, 20:1371-1375, 1998. (Pubitemid 128741382)
43. J.A. Tropp, A.C. Gilbert, and M.J. Strauss. Algorithms for simultaneous sparse approximation. part i: Greedy pursuit. Signal Processing, 86(3):572-588, 2006. (Pubitemid 43106572)
44. A. Vedaldi and B. Fulkerson. VLFeat: An open and portable library of computer vision algorithms. http://www.vlfeat.org/, 2008.
45. A.J. Viterbi. Error bounds for convolutional codes and an asymptotically optimum decoding algorithm. Information Theory, IEEE Transactions on, 13(2):260-269, 1967.
46. C. P. Vogler. American Sign Language Recognition: Reducing the Complexity of the Task with Phoneme-based Modeling and Parallel Hidden Markov Models. PhD thesis, Doctoral dissertation, University of Pennsylvania, 2003.
47. J. Wan, Q. Ruan, G. An, andW. Li. Gesture recognition based on hidden markov model from sparse representative observations. In Signal Processing (ICSP), IEEE 10th International Conference on, pages 1180-1183, 2012.
48. H. Wang, M.M. Ullah, A. Klaser, I. Laptev, C. Schmid, et al. Evaluation of local spatio-temporal features for action recognition. In Proceedings of British Machine Vision Conference, 2009.
49. J. Wang, J. Yang, K. Yu, F. Lv, T. Huang, and Y. Gong. Locality-constrained linear coding for image classification. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pages 3360-3367, 2010.
50. S.B. Wang, A. Quattoni, L.P. Morency, D. Demirdjian, and T. Darrell. Hidden conditional random fields for gesture recognition. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, volume 2, pages 1521-1527, 2006. (Pubitemid 44931500)
51. J. Wright, A.Y. Yang, A. Ganesh, S.S. Sastry, and Yi Ma. Robust face recognition via sparse representation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31:210-227, 2009.
52. J. Yamato, Jun Ohya, and K. Ishii. Recognizing human action in time-sequential images using hidden markov model. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pages 379-385, 1992.
53. J. Yang, K. Yu, Y. Gong, and T. Huang. Linear spatial pyramid matching using sparse coding for image classification. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pages 1794-1801, 2009.
54. M.H. Yang, N. Ahuja, and M. Tabb. Extraction of 2d motion trajectories and its application to hand gesture recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24: 1061-1074, 2002.
55. D. Youtian, C. Feng, X. Wenli, and Li. Yongbin. Recognizing interaction activities using dynamic bayesian network. In Pattern Recognition, 18th International Conference on, volume 1, pages 618-621, 2006. (Pubitemid 46531978)
56. Y. Zhu, G. Xu, and D.J. Kriegman. A real-time approach to the spotting, representation, and recognition of hand gestures for human-computer interaction. Computer Vision and Image Under- standing, 85(3):189-208, 2002.