Adaptive human action recognition with an evolving bag of key poses

IEEE Transactions on Autonomous Mental Development

Volumn 6, Issue 2, 2014, Pages 139-152

  Chaaraoui, Alexandros Andre ^a   Flórez Revuelta, Francisco ^b  

^a UNIVERSITY OF ALICANTE   (Spain)

^b KINGSTON UNIVERSITY   (United Kingdom)

Author keywords

Evolutionary computing and genetic algorithms; feature evaluation and selection; human computer interaction; vision and scene understanding

Indexed keywords

GENETIC ALGORITHMS; GESTURE RECOGNITION; HUMAN COMPUTER INTERACTION; HUMAN ROBOT INTERACTION;

DYNAMIC ENVIRONMENTS; EVOLUTIONARY COMPUTING; EVOLUTIONARY METHOD; EVOLUTIONARY OPTIMIZATION METHOD; FEATURE EVALUATION AND SELECTION; HUMAN-ACTION RECOGNITION; INCREMENTAL LEARNING; VISION AND SCENE UNDERSTANDING;

COMPUTER VISION;

EID: 84903148278     PISSN: 19430604     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAMD.2014.2315676     Document Type: Article

References (43)

1. M. Valera and S. Velastin, "Intelligent distributed surveillance systems: A review," IEE Proc.-Vis., Image, Signal Process., vol. 152, no. 2, pp. 192-204, 2005. (Pubitemid 40643653)
2. J. Aggarwal and M. Ryoo, "Human activity analysis: A review," ACM Comput. Surv., vol. 43, no. 3, pp. 16:1-16:43, Apr. 2011.
3. V. Pavlovic, R. Sharma, and T. Huang, "Visual interpretation of hand gestures for human-computer interaction: A review," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 677-695, Jul. 1997. (Pubitemid 127762261)
4. T. Mann, Y. Park, S. Jeong, M. Lee, and Y. Choe, "Autonomous and interactive improvement of binocular visual depth estimation through sensorimotor interaction," IEEE Trans. Autonom. Mental Develop., vol. 5, no. 1, pp. 74-84, Mar. 2013.
5. A. Yorita and N. Kubota, "Cognitive development in partner robots for information support to elderly people," IEEE Trans. Autonom. Mental Develop., vol. 3, no. 1, pp. 64-73, Mar. 2011.
6. S. Dubowsky, F. Genot, S. Godding, H. Kozono, A. Skwersky, H. Yu, and L. S. Yu, "Pamm - a robotic aid to the elderly formobility assistance and monitoring: A "helping-hand" for the elderly," in Proc. IEEE Int. Conf. Robot. Autom. (ICRA '00), 2000, vol. 1, pp. 570-576.
7. J. Cano, F. Herrera, and M. Lozano, "A study on the combination of evolutionary algorithms and stratified strategies for training set selection in data mining," in Soft Computing: Methodologies and Applications, ser. Advances in Soft Computing, F. Hoffmann, M. Köppen, F. Klawonn, and R. Roy, Eds. Berlin, Germany: Springer-Verlag, 2005, vol. 32, pp. 271-284.
8. E. Cantú-Paz, "Feature subset selection, class separability, and genetic algorithms," in Genetic and Evolutionary Computation - GECCO 2004, ser. Lecture Notes in Computer Science, K. Deb, Ed. Berlin, Germany: Springer-Verlag, 2004, vol. 3102, pp. 959-970. (Pubitemid 39747288)
9. A. Bobick and J. Davis, "The recognition of human movement using temporal templates," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 3, pp. 257-267, Mar. 2001. (Pubitemid 32286632)
10. D. Tran and A. Sorokin, "Human activity recognition with metric learning," in Computer Vision - ECCV 2008, ser. LectureNotes in Computer Science, D. Forsyth, P. Torr, and A. Zisserman, Eds. Berlin, Germany: Springer-Verlag, 2008, vol. 5302, pp. 548-561.
11. D. Weinland, R. Ronfard, and E. Boyer, "Free viewpoint action recognition using motion history volumes," Comput. Vis. Image Understanding, vol. 104, no. 2, pp. 249-257, Nov. 2006. (Pubitemid 44573869)
12. L. Chen, H. Wei, and J. Ferryman, "A survey of human motion analysis using depth imagery," Pattern Recognit. Lett., vol. 34, no. 15, pp. 1995-2006, 2013, Smart Approaches for Human Action Recognition.
13. X. Wu, Z. Shi, and Y. Zhong, "Detailed analysis and evaluation of keypoint extraction methods," in Proc. 2010 Int. Conf. Comput. Appl. Syst. Modeling (ICCASM), Oct. 2010, vol. 2, pp. 562-566.
14. I. Laptev, "On space-time interest points," Int. J. Comput. Vis., vol. 64, pp. 107-123, 2005. (Pubitemid 41314645)
15. A. Oikonomopoulos, I. Patras, and M. Pantic, "Spatiotemporal salient points for visual recognition of human actions," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 36, no. 3, pp. 710-719, Jun. 2005.
16. J. Shotton, A. Fitzgibbon, M. Cook, T. Sharp,M. Finocchio, R.Moore, A. Kipman, and A. Blake, "Real-time human pose recognition in parts from single depth images," in Proc. 2011 IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2011, pp. 1297-1304.
17. L. Miranda, T. Vieira, D. Martinez, T. Lewiner, A. W. Vieira, and M. F. M. Campos, "Real-time gesture recognition from depth data through key poses learning and decision forests," in Proc. SIBGRAPI 2012 XXV Con. Graphics, Patterns, Images, Ouro Preto, MG, Aug. 2012, IEEE.
18. L. Xia, C.-C. Chen, and J. Aggarwal, "View invariant human action recognition using histograms of 3Djoints," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Workshops (CVPRW), Jun. 2012, pp. 20-27.
19. S. Azary and A. Savakis, "3D Action Classification Using Sparse Spatio-temporal Feature Representations," in Adv. Visual Comput., ser. Lecture Notes in Computer Science, G. Bebis, R. Boyle, B. Parvin, D. Koracin, C. Fowlkes, S. Wang, M.-H. Choi, S. Mantler, J. Schulze, D. Acevedo, K. Mueller, and M. Papka, Eds. Berlin, Germany: Springer-Verlag, 2012, vol. 7432, pp. 166-175.
20. H. Soh andY. Demiris, "Iterative temporal learning and predictionwith the sparse online echo state gaussian process," in Proc. 2012 Int. Joint Conf. Neural Netw. (IJCNN), Jun. 2012, pp. 1-8.
21. S. Fothergill, H. Mentis, P. Kohli, and S. Nowozin, "Instructing people for training gestural interactive systems," in Proc. SIGCHI Conf. Human Factors Comput. Syst., ser. CHI '12. New York, NY, USA: ACM, 2012, pp. 1737-1746.
22. X. Yang and Y. Tian, "EigenJoints-based Action Recognition Using Nave-Bayes-Nearest-Neighbor," in Proc. 2nd Int. Workshop Human Activity Understanding 3D Data Conjunction, Providence, RI, USA, 2012, pp. 14-19.
23. M. Raptis, D. Kirovski, and H. Hoppe, "Real-Time Classification of Dance Gestures from Skeleton Animation," in Proc. 10th Annu. ACM SIGGRAPH/Eurographics Symp. Comput. Animation (SCA 2011), 2011, pp. 147-156.
24. A. A. Chaaraoui, J. R. Padilla-López, P. Climent-Pérez, and F. Flórez-Revuelta, "Evolutionary joint selection to improve human action recognition with RGB-D devices," Expert Syst. Appl., vol. 41, no. 3, pp. 786-794, 2014, Methods and Applications of Artificial and Computational Intelligence.
25. J. Wang, Z. Liu, Y. Wu, and J. Yuan, "Mining Actionlet Ensemble for Action Recognition with Depth Cameras," in IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR 2012), Providence, Rhode Island, Jun. 2012.
26. M. Reyes, G. Dominguez, and S. Escalera, "Featureweighting in dynamic timewarping for gesture recognition in depth data," in 2011 IEEE Int. Conf. Comput. Vis. Workshops (ICCV Workshops), 2011, pp. 1182-1188.
27. S. Sempena, N. Maulidevi, and P. Aryan, "Human action recognition using dynamic time warping," in Proc. 2011 Int. Conf. Electr. Eng. Inf. (ICEEI), 2011, pp. 1-5.
28. M. N. Kapp, R. Sabourin, and P. Maupin, "A dynamic optimization approach for adaptive incremental learning," Int. J. Intell. Syst., vol. 26, no. 11, pp. 1101-1124, 2011.
29. R. Minhas, A. Mohammed, and Q.Wu, "Incremental learning in human action recognition based on snippets," IEEE Trans. Circuits Syst. Video Technol., vol. 22, no. 11, pp. 1529-1541, 2012.
30. Z. Wang, M. Jiang, Y. Hu, and H. Li, "An incremental learning method based on probabilistic neural networks and adjustable fuzzy clustering for human activity recognition by using wearable sensors," IEEE Trans. Inf. Technol. Biomed., vol. 16, no. 4, pp. 691-699, 2012.
31. M. S. Ryoo, J. Joung, S. Choi, and W. Yu, "Incremental learning of novel activity categories from videos," in Proc. 2010 16th Int. Conf. Virtual Syst. Multimedia (VSMM), 2010, pp. 21-26.
32. H. Yang, L. Shao, F. Zheng, L. Wang, and Z. Song, "Recent advances and trends in visual tracking: A review," Neurocomputing, vol. 74, no. 18, pp. 3823-3831, 2011.
33. J. Lim,D. Ross, R. sung Lin, and M. hsuanYang, "Incremental learning for visual tracking," in Advances in Neural Information Processing Systems. Cambridge, MA, USA: MIT Press, 2005, pp. 793-800.
34. S. Jain, S. Lange, and S. Zilles, "Towards a better understanding of incremental learning," in Algorithmic Learning Theory, ser. Lecture Notes in Computer Science, J. Balcázar, P. Long, and F. Stephan, Eds. Berlin, Germany: Springer-Verlag, 2006, vol. 4264, pp. 169-183. (Pubitemid 44705627)
35. M. Blank, L. Gorelick, E. Shechtman, M. Irani, and R. Basri, "Actions as space-time shapes," in Proc. IEEE 10th Int. Conf. Comput. Vis. (ICCV 2005) , oct. 2005, vol. 2, pp. 1395-1402. (Pubitemid 44042342)
36. A. A. Chaaraoui, P. Climent-Pérez, and F. Flórez-Revuelta, "Silhouette- based human action recognition using sequences of key poses," Pattern Recognit. Lett., vol. 34, no. 15, pp. 1799-1807, 2013, Smart Approaches for Human Action Recognition.
37. A. A. Chaaraoui, P. Climent-Pérez, and F. Flórez-Revuelta, "An efficient approach for multi-view human action recognition based on bag-of-key-poses," in Human Behavior Understanding, ser. Lecture Notes in Computer Science, A. A. Salah, J. Ruiz-del Solar, C. Meriçli, and P.-Y. Oudeyer, Eds. Berlin, Germany: Springer-Verlag, 2012, vol. 7559, pp. 29-40.
38. M. A. Giese and T. Poggio, "Neural mechanisms for the recognition of biological movements," Nature Rev. Neurosci., vol. 4, no. 3, pp. 179-192, 2003. (Pubitemid 37280183)
39. H. Sakoe and S. Chiba, "Dynamic programming algorithm optimization for spoken word recognition," IEEE Trans. Acoustics, Speech, Signal Process., vol. 26, no. 1, pp. 43-49, 1978. (Pubitemid 8601900)
40. R. Li, J. Lu, Y. Zhang, and T. Zhao, "Dynamic adaboost learning with feature selection based on parallel genetic algorithm for image annotation," Knowledge-Based Syst., vol. 23, no. 3, pp. 195-201, 2010.
41. S. Singh, S. Velastin, and H. Ragheb, "MuHAVi: A multicamera human action video dataset for the evaluation of action recognition methods," in 2010 7th IEEE Int. Conf. Adv. Video Signal Based Surveillance (AVSS), 2010, pp. 48-55.
42. B. Saghafi and D. Rajan, "Human action recognition using pose-based discriminant embedding," Signal Process.: Image Commun., vol. 27, no. 1, pp. 96-111, 2012.
43. L. Shao and X. Chen, "Histogram of body poses and spectral regression discriminant analysis for human action categorization," in Proc. British Mach. Vis. Conf. (BMVC), Aberystwyth, U.K., 2010, vol. 4.