3D flow estimation for human action recognition from colored point clouds

Biologically Inspired Cognitive Architectures

Volumn 5, Issue , 2013, Pages 42-51

  Munaro, Matteo ^a   Ballin, Gioia ^a   Michieletto, Stefano ^a   Menegatti, Emanuele ^a  

^a UNIVERSITY OF PADOVA   (Italy)

Author keywords

3d motion flow; Action recognition; Colored point clouds; Ias lab action dataset; Kinect; Rgb d data

Indexed keywords

IMAGE RECOGNITION; ROBOTS; SECURITY SYSTEMS;

3D MOTION; ACTION RECOGNITION; IAS-LAB ACTION DATASET; KINECT; POINT CLOUD; RGB-D DATA;

HUMAN ROBOT INTERACTION;

EID: 84882242202     PISSN: 2212683X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.bica.2013.05.008     Document Type: Conference Paper

References (49)

1. Ali, S., & Shah, M. (2010). Human action recognition in videos using kinematic features and multiple instance learning. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32, 288-303. http://dx.doi.org/10.1109/TPAMI. 2008.284.
2. [Online], M.K. (a). Microsoft kinect for windows http://www.microsoft. com/en-us/kinectforwindows/.
3. [Online], N.M. (b). Nite middleware http://www.primesense.com/solutions/ nite-middleware.
4. Ballin, G., Munaro, M., & Menegatti, E. (2012). Human action recognition from RGB-D frames based on real-time 3D optical flow estimation. In A. Chella, R. Pirrone, R. Sorbello, & K. R. Jóhannsdóttir (Eds.), Biologically Inspired Cognitive Architectures 2012. Advances in Intelligent Systems and Computing (vol. 196, pp. 65-74). Berlin Heidelberg: Springer.
5. Basso, F., Munaro, M., Michieletto, S., & Menegatti, E. (2012). Fast and robust multi-people tracking from rgb-d data for a mobile robot. In Proceedings of the 12th intelligent autonomous systems (IAS) Conference. Jeju Island (Korea).
6. Blank, M., Gorelick, L., Shechtman, E., Irani, M., & Basri, R. (2005). Actions as space-time shapes. In Proceedings of the Tenth IEEE international conference on computer vision ICCV 2005 (Vol. 2, pp. 1395-1402). doi:http://dx.doi.org/10.1109/ICCV.2005.28.
7. Bloom, V., Makris, D., & Argyriou, V. (2012). G3d: A gaming action dataset and real time action recognition evaluation framework. In IEEE computer society conference on computer vision and pattern recognition workshops (CVPRW) (pp. 7-12).
8. Carlsson, S., & Sullivan, J. (2001). Action recognition by shape matching to key frames. In IEEE computer society workshop on models versus exemplars in computer vision.
9. Dollar, P., Rabaud, V., Cottrell, G., & Belongie, S. (2005). Behavior recognition via sparse spatio-temporal features. In Proceeding of the 2nd joint IEEE international visual surveillance and performance evaluation of tracking and surveillance workshop (pp. 65-72). doi:http://dx.doi.org/10.1109/VSPETS. 2005.1570899.
10. Efros, A., Berg, A., Mori, G., & Malik, J. (2003). Recognizing action at a distance. In Ninth IEEE international conference on proceedings of computer vision, 2003 (Vol. 2, pp. 726-733) doi:http://dx.doi.org/10.1109/ICCV. 2003.1238420.
11. Holte, M., & Moeslund, T. (2008). View invariant gesture recognition using 3d motion primitives. In IEEE international conference on acoustics, speech and signal processing, 2008. ICASSP 2008 (pp. 797-800) doi:http://dx.doi.org/10.1109/ICASSP.2008.4517730.
12. Holte, M., Moeslund, T., Nikolaidis, N., & Pitas, I. (2011). 3d human action recognition for multi-view camera systems. In 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT), 2011 International Conference on (pp. 342 -349). doi:10.1109/3DIMPVT.2011.50.
13. Jiang Wang, Y.W., Zicheng, Liu, & Yuan, J. (2012). Mining actionlet ensemble for action recognition with depth cameras. In IEEE conference on computer vision and pattern recognition (CVPR 2012). Providence, Rhode Island.
14. Johansson, G. (1973). Visual perception of biological motion and a model for its analysis. Attention, Perception, & Psychophysics, 14, 201-211, doi:http://dx.doi.org/10.3758/BF03212378.
15. Ke, Y., Sukthankar, R., & Hebert, M. (2005). Efficient visual event detection using volumetric features. In Proceedings of the tenth IEEE international conference on computer vision ICCV 2005 (Vol. 1, pp. 166-173), doi:http://dx.doi.org/10.1109/ICCV.2005.85.
16. Kläser, A., Marszałek, M., & Schmid, C. (2008). A spatio-temporal descriptor based on 3d-gradients. In British machine vision conference (pp. 995-1004) http://lear.inrialpes.fr/pubs/2008/KMS08.
17. Korner, M., & Denzler, J. (2012). Analyzing the subspaces obtained by dimensionality reduction for human action recognition from 3d data. In IEEE ninth international conference on advanced video and signal-based surveillance (AVSS), 2012 (pp. 130-135).
18. Laptev, I., & Lindeberg, T. (2003). Space-time interest points. In Proceedings of the ninth IEEE international computer vision conference (pp. 432-439), doi:http://dx.doi.org/10.1109/ICCV.2003.1238378.
19. Laptev, I., Caputo, B., Schüldt, C., & Lindeberg, T. (2007). Local velocity-adapted motion events for spatio-temporal recognition. Computer Vision and Image Understanding, 108, 207-229.
20. Laptev, I., Marszalek, M., Schmid, C., & Rozenfeld, B. (2008). Learning realistic human actions from movies. In Proceedings of the IEEE conference computer vision and pattern recognition CVPR 2008 (pp. 1-8), doi:http://dx.doi.org/10.1109/CVPR.2008.4587756.
21. Lei, J., Ren, X., & Fox, D. (2012). Fine-grained kitchen activity recognition using rgb-d. In Proceedings of the 2012 ACM conference on ubiquitous computing UbiComp '12 (pp. 208-211). New York, NY, USA: ACM.
22. Li, W., Zhang, Z., & Liu, Z. (2010). Action recognition based on a bag of 3d points. In Computer Vision and Pattern Recognition Workshops (CVPRW), 2010 IEEE Computer Society Conference on (pp. 9 -14). doi:10.1109/CVPRW.2010. 5543273.
23. Liu, J., Ali, S., & Shah, M. (2008). Recognizing human actions using multiple features. In IEEE conference on computer vision and pattern recognition, 2008. CVPR 2008 (pp. 1-8), doi:http://dx.doi.org/10.1109/CVPR.2008. 4587527.
24. Liu, R., Li, S.Z., Yuan, X., & He, R. (2008). Online determination of track loss using template inverse matching. In The eighth international workshop on visual surveillance - VS2008. Marseille, France: Graeme Jones and Tieniu Tan and Steve Maybank and Dimitrios Makris http://hal.inria.fr/inria- 00325656.
25. Lukas, B., & Kanade, T. (1981). An iterative image registration technique with an application to stereo vision. In IJCAI '81 (pp. 674-679).
26. Ming, Y., Ruan, Q., & Hauptmann, A. (2012). Activity recognition from rgb-d camera with 3d local spatio-temporal features. In IEEE international conference on multimedia and expo (ICME), 2012 (pp. 344-349), doi:http://dx.doi.org/10.1109/ICME.2012.8.
27. Munaro, M., Basso, F., & Menegatti, E. (2012). Tracking people withing groups with rgb-d data. In Proceedings of the international conference on intelligent robots and systems (IROS). Vilamoura (Portugal).
28. Niebles, J. C., Wang, H., & Fei-Fei, L. (2008). Unsupervised learning of human action categories using spatial-temporal words. International Journal of Computer Vision, 79, 299-318. http://dx.doi.org/10.1007/s11263-007-0122-4, .
29. Ni, B., Wang, G., & Moulin, P. (2011). Rgbd- hudaact: a color-depth video database for human daily activity recognition. In IEEE international conference on computer vision workshops (ICCV Workshops), 2011 (pp. 1147-1153), doi:http://dx.doi.org/10.1109/ICCVW.2011.6130379.
30. Ofli, F., Chaudhry, R., Kurillo, G., Vidal, R., & Bajcsy, R. (2012). Sequence of the most informative joints (smij): A new representation for human skeletal action recognition. In IEEE computer society conference on computer vision and pattern recognition workshops (CVPRW), 2012 (pp. 8-13).
31. Ofli, F., Chaudhry, R., Kurillo, G., Vidal, R., & Bajcsy, R. (2013). Berkeley MHAD: A comprehensive multimodal human action database. In Proceedings of WACV.
32. Popa, M., Koc, A., Rothkrantz, L., Shan, C., & Wiggers, P. (2011). Kinect sensing of shopping related actions. In Undefined, K. Van Laerhoven, & J. Gelissen (Eds.), Constructing ambient intelligence: AmI 2011 workshops. Amsterdam, Netherlands.
33. Poppe, R. (2010). A survey on vision-based human action recognition. Image Vision Computation, 28, 976-990.
34. Quigley, M., Gerkey, B., Conley, K., Faust, J., Foote, T., Leibs, J., Berger, E., Wheeler, R., & Ng, A. (2009). Ros: an open-source robot operating system. In Proceedings of the IEEE international conference on robotics and automation (ICRA).
35. Rusu, R. B., Bandouch, J., Meier, F., Essa, I. A., & Beetz, M. (2009). Human action recognition using global point feature histograms and action shapes. Advanced Robotics, 23, 1873-1908.
36. Schuldt, C., Laptev, I., & Caputo, B. (2004). Recognizing human actions: a local svm approach. In Proceedings of the 17th international conference on pattern recognition ICPR 2004 (Vol. 3, pp. 32-36), doi:http://dx.doi.org/10.1109/ICPR.2004.1334462.
37. Scovanner, P., Ali, S., & Shah, M. (2007). A 3-dimensional sift descriptor and its application to action recognition. In Proceedings of the 15th international conference on Multimedia MULTIMEDIA '07 (pp. 357-360). New York, NY, USA: ACM, http://doi.acm.org/10.1145/1291233.1291311.
38. Sung, J., Ponce, C., Selman, B., & Saxena, A. (2011). Human activity detection from rgbd images. In Plan, activity, and intent recognition. AAAI volume WS-11-16 of AAAI Workshops.
39. Sung, J., Ponce, C., Selman, B., & Saxena, A. (2012). Unstructured human activity detection from rgbd images. In International conference on robotics and automation, ICRA.
40. Thuc, H.L.U., Tuan, P.V., & Hwang, J.-N. (2012). An effective 3d geometric relational feature descriptor for human action recognition. In IEEE RIVF international conference on computing and communication technologies, research, innovation, and vision for the future (RIVF), 2012 (pp. 1-6).
41. Wanqing Li, Z.L., Zhengyou, Zhang (2010). Action recognition based on a bag of 3d points. In IEEE international workshop on CVPR for human communicative behavior analysis (in conjunction with CVPR 2010). San Francisco, CA.
42. Weinland, D., Ronfard, R., & Boyer, E. (2006). Free viewpoint action recognition using motion history volumes. Computer Vision and Image Understanding, 104, 249-257. http://dx.doi.org/10.1016/j.cviu.2006.07.013, http://dx.doi.org/10.1016/j.cviu.2006.07.013.
43. Wolf, C., Mille, J., Lombardi, E., Celiktutan, O., Jiu, M., Baccouche, M., et al. (2012). The LIRIS Human activities dataset and the ICPR 2012 human activities recognition and localization competition. Technical Report.
44. Xia, L., Chen, C.-C., & Aggarwal, J. (2012). View invariant human action recognition using histograms of 3d joints. In IEEE computer society conference on computer vision and pattern recognition workshops (CVPRW), 2012 (pp. 20-27).
45. Yacoob, Y., & Black, M. (1998). Parameterized modeling and recognition of activities. In Sixth international conference on computer vision, 1998 (pp. 120-127), doi:http://dx.doi.org/10.1109/ICCV.1998.710709.
46. Yang, X., & Tian, Y. (2012). Eigenjoints-based action recognition using Naive-Bayes-nearest-neighbor. In IEEE workshop on CVPR for human activity understanding from 3D data.
47. Yilmaz, A., & Shah, M. (2005). Actions sketch: a novel action representation. In IEEE computer society conference on computer vision and pattern recognition, 2005. CVPR 2005 (Vol. 1, pp. 984-989), doi:http://dx.doi. org/10.1109/CVPR.2005.58.
48. Zhang, H., & Parker, L.E. (2011). 4-dimensional local spatiotemporal features for human activity recognition. In IEEE/RSJ international conference on intelligent robots and systems (IROS), 2011 (pp. 2044-2049), doi:http://dx.doi.org/10.1109/IROS.2011.6094489.
49. Zhao, Y., Liu, Z., Yang, L., & Cheng, H. (2012). Combing rgb and depth map features for human activity recognition. In Signal information processing association annual summit and conference (APSIPA ASC), 2012 Asia-Pacific (pp. 1-4).