Generation of human depth images with body part labels for complex human pose recognition

Pattern Recognition

Volumn 71, Issue , 2017, Pages 402-413

  Nishi, K ^a   Miura, J ^a  

^a TOYOHASHI UNIVERSITY OF TECHNOLOGY   (Japan)

Author keywords

Care robot; Convolutional neural network; Human depth image; Human pose estimation

Indexed keywords

CLASSIFICATION (OF INFORMATION); CONVOLUTION; NEURAL NETWORKS; STATISTICAL TESTS;

CONVOLUTIONAL NETWORKS; CONVOLUTIONAL NEURAL NETWORK; DEPTH IMAGE; HUMAN BODY MODELING; HUMAN POSE ESTIMATIONS; HUMAN POSE RECOGNITION; LARGE-SCALE DATASET; MOTION CAPTURE SYSTEM;

GESTURE RECOGNITION;

EID: 85020431075     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2017.06.006     Document Type: Article

References (32)

1. United Nations, Department of Economic and Social Affairs, Population Division, World population ageing 2015 (st/esa/ser.a/390).
2. Felzenszwalb, P.F., Huttenlocher, D.P., Pictorial structures for object recognition. Int. J. Comput. Vis. 61:1 (2005), 55–79.
3. Fischler, M.A., Elschlager, R.A., The representation and matching of pictorial structures. IEEE Trans. Comput. 22:1 (1973), 67–92.
4. Ramanan, D., Learning to parse images of articulated bodies. Advances in Neural Information Processing Systems, 2006, 1129–1136.
5. Ferrari, V., Marin-Jimenez, M., Zisserman, A., Progressive search space reduction for human pose estimation. Computer Vision and Pattern Recognition, 2008. CVPR 2008. IEEE Conference on, 2008, IEEE, 1–8.
6. Rother, C., Kolmogorov, V., Blake, A., Grabcut: Interactive foreground extraction using iterated graph cuts. ACM Transactions on Graphics (TOG), vol. 23, 2004, ACM, 309–314.
7. Shotton, J., Sharp, T., Kipman, A., Fitzgibbon, A., Finocchio, M., Blake, A., Cook, M., Moore, R., Real-time human pose recognition in parts from single depth images. Commun. ACM 56:1 (2013), 116–124.
8. Ardiyanto, I., Satake, J., Miura, J., Autonomous monitoring framework with fallen person pose estimation and vital sign detection. Information Technology and Electrical Engineering (ICITEE), 2014 6th International Conference on, 2014, IEEE, 1–6.
9. Wang, S., Zabir, S., Leibe, B., Lying pose recognition for elderly fall detection. Robotics(1), 2012, 345–353.
10. Krizhevsky, A., Sutskever, I., Hinton, G.E., Imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems (NIPS), 2012, 1097–1105.
11. Toshev, A., Szegedy, C., Deeppose: human pose estimation via deep neural networks. Proceedings of the IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2014, 1653–1660.
12. Sapp, B., Taskar, B., Modec: multimodal decomposable models for human pose estimation. Proceedings of the IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2013.
13. Oliveira, G., Valada, A., Bollen, C., Burgard, W., Brox, T., Deep learning for human part discovery in images. Proceedings of the IEEE Int. Conf. on Robotics and Automation (ICRA), 2016.
14. Long, J., Shelhamer, E., Darrell, T., Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2015, 3431–3440.
15. Chen, X., Mottaghi, R., Liu, X., Fidler, S., Urtasun, R., Yuille, A., Detect what you can: detecting and representing objects using holistic models and body parts. Proceedings of the IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2014.
16. Nishi, K., Miura, J., A head position estimation method for a variety of recumbent positions for a care robot. Proceedings of the Int. Conf. on Advanced Mechatronics (ICAM), 2015.
17. Russell, B.C., Torralba, A., Murphy, K.P., Freeman, W.T., Labelme: a database and web-based tool for image annotation. Int. J. Comput. Vis. 77:1–3 (2008), 157–173.
18. Song, S., Lichtenberg, S.P., Xiao, J., Sun rgb-d: a rgb-d scene understanding benchmark suite. Proceedings of the IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2015, 567–576.
19. Sung, J., Ponce, C., Selman, B., Saxena, A., Unstructured human activity detection from rgbd images. Proceedings of the IEEE Int. Conf. on Robotics and Automation (ICRA), 2012, IEEE, 842–849.
20. Xia, L., Chen, C., Aggarwal, J., View invariant human action recognition using histograms of 3d joints. Computer Vision and Pattern Recognition Workshops (CVPRW), 2012, IEEE, 20–27.
21. Shinzaki, M., Iwashita, Y., Kurazume, R., Ogawara, K., Gait-based person identification method using shadow biometrics for robustness to changes in the walking direction. 2015 IEEE Winter Conference on Applications of Computer Vision, 2015, IEEE, 670–677.
22. Hasler, N., Thormählen, T., Rosenhahn, B., Seidel, H.-P., Learning skeletons for shape and pose. Proceedings of the 2010 ACM SIGGRAPH symposium on Interactive 3D Graphics and Games, 2010, ACM, 23–30.
23. Pishchulin, L., Wuhrer, S., Helten, T., Theobalt, C., Schiele, B., Building statistical shape spaces for 3d human modeling. Pattern Recognit. 67 (2017), 276–286.
24. VICON. (accessed 17.04.29) URL https://www.vicon.com/.
25. Maya,. (accessed 17.04.29) URL http://www.autodesk.com/products/maya/overview.
26. MotionBuilder. (accessed 17.04.29) URL http://www.autodesk.com/products/motionbuilder/overview.
27. M. Kouchi, M. Mochimaru, AIST/HQL database of human body dimension and shape 2003. (accessed 17.04.29) URL https://www.dh.aist.go.jp/database/fbodyDB/index.html.
28. D.E. Rumelhart, G.E. Hinton, R.J. Williams, Learning representations by back-propagating errors, Cognit. Model. 5(3) 1.
29. Tokui, S., Oono, K., Hido, S., Clayton, J., Chainer: a next-generation open source framework for deep learning. Proceedings of Workshop on Machine Learning Systems (LearningSys) in The Twenty-ninth Annual Conference on Neural Information Processing Systems (NIPS), 2015.
30. Vidas, S., Moghadam, P., Bosse, M., 3d thermal mapping of building interiors using an rgb-d and thermal camera. Robotics and Automation (ICRA), 2013 IEEE International Conference on, 2013, IEEE, 2311–2318.
31. Rangel, J., Soldan, S., Kroll, A., 3d thermal imaging: fusion of thermography and depth cameras. International Conference on Quantitative InfraRed Thermography, 2014.
32. AISL HDIBPL (Human Depth Images with Body Part Labels) Database. (accessed 17.04.29) URL http://www.aisl.cs.tut.ac.jp/database_HDIBPL.html.