Unsupervised skeleton extraction and motion capture from 3D deformable matching

Neurocomputing

Volumn 100, Issue , 2013, Pages 170-182

  Zhang, Quanshi ^a   Song, Xuan ^a   Shao, Xiaowei ^a   Shibasaki, Ryosuke ^a   Zhao, Huijing ^b  

^a UNIVERSITY OF TOKYO   (Japan)

^b Peking University   (China)

Author keywords

3D point cloud sequence; Skeleton extraction

Indexed keywords

3D INFORMATION; 3D POINT CLOUD; ARTICULATED OBJECT; COARSE-TO-FINE; COMPUTATIONAL COSTS; DEFORMABLE MATCHING; DEFORMABLE OBJECT; DEFORMATION MODELS; FEATURE POINT EXTRACTION; MARKOV RANDOM FIELDS; MOTION CAPTURE; NONRIGID MATCHING; POINT TRACKING; POINT TRAJECTORY; SKELETON EXTRACTION; STEREO-BASED;

DEFORMATION; MUSCULOSKELETAL SYSTEM;

THREE DIMENSIONAL COMPUTER GRAPHICS;

ACCURACY; ALGORITHM; ARTICLE; BIOSENSOR; BODY POSTURE; CONTROLLED STUDY; HUMAN; HUMAN EXPERIMENT; IMAGE ANALYSIS; IMAGE RECONSTRUCTION; MACHINE LEARNING; MALE; MARKOV RANDOM FIELD DEFORMATION MODEL; MOTION ANALYSIS SYSTEM; MOTION CAPTURE; PRIORITY JOURNAL; QUANTITATIVE ANALYSIS; STATISTICAL MODEL; THREE DIMENSIONAL DEFORMABLE NON RIGID MATCHING; THREE DIMENSIONAL IMAGING; THREE DIMENSIONAL POINT CLOUD SEQUENCE; UNSUPERVISED SKELETON EXTRACTION;

EID: 84868617896     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2011.11.032     Document Type: Article

References (27)

1. Ross D.A., Tarlow D., Zemel R.S. Unsupervised learning of skeletons from motion. Eur. Conf. Comput. Vis. 2008, 560-573.
2. Ross D.A., Tarlow D., Zemel R.S. Learning articulated structure and motion. Int. J. Comput. Vis. 2010, 88(2):214-237.
3. Yan J., Pollefeys M. A factorization-based approach for articulated nonrigid shape, motion and kinematic chain recovery from video. IEEE Trans. Pattern Anal. Mach. Intell. 2008, 30(5):865-877.
4. Yan J., Pollefeys M. Automatic kinematic chain building from feature trajectories of articulated objects. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. 2006, 1:712-719.
5. Tresadern P., Reid I. Articulated structure from motion by factorization. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. 2005, 2:1110-1115.
6. Ramanan D., Forsyth D., Barnard K. Building models of animals from video. IEEE Trans. Pattern Anal. Mach. Intell. 2006, 28(8):1319-1334.
7. Kirk A.G., O'Brien J.F., Forsyth D.A. Skeletal parameter estimation from optical motion capture data. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. 2005, 2:782-788.
8. Sturm J., Pradeep V., Stachniss C., Plagemann C., Konolige K., Burgard W. Learning kinematic models for articulated objects. Proc. Int. Conf. Artif. Intell. 2009, 1851-1856.
9. Attali D., Lachaud J.-O. Delaunay conforming iso-surface, skeleton extraction and noise removal. Comput. Geomet. 2001, 19:175-189.
10. Tagliasacchi A., Zhang H., Cohen-Or D. Curve skeleton extraction from incomplete point cloud. Proc. ACM SIGGRAPH 2009, 28(3). Article 71, 9 pages.
11. Au O.K.-C., Tai C.-L., Chu H.-K., Cohen-Or D., Lee T.-Y. Skeleton extraction by mesh contraction. Proc. ACM SIGGRAPH 2008, 1-44.
12. Aujay G., Hétroy F., Lazarus F., Depraz C. Harmonic skeleton for realistic character animation. ACM SIGGRAPH Sympos. Comput. Animat. 2007, 151-160.
13. Schaefer S., Yuksel C. Example-based skeleton extraction. Eur. Sympos. Geomet. Process. 2007, 153-162.
14. Wikipedia. Kinect-Wikipedia, the Free Encyclopedia 〈〉, 2011 [Online: accessed 19 September 2011]. http://en.wikipedia.org/wiki/Kinect.
15. Shi J., Tomasi C. Good features to track. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. 1994, 593-600.
16. Cheung G.K., Baker S., Kanade T. Shape-from-silhouette of articulated objects and its use for human body kinematics estimation and motion capture. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. 2003, 1:77-83.
17. Chu C.-W., Jenkins O.C., Matarić M.J. Marker-less kinematic model and motion capture from volume sequence. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. 2003, 2:475-482.
18. Sturm J., Pradeep V., Stachniss C. Vision-based detection for learning articulation models of cabinet doors and drawers in household environment. IEEE Int. Conf. Robot. Automat. 2010, 362-368.
19. Song Y., Goncalves L., Perona P. Unsupervised learning of human motion. IEEE Trans. Pattern Anal. Mach. Intell. 2003, 25(7):814-827.
20. Shotton J., Fitzgibbon A., Cook M., Blake A. Real-time human pose recognition in parts from single depth images. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. 2011, 1297-1304.
21. Oikonomidis I., Kyriazis N., Argyros A.A. Efficient model-based 3d tracking of hand articulations using kinect. Br. Mach. Vis. Conf. 2011, 1-11.
22. Shekhovtsov A., Kovtun I., Hlaváč V. Efficient mrf deformation model for non-rigid image matching. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. 2007, 1-6.
23. Shekhovtsov A., Kovtun I., Hlaváč V. Efficient mrf deformation model for non-rigid image matching. Comput. Vis. Image Understand. 2008, 112:91-99.
24. Torresani L., Kolmogorov V., Rother C. Feature correspondence via graph matching: models and global optimization. Eur. Conf. Comput. Vis. 2008, 2:596-609.
25. Kolmogorov V. Convergent tree-reweighted message passing for energy minimization. IEEE Trans. Pattern Anal. Mach. Intell. 2006, 28(10):1568-1583.
26. Lee K.J., Kwon D., Yun I.D., Lee S.U. Deformable 3d volume registration using efficient MRFS model with decomposed nodes. Br. Mach. Vis. Conf. 2008, 1-10.
27. A.Y. Ng, M.I. Jordan, Y. Weiss, On spectral clustering: analysis and an algorithm, in: Advances in Neural Information Processing Systems 14 (NIPS), Cambridge, MA, 2002, pp. 849-856.