Articulated and generalized Gaussian kernel correlation for human pose estimation

IEEE Transactions on Image Processing

Volumn 25, Issue 2, 2016, Pages 776-789

  Ding, Meng ^a   Fan, Guoliang ^a  

^a Oklahoma State University   (United States)

Author keywords

Articulated pose estimation; Depth sensor; Hand pose tracking; Human pose tracking; Kernel correlation; Kinect; Shape modeling; Sum of Gaussians (SoG)

Indexed keywords

GESTURE RECOGNITION; TRACKING (POSITION);

ARTICULATED POSE ESTIMATIONS; DEPTH SENSORS; GAUSSIANS; HAND POSE; HUMAN POSE TRACKING; KINECT; SHAPE MODEL;

MOTION ESTIMATION;

ALGORITHM; BODY POSITION; HAND; HUMAN; IMAGE PROCESSING; NORMAL DISTRIBUTION; PHYSIOLOGY; PROCEDURES;

ALGORITHMS; HAND; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; NORMAL DISTRIBUTION; POSTURE;

EID: 85009455140     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2015.2507445     Document Type: Article

References (52)

1. T. B. Moeslund, A. Hilton, and V. Krüger, "A survey of advances in vision-based human motion capture and analysis, " Comput. Vis. Image Understand., vol. 104, nos. 2-3, pp. 90-126, Nov./Dec. 2006.
2. R. Poppe, "Vision-based human motion analysis: An overview, " Comput. Vis. Image Understand., vol. 108, nos. 1-2, pp. 4-18, Oct. 2007.
3. A. Erol, G. Bebis, M. Nicolescu, R. D. Boyle, and X. Twombly, "Vision-based hand pose estimation: A review, " Comput. Vis. Image Understand., vol. 108, nos. 1-2, pp. 52-73, Oct./Nov. 2007.
4. C. Plagemann, V. Ganapathi, D. Koller, and S. Thrun, "Real-time identification and localization of body parts from depth images, " in Proc. IEEE Int. Conf. Robot. Autom. (ICRA), May 2010, pp. 3108-3113.
5. J. Shotton et al., "Real-time human pose recognition in parts from single depth images, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2011, pp. 1297-1304.
6. M. Ye and R. Yang, "Real-time simultaneous pose and shape estimation for articulated objects using a single depth camera, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2014, pp. 2353-2360.
7. V. Ganapathi, C. Plagemann, D. Koller, and S. Thrun, "Real-time human pose tracking from range data, " in Proc. Eur. Conf. Comput. Vis. (ECCV), 2012, pp. 738-751.
8. V. Ganapathi, C. Plagemann, D. Koller, and S. Thrun, "Real time motion capture using a single time-of-flight camera, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2010, pp. 755-762.
9. A. Baak, M. Müller, G. Bharaj, H.-P. Seidel, and C. Theobalt, "A data-driven approach for real-time full body pose reconstruction from a depth camera, " in Proc. IEEE Int. Conf. Comput Vis. (ICCV), Nov. 2011, pp. 1092-1099.
10. M. Ye, X. Wang, R. Yang, L. Ren, and M. Pollefeys, "Accurate 3D pose estimation from a single depth image, " in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Nov. 2011, pp. 731-738.
11. X. Wei, P. Zhang, and J. Chai, "Accurate realtime full-body motion capture using a single depth camera, " ACM Trans. Graph., vol. 31, no. 6, Nov. 2012, Art. ID 188.
12. C. Stoll, N. Hasler, J. Gall, H.-P, Seidel, and C. Theobalt, "Fast articulated motion tracking using a sums of Gaussians body model, " in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Nov. 2011, pp. 951-958.
13. D. Kurmankhojayev, "Monocular pose capture with a depth camera using a sums-of-Gaussians body model, " in Pattern Recognition (Lecture Notes in Computer Science), vol. 8142. Berlin, Germany: Springer, 2013, pp. 415-424.
14. S. Sridhar, A. Oulasvirta, and C. Theobalt, "Interactive markerless articulated hand motion tracking using RGB and depth data, " in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Dec. 2013, pp. 2456-2463.
15. M. Ding, "Fast human pose tracking with a single depth sensor using sum of Gaussians models, " in Advances in Visual Computing (Lecture Notes in Computer Science), vol. 8887. Springer International Publishing, 2014, pp. 599-608.
16. M. Ding and G. Fan, "Generalized sum of Gaussians for real-time human pose tracking from a single depth sensor, " in Proc. IEEE Winter Conf. Appl. Comput. Vis. (WACV), Jan. 2015, pp. 47-54.
17. S. Sridhar, H. Rhodin, H.-P. Seidel, A. Oulasvirta, and C. Theobalt, "Real-time hand tracking using a sum of anisotropic Gaussians model, " in Proc. Int. Conf. 3D Vis. (3DV), Dec. 2014, pp. 319-326.
18. Y. Tsin, "A correlation-based approach to robust point set registration, " in Proc. Eur. Conf. Comput. Vis. (ECCV), Prague, Czech Republic, 2004, pp. 558-569.
19. C. Qian, X. Sun, Y. Wei, X. Tang, and J. Sun, "Realtime and robust hand tracking from depth, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2014, pp. 1106-1113.
20. J. Taylor, J. Shotton, T. Sharp, and A. Fitzgibbon, "The Vitruvian manifold: Inferring dense correspondences for one-shot human pose estimation, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2012, pp. 103-110.
21. P. J. Besl and N. D. McKay, "A method for registration of 3D shapes, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 14, no. 2, pp. 239-256, Feb. 1992.
22. A. M. Peter and A. Rangarajan, "Maximum likelihood wavelet density estimation with applications to image and shape matching, " IEEE Trans. Image Process., vol. 17, no. 4, pp. 458-468, Apr. 2008.
23. Y. Wang, K. Woods, and M. McClain, "Information-theoretic matching of two point sets, " IEEE Trans. Image Process., vol. 11, no. 8, pp. 868-872, Aug. 2002.
24. A. Myronenko and X. Song, "Point set registration: Coherent point drift, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 12, pp. 2262-2275, Dec. 2010.
25. R. Horaud, F. Forbes, M. Yguel, G. Dewaele, and J. Zhang, "Rigid and articulated point registration with expectation conditional maximization, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 3, pp. 587-602, Mar. 2011.
26. B. Jian and B. C. Vemuri, "Robust point set registration using Gaussian mixture models, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 8, pp. 1633-1645, Aug. 2011.
27. D. W. Scott and W. F. Szewczyk, "From kernels to mixtures, " Technometrics, vol. 43, no. 3, pp. 323-335, 2001.
28. Y. Tsin and T. Kanade, "A correlation-based model prior for stereo, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), vol. 1. Jun. 2004, pp. I-135-I-142.
29. P. J. Huber, Robust Statistics. Washington, DC, USA: Springer, 2011.
30. Y. Liu, P. Lasang, M. Siegel, and Q. Sun, "Geodesic invariant feature: A local descriptor in depth, " IEEE Trans. Image Process., vol. 24, no. 1, pp. 236-248, Jan. 2015.
31. D. Tang, T.-H. Yu, and T.-K. Kim, "Real-time articulated hand pose estimation using semi-supervised transductive regression forests, " in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Dec. 2013, pp. 3224-3231.
32. S. Fanello et al., "Learning to be a depth camera for close-range human capture and interaction, " ACM Trans. Graph., vol. 33, no. 4, pp. 86:1-86:11, Jul. 2014.
33. J. Gall, A. Fossati, and L. Van Gool, "Functional categorization of objects using real-time markerless motion capture, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2011, pp. 1969-1976.
34. I. Oikonomidis, N. Kyriazis, and A. A. Argyros, "Efficient model-based 3D tracking of hand articulations using Kinect, " in Proc. Brit. Mach. Vis. Conf. (BMVC), 2011, vol. 1. no. 2, p. 3.
35. I. Oikonomidis, N. Kyriazis, and A. A. Argyros, "Full DOF tracking of a hand interacting with an object by modeling occlusions and physical constraints, " in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Nov. 2011, pp. 2088-2095.
36. I. Oikonomidis, N. Kyriazis, and A. A. Argyros, "Tracking the articulated motion of two strongly interacting hands, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2012, pp. 1862-1869.
37. J. Gall, C. Stoll, E. De Aguiar, C. Theobalt, B. Rosenhahn, and H.-P. Seidel, "Motion capture using joint skeleton tracking and surface estimation, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2009, pp. 1746-1753.
38. L. Ballan, A. Taneja, J. Gall, L. Van Gool, and M. Pollefeys, "Motion capture of hands in action using discriminative salient points, " in Proc. Eur. Conf Comput. Vis. (ECCV), 2012, pp. 640-653.
39. H. Sidenbladh, M. J. Black, and D. J. Fleet, "Stochastic tracking of 3D human figures using 2D image motion, " in Proc. Eur. Conf. Comput. Vis. (ECCV), 2000, pp. 702-718.
40. R. Horaud, M. Niskanen, G. Dewaele, and E. Boyer, "Human motion tracking by registering an articulated surface to 3D points and normals, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 1, pp. 158-163, Jan. 2009.
41. C. R. Wren, A. Azarbayejani, T. Darrell, and A. P. Pentland, "Pfinder: Real-time tracking of the human body, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 780-785, Jul. 1997.
42. R. Plankers and P. Fua, "Articulated soft objects for multiview shape and motion capture, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 9, pp. 1182-1187, Sep. 2003.
43. M. Rouhani and A. Domingo Sappa, "The Richer representation the better registration, " IEEE Trans. Image Process., vol. 22, no. 12, pp. 5036-5049, Dec. 2013.
44. B. Scholkopf, K. Tsuda, and J.-P. Vert, Kernel Methods in Computational Biology (Computational Molecular Biology). Cambridge, MA, USA: MIT Press, Aug. 2004.
45. S. T. Roweis and L. K. Saul, "Nonlinear dimensionality reduction by locally linear embedding, " Science, vol. 290, no. 5500, pp. 2323-2326, Dec. 2000.
46. D. C. Liu and J. Nocedal, "On the limited memory BFGS method for large scale optimization, " Math. Program., vol. 45, no. 3, pp. 503-528, Aug. 1989.
47. T. Helten, M. Muller, H.-P. Seidel, and C. Theobalt, "Real-time body tracking with one depth camera and inertial sensors, " in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Dec. 2013, pp. 1105-1112.
48. J.-R. Zhang, J. Zhang, T.-M. Lok, and M. R. Lyu, "A hybrid particle swarm optimization-back-propagation algorithm for feedforward neural network training, " Appl. Math. Comput., vol. 185, no. 2, pp. 1026-1037, Feb. 2007.
49. S. Li, M. Tan, I. W. Tsang, and J. T.-Y. Kwok, "A hybrid PSO-BFGS strategy for global optimization of multimodal functions, " IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 41, no. 4, pp. 1003-1014, Aug. 2011.
50. V. Plevris and M. Papadrakakis, "A hybrid particle swarm-Gradient algorithm for global structural optimization, " Comput.-Aided Civil Infrastruct. Eng., vol. 26, no. 1, pp. 48-68, 2011.
51. LibLBFGS. [Online]. Available: http://www.chokkan.org/software/liblbfgs/, accessed Dec. 22, 2010.
52. S. L. Dockstader and N. S. Imennov, "Prediction for human motion tracking failures, " IEEE Trans. Image Process., vol. 15, no. 2, pp. 411-421, Feb. 2006.