Real-time posture reconstruction for Microsoft Kinect

IEEE Transactions on Cybernetics

Volumn 43, Issue 5, 2013, Pages 1357-1369

  Shum, Hubert P H ^a   Ho, Edmond S L ^b   Jiang, Yang ^a   Takagi, Shu ^c  

^a NORTHUMBRIA UNIVERSITY   (United Kingdom)

^b HONG KONG BAPTIST UNIVERSITY   (Hong Kong)

^c UNIVERSITY OF TOKYO   (Japan)

Author keywords

Human computer interaction; Kinect; Local principal component analysis; Posture reconstruction

Indexed keywords

DEGREE OF RELIABILITY; KINECT; KINEMATIC CONSTRAINTS; LOCAL PRINCIPAL COMPONENT ANALYSIS; PATTERN RECOGNITION ALGORITHMS; PRINCIPLE COMPONENT ANALYSIS; RECOGNITION ACCURACY; RELIABILITY ESTIMATION;

HUMAN COMPUTER INTERACTION; PATTERN RECOGNITION; SPORTS; VIRTUAL REALITY;

PRINCIPAL COMPONENT ANALYSIS;

ACTIMETRY; ALGORITHM; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BODY POSTURE; COMPUTER; COMPUTER SIMULATION; COMPUTER SYSTEM; DEVICES; HUMAN; IMAGE ENHANCEMENT; PHYSIOLOGY; PROCEDURES; RECREATION; THREE DIMENSIONAL IMAGING; TRANSDUCER; WHOLE BODY IMAGING; ARTICLE; EQUIPMENT; METHODOLOGY;

ACTIGRAPHY; ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER PERIPHERALS; COMPUTER SIMULATION; COMPUTER SYSTEMS; HUMANS; IMAGE ENHANCEMENT; IMAGING, THREE-DIMENSIONAL; PATTERN RECOGNITION, AUTOMATED; POSTURE; TRANSDUCERS; VIDEO GAMES; WHOLE BODY IMAGING;

EID: 84890363599     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCYB.2013.2275945     Document Type: Article

References (46)

1. H. P. H. Shum and E. S. L. Ho, "Real-time physical modelling of character movements with Microsoft Kinect," in Proc. ACM Symp. Virtual Reality Softw. Technol. (VRST), 2012, pp. 17-24.
2. H. P. H. Shum, T. Komura, and S. Takagi, "Fast accelerometer-based motion recognition with a dual buffer framework," Int. J. Virtual Reality, vol. 10, no. 3, pp. 17-24, Sep. 2011.
3. J. Chai and J. K. Hodgins, "Performance animation from lowdimensional control signals," in Proc. ACM SIGGRAPH Papers, 2005, pp. 686-696.
4. Z. Ren, J. Meng, J. Yuan, and Z. Zhang, "Robust hand gesture recognition with Kinect sensor," in Proc. 19th ACM Int. Conf. Multimedia, 2011, pp. 759-760.
5. S. Kean, J. Hall, and P. Perry, Meet the Kinect: An Introduction to Programming Natural User Interfaces, 1st ed. Berkely, CA, USA: Apress, 2011.
6. S. Izadi, D. Kim, O. Hilliges, D. Molyneaux, R. Newcombe, P. Kohli, J. Shotton, S. Hodges, D. Freeman, A. Davison, and A. Fitzgibbon, "KinectFusion: Real-time 3D reconstruction and interaction using a moving depth camera," in Proc. 24th Annu. ACM Symp. User Interface Softw. Technol., 2011, pp. 559-568.
7. R. A. Newcombe, A. J. Davison, S. Izadi, P. Kohli, O. Hilliges, J. Shotton, D. Molyneaux, S. Hodges, D. Kim, and A. Fitzgibbon, "KinectFusion: Real-time dense surface mapping and tracking," in Proc. 10th IEEE Int. Symp. Mixed Augmented Reality (ISMAR), Oct. 2011, pp. 127-136.
8. M. Sun, P. Kohli, and J. Shotton, "Conditional regression forests for human pose estimation," in Proc. IEEE Conf. Comput. Vision Pattern Recognit. (CVPR), Jun. 2012, pp. 3394-3401.
9. R. Girshick, J. Shotton, P. Kohli, A. Criminisi, and A. Fitzgibbon, "Efficient regression of general-activity human poses from depth images," in Proc. IEEE Int. Conf. Comput. Vision (ICCV), Nov. 2011, pp. 415-422.
10. J. Shotton, R. Girshick, A. Fitzgibbon, T. Sharp, M. Cook, M. Finocchio, R. Moore, P. Kohli, A. Criminisi, A. Kipman, and A. Blake, "Efficient human pose estimation from single depth images," IEEE Trans. Pattern Anal. Mach. Intell., vol. PP, no. 99, p. 1, Nov. 2012.
11. A. Baak, M. Muller, G. Bharaj, H. P. Seidel, and C. Theobalt, "A data-driven approach for real-time full body pose reconstruction from a depth camera," in Proc. IEEE Int. Conf. Comput. Vision (ICCV), Nov. 2011, pp. 1092-1099.
12. J. Han, L. Shao, D. Xu, and J. Shotton, "Enhanced computer vision with Microsoft Kinect sensor: A review," IEEE Trans. Cybern., vol. 43, no. 5, pp. 1318-1334, Oct. 2013.
13. Microsoft Corporation, Kinect for windows SDK programming guide, version 1.5, 2012.
14. J. Shotton, A. Fitzgibbon, M. Cook, T. Sharp, M. Finocchio, R. Moore, A. Kipman, and A. Blake, "Real-time human pose recognition in parts from single depth images," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2011, pp. 1297-1304.
15. M. Raptis, D. Kirovski, and H. Hoppe, "Real-time classification of dance gestures from skeleton animation," in Proc. ACM SIGGRAPH/Eurographics Symp. Comput. Animation, 2011, pp. 147-156.
16. S. W. Bailey and B. Bodenheimer, "A comparison of motion capture data recorded from a Vicon system and a Microsoft Kinect sensor," in Proc. ACM Symp. Appl. Perception, 2012, p. 121.
17. A. Fern'ndez-Baena, A. Susin, and X. Lligadas, "Biomechanical validation of upper-body and lower-body joint movements of Kinect motion capture data for rehabilitation treatments," in Proc. 4th Int. Conf. Intell. Netw. Collaborative Syst. (INCoS), Sep. 2012, pp. 656-661.
18. M. Ye, X. Wang, R. Yang, L. Ren, and M. Pollefeys, "Accurate 3D pose estimation from a single depth image," in Proc. IEEE Int. Conf. Comput. Vision (ICCV), Nov. 2011, pp. 731-738.
19. W. Shen, K. Deng, X. Bai, T. Leyvand, B. Guo, and Z. Tu, "Exemplar-based human action pose correction and tagging," in Proc. IEEE Conf. Comput. Vision Pattern Recognit. (CVPR), Jun. 2012, pp. 1784-1791.
20. H. Liu, X. Wei, J. Chai, I. Ha, and T. Rhee, "Realtime human motion control with a small number of inertial sensors," in Proc. Symp. Interactive 3D Graph. Games, 2011, pp. 133-140.
21. J. Tautges, A. Zinke, B. Krüger, J. Baumann, A. Weber, T. Helten, M. Müller, H.-P. Seidel, and B. Eberhardt, "Motion reconstruction using sparse accelerometer data," ACM Trans. Graph., vol. 30, no. 3, pp. 18:1-18:12, May 2011.
22. D. W. Aha, "Editorial," Artif. Intell. Rev., vol. 11, no. 1-5, pp. 7-10, Feb. 1997.
23. C. M. Bishop, Neural Networks for Pattern Recognition, Oxford, U.K.: Oxford University Press, 1996.
24. X. K.Wei and J. Chai, "Intuitive interactive human-character posing with millions of example poses," IEEE Comput. Graph. Applicat., vol. 31, no. 4, pp. 78-88, Jul.-Aug. 2011.
25. Z. Ghahramani and G. E. Hinton, "The EM algorithm for mixtures of factor analyzers," Univ. Toronto, Toronto, Canada, Tech. Rep. CRG-TR-96-1, 1997.
26. M. Lau, J. Chai, Y.-Q. Xu, and H.-Y. Shum, "Face poser: Interactive modeling of 3D facial expressions using model priors," in Proc. ACM SIGGRAPH/Eurographics Symp. Comput. Animation, 2007, pp. 161-170.
27. K. Grochow, S. L. Martin, A. Hertzmann, and Z. Popović, "Style-based inverse kinematics," in Proc. ACM SIGGRAPH Papers, 2004, pp. 522-531.
28. N. D. Lawrence, "Gaussian process latent variable models for visualisation of high dimensional data," in Proc. NIPS, 2003.
29. X. Wu, M. Tournier, and L. Reveret, "Natural character posing from a large motion database," IEEE Comput. Graph. Applicat., vol. 31, no. 3, pp. 69-77, May-Jun. 2011.
30. J. Quiñonero Candela and C. E. Rasmussen, "A unifying view of sparse approximate Gaussian process regression," J. Mach. Learn. Res., vol. 6, pp. 1939-1959, Dec. 2005.
31. J. Quiñonero Candela, C. E. Ramussen, and C. K. I. Williams, "Approximation methods for Gaussian process regression," in Large-Scale-Kernel-Machines. Aug. 2007, pp. 203-223 [Online]. Available: http://books.google.com.hk/books/about/Large-Scale-Kernel-Machines.html?id= MDup2gE3BwgC&redir-esc=y
32. H. Lou and J. Chai, "Example-based human motion denoising," IEEE Trans. Visualization Comput. Graph., vol. 16, no. 5, pp. 870-879, Sep. 2010.
33. H. Yue and M. Tomoyasu, "Weighted principal component analysis and its applications to improve FDC performance," in Proc. CDC 43rd IEEE Conf. Decision Control, vol. 4. Dec. 2004, pp. 4262-4267.
34. H.-P. Kriegel, P. Kröger, E. Schubert, and A. Zimek, "A general framework for increasing the robustness of PCA-based correlation clustering algorithms," in Proc. 20th Int. Conf. Sci. Statist. Database Manage., 2008, pp. 418-435.
35. J. F. Pinto da Costa, H. Alonso, and L. Roque, "A weighted principal component analysis and its application to gene expression data," IEEE/ACM Trans. Comput. Biol. Bioinform., vol. 8, no. 1, pp. 246-252, Jan. 2011.
36. K. Forbes and E. Fiume, "An efficient search algorithm for motion data using weighted PCA," in Proc. ACM SIGGRAPH/Eurograph. Symp. Comput. Animation, 2005, pp. 67-76.
37. H. G. Armstrong. (1988). Anthropometry and mass distribution for human analogues, volume 1, military male aviators. U.S. Army, Air Force, and Navy. Yellow Springs, OH, USA. [Online]. Available: http://books.google.com.hk/books/ about/Anthropometry-and-Mass-Distribution-for.html?id=ZxRNXwAACAAJ&redir- esc=y
38. J. C. Spall, Introduction to Stochastic Search and Optimization, 1st ed. New York, NY, USA: Wiley, 2003.
39. F. J. Solis and R. J.-B. Wets, "Minimization by random search techniques," Math. Oper. Res., vol. 6, no. 1, pp. 19-30, 1981.
40. A. Witkin and M. Kass, "Spacetime constraints," in Proc. 15th Annu. Conf. Comput. Graph. Interactive Tech. (SIGGRAPH), 1988, pp. 159-168.
41. J. M. Wang, D. J. Fleet, and A. Hertzmann, "Optimizing walking controllers," ACM Trans. Graph., vol. 28, no. 5, pp. 168:1-168:8, Dec. 2009.
42. H. P. H. Shum, T. Komura, T. Shiratori, and S. Takagi, "Physically-based character control in low dimensional space," in Proc. 3rd Int. Conf. Motion Games, 2010, pp. 23-34.
43. K. Yin, S. Coros, P. Beaudoin, and M. van de Panne, "Continuation methods for adapting simulated skills," ACM Trans. Graph., vol. 27, no. 3, pp. 81:1-81:7, 2008.
44. R. Smith. (2008). Open dynamics engine [Online]. Available: http://www.ode.org/
45. L. Hoyet, R. McDonnell, and C. O'Sullivan, "Push it real: Perceiving causality in virtual interactions," ACM Trans. Graph., vol. 31, no. 4, pp. 90:1-90:9, Jul. 2012.
46. B. Yao and L. Fei-Fei, "Action recognition with exemplar based 2.5D graph matching," in Proc. 12th Eur. Conf. Comput. Vision - Volume Part IV, 2012, pp. 173-186.