Tensor body: Real-time reconstruction of the human body and avatar synthesis from RGB-D

IEEE Transactions on Cybernetics

Volumn 43, Issue 5, 2013, Pages 1347-1356

  Barmpoutis, Angelos ^a  

^a UNIVERSITY OF FLORIDA   (United States)

Author keywords

3 D reconstruction; Avatar; b spline; Kinect; Positive definite constraints; Tensor basis

Indexed keywords

3D RECONSTRUCTION; AVATAR; B-SPLINE; KINECT; POSITIVE-DEFINITE CONSTRAINTS; TENSOR BASIS;

INTERPOLATION; TENSORS; THREE DIMENSIONAL COMPUTER GRAPHICS;

THREE DIMENSIONAL;

ALGORITHM; ART; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BIOLOGICAL MODEL; BIOMIMETICS; COMPUTER; COMPUTER ASSISTED DIAGNOSIS; COMPUTER SIMULATION; COMPUTER SYSTEM; DEVICES; HUMAN; PROCEDURES; RECREATION; THREE DIMENSIONAL IMAGING; TRANSDUCER; WHOLE BODY IMAGING; ARTICLE; EQUIPMENT; METHODOLOGY;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BIOMIMETICS; CARTOONS AS TOPIC; COMPUTER PERIPHERALS; COMPUTER SIMULATION; COMPUTER SYSTEMS; HUMANS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; MODELS, BIOLOGICAL; PATTERN RECOGNITION, AUTOMATED; TRANSDUCERS; VIDEO GAMES; WHOLE BODY IMAGING;

EID: 84890411897     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCYB.2013.2276430     Document Type: Article

References (33)

1. J. Han, L. Shao, D. Xu, and J. Shotton, "Enhanced computer vision with microsoft kinect sensor: A review," IEEE Trans. Cybern., vol. 43, no. 5, pp. 1318-1334, Oct. 2013.
2. A. P. Placitelli and M. Ciampi, "Controller-free exploration of medical image data: Experiencing the kinect," in Proc. 24th Int. Symp. Comput.-Based Med. Syst., 2011, pp. 1-6.
3. B. Lange, S. Koenig, E. McConnell, C. Chang, R. Juang, E. Suma, M. Bolas, and A. Rizzo, "Interactive game-based rehabilitation using the microsoft kinect," in Proc. IEEE Virtual Reality Workshops, 2012, pp. 171-172.
4. L. Xia, C.-C. Chen, and J. K. Aggarwal, "Human detection using depth information by kinect," in Proc. IEEE Conf. Comput. Vision Pattern Recognit. Workshops, 2011, pp. 15-22.
5. M. Richter, K. Varanasi, N. Hasler, and C. Theobalt, "Real-time reshaping of humans," in Proc. 2nd Int. Conf. 3-D Imag. Model. Process. Vis. Transmission, 2012, pp. 340-347.
6. I. Oikonomidis, N. Kyriazis and A. A. Argyros, "Efficient model-based 3-D tracking of hand articulations using kinect," in Proc. Brit. Mach. Vision Assoc. Conf., 2011, pp. 101.1-101.11.
7. J. Shotton, A. Fitzgibbon, M. Cook, T. Sharp, M. Finocchio, R. Moore, A. Kipman, and A. Blake, "Real-time human pose recognition in parts from single depth images," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., 2011, pp. 1297-1304.
8. O. Faugeras, Three-Dimensional Computer Vision. Cambridge, MA, USA: MIT press, 1993.
9. D. Forsyth and J. Ponce, Computer Vision: A Modern Approach. Englewood Cliffs, NJ, USA: Prentice Hall, 2003.
10. B. Horn, Robot Vision. Cambridge, MA, USA: MIT press, 1986.
11. M. Zollhöfer, M. Martinek, G. Greiner, M. Stamminger, and J. Süßmuth, "Automatic reconstruction of personalized avatars from 3-D face scans," Comput. Animation Virtual Worlds, vol. 22, nos. 2-3, pp. 195-202, 2011.
12. M.-C. Villa-Uriol, "Video-based avatar reconstruction and motion capture," Ph.D. dissertation, Dept. of Electr. Comput. Eng., Univ. California, Irvine, CA, 2005.
13. M.-C. Villa-Uriol, F. Kuester, and N. Bagherzadeh, "Image-based avatar reconstruction," in Proc. NSF Workshop Collaborative Virtual Reality Vis., 2003.
14. A. Hilton, D. Beresford, T. Gentils, R. Smith, and W. Sun, "Virtual people: Capturing human models to populate virtual worlds," in Proc. Comput. Animat., 1999, pp. 174-185.
15. B. Lok, "Online model reconstruction for interactive virtual environments," in Proc. Symp. Interactive 3-D Graph., 2001, pp. 69-72.
16. S.-Y. Lee, I.-J. Kim, S. C. Ahn, H. Ko, M.-T. Lim, and H.-G. Kim, "Real time 3d avatar for interactive mixed reality," in Proc. ACM SIGGRAPH Int. Conf. Virtual Reality Continuum Appl. Ind., 2004, pp. 75-80.
17. J. Tong, J. Zhou, L. Liu, Z. Pan, and H. Yan, "Scanning 3-D full human bodies using kinects," IEEE Trans. Vis. Comput. Graph., vol. 18, no. 4, pp. 643-650, Apr. 2012.
18. A. Weiss, D. Hirshberg, and M. Black, "Home 3d body scans from noisy image and range data," in Proc. IEEE Int. Conf. Comput. Vision, 2011, pp. 1951-1958.
19. A. Barmpoutis, "Automated human avatar synthesis for obesity control using low-cost depth cameras," Stud. Health Technol. Inform., vol. 184, pp. 36-42, Feb. 2013.
20. A. Barmpoutis, B. C. Vemuri, T. M. Shepherd, and J. R. Forder, "Tensor splines for interpolation and approximation of DT-MRI with applications to segmentation of isolated rat hippocampi," TMI: Trans. Medical Imag., vol. 26, no. 11, pp. 1537-1546, 2007.
21. R. Kumar, A. Barmpoutis, A. Banerjee, and B. C. Vemuri, "Non-Lambertian reflectance modeling and shape recovery of faces using tensor splines," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 3, pp. 533-567, Mar. 2011.
22. A. Barmpoutis, J. Ho, and B. C. Vemuri, "Approximating symmetric positive semi-definite tensors of even order," SIAM J. Imag. Sci., vol. 5, no. 1, pp. 434-464, 2012.
23. A. Barmpoutis, M. S. Hwang, D. Howland, J. R. Forder, and B. C. Vemuri, "Regularized positive-definite fourth-order tensor field estimation from DW-MRI," NeuroImage, vol. 45, no. 1 sup.1, pp. 153-162, 2009.
24. C. de Boor, "On calculating with b-splines," J. Approx. Theory, vol. 6, pp. 50-62, 1972.
25. S. Helgason, Differential Geometry, Lie Groups, and Symmetric Spaces. Providence, RI, USA: American Mathematical Society, 2001.
26. P. Fletcher, C. Lu, S. Pizer, and S. Joshi, "Principal geodesic analysis for the study of nonlinear statistics of shape," IEEE Trans. Med. Imag., vol. 23, no. 8, pp. 995-1005, Aug. 2004.
27. X. Pennec, P. Fillard, and N. Ayache, "A Riemannian framework for tensor computing." Int. J. Comput. Vision, vol. 66, no. 1, pp. 41-66, Jan. 2006.
28. Microsoft. "Microsoft Kinect SDK." [Online]. Available: http://www.microsoft.com/enus/kinectforwindows/
29. "OpenNI." [Online]. Available: http://www.openni.org/
30. M. A. Livingston, J. Sebastian, Ai Zhuming, J. W. Decker, "Performance measurements for the microsoft kinect skeleton," in Proc. IEEE Virtual Reality Workshops, 2012, pp. 119-120.
31. A. Davison, Kinect Open Source Programming Secrets: Hacking the Kinect with OpenNI, NITE, and Java. New York, NY, USA: McGraw-Hill, 2012.
32. C. Lawson and R. Hanson, Solving Least Squares Problems. Englewood Cliffs, NJ, USA: Prentice-Hall, 1974.
33. International Standards for Anthropometric Assessment, Int. Std. Adv. Kinanthropometry, Australia, 2001.