Compressing 3-D human motions via keyframe-based geometry videos

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 25, Issue 1, 2015, Pages 51-62

  Hou, Junhui ^a   Chau, Lap Pui ^a   Magnenat Thalmann, Nadia ^b   He, Ying ^c  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^c NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

3 D motion data; geometry video (GV); keyframe; rate distortion analysis

Indexed keywords

ALGORITHMS; ELECTRIC DISTORTION; GEOMETRY; MOTION ANALYSIS; OPTIMIZATION; SIGNAL DISTORTION; VIDEO SIGNAL PROCESSING;

H.264/ADVANCED VIDEO CODING; HETEROGENEOUS COMMUNICATION; KEY FRAMES; MOTION DATA; PROGRESSIVE COMPRESSION; RATE DISTORTION PERFORMANCE; RATE-DISTORTION ANALYSIS; SPATIAL AND TEMPORAL REDUNDANCIES;

IMAGE CODING;

EID: 84921340498     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2014.2329376     Document Type: Article

References (46)

1. S. Zhang and P. Huang. "High-resolution, real-time 3D shape acquisition. "in Proc. Comput. Vis. Pattern Recognit. Workshop, CVPRW Conf., vol. 3. 2004, pp. 1-28
2. S. Zhang and S.-T. Yau. "High-resolution, real-time 3D absolute coordinate measurement based on a phase-shifting method. "Opt. Exp., vol. 14, no. 7, pp. 2644-2649, 2006
3. D. Vlasic, I. Baran, W. Matusik, and J. Popovic. "Articulated mesh animation from multi-view silhouettes. "ACM Trans. Graph., vol. 27, no. 3, p. 97, Mar. 2008
4. H. M. Briceño, P. V. Sander, L. McMillan, S. Gortler, and H. Hoppe. "Geometry videos: A new representation for 3D animations. "in Proc. ACM SIGGRAPH/Eurograph. Symp. Comput. Animat., 2003, pp. 136-146
5. X. Gu, S. J. Gortler, and H. Hoppe. "Geometry images. "ACM Trans. Graph., vol. 21, no. 3, pp. 355-361, July. 2002
6. Y.-K. Lai, S.-M. Hu, D. X. Gu, and R. R. Martin. "Geometric texture synthesis and transfer via geometry images. "in Proc. ACM Symp. Solid Phys. Model., 2005, pp. 15-26
7. Huawei/3DLife ACM Multimedia Grand Challenge. (2013). [Online]. Available: http://mmv.eecs.qmul.ac.uk/mmgc2013/
8. Dynamic Geometry Compression Competition. [Online]. Available: http://research.microsoft.com/en-us/um/redmond/events/geometrycompression/, accessed 2013
9. M. Alexa and W. Müller. "Representing animations by principal components. "Comp. Graph. Forum, vol. 19, no. 3, pp. 411-418, 2000
10. Z. Karni and C. Gotsman. "Compression of soft-body animation sequences. "Comput. Graph., vol. 28, pp. 25-34, Sep. 2004
11. M. Sattler, R. Sarlette, and R. Klein. "Simple and efficient compression of animation sequences. "in Proc. ACM/Eurograph. Symp. Comp. Anim., 2005, pp. 209-217
12. L. Váša and V. Skala. "Geometry-driven local neighbourhood based predictors for dynamic mesh compression. "Comput. Graph. Forum, vol. 29, no. 6, pp. 1921-1933, 2010
13. L. Váša and V. Skala. "COBRA: Compression of basis of PCA represented animations. "Comput. Graph. Forum, vol. 28, no. 6, pp. 1529-1540, 2010
14. L. Váša and V. Skala. "Optimising perceived distortion in lossy encoding of dynamic meshes. "Comput. Graph. Forum, vol. 30, no. 5, pp. 1439-1449, 2011
15. A. Smolic et al., "Coding algorithms for 3DTV-a survey. "IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 11, pp. 1606-1621, Nov. 2007
16. L. Váša and V. Skala. "A perception correlated comparison method for dynamic meshes. "IEEE Trans. Vis. Comput. Graphics, vol. 17, no. 2, pp. 220-230, Feb. 2011
17. M. Corsini, M.-C. Larabi, G. Lavoué, O. Petřík, L. Váša, and K. Wang. "Perceptual metrics for static and dynamic triangle meshes. "Comput. Graph. Forum, vol. 32, no. 11, pp. 101-125, 2013
18. I. Eckstein, M. Desbrun, and C.-C. J. Kuo. "Compression of time varying isosurfaces. "in Proc. Graph. Inter., 2006, pp. 99-105
19. S.-R. Han, T. Yamasaki, and K. Aizawa. "Time-varying mesh compression using an extended block matching algorithm. "IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 11, pp. 1506-1518, Nov. 2007
20. J.-H. Yang, C.-S. Kim, and S.-U. Lee. "Semi-regular representation and progressive compression of 3-D dynamic mesh sequences. "IEEE Trans. Image Process., vol. 15, no. 9, pp. 2531-2544, Sep. 2006
21. S. Gupta, K. Sengupta, and A. Kassim. "Registration and partitioningbased compression of 3-D dynamic data. "IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 11, pp. 1144-1155, Nov. 2003
22. H. Habe, Y. Katsura, and T. Matsuyama. "Skin-off: Representation and compression scheme for 3D video. "in Proc. Picture Coding Symp., 2004, pp. 301-306
23. T. Matsuyama, S. Nobuhara, T. Takai, and T. Tung, 3D Video and its Applications. New York, NY, USA: Springer-Verlag, 2012
24. J. Xia, Y. He, D. T. P. Quynh, X. Chen, and S. C. H. Hoi. "Modeling 3-D facial expressions using geometry videos. "in Proc. ACM Multimedia, 2010, pp. 591-600
25. J. Xia, D. T. P. Quynh, Y. He, X. Chen, and S. C. H. Hoi. "Modeling and compressing 3-D facial expressions using geometry videos. "IEEE Trans. Circuits Syst. Video Technol., vol. 22, no. 1, pp. 77-90, Jan. 2012
26. J. Hou, L.-P. Chau, M. Zhang, N. Magnenat-Thalmann, and Y. He. "A highly efficient compression framework for time-varying 3-D facial expressions. "IEEE Trans. Circuits Syst. Video Technol., vol. 24, no. 9, pp. 1541-1553, Sep. 2014
27. J. Hou, L.-P. Chau, Y. He, M. Zhang, and N. Magnenat-Thalmann. "Rate-distortion model based bit allocation for 3-D facial compression using geometry video. "IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 9, pp. 1537-1541, Sep. 2013
28. D. T. P. Quynh, Y. He, X. Chen, J. Xia, Q. Sun, and S. C. H. Hoi. "Modeling 3D articulated motions with conformal geometry videos (CGVs)," in Proc. ACM Multimedia, 2011, pp. 383-392
29. X. Gu, S. Zhang, P. Huang, L. Zhang, S.-T. Yau, and R. Martin. "Holoimages. "in Proc. ACM Symp. Solid Phys. Model., 2006, pp. 129-138
30. N. Karpinsky and S. Zhang. "Holovideo: Real-time 3D range video encoding and decoding on GPU. "Opt. Lasers Eng., vol. 50, no. 2, pp. 280-286, 2012
31. N. Karpinsky and S. Zhang. "3D range geometry video compression with the H.264 codec. "Opt. Lasers Eng., vol. 51, no. 5, pp. 620-625, 2013
32. I. Garcia, J. Xia, Y. He, S.-Q. Xin, and G. Patow. "Interactive applications for sketch-based editable polycube-map. "IEEE Trans. Vis. Comput. Graphics, vol. 19, no. 7, pp. 1158-1171, Jul. 2013
33. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli. "Image quality assessment: From error visibility to structural similarity. "IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004
34. T. Wiegand, G. Sullivan, G. Bjöntegaard, and A. Luthra. "Overview of the H.264/AVC video coding standard. "IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 7, pp. 560-576, Jul. 2003
35. T. H. Cormen, Introduction to Algorithms. Cambridge, MA, USA: MIT Press, 2001
36. J. Max. "Quantizing for minimum distortion. "IRE Trans. Inform. Theory, vol. 6, no. 1, pp. 7-12, Mar. 1960
37. C. E. Shannon. "A mathematical theory of communication. "ACM SIGMOBILE Mobile Comput. Commun. Rev., vol. 5, no. 1, pp. 3-55, 2001
38. N. Kamaci, Y. Altinbasak, and R. M. Mersereau. "Frame bit allocation for H.264/AVC video coder via Cauchy-density-based rate and distortion models. "IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 8, pp. 994-1006, Aug. 2005
39. X. Li, N. Oertel, A. Hutter, and A. Kaup. "Laplace distribution based lagrangian rate distortion optimization for hybrid video coding. "IEEE Trans. Circuits Syst. Video Technol., vol. 19, no. 2, pp. 193-205, Feb. 2009
40. J. Hou, S.Wan, Z. Ma, F. Yang, and L.-P. Chau. "A new rate-quantization model for H.264/AVC low-delay rate control. "Adv. Multimedia Inform. Process., vol. 7674, pp. 492-500, Dec. 2012
41. Joint Video Team Reference Software Encoder, Version 17.2 [Online]. Available: http://iphome.hhi.de/suehring/tml/download/old-jm/, accessed 2011
42. P. Cignoni, C. Rocchini, and R. Scopigno. "Metro: Measuring error on simplified surfaces. "Comput. Graph. Forum vol. 17, no. 2, pp. 167-174, 1998
43. G. Lavoué. "A multiscale metric for 3D mesh visual quality assessment. "Comput. Graph. Forum, vol. 30, no. 5, pp. 1427-1437, May 2011
44. Z. Ma, H. Hu, and Y. Wang. "On complexity modeling of H.264/AVC video decoding and its application for energy efficient decoding. "IEEE Trans. Multimedia, vol. 13, no. 6, pp. 1240-1255, Dec. 2011
45. H. Schwarz, D. Marpe, and T. Wiegand. "Overview of the scalable video coding extension of the H.264/AVC standard. "IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 9, pp. 1103-1120, Sep. 2007
46. S.-Q. Xin, D. T. P. Quynh, X. Ying, and Y. He. "A global algorithm to compute defect-tolerant geodesic distance. "ACM SIGGRAPH Asia Tech. Briefs, vol. 23, no. 4, pp. 1-23, Nov. 2012