A highly efficient compression framework for time-varying 3-D facial expressions

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 24, Issue 9, 2014, Pages 1541-1553

  Hou, Junhui ^a   Chau, Lap Pui ^a   Zhang, Minqi ^b   Magnenat Thalmann, Nadia ^c   He, Ying ^b  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^c NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

Geometry video (GV); low rank and sparse matrix decomposition (LRSMD); optimal bit allocation; rate and distortion models; time varying 3 D mesh

Indexed keywords

ELECTRIC DISTORTION; SIGNAL DISTORTION;

3-D SCENE REPRESENTATION; HUMAN FACIAL EXPRESSIONS; LOW RANK AND SPARSE MATRIX DECOMPOSITIONS; OPTIMAL BIT ALLOCATION; RATE AND DISTORTION MODELS; RATE DISTORTION PERFORMANCE; STATE-OF-THE-ART ALGORITHMS; TIME VARYING;

IMAGE CODING;

EID: 84921329192     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2014.2313890     Document Type: Article

References (39)

1. J. Hou, L.-P. Chau, Y. He, D. Quynh, and N. Magnenat-Thalmann, "Dynamic 3-D facial compression using low rank and sparse decomposition," in Proc. SIGGRAPH Asia Tech. Briefs, 2012, pp. 1-4.
2. Y. Lin, M. Song, D. Quynh, Y. He, and C. Chen, "Sparse coding for flexible, robust 3D facial-expression synthesis," IEEE Comput. Graph. Appl., vol. 32, no. 2, pp. 76-88, Mar. 2012.
3. B. Guenter, C. Grimm, D. Wood, H. Malvar, and F. Pighin, "Making faces," in Proc. ACM SIGGRAPH, 1998, pp. 55-66.
4. N. Karpinsky, M. Hoke, V. Chen, and S. Zhang, "High-resolution, realtime three-dimensional shape measurement on graphics processing unit," Opt. Eng., vol. 52, no. 2, pp. 024105-1-024105-8, 2014.
5. M. Alexa and W. Müller, "Representing animations by principal components," Comput. Graph. Forum, vol. 19, no. 3, pp. 411-418, 2000.
6. Z. Karni and C. Gotsman, "Compression of soft-body animation sequences," Comput. Graph., vol. 28, no. 1, pp. 25-34, 2004.
7. I. Guskov and A. Khodakovsky, "Wavelet compression of parametrically coherent mesh sequences," in Proc. ACM/Eurograph. Symp. Comput. Animat., 2004, pp. 183-192.
8. J. Zhang and C. B. Owen, "Octree-based animated geometry compression," Comput. Graph., vol. 31, no. 3, pp. 463-479, 2007.
9. K. Muller, A. Smolic, M. Kautzner, P. Eisert, and T. Wiegand, "Rate-distortion-optimized predictive compression of dynamic 3D mesh sequences," Signal Process. Imag. Commun., vol. 21, no. 9, pp. 812-828, 2006.
10. N. Stefanoski and J. Ostermann, "SPC: Fast and efficient scalable predictive coding of animated meshes," Comput. Graph. Forum, vol. 29, no. 1, pp. 101-116, 2010.
11. A. Smolic et al., "Coding algorithms for 3DTV-A survey," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 11, pp. 1606-1621, Nov. 2007.
12. S. Gupta, K. Sengupta, and A. Kassim, "Registration and partitioningbased compression of 3D dynamic data," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 11, pp. 1144-1155, Nov. 2003.
13. S.-R. Han, T. Yamasaki, and K. Aizawa, "Time-varying mesh compression using an extended block matching algorithm," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 11, pp. 1506-1518, Nov. 2007.
14. X. Gu, S. J. Gortler, and H. Hoppe, "Geometry images," in Proc. SIGGRAPH, 2002, pp. 355-361.
15. T. Ochotta and D. Saupe, "Image-based surface compression," Comput. Graph. Forum, vol. 27, no. 6, pp. 1647-1663, 2008.
16. B.-S. Chew, L.-P. Chau, Y. He, D. Wang, and S. C. H. Hoi, "Spectral geometry image: Image based 3D models for digital broadcasting applications," IEEE Trans. Broadcast., vol. 57, no. 3, pp. 636-635, Sep. 2011.
17. J. Xia, D. Quynh, Y. He, X. Chen, and S. C. H. Hoi, "Modeling and compressing 3D facial expressions using geometry videos," IEEE Trans. Circuits Syst. Video Technol., vol. 22, no. 1, pp. 77-90, Jan. 2012.
18. J. Hou, L.-P. Chau, Y. He, M. Zhang, and N. Magnenat-Thalmann, "Rate-distortion model based bit allocation for 3D facial compression using geometry video," IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 9, pp. 1537-1541, Sep. 2013.
19. D. Quynh, Y. He, X. Chen, J. Xia, Q. Sun, and S. C. H. Hoi, "Modeling 3D articulated motions with conformal geometry videos (CGVs)," in Proc. ACM Multimedia, 2011, pp. 383-392.
20. N. Karpinsky and S. Zhang, "Holovideo: Real-time 3D range video encoding and decoding on GPU," Opt. Lasers Eng., vol. 50, no. 2, pp. 280-286, 2012.
21. N. Karpinsky and S. Zhang, "3D video compression with the H.264 codec," Proc. SPIE, vol. 8290, pp. 829012-1-829012-8, Jan. 2012.
22. K. Hormann, B. Lévy, and A. Sheffer, "Mesh parameterization: Theory and practice," in Proc. SIGGRAPH Course Notes, 2007.
23. H. Briceno, P. Sander, L. McMillan, S. Gortler, and H. Hoppe, "Geometry videos: A new representation for 3D animations," in Proc. ACM Symp. Comput. Animat., 2003, pp. 136-146.
24. X. Gu et al., "Ricci flow for 3D shape analysis," in Proc. ICCV, 2007, pp. 1-8.
25. E. J. Candes, X. Li, Y. Ma, and J. Wright, "Robust principal component analysis," J. ACM, vol. 58, no. 3, pp. 1-37, 2011.
26. Z. Wang, H. Li, Q. Ling, and W. Li, "Robust temporal-spatial decomposition and its applications in video processing," IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 3, pp. 387-400, Mar. 2013.
27. C. Chen, J. Cai, W. Lin, and G. Shi, "Surveillance video coding via lowrank and sparse decomposition," in Proc. ACM MM, 2012, pp. 713-716.
28. T. Wiegand, G. Sullivan, G. Bjøntegaard, and A. Luthra, "Overview of the H.264/AVC video coding standard," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 7, pp. 560-576, Jul. 2003.
29. T. Zhou and D. Tao, "GoDec: Randomized low-rank & sparse matrix decomposition in noisy case," in Proc. ICML, 2011, pp. 33-40.
30. S. Ma, W. Gao, and Y. Lu, "Rate-distortion analysis for H.264/AVC video coding and its application to rate control," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 12, pp. 1533-1544, Dec. 2005.
31. H.-J. Lee, T. Chiang, and Y.-Q. Zhang, "Scalable rate control for MPEG-4 video," IEEE Trans. Circuits Syst. Video Technol., vol. 10, no. 6, pp. 878-894, Sep. 2000.
32. X. Jing, L.-P. Chau, and W.-C. Siu, "Frame complexity based ratequantization model for H.264/AVC intraframe rate control," IEEE Signal Process. Lett., vol. 15, no. 1, pp. 373-376, Mar. 2008.
33. J. Hou, S. Wan, Z. Ma, F. Yang, and L.-P. Chau, "A new ratequantization model for H.264/AVC low-delay rate control," in Advances in Multimedia Information Processing (Lectures Notes in Computer Science), vol. 7674. Berlin, Germany: Springer-Verlag, Dec. 2012, pp. 492-500.
34. Joint Video Team. (2011). JVT Reference Software Encoder Online . Available: http://www.bs.hhi.de/seuhring/tml/download
35. J. L. Devore and N. R. Farnum, Applied Statistics for Engineers and Scientists. New York, NY, USA: Duxbury, 1999.
36. L. Zhang, N. Snavely, B. Curless, and S. M. Seitz, "Spacetime faces: High resolution capture for modeling and animation," ACM Trans. Graph., vol. 23, no. 3, pp. 548-558, 2004.
37. L. Zhang, N. Snavely, B. Curless, and S. M. Seitz, "Spacetime faces: High resolution capture for modeling and animation," ACM Trans. Graph., vol. 23, no. 3, pp. 548-558, 2004.
38. P. Degener, J. Meseth, and R. Klein, "An adaptable surface parameterization method," in Proc. 12th Int. Meshing Roundtable, 2003, pp. 201-213.
39. T. F. Cootes, G. J. Edwards, and C. J. Taylor, "Active appearance models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 6, pp. 681-685 Mar. 2001.