Modeling and compressing 3-D facial expressions using geometry videos

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 22, Issue 1, 2012, Pages 77-90

  Xia, Jiazhi ^a   Quynh, Dao Thi Phuong ^a   He, Ying ^a   Chen, Xiaoming ^a   Hoi, Steven C H ^a  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

3 D facial expression; expression invariant parameterization; feature correspondence; geometry video (GV); H264 AVC; video compression

Indexed keywords

BIT-RATE REDUCTION; EXPRESSION DATA; FACE SEGMENTATION; FACIAL EXPRESSIONS; FEATURE CORRESPONDENCE; H264/AVC; HIGH RESOLUTION; HOLE FILLING; MOTION DATA; MOVIE INDUSTRY; PARAMETERIZATION METHOD; PREDICTION SCHEMES; REAL-WORLD DATASETS; SALIENT FEATURES; SPATIAL AND TEMPORAL COHERENCE; VIDEO PROCESSING; VIDEO QUALITY;

ALGORITHMS; DATA HANDLING; GEOMETRY; IMAGE COMPRESSION; MOTION PICTURE EXPERTS GROUP STANDARDS; PARAMETERIZATION;

THREE DIMENSIONAL;

EID: 84862952041     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2011.2158337     Document Type: Article

References (40)

1. S. Zhang and P. Huang, "High-resolution, real-time 3D shape acquisition," in Proc. CVPRW, vol. 3. 2004, p. 28.
2. X. Gu, S. J. Gortler, and H. Hoppe, "Geometry images," in Proc. SIGGRAPH, 2002, pp. 355-361.
3. H. Briceño, P. Sander, L. McMillan, S. Gortler, and H. Hoppe, "Geometry videos: A new representation for 3D animations," in Proc. SCA, 2003, pp. 136-146.
4. T. Wiegand, G. Sullivan, G. Bj̈ontegaard, and A. Luthra, "Overview of the H.264/AVC video coding standard," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 7, pp. 560-576, Jul. 2003.
5. S. Rusinkiewicz, O. Hall-Holt, and M. Levoy, "Real-time 3D model acquisition," ACM Trans. Graphics, vol. 21, no. 3, pp. 438-446, Jul. 2002.
6. T. P. Koninckx and L. V. Gool, "Real-time range acquisition by adaptive structured light," IEEE Trans. Patt. Anal. Mach. Intell., vol. 28, no. 3, pp. 432-445, Mar. 2006. (Pubitemid 43159638)
7. D. Nehab, R. Ramamoorthi, J. Davis, and S. Rusinkiewicz, "Spacetime stereo: A unifying framework for depth from triangulation," IEEE Trans. Patt. Anal. Mach. Intell., vol. 27, no. 2, pp. 296-302, Feb. 2005. (Pubitemid 40384127)
8. L. Zhang, N. Snavely, B. Curless, and S. M. Seitz, "Spacetime faces: High resolution capture for modeling and animation," in Proc. SIGGRAPH, 2004, pp. 548-558.
9. Y. Wang, X. Huang, C. S. Lee, S. Zhang, Z. Li, D. Samaras, D. Metaxas, A. Elgammal, and P. Huang, "High resolution acquisition, learning and transfer of dynamic 3-D facial expressions," in Proc. CGF, 2004, pp. 677-686.
10. S. Wang, Y. Wang, M. Jin, X. Gu, and D. Samaras, "3D surface matching and recognition using conformal geometry," in Proc. CVPR, vol. 2. 2006, pp. 2453-2460. (Pubitemid 44931617)
11. N. J. Mitra, S. Fl̈ory, M. Ovsjanikov, N. Gelfand, L. Guibas, and H. Pottmann, "Dynamic geometry registration," in Proc. SGP, 2007, pp. 173-182.
12. W. Chang and M. Zwicker, "Automatic registration for articulated shapes," Comput. Graphics Forum, vol. 27, no. 5, pp. 1459-1468, 2008.
13. A. Sharf, D. A. Alcantara, T. Lewiner, C. Greif, A. Sheffer, N. Amenta, and D. Cohen-Or, "Space-time surface reconstruction using incompressible flow," in Proc. SIGGRAPH Asia, 2008, pp. 1-10.
14. Y. Wang, M. Gupta, S. Zhang, S. Wang, X. Gu, D. Samaras, and P. Huang, "High resolution tracking of non-rigid motion of densely sampled 3D data using harmonic maps," Int. J. Comput. Vision, vol. 76, no. 3, pp. 283-300, Mar. 2008.
15. A. M. Bronstein, M. M. Bronstein, and R. Kimmel, " Expressioninvariant representations of faces," IEEE Trans. Image Process., vol. 2, no. 3, pp. 537-547, Sep. 2007.
16. S.-R. Han, T. Yamasaki, and K. Aizawa, "Time-varying mesh compression using an extended block matching algorithm," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 11, pp. 1506-1518, Nov. 2007. (Pubitemid 350027673)
17. T. Matsuyama, X. Wu, T. Takai, and T. Wada, "Real-time dynamic 3-D object shape reconstruction and high-fidelity texture mapping for 3-D video," IEEE Trans. Circuits Syst. Video Technol., vol. 14, no. 3, pp. 357-369, Mar. 2004.
18. S.-R. Han, T. Yamasaki, and K. Aizawa, "Geometry compression for time-varying meshes using coarse and fine levels of quantization and run-length encoding," in Proc. ICIP, 2008, pp. 1045-1048.
19. T. Yamasaki and K. Aizawa, "Patch-based compression for time-varying meshes," in Proc. ICIP, 2010, pp. 3433-3436.
20. H. Hoppe and E. Praun, "Shape compression using spherical geometry images," in Advances in Multiresolution for Geometric Modelling. New York: Springer-Verlag, 2005, pp. 27-46.
21. N.-H. Lin, T.-H. Huang, and B.-Y. Chen, "3D model streaming based on a JPEG 2000 image," IEEE Trans. Consumer Electron., vol. 53, no. 1, pp. 182-190, Feb. 2007. (Pubitemid 46584345)
22. G. Peyŕe and S. Mallat, "Surface compression with geometric bandelets," in Proc. SIGGRAPH, 2005, pp. 601-608.
23. G. Sullivan and T. Wiegand, "Video compression: From concepts to the H.264/AVC standard," Proc. IEEE, vol. 93, no. 1, pp. 18-31, Jan. 2005. (Pubitemid 40851238)
24. The H.264/AVC standard, document ITU-T Rec. H.264, ITU-T, 2008.
25. A.-C. Tsai, A. Paul, J.-C. Wang, and J.-F. Wang, "Intensity gradient technique for efficient intra-prediction in H.264/AVC," IEEE Trans. Circuits Syst. Video Technol., vol. 18, no. 5, pp. 694-698, May 2008. (Pubitemid 351634393)
26. M. Parlak, Y. Adibelli, and I. Hamzaoglu, "A novel computational complexity and power reduction technique for H.264 intra prediction," IEEE Trans. Consumer Electron., vol. 54, no. 4, pp. 2006-2014, Nov. 2008.
27. A.-C. Tsai, J.-F. Wang, J.-F. Yang, and W.-G. Lin, "Effective subblockbased and pixel-based fast direction detections for H.264 intra prediction," IEEE Trans. Circuits Syst. Video Technol., vol. 18, no. 7, pp. 975-982, Jul. 2008.
28. D.-Y. Kim, K.-H. Han, and Y.-L. Lee, "Adaptive single-multiple prediction for H.264/AVC intra coding," IEEE Trans. Circuits Syst. Video Technol., vol. 20, no. 4, pp. 610-615, Apr. 2010.
29. Y. Zheng, P. Yin, O. Escoda, X. Li, and C. Gomila, "Intra prediction using template matching with adaptive illumination compensation," in Proc. ICIP, 2008, pp. 125-128.
30. J. Zhou, H. Zhou, and X. Yang, "An interpolation method by predicting the direction of pixel texture changing trend for H.264/AVC intra prediction," in Proc. IITA, vol. 1. 2008, pp. 884-888.
31. D. Liu, X. Sun, F. Wu, and Y.-Q. Zhang, "Edge-oriented uniform intra prediction," IEEE Trans. Image Process., vol. 17, no. 10, pp. 1827-1836, Oct. 2008.
32. L. Wang, L.-M. Po, Y. Uddin, K.-M. Wong, and S. Li, "A novel weighted cross prediction for H.264 intra coding," in Proc. ICME, 2009, pp. 165-168.
33. M. W. Marcellin, M. J. Gormish, A. Bilgin, and M. P. Boliek, "An overview of JPEG-2000," in Proc. DCC, 2000, pp. 523-544.
34. T. F. Cootes, G. J. Edwards, and C. J. Taylor, "Active appearance models," IEEE Trans. Patt. Anal. Mach. Intell., vol. 23, no. 6, pp. 681-685, Jun. 2001. (Pubitemid 32585279)
35. X. Gu and S.-T. Yau, Computational Conformal Geometry. Somerville, MA: International Press of Boston, 2008.
36. S.-Q. Xin and G.-J. Wang, "Improving Chen and Han's algorithm on the discrete geodesic problem," ACM Trans. Graphics, vol. 28, no. 4, pp. 104:1-104:8, Aug. 2009.
37. M. S. Floater and K. Hormann, "Surface parameterization: A tutorial and survey," in Proc. AMGM, 2005, pp. 157-186.
38. A. Sheffer, E. Praun, and K. Rose, "Mesh parameterization methods and their applications," Found. Trends. Comput. Graph. Vis., vol. 2, no. 2, pp. 105-171, 2006. (Pubitemid 46732197)
39. J. Xia, Y. He, D. T. P. Quynh, X. Chen, and S. Hoi, "Modeling 3D facial expressions using geometry videos," in Proc. ACM MM, 2010, pp. 591-600.
40. X. Gu, S. Wang, J. Kim, Y. Zeng, Y. Wang, H. Qin, and D. Samaras, "Ricci flow for 3D shape analysis," in Proc. ICCV, 2007, pp. 1-8.