Digital video transcoding

Proceedings of the IEEE

Volumn 93, Issue 1, 2005, Pages 84-97

  Xin, Jun ^a   Lin, Chia Wen ^b   Sun, Ming Ting ^c  

^a MITSUBISHI ELECTRIC RESEARCH LABORATORIES   (United States)

^b NATIONAL CHUNG CHENG UNIVERSITY   (Taiwan)

^c University of Washington   (United States)

Author keywords

Error resilience; Motion estimation; Rate control; Transcoding architecture; Video transcoding

Indexed keywords

BANDWIDTH; COMPUTATIONAL COMPLEXITY; IMAGE QUALITY; LOCAL AREA NETWORKS; MOTION ESTIMATION; MOTION PICTURES; MULTIMEDIA SYSTEMS; VIDEODISKS;

DIGITAL SUBSCRIBER LINES (DSL); ERROR RESILIENCE; INTEGRATED SERVICES DIGITAL NETWORKS (ISDN); RATE CONTROL; TRANSCODING; TRANSCODING ARCHITECTURE; VIDEO TRANSCODING;

IMAGE CODING;

EID: 20744433049     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/JPROC.2004.839620     Document Type: Article

References (98)

1. R. Mohan, J. R. Smith, and C.-S. Li, "Adapting multimedia Internet content for universal access," IEEE Trans. Multimedia, vol. 1, no. 1, pp. 104-114, Mar. 1999.
2. S.-F. Chang and A. Vetro, "Video adaptation: Concepts, technologies, and open issues," Proc. IEEE, vol. 93, no. 1, pp. 148-158, Jan. 2005.
3. Y. Wu, A. Vetro, H. Sun, and S. Y. Kung, "Intelligent multi-hop video communications," presented at the IEEE Pacific-Rim Conf. Multimedia, Beijing, China, 2001.
4. J. Xin, M. T. Sun, and K.-S. Kan, "Bit allocation for joint transcoding of multiple MPEG coded video streams," in Proc. IEEE Int. Conf. Multimedia and Expo, 2001, pp. 8-11.
5. "Information technology - Multimedia content description interface - Part 5: Multimedia description schemes (MPEG-7 MDS)," Int. Standards Org./Int. Electrotech. Comm. (ISO/IEC), ISO/IEC CD 15 938-5, 1st ed., 2001.
6. P. M. Kuhn, T. Suzuki, and A. Vetro, "MPEG-7 transcoding hints for reduced complexity and improved quality," presented at the International Packet Video Workshop 2001, Ryongju, Rorea.
7. A. Vetro, H. Sun, and Y. Wang, "Object-based transcoding for adaptable video content delivery," IEEE Trans. Circuits Syst. Video Technol., vol. 11, no. 3, pp. 387-401, Mar. 2001.
8. S. Wee, "Reversing motion vector fields," in Proc. IEEE Int. Conf. Image Processing, vol. 2, 1998, pp. 209-212.
9. S. Wee and B. Vasudev, "Compressed-domain reverse play of MPEG video streams," in Proc. SPIE Int. Symp. Voice, Video, and Data Communications, 1998, pp. 237-248.
10. Y.-P. Tan, Y.-Q. Liang, and J. Yu, "Video transcoding for fast forward/reverse video playback," in Proc. IEEE Int. Conf. Image Processing, vol. 1, 2002, pp. 713-716.
11. S.-F. Chang, "Optimal video adaptation and skimming using a utility-based framework," presented at the Tyrrhenian Int. Workshop Digital Communications, Capri Island, Italy, 2002.
12. J.-G. Kim, Y. Wang, and S.-F. Chang, "Content-based utility function prediction for real-time MPEG-4 video transcoding," in Proc. IEEE Int. Conf. Image Processing, 2003, pp. 189-192.
13. P. Yin, A. Vetro, and B. Liu, "Rate-distortion models for video transcoding," in Proc. SPIE Conf. Image Video Communications Processing, 2003, pp. 479-488.
14. M. Ghanbari, "Two-layer coding of video signals for VBR networks," IEEE J. Sel. Areas Commun., vol. 7, no. 5, pp. 771-781, Jun. 1989.
15. W. Li, "Overview of fine granularity scalability in MPEG-4 video standard," IEEE Trans. Circuits Syst. Video Technol., vol. 11, no. 3, pp. 301-317, Mar. 2001.
16. "Applications and requirements for scalable video coding," Int. Standards Org./Int. Electrotech. Comm. (ISO/IEC), ISO/IEC/JTC1/ SC29/WG11/N5540, Mar. 2003.
17. "Information technology - Coding of moving pictures and associated audio for digital storage media at up to about 1.5 Mbit/s - Part 2: Video (MPEG-1 video)," Int. Standards Org./Int. Electrotech. Comm. (ISO/IEC), ISO/IEC 11172-2, 1st ed., 1993.
18. "Information technology - Generic coding of moving pictures and associated audio information: Video (MPEG-2 video)," Int. Standards Org./Int. Electrotech. Comm. (ISO/IEC), ISO/IEC 13818-2, 2nd ed., 2000.
19. "Coding of audio-visual objects - Part 2: Visual (MPEG-4 video)," Int. Standards Org./Int. Electrotech. Comm. (ISO/IEC), ISO/IEC 14496-2:2001, 2nd ed., 2001.
20. "Video coding for low bit rate communication," Int. Telecommun. Union-Telecommun. (ITU-T), Geneva, Switzerland, Recommendation H.263, 1998.
21. "Draft text of final draft international standard for advanced video coding," Int. Telecommun. Union-Telecommun. (ITU-T), Geneva, Switzerland, Recommendation H.264 (draft), Mar. 2003.
22. A. Vetro, C. Christopulos, and H. Sun, "Video transcoding architectures and techniques: An overview," IEEE Signal Process. Mag., vol. 20, no. 2, pp. 18-29, Mar. 2003.
23. A. Eleftheriadis and D. Anastassiou, "Constrained and general dynamic rate shaping of compressed digital video," in Proc. IEEE Int. Conf. Image Processing, vol. 3, 1995, pp. 396-399.
24. H. Sun, W. Kwok, and J. W. Zdepski, "Architectures for MPEG compressed bitstream scaling," IEEE Trans. Circuits Syst. Video Technol., vol. 6, no. 2, pp. 191-199, Apr. 1996.
25. Y. Nakajima, H. Hori, and T. Kanoh, "Rate conversion of MPEG coded video by re-quantization process," in Proc. IEEE Int. Conf. Image Processing, vol. 3, 1995, pp. 408-411.
26. J. Youn, M.-T. Sun, and J. Xin, "Video transcoder architectures for bit rate scaling of H.263 bit streams," in Proc. ACM Multimedia, Nov. 1999, pp. 243-250.
27. D. G. Morrison, M. E. Nilson, and M. Ghanbari, "Reduction of the bit-rate of compressed video while in its coded form," in Proc. 6th Int. Workshop Packet Video, 1994, pp. D17.1-D17.4.
28. G. Keesman, R. Hellinghuizen, F. Hoeksema, and G. Heideman, "Transcoding of MPEG bitstreams," Signal Process. Image Commun., vol. 8, no. 6, pp. 481-500, Sep. 1996.
29. P. A. A. Assuncao and M. Ghanbari, "A frequency-domain video transcoder for dynamic bitrate reduction of MPEG-2 bit streams," IEEE Trans. Circuits Syst. Video Technol., vol. 8, no. 8, pp. 953-967, Dec. 1998.
30. J. Youn and M.-T. Sun, "Video transcoding with H.263 bit streams," J. Visual Commun. Image Represent., vol. 11, pp. 385-404, Dec. 2000.
31. T. Shanableh and M. Ghanbari, "Heterogeneous video transcoding to lower spatial-temporal resolutions and different encoding formats," IEEE Trans. Multimedia, vol. 2, no. 2, pp. 101-110, Jun. 2000.
32. S.-F. Chang and D. G. Messerschmitt, "Manipulation and compositing of MC-DCT compressed video," IEEE J. Sel. Areas Commun., vol. 13, no. 1, pp. 1-11, Jan. 1995.
33. N. Merhav and V. Bhaskaran, "Fast algorithms for DCT-domain image downsampling and for inverse motion compensation," IEEE Trans. Circuits Syst. Video Technol., vol. 7, no. 3, pp. 468-476, Jun. 1997.
34. J. Song and B.-L. Yeo, "A fast algorithm for DCT-domain inverse motion compensation based on shared information in a macroblock," IEEE Trans. Circuits Syst. Video Technol., vol. 10, no. 5, pp. 767-775, Aug. 2000.
35. C.-W. Lin and Y.-R. Lee, "Fast algorithms for DCT-domain video transcoding," in Proc. IEEE Int. Conf. Image Processing, vol. 1, 2001, pp. 421-424.
36. S. Acharya and B. Smith, "Compressed domain transcoding of MPEG," in Proc. IEEE Int. Conf. Multimedia Computing and Systems, 1998, pp. 295-304.
37. S. Liu and A. C. Bovik, "Local bandwidth constrained fast inverse motion compensation for DCT-domain video transcoding," IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 5, pp. 309-319, May 2000.
38. W. Zhu, K. Yang, and M. Beacken, "CIF-to-QCIF video bitstream down-conversion in the DCT domain," Bell Labs. Tech. J., vol. 3, no. 3, pp. 21-29, Jul.-Sep. 1998.
39. R. Dugad and N. Ahuja, "A fast scheme for image size change in the compressed domain," IEEE Trans. Circuit Syst. Video Technol., vol. 11, no. 4, pp. 461-474, Apr. 2001.
40. Y.-R. Lee, C.-W. Lin, and Y.-W. Chen, "Computation reduction in cascaded DCT-domain video downscaling transcoding," in Proc. IEEE Int. Symp. Circuits and Systems, 2003, pp. 860-863.
41. N. Bjork and C. Christopoulos, "Transcoder architecture for video coding," IEEE Trans. Consum. Electron., vol. 44, no. 1, pp. 88-98, Feb. 1998.
42. S. Wee, J. G. Apostolopoulos, and N. Feamster, "Field-to-frame transcoding with spatial and temporal downsampling," in Proc. IEEE Int. Conf. Image Processing, vol. 4, 1999, pp. 271-275.
43. B. Shen, I. K. Ishwar, and V. Bhaskaran, "Adaptive motion-vector re-sampling for compressed video downscaling," IEEE Trans. Circuits Syst. Video Technol., vol. 9, no. 6, pp. 929-936, Sep. 1999.
44. S.-H. Jang and N. S. Jayant, "An adaptive nonlinear motion vector resampling algorithm for down-scaling video transcoding," in Proc. IEEE Conf. Multimedia and Expo, vol. 2, 2003, pp. 229-232.
45. G. Shen, B. Zeng, Y.-Q. Zhang, and M.-L. Liou, "Transcoder with arbitrarily resizing capability," in Proc. IEEE Int. Symp. Circuits and Systems, vol. 5, 2001, pp. 25-28.
46. J. Xin, M.-T. Sun, B. S. Choi, and K. W. Chun, "An HDTV to SDTV spatial transcoder," IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 11, pp. 998-1008, Nov. 2002.
47. J. Xin, M.-T. Sun, and T.-D. Wu, "Motion vector composition for MPEG-2 to MPEG-4 video transcoding," in Proc. Workshop and Exhibition MPEG-4, 2002, pp. 9-12.
48. J. Youn, M.-T. Sun, and C.-W. Lin, "Motion vector refinement for high-performance transcoding," IEEE Trans. Multimedia, vol. 1, no. 1, pp. 30-40, Mar. 1999.
49. M.-J. Chen, M.-C. Chu, and C.-W. Pan, "Efficient motion estimation algorithm for reduced frame-rate video transcoder," IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 4, pp. 269-275, Apr. 2002.
50. J.-N. Hwang, T.-D. Wu, and C.-W. Lin, "Dynamic frame-skipping in video transcoding," in Proc. IEEE Workshop Multimedia Signal Processing, 1998, pp. 616-621.
51. K.-D. Seo and J.-K. Kim, "Motion vector refinement for video down-sampling in the DCT domain," IEEE Signal Process. Lett., vol. 9, no. 11, pp. 356-359, Nov. 2002.
52. P. Yin, M. Wu, and B. Liu, "Video transcoding by reducing spatial resolution," in Proc. IEEE Int. Conf. Image Processing, vol. 1, Sep. 2000, pp. 972-975.
53. P. Yin, A. Vetro, H, Sun, and B. Liu, "Drift compensation architectures and techniques for reduced resolution transcoding," Proc. SPIE, Visual Commun. Image Process., vol. 4671, pp. 180-191, Jan. 2002.
54. P. Yin, A. Vetro, B. Liu, and H. Sun, "Drift compensation for reduced spatial resolution transcoding," IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 11, pp. 1009-1020, Nov. 2002.
55. A. Vetro, T. Hata, N. Kuwahara, H. Kalva, and S. Sekiguchi, "Complexity-quality analysis of transcoding architectures for reduced spatial resolution," IEEE Trans. Consum. Electron., vol. 48, no. 3, pp. 515-521, Aug. 2002.
56. K.-T. Fung, Y.-L. Chan, and W.-C. Siu, "New architecture for dynamic frame-skipping transcoder," IEEE Trans. Image Process., vol. 11, no. 8, pp. 886-900, Aug. 2002.
57. T. Shanableh and M. Ghanbari, "Hybrid DCT/pixel domain architecture for heterogeneous video transcoding," Signal Process. Image Commun., vol. 18, no. 8, pp. 601-620, Sep. 2003.
58. J. Xin, M.-T. Sun, and K. Chun, "Motion re-estimation for MPEG-2 to MPEG-4 simple profile transcoding," presented at the Int. Packet Video Workshop, Pittsburgh, PA, 2002.
59. J. Xin, "Improved standard-conforming video transcoding techniques," Ph.D. dissertation, Univ. Washington, Seattle, 2002.
60. H. Jozawa, K. Kamikura, A. Sagata, H. Kotera, and H. Watanabe, "Two-stage motion compensation using adaptive global MC and local affine MC," IEEE Trans. Circuit Syst. Video Technol., vol. 7, no. 1, pp. 75-85, Feb. 1997.
61. "MPEG-4 video verification model version 18.0," Int. Standards Org./Int. Electrotech. Comm. (ISO/IEC), ISO/IEC JTC1/SC29/WG11, Jan. 2001.
62. F. Dufaux and J. Konrad, "Efficient, robust and fast global motion estimation for video coding," IEEE Trans. Image Process., vol. 9, no. 3, pp. 497-501, Mar. 2003.
63. Y. Su, M.-T. Sun, and V. Hsu, "Global motion estimation from coarsely sampled motion vector field and the applications," in Proc. IEEE Int. Symp. Circuits and Systems, vol. 2, 2003, pp. 628-631.
64. Y.-C. Lin, C.-N, Wang, T. Chiang, A. Vetro, and H. Sun, "Efficient FGS-to-single layer transcoding," in Proc. IEEE Int. Conf. Consumer Electronics, 2002, pp. 134-135.
65. Y.-P. Tan and Y.-Q. Liang, "Methods and need for transcoding MPEG-4 fine granularity scalability video," in Proc. IEEE Int. Symp. Circuits and Systems, vol. 4, 2002, pp. 719-722.
66. E. Barrau, "MPEG video transcoding to a fine-granular scalable format," in Proc. IEEE Int. Conf. Image Processing, vol. 1, 2002, pp. 717-720.
67. S. Dogan, A. H. Sadka, and A. M. Kondoz, "Efficient MPEG-4/H.263 video transcoder for interoperability between heterogeneous multimedia networks," Electron. Lett., vol. 35, no. 11, pp. 863-864, May 1999.
68. H. Kato, H. Yanagihara, Y. Nakajima, and Y. Hatori, "A fast motion estimation algorithm for DV to MPEG-2 conversion," in Proc. IEEE Int. Conf. Consumer Electronics, 2002, pp. 140-141.
69. N. Feamster and S. Wee, "An MPEG-2 to H.263 transcoder," presented at the SPIE Int. Symp. Voice, Video, and Data Communication Conf., Boston, MA, 1999.
70. J.-L. Wu, S.-J. Huang, Y.-M. Huang, C.-T. Hsu, and J. Shiu, "An efficient JPEG to MPEG-1 transcoding algorithm," IEEE Trans. Consum. Electron., vol. 42, no. 3, pp/447-457, Aug. 1996.
71. A. Gersho and R. Gray, Vector Quantization and Signal Compression. Norwell, MA: Kluwer, 1991.
72. O. Werner, "Requantization for transcoding of MPEG-2 intraframes," IEEE Trans. Image Process., vol. 8, no. 2, pp. 179-191, Feb. 1999.
73. Z. Guo, O. C. Au, and K. B. Letaief, "Parameter estimation for image/video transcoding," in Proc. IEEE Int. Symp. Circuits and Systems, vol. 2, 2000, pp. 269-272.
74. H. Sorial, W. Lynch, and A. Vincent, "Selective requantization for transcoding of MPEG compressed video," in Proc. IEEE Int. Conf. Multimedia and Expo., 2000, pp. 217-220.
75. B. Shen, "Efficient deblocking and optimal quantizer selection for video transcoding," in Proc. IEEE Int. Conf. Image Processing, 2003, pp. 193-196.
76. "Test Model 5" Int. Standards Org./lnt. Electrotech. Comm. (ISO/IEC), ISO/IEC JTC1/SC29/WG11, N0400, Apr. 1993.
77. L. Wang, A. Luthra, and B. Eifrig, "Rate control for MPEG transcoding," IEEE Trans. Circuits Syst. Video Technol., vol. 11, no. 2, pp. 222-234, Feb. 2001.
78. P. N. Tudor and O. H. Wemer, "Real-time transcoding of MPEG-2 video bit streams," in Proc. IEE Int. Broadcasting Com., 1997, pp. 286-301.
79. P. Assunção and M. Ghanbari, "Buffer analysis and control in CBR video transcoding," IEEE Trans. Circuits Syst. Video Technol., vol. 10, no. 1, pp. 83-92, Feb. 2000.
80. J. Xin, M.-T. Sun, and K. W. Chun, "Bit allocation for transcoding of pre-encoded video streams," Proc. SPIE: Visual Commun. Image Process., vol. 4671, pp. 164-171, Jan. 2002.
81. I. Koo, P. Nasiopoulos, and R. Ward, "Joint MPEG-2 coding for multi-program broadcasting of pre-recorded video," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, vol. 4, 1999, pp. 2227-2230.
82. H. Sorial, W. E. Lynch, and A. Vincent, "Joint transcoding of multiple MPEG video bitstreams," in Proc. IEEE Int. Symp. Circuits Systems, 1999, pp. 251-254.
83. H. Kasai, T. Hanamura, W. Kamayama, and H. Tominaga, "Rate control scheme for low-delay MPEG-2 video transcoder," in Proc. IEEE Int. Conf. Image Processing, 2000, pp. 964-967.
84. M.-T. Sun, T.-D. Wu, and J.-N. Hwang, "Dynamic bit allocation in video combining for multipoint video conferencing," IEEE Trans. Circuits Syst. II, Exp. Briefs, vol. 45, no. 5, pp. 644-648, May 1998.
85. T.-D. Wu and J.-N. Hwang, "Dynamic bit rate conversion in multipoint video transcoding," in Proc. IEEE Int. Conf. Image Processing, 1999, pp. 817-821.
86. C.-W. Lin, Y.-C. Chen, and M-.T. Sun, "Dynamic region of interest transcoding for multipoint video conferencing," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 10, pp. 982-992, Oct. 2003.
87. G. Sullivan and T. Wiegand, "Rate-distortion optimization for video compression," IEEE Signal Process. Mag., vol. 15, no. 6, pp. 74-90, Nov. 1998.
88. F. Hartung and B. Girod, "Watermarking of uncompressed and compressed video," Signal Process., vol. 66, no. 3, pp. 283-301, May 1998.
89. J. Meng and S. F. Chang, "Embedding visible video watermarks in the compressed domain," in Proc. IEEE Int. Conf. Image Processing, vol. 1, 1998, pp. 474-477.
90. J. Youn, J. Xin, and M.-T. Sun, "Fast video transcoding architectures for networked multimedia applications," in Proc. IEEE Int. Symp. Circuits and Systems, vol. 4, 2000, pp. 25-28.
91. K. Panusopone, X. Chen, and F. Ling, "Logo insertion in MPEG transcoder," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, vol. 2, 2001, pp. 981-984.
92. G. de los Reyes, A. R. Reibman, S.-F. Chang, and J. C.-I. Chuang, "Error-resilient transcoding for video over wireless channels," IEEE ' J. Sel. Areas Commun., vol. 18, no. 6, pp. 1063-1074, Jun. 2000.
93. S. Dogan, A. Cellatoglu, M. Uyguroglu, A. H. Sadka, and A. M. Kondoz, "Error-resilient video transcoding for robust internetwork communications using GPRS," IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 6, pp. 453-564, Jun. 2002.
94. R. Puri, K.-W. Lee, K. Ramchandran, and V. Bhargavan, "An integrated source transcoding and congestion control paradigm for video streaming in the internet," IEEE Trans. Multimedia, vol. 3, no. 1, pp. 18-32, Mar. 2001.
95. Y. Wang and Q.-F. Zhu, "Error control and concealment for video communication: A review," Proc. IEEE, vol. 86, no. 5, pp. 974-997, May 1998.
96. R. Swann and N. Kingsbury, "Transcoding of MPEG-II for enhanced resilience to transmission errors," in Proc. IEEE Int. Conf. Image Processing, vol. 2, 1996, pp. 813-816.
97. M. Xia, A. Vetro, B. Liu, and H. Sun, "Rate-distortion optimized bit allocation for error resilient video transcoding," in Proc. IEEE Int. Symp. Circuits and Systems, vol. 3, 2004, pp. III-945-III-948.
98. T.-C. Wang, H.-C. Fang, and L.-O. Chen, "Low delay and error robust wireless video transmission for video communication," IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 12, pp. 1049-1058, Dec. 2002.