Video coding on multicore graphics processors

IEEE Signal Processing Magazine

Volumn 27, Issue 2, 2010, Pages 79-89

  Cheung, Nagai Man ^a   Fan, Xiaopeng ^b   Au, Oscar ^c   Kung, Man Cheung ^d  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^b HARBIN INSTITUTE OF TECHNOLOGY   (China)

^c HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

^d HONG KONG APPLIED SCIENCE AND TECHNOLOGY RESEARCH INSTITUTE   (Hong Kong)

Author keywords

[No Author keywords available]

Indexed keywords

CODES (SYMBOLS); COMPUTER GRAPHICS; COMPUTER GRAPHICS EQUIPMENT; DECODING; ELECTRIC DISTORTION; IMAGE CODING; INTEGRATED CIRCUIT DESIGN; MOTION ESTIMATION; PROGRAM PROCESSORS; SIGNAL DISTORTION; VIDEO SIGNAL PROCESSING;

DATA PARALLELISM; DESIGN CONSIDERATIONS; FAST MOTION ESTIMATION; GRAPHICS PROCESSOR; PARALLEL PROCESSING; RATE DISTORTION PERFORMANCE; VIDEO DECODING; VIDEO ENCODINGS;

GRAPHICS PROCESSING UNIT;

EID: 85032750945     PISSN: 10535888     EISSN: None     Source Type: Journal    
DOI: 10.1109/MSP.2009.935416     Document Type: Article

References (57)

1. Y. Wang, J. Ostermann, and Y.-Q. Zhang, Video Processing and Communications. Englewood Cliffs, NJ: Prentice-Hall, 2002.
2. T. Wiegand, "Joint final committee draft for joint video specification H.264," Joint Video Team (JVT) of ISO/IEC MPEG and ITU-T VCEG, Tech. Rep. J V T-D157, 2002.
3. AVS Video Expert Group, Information Technology\Advanced Audio Video Coding Standard Part 2: Video, in Audio Video Coding Standard Group of China (AVS), Doc. AVS-N1063, Dec. 2003.
4. L. Yu, F. Yi, J. Dong, and C. Zhang, "Overview of AVS-Video: Tools, performance and complexity," in Proc. Visual Communications and Image Processing (VCIP), 2005, pp. 679-690.
5. T. Wiegand, G. Sullivan, G. Bjontegaard, and A. Luthra, "Overview of the H.264/AVC video coding standard," IEEE Trans. Circuits Syst. Video Technol., vol.13, no.7, pp. 560-576, July 2003.
6. G. Sullivan, J.-R. Ohm, A. Ortega, E. Delp, A. Vetro, and M. Barni, "dsp Forum\Future of video coding and transmission," IEEE Signal Processing Mag., vol.23, no.6, pp. 76-82, Nov. 2006.
7. J. Loomis and M. Wasson. (2007). VC-1 technical overview [Online]. Available: http://www.microsoft.com/windows/windowsmedia/
8. B. G. Haskell, A. Puri, and A. N. Netravali, Digital Video: An Introduction to MPEG-2. Berlin: Springer-Verlag, 1996.
9. L. Fan, S. Ma, and F. Wu, "An overview of AVS video standard," in Proc. IEEE Int. Conf. Multimedia and Expo, 2004, pp. 423-426.
10. G. Shen, G. Gao, S. Li, H. Shum, and Y. Zhang, "Accelerate video decoding with generic GPU," IEEE Trans. Circuits Syst. Video Technol., vol.15, no.5, pp. 685-693, 2005.
11. A. Mather, "GPU-accelerated video encoding," in Proc. SIGGRAPH Tech Talks, 2008.
12. J. Kruger and R. Westermann, "Linear algebra operators for GPU implementation of numerical algorithms," in Proc. Int. Conf. Computer Graphics and Interactive Techniques, Los Angeles, CA, 2005, p. 234.
13. O. Fialka and M. Cadik, "FFT and convolution performance in image filtering on GPU," in Proc. Conf. Information Visualization, 2006, pp. 609-614.
14. A. Brunton and J. Zhao, "Real-time video watermarking on programmable graphics hardware," in Proc. Canadian Conf. Electrical and Computer Engineering, 2005, pp. 1312-1315.
15. NVIDIA, "NVIDIA GeForce 8800 architecture technical brief," NVIDIA, Tech. Rep., 2006.
16. NVIDIA. (2009). CUDA\Compute unified device architecture [Online]. Available: http://www.nvidia.com/object/cuda-home.html
17. Khronos Group. (2009). OpenCL\The open standard for parallel programming of heterogeneous systems [Online]. Available: http://www.khronos.org/opencl/
18. M. Macedonia, "The GPU enters computing's mainstream," Computer, vol.36, no.10, pp. 106-108, Oct. 2003.
19. F. Kelly and A. Kokaram, "General purpose graphics hardware for accelerating motion estimation," in Proc. Irish Machine Vision and Image Processing Conf., 2003.
20. Y. Lin, P. Li, C. Chang, C. Wu, Y. Tsao, and S. Chien, "Multi-pass algorithm of motion estimation in video encoding for generic GPU," in Proc. IEEE Int. Symp. Circuits and Systems, 2006.
21. C.-W. Ho, O. Au, G. Chan, S.-K. Yip, and H.-M. Wong, "Motion estimation for H.264/AVC using programmable graphics hardware," in Proc. IEEE Int. Conf. Multimedia and Expo, 2006, pp. 2049-2052.
22. M. Kung, O. Au, P. Wong, and C. Liu, "Block based parallel motion estimation using programmable graphics hardware," in Proc. Int. Conf. Audio, Language and Image Processing, 2008, pp. 599-603.
23. M. L. Schmit, R. M. Rawther, and R. Giduthuri, "Software video encoder with GPU acceleration," U.S. Patent 20 090 016 430, 2009.
24. G. Jin and H.-J. Lee, "A parallel and pipelined execution of H.264/AVC intra prediction," in Proc. IEEE Int. Conf. Computer and Information Technology, 2006, p. 246.
25. W. Lee, S. Lee, and J. Kim, "Pipelined intra prediction using shuffled encoding order for H.264/AVC," in Proc. IEEE Region 10 Conf. (TENCON), 2006, pp. 1-4.
26. M. Kung, O. Au, P. Wong, and C. Liu, "Intra frame encoding using programmable graphics hardware," in Proc. Pacific Rim Conf. Multimedia (PCM), 2007, pp. 609-618.
27. N.-M. Cheung, O. Au, M. Kung, H. Wong, and C. Liu, "Highly parallel rate-distortion optimized intra mode decision on multi-core graphics processors," IEEE Trans. Circuits Syst. Video Technol.(Special Issue on Algorithm/Architecture Co-Exploration of Visual Computing), vol.19, no.11, pp. 1692-1703, Nov. 2009.
28. A. Obukhov and A. Kharlamov, "Discrete cosine transform for 8×8 blocks with CUDA," NVIDIA, Santa Clara, CA, Tech. Rep., Oct. 2008.
29. B. Pieters, D. Van Rijsselbergen, W. De Neve, and R. Van de Walle, "Motion compensation and reconstruction of H.264/AVC video bitstreams using the GPU," in WIAMIS '07: Proc. 8th Int. Workshop Image Analysis for Multimedia Interactive Services. Washington, DC: IEEE Comput. Soc., 2007, p. 69.
30. A. Hirvonen and T. Leppanen, "H.263 video decoding on programmable graphics hardware," in Proc. 5th IEEE Int. Symp. Signal Processing and Information Technology, Dec. 2005, pp. 902-907.
31. B. Han and B. Zhou, "Efficient video decoding on GPUs by point based rendering," in GH '06: Proc. 21st ACM SIGGRAPH/EUROGRAPHICS Symp. Graphics Hardware. New York, NY: ACM, 2006, pp. 79-86.
32. NVIDIA. (2009). PureVideo overview [Online]. Available: http://www.nvidia.com/object/purevideo-overview.html
33. J. Munkberg, P. Clarberg, J. Hasselgren, and T. Akenine-Moller, "High dynamic range texture compression for graphics hardware," ACM Trans. Graph., vol.25, no.3, 2006, pp. 698-706.
34. Y.-K. Chen, W. Li, J. Li, and T. Wang, "Novel parallel Hough transform on multi-core processors," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP), 2008, pp. 1457-1460.
35. J. Fung, S. Mann, and C. Aimone, "OpenVIDIA: Parallel GPU computer vision," in Proc. ACM Multimedia, 2005, pp. 849-852.
36. P. M. Novotny, J. A. Stoll, N. V. Vasilyev, P. J. del Nido, P. E. Dupont, T. E. Zickler, and R. D. Howe, "GPU based real-time instrument tracking with three-dimensional ultrasound," Med. Image Anal.(Special Issue on the 9th Int. Conf. on Medical Image Computing and Computer-Assisted Interventions\MICCAI 2006), vol.11, no.5, pp. 458-464, 2007.
37. D. Lin, V. Huang, Q. Nguyen, J. Blackburn, C. Rodrigues, T. Huang, M. N. Do, S. J. Patel, and W.-M. W. Hwu, "The parallelization of video processing," IEEE Signal Processing Mag., vol.26, no.6, pp. 103-112, Nov. 2009.
38. D. Kirk and W. Hwu, "Textbook for UIUC ECE 498 AL: Programming massively parallel processors," Draft, 2009.
39. NVIDIA, "CUDA programming guide," NVIDIA, Tech. Rep., 2009.
40. J. P. Shen and M. H. Lipasti, Modern Processor Design: Fundamentals of Superscalar Processors. Boston: McGraw-Hill, 2005.
41. M. Houston. (2007). SIGGRAPH 2007 GPGPU course [Online]. Available: http://gpgpu.org/s2007
42. X. Yi, J. Zhang, N. Ling, and W. Shang, "Improved and simplified fast motion estimation for JM," in Proc. JVT Meeting, Poznan, Poland, Tech. Rep. JVT-P021, July 2005.
43. C.-L. Yang, L.-M. Po, and W.-H. Lam, "A fast H.264 intra prediction algorithm using macroblock properties," in Proc. IEEE Int. Conf. Image Processing (ICIP), 2004, pp. 461-464.
44. R. Su, G. Liu, and T. Zhang, "Fast mode decision algorithm for intra prediction in H.264/AVC," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP), 2006.
45. M. Liu and Z.-Q. Wei, "A fast mode decision algorithm for intra prediction in AVS-M video coding," in Proc. Int. Conf. Wavelet Analysis and Pattern Recognition, Nov. 2007, pp. 326-331.
46. K.-W. Yoo and H.-H. Kim, "Intra prediction method and apparatus," U.S. Patent 2005/0 089 094, 2005.
47. I. E. Richardson, H.264 and MPEG-4 Video Compression, Video Coding for Next-Generation Multimedia. England: Wiley, Nov. 2003.
48. T. Wiegand and B. Girod, "Lagrange multiplier selection in hybrid video coder control," in Proc. IEEE Int. Conf. Image Processing (ICIP), 2001, pp. 542-545.
49. Advanced Micro Devices Inc. 2006). ATI CTM guide [Online]. Available: http://ati.amd.com/companyinfo/researcher/documents/ATI-CTM-Guide.pdf
50. Advanced Micro Devices Inc.(2009). ATI stream software development kit (SDK) [Online]. Available: http://developer.amd.com/gpu/ATIStreamSDK/Pages/ default.aspx
51. G. Bjontegaard, "Calculation of average PSNR differences between RD-curves," in Proc. JVT Meeting, Tech. Rep. VCEG-M33, Apr. 2001.
52. OpenMP. (2009). The OpenMP API specification for parallel programming [Online]. Available: http://openmp.org/
53. A. Vetro, C. Christopoulos, and H. Sun, "Video transcoding architectures and techniques: An overview," IEEE Signal Processing Mag., vol.20, no.2, pp. 18-29, Mar. 2003.
54. H. Sun, X. Chen, and T. Chiang, Digital Video Transcoding for Transmission and Storage. New York: CRC, 2005.
55. I. Ahmad, X. Wei, Y. Sun, and Y.-Q. Zhang, "Video transcoding: An overview of various techniques and research issues," IEEE Trans. Multimedia, vol.7, no.5, pp. 793-804, Oct. 2005.
56. Techreport. (2009). Badaboom 1.0 uses Nvidia GPUs to transcode video [Online]. Available: http://techreport.com/discussions.x/15763
57. AnandTech. (2009). AVIVO video converter Redux and ATI stream quick look [Online]. Available:http://www.anandtech.com/video/showdoc.aspx?i=3578