Fast MPEG-4 motion estimation: processor based and flexible VLSI implementations

Journal of VLSI Signal Processing Systems for Signal, Image, and Video Technology

Volumn 23, Issue 1, 1999, Pages 67-92

  Kuhn, Peter M ^a  

^a SONY CORPORATION   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; COMPUTATIONAL COMPLEXITY; COMPUTER GRAPHICS; DIGITAL COMMUNICATION SYSTEMS; IMAGE COMPRESSION; MULTIMEDIA SYSTEMS; PARAMETER ESTIMATION; PROGRAM PROCESSORS; RECEPTION QUALITY; STANDARDS; VLSI CIRCUITS;

COMPUTATIONAL POWER; MOTION ESTIMATION; MOVING PICTURE EXPERTS GROUP;

MOTION COMPENSATION;

EID: 0033207233     PISSN: 09225773     EISSN: None     Source Type: Journal    
DOI: 10.1023/A:1008192719838     Document Type: Article

References (79)

1. ISO/IEC 14496-2 Information technology - generic coding of moving pictures and associated audio information, Part 2: Visual, 1999.
2. J. Kneip, S. Bauer, J. Vollmer, B. Schmale, and P. Kuhn, "The MPEG-4 video coding standard - a VLSI point of view," IEEE Workshop on Signal Processing Systems (SiPS), Cambridge, MA, USA, Oct. 1998.
3. ISO/IEC 11172-2, Information technology - coding of moving pictures and associated audio for digital storage media at up to 1.5 Mbit/s. Part 2: Video.
4. ISO/IEC 13818-2 Information technology - generic coding of moving pictures and associated audio information. Part 2: Video.
5. P. Kuhn, Algorithms, Complexity-Analysis and VLSI-Architectures for MPEG-4 Motion Estimation, Kluwer Academic Publishers, Boston/Dordrecht/London, June 1999.
6. S. Dutta, W. Wolf, and A. Wolfe, "A methodology to evaluate memory architecture design tradeoffs for video signal processors," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 8, No. 1, pp. 36-53, Feb. 1998.
7. P. Kuhn, "Instrumentation tools and methods for MPEG-4 VM: review and a new proposal," ISO/IEC JTC1/SC29/WG11/ MPEG96/M0838, Firence, Italy, 1996.
8. P. Kuhn, "Complexity analysis of the MPEG-4 video verification model encoder using profiling tools," ISO/IEC JTC1/ SC29/WG11 MPEG96/M0920, Tampere, Finland, 1996.
9. P. Kuhn, "A portable instruction level profiler for complexity analysis - documentation," ISO/IEC JTC1/SC29/ WG11 MPEG96/M0921, Tampere, Finland, 1996.
10. P. Kuhn, "A portable instruction level profiler for complexity analysis - software," ISO/IEC JTC1/SC29/WG11 MPEG96/ M1056, Tampere, Finland, 1996.
11. P. Kuhn, "Complexity analysis of single video tools of the MPEG-4 verification model," ISO/IEC JTC1/SC29/WG11/ M3204, San Jose, USA, Jan. 1998.
12. P. Kuhn, "A Complexity analysis tool: iprof (version 0.41)," ISO/IEC JTC1/SC29/WG11/M3551, Dublin, Ireland, July 1998.
13. K. Itoh, K. Sasaki, and Y. Nakagome, "Trends in low-power RAM circuit technologies," Proceedings of the IEEE, Vol. 83, pp. 524-543, April 1995.
14. H. Schmeck, Analyse von VLSI-Algorithmen, Spektrum-Verlag, Heidelberg, Berlin, Oxford, chap. 3, 1995 (in German).
15. Zhong L. He and Ming L. Liou, "Design trade-offs for real-time block-matching motion estimation," Lecture Notes on Computer Science, Image Analysis and Processing, pp. 129-138, 1996.
16. H.G. Musmann, P. Pirsch, and H.-J. Grallert, "Advances in picture coding," Proceedings of the IEEE, Vol. 73, No. 4, pp. 523-548, April 1985.
17. B. Furht, J. Greenberg, and R. Westwater, Motion Estimation Algorithms for Video Compression, Kluwer Academic Publishers, Boston/Dordrecht/London, 1997.
18. F. Dufaux and F. Moscheni, "Motion estimation techniques for digital TV: a review and a new contribution," Proc. IEEE, Vol. 83, No. 6, pp. 858-876, 1995.
19. J.-R. Ohm, Digitale Bildcodierung: Repräsentation, Kompression und Ubertragung von Bildsignalen," Springer Verlag, 1995 (in German).
20. M.A. Tekalp, Digital Video Processing, Prentice Hall, 1995.
21. J.L. Mitchell, W.B. Pennebaker, C.E. Fogg, and D.J. LeGall, MPEG Video Compression Standard, Chapter 13: Motion estimation, Chapman & Hall, pp. 283-311, 1997.
22. P. Pirsch, N. Demassieux, and W. Gehrke, "VLSI architectures for video compression - a survey," Proceedings of the IEEE, Vol. 83, No. 2, pp. 220-246, Feb. 1995.
23. P. Kuhn and W. Stechele, "Complexity analysis of the emerging MPEG-4 standard as a basis for VLSI implementation," Vol. SPIE 3309, Visual Communications and Image Processing, San Jose, pp. 498-509, Jan. 1998.
24. T. Berger, Rate Distortion Theory: A Mathematical Basis for Data Compression, Englewood Cliffs, NJ: Prentice-Hall Elec. Eng. Series, 1971.
25. V. Bhaskaran and K. Konstantinides, Image and Video Compression Standards: Algorithms and Architectures, Kluwer Academic Publishers, 1995.
26. B. Girod, "Rate constrained motion estimation," SPIE Proc. Visual Communications and Image Processing, Vol. 2308, pp. 1026-1034, 1994.
27. Lung-Kuo Liu, "Rate-constrained motion estimation algorithm for video coding," IEEE International Conference on Image Processing, ICIP 97, 1997.
28. F. Kossentini, Y.-W. Lee, M.J.T. Smith, and R.K. Ward, "Predictive RD optimized motion estimation for very low bit-rate video coding," IEEE Journal on Selected Areas in Communications, Vol. 15, No. 9, Dec. 1997.
29. P. Sriram and S. Sudharsanan, "Entropy constrained motion estimation: algorithm and implementation," SPIE 3311 MHA Multimedia Hardware Architectures, San Jose, CA, pp. 99-107, 1998.
30. G.J. Sullivan and T. Wiegand, "Rate-distortion optimization for video compression," IEEE Signal Processing Magazine, pp. 74-90, Nov. 1998.
31. M.Z. Coban and R.M. Mersereau, "Computationally efficient exhaustive search algorithm for rate-constrained motion estimation," IEEE International Conference on Image Processing, ICIP 97, Santa Barbara, Oct. 1997.
32. W.C. Chung, F. Kossentini, and M.J.T. Smith, "An efficient motion estimation technique based on a rate-distortion criterion," ICASSP 96, 1996.
33. Zhongli He and Ming L. Liou, "A high performance fast search algorithm for block matching motion estimation," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 7, No. 5, pp. 826-828, Oct. 1997.
34. G. Cote, M. Gallant, and F. Kossentini, "Efficient motion vector estimation and coding for H.263-based very low bit rate video compression," ITU-T SG 16, Q15-A-45, June 1997.
35. K. Lengwehasatit, A. Ortega, A. Basso, and A. Reibmann, "A novel computationally scalable algorithm for motion estimation," SPIE 3309 VCIP Visual Communications and Image Processing, San Jose, CA, pp. 68-79, Jan. 1998.
36. K.R. Rao and P. Yip, Discrete Cosine Transform - Algorithms, Advantages, Applications, Academic Press, Boston/San Diego/ New York/London/Sydney/Tokyo/Toronto, p. 242ff, 1990.
37. H. Gharavi and M. Mills, "Block-matching motion estimation algorithms - new results," IEEE Transactions on Circuits and Systems, Vol. 37, No. 5, pp. 649-651, May 1990.
38. S. Kappagantula and K. Rao, "Motion compensated interframe image prediction," IEEE Trans, on Communications, Vol. 33, No. 9, pp. 1011-1015, Sept. 1985.
39. Mei-Juan Chen, Liang-Gee Chen, Tzi-Dar Chiueh, and Yung-Pin Lee, "A new block-matching criterion for motion estimation and its implementation," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 5, No. 3, pp. 231-236, June 1995.
40. Yunju Baek, Hwang-Soek Oh, and Heung-Kyu Lee, "Block-matching criterion for efficient VLSI implementation for motion estimation," IEE Electronics Letters, Vol. 32, No. 13, pp. 1184-1185, June 1996.
41. S. Lee and S.-I. Chae, "Motion Estimation algorithm using low resolution quantisation," IEE Electronic Letters, Vol. 32, No. 7, pp. 647-648, March 1996.
42. J.R. Jain and A.K. Jain, "Displacement measurement and its application in interframe image coding," IEEE Transactions Commun., Vol. COM-29, pp. 1799-1808, Dec. 1981.
43. R. Li, B. Zeng, and M.L. Liu, "A new three-step search algorithm for block motion estimation," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 4, No. 4, pp. 438-442, Aug. 1994.
44. Lai-Man Po and Wing-chung Ma, "A novel four-step search algorithm for fast blockmatching," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 6, No. 3, pp. 313-317, June 1996.
45. R. Srinivasan and K.R. Rao, "Predictive coding based on efficient motion estimation," IEEE Transactions on Communications, Vol. COM-33, No. 8, pp. 888-896, Aug. 1985.
46. A. Puri, H.M. Hang, and D.L. Schilling, "An efficient block-matching algorithm for motion compensated coding," Proc. IEEE ICASSP, pp. 2.4.1.-25.4.4, 1987.
47. Liang-Gee Chen, Wai-Ting Chen, Yeu-Shen Jehng, and Tzi-Dar Chiueh, "An efficient parallel motion estimation algorithm for digital image processing," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 1, No. 4, pp. 378-385, Dec. 1991.
48. T. Koga, K. Iinuma, A. Hirano, Y. Ijima, and T. Ishiguro, "Motion compensated interframe coding for video conferencing," Proc. NTC 81, pp. C9.6.1-9.6.5.
49. M. Bierling, "Displacement estimation by hierarchical block-matching," SPIE, Vol. 1001, Visual Communications and Image Processing, pp. 942-951, May 1988.
50. Kwon Moon Nam, Joon-Seek Kim Rae-Hong Park, and Young Serk Shim, "A fast hierarchical motion vector estimation algorithm using mean pyramid," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 5, No. 4, pp. 344-351, Aug. 1995.
51. Minhua Zhou, "A fast motion estimation algorithm for MPEG-2 video encoding," Vol. SPIE 3653, Visual Communications and Image Processing, San Jose, pp. 1487-1495, Jan. 1999.
52. B. Liu and A. Zaccarin, "New fast algorithms for the estimation of block motion vectors," IEEE Trans. on Circuits and Systems for Video Technology," Vol. 3, No. 2, pp. 148-157, April 1993.
53. S. Kim, J. Chalidabhongse, and C.-C. Jay Kuo, "A new stochastic block matching algorithm (SBMA) for video coding based on modified 3-step search," ICASSP 96, 1996.
54. Y.-W. Lee, F. Kossentini, M.J.T. Smith, and R. Ward, "Prediction and search techniques for RD-optimized motion estimation in a very low bit rate video coding framework," ICASSP 97, pp. 2861ff, 1997.
55. Jie-Bin Xu, Lai-Man Po, and Chok-Kwan Cheung, "A new prediction model search algorithm for fast block motion estimation," IEEE International Conference on Image Processing, ICIP 97, Santa Barbara, 1997.
56. Joon-Seek Kim and Rae-Hong Park, "A fast feature-based block matching algorithm using integral projections," IEEE Journal on Selected Areas in Communications, Vol. 10, No. 5, pp. 968-971, June 1992.
57. E. Ogura, Y. Ikenaga, Y. Iida, Y. Hosoya, M. Takashima, and K. Yamashita, "A cost effective motion estimation processor LSI using a simple and efficient algorithm," IEEE Transactions on Consumer Electronics, Vol. 41, No. 3, pp. 690-697, Aug. 1995.
58. K. Sauer and B. Schwartz, "Efficient motion estimation using integral projections," Transactions on Circuits and Systems for Video Technology, Vol. 6, No. 5, pp. 513-518, Oct. 1996.
59. Sung Bum Pan, Seung Soo Chae, and Rae-Hong Park, "VLSI architectures for block matching algorithms using systolic arrays," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 6, No. 1, pp. 67-73, Feb. 1996.
60. M.M. Mizuki, U.Y Desai, I. Masaki, and A. Chandrakasan, "A binary block matching architecture with reduced power consumptation and silicon area requirement," ICASSP 96, p. 3249ff, 1996.
61. B. Natarajan, V. Bhaskaran, and K. Konstantinides, "Low-complexity block-based motion estimation via one-bit transforms," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 7, No. 4, pp. 702-706, Aug. 1997.
62. ISO/IEC JTC1/SC29/WG11/MPEG97/M2915, "Momusys implementation of the VM (VM8-971021)," Fribourg, Oct. 1997.
63. P. Kuhn, iprof software available under GNU license terms for Sparc and x86-Linux, email: Peter.Kuhn@computer.org
64. B. Girod, "Motion-compensating prediction with fractional pel accuracy," IEEE Transactions on Communications, Vol. 41, No. 4, pp. 604-612, April 1993.
65. P. Kuhn, G. Diebel, S. Herrmann, A. Keil, H. Mooshofer, A. Karp, R. Mayer, and W. Stechele, "Complexity and PSNR-comparison of several fast motion estimation algorithms for MPEG-4," Vol. SPIE 3460, Applications of Digital Image Processing XXI, San Diego, pp. 486-499, July 1998.
66. S.Y. Kung, VLSI Array Processors, Prentice Hall, Englewood Cliffs, 1988.
67. L. De Vos and M. Stegherr, "Paramaterizable VLSI architectures for the full-search block-matching algorithm," IEEE Trans. Circuits Syst., Vol. 36, pp. 1309-1316, Oct. 1989.
68. T. Komarek and P. Pirsch, "Array architectures for blockmatching algorithms," IEEE Trans. Circuits and Systems, Vol. 36, No. 10, pp. 1301-1308, Oct. 1989.
69. T. Komarek, "VLSI-Architekturen für Displacementschätzverfahren auf der Basis von Blockmatching-Algorithmen," Dissertation, Hannover, 1993, VDI Verlag (in German).
70. L. de Vos, "Dedizierte VLSI-Architekturen für Block Matching Algorithmen," VDI-Verlag, Düsseldorf 1994, Reihe 10 Informatik/Kommunikationstechnik, Nr. 326 (dissertation, in German).
71. L. de Vos and M. Schöbinger, "VLSI architecture for a flexible block matching processor," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 5, No. 5, pp. 417-428, Oct. 1995.
72. Yeu-Shen Jehng, Liang-Gee Chen, and Tzi-Dar Chiueh, "An efficient and simple VLSI Tree architecture for motion estimation algorithms," IEEE Transactions on Signal Processing, Vol. 41, No. 2, pp. 889-900, Feb. 1993.
73. ITU-Telecommunication Standardization Sector-Study Group 16 Video Coding Experts Group: Video Codec Test Model Near Term Version 9.
74. P. Kuhn, U. Niedermeier, L.-F. Chao, and W. Stechele, "A flexible low power VLSI architecture for MPEG-4 motion estimation," Vol. SPIE 3653, Visual Communications and Image Processing, San Jose, pp. 883-894, Jan. 1999.
75. Kun-Min Yang, Ming-Ting Sun, and Lancelot Wu, "A family of VLSI designs for the motion compensation block-matching algorithm," IEEE Transactions on Circuits and Systems, Vol. 36, No. 10, pp. 1317-1325, Oct. 1989.
76. S. Dutta and W. Wolf, "A flexible parallel architecture adapted to block-matching motion-estimation algorithms," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 6, No. 1, pp. 74-86, Feb. 1996.
77. Sheu-Chih Cheng and Hsueh-Ming Hang, "A comparison of block-matching algorithms mapped to systolic-array implementation," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 7, No. 5, pp. 741-757, Oct. 1997.
78. Internet: http://www.sun.com/microelectronics/products/microproc.html
79. U. Niedermeier, "Entwurf einer Multi-Mode Search Engine für MPEG-4," Diplomarbeit at the Technical University of Munich, Germany, Sept. 1998 (in German).