Motion Estimation Methods for Video Compression - A Review

Journal of the Franklin Institute

Volumn 335, Issue 8, 1998, Pages 1411-1441

  Tabatabai, Ali J ^a   Jasinschi, Radu S ^a   Naveen, T ^a  

^a TEKTRONIX INC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BANDWIDTH; DIGITAL SIGNAL PROCESSING; IMAGE ANALYSIS; MULTIMEDIA SYSTEMS; TELECOMMUNICATION SERVICES; VIDEO SIGNAL PROCESSING;

MOTION ESTIMATION METHODS;

IMAGE COMPRESSION;

EID: 0032210476     PISSN: 00160032     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0016-0032(98)00007-6     Document Type: Review

References (117)

1. Haskell, B. G., Mounts, F. W. and Candy, J. C., Interframe coding of videotelephone pictures. Proceedings of the IEEE, 1972, 60(7), 792-800.
2. Huang, T. S., Image Sequence Processing and Dynamic Scene Analysis. New York, NY: Springer-Verlag, 1983.
3. Horn, B. K. P., Robot Vision. Cambridge, MA: The MIT Press, 1986.
4. Aggarwal, J. K. and Nandhakumar, N., On the computation of motion from sequences of images-a review. Proceedings of the IEEE, 1988, 76(8), 917-935.
5. Nagel, H. H., Image sequences - ten (octal) years: From phenomenology towards a theoretical foundation. In Proc. 8th International Conference on Pattern Recognition, pp. 1174-1185, Oct. 1986.
6. Musmann, H. G., Pirsch, P. and Grallert, H. J., Advances in picture coding. Proceedings of the IEEE, 1985, 73(4), 523-548.
7. Driessen, J. N., Motion Estimation for Digital Video. PhD thesis, Delft University of Technology, Delft, The Netherlands, 1992.
8. Jain, A. K., Image data compression: A review. Proceedings of the IEEE, 1981, 69(3), 349-389.
9. Aizawa, K., Harashima, H. and Saito, T., Model-based analysis synthesis image coding for a person's face. Signal Processing: Image Communie., 1989, 1(2), 139-152.
10. Huang, T. S., Reddy, S. C. and Aizawa, K., Human facial motion modeling, analysis and synthesis for video compression. Proc. SPIE Conf. Visual Communications and Image Process., Vol. SPIE 1605, pp. 234-241, Nov. 1991.
11. Spetsakis, M. and Aloimonos, J. Y., A multi-frame approach to visual motion perception. International Journal of Computer Vision, 1991, 6(3), 245-255.
12. Longuett-Higgins, H. C. A computer algorithm for reconstructing a scene for two projections. Nature, 1981, 293, 133-135.
13. Tsai, R. Y. and Huang, T. S., Uniqueness and estimation of three-dimensional motion parameters of rigid objects with curved surfaces. IEEE Trans. Pattern Analysis and Machine Intelligence, 1984, 6(1), 13-40.
14. Aloimonos, J. Y., Perspective approximations. Image and Vision Computing, 1990, 8, 179-192 Aug.
15. Tekalp, A. M., Digital Video Processing. Upper Saddle River, NJ: Prentice Hall PTR, 1995.
16. Netravali, A. N. and Haskell, B. G., Digital Pictures: Representation and Compression. New York, NY: Plenum Press, 1988.
17. Jain, A. K., Fundamentals of Digital Image Processing. Englewood Cliffs, NJ: Prentice Hall, 1989.
18. Lim, J. S., Two-Dimensional Signal and Image Processing. Englewood Cliffs, NJ: Prentice-Hall, 1990.
19. Papadopoulos, C. A. and Clarkson, T. G., Motion compensation using second-order geometric transformations. IEEE Trans. Circuits and Systems for Video Technology, 1995, 5 Aug., 319-331.
20. Mann, S. and Picard, R. W., Video orbits of the projective group: A new perspective on image mosaicing, submitted to IEEE Trans. Image Processing. Also available as TR-338 from http://www.white.media.mit.edu/vismod/cgi-bin/tr_pagemaker, 1995.
21. Srinivasan, R. and Rao, K. R., Predictive coding based on efficient motion estimation. IEEE Trans. Commun., 1985 Aug., COM-33, 888-896.
22. Chen, M.-J., Chen, L.-G., Chiueh, T.-D. and Lee, Y.-P., A new block-matching criterion for motion estimation and its implementation. IEEE Trans. Circuits and Systems for Video Technology, 1995 June, 5, 231-236.
23. Sayrol, E., Gasull, A. and Fonollosa, J. R., Motion estimation using higher order statistics. IEEE Trans. Image Process., 1996 June, 5, 1077-1084.
24. Flusser, J., An adaptive method for image registration. Pattern Recognition, 1992, 25, 45-54.
25. Wang, Y. and Lee, O., Adaptive mesh: A feature seeking and tracking image sequence representation scheme. IEEE Trans. Image Process., 1994 Sept., 3, 610-624.
26. Huang. C.-L. and Hu, C.-Y., A new motion compensation method for image sequence coding using hierarchical grid interpolation. IEEE Trans. Circuits and Systems for Video Technology, 1994 Feb., 4, 42-52.
27. Wang, Y. and Lee, O., Use of two-dimensional deformable mesh structures for video coding, Part I - the synthesis problem: Mesh-based function approximation and mapping. IEEE Trans. Circuits and Systems for Video Technology, 1996 Dec., 6, 636-646.
28. Wang, Y., Lee, O. and Vetro, A., Use of two-dimensional deformable mesh structures for video coding, Part II - the analysis problem and a region-based coder employing an active mesh representation. IEEE Trans. Circuits and Systems for Video Technology, 1996 Dec., 6, 647-659.
29. Nakaya, Y. and Harashima, H., An iterative motion estimation method using triangular patches for motion compensation. Proc. SPIE Conf. Visual Communications and Image Process., 1991, 1605, 546-557.
30. Sullivan, G. J. and Baker, R. L., Motion compensation for video compression using control grid interpolation. Proc. IEEE ICASSP, pp. 2713-2716, 1991.
31. Brusewitz, H., Motion compensation with triangles, in Proc. 3rd Int. Conf. on 64 kbit Coding of Moving Video, (Rotterdam, The Netherlands), Sept. 1990.
32. Altunbasak, Y., Tekalp, A. M. and Bozdagi, G., Two-dimensional object-based coding using a content-based mesh and affine motion parameterization, in Proc. IEEE International Conference on Image Processing, vol. II, Washington, DC, 1995 Oct., pp. 394-397.
33. ISO/IEC 11172-2, Information technology - Coding of moving pictures and associated audio for digital storage media at up to about 1.5 Mbit/s - Part 2. International Organisation for Standardisation, Jan. 1993. International Standard (MPEG-1 Video).
34. ISO/IEC 13818-2, Generic Coding of Moving Pictures and Associated Audio Information: Video. International Organisation for Standardisation, Jan. 1995. International Standard (MPEG-2 Video).
35. ITU-T, Recommendation H.261, Video coding for audiovisual services at p × 64 kbit/s. Telecommunication Standardization Sector of International Telecommunication Union (ITU-T), Aug. 1990.
36. Draft ITU-T Recommendation H.263, Video coding for low bitrate communication. Telecommunication Standardization Sector of International Telecommunication Union (ITU-T), Oct. 1995.
37. Chan, M. H., Yu, Y. B. and Constantinides, A. G., Variable size block matching motion compensation with applications to video coding. IEE Proceedings, 1990 Aug., 137, 205-212.
38. Orchard, M. T. and Sullivan, G. J., Overlapped block motion compensation: An estimation-theoretic approach. IEEE Trans. Image Process., 1994 Sept., 3, 693-669.
39. Gersho, A. and Gray, R. M., Vector Quantization and Signal Compression. Norwell, MA: Kluwer Academic Publishers, 1992.
40. Huang, X.-M., Bi, Q., Stiles, G. S. and Harris, R. W., Fast full search equivalent encoding algorithm for image compression using vector quantization. IEEE Trans. Image Process., 1992 July, 1, 413-416.
41. Liu, B. and Zaccarin, A., New fast algorithms for the estimation of block motion vectors. IEEE Trans. Circuits and Systems for Video Technology, 1993 Apr., 3, 148-157.
42. Lee, L.-W., Wang, J.-F., Lee, J.-Y. and Shie, J.-D., Dynamic search-window adjustment and interlaced search for block-matching algorithm. IEEE Trans. Circuits and Systems for Video Technology, 1993 Feb., 3, 85-87.
43. Li, R., Zeng, B. and Liou, M. L., A new three-step search algorithm for block motion estimation. IEEE Trans. Circuits and Systems for Video Technology, 1994 Aug., 4, 438-442.
44. Jong, H.-M., Chen. L.-G. and Chiueh, T.-D., Accuracy improvement and cost reduction of 3-step search block matching algorithm for video coding. IEEE Trans. Circuits and Systems for Video Technology, 1994 Feb., 4, 88-90.
45. Pan, S. B., Chae, S. S. and Park, R.-H., VLSI architectures for block matching algorithms using systolic arrays. IEEE Trans. Circuits and Systems for Video Technology, 1996 Feb., 6, 67-73.
46. Po, L.-M. and Ma, W.-C., A novel four-step search algorithm for fast block motion estimation. IEEE Trans. Circuits and Systems for Video Technology, 1996 June, 6, 313-317.
47. Ghanbari, M., The cross-search algorithm for motion estimation. IEEE Trans. Commun., 1990 July, 7, 950-953.
48. Gharavi, H. and Mills, M., Block-matching motion estimation algorithms: New results. IEEE Trans. Circuits and Systems, 1990, 37, 649-651.
49. Liu, L.-K. and Feig, E., A block-based gradient descent search algorithm for block motion estimation in video coding. IEEE Trans. Circuits and Systems for Video Technology, 1996 Aug., 6, 419-422.
50. Chow, K. H.-K. and Liou, M. L., Genetic motion search algorithm for video compression. IEEE Trans. Circuits and Systems for Video Technology, 1993 Dec., 3, 440-445.
51. Glazer, F., Reynolds, G. and Anandan, P., Scene matching by hierarchical correlation, in Proc. IEEE Computer Vision and Pattern Recognition Conf., Washington, DC, June 1983.
52. Bierling, M. and Thoma, R., Motion compensating field interpolation using a hierarchically structured displacement estimator. Signal Processing, 1986 Nov., 387-404.
53. Lee, X. and Zhang, T.-Q., A fast hierarchical motion-compensation scheme for video coding using block feature matching. IEEE Trans. Circuits and Systems for Video Technology, 1996 Dec., 6, 627-635.
54. Nam, K. M., Kim. J.-S., Park, R.-H. and Shim. Y. S., A fast hierarchical motion vector estimation algorithm using mean pyramid. IEEE Trans. Circuits and Systems for Video Technology, 1995 Aug., 5, 344-351.
55. Hang, H.-M. and Chou, Y.-M., Motion estimation for image sequence compression, in Handbook of visual communications ed. J. W. Woods and H.-M. Hang. Sandiego, CA: Academic Press, 1995, pp. 147-188.
56. Heeger, D. J., Model for the extraction of image flow. J. Opt. Soc. Am. A, 1988 Aug., 4, 1455-1471.
57. Jacobson, L. and Wechler, H., Derivation of optical flow using a spatio-temporal frequency approach. Computer Vision Graph. Image Processing, 1987, 38, 57-61.
58. Stuller, J. A. and Netravali, A. N., Transform domain motion estimation. The Bell. System Technical Journal, vol. 58, pp. 1673-1702, Sept. 1979.
59. Kuglin, C. D. and Hines, D. C., The phase correlation image alignment method, in Proceedings of IEEE International Conference on Cybernetics Society, San Franscisco, 1975 Sept., pp. 163-165.
60. Haskell, B. G., Frame-to-frame coding of television pictures using two-dimensional Fourier transforms. IEEE Trans. Inform. Theory, 1974 Jan., IT-20, 119-120.
61. Girod, B. and Kuo, D., Direct estimation of displacement histograms. Image Understanding and Machine Vision, vol. 14, pp. TuB3-1-TuB3-4, July 1989. OSA 1989 Tech. Dig. Series.
62. Thomas, G. A. and Hons, B. A., Television motion measurement for DATV and other applications, Tech. Rep. BBC-RD-1987-11, BBC, 1987.
63. Jasinschi, R. S., Energy filters, motion uncertainty and motion sensitive cells in the visual cortex: a mathematical analysis. Biological Cybernetics, 1995, no. 65, 515-523.
64. Jasinschi, R. S., Intrinsic constraints in space-time filtering: A new approach to representing uncertainty in low-level vision. IEEE Trans. Pattern Analysis and Machine Intelligence, 1992 Mar., 14, 353-366.
65. Bertero, M., Poggio, T. A. and Torre, V., Ill-posed problems in early vision. Proceedings of IEEE, 1988 Aug., 76, 869-889.
66. Horn, B. K. P. and Schunck, B. G., Determining optical flow. Artificial Intelligence, 1981, 17, 185-203.
67. Fleet, D. and Jepson, A., On the hierarchical construction of orientation and velocity selective filter, Tech. Rep. RBCV-T-85-8, University of Toronto, 1985.
68. Lucas, B. and Kanade, T., An iterative image registration technique with an application in stereo vision, in Proceedings of IJCAI-81, 1981, pp. 674-679.
69. Hildreth, E., Computations underlying the measurement of visual motion. Artificial Intelligence, 1984, 23(3), 309-354.
70. Ahumada, A. and Watson, A., A model of human visual-motion sensing. J. Opt. Soc. Am., 1985, 2, 322-342.
71. Adelson, E. and Bergen, J., Spatiotemporal energy models for the perception of motion. J. Opt. Soc. Am., 1985, 2, 284-299.
72. Heeger, D., A model for the extraction of image flow. J. Opt. Soc. Am, 1987, 4, 1455-1471.
73. Fleet, D. and Jepson, A., Computation of component image velocity from local phase information. International Journal of Computer Vision, 1990, 5(1), 77-104.
74. Beauchemin, S. S. and Barron, J. L., The computation of optical flow. ACM Computing Surveys, 1995 Sept., 27, 433-467.
75. Netravali, A. N. and Robbins, J. D., Motion compensated television coding. Bell. System Technical Journal, 1979 Mar., 53, 631-670.
76. Walker, D. R. and Rao, K. R., Improved pel-recursive motion compensation. IEEE Trans. Commun., 1984 Oct., COM-32, 1128-1134.
77. Biemond, J., Driessen, J. N., Geurtz, A. M. and Boekee, D. E., A pel-recursive Wiener based algorithm for the simultaneous estimation of rotation and translation. Proc. SPIE Conf. Visual Communications and Image Process., 1988 Nov., pp. 917-924.
78. Papoulis, A., Probability, Random Variables, and Stochastic Processes. New York, NY: McGraw-Hill Book Company, 1984.
79. Heitz, F. and Bouthemy, P., Multimodal estimation of discontinuous optical flow using Markov random fields. IEEE Trans. Pattern Analysis and Machine Intelligence, 1993 Dec., 15, 1217-1232.
80. Abdelqader, I. M., Rajala, S. A., Snyder, W. E. and Bilbro, G. L., Energy minimization approach to motion estimation. Signal Processing, 1992 Sept., 28, 291-309.
81. Konrad, J. and Dubois, E., Bayesian estimation of motion vector fields. IEEE Trans. Pattern Analysis and Machine Intelligence, 1992 Sept., 14, 910-927.
82. Stiller, C. and Huertgen, B., Combined displacement estimation and segmentation in image sequences. Proc. Video Communications and PACSfor Medical Applications, 1993, SPIE 1977, pp. 276-297.
83. Besag, J., Nearest-neighbor systems and the auto-logistic model for binary data. J. Royal Statist. Soc., 1972, 34, 75-83.
84. Marroquin, J., Mitter, S. K. and Poggio, T., Probabilistic solution of ill-posed problems in computational vision. J. Am. Stat. Soc., 1987, 82, 76-89.
85. Besag, J., On the statistical analysis of dirty pictures. J. Royal Statist. Soc., 1986, 48(3), 259-302.
86. Yuille, A. L. and Bulthoff, H., Stereo integration, mean field theory and psychophysics, in Proc. First European Conference on Computer Vision, Antibes, France, 1990 Apr., pp. 73-82.
87. Blake, A. and Zisserman, A., Visual Reconstruction. Cambridge, MA: The MIT Press, 1987.
88. Chou, P. B. and Brown, C. M., The theory and practice of Bayesian image modeling. International Journal of Computer Vision, 1990, 4, 185-210.
89. Stiller, C., Object-oriented video coding employing dense motion fields, in Proc. IEEE ICASSP, 1994, V, 273-276.
90. Chang, M., Sezan, I. and Tekalp, A. M., An algorithm for simultaneous motion estimation and scene segmentation, in Proc. IEEE ICASSP, 1994, V, 221-224.
91. Han, S.-C., Boroczky, L. and Woods, J. W., Joint motion estimation/segmentation for object-based video coding, in Signal Processing VIII: Theories and Applications, Vol. 2, Trieste, Italy: EUSIPCO, Elsevier Press, 1996 Sept., pp. 1075-1078.
92. Burt, P. J. and Adelson, E. H., The Laplacian pyramid as a compact image code. IEEE Trans. Commun., 1983 Apr., 31, 532-540.
93. Gupta, G. and Chakrabarti, C., Architectures for hierarchical and other block matching algorithms. IEEE Trans. Circuits and Systems for Video Technology, 1995 Dec., 5, 477-489.
94. Girod, B., Motion-compensating prediction with fractional-pel accuracy. IEEE Trans. Commun., 1993 Apr., 41, 604-612.
95. Test Model Editing Committee, Test Model 5 (Draft). International Organisation for Standardisation, ISO/IEC/JTC1/SC29/WG11/N0400, Apr. 1993.
96. Li, X. and Gonzales, C., A locally quadratic model of the motion estimation error criterion function and its application to subpixel interpolations. IEEE Trans. Circuits and Systems for Video Technology, 1996 Feb., 6, 118-122.
97. Naveen, T., Fractional pixel motion estimation of video signals. U.S. Patent 5,623,313, 1997 Apr.
98. Faugeras, O. and Lustmann, F., Motion and structure from motion in a piecewise planar environment. International Journal of Pattern Recognition and Artificial Intelligence, 1988, 2(3), 485-508.
99. Hartley, R. I., In defense of the eight-point algorithm. IEEE Trans. on Pattern Analysis and Machine Intelligence, 1997, 19, 580-593.
100. Horn, B. K. P. and Weldon, E. J., Direct methods for recovery motion. The International Journal of Computer Vision, 1988, 2(1), 51-76.
101. Nagel, H. H., Representation of moving rigid objects based on visual observations. IEEE Computer, 1981, 14(8), 29-38.
102. Prazdny, K., Motion and structure from optical flow, in Proc. of the Intern. Joint Conf. on Artificial Intelligence, Tokyo, Japan, 1979, pp. 702-704.
103. Shashua, A., Algebraic functions for recognition. IEEE Trans. Pattern Analysis and Machine Intelligence, 1994 Aug., 17, 779-789.
104. Ullman, S., The Interpretation of Visual Motion. Cambridge, MA: The MIT Press, 1979.
105. Faugeras, O., Three-Dimensional Computer Vision: A Geometric Point of View. Cambridge, MA: The MIT Press, 1993.
106. Aizawa, K. and Huang, T. S., Model-based image coding: Advanced video coding techniques for very low bit-rate applications. Proceedings of the IEEE, 1995 Feb., 83, 259-271.
107. Bozdagi, G., Tekalp, A. M. and Onural, L., 3-D motion estimation and wireframe adaptation including photometric effects for model-based coding of facial image sequences. IEEE Trans. Circuits and Systems for Video Technology, 1994 Sept., 4, 246-256.
108. Choi, C. S., Aizawa, K., Harashima, H. and Takabe, T., Analysis and synthesis of facial image sequences in model-based image coding. IEEE Trans. Circuits and Systems for Video Technology, 1994 Sept., 4, 257-275.
109. Zhang, L., Tracking a face for knowledge-based coding of videophone sequences. Image-Communication, 1997 July, 10, 93-114.
110. Ekman, P. and Friesen, W. V., Facial Action Coding System. Consulting Psychologist Press, 1977.
111. Chiariglione, L., MPEG and multimedia communications. http://drogo.cselt.stet.it/ufv/ leonardo/paper/isce96.html, 1997.
112. SNHC Editing Committee, Synthetic and Natural Hybrid Coding: Verification Model 6.0. International Organisation for Standardisation. ISO/IEC JTC1/SC29/WG11/N1891, Oct. 1997.
113. Moezzi, S., Immersive telepresence. IEEE Multimedia, 1997 Jan., 4, 17.
114. ISO/IEC 14496-2, Information Technology - Coding of Audio-Visual Objects: Visual. International Organisation for Standardisation, Committee Draft (MPEG-4 Visual), Oct. 1997.
115. Lee, Y. Y. and Woods, J. W., Motion vector quantization for video coding. IEEE Trans. Image Process, 1995 Mar., 4, 378-382.
116. Moulin, P. and Krishnamurthy, R., Multiscale modeling and estimation of motion fields for video coding, To appear in IEEE Trans, on Image Processing. Currently available at http://cipr.rpi.edu/publications/publications.html, 1997.
117. Geman, S. and Geman, D., Stochastic relaxation, Gibbs distribution, and Bayesian restoration of images. IEEE Trans. Pattern Analysis and Machine Intelligence, 1984 Nov., 4, 721-741.