Multiscale modeling and estimation of motion fields for video coding

IEEE Transactions on Image Processing

Volumn 6, Issue 12, 1997, Pages 1606-1620

  Moulin, Pierre ^a,b   Krishnamurthy, Ravi ^c   Woods, John W ^a,d  

^a IEEE   (United States)

^b UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^c SARNOFF CORPORATION   (United States)

^d RENSSELAER POLYTECHNIC INSTITUTE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; COMPUTATIONAL METHODS; COMPUTER SIMULATION; ESTIMATION; FINITE ELEMENT METHOD; IMAGE COMPRESSION; IMAGE RECONSTRUCTION; MATHEMATICAL MODELS; OPTICAL FLOWS; OPTIMIZATION;

COST FUNCTIONS; HORN AND SCHUNK'S CRITERION; MULTISCALE MOTION FIELD ESTIMATION; MULTISCALE MOTION FIELD MODELING; TRIANGLE MOTION COMPENSATION (TMC) METHOD;

IMAGE CODING;

EID: 0031362112     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/83.650115     Document Type: Article

References (47)

1. A. M. Tekalp, Digital Video Processing. Englewood Cliffs, NJ: Prentice-Hall, 1995.
2. P. Anandan, "A computational framework and an algorithm for the measurement of visual motion," Int. J. Comput. Vis., vol. 2, pp. 283-312, 1989.
3. P. Anandan, J. R. Bergen, K. J. Hanna, and R. Hingorani, "Hierarchical model-based motion estimation," in Motion Analysis and Image Sequence Processing, M. I. Sezan and R. L. Lagendijk, Eds. Boston, MA: Kluwer, 1993, pp. 1-22.
4. R. Chin, M. R. Luettgen, W. C. Karl, and A. S. Willsky, "An estimation-theoretic perspective on image processing and the calculation of optical flow," in Motion Analysis and Image Sequence Processing, M. I. Sezan and R. L. Lagendijk, Eds. Boston, MA: Kluwer, 1993, pp. 23-52.
5. H. Li, A. Lundmark, and R. Forchheimer, "Image sequence coding at very low bitrates: A review," IEEE Trans. Image Processing, vol. 3, pp. 589-609, 1994.
6. C. Stiller and D. Lappe, "Gain/Cost controlled displacement-estimation for image sequence coding," in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Processing, 1991, vol. 4, pp. 2729-2732.
7. T. Ebrahimi, "A new technique for motion field segmentation and coding for very low bitrate video coding applications," in Proc. IEEE Int. Conf. Image Processing, Austin, TX, vol. II, pp. 433-437, 1994.
8. H. Brusewitz, "Motion compensation with triangles," in Proc. 3rd Int. Conf. on 64 kbit Coding of Moving Video, Rotterdam, The Netherlands, Sept. 1990.
9. Y. Nakaya and H. Harashima, "An iterative motion estimation method using triangular patches for motion compensation," SPIE, vol. 1605, pp. 546-557, 1991.
10. K. Aizawa and T. S. Huang, "Model-based coding: Advanced video coding techniques for very low bit-rate applications," in Proc. IEEE, vol. 83, pp. 259-271, Feb. 1995.
11. G. Sullivan and R. L. Baker, "Motion compensation for video compression using control grid interpolation," in Proc. ICASSP'91, 1991, pp. 2713-2716.
12. M. H. Chan, Y. B. Yu, and A. G. Constantinides, "Variable size block matching motion compensation with applications to video coding," Proc. Inst. Elect. Eng., vol. 137, pp. 205-212, Aug. 1990.
13. F. Dufaux and F. Moscheni, "Motion estimation techniques for digital TV: A review and a new contribution," in Proc. IEEE, vol. 83, pp. 858-876, June 1995.
14. M. T. Orchard, "Predictive motion-field segmentation for image sequence coding," IEEE Trans. Circuits Syst. Video Technol., vol. 3, pp. 54-70, Feb. 1993.
15. C.-L. Huang and C.-Y. Hsu, "A new motion compensation method for image sequence coding using hierarchical grid interpolation," IEEE Trans. Circuits Syst. Video Technol., vol. 4, pp. 42-51, Feb. 1994.
16. J.-R. Ohm, "Motion-compensated 3-D subband coding with multiresolution representation of motion parameters," in Proc. IEEE Int. Conf. Image Processing, Austin, TX, 1994, vol. II, pp. 250-254.
17. Y. Altunbasak, A. M. Tekalp, and G. Bozdagi, "Two-dimensional object-based coding using a content-based mesh and affine motion parameterization," in Proc. IEEE Int. Conf. Image Processing, Arlington, VA, Oct. 1995, vol. II, pp. 394-397.
18. H. Zheng and S. D. Blostein, "Motion-based object segmentation and estimation using the MDL principle," IEEE Trans. Image Processing, vol. 4, pp. 1223-1235, Sept. 1995.
19. C. Stiller, "Object-oriented video coding employing dense motion fields," in Proc. ICASSP, Adelaide, Australia, 1994, pp. V.273-276.
20. B. K. P. Horn and B. Schunck, "Determining optical flow," Artif. Intell., vol. 17, pp. 185-203, 1981.
21. H.-H. Nagel, "On the estimation of optical flow: Relations between different approaches and some new results," Artif. Intell., vol. 33, pp. 299-324, 1987.
22. J. L. Barron, D. J. Fleet, and S. S. Beauchemin, "Performance of optical flow techniques," Int. J. Comput. Vis., vol. 12, pp. 43-77, 1994.
23. M. Nickel and J. H. Husøy, "A hybrid coder for image sequences using detailed motion estimates," in Proc. SPIE Conf. Visual Communications and Image Processing, Boston, MA, 1991, pp. 963-971.
24. J. N. Driessen, "Motion estimation for digital video," Ph.D. dissertation, Delft Univ. Technol., Delft, The Netherlands, 1992.
25. J. Rissanen, Stochastic Complexity in Statistical Inquiry. Singapore: World Scientific, 1989.
26. M. Vetterli and J. Kovačević, Wavelets and Subband Coding. Englewood Cliffs, NJ: Prentice-Hall 1995.
27. R. A. DeVore, B. Jawerth, and V. Popov, "Compression of wavelet decompositions," Amer. J. Math., vol. 114, pp. 737-785, 1992.
28. R. A. DeVore and B. Lucier, "Classifying the smoothness of images: Theory and applications to wavelet image processing," in Proc. IEEE Int. Conf. Image Processing, Austin, TX, pp. II.6-10.
29. H. Yserentant, "On the multilevel splitting of finite-element spaces," Numer. Math., vol. 49, pp. 379-412, 1986.
30. P. Moulin, "An adaptive finite-element method for image representation," in Proc. IEEE Int. Conf. Pattern Recognition, The Hague, The Netherlands, Sept. 1992, pp. III.70-74.
31. _, "A multiscale relaxation algorithm for SNR maximization in nonorthogonal subband coding," IEEE Trans. Image Processing, vol. 4, pp. 1269-1281, Sept. 1995.
32. E. Simoncelli, "Distributed representation and analysis of visual motion," Ph.D. dissertation, Dept. Electr. Eng. Comput. Sci., Mass. Inst. Technol., Cambridge, 1993. Available by anonymous ftp from whitechapel.mit.edu.
33. _, "Coarse-to-fine estimation of visual motion," in Proc. 8th IEEE Workshop on Image and Multidimsional Signal Processing, Cannes, France, 1993, pp. 128-129.
34. S. H. Hwang and S. U. Lee, "A hierarchical optical flow estimation algorithm based on the interlevel motion smoothness constraint," Pattern Recognit., vol. 26, pp. 939-952, 1993.
35. E. H. Adelson, E. Simoncelli, and R. Hingorani, "Orthogonal pyramid transforms for image coding," in Proc. SPIE Conf. VCIP, 1987, pp. 50-58.
36. R. Szeliski, "Fast surface interpolation using hierarchical basis functions," IEEE Trans. Pattern Anal. Machine Intell., vol. 12, pp. 513-528, 1990.
37. J. V. Gísladóttir and M. T. Orchard, "Motion-only video coding," in Proc. IEEE Int. Conf. Image Processing, Austin, TX, 1994, pp. I.730-734.
38. Y. Y. Lee and J. W. Woods, "Motion vector quantization for video coding," IEEE Trans. Image Processing, vol. 4, pp. 378-382, Mar. 1995.
39. D. Terzopoulos, "Image relaxation using multigrid relaxation methods," IEEE Trans. Pattern Anal. Machine Intell., vol. 8, pp. 129-139, 1986.
40. W. L. Briggs, A Multigrid Tutorial. Philadelphia, PA: SIAM, 1987.
41. F. Heitz, P. Perez, and P. Bouthemy, "Multiscale minimization of global energy functions in some visual recovery problems," Comput. Vis., Graph. Image Processing: Image Understand., vol. 59, pp. 125-134, Jan. 1994.
42. J. K. Kearney, W. B. Thompson, and D. L. Boley, "Optical flow estimation: An error analysis of gradient-based methods with local optimization," IEEE Trans. Pattern Anal. Machine Intell., pp. 229-244, 1987.
43. F. Glazer, "Multilevel relaxation in low-level computer vision," in Multiresolution Methods for Image Processing and Analysis, A. Rosenfeld, Ed. New York: Springer-Verlag, 1984, pp. 312-330.
44. P. J. Burt and E. H. Adelson, "The Laplacian pyramid as a compact image code," IEEE Trans. Commun., vol. COMM-31, pp. 532-540, 1983.
45. R. M. Witten, I. H. Neal, and J. G. Cleary, "Arithmetic coding for data compression," Commun. ACM, vol. 30, pp. 520-540, June 1987.
46. R. Krishnamurthy, P. Moulin, and J. W. Woods, "Multiscale motion estimation for scalable video coding," in Proc. IEEE Int. Conf. Image Processing, Lausanne, Switzerland, Sept. 1996, vol. I, pp. 965-968.
47. P. Moulin, G. Lilienfeld, A. Ogielski, and J. W. Woods, "Video signal processing and coding on data-parallel computers," Digital Signal Processing: A Review Journal, vol. 5, pp. 118-129, Apr. 1995.