Efficient Multiscale Regularization with Applications to the Computation of Optical Flow

IEEE Transactions on Image Processing

Volumn 3, Issue 1, 1994, Pages 41-64

  Luettgen, Mark R ^a   Karl, W Clem ^b   Willsky, Alan S ^b  

^a BAE SYSTEMS   (United Kingdom)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL COMPLEXITY; COMPUTATIONAL METHODS; CONSTRAINT THEORY; DIFFERENTIAL EQUATIONS; IMAGE ANALYSIS; IMAGE CODING; IMAGE QUALITY; IMAGE RECONSTRUCTION; IMAGING TECHNIQUES; OPTICAL FLOWS;

ELLIPTIC PARTIAL DIFFERENTIAL EQUATION; MULTISCALE ERROR COVARIANCE INFORMATION; MULTISCALE REGULARIZATION; SMOOTHNESS CONSTRAINT;

IMAGE PROCESSING;

EID: 0028204562     PISSN: 10577149     EISSN: 19410042     Source Type: Journal    
DOI: 10.1109/83.265979     Document Type: Article

References (53)

1. J. Aggarwal and N. Nandhakumar, “On the computation of motion from sequences of images—a review,”Proc. IEEE, vol. 76, pp. 917–935, 1988.
2. N. Baaziz and C. Labit, “Multigrid motion estimation on pyramidal representations for image sequence coding,” Technical Report 572, IRISA, Feb. 1991.
3. J. Barron, D. Fleet, S. Beauchemin, and T. Burkitt, “Performance of optical flow techniques,” in Proc. IEEE Comput. Vision Pattern Recognition Conf., 1992, pp. 236–242.
4. M. Basseville and A. Benveniste, Detection of Abrupt Changes in Signals and Dynamical Systems, vol. 77 of Lecture Notes in Control and Information Sciences. New York: Springer-Verlag, 1986.
5. M. Bertero, T. Poggio, and V. Torre, “III posed problems in early vision,” Proc. IEEE, vol. 76, pp. 869–889, 1988.
6. P. Burt and E. Adelson, “The Laplacian pyramid as a compact image code,” IEEE Trans. Commun., vol. 31, pp. 482–540, 1983.
7. T. Chin, “Dynamic estimation in computational vision,” Ph.D. dissertation, Dept. Elec. Eng. and Comput. Sci., M.I.T., Cambridge, 1991.
8. T. M. Chin, W. Karl, and A. Willsky, “Sequential optical flow estimation using temporal coherence,” Tech. Rep. LIDS-P-2122, Laboratory for Information and Decision Systems, M.I.T., Cambridge, 1992, submitted to IEEE transactions on image processing.
9. K. C. Chou, “A Stochastic modeling approach to multiscale signal processing,” Ph.D. dissertation. Dept. Elec. Eng. and Comput. Sci., M.I.T., Cambridge, May 1991.
10. K. C. Chou, A. S. Willsky, and A. Benveniste, “Multiscale recursive estimation, data fusion and regularization,” Tech. Rep. LIDS-P-2085, Laboratory for Information and Decision Systems, M.I.T., Cambridge, 1991.
11. K. C. Chou, A. S. Willsky, A. Benveniste, and M. Basseville, “Recursive and iterative estimation algorithms for multiresolution stochastic processes,” in Proc. IEEE Conf. Decision and Control, 1989.
12. K. C. Chou, A. S. Willsky, and R. Nikoukhah, “Multiscale systems, Kalman filters and Riccati equations,” Tech. Rep. LIDS-P-2152, Laboratory for Information and Decision Systems, M.I.T., Cambridge, 1992.
13. S. C. Clippingdale and R. G. Wilson, “Least squares image estimation on a multiresolution pyramid,” in Proc. Int. Conf. Acoust., Speech, Signal Processing, 1989.
14. W. Enkelmann, “Investigations of multigrid algorithms for the estimation of optical flow fields in image sequences,” Int. J. Comput. Vision, vol. 43, pp. 150–177, 1990.
15. D. Fleet and A. Jepson, “Computation of component image velocity from local phase information,” Int. J. Comput. Vision, vol. 5, pp. 77–104, 1990.
16. N. Haddadi and C. C. Jay Kuo, “Computation of dense optical flow fields with a parametric smoothness model,” Tech. Rep. USC SIPI 233, USC Signal and Image Processing Institute, 1992.
17. D. Heeger and E. Simoncelli, “Sequential motion analysis,” in Proc. AAAI Robot Navigation Symp., Mar. 1989.
18. F. Heitz and P. Bouthemy, “Multimodal estimation of discontinuous optical flow using Markov random fields,” Tech. Rep. 561, Programme 6, IRISA, Jan. 1991.
19. B. K. P. Horn and B. Schunck, “Determining optical flow,” Artificial Intell., vol. 17, pp. 185–203, 1981.
20. J. Konrad and E. Dubois, “Estimation of image motion fields: Bayesian formulation and stochastic solution,” in Proc. IEEE Int. Conf. Acoust., Speech, Signal Processing, 1988, pp. 1072–1074.
21. C.-C. J. Kuo, B. C. Levy, and B. R. Musicus, “A local relaxation method for solving elliptic pde's on mesh connected arrays,” SIAM J. Sci. Stat. Comput., vol. 8, pp. 550–573, 1987.
22. M. Laurentev, V. Romanov and S. Shishat-skii, III-Posed Problems of Mathematical Physics and Analysis. American Mathematical Society, 1986.
23. M. Luettgen, “Image processing with multiscale stochastic models,” Ph.D. dissertation. Dept. Elec. Eng. Comput. Sci., M.I.T., Cambridge, May 1993.
24. S. Mallat, “Multi-frequency channel decomposition of images and wavelet models,” IEEE Trans. Acoust., Speech, Signal Processing, vol. 37, pp. 2091–2110, 1989.
25. B. Mandelbrot and H. Van Ness, “Fractional Brownian motions, fractional noises and applications,” SIAM Rev., vol. 10, pp. 422–436, Oct. 1968.
26. A. Mariano, “Contour analysis: A new approach for melding geophysical fields,” J. Atmospheric, Oceanic Technol., vol. 7, pp. 287–295, 1990.
27. D. Mumford and J. Shah, “Optimal approximation by piecewise smooth functions and associated variational problems,” Tech. Rep. CICS-P-88, Center for Intelligent Control Systems, 1988.
28. D. Murray and B. Buxton, “Scene segmentation from visual motion using global optimization,” IEEE Trans. Pattern Anal., Intell., vol. 9, pp. 220–228, 1987.
29. H. Nagel and W. Enkelmann, “An investigation of smoothness constraints for the estimation of displacement vector fields from image sequences,” IEEE Trans. Pattern Analysis, Mach. Intell., vol. 8, pp. 565–593, 1986.
30. A. Netravali and J. Robbins, “Motion-compensated television coding: Part I,” Bell System Tech. J., vol. 58, pp. 631–670, 1979.
31. R. Pool, “Making 3-D movies of the heart,” Sci., vol. 251, pp. 28–30, 1991.
32. P. Prenter, Splines and Variational Methods. New York: Wiley, 1975.
33. J. Prince and E. McVeigh, “Motion estimation from tagged MR image sequences,” IEEE Trans. Medical Imaging, vol. 11, pp. 238–249, 1992.
34. D. Raviv, “A quantitative approach to camera fixation,” in Proc. IEEE Conf. Comput. Vision, Pattern Recognition (Maui, HI), 1991.
35. A. Rougee, B. Levy, and A. S. Willsky, “An estimation-based approach to the reconstruction of optical flow,” Tech. Rep. LIDS-P-1663, Laboratory for Information and Decision Systems, M.I.T., Cambridge, 1987.
36. A. Rougée, B. Levy, and A. S. Willsky, “Reconstruction of two-dimensional velocity fields as a linear estimation problem,” in Proc. 1st Int. Conf. Comput. Vision, 1987, pp. 646–650.
37. J. Schroter and C. Wunsch, “Solution of nonlinear finite difference ocean models by optimization methods with sensitivity and observational strategy analysis,” J. Physical Oceanography, vol. 16, pp. 1855–1874, 1986.
38. A. Shio and J. Sklansky, “Segmentation of people in motion,” in Proc. IEEE Workshop Visual Motion (Princeton NJ), 1991, pp. 325–332.
39. E. Simoncelli, E. Adelson, and D. Heeger, “Probability distributions of optical flow,” in IEEE Conf. Comput. Vision and Pattern Recognition (Maui, HI), June 1991.
40. A. Singh, “Incremental estimation of image flow using a Kalman filter, in Proc. IEEE Workshop on Visual Motion, 1991, 36–43.
41. G. Strang, Introduction to Applied Mathematics. Wellesley, MA: Wellesley-Cambridge Press, 1986.
42. G. Strang, Linear Algebra and its Applications. New York: Harcourt-Brace-Jovanovich, 1988.
43. J. Stuller and G. Krishnamurthy, “Kalman filter formulation of low-level television motion estimation,” Comput. Vision, Graphics, Image Processing, vol. 21, pp. 169–204, 1983.
44. V. Sundareswaren, “Egomotion from global flow field data,” in Proc. IEEE Workshop Visual Motion (Princeton, NJ), 1991, pp. 140–145.
45. R. Szeliski, Bayesian Modeling of Uncertainty in Low-level Vision. Norwell, MA: Kluwer, 1989.
46. D. Terzopoulos, “Image analysis using multigrid relaxation methods,” IEEE Trans. Pattern Analysis Mach. Intell., vol. 8, pp. 129–139, 1986.
47. A. Tikhonov and V. Arsenin, Solutions of III-Posed Problems. New York: Halstead Press, Wiley, 1977.
48. S. Turkoz, Variational Procedures for Φ4Scalar Field Theory. Ph.D. dissertation, Dept. Physics, M.I.T., Cambridge, 1990.
49. H. L. VanTrees, Detection, Estimation and Modulation Theory: Part I. New York: Wiley, 1968.
50. J. Vlontzos and D. Geiger, “A MRF approach to optical flow estimation,” in Proc. IEEE Conf. Comput. Vision Pattern Recognition, 1992, pp. 853–856.
51. D. Walker and K. Rao, “Improved pel-recursive motion compensation,” IEEE Trans. Communicat., vol. 32, pp. 1128–1134, 1984.
52. A. S. Willsky, “A survey of design methods for failure detection in dynamic systems,” Automatica, pp. 601–611, Nov. 1976.
53. G. Womell, “A Karhunen-Loève like expansion for 1/f processes,” IEEE Trans. Inform. Theory, vol. 36, pp. 859–861, 1990.