Pixelwise-adaptive blind optical flow assuming nonstationary statistics

IEEE Transactions on Image Processing

Volumn 14, Issue 2, 2005, Pages 222-230

  Foroosh, Hassan ^a  

^a University of Central Florida   (United States)

Author keywords

Blind estimation; Generalized cross validation (GCV); Motion estimation; Nonstationary statistic; Optical flow

Indexed keywords

ALGORITHMS; BLIND SOURCE SEPARATION; COMPUTATIONAL COMPLEXITY; CONSTRAINT THEORY; IMAGE ANALYSIS; MATHEMATICAL MODELS; MATRIX ALGEBRA; OPTICAL FLOWS; SIGNAL TO NOISE RATIO; STATISTICAL METHODS;

BLIND ESTIMATION; GENERALIZED CROSS VALIDATION (GCV); NONSTATIONARY STATISTIC;

MOTION ESTIMATION;

ALGORITHM; ARTICLE; AUTOMATED PATTERN RECOGNITION; CLUSTER ANALYSIS; COMPARATIVE STUDY; COMPUTER ASSISTED DIAGNOSIS; EVALUATION; IMAGE ENHANCEMENT; IMAGE SUBTRACTION; INFORMATION RETRIEVAL; MATHEMATICAL COMPUTING; METHODOLOGY; MOVEMENT (PHYSIOLOGY); REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING; STATISTICAL MODEL; STATISTICS; VALIDATION STUDY; VIDEORECORDING;

ALGORITHMS; CLUSTER ANALYSIS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; INFORMATION STORAGE AND RETRIEVAL; MODELS, STATISTICAL; MOVEMENT; NUMERICAL ANALYSIS, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING, COMPUTER-ASSISTED; STOCHASTIC PROCESSES; SUBTRACTION TECHNIQUE; VIDEO RECORDING;

EID: 13244278022     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2004.840685     Document Type: Article

References (73)

1. L. Alvarez, J. Weickert, and J. Sanchez, "A scale-space approach to non-local optical flow calculations," in Proc. Int. Conf. Scale-Space, 1999, pp. 235-246.
2. G. Aubert and P. Kornprobst, "A mathematical study of the relaxed optical flow problem in the space bv( ω )," SIAM J. Math. Anal., vol. 30, no. 6, pp. 1282-1308, 1999.
3. A. Bab-Hadiashar, "Robust optic flow computation," Ph.D. dissertation, Dept. Elect. Comput. Syst. Eng., Monash Univ., Australia, 1998.
4. A. Bainbridge-Smith and R. Lane, "Determining optical flow using a differential method," Image Vis. Comput., vol. 15, no. 1, pp. 11-22, 1997.
5. J. Barron, D. Fleet, and S. Beauchemin, "Performance of optical flow techniques," Int. J. Comput. Vis., vol. 12, no. 1, pp. 43-77, 1994.
6. D. Ben-Tzvi, A. D. Bimbo, and P. Nesi, "Optical flow from constraint lines parametrization," Pattern Recognit., vol. 26, no. 10, pp. 1549-1561, 1993.
7. S. Beuchemin and J. Barron, "The computation of optical flow," ACM Comput. Surv., vol. 27, no. 3, pp. 433-467, 1995.
8. [Online]. Available: http://www.cs.brown.edu/people/black/sequences/ yosfaq.html
9. M. Black and P. Anandan, "A framework for the robust estimation of optical flow," in Proc. Int. Conf. Comput. Vis., 1993, pp. 231-236.
10. M. Black and A. Jepson, "Estimating optical flow in segmented images using variable-order parametric models with local deformations," IEEE Trans. Pattern Anal. Mach. Intell., vol. 18, no. 10, pp. 972-986, Oct. 1996.
11. M. Black and A. Rangarajan, "The outlier process: Unifying line processes and robust statistics," in Proc. CVPR, 1994, pp. 15-22.
12. A. Bors and I. Pitas, "Optical flow estimation and moving object segmentation based on median radial basis function network," IEEE Trans. Image Process., vol. 7, no. 5, pp. 693-702, May 1998.
13. A. Bors and I. Pitas, "Improved accuracy in gradient-based optical flow estimation," Int. J. Comput. Vis., vol. 25, no. 1, pp. 5-22, 1997.
14. S. Brette, J. Idier, and A. Mohammad-Djafari, "Scale invariant Markov models for Bayesian inversion of linear inverse problems," in Maximum Entropy and Bayesian Methods, J. Skilling and S. Sibisi, Eds. Norwell, MA: Kluwer, 1996.
15. T. Bums, S. Rogers, D. Ruck, and M. Oxley, "Discrete, spatiotemporal, wavelet multiresolution analysis method for computing optical flow," Opt. Eng., vol. 33, no. 7, pp. 2236-2247, 1994.
16. I. Cohen and I. Herlin, "Non uniform multiresolution method for optical flow and phase portrait models: Environmental applications," Int. J. Comput. Vis., vol. 33, no. 1, pp. 29-49, 1999.
17. C. Colombo, A. D. Bimbo, and S. Santini, "Optical flow by nonlinear relaxation," Pattern Recognit., vol. 28, no. 7, pp. 977-988, 1995.
18. A. DelBimbo, P. Nesi, and J. Sanz, "Analysis of optical flow constraints," IEEE Trans. Image Process., vol. 4, no. 4, pp. 460-469, Apr. 1995.
19. J. Duncan and T.-C. Chou, "On the detection of motion and the computation of optical flow," IEEE Trans. Pattern Anal. Mach. Intell., vol. 14, no. 3, pp. 346-352, Mar. 1992.
20. A. Earnshaw and S. Blostein, "The performance of camera translation direction estimators from optical flow: Analysis, comparison, and the-oretical limits," IEEE Trans. Pattern Anal. Mach. Intell., vol. 18, no. 9, pp. 927-932, Sep. 1996.
21. M. Elad and A. Feuer, "Recursive optical flow estimation-adaptive filtering approach," J. Vis. Commun. Image Reprsentation, vol. 9, no. 2, pp. 119-138, 1998.
22. D. Fleet and K. Langley, "Recursive filters for optical flow," IEEE Trans. Pattern Anal. Mach. Intell., vol. 17, no. 1, pp. 61-67, Jan. 1995.
23. G. Golub and M. Heath, "Generalized cross-validation as a method for choosing a good ridge parameter," Technometr., vol. 21, no. 2, pp. 195-197, 1979.
24. N. Haddadi and C.-C. Kuo, "Computation of dense optical flow with a parametric smoothness model," J. Vis. Commun. Image Representation vol. 4, no. 4, pp. 309-323, 1993.
25. D. Heeger, "Model for the extraction of image flow," J. Opt. Soc. Amer. A, vol. 4, pp. 1455-1471, 1987.
26. F. Heitz and P. Bouthemy, "Multimodal estimation of discontinuous optical flow using Markov random fields," IEEE Trans. Pattern Anal. Mach. Intell., vol. 15, no. 12, pp. 1217-1232, Dec. 1993.
27. B. Horn and B. Schunck, "Determining optical flow," Artif. Intell. vol. 17, pp. 185-203, 1981.
28. T.-R. Isao and V. Chen, "A neural scheme for optical flow computation based on Gabor filters and generalized gradient method," Neurocomput., vol. 6, no. 3, pp. 305-325, 1994.
29. L. Jacobson and H. Wechsler, "Derivation of optical flow using a spatiotemporal-frequency," CVGIP, vol. 38, no. 1, pp. 29-65, 1987.
30. E. Kang, I. Cohen, and G. Medioni, "A graph-based global registration for 2-D mosaics," in Proc. ICPR, vol. I, 2000, pp. 257-260.
31. J. Kim and S. Mitra, "A local relaxation method for optical flow estimation," Signal Process.: Image Commun., vol. 11, no. 1, pp. 21-38, 1997.
32. A. Kumar, A. Tannenbaum, and G. Balas, "Optical flow: A curve evolution approach," IEEE Trans. Image Process., vol. 5, no. 5, pp. 598-610, May 1996.
33. S.-H. Lai and B. Vemuri, "Reliable and efficient computation of optical flow," Int. J. Comput. Vis., vol. 29, no. 2, 1998.
34. J. Lee, "Digital image enhancement and noise filtering by use of local statistics," IEEE Trans. Pattern Anal Mach. Intell., vol. 2, no. 1, pp. 165-168, Jan. 1980.
35. B. Ma, A. Hero, J. Gorman, and O. Michel, "Image registration with minimum spanning tree algorithm," in Proc. ICIP, vol. 1, 2000, pp. 10-13.
36. J. Malik and J. Shi, "Motion segmentation and tracking using normalized cuts," in Proc. ICCV, 1998, pp. 1154-1160.
37. S. Maybank, "Optical flow and the Taylor expansion," Pattern Recognit. Lett., vol. 4, no. 4, pp. 243-246, 1986.
38. S. Maybank, "A least-squares algorithm for analysing optical flow," Comput. Vis. Image Process., pp. 53-76, 1988.
39. E. Memin and P. Perez, "Dense estimation and object-based segmentation of the optical flow with robust techniques," IEEE Trans. Image Process., vol. 7, no. 5, pp. 703-719, May 1998.
40. E. Micheli, V. Torre, and S. Uras, "The accuracy of the computation of optical flow and of the recovery of motion parameters," IEEE Trans. Pattern Anal. Mach. Intell., vol. 15, no. 5, pp. 434-447, May 1993.
41. K. Miller, "Least squares methods for ill-posed problems with a prescribed bound," SIAM J. Math. Anal., vol. 1, pp. 52-74, 1970.
42. O. Morris, M. Lee, and A. Constantinides, "Graph theory for image analysis: An approach based on the shortest spanning tree," Proc. Inst. Elect. Eng., vol. 133, no. 2, pp. 146-152, Feb. 1986.
43. P. Moulin and A. Loui, "Application of a multiresolution optical-flow-based method for motion estimation to video coding," in Proc. Int. Symp. Circuits and Systems, vol. 1, 1993, pp. 2829 1-4.
44. H.-H. Nagel, "Optical flow estimation and the interaction between measurement errors at adjacent pixel positions," Int. J. Comput. Vis., vol. 15, no. 3, pp. 271-288, 1995.
45. H. H. Nagel, "On the estimation of optical flow: Relations between different approaches and some new results," Artif. Intell., vol. 33, pp. 299-324, 1987.
46. H. Neemuchwala, A. Hero, and P. Carson, "Image registration using entropic graph-matching criteria," in Proc. Asilomar Conf. Signals Systems and Computers, vol. 1, 2002, pp. 134-138.
47. S. Negahdaripour, "Revised definition of optical flow: Integration of radiometric and geometric cues for dynamic scene analysis," IEEE. Trans. Pattern Anal. Mach. Intell., vol. 20, no. 9, pp. 961-979, Sep. 1998.
48. S. Negahdaripour and S. Lee, "Motion recovery from image sequences using only first order optical flow information," Int. J. Comput. Vis., vol. 9, no. 3, pp. 163-184, 1992.
49. P. Nesi, "Variational approach to optical flow estimation managing discontinuities," Image Vis. Comput., vol. 11, pp. 419-439, 1993.
50. E. Ong and M. Spann, "Robust optical flow computation based on least-median-of-squares regression," Int. J. Comput. Vis., vol. 31, no. 1, pp. 51-82, 1999.
51. M. Orkisz and P. Clarysse, "Optical flow estimation preserving discontinuities: A survey," Traitement du Signal, vol. 13, no. 5, pp. 489-513, 1996.
52. M. Otte and H.-H. Nagel, "Estimation of optical flow based on higher-order spatiotemporal derivatives in interlaced and noninterlaced image sequences," Artif. Intell., to be published.
53. S. Rakshit and C. Anderson, "Computation of optical flow using basis functions," IEEE Trans. Image Process., vol. 6, no. 10, pp. 1246-1254, Oct. 1997.
54. T. Reed, "On the computation of optical flow using the 3-D Gabor transform," Maltidimen. Syst. Signal Process., vol. 9, no. 4, pp. 447-452, 1998.
55. C. Schnorr, "Computation of discontinuous optical flow by domain decomposition and shape optimization," Int. J. Comput. Vis., vol. 8, no. 2, pp. 153-165, 1992.
56. Y. Shi, S. Lin, and Y.-Q. Zhang, "Optical flow-based motion compensation algorithm for very low-bit-rate video coding," Int. J. Imag. Syst. Technol., vol. 9, no. 4, pp. 230-237, 1998.
57. E. Simoncelli, "Bayesian multi-scale differential optical flow," in Handbook of Computer Vision and Applications. New York: Academic, 1999, pp. 397-422.
58. M. Spetsakis, "Optical flow estimation using discontinuity conforming filters," Comput. Vis. Image Understanding, vol. 68, no. 3, pp. 276-289, 1997.
59. S. Srinivasan and R. Chellappa, "Noise-resilient estimation of optical flow by use of overlapped basis functions," J. Opt. Soc. Amer. A, vol. 16, no. 3, pp. 493-507, 1999.
60. F. Stein, Introduction to Matrices and Determinants. Belmont, CA: Wadsworth, 1967.
61. R. Szeliski and H.-Y. Shum, "Motion estimation with quadtree splines," IEEE Trans. Pattern Anal. Mach. Intell., vol. 18, no. 12, pp. 1199-1210, Dec. 1996.
62. W. Thompson, "Exploiting discontinuities in optical flow," Int. J. Comput. Vis., vol. 30, no. 3, pp. 163-173, 1998.
63. A. Tikhonov and A. Arsenin, Solutions of Ill-Posed Problems. Washington, DC: Winston, 1977.
64. M. Tistarelli, "Multiple constraints to compute optical fiow," IEEE Trans. Pattern Anal. Mach. Intell., vol. 18, no. 12, pp. 1243-1250, Dec. 1996.
65. C.-J. Tsai, N. Galatsanos, and T. Stathaki, "Total least-squares disparity-assisted stereo optical flow estimation," Proc. Image and Multidimensional Digital Signal Processing, pp. 147-150, 1998.
66. S. Uras, F. Girosi, A. Verri, and V. Torre, "A computational approach to motion perception," Biol. Cybern., vol. 60, pp. 79-97, 1988.
67. S. Vedula, S. Baker, P. Rander, R. Collins, and T. Kanade, "Three-dimensional scene flow," in Proc. Int. Conf. Computer Vision vol. 2, 1999, pp. 722-729.
68. A. Verri and A. Poggio, "Against quantitative optical flow," in Proc. ICCV, 1987, pp. 171-180.
69. A. Verri and A. Poggio, "Robust computation of optical flow in a multi-scale differential framework," Int. J. Comp. Vis., vol. 14, no. 1, pp. 67-81, 1995.
70. Y.-T. Wu, T. Kanade, J. Cohn, and C.-C Li, "Optical flow estimation using wavelet motion model," in Proc. Int. Conf. Computer Vision, 1998, pp. 992-998.
71. Y.-T. Wu, T. Kanade, J. Cohn, and C.-C Li, "Dense structure from a dense optical flow sequence," Comput. Vis. Image Understanding, vol. 69, no. 2, pp. 222-245, 1998.
72. Y.-T. Wu, T. Kanade, J. Cohn, and C.-C Li, "Temporal multi-scale models for flow and acceleration," IJCV, vol. 32, no. 2, pp. 147-163, 1999.
73. C. Yuan, Y.-F. Ma, and H.-J. Zhang, "A graph-theoretic approach to video object segmentation in 2d + t space," Tech. Rep., Microsoft Research, 2003.