Occlusion-aware optical flow estimation

IEEE Transactions on Image Processing

Volumn 17, Issue 8, 2008, Pages 1443-1451

  Ince, Serdar ^a,b   Konrad, Janusz ^a  

^a Boston University   (United States)

^b IntelliVid Corporation   (United States)

Author keywords

Anisotropic diffusion; Disparity estimation; Motion estimation; Occlusions; Optical flow

Indexed keywords

ANISOTROPY; APPROXIMATION THEORY; DIFFUSION; EXTRAPOLATION; FLOW INTERACTIONS; IMAGE CODING; IMAGE MATCHING; MOTION ESTIMATION; OPTICAL ANISOTROPY;

ANISOTROPIC DIFFUSION; DISPARITY ESTIMATION; IMAGE DOMAINS; IMAGE GRADIENTS; OCCLUSIONS; OPTICAL FLOW ESTIMATIONS; OPTICAL FLOW FIELDS; THREE STEPS; VARIATIONAL FORMULATIONS;

OPTICAL FLOWS;

ALGORITHM; ARTICLE; COMPUTER ASSISTED DIAGNOSIS; FLOW KINETICS; IMAGE ENHANCEMENT; METHODOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; THREE DIMENSIONAL IMAGING; VIDEORECORDING;

ALGORITHMS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; REPRODUCIBILITY OF RESULTS; RHEOLOGY; SENSITIVITY AND SPECIFICITY; VIDEO RECORDING;

EID: 48349141624     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2008.925381     Document Type: Article

References (29)

1. B. K. P. Horn and B. G. Schunck, "Determining optical flow," Artif. Intell., vol. 17, pp. 185-203, 1981.
2. B. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision," in Proc. Int. Joint Conf. Artificial Intelligence, Aug. 1981, pp. 674-679.
3. R. March, "Computation of stereo disparity using regularization," Pattern Recognit. Lett., vol. 8, pp. 181-187, Oct. 1988.
4. M. J. Black and P. Anandan, "The robust estimation of multiple motions: Parametric and piecewise-smooth flow fields," Comput. Vis. Image Understanding, vol. 63, no. 1, pp. 75-104, 1996.
5. L. Alvarez, R. Deriche, J. Sánchez, and J. Weickert, "Dense disparity map estimation respecting image discontinuities: A PDE and scale-space based approach," J. Vis. Commun. Image Representation vol. 13, pp. 3-21, 2002.
6. T. Brox, A. Bruhn, N. Papenberg, and J.Weickert, "High accuracy optical flow estimation based on a theory for warping," in Proc. European Conf. Computer Vision, 2004, pp. 25-36.
7. R. Depommier and E. Dubois, "Motion estimation with detection of occlusion areas," in Proc. IEEE Int. Conf. Acoustics Speech Signal Processing, Mar. 1992, pp. III.269-III.272.
8. N. Grammalidis and M. G. Strintzis, "Disparity and occlusion estimation in multiocular systems and their coding for the communication of multiview image sequences," IEEE Trans. Circuits Syst. Video Technol., vol. 8, no. 3, pp. 328-344, Jun. 1998.
9. C. Strecha and L. Van Gool, "PDE-based multi-view depth estimation," in Proc. 1st Int. Symp. 3D Data Processing Visualization and Transmission, 2002, vol. 2, pp. 416-425.
10. L. Alvarez, J. Esclarin, M. Lefébure, and J. Sánchez, "A PDE model for computing the optical flow," in Proc. XVI Congreso de Ecuaciones Diferenciales y Aplicaciones, Sep. 1999, pp. 1349-1356.
11. H.-H. Nagel and W. Enkelmann, "An investigation of smoothness constraints for the estimation of displacement vector fields from image sequences," [iIEEE Trans. Pattern Anal. Mach. Intell., vol. 8, no. 5, pp. 565-593, Sep. 1986.
12. A.-R. Mansouri, A. Mitiche, and J. Konrad, "Selective image diffusion: Application to disparity estimation," in Proc. IEEE Int. Conf. Image Processing, Oct. 1998, vol. 3, pp. 284-288.
13. H. Kim and K. Sohn, "3D reconstruction from stereo images for interactions between real and virtual objects," Signal Process., Image Commun., vol. 20, no. 1, pp. 61-75, 2005.
14. X. Huang and E. Dubois, "Three-view dense disparity estimation with occlusion detection," in Proc. IEEE Int. Conf. Image Processing, Sep. 2005, vol. 3, pp. 393-396.
15. M. Proesmans, L. Van Gool, E. Pauwels, and A. Oosterlinck, "Determination of optical flow and its discontinuities using non-linear diffusion," in Proc. European Conf. Computer Vision, 1994, vol. 2, pp. 295-304.
16. L. Alvarez, R. Deriche, T. Papadopoulo, and J. Sánchez, "Symmetrical dense optical flow estimation with occlusions detection," in Proc. European Conf. Computer Vision, 2002, vol. 1, pp. 721-736.
17. J. Sun, Y. Li, S. B. Kang, and H.-Y. Shum, "Symmetric stereo matching for occlusion handling," presented at the IEEE Conf. Computer Vision Pattern Recognition, 2005.
18. K. P. Lim, A. Das, and M. N. Chong, "Estimation of occlusion and dense motion fields in a bidirectional Bayesian framework," IEEE Trans. Pattern Anal. Machine Intell., vol. 24, no. 5, pp. 712-718, May 2002.
19. V. Kolmogorov and R. Zabih, "Computing visual correspondence with occlusions using graph cuts," in Proc. IEEE Int. Conf. Computer Vision, 2001, vol. 2, pp. 508-515.
20. J. Xiao and M. Shah, "Motion layer extraction in the presence of occlusion using graph cuts," IEEE Trans. Pattern Anal. Machine Intell., vol. 27, no. 10, pp. 1644-1659, Oct. 2005.
21. J. Xiao, H. Cheng, H. Sawhney, C. Rao, and M. Isnardi, "Bilateral filtering-based optical flow estimation with occlusion detection," presented at the European Conf. Computer Vision, 2006.
22. S. Ince and J. Konrad, "Geometry-based estimation of occlusions from video frame pairs," in Proc. IEEE Int. Conf. Acoustics Speech Signal Processing, Mar. 2005, vol. II, pp. 933-936.
23. P. Aguiar and J. Moura, "Figure-ground segmentation from occlusion," [iIEEE Trans. Image Process., vol. 14, no. 8, pp. 1109-1124, Aug. 2005.
24. M. Bertalmio, G. Sapiro, V. Caselles, and C. Ballester, "Image inpainting," in Proc. 27th Annu. Conf. Computer Graphics and Interactive Techniques, Jul. 2000, pp. 417-424.
25. P. Perona and J. Malik, "Scale-space and edge detection using anisotropic diffusion," IEEE Trans. Pattern Anal. Machine Intell. vol. 12, no. 7, pp. 629-639, Jul. 1990.
26. J. Konrad and N. Božinović, "Importance of motion in motion-compensated temporal discrete wavelet transforms," Proc. SPIE Image and Video Communications and Process., vol. 5685, pp. 354-365, Jan. 2005.
27. A. P. Dempster, N. M. Laird, and D. P. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. Roy. Statist. Soc. B, vol. 39, no. 1, pp. 1-38, 1977.
28. M. Gennert and A. Yuille, "Determining the optimal weights in multiple objective function optimization," in Proc. IEEE Int. Conf. Computer Vision, 1988, vol. 2, pp. 87-89.
29. L. Ng and V. Solo, "A data-driven method for choosing smoothing parameters in optical flow problems," in Proc. IEEE Int. Conf. Image Processing, 1997, pp. 360-363.