Concurrent 3-D motion segmentation and 3-D interpretation of temporal sequences of monocular images

IEEE Transactions on Image Processing

Volumn 15, Issue 3, 2006, Pages 641-653

  Sekkati, Hicham ^a   Mitiche, Amar ^a  

^a INRS EMT   (Canada)

Author keywords

3 D motion segmentation; Curve evolution; Dense structure from motion; Image sequence analysis; Level sets; Three dimensional (3 D) interpretation

Indexed keywords

ALGORITHMS; ANIMATION; CONVERGENCE OF NUMERICAL METHODS; OPTIMIZATION; SPECIAL EFFECTS; THREE DIMENSIONAL COMPUTER GRAPHICS; TOPOLOGY;

ANAGLYPHS; CURVE EVOLUTION; IMAGE SEQUENCE ANALYSIS; LEVEL SETS; THREE-DIMENSIONAL MOTION SEGMENTATION;

IMAGE SEGMENTATION;

ALGORITHM; ARTICLE; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; EVALUATION; IMAGE ENHANCEMENT; IMAGE SUBTRACTION; INFORMATION RETRIEVAL; METHODOLOGY; MOTION; THREE DIMENSIONAL IMAGING; TIME; VIDEORECORDING;

ALGORITHMS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; INFORMATION STORAGE AND RETRIEVAL; MOTION; PATTERN RECOGNITION, AUTOMATED; SUBTRACTION TECHNIQUE; TIME FACTORS; VIDEO RECORDING;

EID: 32944471105     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2005.863699     Document Type: Article

References (40)

1. T. Huang, Image Sequence Analysis. New York: Springer-Verlag Berlin Heidelberg, 1981.
2. J. Aloimonos and C. Brown, "Direct processing of curvilinear sensor motion from a sequence of perspective images," in Proc. IEEE Workshop on Computer Vision: Representation and Analysis, Annapolis, MD, 1984, pp. 72-77.
3. B. Horn and E. Weldon, "Direct methods for recovering motion," Int. J. Comput. Vis., vol. 2, no. 2, pp. 51-76, 1988.
4. J. Aggarwal and N. Nandhakumar, "On the computation of motion from a sequence of images: A review," Proc. IEEE, vol. 76, no. 8, pp. 917-935, Aug. 1988.
5. T. Huang and A. Netravali, "Motion and structure from feature correspondences: A review," Proc. IEEE, vol. 82, no. 2, pp. 252-268, Feb. 1994.
6. O. Faugeras, Three Dimensional Computer Vision: A Geometric Viewpoint. Cambridge, MA: MIT Press, 1993.
7. A. Mitiche, Computational Analysis of Visual Motion. New York: Plenum, 1994.
8. A. Zisserman and R. Hartly, Multiple View Geometry in Computer Vision. Cambridge, U.K.: Cambridge Univ. Press, 2000.
9. B. Horn and B. Schunk, "Determining optical flow," Artif. Intell., no. 17, pp. 185-203, 1981.
10. G. Aubert, G. Deriche, and P. Kornprobst, "Computing optical flow via variational techniques," SIAM J. Appl. Math., vol. 60, no. 1, pp. 156-182, 1999.
11. A. Mitiche and P. Bouthemy, "Computation and analysis of image motion: a synopsis of current problems and methods," Int. J. Comput. Vis., vol. 19, no. 1, pp. 29-55, 1996.
12. J. Mellor, S. Teller, and T. Lozano-Perez, "Dense depth map for epipolar images," in Proc. Image Understanding Workshop, 1997, pp. 893-900.
13. S. Negahdaripour and B. Horn, "Direct passive navigation," IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-9, no. 1, pp. 168-176, 1987.
14. R. Laganiere and A. Mitiche, "Direct bayesian interpretation of visual motion," J. Robot. Autonom. Syst., no. 14, pp. 247-254, 1995.
15. R. Chellappa and S. Srinivasan, "Structure from motion: Sparse versus dense correspondance methods," in Proc. Int. Conf. Image Processing, vol. 2, 1999, pp. 492-499.
16. Y. Hung and H. Ho, "A kalman filter approach to direct depth estimation incorporating surface structure," IEEE Trans. Pattern Anal. Mach. Intell., vol. 21, no. 6, pp. 570-575, Jun. 1999.
17. S. Srinivasan, "Extracting structure from optical flow using the fast error search technique," Int. J. Comput. Vis., vol. 37, no. 3, pp. 203-230, 2000.
18. T. Brodsky, C. Fermuller, and Y. Aloimonos, "Structure from motion: beyond the epipolar constraint," Int. J. Comput. Vis., vol. 37, no. 3, pp. 231-258, 2000.
19. H. Longuet-Higgins and K. Prazdny, "The interpretation of a moving retinal image," Proc. Roy. Soc. Lond. B, pp. 385-397, 1981.
20. G. Adiv, "Determining three-dimensional motion and structure from optical flow generated by several moving objects," IEEE Tans. Pattern Anal. Mach. Intell., vol. PAMI-7, no. 4, pp. 384-401, Apr. 1985.
21. A. Mitiche and S. Hadjres, "Mdl estimation of a dense map of relative depth and 3D motion from a temporal sequence of images," Pattern Anal. Applicat., no. 6, pp. 78-87, 2003.
22. H. Sekkati and A. Mitiche, "Dense 3D interpretation of image sequences: A variational approach using anisotropic diffusion," presented at the Int. Conf. Image Analysis and Processing, Mantova, Italy, 2003.
23. F. Morier, H. Nicolas, J. Benois, D. Barba, and H. Sanson, "Relative depth estimation of video objects for image interpolation," in Proc. Int. Conf. Image Processing, 1998, pp. 953-957.
24. F. Martinez, J. Benois-Pineau, and D. Barba, "Extraction of the relative depth information of objects in video sequences," in Proc. Int. Conf. Image Processing, 1998, pp. 948-952.
25. J. Sethian, Level Set Methods and Fast Marching Methods. Cambridge, U.K.: Cambridge Univ. Press, 1999.
26. S. Jehan, M. Gastaud, M. Barlaud, and G. Aubert, "Region-based active contours using geometrical and statistical features for image segmentation," presented at the Int. Conf. Image Processing, Barcelona, Spain, 2003.
27. G. Aubert and P. Komprobst, Mathematical Problems in Image Processing. New York: Springer, 2002.
28. S. Osher and N. Paragios, Geometric Level Set Methods in Imaging, Vision, and Graphics. New York: Springer, 2003.
29. O. Faugeras and R. Keriven, "Variational principles, surface evolution, PDE's, level set methods, and the stereo problem," IEEE Trans. Image Process., vol. 7, no. 3, pp. 336-344, Mar. 1998.
30. H. Sekkati and A. Mitiche, "Joint dense 3D interpretation and multiple motion segmentation of temporal image sequences: A variational framework with active curve evolution and level sets," presented at the Int. Conf. Image Processing, Singapore, 2004.
31. D. Mumford and J. Shah, "Optimal approximation by piecewise smooth functions and associated variational problems," Commun. Pure Appl. Math., no. 42, pp. 577-685, 1989.
32. R. Feghali and A. Mitiche, "Fast computation of a boundary preserving estimate of optical flow," in Proc. Brit. Machine Vision Conf., 2000, pp. 212-221.
33. T. Chan and L. Vese, "An active contour model without edges," in Proc. Int. Conf. Scale-Space Theories in Computer Vision, Corfu, Greece, 1999, pp. 141-151.
34. A. Mansouri and J. Konrad, "Multiple motion segmentation with level sets," IEEE Trans. Image Process., vol. 12, no. 2, pp. 201-220, Feb. 2003.
35. A. Mansouri, A. Mitiche, and C. Vazquez, "Image segmentation by multiregion competition," presented at the Reconnaissance de Formes et Intelligence Artificielle Conf., RFIA-04, Toulouse, France, 2004.
36. C. Vazquez, A. Mitiche, and I. B. Ayed, "Segmentation of vectorial images by a global curve evolution method," presented at the Reconnaissance de Formes et Intelligence Artificielle Conf., RFIA-04, Toulouse, France, 2004.
37. C. Vazquez, A. Mitiche, and I. B. Ayed, "Image segmentation as regularized clustring: A fully flobal curve evolution method," in Int. Conf. Image Processing, Singapore, 2004, pp. 3467-3470.
38. S. Zhu and A. Yuille, "Region competition: Unifying snakes, region growing, and bayes/mdl for multiband image segmentation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 18, no. 9, pp. 884-900, Sep. 1996.
39. A. Mitiche, R. Feghali, and A. Mansouri, "Motion tracking as spatiotemporal motion boundary detection," J. Robot. Autonom. Syst., no. 43, pp. 39-50, 2003.
40. E. Dubois, "A projection method to generate anaglyph stereo images," in Proc. ICASP, vol. III, 2001, pp. 1661-1664.