Joint space-time motion-based video segmentation and occlusion detection using multiphase level sets

Proceedings of SPIE - The International Society for Optical Engineering

Volumn 5308, Issue PART 1, 2004, Pages 156-167

  Ristivojević, Mirko ^a   Konrad, Janusz ^a  

^a Boston University   (United States)

Author keywords

Level sets; Motion estimation; Occlusion detection; Video segmentation; Volume competition

Indexed keywords

LEVEL SETS; OCCLUSION; VIDEO SEGMENTATION; VOLUME COMPETITION;

COMPUTER SIMULATION; IMAGE COMPRESSION; IMAGE QUALITY; MOTION ESTIMATION; TRAJECTORIES; VIDEO SIGNAL PROCESSING;

IMAGE SEGMENTATION;

EID: 10444277235     PISSN: 0277786X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1117/12.523975     Document Type: Conference Paper

References (36)

1. E. Mémin and P. Pérez, "Dense estimation and object-based segmentation of the optical flow with robust techniques," IEEE Trans. Image Process. 7, pp. 703-719, May 1998.
2. M. Chang, A. Tekalp, and M. Sezan, "Simultaneous motion estimation and segmentation," IEEE Trans. Image Process. 6, pp. 1326-1333. Sept. 1997.
3. J. Wang and E. Adelson, "Representing moving images with layers," IEEE Trans. Image Process. 3(5), pp. 625-638, 1994.
4. H. Sawhney and S. Ayer, "Compact representations of videos through dominant and multiple motion estimation," IEEE Trans. Pattern Anal. Machine Intell. 18, pp. 814-830, Aug. 1996.
5. M. Kass, A. Witkin, and D. Terzopoulos, "Snakes: Active contour models," Intern. J. Comput. Vis. 1, pp. 321-331, 1988.
6. J. Sethian, Level Set Methods, Cambridge University Press, 1996.
7. V. Caselles, R. Kimmel, and G. Sapiro, "Geodesic active contours," Intern. J. Comput. Vis. 22(1), pp. 61-79, 1997.
8. N. Paragios and R. Deriche, "Geodesic active contours and level sets for the detection and tracking of moving objects," IEEE Trans. Pattern Anal. Machine Intell. 22, pp. 266-280, Mar. 2000.
9. J. Zhang, J. Gao, and W. Liu, "Image sequence segmentation using 3-D structure tensor and curve evolution," IEEE Trans. Circuits Syst. Video Technol. 11, pp. 629-641, May 2001.
10. G. Kühne, J. Weickert, O. Schuster, and S. Richter, "A tensor-driven active contour model for moving object segmentation," in Proc. IEEE Int. Conf. Image Processing, pp. 73-76, 2001.
11. A.-R. Mansouri and J. Konrad, "Motion segmentation with level sets," in Proc. IEEE Int. Conf. Image Processing, 2, pp. 126-130, Oct. 1999.
12. S. Jehan-Besson, M. Barlaud, and G. Aubert, "Detection and tracking of moving objects using a new level set based method," in Proc. Int. Conf. Patt. Recog., pp. 1112-1117, Sept. 2000.
13. E. Debreuve, M. Barlaud, G. Aubert, I. Laurette, and J. Darcourt, "Space-time segmentation using level set active contours applied to myocardial gated SPECT," IEEE Trans. Med. Imag. 20, pp. 643-659, July 2001.
14. F. Luthon, A. Caplier, and M. Liévin, "Spatiotemporal MRF approach with application to motion detection and lip segmentation in video sequences," Signal Process. 76, pp. 61-80, 1999.
15. F.-M. Porikli and Y. Wang, "An unsupervised multi-resolution object extraction algorithm using videocube," in Proc. IEEE Int. Conf. Image Processing, pp. 359-362, 2001.
16. R. El-Feghali, A. Mitiche, and A.-R. Mansouri, "Tracking as motion boundary detection in spatio-temporal space," in Int. Conf. Imaging Science, Systems, and Technology, pp. 600-604, June 2001.
17. A. Mitiche, R. El-Feghali, and A.-R. Mansouri, "Tracking moving objects as spatio-temporal boundary detection," in Proc. IEEE Southwest Symp. on Image Anal. Interp., pp. 206-110, Apr. 2002.
18. A.-R. Mansouri, A. Mitiche, and R. El-Feghali, "Spatio-temporal motion segmentation via level set partial differential equations," in Proc. IEEE Southwest Symp. on Image Anal. Interp., pp. 243-247, Apr. 2002.
19. A.-R. Mansouri and A. Mitiche, "Spatial/joint space-time motion segmentation of image sequences by level set pursuit," in Proc. IEEE Int. Conf. Image Processing, 2, pp. 265-268, Sept. 2002.
20. J. Konrad and M. Ristivojević, "Joint space-time image sequence segmentation based on volume competition and level sets," in Proc. IEEE Int. Conf. Image Processing, 1, pp. 573-576, Sept. 2002.
21. R. Thoma and M. Bierling, "Motion compensating interpolation considering covered and uncovered background," Signal Process., Image Commun. 1, pp. 191-212, 1989.
22. J. Driessen and J. Biemond, "Motion field estimation for complex scenes," in Proc. SPIE Visual Communications and Image Process., pp. 511-521, 1991.
23. R. Depommier and E. Dubois, "Motion estimation with detection of occlusion areas," in Proc. IEEE Int. Conf. Acoustics Speech Signal Processing, pp. III.269-III.272, Mar. 1992.
24. F. Heitz and P. Bouthemy, "Multimodal estimation of discontinuous optical flow using Markov random fields," IEEE Trans. Pattern Anal. Machine Intell. 15, pp. 1217-1232, Dec. 1993.
25. M. Irani and S. Peleg, "Motion analysis for image enhancement: resolution, occlusion and transparency," J. Vis. Commun. Image Represent. 4, pp. 324-335, Dec. 1993.
26. K. Lim, A. Das, and M. Chong, "Estimation of occlusion and dense motion fields in a bidirectional Bayesian framework," IEEE Trans. Pattern Anal. Machine Intell. 24, pp. 712-718, May 2002.
27. M. Chahine and J. Konrad, "Estimation and compensation of accelerated motion for temporal sequence interpolation," Signal Process., Image Commun. 7, pp. 503-527, Nov. 1995.
28. J. Konrad and M. Ristivojević, "Video segmentation and occlusion detection over multiple frames," in Proc. SPIE Image and Video Communications and Process., 5022, pp. 377-388, Jan. 2003.
29. L. Vese and T. Chan, "A multiphase level set framework for image segmentation using the Mumford and Shah model," Intern. J. Comput. Vis. 50(3), pp. 271-293, 2002.
30. A.-R. Mansouri and J. Konrad, "Multiple motion segmentation with level sets," IEEE Trans. Image Process. 12, pp. 201-220, Feb. 2003.
31. D. Cremers, "A multiphase level set framework for motion segmentation," in 4-th Int. Conf. on Scale Space Theories in Computer Vision, June 2003.
32. Y. Shi, J. Konrad, and W. Karl, "Multiple motion and occlusion segmentation with a multiphase level set method," in Proc. SPIE Visual Communications and Image Process., Jan. 2004.
33. E. Dubois, "Motion-compensated filtering of time-varying images," Multidimens. Syst. Signal Process. 3, pp. 211-239, 1992.
34. E. Dubois, "The sampling and reconstruction of time-varying imagery with application in video systems," Proc. IEEE 73, pp. 502-522, Apr. 1985.
35. R. Keys, "Cubic convolution interpolation for digital image processing," IEEE Trans. Acoust. Speech Signal Process. 29, pp. 1153-1160, Dec. 1981.
36. http://iss.bu.edu/jkonrad/Research/research.html.