Video Scene Segmentation Using Spatial Contours and 3-D Robust Motion Estimation

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 14, Issue 4, 2004, Pages 485-497

  Papadimitriou, Theophilos ^a   Diamantaras, Konstantinos I ^b   Strintzis, Michael G ^c   Roumeliotis, Manos ^d  

^a DEMOCRITUS UNIVERSITY OF THRACE   (Greece)

^b ALEXANDER TECHNOLOGICAL EDUCATIONAL INSTITUTE OF THESSALONIKI   (Greece)

^c ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

^d UNIVERSITY OF MACEDONIA   (Greece)

Author keywords

Point correspondences; Region merging; Spatio temporal segmentation; Three dimensional (3 D) motion estimation

Indexed keywords

ALGORITHMS; EDGE DETECTION; IMAGE COMPRESSION; ITERATIVE METHODS; MATHEMATICAL MODELS; MOTION ESTIMATION; OBJECT RECOGNITION; OPTICAL FLOWS; PROBABILITY; SPURIOUS SIGNAL NOISE; STATISTICAL METHODS; VECTORS;

POINT CORRESPONDENCES; REGION MERGING; SPATIO-TEMPORAL SEGMENTATION; THREE-DIMENSIONAL (3-D) MOTION ESTIMATION;

IMAGE SEGMENTATION;

EID: 2042507069     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2004.825562     Document Type: Review

References (39)

1. P. Bouthemy and E. François, "Motion segmentation and qualitative dynamic scene analysis from an image sequence," Int. J. Comput. Vis., vol. 10, no. 2, pp. 157-182, 1993.
2. G. Adiv, "Determining three-dimensional motion and straucture from optical flow generated by several moving objects," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-7, pp. 384-401, Apr. 1985.
3. Th. Papadimitriou, K. I. Diamantaras, M. G. Strintzis, and M. Roumeliotis, "Robust estimation of rigid body 3-D motion parameters based on point correspondences," IEEE Trans. Circuits Syst. Video Technol., vol. 10, pp. 541-549, June 2000.
4. Y. Huang, K. Palaniappan, X. Zhuang, and J. E. Cavanaugh, "Optic flow field segmentation and motion estimation using a robust genetic partitioning algorithm," IEEE Trans. Pattern Anal. Machine Intell., vol. 12, pp. 1177-1189, Dec. 1995.
5. F. Moscheni, S. Bhattacharjee, and M. Kunt, "Spatiotemporal segmentation based on region merging," Trans. Image Processing, no. 9, pp. 897-915, Sept. 1998.
6. P. J. Huber, Robust Statistics. New York: Wiley, July 1981.
7. M. Irani, B. Rousso, and S. Peleg, "Computing occludign and transparent motions," Int. J. Comput. Vis., vol. 12, no. 1, pp. 5-16, 1994.
8. H. G. Mussmann, N. Hoetter, and J. Ostermann, "Object-oriented analysis-synthesis coding of moving images," Signal Processing: Image Commun., vol. 1, no. 2, pp. 117-135, Oct.
9. J. R. Bergen, J. B. Burt, J. Hingorani, and S. Peleg, "A three-frame algorithm for estimating two-component image motions," IEEE Trans. Pattern Anal. Machine Intell., vol. 12, pp. 43-77, Jan. 1992.
10. M. Irani, B. Rousso, and S. Peleg, "Detecting and tracking multiple moving object using temporal integration," in Proc. 2nd Eur. Conf. Computer Vision, G. Sandini, Ed, S. Margherita, Italy: Springer-Verlag, 1992, pp. 282-287.
11. P. J. Rousseeuw and A. M. Leroy, Robust Resgression and Outlier Detection. New York: Wiley, 1987.
12. S. Ayer and P. Schroeter, "Hierarchical robust motion estimation for segmentation of moving objects," in Proc. IEEE Workshop Image and Multidimensional Signal Processing, Cannes, France, 1993, pp. 122-123.
13. J. Y. A. Wang and E. H. Anderson, "Representing moving images with layers," IEEE Trans. Image Processing, vol. 3, pp. 625-638, May 1994.
14. F. Dufaux, F. Moscheni, and A. Lippman, "Spatiotemporal segmentation based on motion and static segmentation," in Proc. ICIP, Washington, DC, Oct. 1995, pp. 306-309.
15. J. Y. A. Wang and E. H. Adelson, "Spatiotemporal segmentation of video data," in SPIE Proc. Image and Video Processing II, vol. 2, San Jose, CA, Feb. 1994.
16. I. Patras, E.-A. Hendriks, and R. L. Lagendijk, "Video segmentation by MAP labeling of watershed segments," IEEE Trans. Pattern Anal. Machine Intell., vol. 23, pp. 326-332, Mar., 2001.
17. W.-Y. Ma and B. S. Manjunath, "Edgeflow: A technique for boundary detection and image segmentation," IEEE Trans. Image Processing, vol. 9, pp. 1375-1388, Aug. 2000.
18. D. Heeger and A. Jepson, "Subspaces methods for recovering rigid motion i:algorithm and implementation," Int. J. Comput. Vis., vol. 7, pp. 95-117, Aug., 1992.
19. E. Mémin and P. Pérez, "Dense estimation and object-based segmentation of the optical flow with robust techniques," IEEE Trans. Image Processing, vol. 7, pp. 703-719, May 1998.
20. M. E. Al Mualla, C. N. Canagarajah, and D. R. Bull, "Simplex minimization for single- and multiple-reference motion estimation," IEEE Trans. Circuits Syst. Video Technol., vol. 11, pp. 1209-1220, Dec. 2001.
21. H. C. Longuet-Higgins, "A computer program for reconstructing a scene from two projections," Nature, vol. 293, pp. 133-135, Sept. 1981.
22. R. Y. Tsai and T. S. Huang, "Uniqueness and estimation of 3-D motion parameters of rigid bodies with curved surfaces," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-6, pp. 13-27, Jan. 1984.
23. R. M. Haralick, H. Joo, C. N. Lee, X. Zhuang, V. G. Vaidya, and M. B. Kim, "Pose estimation from corresponding point data," IEEE Trans. Syst., Man, Cybern., vol. 19, pp. 1426-1446, Aug. 1989.
24. O. Faugeras, Three-Dimensional Computer Vision: A Geometric Viewpoint. Cambridge, MA: MIT Press, 1993.
25. J. Weng, Y. Liu, T. S. Huang, and N. Ahuja, "Estimating motion structures from line correspondences a robust linear algorithm and uniqueness theorems," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, Ann Arbor, MI, 1988, pp. 387-392.
26. Z. Zhang, "Estimating motion and structure from corresponding of lines segments between two perspective images," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-17, pp. 1129-1139, Dec. 1995.
27. I.-F. Chen, H.-Y. M. Liao, and J.-C. Lin, "Wavelet-based optical flow estimation," IEEE Trans. Circuits Syst. Video Technol., vol. 12, pp. 1-12, Jan., 2002.
28. B. K. P. Horn and E. J. Schunck, "Determining optical flow," Artif. Intell., vol. 23, pp. 185-203, 1981.
29. H.-H. Nagel and W. Enkelman, "An investigation of smoothness constraints for the estimation of displacement vector field from image sequences," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-8, pp. 565-593, May 1986.
30. K. I. Diamantaras, Th. Papadimitriou, M. G. Strintzis, and M. Roumeliotis, "Total least squares 3-D motion estimation," in Proc. ICIP, Chicago, IL, Oct. 1998, paper MP11_4.
31. K. I. Diamantaras and M. G. Strintzis, "Camera motion parameter recovery under perspective projection," in Proc. IEEE Conf. Image Processing, vol. 3, Lausanne, Switzerland, Sept. 1996, pp. 807-810.
32. G.H. Golub and C.F. Van Loan, Matrix Computation. Baltimore, MD: Johns Hopkins Univ. Press, 1998.
33. D.-G. Sim and R.-H. Park, "Robust reweighted MAP motion estimation," IEEE Trans. Pattern Anal. Machine Intell., vol. 20, pp. 353-365, Apr. 1998.
34. K.-M. Lee, P. Meer, and R.-H. Park, "Robust adaptive segmentation of range images," IEEE Trans. Pattern Anal. Machine Intell., vol. 20, pp. 200-205, Feb. 1998.
35. T. A. Cass, "Robust affine structure matching for 3D object recognition," IEEE Trans. Pattern Anal. Machine Intell., vol. 20, pp. 1265-1274, Nov. 1998.
36. R. G. Staudte and S. J. Sheather, Robust Estimation & Testing, ser. Probability and Mathimatical Statistics. New York: Wiley, 990.
37. Th. Papadimitriou, K. I. Diamantaras, M. G. Strintzis, and M. Roumeliotis, "A new image sequence segmentation method based on luminance and 3-D motion information," in Proc. Int. Workshop Synthetic-Natural Hybrid Coding and Three Dimensional Imaging (IWSNHC3DI-99), Santorini, Greece, Sept. 15-17, 1999, pp. 53-57.
38. Rotating Around the MOVI House [Online]. Available: http://www.irisa.fr/ texmex/base_images/sequences/g3_vp_ra_s1/index.html
39. Y. Tsaig and A. Averbuch, "Automatic segmentation of moving objects in video sequences: A region labeling approach," IEEE Trans. Circuits Syst. Video Technol., vol. 12, pp. 597-612, July 2002.