Spatio-temporal video object segmentation via scale-adaptive 3D structure tensor

Eurasip Journal on Applied Signal Processing

Volumn 2004, Issue 6, 2004, Pages 798-813

  Wang, Hai Yun ^a   Ma, Kai Kuang ^a  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

3D structure tensor; Rigidity analysis; Video object segmentation

Indexed keywords

3D STRUCTURE TENSOR; RIGIDITY ANALYSIS; VIDEO OBJECT SEGMENTATION;

COMPUTATIONAL COMPLEXITY; EDGE DETECTION; IMAGE RECONSTRUCTION; PROBABILITY; TENSORS; VIRTUAL REALITY; VISION;

IMAGE SEGMENTATION;

EID: 4043069300     PISSN: 11108657     EISSN: None     Source Type: Journal    
DOI: 10.1155/S111086570440122X     Document Type: Article

References (40)

1. J. Y. A. Wang and E. H. Adelson, "Representing moving images with layers," IEEE Trans. Image Processing, vol. 3, no. 5, pp. 625-638, 1994.
2. P. Salembier, F. Marques, M. Pardas, et al., "Segmentation-based video coding system allowing the manipulation of objects," IEEE Trans. Circuits and Systems for Video Technology, vol. 7, no. 1, pp. 60-74, 1997.
3. T. Meier and K. N. Ngan, "Automatic segmentation of moving objects for video object plane generation," IEEE Trans. Circuits and Systems for Video Technology, vol. 8, no. 5, pp. 525-538, 1998.
4. J. A. Sethian, Level Set Methods and Fast Marching Methods: Evolving Interfaces in Computational Geometry, Fluid Mechanics, Computer Vision, and Materials Science, Cambridge University Press, Cambridge, UK, 1999.
5. G. Kuhne, J. Weickert, O. Schuster, and S. Richter, "A tensor-driven active contour model for moving object segmenta tion," in Proc. IEEE International Conference on Image Processing, vol. 2, pp. 73-76, Thessaloniki, Greece, October 2001.
6. M. M. Chang, A. M. Tekalp, and M. I. Sezan, "Simultaneous motion estimation and segmentation," IEEE Trans. Image Processing, vol. 6, no. 9, pp. 1326-1333, 1997.
7. H. Gu, Y. Shirai, and M. Asada, "MDL-based segmentation and motion modeling in a long image sequence of scene with multiple independently moving objects," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 18, no. 1, pp. 58-64, 1996.
8. M. J. Black and P. Anandan, "The robust estimation of multiple motions: parametric and piecewise-smooth flow fields," Computer Vision and Image Understanding, vol. 63, no. 1, pp. 75-104, 1996.
9. J. Zhang, J. Gao, and W. Liu, "Image sequence segmentation using 3-D structure tensor and curve evolution," IEEE Trans. Circuits and Systems for Video Technology, vol. 11, no. 5, pp. 629-641, 2001.
10. G. Farneback, "Motion-based segmentation of image sequences," M.S. thesis, Linköping University, Linköping, Sweden, May 1996.
11. M. G. Ross, "Exploiting texture-motion duality in optical flow and image segmentation," M.S. thesis, Massachusetts Institute of Technology, Cambridge, Mass, USA, August 2000.
12. M. Sonka, V. Hlavac, and R. Boyle, Image Processing, Analysis, and Machine Vision, PWS Publishing, Pacific Grove, Calif, USA, 2nd edition, 1999.
13. S. Ayer and H. S. Sawhney, "Layered representation of motion video using robust maximum likelihood estimation of mixture models and MDL encoding," in Proc. 5th International Conference on Computer Vision, pp. 777-784, Boston, Mass, USA, June 1995.
14. B. A. Wandell, Foundations of Vision, Sinauer Press, Sunderland, Mass, USA, 1995.
15. R. M. Haralick and L. G. Shapiro, Computer and Robot Vision, vol. 2, Addison-Wesley, Reading, Mass, USA, 1992.
16. A. Mitiche and P. Bouthemy, "Computation and analysis of image motion: a synopsis of current problems and methods," International Journal of Computer Vision, vol. 19, no. 1, pp. 29-55, 1996.
17. B. Jähne, H. Haussecker, and P. Geissler, Handbook of Computer Vision and Applications, vol. 2, pp. 309-396, Academic Press, San Diego, Calif, USA, 1999.
18. J. L. Barron, D. J. Fleet, and S. S. Beauchemin, "Performance of optical flow techniques," International Journal of Computer Vision, vol. 12, no. 1, pp. 43-77, 1994.
19. R. Plankers, "A level set approach to shape recognition," Tech. Rep., Ecole Polytechnique Fédérale de Lausanne, Lausanne, Switzerland, 1997.
20. P. Felzenszwalb and D. Huttenlocher, "Efficiently computing a good segmentation," in Proc. DARPA Image Understanding Workshop, pp. 251-258, Monterey, Calif, USA, November 1998.
21. I. T. Jolliffe, Principle Component Analysis, Springer-Verlag, New York, NY, USA, 1986.
22. S. K. Mitra and G. L. Sicuranza, Eds., Nonlinear Image Processing, Academic Press, San Diego, Calif, USA, 2001.
23. N. U. Ahmed, Linear and Nonlinear Filtering for Scientists and Engineers, World Scientific, River Edge, NJ, USA, 1998.
24. N. Paragios and G. Tziritas, "Adaptive detection and localization of moving objects in image sequences," Signal Processing: Image Communication, vol. 14, no. 4, pp. 277-296, 1999.
25. F. Bartolini, V. Cappellini, C. Colombo, and A. Mecocci, "A multiwindow least squares approach to the estimation of optical flow with discontinuities," Optical Engineering, vol. 32, no. 6, pp. 1250-1256, 1993.
26. K. S. Pedersen and M. Nielsen, "Computing optic flow by scale-space integration of normal flow," in Proc. 3rd International Scale-Space Conference, pp. 14-25, Vancouver, British Columbia, Canada, July 2001.
27. W. J. Niessen, J. S. Duncan, M. Nielsen, L. M. J. Florack, B. M. ter Haar Romeny, and M. A. Viergever, "Multiscale approach to image sequence analysis," Computer Vision and Image Understanding, vol. 65, no. 2, pp. 259-268, 1997.
28. M. Gutierrez, M. Rebelo, and S. Furuie, "A multiresolution approach for computing myocardial motion," in Proc. IEEE-SP International Symposium Time-Frequency and Time-Scale Analysis, pp. 89-92, Pittsburgh, Pa, USA, October 1998.
29. M. Middendorf and H.-H. Nagel, "Estimation and interpretation of discontinuities in optical flow fields," in Proc. 8th IEEE International Conference Computer Vision, vol. 1, pp. 178-183, Vancouver, British Columbia, Canada, July 2001.
30. G. H. Golub and C. F. Van Loan, Matrix Computations, Jason Hopkins University Press, Baltimore, Md, USA, 1983.
31. A. J. Lipton, "Local application of optic flow to analyze rigid versus non-rigid motion," in Proc. ICCV Workshop on Frame-Rate Vision, Corfu, Greece, September 1999.
32. R. J. Larsen and M. L. Marx, An Introduction to Mathematical Statistics and Its Applications, Prentice-Hall, Englewood Cliffs, NJ, USA, 3rd edition, 2001.
33. T. Aach, A. Kaup, and R. Mester, "Statistical model-based change detection in moving video," Signal Processing, vol. 31, no. 2, pp. 165-180, 1993.
34. K.-K Ma and H.-Y. Wang, "Region-based nonparametric optical flow segmentation with preclustering and postclustering," in Proc. International Conference on Multimedia and Expo, vol. 2, pp. 201-204, Lausanne, Switzerland, August 2002.
35. I. Pitas, Digital Image Processing Algorithms, Prentice-Hall, Englewood Cliffs, NJ, USA, 1993.
36. B. K. P. Horn and B. G. Schunck, "Determining optical flow," Artificial Intelligence, vol. 17, no. 1-3, pp. 185-203, 1981.
37. J. Malo, J. Gutierrez, I. Epifanio, and F. J. Ferri, "Perceptually weighted optical flow for motion-based segmentation in MPEG-4 paradigm," Electronics Letters, vol. 36, no. 20, pp. 1693-1694, 2000.
38. Y. Altunbasak, P. E. Eren, and A. M. Tekalp, "Region-based parametric motion segmentation using color information," Journal of Graphical Models and Image Processing, vol. 60, no. 1, pp. 13-23, 1998.
39. M. Kim, J. G. Choi, D. Kim, et al., "A VOP generation tool: automatic segmentation of moving objects in image sequences based on spatio-temporal information," IEEE Trans. Circuits and Systems for Video Technology, vol. 9, no. 8, pp. 1216-1226, 1999.
40. A. G. Bors and I. Pitas, "Optical flow estimation and moving object segmentation based on median radial basis function network," IEEE Trans. Image Processing, vol. 7, no. 5, pp. 693-702, 1998.