Automatic moving object extraction for content-based applications

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 14, Issue 6, 2004, Pages 796-812

  Xu, Haifeng ^a   Younis, Akmal A ^b   Kabuka, Mansur R ^b  

^a MOTOROLA INC   (United States)

^b UNIVERSITY OF MIAMI   (United States)

Author keywords

Hausdorff distance; Motion segmentation; Object tracking; Robust estimation; Watershed transformation

Indexed keywords

ALGORITHMS; DATA COMPRESSION; ENCODING (SYMBOLS); IMAGE SEGMENTATION; INTERNET; MATHEMATICAL MODELS; MULTIMEDIA SYSTEMS; SIGNAL FILTERING AND PREDICTION;

HAUSDORFF DISTANCE; MOTION SEGMENTATION; OBJECT TRACKING; ROBUST ESTIMATION; WATERSHED TRANSFORMATION;

OBJECT RECOGNITION;

EID: 2942683170     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2004.828338     Document Type: Article

References (56)

1. F. Idris and S. Panchanathan, "A review of image and video indexing techniques," J. Vis. Commun. Image Represent., vol. 8, no. 2, pp. 146-166, June 1997.
2. H. Xu, E. El-Kwae, A. Younis, and M. Kabuka, "Efficient multi-resolution video partitioning in video databases," in Proc. 6th Int. Workshop Multimedia Information Systems, Chicago, IL, Oct. 26-28, 2000, pp. 4-13.
3. H. J. Zhang, J. Wu, D. Zhong, and S. Smoliar, "An integrated system for content-based video retrieval and browsing," Pattern Recognit., vol. 30, no. 4, pp. 643-658, Apr. 1997.
4. Overview of the MPEG-4 Standard, ISO/IEC JTC1/SC29/WG11, Mar. 2001.
5. F. Moscheni, S. Bhattacharjee, and M. Kunt, "Spatiotemporal segmentation based on region merging," IEEE Trans. Pattern Anal. Machine Intell., vol. 20, pp. 897-915, Sept. 1998.
6. E. R. Dougherty, Mathematical Morphology in Image Processing. New York: Marcel Dekker, 1992.
7. S. R. Sternberg, "Grayscale morphology," Comput. Vis., Graph., Image Process., vol. 35, no. 3, pp. 333-355, Sept. 1996.
8. F. Meyer and S. Beucher, "Morphological segmentation," J. Vis. Commun. Image Representation, vol. 1, no. 1, pp. 21-46, Oct. 1990.
9. P. Salembier and M. Paradas, "Hierarchical morphological segmentation for image sequence coding," IEEE Trans. Image Processing, vol. 3, pp. 639-651, Sept. 1994.
10. M. Pardas and P. Salembier, "3-D morphological segmentation and motion estimation for image sequences," Signal Process., vol. 38, no. 1, pp. 31-43, Sept. 1994.
11. D. Wang, "Unsupervised video segmentation based on watersheds and temporal tracking," IEEE Trans. Circuits Syst. Video Technol., vol. 8, pp. 539-546, Sept. 1998.
12. A. Neri, S. Colonnese, G. Russo, and P. Talone, "Automatic moving object and background separation," Signal Process., vol. 66, no. 2, pp. 219-232, Apr. 1998.
13. C. Kim and J.-N. Hwang, "Fast and automatic video object segmentation and tracking for content-based applications," IEEE Trans. Circuits Syst. Video Technol., vol. 12, pp. 122-129, Feb. 2002.
14. T. Meier and K. N. Ngan, "Automatic segmentation of moving objects for video object plane generation," IEEE Trans. Circuits Syst. Video Technol., vol. 8, pp. 525-538, Sept. 1998.
15. D. P. Huttenlocher, J. J. Noh, and W. J. Rucklidge, "Tracking Non-Rigid Objects in Complex Scenes," Dept. of Computer Science, Cornell Univ., Tech. Rep. 1320, 1992.
16. A. Singh, Optical Flow Computation: A Unified Perspective. Los Alamitos, CA: IEEE Computer Soc. Press, 1991.
17. P. J. Huber, Robust Statistics. New York: Wiley, 1981.
18. F. R. Hampel, P. J. Rousseeuw, E. Ronchetti, and W. A. Stahel, Robust Statistics: The Approach Based on Influence Functions. New York: Wiley, 1986.
19. C.V. Stewart, "Bias in robust estimation caused by discontinuities and multiple structures," IEEE Trans. Pattern Anal. Machine Intell., vol. 19, pp. 818-833, Aug. 1997.
20. T. Darrel and A. P. Pentland, "Cooperative robust estimation using layers of support," IEEE Trans. Pattern Anal. Machine Intell., vol. 17, pp. 474-487, May 1995.
21. J. Y. A. Wang and E. H. Adelson, "Representing moving images with layers," IEEE Trans. Image Processing, vol. 3, pp. 625-638, Sept. 1994.
22. M. Black, "The robust estimation of multiple motions: Parametric and piecewise-smooth flow fields," Comput. Vis. Image Understand., vol. 63, pp. 75-104, Jan. 1996.
23. L. Patras, E. A. Hendriks, and R. L. Lagendijk, "Video segmentation by MAP labeling of watershed segments," IEEE Trans. Pattern Anal. Machine Intell., vol. 23, pp. 326-332, Mar. 2001.
24. Y. Huang, K. Palaniappan, X. Zhuang, and J. E. Cavanaugh, "Optic flow field segmentation and motion estimation using a robust genetic partitioning algorithm," IEEE Trans. Pattern Anal. Machine Intell., vol. 17, pp. 1177-1190, Dec. 1995.
25. D. K. Panjwani and G. Healey, "Markov random field models for unsupervised segmentation of textured color images," IEEE Trans. Pattern Anal Machine Intell., vol. 17, pp. 939-954, Oct. 1995.
26. B. Carpentieri and J. A. Storer, "Split-merge video displacement estimation," Proc. IEEE, vol. 82, pp. 940-947, June 1994.
27. F. Dufaux, F. Moscheni, and A. Lippman, "Spatio-temporal segmentation based on motion and static segmentation," in Proc. ICIP'95, vol. 1, Washington, DC, Oct. 1995, pp. 306-309.
28. O. Adiv, "Determining three-dimensional motion and structure from optical flow generated by several moving objects," IEEE Trans. Pattern Anal. Machine Intell., vol. 7, pp. 384-401, July 1985.
29. A. Papoulis, Probability, Random Variables, and Stochastic Processes. New York: McGraw-Hill, 1991.
30. W. H. Press, S. A. Teukolsky, W. T. Vetterling, and B. P. Flannery, Numerical Recipes in C. Cambridge, U.K.: Cambridge Univ. Press, 1992.
31. D.P. Huttenlocher, G. A. Klanderman, and W. J. Rucklidge, "Comparing images using the Hausdorff distance," IEEE Trans. Pattern Anal. Machine Intell., vol. 15, pp. 850-863, Sept. 1993.
32. G. Borgefors, "Distance transformations in digital images," Comput. Vis., Graph., Image Process., vol. 34, no. 3, pp. 344-371, 1986.
33. L. Vincent and P. Soille, "Watersheds in digital spaces: An efficient algorithm based on immersion simulations," IEEE Trans. Pattern Anal. Machine Intell., vol. 13, pp. 583-598, June 1991.
34. I. Kompatsiaris and M. G. Strintzis, "Spatiotemporal segmentation and tracking objects for visualization of video conference image sequences," IEEE Trans. Circuits Syst. Video Technol., vol. 10, pp. 1388-1402, Dec. 2000.
35. P. J. Burt, R. Hingorani, and R. J. Kolczynski, "Mechanisms for isolating component patterns in the sequential analysis of multiple motion," in Proc. IEEE Workshop on Visual Motion, Princeton, NJ, Oct. 7-9, 1991, pp. 187-193.
36. M. Hötter and R. Thoma, "Image segmentation based on object oriented mapping parameter estimation," Signal Process., vol. 15, no. 3, pp. 315-334, Oct. 1988.
37. P. Bouthemy and E. Francois, "Motion segmentation and qualitative dynamic scene analysis from an image sequence," Int. J. Comput. Vis., vol. 10, no. 2, pp. 157-182, 1993.
38. R. Mech and M. Wollborn, "A noise robust method for 2D shape estimation of moving objects in video sequences considering a moving camera," Signal Process., vol. 66, no. 2, pp. 203-217, Apr. 1998.
39. T. Meier and K. N. Ngan, "Video segmentation for content-based coding," IEEE Trans. Circuits Syst. Video Technol., vol. 9, pp. 1190-1203, Dec. 1999.
40. S.-Y. Chien, S.-Y. Ma, and L.-G. Chen, "Efficient moving object segmentation algorithm using background registration technique," IEEE Trans. Circuits Syst. Video Technol., vol. 12, pp. 577-586, July 2002.
41. Y. Tsaig and A. Averbuch, "Automatic segmentation of moving objects in video sequences: A region labeling approach," IEEE Trans. Circuits Syst. Video Technol., vol. 12, pp. 597-612, July 2002.
42. J. G. Choi, S. W. Lee, and S. D. Kim, "Spatio-temporal video segmentation using a joint similarity measure," IEEE Trans. Circuits Syst. Video Technol., vol. 7, pp. 279-286, Apr. 1997.
43. P. Salembier, P. Brigger, J. R. Casas, and M. Pardas, "Morphological operators for image and video compression," IEEE Trans. Image. Processing, vol. 5, pp. 881-898, June 1996.
44. F. Marques and C. Molina, "Object tracking for content-based functionalities," in Proc. SPIE Visual Communications Image Processing, vol. 3024, San Jose, CA, Feb. 1997, pp. 190-199.
45. P. V. C. Hough, "Machine analysis of bubble chamber pictures," in Proc. Int. Conf. High Energy Accelerators and Instrumentation, CERN, 1959, pp. 554-556.
46. Y. Zhong, A. K. Jain, and M.-P. Dubuisson-Jolley, "Object tracking using deformable templates," IEEE Trans. Pattern Anal Machine Intell., vol. 22, pp. 544-549, May 2000.
47. N. Paragios and R. Deriche, "Geodesic active contours and level sets for the detection and tracking of moving objects," IEEE Trans. Pattern Anal. Machine Intell., vol. 22, pp. 266-280, Mar. 2000.
48. G. D. Borshukov, G. Bozdagi, Y. Altunbasak, and A. M. Tekalp, "Motion segmentation by multistage affine classification," IEEE Trans. Image Processing, vol. 6, pp. 1591-1594, Nov. 1997.
49. M. M. Chang, A. M. Tekalp, and M. I. Sezan, "Motion-field segmentation using adaptive MAP criterion," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, vol. V, Minneapolis, MN, Apr. 1993, pp. 33-36.
50. D. W. Murray and B. F. Buxton, "Scene segmentation from visual motion using global optimisatinn," IEEE Trans. Pattern Anal. Machine Intell., vol. 9, pp. 220-228, Mar. 1987.
51. M. M. Chang, M. I. Sezan, and A. M. Tekalp, "An algorithm for simultaneous motion estimation and scene segmentation," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, vol. V, Adelaide, Australia, Apr. 1994, pp. 221-224.
52. M. M. Chang, A. M. Tekalp, and M. I. Sezan, "Simultaneous motion estimation and segmentation," IEEE Trans. Image Processing, vol. 6, pp. 1326-1333, Sept. 1997.
53. C. Stiller, "Object-based estimation of dense motion fields," IEEE Trans. Image Processing, vol. 6, pp. 234-250, Feb. 1997.
54. _, "A statistical image model for motion estimation," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, vol. V, Minneapolis, MN, Apr. 1993, pp. 193-196.
55. E. Tuncel and L. Onural, "Utilization of the recursive shortest spanning tree algorithm for video object segmentation by 2-D affine motion modeling," IEEE Trans. Circuits Syst. Video Technol., vol. 10, pp. 776-781, Aug. 2000.
56. A. A. Alatan, L. Onural, M. Wollborn, R. Mech, E. Tuncel, and T. Sikora, "Image sequence analysis for emerging interactive multimedia sevices - The European COST 211 framework," IEEE Trans. Circuits Syst. Video Technol., vol. 8, pp. 802-813, Nov. 1998.