A joint approach to global motion estimation and motion segmentation from a coarsely sampled motion vector field

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 21, Issue 9, 2011, Pages 1316-1328

  Chen, Yue Meng ^a   Bajic, Ivan V ^a  

^a SIMON FRASER UNIVERSITY   (Canada)

Author keywords

Global motion estimation; Markov random field; motion segmentation; outlier removal

Indexed keywords

CONTENT-BASED; GLOBAL MOTION; GLOBAL MOTION ESTIMATION; GLOBAL MOTION PARAMETERS; MARKOV RANDOM FIELDS; MOTION FIELDS; MOTION SEGMENTATION; MOTION VECTOR; MOTION VECTOR FIELD; MOVING OBJECTS; MOVING REGIONS; OBJECT SEGMENTATION; OUTLIER REMOVAL; REAL VIDEO SEQUENCES; SEGMENTATION ACCURACY; STATE-OF-THE-ART METHODS; VIDEO PROCESSING;

ESTIMATION; IMAGE CODING; IMAGE SEGMENTATION; OBJECT RECOGNITION; PARAMETER ESTIMATION; STATISTICS;

MOTION ESTIMATION;

EID: 80052541448     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2011.2148490     Document Type: Article

References (34)

1. C. Stiller and J. Konrad, "Estimating motion in image sequences," IEEE Signal Process. Mag., vol. 16, no. 6, pp. 70-91, Jul. 1999.
2. F. Dufaux and J. Konrad, "Efficient, robust and fast global motion estimation for video coding," IEEE Trans. Image Process., vol. 9, no. 3, pp. 497-501, Mar. 2000. (Pubitemid 30572352)
3. Y. Su, M.-T. Sun, and V. Hsu, "Global motion estimation from coarsely sampled motion vector field and the applications," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 2, pp. 232-242, Feb. 2005
4. MPEG-4 Video Verification Model Version v18.0, document N3908, ISO/IEC JTC1/SC29/WG11 Coding of Moving Pictures and Audio, Pisa, Italy, Jan. 2001.
5. A. Krutz, M. Frater, M. Kunter, and T. Sikora, "Windowed image registration for robust mosaicing of scenes with large background occlusions," in Proc. IEEE ICIP, Oct. 2006, pp. 353-356.
6. R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, 2nd ed. Cambridge, U.K.: Cambridge Univ. Press, Mar. 2004.
7. H. Xu, A. A. Younis, and M. R. Kabuka, "Automatic moving object extraction for content-based applications," IEEE Trans. Circuits Syst. Video Technol., vol. 14, no. 6, pp. 796-812, Jun. 2004.
8. B. Qi, M. Ghazal, and A. Amer, "Robust global motion estimation oriented to video object segmentation," IEEE Trans. Image Process., vol. 17, no. 6, pp. 958-967, Jun. 2008. (Pubitemid 351772612)
9. M. Kunter, A. Krutz, M. Mandal, and T. Sikora, "Optimal multiple sprite generation based on physical camera parameter estimation," in Proc. VCIP, vol. 6508, no. 2. Jan. 2007, pp. 1-10.
10. H. Alzoubi and W. D. Pan, "Efficient global motion estimation using fixed and random subsampling patterns," in Proc. IEEE ICIP, Sep. 2007, pp. 477-480.
11. A. Smolic, M. Hoeynck, and J.-R. Ohm, "Low-complexity global motion estimation from P-frame motion vectors for MPEG-7 application," in Proc. IEEE ICIP, Sep. 2000, pp. 271-274. (Pubitemid 32465611)
12. R. Wang and T. S. Huang, "Fast camera motion analysis in MPEG domain," in Proc. IEEE ICIP, Oct. 2006, pp. 353-356.
13. Y.-P. Tan, D. D. Saur, S. R. Kulkarni, and P. J. Ramadge, "Rapid estimation of camera motion from compressed video with application to video annotation," IEEE Trans. Circuits Syst. Video Technol., vol. 10, no. 1, pp. 133-146, Jun. 2000. (Pubitemid 30560010)
14. Y. Deng and B. S. Manjunath, "Unsupervised segmentation of color-texture regions in images and video," IEEE Trans. Patt. Anal. Mach. Intell., vol. 23, no. 8, pp. 800-810, Aug. 2001. (Pubitemid 32780009)
15. Z. Kato, T. C. Pong, and J. C. M. Lee. "Color image segmentation and parameter estimation in a Markovian framework," Patt. Recog. Lett., vol. 22, nos. 3-4, pp. 309-321, Mar. 2001. (Pubitemid 32376283)
16. W. Zeng, J. Du, W. Gao, and Q. Huang, "Robust moving object segmentation on H.264/AVC compressed video using the block-based MRF model," Real-Time Imag., vol. 11, no. 4, pp. 290-299, Aug. 2005. (Pubitemid 41085273)
17. J. Wang and E. Adelson, "Representing moving images with layers," IEEE Trans. Image Process., vol. 3, no. 5, pp. 625-638, Sep. 1994.
18. R. V. Babu, K. R. Ramakrishnan, and S. H. Srinivasan, "Video object segmentation: A compressed domain approach," IEEE Trans. Ciruits Syst. Video Technol., vol. 14, no. 4, pp. 462-474, Apr. 2004.
19. N. Vasconcelos and A. Lippman, "Empirical Bayesian motion segmentation," IEEE Trans. Patt. Anal. Mach. Intell., vol. 2, no. 2, pp. 217-221, Feb. 2001. (Pubitemid 32254714)
20. Z. Liu, Y. Lu, and Z. Zhang, "Real-time spatiotemporal segmentation of video objects in the H.264 compressed domain," J. Vis. Commun. Image Representat., vol. 18, no. 3, pp. 275-290, Jun. 2005.
21. J. Besag, "On the statistic analysis of dirty pictures," J. Royal Statist. Soc. B, vol. 48, no. 3, pp. 259-302, 1986.
22. M. Fischler and R. Bolles, "Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography," Commun. ACM, vol. 24, no. 6, pp. 381-395, Jun. 1981. (Pubitemid 12444102)
23. A. Dante and M. Brookes, "Precise real-time outlier removal from motion vector fields for 3D reconstruction," in Proc. IEEE ICIP, Sep. 2003, pp. 393-396.
24. S. Tubaro and S. Rocca, "Motion field estimators and their application to image interpolation," in Motion Analysis and Image Sequence Processing, M. I. Sezan and R. L. Lagendijk, Eds. Norwell, MA: Kluwer, 1993, pp. 153-187.
25. D. Farin, "Automatic video segmentation employing object/camera modeling techniques," Ph.D. thesis, Dept. Electric. Eng., Eindhoven Univ. Technol., Eindhoven, The Netherlands, 2005.
26. M. Haller, A. Krutz, and T. Sikora, "Evaluation of pixel-and motion vector-based global motion estimation for camera motion characterization," in Proc. WIAMIS, May 2009, pp. 49-52.
27. Y.-M. Chen, I. V. Bajić, and P. Saeedi, "Coarse-to-fine moving region segmentation in compressed video," in Proc. IEEE WIAMIS, May 2009, pp. 45-48.
28. Y.-M. Chen and I. V. Bajić, "Motion vector outlier rejection cascade for global motion estimation," IEEE Signal Process. Lett., vol. 17, no. 2, pp. 197-200, Feb. 2010.
29. Y. Su and M.-T. Sun, "A non-iterative motion vector based global motion estimation algorithm," in Proc. IEEE ICME, Aug. 2004, pp. 703-706. (Pubitemid 40063131)
30. D. Wang and L. Wang, "Global motion parameters estimation using a fast and robust algorithm," IEEE Trans. Circuits Syst. Video Technol., vol. 7, no. 5, pp. 823-826, Oct. 1997. (Pubitemid 127765245)
31. C. Poppe, S. D. Bruyne, T. Paridaens, P. Lambert, and R. V. D. Walle, "Moving object detection in the H.264/AVC compressed domain for video surveillance applications," J. Vis. Commun. Image Representat., vol. 20, no. 6, pp. 428-437, Aug. 2009.
32. H. Hadizadeh and I. V. Bajić, "NAL-SIM: An interactive simulator for H.264/AVC video coding and transmission," in Proc. IEEE CCNC, Jan. 2010, pp. 1-2.
33. L. Cloutier, A. Mitiche, and P. Bouthemy, "Segmentation and estimation of image motion by a robust method," in Proc. IEEE ICIP, Nov. 1994, pp. 805-809.
34. M. M. Chang, A. M. Tekalp, and M. I. Sezan, "Simultaneous motion estimation and segmentation," IEEE Trans. Image Process., vol. 6, no. 9, pp. 1326-1333, Sep. 1997 (Pubitemid 127776974)