Video object tracking in the compressed domain using spatio-temporal Markov random fields

IEEE Transactions on Image Processing

Volumn 22, Issue 1, 2013, Pages 300-313

  Khatoonabadi, Sayed Hossein ^a   Bajić, Ivan V ^a  

^a SIMON FRASER UNIVERSITY   (Canada)

Author keywords

Compressed domain video object tracking; H.264 AVC; spatio temporal Markov random field (ST MRF)

Indexed keywords

BIT STREAM; BLOCK CODING; BLOCK MOTION; COMPRESSED DOMAIN; GLOBAL MOTION COMPENSATION; H.264/AVC; MARKOV RANDOM FIELDS; MOTION VECTORS; PIXEL DOMAIN; REASONABLE ACCURACY; RECENT PROGRESS; SPATIO-TEMPORAL; STATE-OF-THE-ART METHODS; TEMPORAL ASPECTS; TRACKING MOVING OBJECTS; VIDEO OBJECT TRACKING; VIDEO SEQUENCES;

IMAGE CODING; IMAGE COMPRESSION; IMAGE SEGMENTATION; MOTION COMPENSATION; MOTION PICTURE EXPERTS GROUP STANDARDS; TRACKING (POSITION);

STRUCTURAL FRAMES;

EID: 84871646421     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2012.2214049     Document Type: Article

References (40)

1. M. G. Arvanitidou, M. Tok, A. Krutz, and T. Sikora, "Short-term motion-based object segmentation," in Proc. IEEE Int. Conf. Multimedia Expo, Barcelona, Spain, Jul. 2011, pp. 1-6.
2. C. Aeschliman, J. Park, and A. C. Kak, "A probabilistic framework for joint segmentation and tracking," in Proc. IEEE Comput. Vis. Pattern Recognit., San Francisco, CA, Jun. 2010, pp. 1371-1378.
3. D. Comaniciu, V. Ramesh, and P. Meer, "Kernel-based object tracking," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 5, pp. 564-575, May 2003.
4. T. Drummond and R. Cipolla, "Real-time visual tracking of complex structures," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 7, pp. 932-946, Jul. 2002. (Pubitemid 34835468)
5. Z. Kato, T.-C. Pong, and J. C.-M. Lee, "Color image segmentation and parameter estimation in a Markovian framework," Pattern Recognit. Lett., vol. 22, nos. 3-4, pp. 309-321, 2001. (Pubitemid 32376283)
6. Z. Yin and R. Collins, "Belief propagation in a 3D spatio-temporal MRF for moving object detection," in Proc. IEEE Comput. Vis. Pattern Recognit., Jun. 2007, pp. 1-8.
7. Y. Wang, K.-F. Loe, T. Tan, and J.-K. Wu, "Spatiotemporal video segmentation based on graphical models," IEEE Trans. Image Process., vol. 14, no. 7, pp. 937-947, Jul. 2005. (Pubitemid 40889988)
8. R. Huang, V. Pavlovic, and D. N. Metaxas, "A new spatio-temporal MRF framework for video-based object segmentation," in Proc. MLVMA Conjunct. Eur. Conf. Comput. Vis., 2008, pp. 1-12.
9. Y. Wang, "A dynamic conditional random field model for object segmentation in image sequences," in Proc. IEEE Comput. Vis. Pattern Recognit., vol. 1. Jun. 2005, pp. 264-270.
10. A. Cherian, J. Andersh, V. Morellas, N. Papanikolopoulos, and B. Mettler, "Autonomous altitude estimation of a UAV using a single onboard camera," in Proc. IEEE Int. Conf. Intell. Robots Syst., Oct. 2009, pp. 3900-3905.
11. Z. Liu, Y. Lu, and Z. Zhang, "Real-time spatiotemporal segmentation of video objects in the H.264 compressed domain," J. Visual Commun. Image Represent., vol. 18, no. 3, pp. 275-290, 2007. (Pubitemid 46680551)
12. Z. Liu, L. Shen, and Z. Zhang. "An efficient compressed domain moving object segmentation algorithm based on motion vector field," J. Shanghai Univ. (English Ed.), vol. 12, no. 3, pp. 221-227, 2008.
13. W. Fei and S. Zhu, "Mean shift clustering-based moving object segmentation in the H.264 compressed domain," IET Image Process., vol. 4, no. 1, pp. 11-18, Feb. 2010.
14. V. Mezaris, I. Kompatsiaris, N. V. Boulgouris, and M. G. Strintzis, "Real-time compressed-domain spatiotemporal segmentation and ontologies for video indexing and retrieval," IEEE Trans. Circuits Syst. Video Technol., vol. 14, no. 5, pp. 606-621, May 2004.
15. C. Käs and H. Nicolas, "An approach to trajectory estimation of moving objects in the H.264 compressed domain," in Proc. 3rd Pacific Rim Symp. Adv. Image Video Technol., LNCS 5414. 2009, pp. 318-329.
16. S. Treetasanatavorn, U. Rauschenbach, J. Heuer, and A. Kaup, "Bayesian method for motion segmentation and tracking in compressed videos," in Proc. 27th DAGM Conf. Pattern Recognit., LNCS 3663. 2005, pp. 277-284. (Pubitemid 41520665)
17. S. Treetasanatavorn, U. Rauschenbach, J. Heuer, and A. Kaup, "Model based segmentation of motion fields in compressed video sequences using partition projection and relaxation," in Proc. Visual Commun. Image Process., Beijing, China, Jul. 2005, pp. 111-120. (Pubitemid 43233105)
18. S. Treetasanatavorn, U. Rauschenbach, J. Heuer, and A. Kaup, "Stochastic motion coherency analysis for motion vector field segmentation on compressed video sequences," in Proc. IEEE Workshop Image Anal. Multimedia Interact. Services, Apr. 2005, pp. 1-4.
19. W. Zeng, J. Du, W. Gao, and Q. Huang, "Robust moving object segmentation on H.264/AVC compressed video using the block-based MRF model," Real-Time Imaging, vol. 11, no. 4, pp. 290-299, Aug. 2005. (Pubitemid 41085273)
20. Y.-M. Chen and I. V. Bajic, "A joint approach to global motion estimation and motion segmentation from a coarsely sampled motion vector field," IEEE Trans. Circuits Syst. Video Technol., vol. 21, no. 9, pp. 1316-1328, Sep. 2011.
21. Y.-M. Chen, I. V. Bajic, and P. Saeedi, "Moving region segmentation from compressed video using global motion estimation and Markov random fields," IEEE Trans. Multimedia, vol. 13, no. 3, pp. 421-431, Jun. 2011.
22. Y.-M. Chen, I. V. Bajic, and P. Saeedi, "Motion segmentation in compressed video using Markov random fields," in Proc. IEEE Int. Conf. Multimedia Expo, Singapore, Jul. 2010, pp. 760-765.
23. W. You, M. S. H. Sabirin, and M. Kim, "Moving object tracking in H.264/AVC bitstream," in Proc. Int. Workshop Multimedia Content Anal. Mining, LNCS 4577. 2007, pp. 483-492. (Pubitemid 350270592)
24. W. You, M. S. H. Sabirin, and M. Kim, "Real-time detection and tracking of multiple objects with partial decoding in H.264/AVC bitstream domain," Proc. SPIE, Real-Time Image Video Process., vol. 7244, pp. 72440D-1-72440D-12, Mar. 2009.
25. C. Niu and Y. Liu, "Moving object segmentation in the H.264 compressed domain," in Proc. Asian Conf. Comput. Vis. Conf., LNCS 5995. 2009, pp. 645-654.
26. T. Wiegand, G. J. Sullivan, G. Bjontegaard, and A. Luthra, "Overview of the H.264/AVC video coding standard," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 7, pp. 560-576, Jul. 2003.
27. P. Vandewalle, J. Kovacevic, and M. Vetterli, "Reproducible research in signal processing," IEEE Signal Process. Mag., vol. 26, no. 3, pp. 37-47, May 2009.
28. J. E. Besag, "Spatial interaction and the statistical analysis of lattice systems," J. Royal Stat. Soc., Ser. B, vol. 36, no. 2, pp. 192-236, 1974.
29. J. Besag, "On the statistical analysis of dirty pictures," J. Royal Stat. Soc. B, vol. 48, no. 3, pp. 259-302, 1986.
30. P. J. Rousseeuw and A. M. Leroy, Robust Regression and Outlier Detection. New York: Wiley, 2003.
31. R. Venables and B. Ripley, Modern Applied Statistics with S. New York: Springer-Verlag, 2002, pp. 119-126.
32. P. J. Rousseeuw and C. Croux, "Alternatives to the median absolute deviation," J. Amer. Stat. Assoc., vol. 88, no. 424, pp. 1273-1283, 1993.
33. Y. Hu and T. J. Dennis, "Simulated annealing and iterated conditional modes with selective and confidence enhanced update schemes," in Proc. 5th Annu. IEEE Symp. Comput.-Based Med. Syst., Jun. 1992, pp. 257-264.
34. S. Geman and D. Geman, "Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images," IEEE Trans. Pattern Anal. Mach. Intell., vol. 6, no. 6, pp. 721-741, Nov. 1984. (Pubitemid 15453722)
35. R. Szeliski, R. Zabih, D. Scharstein, O. Veksler, V. Kolmogorov, A. Agarwala, M. Tappen, and C. Rother, "A comparative study of energy minimization methods for Markov random fields," in Proc. Eur. Conf. Comput. Vis., LNCS 3952. 2006, pp. 16-29. (Pubitemid 44029714)
36. J. Astola, P. Haavisto, and Y. Neuvo, "Vector median filters," Proc. IEEE, vol. 78, no. 4, pp. 678-689, Apr. 1990. (Pubitemid 20702858)
37. R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vis ion, 2nd ed. Cambridge, U.K.: Cambridge Univ. Press, 2004, pp. 39-44.
38. M. G. Arvanitidou, A. Glantz, A. Krutz, T. Sikora, M. Mrak, and A. Kondoz, "Global motion estimation using variable block sizes and its application to object segmentation," in Proc. IEEE Workshop Image Anal. Multimedia Interact. Services, London, U.K., May 2009, pp. 173-176.
39. A. Smolic, M. Hoeynck, and J.-R. Ohm, "Low-complexity global motion estimation from P-frame motion vectors for MPEG-7 applications," in Proc. IEEE Int. Conf. Image Process., vol. 2. Vancouver, BC, Canada, Sep. 2000, pp. 271-274. (Pubitemid 32465611)
40. H.264/AVC Reference Software JM18.0. (2012, Aug.) [Online]. Available: http://iphome.hhi.de/suehring/tml