Video processing via implicit and mixture motion models

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 17, Issue 8, 2007, Pages 953-963

  Li, Xin ^a,b  

^a IEEE

^b West Virginia University   (United States)

Author keywords

Implicit motion estimation; Least squares method; Mixture model; Video processing; Virtual camera

Indexed keywords

CAMERAS; IMAGE SEGMENTATION; LEAST SQUARES APPROXIMATIONS; MOTION ESTIMATION; SPACE TIME ADAPTIVE PROCESSING; VIRTUAL REALITY;

IMPLICIT MOTION ESTIMATION; IMPULSE REMOVAL; MIXTURE MODELS; VIDEO DEJITTERING;

VIDEO SIGNAL PROCESSING;

EID: 34548279333     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2007.896656     Document Type: Article

References (42)

1. P. M. Q. Aguiar and J. M. F. Moura, "Figure-ground segmentation from, occlusion," IEEE Trans. Image Process., vol. 14, no. 8, pp. 1109-1124, Aug. 2005.
2. G. Aubert and P. Kornprobst, Mathematical Problems in Image Processing: Partial Differential Equations and the Calculus of Variations. Berlin, Germany: Springer-Verlag, 2002, vol. 147, Applied Mathematical Sciences.
3. T. Chen and H. R. Wu, "Adaptive impulse detection using center-weighted median filters," IEEE Signal Process. Lett., vol. 8, no. 1, pp. 1-3, Jan. 2001.
4. A. Criminisi, P. Perez, and K. Toyama, "Region filling and object removal by exemplar-based image inpainting," IEEE Trans. Image. Process., vol. 13, no. 9, pp. 1200-1212, Sep. 2004.
5. Y. N. Deng and B. S. Manjunath, "Netra-v: Toward an object-based video representation," IEEE Trans. Circuits Syst. Video Technol., vol. 8, no. 5, pp. 616-627, Sep. 1998.
6. W. T. Freeman and E. H. Adelson, "The design and use of steerable filters," IEEE Trans. Pattern Anal. Mach. Intell., vol. 13, no. 9, pp. 891-906, Sep. 1991.
7. B. Girod, A. Aaron, S. Rane, and D. Rebollo-Monedero, "Distributed video coding," Proc. IEEE, vol. 93, no. 1, pp. 71-83, Jan. 2005.
8. H. S. Sawhney, H. Tao, and R. Kumar, "Object tracking with bayesian estimation of dynamic layer representations," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 1, pp. 75-89, Jan. 2002.
9. M. Wainwright, J. Portilla, V. Strela, and E. Simoncelli, "Image denoising using scale mixtures of Gaussians in the wavelet domain," IEEE Trans. Image Process., vol. 12, no. 11, pp. 1338-1351, Nov. 2003.
10. N. S. Jayant and P. Noll, Digital Coding of Waveforms: Principles and Applications to Speech and Video. Englewood Cliffs, NJ: Prentice-Hall, 1984.
11. A. D. Jepson and M. J. Black, "Mixture models for optical flow computation," in Proc. CVPR, 1993, pp. 760-761.
12. N. Jojic and B. J. Frey, "Learning flexible sprites in video layers," in Proc. CVPR, 2001, pp. 1:199-1:206.
13. ISO/IEC JTC1. Coding of Audio-Visual Objects-Part 2: Visual., ISO/IEC 14496-2, 1999, (MPEG-4 visual version 1).
14. F. Lauze and M. Nielsen, "A variational algorithm for motion compensated inpainting," presented at the BMVC, 2004 [Online]. Available: http://www.bmva.ac.uk/bmvc/2004/B>VC_2004a.html
15. W. Li, "Overview of fine granularity scalability in MPEG-4 video standard," IEEE Trans. Circuits Syst. Video Technol., vol. 11, no. 3, pp. 301-317, Mar. 2001.
16. X. Li, "Edge directed statistical inference and its applications to image processing," Ph.D. dissertation, Dept. Elect. Eng., Princeton Univ., Princeton, NJ, 2000.
17. X. Li, "Least-square based prediction for backward adaptive video coding," EURASIP J. Appl Signal Process., Special Issue on H.264 and Beyond, ID 90542, 2006 [Online], Available: http://www.hindawi.com/ GetArticle.aspx?doi=10.155/ASP/2006/90542
18. X. Li and M. Orchard, "Novel sequential error concealment techniques using orientation adaptive interpolation," IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 10, pp. 857-864, Oct. 2002.
19. A. Litvin, J. Konrad, and W. C. Karl, "Probabilistic video stabilization using Kaiman filtering and mosaicing," in Proc. SPIE Image Video Commun. Process., B. Vasudev, T. R. Hsing, A. G. Tescher, and T. Ebrahimi, Eds., May 2003, pp. 663-674.
20. D. Marpe and H. L. Cycon, "Rate-constrained multihypothesis prediction, for motion-compensated video compression," IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 11, pp. 957-969, Nov. 2002.
21. D. Marpe, H. Schwarz, and T. Wiegand, "Context-based adaptive binary arithmetic coding in the H.264/AVC video compression standard," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 7, pp. 620-636, Jul. 2003.
22. C.-W. Ngo, T.-C. Pong, and H.-J. Zhang, "Motion analysis and segmentation through spatio-temporal slices processing," IEEE Trans. Image Process., vol. 12, no. 3, pp. 341-355, Mar. 2003.
23. M. Orchard and G. Sullivan, "Overlapped block motion compensation: An estimation-theoretic approach," IEEE Trans. Image Process., vol. 3, no. 5, pp. 693-699, Sep. 1994.
24. S. C. Park, M. K. Park, and M. G. Kang, "Super-resolution image reconstruction: A technical overview," IEEE Signal Process. Mag., vol. 20, no. 5, pp. 21-36, May 2003.
25. C. Rasmussen and T. Korah, "Spatiotemporal inpainting for recovering texture maps of partially occluded building facades," in Proc. ICIP, 2005, pp. 111:125-111:128.
26. S. Roth and M. J. Black, "On the spatial statistics of optical flow," in Proc. Int. Conf Comp. Vision, 2005, pp. 1:42-1:49.
27. P. Salama, N. B. Shroff, E. J. Coyle, and E. J. Delp, "Error concealment techniques for encoded video streams," in Proc. ICIP, 1995, pp. 9-12.
28. E. Simoncelli, "Distributed representation and analysis of visual motion," Ph.D. dissertation, Dept. Elect. Eng. Comp. Sci., Mass. Inst. Technol., Cambridge, MA, Jan. 1993.
29. S. Srinivasan and R. Chellappa, "An integrated approach to image stabilization, mosaicking and super-resolution," in Proc. DARPA, 1997, pp. 247-254.
30. G. J. Sullivan and T. Wiegand, "Video compression-From concepts to the H.264/AVC standard," Proc. IEEE, vol. 93, no., pp. 18-31, Jan. 2005.
31. M. Szummer and R. W. Picard, "Temporal texture modeling," in Proc. Int. Conf. Image Process., 1996, pp. 823-826.
32. D. Taubman. and A. Zakhor, "Multi-rate 3d subband coding of video," IEEE Trans. Image Process., vol. 3, no. 5, pp. 572-588, Sep. 1994.
33. A. M. Tekalp, Digital Video Processing. Englewood Cliffs, NJ: Prentice-Hall, 1995.
34. C. Tomasi and R. Manduchi, "Bilateral filtering for gray and color images," in Proc. ICCV, 1998, pp. 839-846.
35. A. Tourapis, H. Cheong, M. Liou, and O. Au, "Temporal interpolation of video sequences using zonal based algorithms," in Proc. IEEE Int. Conf. Image Process., 2001, pp. 895-898.
36. J. Y. A. Wang and E. H. Adelson, "Representing moving images with layers," IEEE Trans. Image Process., vol. 3, no. 5, pp. 625-638, Sep. 1994.
37. Y. Wang and Q.-F. Zhu, "Error control and concealment for video communication: A review," Proc. IEEE, vol. 86, no. 5, pp. 974-997, May 1998.
38. M. J. Weinberger, G. Seroussi, and G. Sapiro, "The LOCO-I lossless image compression algorithm: Principles and standardization into JPEG-LS," IEEE Trans. Image Process., vol. 9, no. 8, pp. 1309-1324, Aug. 2000.
39. Y. Weiss and E. H. Adelson, "Smoothness in layers: Motion segmentation using nonparametric mixture estimation," in Proc. IEEE Int. Conf. Comp. Vis. Pattern Recognit., 1997, p. 520.
40. Y. Wexler, E. Shechtman, and M. Irani, "Space-time video completion," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit, 2004, pp. 120-127.
41. H. J. Zhang, A. Kankanhalli, and S. W. Smoliar, "Automatic partitioning of full-motion video," Multimedia Syst., vol. 1, no. 1, pp. 10-28, 1993.
42. W. Y. Zhao, "Motion-based spatial-temporal image repairing," in Proc. ICIP, 2004, pp. 1:291-1:294.