Motion-compensated frame rate up-conversion- Part I: Fast multi-frame motion estimation

IEEE Transactions on Broadcasting

Volumn 56, Issue 2, 2010, Pages 133-141

  Wang, Demin ^a   Zhang, Liang ^a   Vincent, André ^a  

^a Industry Canada   (Canada)

Author keywords

Frame interpolation; Frame rate conversion; MAP estimation; Motion estimation; Video processing

Indexed keywords

ACCURATE MOTION; BLOCK MATCHING ALGORITHMS; COMPUTATIONAL COSTS; FRAME INTERPOLATION; FRAME RATE; FRAME RATE CONVERSION; FRAME RATE UP-CONVERSION; FULL SEARCH; GLOBAL MINIMA; KEY ELEMENTS; LOOK UP TABLE; MAP ESTIMATION; MAXIMUM A POSTERIORI PROBABILITIES; MOTION ESTIMATION ALGORITHM; MOTION FIELDS; MOTION TRAJECTORIES; MULTI-FRAME MOTION ESTIMATION; PERCEIVED QUALITY; TEMPORAL CORRELATIONS; VIDEO PROCESSING;

ALGORITHMS; COST REDUCTION; ESTIMATION; INTERPOLATION; MOTION COMPENSATION; OPTIMIZATION; TABLE LOOKUP; VIDEO SIGNAL PROCESSING;

MOTION ESTIMATION;

EID: 77953026776     PISSN: 00189316     EISSN: None     Source Type: Journal    
DOI: 10.1109/TBC.2010.2043896     Document Type: Article

References (28)

1. Q. Huynh-thu and M. Ghanbari, "Temporal aspect of perceived quality in mobile video broadcasting," IEEE Trans. Broadcasting, vol.54, no.3, pp. 641-651, Sep. 2008
2. I. P. Gunawan and M. Ghanbari, "Efficient reduced-reference video quality meter," IEEE Trans. Broadcasting, vol.54, no.3, pp. 669-679, Sep. 2008.
3. D. Wang et al., "Towards optimal rate control: A study of the impact of spatial resolution, frame rate, and quantization on subjective video quality and bit rate," in Visual Communications and Image Processing 2003, Lugano, Switzerland, Jul. 8-11, 2003, pp. 198-209.
4. R. Feghali, F. Speranza, D. Wang, and A. Vincent, "Video quality metric for bit rate control via joint adjustment of quantization and frame rate," IEEE Trans. Broadcasting, vol.33, no.1, pt. II, pp. 441-446, Mar. 2007.
5. P. Blanchfield, D. Wang, A. Vincent, F. Speranza, and R. Renaud, "Advanced frame rate conversion and performance evaluation," The SMPTE Motion Imaging Journal, pp. 153-159, Apr. 2006.
6. D. Wang et al., "Motion-compensated frame rate conversion-Part II: New algorithms for frame interpolation," IEEE Trans. Broadcasting, vol.56, no.2, Jun. 2010.
7. M. Tekalp, Digital Video Processing. Englewood Cliffs, NJ: Prentice Hall, 1995.
8. Y. Wang, J. Ostermann, and Y.-Q. Zhang, Video Processing and Communications. Englewood Cliffs, NJ: Prentice Hall, 2002.
9. P. M. Muhn et al., "Complexity and PSNR-comparison for several fast motion estimation algorithms for MPEG-4," in SPIE Vol. 3460 Applications of Digital Image Processing XXI, San Diego, California, Jul. 1998, pp. 486-499.
10. F. Dufaux and M. Kunt, "Multigrid block matching motion estimation with an adaptive local mesh refinement," in SPIE Vol. 1818 Visual Communications and Image Processing' 92, pp. 97-109.
11. J. W. Kim and S. U. Lee, "On the hierarchical variable block size motion estimation technique for motion sequence coding," SPIE, vol.2094, Visual Communications and Image Processing, pp. 372-384, 1993.
12. M. Bierling, "Displacement estimation by hierarchical blockmatching," in SPIE Vol. 1001 Visual Communications and Image Processing' 88, pp. 942-951.
13. K. M. Nam et al., "A fast hierarchical motion vector estimation algorithm using mean pyramid," IEEE Trans. Circuits Syst. Video Technol., vol.5, no.4, pp. 344-351, Aug. 1995.
14. X. Song, T. Chiang, and Y.-Q. Zhang, "A hierarchical motion estimation algorithm using nonlinear pyramid for MPEG-2," in IEEE International Symposium on Circuits and Systems, Hong Kong, Jun. 9-12, 1997, pp. 1165-1168.
15. D. Wang and D. Lauzon, "Hybrid algorithm for estimating true motion fields," Optical Engineering, vol.39, no.11, pp. 2876-2881, Nov. 2000.
16. J.Konard and E. Dubois, "Bayesian estimation of motion vector fields," IEEE Trans. Patt. Anal. Machine Intell., vol.14, no.9, pp. 910-927, Sep. 1992.
17. C. Stiller, "Object-based estimation of dense motion field," IEEE Trans. Image Processing, vol.6, no.2, pp. 234-250, Feb. 1997.
18. M. M. Chang, A. M. Tekalp, and M. I. Sezan, "Simultaneous motion estimation and segmentation," IEEE Trans. Image Processing, vol.6, no.9, pp. 1326-1333, Sep. 1997.
19. H. Shen, L. Zhang, B. Huang, and P. Li, "A MAP approach for joint motion estimation, segmentation, and super resolution," IEEE Trans. Image Processing, vol.16, no.2, pp. 479-490, Feb. 2007.
20. J. Wu and A. C. S. Chung, "A segmentation model using compound Markov random fields based on a boundary model," IEEE Trans. Image Processing, vol.16, no.1, pp. 241-252, Feb. 2007.
21. P. J. McNerney, J. Konard, and M. Betke, "Block-based MAP disparity estimation under alpha-channel constraints," IEEE Trans. Circuits Syst. Video Technol., vol.17, no.6, pp. 785-789, Jun. 2007.
22. D. Wang, "Improvement of region-based motion estimation by considering uncovered regions," Signal Processing: Image Communication, vol.14, pp. 841-849, 1999.
23. S. Ince and J.Konard, "Occlusion-aware optical flowestimation," IEEE Trans. Image Processing, vol.17, no.8, pp. 1433-1451, Aug. 2008.
24. H. Shariat and K. E. Price, "Motion estimation with more than two frames," IEEE Trans. Patt. Anal. Machine Intell., vol.12, no.5, pp. 417-433, May 1992.
25. D. Gibson and M. Span, "Robust optical flow estimation based on a sparse motion trajectory set," IEEE Trans. Image Processing, vol.12, no.4, pp. 431-445, Apr. 2003.
26. R. Feghali, "Multi-frame simultaneous motion estimation and segmentation," IEEE Trans. Consumer Electronics, vol.51, no.1, pp. 245-248, Feb. 2005. (Pubitemid 40679203)
27. P. J. Burt and E. H. Adelson, "The Laplacian pyramid as a compact image code," IEEE Trans. Commun., vol.COM-31, pp. 337-345, Apr. 1983.
28. S. Baker et al., "A database and evaluation methodology for optical flow," in IEEE International Conference on Computer Vision, Rio de Janeiro, Brazil, Oct. 2009.