Motion-compensated frame rate up-conversion-Part II: New algorithms for frame interpolation

IEEE Transactions on Broadcasting

Volumn 56, Issue 2, 2010, Pages 142-149

  Wang, Demin ^a   Vincent, André ^a   Blanchfield, Philip ^a   Klepko, Robert ^a  

^a Industry Canada   (Canada)

Author keywords

Frame interpolation; Frame rate conversion; MAP estimation; Motion estimation; Video processing

Indexed keywords

BI-DIRECTIONAL; BLOCKING ARTIFACTS; DIRECTIONAL HOLE; FILL HOLES; FILLING HOLES; FRAME INTERPOLATION; FRAME RATE CONVERSION; FRAME RATE UP-CONVERSION; KEY ELEMENTS; LOCAL TEXTURE; MAP ESTIMATION; MEDIAN FILTER; MOTION ESTIMATION ALGORITHM; OBJECT BASED; PLUG-INS; UNIDIRECTIONAL MOTION; VIDEO PROCESSING;

ALGORITHMS; ESTIMATION; INTERPOLATION; MOTION COMPENSATION; VIDEO SIGNAL PROCESSING;

MOTION ESTIMATION;

EID: 77953025988     PISSN: 00189316     EISSN: None     Source Type: Journal    
DOI: 10.1109/TBC.2010.2043895     Document Type: Article

References (32)

1. D. Wang, L. Zhang, and A. Vincent, "Motion-compensated frame rate up-conversion-Part I: Fast multi-frame motion estimation," IEEE Trans. Broadcasting, vol.56, no.2, Jun. 2010.
2. Q. Huynh-thu and M. Ghanbari, "Temporal aspect of perceived quality in mobile video broadcasting," IEEE Trans. Broadcasting, vol.54, no.3, pp. 641-651, Sep. 2008.
3. I. P. Gunawan and M. Ghanbari, "Efficient reduced-reference video quality meter," IEEE Trans. Broadcasting, vol.54, no.3, pp. 669-679, Sep. 2008.
4. D. Wang et al., "Towards optimal rate control: A study of the impact of spatial resolution, frame rate, and quantization on subjective video quality and bit rate," in Visual Communications and Image Processing 2003, Lugano, Switzerland, Jul. 8-11, 2003, pp. 198-209.
5. R. Feghali, F. Speranza, D. Wang, and A. Vincent, "Video quality metric for bit rate control via joint adjustment of quantization and frame rate," IEEE Trans. Broadcasting, vol.33, no.1, pt. II, pp. 441-446, Mar. 2007.
6. C.-L. Huang and T.-T. Chai, "Motion-compensated interpolation for scan rate up-conversion," Optical Engineering, vol.35, no.1, pp. 166-176, Jan. 1996.
7. S.-C. Han and J. W. Woods, "Frame-rate up-conversion using transmitted motion and segmentation fields for very low bit-rate video coding," in Proc. Int. conf. Image Processing, Washington, DC, Oct. 1997, vol.1, pp. 747-750.
8. T.-Y. Kuo and C.-C. J. Kuo, "Motion-compensated interpolation for low-bit-rate video quality enhancement," in SPIE Conference on Applications of Digital Image Processing XXI, San Diego, CAa, Jul. 1998, pp. 277-288.
9. S. Liu, C.-C. J. Kuo, and J. W. Kim, "Hybrid global-local motion compensated frame interpolation for low bit rate video coding," Journal of Visual Communication and Image Representation, vol.14, pp. 61-79, 2003.
10. T. Liu, K.-T. Lo, J. Feng, and X. Zhang, "Frame interpolation scheme using inertia motion prediction," Signal Processing: Image Communication, vol.18, pp. 221-229, 2003.
11. J. Benois-Pineau and H. Nicolas, "A new method for region-based depth ordering in a video sequence: Application to frame interpolation," Journal of Visual Communication and Image Representation, vol.13, pp. 363-385, 2002.
12. P. Blanchfield, D. Wang, A. Vincent, F. Speranza, and R. Renaud, "Advanced frame rate conversion and performance evaluation," The SMPTE Motion Imaging Journal, pp. 153-159, Apr. 2006.
13. A. Kaup and T. Aach, "Efficient prediction of uncovered background in interframe coding using spatial extraprediction," in Proc. ICASSP, Apr. 1994, pp. 501-504.
14. M. Bertalmio, G. Sapiro, V. Caselles, and C. Ballester, "Image inpainting," in Computer Graphics (SIGGRAPG 2000), Jul. 2000, pp. 417-424.
15. S. D. Rane, G. Sapiro, and M. Bertalmio, "Structure and texture filling-in of missing image blocks in wireless transmission and compression applications," IEEE Trans. Image Processing, vol.12, no.3, pp. 296-303, Mar. 2003.
16. A. Criminisi, P. Perez, and K. Toyama, "Region filling and object removal by exemplar-based image inpainting," IEEE Trans. Image Processing, vol.13, no.9, pp. 1200-1212, Sep. 2004.
17. B.-T. Choi, S. H. Lee, and S.-J. Ko, "New frame rate up-conversion using bi-directional motion estimation," IEEE Trans. Consumer Electronics, vol.46, no.3, pp. 603-609, Aug. 2000.
18. T. Ha, S. Lee, and J. Kim, "Motion compensated frame interpolation by newblock-based motion estimation algorithm," IEEE Trans. Consumer Electronics, vol.50, no.2, pp. 752-759, May 2004.
19. J. O. Lee, S. K. Jamg, Q. S. chen, Y.-H. Kim, and C.-W. Kim, "An efficient frame rate up-conversion method for mobile phone with projection functionality," IEEE Trans. Consumer Electronics, vol.53, no.4, pp. 1615-1621, Nov. 2007.
20. S.-J. Kang, K.-R. cho, and Y. H. Kim, "Motion compensated frame rate up-conversion using extended bilateral motion estimation," IEEE Trans. Consumer Electronics, vol.53, no.4, pp. 1759-1767, Nov. 2007.
21. S.-J. Kang, D.-G. Yoo, S.-K. Lee, and Y. H. Kim, "Multiframe-based bilateral motion estimation with emphasis on stationary caption processing for frame rate up-conversion," IEEE Trans. Consumer Electronics, vol.54, no.4, pp. 1830-1838, Nov. 2008.
22. R. Castagno, P. Haavisto, and G. Ramponi, "A method for motion adaptive frame rate up-conversion," IEEE Trans. Circuits and Systems for Video Technology, vol.6, no.5, pp. 436-445, Oct. 1996.
23. K. Hilman, H. W. Park, and Y. Kim, "Using motion-compensated frame-rate conversion for the correction of 3:2 pulldown artifacts in video sequences," IEEE Trans. Circuits and Systems for Video Technology, vol.10, no.6, pp. 869-877, Sep. 2000.
24. S.-H. Lee, O. Kwon, and R.-H. Park, "Weighted-adaptive motion-compensated frame rate up-conversion," IEEE Trans. Consumer Electronics, vol.49, no.3, pp. 485-492, Aug. 2003.
25. B.-D. Choi, J.-W. han, C.-S. Kim, and S.-J. Ko, "Frame rate up-conversion using perspective transform," IEEE Trans. Consumer Electronics, vol.52, no.3, pp. 975-982, Aug. 2006.
26. Y.-T. Yang, Y.-S. Tung, and J.-L. Wu, "Quality enhancement of frame rate up-converted video by adaptive frame skip and reliable motion extraction," IEEE Trans. Circuits and Systems for Video Technology, vol.17, no.12, pp. 1700-1713, Dec. 2007.
27. Y. Ling, J. Wang, Y. Liu, and W. Zhang, "A novel spatial and temporal correlation integrated based motion-compensated interpolation for frame rate up-conversion," IEEE Trans. Consumer Electronics, vol.54, no.2, pp. 863-869, May 2008.
28. A.-M. Huang and T. Q. Nguyen, "A multistage motion vector processing method for motion-compensated frame interpolation," IEEE Trans. Image Processing, vol.17, no.5, pp. 694-708, May 2008.
29. A.-M. Huang and T. Nguyen, "Correlation-based motion vector processing with adaptive interpolation scheme for motion-compensated frame interpolation," IEEE Trans. Image Processing, vol.18, no.4, pp. 740-752, Apr. 2009.
30. Video Coding for Low Bitrate Communication, Draft ITU-T Recommendation H.263, ITU-T, Mar. 6, 1997.
31. M. T. Orchard and G. J. Sullivan, "Overlapped block motion compensation: An estimation theoretic approach," IEEE Trans. Image Processing, vol.3, no.5, pp. 693-699, Sep. 1994.
32. RE:Vision Effects, Inc, "Products: Twixtor" [Online]. Available: http:// www.revisionfx.com/products/twixtor/