Correlation-based motion vector processing with adaptive interpolation scheme for motion-compensated frame interpolation

IEEE Transactions on Image Processing

Volumn 18, Issue 4, 2009, Pages 740-752

  Huang, Ai Mei ^a   Nguyen, Truong ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Frame rate up conversion; Motion vector correlation; Motion vector processing; Motion compensated frame interpolation (MCFI); Video occlusions

Indexed keywords

CORRELATION METHODS; INTERPOLATION; OBJECT RECOGNITION; PROCESSING; VIDEO RECORDING;

FRAME RATE UP CONVERSION; MOTION VECTOR CORRELATION; MOTION VECTOR PROCESSING; MOTION-COMPENSATED FRAME INTERPOLATION (MCFI); VIDEO OCCLUSIONS;

VECTORS;

EID: 63749092565     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2008.2010206     Document Type: Article

References (29)

1. G. Haan, P. W. A. C. Biezen, H. Huijgen, and O. A. Ojo, "True-motion estimation with 3-D recursive search block matching," IEEE Trans. Circuit Syst. Video Technol., vol. 3, no. 5, pp. 368-379, Oct. 1993.
2. R. Krishnamurthy, J. W. Woods, and P. Moulin, "Frame interpolation and bidirectional prediction of video using compactly encoded optical-flow fields and label fields," IEEE Trans. Circuit Syst. Video Technol. vol. 9, no. 5, pp. 713-726, Aug. 1999.
3. B.-D. Choi, J.-W. Han, C.-S. Kim, and S.-J. Ko, "Motion-compensated frame interpolation using bilateral motion estimation and adaptive overlapped block motion compensation," IEEE Trans. Circuit Syst. Video Technol., vol. 17, no. 4, pp. 407-416, Apr. 2007.
4. R. Thoma and M. Bierling, "Motion compensating interpolation considering covered and uncovered background," Signal Process.: Image Commun., vol. 1, pp. 191-212, 1989.
5. S. Fujiwara and A. Taguchi, "Motion-compensated frame rate up-conversion based on block matching algorithm with multi-size blocks," in Proc. ISPACS, Hong Kong, Dec. 2005, pp. 353-356.
6. H. Blume, G. Herczeg, O. Erdler, and T. G. Noll, "Object based refinement of motion vector field applying probabilistic homogenization rules," IEEE Trans. Consum. Electron., vol. 48, no. 3, pp. 694-701, Aug. 2002.
7. S.-C. Han and J. W. Woods, "Frame-rate up-conversion using transmitted motion and segmentation fields for very low bit-rate video coding," in Proc. Int. Conf. Image Processing, Washington, DC, Oct. 1997, vol. 1, pp. 747-750.
8. B.-D. Choi, J.-W. Han, C.-S. Kim, and S.-J. Ko, "Frame rate up-conversion using perspective transform," IEEE Trans. Consum. Electron., vol. 52, no. 8, pp. 975-982, Aug. 2006.
9. J. Astola, P. Haavisto, and Y. Neuvo, "Vector median filters," Proc. IEEE, vol. 78, no. 4, pp. 678-689, Apr. 1990.
10. L. Alparone, M. Barni, F. Bartolini, and V. Cappellini, "Adaptively weighted vector-median filters for motion-fields smoothing," in Proc. ICASSP, Atlanta, May 1996, vol. 4, pp. 2267-2270.
11. S. Sekiguchi, Y. Idehara, K. Sugimoto, and K. Asai, "A low-cost video frame-rate up conversion using compressed-domain information," in Proc. Int. Conf. Image Processing, Genova, Italy, Sep. 2005, vol. 2, pp. 974-977.
12. H. Sasai, S. Kondo, and S. Kadono, "Frame-rate up-conversion using reliable analysis of transmitted motion information," in Proc. ICASSP, Montreal, QC, Canada, May 2004, vol. 5, pp. 257-260.
13. J. Wang, N. Patel, and W. Grosky, "A fast block-based motion compensated video frame interpolation approach," in Proc. Asilomar Conf. Signals, Systems and Computers, Dec. 2004, pp. 1740-1743.
14. J. Zhai, J. L. K. Yu, and S. Li, "A low complexity motion compensated frame interpolation method," in Proc. ISCAS, Kobe, Japan, Sep. 2005, vol. 2, pp. 4927-4930.
15. A.-M. Huang and T. Nguyen, "A novel motion compensated frame interpolation based on block merging and residual energy," in Proc. Multimedia Signal Processing Workshop, Victoria, BC, Canada, Sep. 2006, vol. 4, pp. 353-356.
16. A.-M. Huang and T. Nguyen, "Motion vector processing based on residual energy information for motion compensated frame interpolation," in Proc. Int. Conf. Image Processing, Atlanta, GA, Sep. 2006, vol. 4, pp. 353-356.
17. B.-D. Choi, S.-H. Lee, and S.-J. Ko, "New frame rate up-conversion using bi-directional motion estimation," IEEE Trans. Consum. Electron., vol. 46, pp. 603-609, Aug. 2000.
18. M. E. Al-Mualla, "Motion field interpolation for frame rate conversion," in Proc. ISCAS, Bangkok, Thailand, May 2003, vol. 2, pp. 652-655.
19. G. Dane and T. Q. Nguyen, "Smooth motion vector resampling for standard compatible video post-processing," presented at the Asilomar Conf. Signals, Systems and Computers, 2004.
20. S.-H. Lee, O. Kwon, and R.-H. Park, "Weighted-adaptive motion-compensated frame rate up-conversion," IEEE Trans. Consum. Electron., vol. 49, no. 3, pp. 485-492, Aug. 2003.
21. O. A. Ojo and G. Haan, "Robust motion-compensated video upconversion," IEEE Trans. Consum. Electron., vol. 43, no. 4, pp. 1045-1056, Nov. 1997.
22. T. Chen, "Adaptive temporal interpolation using bidirectional motion estimation and compensation," in Proc. Int. Conf. Image Processing Rochester, NY, Sep. 2002, vol. 2, pp. 313-317.
23. Y.-T. Yang, Y.-S. Tung, and J.-L.Wu, "Quality enhancement of frame rate up-converted video by adaptive frame skip and reliable motion extraction," IEEE Trans. Circuit Syst. Video Technol., vol. 17, no. 12, pp. 1700-1713, Dec. 2007.
24. A.-M. Huang and T. Nguyen, "A multistage motion vector processing method for motion-compensated frame interpolation," IEEE Trans. Image Process., vol. 17, no. 5, pp. 694-708, May 2008.
25. P. Csillag and L. Boroczky, "Frame rate conversion based on acceleration and motion-based segmentation," in Proc. Eur. Symp. Advanced Imaging and Network Technologies, Conference on Digital Compression Technologies and Systems for Video Communications, Oct. 1996, pp. 438-448.
26. K. A. and T. Aach, "Efficient prediction of uncovered background in interframe coding using spatial extrapolation," in Proc. ICASSP, Adelaide, Australia, 1994, vol. 5, pp. 501-504.
27. T. Ha, S. Lee, and J. Kim, "Motion compensated frame interpolation by new block-based motion estimation algorithm," IEEE Trans. Consum. Electron., vol. 50, no. 2, pp. 752-759, May 2004.
28. A.-M. Huang and T. Nguyen, "Motion vector processing using bidirectional frame difference in motion compensated frame interpolation," IEEE WoWMoM. Newport Beach, CA, pp. 1-6, Jun. 2008.
29. Z. Wang, A. C. Conrad, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: From error visibility to structure similarity," IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004.