A multistage motion vector processing method for motion-compensated frame interpolation

IEEE Transactions on Image Processing

Volumn 17, Issue 5, 2008, Pages 694-708

  Huang, Ai Mei ^a   Nguyen, Truong Q ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Frame rate up conversion; Motion vector processing; Motion compensated frame interpolation (MCFI); Residual energy

Indexed keywords

ALGORITHMS; DECODING; INTERPOLATION; VECTOR QUANTIZATION;

FRAME RATE UP-CONVERSION; MOTION VECTOR PROCESSING; MOTION-COMPENSATED FRAME INTERPOLATION;

MOTION COMPENSATION;

ALGORITHM; ARTICLE; ARTIFACT; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; EVALUATION; IMAGE ENHANCEMENT; INFORMATION PROCESSING; MATHEMATICAL COMPUTING; METHODOLOGY; MOTION; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING; VIDEORECORDING;

ALGORITHMS; ARTIFACTS; ARTIFICIAL INTELLIGENCE; DATA COMPRESSION; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; MOTION; NUMERICAL ANALYSIS, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING, COMPUTER-ASSISTED; VIDEO RECORDING;

EID: 42649115133     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2008.919360     Document Type: Article

References (25)

1. G. Haan, P. W. A. C. Biezen, H. Huijgen, and O. A. Ojo, "True-motion estimation with 3-D recursive search block matching," IEEE. Trans. Circuits Syst. Video Technol., vol. 3, no. 5, pp. 368-379, Oct. 1993.
2. R. Krishnamurthy, J. W. Woods, and P. Moulin, "Frame interpolation and bidirectional prediction of video using compactly encoded optical-flow fields and label fields," IEEE Trans. Circuits Syst. Video Technol. vol. 9, no. 5, pp. 713-726, Aug. 1999.
3. T. Chen, "Adaptive temporal interpolation using bidirectional motion estimation and compensation," in Proc. Int. Conf. Image Processing Sep. 2002, vol. 2, pp. 313-317.
4. T. Ha, S. Lee, and J. Kim, "Motion compnesated frame interpoaltion by new block-based motion estimation algorithm," IEEE Trans. Consum. Electron., vol. 50, no. 2, pp. 752-759, May 2004.
5. J. Wang, N. Patel, and W. Grosky, "A fast blook-based motion compensated video frame interpolation approach," in Proc. Asilomar Conf. Signals, Systems Computers, Nov. 2004, pp. 1740-1743.
6. J. Zhai, J. L. K. Yu, and S. Li, "A low complexity motion compensated frame interpolation method," in Proc. ISCAS, Sep. 2005, vol. 2, pp. 4927-4930.
7. S. Fujiwara and A. Taguchi, "Motion-compensated frame rate up-conversion based on block matching algorithm with multi-size blocks," in Proc. Int. Symp. Intelligent Signal Processing and Communication Systems, Dec. 2005, pp. 353-356.
8. H. Blume, G. Herczeg, O. Erdler, and T. G. Noll, "Object based refinement of motion vector field applying probabilistic homogenization rules," IEEE Trans. Consum. Electron., vol. 48, no. 3, pp. 694-701, Aug. 2002.
9. B.-D. Choi, J.-W. Han, C.-S. Kim, and S.-J. Ko, "Frame rate up-conversion using perspective transform," IEEE Trans. Consum. Electron., vol. 52, no. 3, pp. 975-982, Aug. 2006.
10. J. Astola, P. Haavisto, and Y. Neuvo, "Vector median filters," Proc. IEEE, vol. 78, pp. 678-689, Apr. 1990.
11. L. Alparone, M. Barni, F. Bartolini, and V. Cappellini, "Adaptively weighted vector-median filters for motion-fields smoothing," in Proc. ICASSP, May 1996, vol. 4, pp. 2267-2270.
12. G. Dane and T. Q. Nguyen, "Motion vector processing for frame rate up conversion," in Proc. ICASSP, May 2004, vol. 3, pp. 309-312.
13. G. Dane and T. Q. Nguyen, "Smooth motion vector resampling for standard compatible video post-processing," presented at the Asilomar Conf. Signals, Systems, Computers, 2004.
14. H. Sasai, S. Kondo, and S. Kadono, "Frame-rate up-conversion using reliable analysis of transmitted motion information," in Proc. ICASSP, May 2004, vol. 5, pp. 257-260.
15. S. Sekiguchi, Y. Idehara, K. Sugimoto, and K. Asai, "A low-cost video frame-rate up conversion using compressed-domain information," in Proc. Int. Conf. Image Processing, Sep. 2005, vol. 2, pp. 974-977.
16. J. Zhang, L. Sun, S. Yang, and Y. Zhong, "Position prediction motion-compensated interpoaltion for frame rate up-conversion using temporal modeling," presented at the Int. Conf. Image Processing, 2005.
17. T. Shanableh and M. Ghanbari, "Loss concealment using b-pictures motion information," IEEE Trans. Multimedia, vol. 5, no, 2, pp. 257-266, Jun. 2003.
18. C. C. A. Vetro and H. Sun, "Video transcoding architectures and techniques: An overview," IEEE Signal Process. Mag., pp. 18-29, Mar. 2003.
19. O. A. Ojo and G. Haan, "Robust motion-compensated video upconversion," IEEE Trans. Consumn. Electron., vol. 43, no. 4, pp. 1045-1056, Nov. 1997.
20. G. Dane, K. El-Maleh, and Y.-C. Lee, "Encoder-assisted adaptive video frame interpolation," in Proc. ICASSP, 2005, vol. 2, pp. 349-352.
21. S.-H. Lee, O. Kwon, and R.-H. Park, "Weighted-adaptive motion-compensated frame rate up-conversion," IEEE Trans. Consum. Electron., vol. 49, no. 3, pp. 485-492, Aug. 2003.
22. G. Dane and T. Q. Nguyen, "Optimal temporal interpolation filter for motion-compensated frame rate up conversion," IEEE Trans. Image Process., vol. 15, no. 4, pp. 978-991, Apr. 2006.
23. A. Huang and T. Nguyen, "A novel motion compensated frame interpolation based on block merging and residual energy," in Proc. Multimedia Signal Processing Workshop, Sep. 2006, vol. 4, pp. 353-356.
24. A. Huang and T. Nguyen, "Motion vector processing based on residual energy information for motion compensated frame interpolation," in Proc. Int. Conf. Image Processing, Sep. 2006, vol. 4, pp. 353-356.
25. Z. Wang, A. C. Conrad, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: From error visibility to structure similarity," in Proc. Multimedia Signal Processing Workshop, Apr. 2004, vol. 13, no. 4, pp. 600-612.