Optimal temporal interpolation filter for motion-compensated frame rate up conversion

IEEE Transactions on Image Processing

Volumn 15, Issue 4, 2006, Pages 978-991

  Dane, Gökçe ^a,b   Nguyen, Truong Q ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b Thomson Corporate Research   (United States)

Author keywords

Frame interpolation; Frame rate conversion; Image modeling; Interpolation filter; Motion compensation; Motion vector error

Indexed keywords

INTERPOLATION; LAGRANGE MULTIPLIERS; MATHEMATICAL MODELS; MOTION COMPENSATION; STATISTICAL METHODS; VECTORS;

FRAME INTERPOLATION; FRAME RATE CONVERSION; IMAGE MODELING; INTERPOLATION FILTER; MOTION VECTOR ERROR;

IMAGE PROCESSING;

ALGORITHM; ARTICLE; ARTIFACT; ARTIFICIAL INTELLIGENCE; COMPUTER ASSISTED DIAGNOSIS; EVALUATION; IMAGE ENHANCEMENT; INFORMATION RETRIEVAL; METHODOLOGY; MOTION; PHOTOGRAPHY; SIGNAL PROCESSING; VIDEORECORDING;

ALGORITHMS; ARTIFACTS; ARTIFICIAL INTELLIGENCE; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; INFORMATION STORAGE AND RETRIEVAL; MOTION; PHOTOGRAPHY; SIGNAL PROCESSING, COMPUTER-ASSISTED; VIDEO RECORDING;

EID: 33645156701     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2005.863947     Document Type: Article

References (27)

1. E. B. Bellers and G. de Haan, De-Interlacing: A Key Technology for Scan Rate Conversion, Advances in Image Communication. Elsevier, MA: Wellesley-Cambridge, 2000, vol. 9.
2. C. Cafforio, F. Rocca, and S. Tubaro, "Motion-compensated image interpolation," IEEE Trans. Commun., vol. 38, no. 2, pp. 215-221, Feb., 1990.
3. A. Patti, I. Sezan, and M. Tekalp, "Digital video standards conversion in the presence of accelerated motion," Signal Process.: Image Commun., vol. 6, pp. 213-227, 1994.
4. O. A. Ojo and G. de Haan, "Robust motion-compensated up conversion," IEEE Trans. Consum. Electron., vol. 43, no. 4, pp. 1045-1056, Nov. 1997.
5. T. S. Huang and Y. P. Su, "Image sequence enhancement," in Image Sequence Analysis, T. S. Huang, Ed. Berlin, Germany: Springer-Verlag, 1981, pp. 289-309.
6. E. Dubois and S. Sabri, "Noise reduction in image sequences using motion-compensated temporal filtering," IEEE Trans. Commun., vol. COM-32, no. 7, pp. 826-831, Jul. 1984.
7. M. Ozkan, I. Sezan, and M. Tekalp, "Adaptive motion-compensated filtering of noisy image sequence," IEEE Trans. Circuits Syst. Video Technol., vol. 3, no. 4, pp. 277-289, Aug. 1993.
8. D. Martinez and S. Lim, "Implicit motion-compensated noise reduction of motion video sequences," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 1985, pp. 375-378.
9. J. C.-H. Ju, Y.-K. Chen, and S. Y. Kung, "A fast rate-optimized motion estimation algorithm for low-bit-rate video coding," IEEE Trans. Circuits Syst. Video Technol., vol. 9, no. 7, pp. 994-1002, Jul. 1999.
10. J. Ribas-Corbera and D. L. Neuhoff, "Optimizing motion-vector accuracy in block-based video coding," IEEE Trans. Circuits Syst. Video Technol., vol. 11, no. 4, pp. 497-511, Apr. 2001.
11. G. de Haan, P. W. A. C. Biezen, H. Huijgen, and O. A. Ojo, "True-motion estimation with 3-D recursive search block matching," IEEE Trans. Circuits Syst. Video Technol., vol. 3, no. 5, pp. 368-379, Oct. 1993.
12. F. J. de Bruijn, W. H. A. Bruls, D. D. Burazerovic, and G. de Haan, "Efficient video coding integrating MPEG-2 and picture rate conversion," IEEE Trans. Consum. Electron., vol. 48, no. 3, pp. 688-693, Aug. 2002, to be published.
13. H. Blume, G. Herczeg, O. Erdler, and T. G. Noll, "Object based refinement of motion vector fields applying probabilistic homogenization rules," IEEE Trans. Consum. Electron., vol. 48, no. 3, pp. 694-701, Aug. 2002.
14. M. Flierl, T. Wiegand, and B. Girod, "A locally optimal design algorithm for block-based multi-hypothesis motion-compensated prediction," in Proc. IEEE Data Compression Conf., 1998, pp. 239-248.
15. R. Krishnamurty, J. Woods, and P. Moulin, "Frame interpolation and bidirectional prediction of video using compactly encoded optical-flow fields and label fields," IEEE Trans. Circuits Syst. Video Technol., vol. 9, no. 5, pp. 713-726, Aug. 1999.
16. R. Buschmann, "Efficiency of displacement estimation techniques," Signal Process.: Image Commun., vol. 10, pp. 43-61, 1997.
17. B. Girod, "Efficiency analysis of multihypothesis motion-compensated prediction for video coding," IEEE Trans. Image Process., vol. 9, no. 2, pp. 173-183, Feb. 2000.
18. T. J. Borer, "Motion Vector Field Error Estimation," U.S. Patent 6442202 B1, 2002.
19. B. Girod, "The efficiency of motion-compensating prediction for hybrid coding of video sequences," IEEE J. Sel. Areas Commun., vol. SAC-5, no. 7, pp. 1140-1154, Aug. 1987.
20. A. Habibi and A. Wintz, "Image coding by linear transformations and block quantization," IEEE Trans. Commun., vol. COM-19, no. 2, pp. 50-62, Feb. 1971.
21. R. A. F. Belfor, R. L. Lagendijk, and J. Biemond, "Subsampling of digital image sequences using motion information," in Motion Analysis and Image Sequence Processing, M. I. Sezan and R. L. Lagendijk, Eds. Norwell, MA: Kluwer, 1993, pp. 189-223.
22. P. Stoica and R. Moses, Introduction to Spectral Analysis. Englewood Cliffs, NJ: Prentice-Hall, 1997.
23. J. B. O'Neal and T. J. Natarajan, "Coding isotropic images," IEEE Trans. Inf. Theory, vol. IT-23, no. 6, pp. 697-707, Nov. 1977.
24. B. Tao and M. T. Orchard, "A parametric solution for optimal overlapped block motion compensation," IEEE Trans. Image Process., vol. 10, no. 3, pp. 341-350, Mar. 2001.
25. A. Bovik, Ed., "Video sampling and interpolation," in Handbook of Image and Video Processing. San Diego, CA: Academic, 2000, ch. 7.2, pp. 645-654.
26. K. K. Pang and T. K. Tan, "Optimum loop filters in hybrid coders," IEEE Trans. Circuits Syst. Video Technol., vol. 4, no. 2, pp. 158-167, Apr. 1994.
27. G. J. Sullivan, "Multi-hypothesis motion compensation for low-bit rate video coding," in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Processing, Minneapolis, MN, Apr. 1993, pp. 437-440.