Super-resolution reconstruction of compressed video using transform-domain statistics

IEEE Transactions on Image Processing

Volumn 13, Issue 1, 2004, Pages 33-43

  Gunturk, Bahadir K ^a   Altunbasak, Yucel ^b   Mersereau, Russell M ^b  

^a LOUISIANA STATE UNIVERSITY   (United States)

^b GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

DCT domain reconstruction; MAP; Multiframe image reconstruction; POCS; Super resolution

Indexed keywords

COSINE TRANSFORMS; ERROR ANALYSIS; IMAGE COMPRESSION; IMAGE ENHANCEMENT; IMAGE QUALITY; MATHEMATICAL MODELS; RANDOM PROCESSES; SPURIOUS SIGNAL NOISE; STATISTICAL METHODS;

MULTIFRAME RECONSTRUCTION; QUANTIZATION ERROR; SUPER RESOLUTION RECONSTRUCTION;

IMAGE RECONSTRUCTION;

ALGORITHM; ARTICLE; AUTOMATED PATTERN RECOGNITION; COMPARATIVE STUDY; COMPUTER ASSISTED DIAGNOSIS; COMPUTER SIMULATION; EVALUATION; IMAGE ENHANCEMENT; IMAGE SUBTRACTION; INFORMATION PROCESSING; INFORMATION RETRIEVAL; METHODOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING; STATISTICAL MODEL; VALIDATION STUDY; VIDEORECORDING;

ALGORITHMS; COMPUTER SIMULATION; DATA COMPRESSION; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; INFORMATION STORAGE AND RETRIEVAL; MODELS, STATISTICAL; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING, COMPUTER-ASSISTED; SUBTRACTION TECHNIQUE; VIDEO RECORDING;

EID: 1242330875     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2003.819221     Document Type: Article

References (26)

1. R. Y. Tsai and T. S. Huang, "Multiframe image restoration and registration," in Advances in Computer Vision and Image Processing. Greenwich, CT: JAI, 1984.
2. S. P. Kim, N. K. Bose, and H. M. Valenzuela, "Recursive reconstruction of high resolution image from noisy undersampled multiframes," IEEE Trans. Acoust., Speech, Signal Processing, vol. 38, pp. 1013-1027, June 1990.
3. S. P. Kim and W. Su, "Recursive high-resolution reconstruction of blurred multiframe images," IEEE Trans. Image Processing, vol. 2, pp. 534-539, Oct. 1993.
4. B. C. Tom, A. K. Katsaggelos, and N. P. Galatsanos, "Reconstruction of a high resolution from registration and restoration of low resolution images," in Proc. IEEE Int. Conf. Image Processing, Nov. 1994, pp. 13-16.
5. H. Ur and D. Gross, "Improved resolution from subpixel shifted pictures," CVGIP: Graph. Models Image Process., vol. 54, pp. 181-186, Mar. 1992.
6. C. Srinivas and M. D. Srinath, "A stochastic model-based approach for simultaneous restoration of multiple misregistered images," Proc. SPIE, vol. 1360, pp. 1416-1427, 1990.
7. H. Stark and P. Oskoui, "High-resolution image recovery from image-play arrays, using convex projections," J. Opt. Soc. Amer. A, vol. 6, no. 11, pp. 1715-1726, 1989.
8. A. M. Tekalp, M. K. Ozkan, and M. I. Sezan, "High-resolution image reconstruction from lower-resolution image sequences and space-varying image restoration," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, Mar. 1992, pp. 169-172.
9. A. J. Patti, M. I. Sezan, and A. M. Tekalp, "Superresolution video reconstruction with arbitrary sampling lattices and nonzero aperture time," IEEE Trans. Image Processing, vol. 6, pp. 1064-1076, Aug. 1997.
10. M. Irani and S. Peleg, "Improving resolution by image registration," CVGIP: Graph. Models Image Process., vol. 53, pp. 231-239, May 1991.
11. S. Mann and R. W. Picard, "Virtual bellows: Constructing high quality stills from video," in IEEE Int. Conf. Image Processing, Nov. 1994, pp. 13-16.
12. M. Irani and S. Peleg, "Motion analysis for image enhancement: Resolution, occlusion, and transparency," J. Vis. Commun. Image Represent., vol. 4, pp. 324-335, Dec. 1993.
13. T. Komatsu, K. Aizawa, and T. Saito, "Very high resolution imaging scheme with multiple different-aperature cameras," Signal Process.: Image Commun., vol. 5, pp. 511-526, Dec. 1993.
14. P. Cheeseman, B. Kanefsky, and R. Hanson, "Super-Resolved Surface Reconstruction from Multiple Images," NASA Rep., 1993.
15. R. R. Schultz and R. L. Stevenson, "Extraction of high-resolution frames from video sequences," IEEE Trans. Image Processing, vol. 5, pp. 996-1011, June 1996.
16. M. Elad and A. Feuer, "Restoration of a single superresolution image from several blurred, noisy and undersampled measured images," IEEE Trans. Image Processing, vol. 6, pp. 1646-1658, Dec. 1997.
17. S. Borman and R. L. Stevenson, "Simultaneous multi-frame map superesolution video enhancement using spatio-temporal priors," in Proc. IEEE Int. Conf. Image Processing, vol. 3, 1999, pp. 469-473.
18. D. Chen and R. R. Schultz, "Extraction of high-resolution video stills from MPEG image sequences," in Proc. IEEE Int. Conf. Image Processing, vol. 2, 1998, pp. 464-469.
19. Y. Altunbasak, A. J. Patti, and R. M. Mersereau, "Super-resolution still and video reconstruction from MPEG coded video," IEEE Trans. Circuits, Syst., Video Technol., vol. 12, no. 4, pp. 217-226, 2002.
20. M. A. Robertson and R. L. Stevenson, "DCT quantization noise in compressed images," in Proc. IEEE Int. Conf. Image Processing, vol. 1, 2001, pp. 185-188.
21. ____, "Restoration of compressed video using temporal information," Proc. SPIE, vol. 4310, pp. 21-29, 2001.
22. C. A. Segall, R. Molina, A. K. Katsaggelos, and J. Mateos, "Reconstruction of high-resolution image frames from a sequence of low-resolution and compressed observations," in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Processing, vol. 2, 2002, pp. 1701-1704.
23. B. K. Gunturk, Y. Altunbasak, and R. M. Mersereau, "Multiframe resolution-enhancement methods for compressed video," IEEE Signal Processing Lett., vol. 9, pp. 170-174, June 2002.
24. A. J. Patti and Y. Altunbasak, "Artifact reduction for set theoretic superresolution image reconstruction with edge adaptive constraints and higher-order interpolants," IEEE Trans. Image Processing, vol. 10, pp. 179-186, Jan. 2001.
25. A. M. Tekalp, Digital Video Processing. Englewood Cliffs, NJ: Prentice-Hall, 1995
26. C. J. Harris and M. Stephens, "A combined corner and edge detector," in Proc. 4th Alvey Vision Conf., 1988, 147-151.