A learning-based method for image super-resolution from zoomed observations

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 35, Issue 3, 2005, Pages 527-537

  Joshi, Manjunath V ^a   Chaudhuri, Subhasis ^b   Panuganti, Rajkiran ^b  

^a GOGTE INSTITUTE OF TECHNOLOGY   (India)

^b INDIAN INSTITUTE OF TECHNOLOGY BOMBAY   (India)

Author keywords

Learning based method; MAP estimation; Markov random field; Mean correction; Parameter estimation; Simultaneous autoregressive model; Super resolution; Zooming

Indexed keywords

IMAGE QUALITY; LEARNING SYSTEMS; MARKOV PROCESSES; MATHEMATICAL MODELS; PARAMETER ESTIMATION; REGRESSION ANALYSIS;

LEARNING BASED METHOD; MARKOV RANDOM FIELD; MEAN CORRECTION; SIMULTANEOUS AUTOREGRESSIVE MODEL; SUPER-RESOLUTION; ZOOMING;

IMAGING TECHNIQUES;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BIOLOGICAL MODEL; CLUSTER ANALYSIS; COMPARATIVE STUDY; COMPUTER ASSISTED DIAGNOSIS; COMPUTER GRAPHICS; COMPUTER SIMULATION; EVALUATION; IMAGE ENHANCEMENT; INFORMATION RETRIEVAL; MATHEMATICAL COMPUTING; METHODOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING; STATISTICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; CLUSTER ANALYSIS; COMPUTER GRAPHICS; COMPUTER SIMULATION; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; INFORMATION STORAGE AND RETRIEVAL; MODELS, BIOLOGICAL; MODELS, STATISTICAL; NUMERICAL ANALYSIS, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING, COMPUTER-ASSISTED;

EID: 20444366491     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2005.846647     Document Type: Article

References (54)

1. C. Delherm, J. M. Lavest, M. Dhome, and J. T. Lapreste, "Dense reconstruction by zooming," in Proc. Fourth Eur. Conf. Comput. Vision, Apr. 1996, pp. 427-438.
2. J. M. Lavest, G. Rives, and M. Dhome, "Three dimensional reconstruction by zooming," IEEE Trans. Robotics Autom., vol. 9, no. 2, pp. 196-207, Apr. 1993.
3. J. Ma and S. I. Olsen, "Depth from zooming," J. Amer. Opt. Soc., vol. 7, no. 10, pp. 1883-1890, Oct. 1990.
4. D. Wilkes, S. J. Dickinson, and J. K. Tsotsos, "A quantitative analysis of view degeneracy and its use for active focal length control," in Proc. IEEE Int. Conf. Comput. Vision, Cambridge, MA, 1995, pp. 938-944.
5. J. A. Fayman, O. Sudarsky, and E. Rivlin, "Zoom Tracking and its Applications," Technion - Israel Inst. Technol., Tech. Rep. TR CIS9717, Dec. 1997.
6. R. Y. Tsai and T. S. Huang, "Multiframe image restoration and registration," in Advances in Computer Vision and Image Processsing. New York: JAI, 1984, pp. 317-339.
7. S. P. Kim, N. K. Bose, and H. M. Valenzuela, "Recursive reconstruction of high-resolution image from noisy undersampled multiframes," IEEE Trans. Acoust., Speech, Signal Process., vol. 18, no. 6, pp. 1013-1027, Jun. 1990.
8. H. Ur and D. Gross, "Improved resolution from sub-pixel shifted pictures," CVGIP: Graphical Models Image Process., vol. 54, pp. 181-186, Mar. 1992.
9. M. Irani and S. Peleg, "Improving resolution by image registration," CVGIP: Graphical Models Image Process., vol. 53, pp. 231-239, Mar. 1991.
10. M. Irani and S. Peleg, "Motion analysis for image enhancement: Resolution, occlusion, and tranparancy," in Proc. VCIR, vol. 4, Dec. 1993, pp. 324-335.
11. A. M. Tekalp, M. K. Ozkan, and M. I. Sezan, "High-resolution image reconstruction from lower-resolution image sequences and space-varying image restoration," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., San Francisco, CA, 1992, pp. 169-172.
12. A. J. Patti, M. I. Sezan, and A. M. Tekalp, "Superresolution video reconstruction with arbitrary sampling lattices and nonzero aperture time," IEEE Trans. Image Process., vol. 6, no. 8, pp. 1064-1076, Aug. 1997.
13. M. K. Ng, J. Koo, and N. K. Bose, "Constrained total least squares computation for high-resolution image reconstruction with multisensors," Int. J. Imaging Syst. Technol., vol. 12, pp. 35-42, 2002.
14. N. Nguyen, P. Milanfar, and G. Golub, "A computationally efficient super-resolution reconstruction algorithm," IEEE Trans. Image Process., vol. 10, no. 4, pp. 573-583, Apr. 2001.
15. R. C. Hardie, K. J. Barnard, and E. E. Armstrong, "Joint MAP registration and high- resolution image estimation using a sequence of undersampled images," IEEE Trans. Image Process., vol. 6, no. 12, pp. 1621-1633, Dec. 1997.
16. R. R. Schultz and R. L. Stevenson, "A Bayesian approach to image expansion for improved definition," IEEE Trans. Image Process., vol. 3, no. 3, pp. 233-242, May 1994.
17. D. Rajan and S. Chaudhuri, "Generation of super-resolution images from blurred observations using an MRF model," J. Math. Imag. Vision, vol. 16, pp. 5-15, 2002.
18. D. Rajan and S. Chaudhuri, "Simultaneous estimation of super-resolved intensity and depth maps from low-resolution defocussed observations of a scene," in Proc. IEEE Int. Conf. Comput. Vision, Vancouver, BC, Canada, 2001, pp. 113-118.
19. A. N. Rajagopalan and V. P. Kiran, "Motion-free super-resolution and the role of relative blur," J. Opt. Soc. Amer. A, vol. 20, no. 11, pp. 2022-2032, Nov. 2003.
20. P. Cheeseman, B. Kanefsky, R. Hanson, and J. Stutz, "Super-Resolved Surface Reconstruction from Multiple Images," NASA Ames Res. Cent., Moffett Field, CA, Tech. Rep. FIA-94-12, Dec. 1994.
21. M. Elad and A. Feuer, "Restoration of a single superresolution image from several blurred, noisy, and undersampled measured images," IEEE Trans. Image Process., vol. 6, no. 12, pp. 1646-1658, Dec. 1997.
22. M. Elad and A. Feuer, "Super-resolution restoration of an image sequence: Adaptive filtering approach," IEEE Trans. Image Process., vol. 8, no. 3, pp. 387-395, Mar. 1999.
23. M. Elad and Y. Hel-Or, "A fast super-resolution reconstuction algorithm for pure translation motion and common space-invariant blur," IEEE Trans. Image Process., vol. 10, no. 8, pp. 1187-1193, Aug. 2001.
24. M. C. Chiang and T. E. Boult, "Local blur estimation and super-resolution," in Proc. IEEE Conf. Comput. Vision Pattern Recogn., Puerto Rico, TX, 1997, pp. 821-826.
25. M. C. Chiang and T. E. Boult, "Efficient super-resolution via image warping," Image Vision Comput., vol. 18, pp. 761-771, Dec. 2000.
26. B. K. Gunturk, A. U. Batur, Y. Altunbasak, M. H. Hayes III, and R. M. Mersereau, "Eigenface based super-resolution for face recognition," in Proc. IEEE Int. Conf. Image Process., Rochester, NY, 2002, pp. 845-848.
27. Z. Lin and H. Y. Shum, "Fundamental limits of reconstruction-based super-resolution algorithms under local translation," IEEE Trans. Pattern Anal. Machine Intell., vol. 26, no. 1, pp. 83-97, Jan. 2004.
28. Y. Altunbask, A. J. Patti, and R. M. Mersereau, "Super-resolution still and video reconstruction from MPEG-coded video," IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 4, pp. 217-226, Apr. 2002.
29. C. A. Segall, R. Molina, A. K. Katsaggelos, and J. Mateos, "Bayesian high-resolution reconstruction of low-resolution compressed video," in Proc. IEEE Int. Conf. Image Process., Thessaloniki, Greece, 2001, pp. 25-28.
30. E. Shechtman, Y. Caspi, and M. Irani, "Increasing space-time resolution in video," in Proc. Eur. Conf. Comput. Vision, Copenhagen, Denmark, 2002, pp. 753-769.
31. S. C. Park, M. G. Kang, C. A. Segall, and A. K. Katsaggelos, "High-resolution image reconstruction of low-resolution DCT-based compressed images," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Orlando, FL, 2002, pp. 1665-1668.
32. H. Shekarforoush and R. Chellappa, "Data-driven multichannel super-resolution with applications to video sequences," J. Opt. Soc. Amer. A, vol. 16, no. 3, pp. 481-492, 1999.
33. S. Borman and R. L. Stevenson, "Simultaneous multi-frame MAP super-resolution video enhancement using spatio-temporal priors," in Proc. IEEE Int. Conf. Image Process., Kobe, Japan, Oct. 1999, pp. 469-473.
34. D. Capel and A. Zisserman, "Automated mosaicing with super-resolution zoom," in Proc. IEEE Int. Conf. Comput. Vision Pattern Recogn., Santa Barbara, CA, 1998, pp. 885-891.
35. D. Capel and A. Zisserman, "Super-resolution from multiple views using learned image models," in Proc. IEEE Int. Conf. Comput. Vision Pattern Recogn., 2001, pp. II:627-II:634.
36. W. T. Freeman, T. R. Jones, and E. C. Pasztor, "Example-based super-resolution," IEEE Comput. Graphics Appl., vol. 22, no. 2, pp. 56-65, Mar./Apr. 2002.
37. S. Baker and T. Kanade, "Limits on super-resolution and how to break them," IEEE Trans. Pattern Anal. Machine Intell., vol. 24, no. 9, pp. 1167-1183, Sep. 2002.
38. F. M. Candocia and J. C. Principe, "Super-resolution of images based on local correlations," IEEE Trans. Neural Networks, vol. 10, no. 2, pp. 372-380, Mar. 1999.
39. Y. Yu and Q. Cheng, "MRF parameter estimation by an accelerated method," Pattern Recogn. Lett., vol. 24, pp. 1251-1259, 2003.
40. S. Lakshamanan and H. Derin, "Simultaneous parameter estimation and segmentation of Gibbs random fields using simulated annealing," IEEE Trans. Pattern Anal. Machine Intell., vol. 11, no. 8, pp. 799-813, Aug. 1989.
41. S. G. Nadabar and A. K. Jain, "Parameter estimation in MRF line process models," in Proc. IEEE Int. Conf. on Computer Vision and Pattern Recognition, 1992, pp. 528-533.
42. G. Potamianos and J. Goutsias, "Partition function estimation of Gibbs random field images using Monte Carlo simulations," IEEE Trans. on Information Theory, vol. 39, no. 4, pp. 1322-1331, July 1993.
43. G. Potamianos and J. Goutsias, "Stochastic approximation algorithms for partition function estimation of Gibbs random fields," IEEE Trans. Inf. Theory, vol. 43, no. 6, pp. 1948-1965, Nov. 1997.
44. S. C. Zhu, Y. N. Wu, and D. Mumford, "Minimax entropy principle and its application to texture modeling," Neural Comput., vol. 9, no. 8, pp. 1627-1660, 1997.
45. S. C. Zhu, Y. N. Wu, and D. Mumford, "Filters, random fields, and maximum entropy," Int. J. Comput. Vision, vol. 27, no. 2, pp. 1-20, Mar./Apr. 1998.
46. S. C. Zhu and X. Liu, "Learning in Gibbsian fields: How accurate and how fast can it be?," IEEE Trans. Pattern Anal. Machine Intell., vol. 24, no. 7, pp. 1001-1006, Jul. 2002.
47. S. Z. Li, Markov Random Field Modeling in Computer Vision. New York: Springer-Verlag, 1995.
48. R. Kashyap and R. Chellappa, "Estimation and choice of neighbors in spatial-interaction models of images," IEEE Trans. Inf. Theory, vol. IT-29, no. 1, pp. 60-72, Jan. 1983.
49. J. Mao and A. K. Jain, "Texture classification and segmentation using multiresolution simultaneous autoregressive models," Pattern Recogn., vol. 25, no. 2, pp. 173-188, 1992.
50. J. Bennett and A. Khotanzad, "Multispectral random field models for synthesis and analysis of color images," IEEE Trans. Pattern Anal. Machine Intell., vol. 20, no. 3, pp. 327-332, Mar. 1998.
51. J. Besag, "Spatial interaction and the statistical analysis of lattice systems," J. R. Statist. Soc. B, vol. 36, pp. 192-236, 1974.
52. S. Lakshmanan and H. Derin, "Gaussian Markov random fields at multiple resolutions," in Markov Random Fields, Theory, and Application, R. Chellappa and A. K. Jain, Eds. New York: Academic, 1993, pp. 131-157.
53. P. K. Nanda, K. S. Kumar, S. Ghokale, and U. B. Desai, "A multiresolution approach to color image restoration and parameter estimation using homotopy continuation method," in Proc. IEEE Int. Conf. Image Process., 1995, pp. 2045-2048.
54. A. N. Rajagopalan and S. Chaudhuri, "Performance analysis of maximum likelihood estimator for recovery of depth from defocused images and optimal selection of camera parameters," Int. J. Comput. Vision, vol. 30, no. 3, pp. 175-190, Dec. 1998.