Limits on super-resolution and how to break them

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 24, Issue 9, 2002, Pages 1167-1183

  Baker, Simon ^b   Kanade, Takeo ^a,b  

^a IEEE   (United States)

^b CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Analysis of reconstruction constraints; Faces; Hallucination; Learning; Recogstruction; Super resolution; Text

Indexed keywords

RECONSTRUCTION CONSTRAINTS;

ALGORITHMS; CHARGE COUPLED DEVICES; CONSTRAINT THEORY; IMAGE SENSORS; OPTICAL CHARACTER RECOGNITION;

IMAGE RECONSTRUCTION;

EID: 0036709429     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2002.1033210     Document Type: Article

References (53)

1. S. Baker and T. Kanade, "Hallucinating Faces," Technical Report CMU-RI-TR-99-32, The Robotics Inst., Carnegie Mellon Univ., 1999.
2. S. Baker and T. Kanade, "Super-Resolution Optical Flow," Technical Report CMU-RI-TR-99-36, The Robotics Inst., Carnegie Mellon Univ., 1999.
3. S. Baker and T. Kanade, "Hallucinating Faces," Proc. Fourth Int'l Conf. Automatic Face and Gesture Recognition, 2000.
4. S. Baker and T. Kanade, "Limits on Super-Resolution and How to Break Them," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2000.
5. S. Baker, S.K. Nayar, and H. Murase, "Parametric Feature Detection," Int'l J. Computer Vision, vol. 27, no. 1, pp. 27-50, 1998.
6. D.F. Barbe, Charge-Coupled Devices. Springer-Verlag, 1980.
7. B. Bascle, A. Blake, and A. Zisserman, "Motion Deblurring and Super-Resolution from an Image Sequence," Proc. Fourth European Conf. Computer Vision, pp. 573-581, 1996.
8. J.R. Bergen, P. Anandan, K.J. Hanna, and R. Hingorani, "Hierarchical Model-Based Motion Estimation," Proc. Second European Conf. Computer Vision, pp. 237-252, 1992.
9. M. Berthod, H. Shekarforoush, M. Werman, and J. Zerubia, "Reconstruction of High Resolution 3D Visual Information," Proc. Conf. Computer Vision and Pattern Recognition, pp. 654-657, 1994.
10. M. Born and E. Wolf, Principles of Optics. Permagon Press, 1965.
11. P.J. Burt, "Fast Filter Transforms for Image Processing," Computer Graphics and Image Processing, vol. 16, pp. 20-51, 1980.
12. P.J. Burt and E.H. Adelson, "The Laplacian Pyramid as a Compact Image Code," IEEE Trans. Comm., vol. 31, no. 4, pp. 532-540, 1983.
13. P. Cheeseman, B. Kanefsky, R. Kraft, J. Stutz, and R. Hanson, "Super-Resolved Surface Reconstruction from Multiple Images," Technical Report FIA-94-12, NASA Ames Research Center, 1994.
14. M.-C. Chiang and T.E. Boult, "Imaging-Consistent Super-Resolution," Proc. DARPA Image Understanding Workshop, 1997.
15. M.-C. Chiang and T.E. Boult, "Local Blur Estimation and Super-Resolution," Proc. Conf. Computer Vision and Pattern Recognition, pp. 821-826, 1997.
16. J.S. De Bonet, "Multiresolution Sampling Procedure for Analysis and Synthesis of Texture Images," Computer Graphics Proc., Ann. Conf. Series, (SIGGRAPH '97), pp. 361-368, 1997.
17. J.S. De Bonet and P. Viola, "Texture Recognition Using a Non-Parametric Multi-Scale Statistical Model," Proc. Conf. Computer Vision and Pattern Recognition, pp. 641-647, 1998.
18. F. Dellaert, S. Thrun, and C. Thorpe, "Jacobian Images of Super-Resolved Texture Maps for Model-Based Motion Estimation and Tracking," Proc. Fourth Workshop Applications of Computer Vision, pp. 2-7, 1998.
19. G.J. Edwards, C.J. Taylor, and T.F. Cootes, "Learning to Identify and Track Faces in Image Sequences," Proc. Third Int'l Conf. Automatic Face and Gesture Recognition, pp. 260-265, 1998.
20. M. Elad, "Super-Resolution Reconstruction of Image Sequences -Adaptive Filtering Approach," PhD thesis, The Technion-Israel Inst. Technology, Haifa, Israel, 1996.
21. M. Elad and A. Feuer, "Restoration of Single Super-Resolution Image from Several Blurred, Noisy, and Down-Sampled Measured Images," IEEE Trans. Image Processing, vol. 6, no. 12, pp. 1646-1658, 1997.
22. M. Elad and A. Feuer, "Super-Resolution Reconstruction of Image Sequences," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 9, pp. 817-834, Sept. 1999.
23. M. Elad and A. Feuer, "Super-Resolution Restoration of an Image Sequence-Adaptive Filtering Approach," IEEE Trans. Image Processing, vol. 8, no. 3, pp. 387-395, 1999.
24. W.T. Freeman and E.H. Adelson, "The Design and Use of Steerable Filters," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, pp. 891-906, 1991.
25. W.T. Freeman, E.C. Pasztor, and O.T. Carmichael, "Learning Low-Level Vision," Int'I J. Computer Vision, vol. 20, no. 1, pp. 25-47, 2000.
26. R.C. Hardie, K.J. Barnard, and E.E. Armstrong, "Joint MAP Registration and High-Resolution Image Estimation Using a Sequence of Undersampled Images," IEEE Trans. Image Processing, vol. 6, no. 12, pp. 1621-1633, 1997.
27. B.K.P. Horn, Robot Vision. McGraw-Hill, 1996.
28. T.S. Huang and R. Tsai, "Multi-Frame Image Restoration and Registration," Advances in Computer Vision and Image Processing, vol. 1, pp. 317-339, 1984.
29. M. Irani and S. Peleg, "Improving Resolution by Image Restoration," Computer Vision, Graphics, and Image Processing, vol. 53, pp. 231-239, 1991.
30. M. Irani and S. Peleg, "Motion Analysis for Image Enhancement: Resolution, Occulsion, and Transparency," J. Visual Comm. and Image Representation, vol. 4, no. 4, pp. 324-335, 1993.
31. M. Irani, B. Rousso, and S. Peleg, "Image Sequence Enhancement Using Multiple Motions Analysis," Proc. 1992 Conf. Computer Vision and Pattern Recognition, pp. 216-221, 1992.
32. D. Keren, S. Peleg, and R. Brada, "Image Sequence Enhancement Using Sub-Pixel Displacements," Proc. Conf. Computer Vision and Pattern Recognition, pp. 742-746, 1988.
33. S. Kim, N. Bose, and H. Valenzuela, "Recursive Reconstruction of High Resolution Image from Noisy Undersampled Multiframes," IEEE Trans. Acoustics, Speech, and Signal Processing, vol. 38, pp. 1013-1027, 1990.
34. S. Kim and W.-Y. Su, "Recursive High-Resolution Reconstruction of Blurred Multiframe Images," IEEE Trans. Image Processing, vol. 2, pp. 534-539, 1993.
35. S. Mann and R.W. Picard, "Virtual Bellows: Constructing High Quality Stills from Video," Proc. First Int'l Conf. Image Processing, pp. 363-367, 1994.
36. V.S. Nalwa, A Guided Tour of Computer Vision. Addison-Wesley, 1993.
37. T. Numnonda, M. Andrews, and R. Kakarala, "High Resolution Image Reconstruction by Simulated Annealing," Image and Vision Computing, vol. 11, no. 4, pp. 213-220, 1993.
38. A. Patti, M. Sezan, and A. Tekalp, "Super-resolution Video Reconstruction with Arbitrary Sampling Latices and Nonzero Aperture Time," IEEE Trans. Image Processing, vol. 6, no. 8, pp. 1064-1076, 1997.
39. S. Peleg, D. Keren, and L. Schweitzer, "Improving Image Resolution Using Subpixel Motion," Pattern Recognition Letters, pp. 223-226, 1987.
40. P.J. Philips, H. Moon, P. Rauss, and S.A. Rizvi, "The FERET Evaluation Methodology for Face-Recognition Algorithms," Proc. IEEE Conf. Vision and Pattern Recognition (CVPR '97), 1997.
41. W.K. Pratt, Digital Image Processing. Wiley-Interscience, 1991.
42. W.H. Press, S.A. Teukolsky, W.T. Vetterling, and B.P. Flannery, Numerical Recipes in C, second ed. Cambridge Univ. Press, 1992.
43. H. Qi and Q. Snyder, "Conditioning Analysis of Missing Data Estimation for Large Sensor Arrays," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2000.
44. T. Riklin-Raviv and A. Shashua, "The Quotient Image: Class Based Recognition and Synthesis under Varying Illumination," Proc. Conf. Computer Vision and Pattern Recognition, pp. 566-571, 1999.
45. H.A. Rowley, S. Baluja, and T. Kanade, "Neural Network-Based Face Detection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 1, pp. 23-38, Jan. 1998.
46. R. Schultz and R. Stevenson, "A Bayseian Approach to Image Expansion for Improved Definition," IEEE Trans. Image Processing, vol. 3, no. 3, pp. 233-242, 1994.
47. R. Schultz and R. Stevenson, "Extraction of High-Resolution Frames from Video Sequences," IEEE Trans. Image Processing, vol. 5, no. 6, pp. 996-1011, 1996.
48. H. Shekarforoush, "Conditioning Bounds for Multi-Frame Super-Resolution Algorithms," Technical Report CAR-TR-912, Computer Vision Laboratory, Center for Automation Research, Univ. of Maryland, 1999.
49. H. Shekarforoush, M. Berthod, J. Zerubia, and M. Werman, "Sub-Pixel Bayesian Estimation of Albedo and Height," Int'l J. Computer Vision, vol. 19, no. 3, pp. 289-300, 1996.
50. V. Smelyanskiy, P. Cheeseman, D. Maluf, and R. Morris, "Bayesian Super-Resolved Surface Reconstruction from Images," Proc. 2000 IEEE Conf. Computer Vision and Pattern Recognition, 2000.
51. H. Stark and P. Oskoui, "High-Resolution Image Recovery from Image-Plane Arrays, Using Convex Projections," J. Optical Soc. Am. A, vol. 6, pp. 1715-1726, 1989.
52. R. Szeliski and P. Golland, "Stereo Matching with Transparency and Matting," Proc. Sixth Int'l Conf. Computer Vision (ICCV '98), pp. 517-524, 1998.
53. H. Ur and D. Gross, "Improved Resolution from Subpixel Shifted Pictures," Computer Vision, Graphics, and Image Processing, vol. 54, no. 2, pp. 181-186, 1992.