Joint registration and super-resolution with omnidirectional images

IEEE Transactions on Image Processing

Volumn 20, Issue 11, 2011, Pages 3151-3162

  Arican, Zafer ^a   Frossard, Pascal ^a  

^a EPFL   (Switzerland)

Author keywords

Image reconstruction; image registration; omnidirectional imaging; spherical Fourier ring correlation; spherical imaging; super resolution

Indexed keywords

2-SPHERE; ARBITRARY ROTATION; FOURIER; HIGH RESOLUTION; HIGH RESOLUTION IMAGE; INTERIOR POINT METHODS; LOW RESOLUTION IMAGES; MINIMIZATION PROBLEMS; NATURAL IMAGES; OMNIDIRECTIONAL IMAGE; OMNIDIRECTIONAL IMAGING; RECONSTRUCTED IMAGE; RECONSTRUCTION QUALITY; REGISTRATION ERROR; ROTATION GROUP; SPHERICAL FOURIER TRANSFORMS; SPHERICAL IMAGES; SPHERICAL IMAGING; SUPER RESOLUTION; TOTAL LEAST SQUARES; TRANSFORM COEFFICIENTS; TRANSFORM DOMAIN; VISION SENSORS;

FOURIER TRANSFORMS; IMAGE RECONSTRUCTION; LEAST SQUARES APPROXIMATIONS; ROTATION; SPHERES;

OPTICAL RESOLVING POWER;

EID: 80054830148     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2011.2144609     Document Type: Article

References (33)

1. C. Segall, R. Molina, and A. Katsaggelos, "High-resolution images from low-resolution compressed video," IEEE Signal Process. Mag., vol. 20, no. 3, pp. 37-48, Mar. 2003.
2. S. Farsiu, D. Robinson, M. Elad, and P. Milanfar, "Advances and challenges in super-resolution," Int. J. Imaging Syst. Technol., vol. 14, pp. 47-57, Jan. 2004.
3. S. Park, M. Park, and M. Kang, "Super-resolution image reconstruction: A technical overview," IEEE Signal Process. Mag., vol. 20, no. 3, pp. 21-36, Mar. 2003.
4. G. Costa and J. Bermudez, "Registration errors: Are they always bad for super-resolution?," IEEE Trans. Signal Process., vol. 57, no. 10, pp. 3815-3826, Oct. 2009.
5. P. Vandewalle, L. Sbaiz, J. Vandewalle, and M. Vetterli, "Super-resolution from unregistered and totally aliased signals using subspace methods," IEEE Trans. Signal Process., vol. 55, no. 7, pp. 3687-3703, Jul. 2007.
6. M. Ng, J. Koo, and N. Bose, "Constrained total least-squares computations for high-resolution image reconstruction with multisensors," Int. J. Imaging Syst. Technol., vol. 12, no. 1, pp. 35-42, 2002.
7. Y. He, K. Yap, L. Chen, and L. Chau, "A nonlinear least square technique for simultaneous image registration and super-resolution," IEEE Trans. Image Process., vol. 16, no. 11, pp. 2830-2841, Nov. 2007.
8. 1 norm approach for joint image registration and super-resolution," IEEE Signal Process. Lett., vol. 16, no. 11, pp. 981-984, Nov. 2009.
9. L. Wang and F. Sigworth, "Cryo-EM and single particles," Physiology, vol. 21, pp. 13-18, 2006.
10. S. Ludtke, P. Baldwin, and W. Chiu, "EMAN: Semiautomated software for high-resolution single-particle reconstructions," J. Structural Biol., vol. 128, no. 1, pp. 82-97, 1999.
11. L. Joyeux and P. Penczek, "Efficiency of 2-D alignment methods," Ultramicroscopy, vol. 92, no. 2, pp. 33-46, 2002.
12. P. Baldwin and P. Penczek, "Estimating alignment errors in sets of 2-D images," J. Structural Biol., vol. 150, no. 2, pp. 211-225, 2005.
13. H. Kawasaki, K. Ikeuchi, and M. Sakauchi, "Super-resolution omnidirectional camera images using spatio-temporal analysis," Electron. Commun. Japan, vol. 89, no. 6, p. 47, 2006.
14. H. Nagahara, Y. Yagi, and M. Yachida, "Super-resolution from an omnidirectional image sequence," in Proc. IEEE Industrial Electron. Soc. Annu. Conf., 2000, vol. 4, pp. 2559-2564.
15. B. Rafaely and M. Park, "Super-resolution spherical microphone arrays," in Proc. IEEE Conv. Electr. Electron. Eng. Israel, 2004, pp. 424-427.
16. A. Makadia and K. Daniilidis, "Rotation recovery from spherical images without correspondences," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 7, pp. 1170-1175, Jul. 2006.
17. D. Stein, E. Scheinerman, and G. Chirikjian, "Mathematical models of binary spherical-motion encoders," IEEE/ASME Trans. Mechatron., vol. 8, no. 2, pp. 234-244, Feb. 2003.
18. G. Chirikjian, P. Kim, J. Koo, and C. Lee, "Rotational matching problems," Int. J. Computat. Intell. Applic., vol. 4, no. 4, pp. 401-416, 2004.
19. Z. Fan and Z. Qi-dan, "Super-resolution image reconstruction for omni-vision based on POCs," in Proc. Chinese Control Decision Conf., Jun. 2009, pp. 5045-5049.
20. C. Geyer and K. Daniilidis, "Catadioptric projective geometry," Int. J. Comput. Vis., vol. 45, no. 3, pp. 223-243, 2001.
21. Z. Arican and P. Frossard, "Super-resolution from unregistered omnidirectional images," in Proc. Int. Conf. Pattern Recognit., 2008, pp. 1-4.
22. Z. Arican and P. Frossard, "l1-regularized super-resolution from unregistered omnidirectional images," in Proc. Int. Conf. Acoust., Speech Signal Process., 2009, pp. 829-832.
23. K. Daniilidis, A. Makadia, and T. Bulow, "Image processing in catadioptric planes: Spatiotemporal derivatives and optical flow computation," in Proc. 3rd Workshop Omnidirectional Vision, 2002, pp. 3-10.
24. S. Baker and S. Nayar, "A theory of single-viewpoint catadioptric image formation," Int. J. Comput. Vis., vol. 35, pp. 175-196, Jan. 1999.
25. J. Driscoll and D. Healy, "Computing fourier transforms and convolutions on the 2-sphere," Adv. Appl. Math., vol. 15, pp. 202-250, Jan. 1994.
26. J. R. Driscoll and D. M. Healy, Jr., "Asymptotically fast algorithms for spherical and related transforms," in Proc. 30th Annu. Symp. Foundations Comput. Sci., Oct. 1989, pp. 344-349.
27. D. Healy, D. Rockmore, P. Kostelec, and S. Moore, "FFTs for the 2-sphere-Improvements and variations," J. Fourier Anal. Applic., vol. 9, no. 4, pp. 341-385, 2003.
28. I. Tosic and P. Frossard, "FST-based reconstruction of 3D-models from non-uniformly sampled datasets on the sphere," in Proc. Picture Coding Symp., 2006.
29. G. Chirikjian and A. Kyatkin, Engineering Applications of Noncommutative Harmonic Analysis: With Emphasis on Rotation and Motion Groups. Boca Raton, FL: CRC, 2000.
30. D. W. Marquardt, "An algorithm for least-squares estimation of nonlinear parameters," SIAM J. Appl. Math., vol. 11, no. 2, pp. 431-441, 1963.
31. S. Kim, K. Koh, M. Lustig, S. Boyd, and D. Gorinevsky, "An interiorpoint method for large-scale l1-regularized least squares," IEEE J. Sel. Topics Signal Process., vol. 1, no. 6, pp. 606-617, Dec. 2007.
32. M. Van Heel, "Detection of objects in quantum-noise-limited images," Ultramicroscopy, vol. 7, no. 4, pp. 331-341, 1982.
33. W. Saxton and W. Baumeister, "The correlation averaging of a regularly arranged bacterial cell envelope protein.," J. Microscopy, vol. 127, no. 2, p. 127, 1982.