Removing camera shake via weighted fourier burst accumulation

IEEE Transactions on Image Processing

Volumn 24, Issue 11, 2015, Pages 3293-3307

  Delbracio, Mauricio ^a   Sapiro, Guillermo ^a  

^a Duke University   (United States)

Author keywords

burst fusion; camera shake; high dynamic range; low light photography; multi image deblurring

Indexed keywords

EID: 84934325698     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2015.2442914     Document Type: Article

References (42)

1. O. Whyte, J. Sivic, A. Zisserman, and J. Ponce, "Non-uniform deblurring for shaken images," Int. J. Comput. Vis., vol. 98, no. 2, pp. 168-186, 2012.
2. T. Buades, Y. Lou, J.-M. Morel, and Z. Tang, "A note on multi-image denoising," in Proc. Int. Workshop Local Non-Local Approx. Image Process. (LNLA), Aug. 2009, pp. 1-15.
3. H. Zhang, D. Wipf, and Y. Zhang, "Multi-image blind deblurring using a coupled adaptive sparse prior," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2013, pp. 1051-1058.
4. B. Carignan, J.-F. Daneault, and C. Duval, "Quantifying the importance of high frequency components on the amplitude of physiological tremor," Experim. Brain Res., vol. 202, no. 2, pp. 299-306, 2010.
5. F. Gavant, L. Alacoque, A. Dupret, and D. David, "A physiological camera shake model for image stabilization systems," in Proc. IEEE Sensors, Oct. 2011, pp. 1461-1464.
6. F. Xiao, A. Silverstein, and J. Farrell, "Camera-motion and effective spatial resolution," in Proc. Int. Congr. Imag. Sci. (ICIS), 2006, pp. 33-36.
7. V. Garrel, O. Guyon, and P. Baudoz, "A highly efficient lucky imaging algorithm: Image synthesis based on Fourier amplitude selection," Pub. Astron. Soc. Pacific, vol. 124, no. 918, pp. 861-867, 2012.
8. D. L. Fried, "Probability of getting a lucky short-exposure image through turbulence," J. Opt. Soc. Amer., vol. 68, no. 12, pp. 1651-1657, 1978.
9. D. Kundur and D. Hatzinakos, "Blind image deconvolution," IEEE Signal Process. Mag., vol. 13, no. 3, pp. 43-64, May 1996.
10. R. Fergus, B. Singh, A. Hertzmann, S. T. Roweis, and W. T. Freeman, "Removing camera shake from a single photograph," ACM Trans. Graph., vol. 25, no. 3, pp. 787-794, 2006.
11. Q. Shan, J. Jia, and A. Agarwala, "High-quality motion deblurring from a single image," ACM Trans. Graph., vol. 27, no. 3, 2008, Art. ID 73.
12. J.-F. Cai, H. Ji, C. Liu, and Z. Shen, "Blind motion deblurring from a single image using sparse approximation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2009, pp. 104-111.
13. D. Krishnan, T. Tay, and R. Fergus, "Blind deconvolution using a normalized sparsity measure," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2011, pp. 233-240.
14. 0 sparse representation for natural image deblurring," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2013, pp. 1107-1114.
15. T. Michaeli and M. Irani, "Blind deblurring using internal patch recurrence," in Proc. IEEE Eur. Conf. Comput. Vis. (ECCV), Sep. 2014, pp. 783-798.
16. S. Cho and S. Lee, "Fast motion deblurring," ACM Trans. Graph., vol. 28, no. 5, 2009, Art. ID 145.
17. A. Levin, Y. Weiss, F. Durand, and W. T. Freeman, "Understanding and evaluating blind deconvolution algorithms," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2009, pp. 1964-1971.
18. A. Levin, Y. Weiss, F. Durand, and W. T. Freeman, "Efficient marginal likelihood optimization in blind deconvolution," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2011, pp. 2657-2664.
19. A. Rav-Acha and S. Peleg, "Two motion-blurred images are better than one," Pattern Recognit. Lett., vol. 26, no. 3, pp. 311-317, 2005.
20. L. Yuan, J. Sun, L. Quan, and H.-Y. Shum, "Image deblurring with blurred/noisy image pairs," ACM Trans. Graph., vol. 26, no. 3, 2007, Art. ID 1.
21. J.-F. Cai, H. Ji, C. Liu, and Z. Shen, "Blind motion deblurring using multiple images," J. Comput. Phys., vol. 228, no. 14, pp. 5057-5071, 2009.
22. J. Chen, L. Yuan, C.-K. Tang, and L. Quan, "Robust dual motion deblurring," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2008, pp. 1-8.
23. F. Sroubek and P. Milanfar, "Robust multichannel blind deconvolution via fast alternating minimization," IEEE Trans. Image Process., vol. 21, no. 4, pp. 1687-1700, Apr. 2012.
24. X. Zhu, F. Šroubek, and P. Milanfar, "Deconvolving PSFs for a better motion deblurring using multiple images," in Proc. IEEE 12th Eur. Conf. Comput. Vis. (ECCV), Oct. 2012, pp. 636-647.
25. S. H. Park and M. Levoy, "Gyro-based multi-image deconvolution for removing handshake blur," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2014, pp. 3366-3373.
26. A. Ito, A. C. Sankaranarayanan, A. Veeraraghavan, and R. G. Baraniuk, "Blurburst: Removing blur due to camera shake using multiple images," ACM Trans. Graph., to be published.
27. N. M. Law, C. D. Mackay, and J. E. Baldwin, "Lucky imaging: High angular resolution imaging in the visible from the ground," Astron. Astrophys., vol. 446, no. 2, pp. 739-745, 2006.
28. S. John and M. A. Vorontsov, "Multiframe selective information fusion from robust error estimation theory," IEEE Trans. Image Process., vol. 14, no. 5, pp. 577-584, May 2005.
29. M. Aubailly, M. A. Vorontsov, G. W. Carhart, and M. T. Valley, "Automated video enhancement from a stream of atmospherically-distorted images: The lucky-region fusion approach," Proc. SPIE, Atmos. Opt., Models, Meas., Target-Loop Propag. III, vol. 7463, pp. 74630C-1-74630C-10, Aug. 2009.
30. N. Joshi and M. F. Cohen, "Seeing Mt. Rainier: Lucky imaging for multi-image denoising, sharpening, and haze removal," in Proc. IEEE Int. Conf. Comput. Photogr. (ICCP), Mar. 2010, pp. 1-8.
31. G. Haro, A. Buades, and J.-M. Morel, "Photographing paintings by image fusion," SIAM J. Imag. Sci., vol. 5, no. 3, pp. 1055-1087, 2012.
32. M. Delbracio, P. Musé, A. Almansa, and J.-M. Morel, "The non-parametric sub-pixel local point spread function estimation is a well posed problem," Int. J. Comput. Vis., vol. 96, no. 2, pp. 175-194, 2012.
33. G. Boracchi and A. Foi, "Modeling the performance of image restoration from motion blur," IEEE Trans. Image Process., vol. 21, no. 8, pp. 3502-3517, Aug. 2012.
34. B. Zitová and J. Flusser, "Image registration methods: A survey," Image Vis. Comput., vol. 21, no. 11, pp. 977-1000, 2003.
35. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
36. L. Moisan, P. Moulon, and P. Monasse, "Automatic homographic registration of a pair of images, with a contrario elimination of outliers," Image Process. Line, vol. 2, pp. 56-73, May 2012.
37. M. A. Fischler and R. C. Bolles, "Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography," Commun. ACM, vol. 24, no. 6, pp. 381-395, 1981.
38. M. Lebrun, A. Buades, and J.-M. Morel, "Implementation of the 'non-local Bayes' (NL-Bayes) image denoising algorithm," Image Process. Line, vol. 3, pp. 1-42, Jul. 2013.
39. E. Reinhard, W. Heidrich, P. Debevec, S. Pattanaik, G. Ward, and K. Myszkowski, High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting. San Mateo, CA, USA: Morgan Kaufmann, 2010.
40. F. Banterle, A. Artusi, K. Debattista, and A. Chalmers, Advanced High Dynamic Range Imaging: Theory and Practice. New York, NY, USA: CRC Press, 2011.
41. W. Zhang and W.-K. Cham, "Gradient-directed composition of multi-exposure images," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2010, pp. 530-536.
42. L. Zhang, A. Deshpande, and X. Chen, "Denoising vs. deblurring: HDR imaging techniques using moving cameras," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2010, pp. 522-529.