Photographing paintings by image fusion

SIAM Journal on Imaging Sciences

Volumn 5, Issue 3, 2012, Pages 1055-1087

  Haro, Gloria ^a   Buades, Antoni ^b,c   Morel, Jean Michel ^d  

^a UNIVERSITAT POMPEU FABRA   (Spain)

^b UNIVERSITAT DE LES ILLES BALEARS   (Spain)

^c UNIVERSITÉ PARIS DESCARTES   (France)

^d UNIVERSITÉ PARIS SACLAY   (France)

Author keywords

Denoising; Multi image processing; Registration; Restoration

Indexed keywords

AUTOMATIC IMAGE PROCESSING; DE-NOISING; FUSION METHODS; HAND-HELD CAMERAS; IMAGE FUSION METHODS; LIGHTING CONDITIONS; MOTION BLUR; OPTICAL DISTORTION; PROCESSING CHAIN; REDUCING NOISE; REGISTRATION; REGISTRATION PROCESS; ROBUST STATISTICS; UNCONTROLLED ILLUMINATION;

IMAGE ENHANCEMENT; IMAGE FUSION; IMAGE RECONSTRUCTION; IMAGE REGISTRATION; OPTICAL DATA PROCESSING; PHOTOGRAPHY;

PAINTING;

EID: 84867189454     PISSN: None     EISSN: 19364954     Source Type: Journal    
DOI: 10.1137/120873923     Document Type: Article

References (57)

1. A. Agarwala, M. Dontcheva, M. Agrawala, S. Drucker, A. Colburn, B. Curless, D. Salesin, and M. Cohen, Interactive digital photomontage, ACM Trans. Graph., 23 (2004), pp. 294-302.
2. A. Agrawal, R. Raskar, S. Nayar, and Y. Li, Removing photography artifacts using gradient projection and flash-exposure sampling, ACM Trans. Graph., 24 (2005), pp. 828-835.
3. J. Astola, P. Haavisto, and Y. Neuvo, Vector median filters, Proc. IEEE, 78 (1990), pp. 678-689.
4. R. Bajcsy, S. Lee, and A. Leonardis, Detection of diffuse and specular interface reflections and inter-reflections by color image segmentation, Int. J. Comput. Vis., 17 (1996), pp. 241-272.
5. M. Barni, A. Pelagotti, and A. Piva, Image processing for the analysis and conservation of paintings: Opportunities and challenges, IEEE Signal Process. Mag., 22 (2005), pp. 141-144.
6. th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL), 2009, pp. 263-266.
7. R. Berns, The science of digitizing paintings for color-accurate image archives: A review, J. Imag. Sci. Tech., 45 (2001), pp. 305-325.
8. R. Berns and E. de la Rie, The effect of the refractive index of a varnish on the appearance of oil paintings, Stud. Conservat., 48 (2003), pp. 251-262.
9. M. Bertalmío and S. Levine, Fusion of bracketing pictures, in Proceedings of the 6th Conference on Visual Media Production, 2009.
10. G. Blanchet, L. Moisan, and B. Rougé, Measuring the global phase coherence of an image, in Proceedings of the 15th IEEE International Conference on Image Processing, 2008, pp. 1176-1179.
11. A. Buades, B. Coll, and J. M. Morel, A review of image denoising algorithms, with a new one, Multiscale Model. Simul., 4 (2005), pp. 490-530.
12. A. Buades, Y. Lou, J. Morel, and Z. Tang, A note on multi-image denoising, in Proceedings of the International Workshop on Local and Non-local Approximation in Image Processing (LNLA) 2009, pp. 1-15.
13. A. Chakrabarti, T. Zickler, and W. Freeman, Analyzing spatially-varying blur, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2010, pp. 2512-2519.
14. C. Chevalier, G. Roman, and J. Niepce, Guide du photographe, C. Chevalier, Paris, 1854.
15. O. Chum, M. Urban, J. Matas, and T. Pajdla, Robust wide baseline stereo from maximally stable extremal regions, in Proceedings of the British Machine Vision Conference, 2002, pp. 384-396.
16. K. Dabov, A. Foi, and K. Egiazarian, Video denoising by sparse 3d transform-domain collaborative filtering, in Proceedings of the 15th European Signal Processing Conference, Vol. 1, 2007, pp. 145-149.
17. K. Dabov, A. Foi, V. Katkovnik, and K. Egiazarian, Image denoising by sparse 3-d transformdomain collaborative filtering, IEEE Trans. Image Process., 16 (2007), pp. 2080-2095.
18. J. Delon, Midway image equalization, J. Math. Imaging Vision, 21 (2004), pp. 119-134.
19. E. Eisemann and F. Durand, Flash photography enhancement via intrinsic relighting, ACM Trans. Graph., 23 (2004), pp. 673-678.
20. S. Farsiu, M. Robinson, M. Elad, and P. Milanfar, Fast and robust multiframe super resolution, IEEE Trans. Image Process., 13 (2004), pp. 1327-1344.
21. R. Fattal, M. Agrawala, and S. Rusinkiewicz, Multiscale shape and detail enhancement from multilight image collections, ACM Trans. Graph., 26 (2007), article 51.
22. R. Ferzli and L. Karam, A no-reference objective image sharpness metric based on the notion of just noticeable blur (JNB), IEEE Trans. Image Process., 18 (2009), pp. 717-728.
23. M. Fischler and R. Bolles, Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography, Comm. ACM, 24 (1981), pp. 381-395.
24. Google, Art Project, http://www.googleartproject.com.
25. M. Irani and S. Peleg, Improving resolution by image registration, CVGIP: Graphical Models and Image Processing, 53 (1991), pp. 231-239.
26. N. Joshi and M. Cohen, Seeing Mt. Rainier: Lucky imaging for multi-image denoising, sharpening, and haze removal, in Proceedings of the IEEE International Conference on Computational Photography (ICCP), 2010, pp. 1-8.
27. G. Klinker, S. Shafer, and T. Kanade, The measurement of highlights in color images, Int. J. Comput. Vis., 2 (1988), pp. 7-32.
28. J. Kopf, M. Uyttendaele, O. Deussen, and M. Cohen, Capturing and viewing gigapixel images, ACM Trans. Graph., 26 (2007), article 93.
29. A. Levin, Blind motion deblurring using image statistics, in Advances in Neural Information Processing Systems, Vol. 19, MIT Press, Cambridge, MA, 2007, pp. 841-848.
30. A. Levin and Y. Weiss, User assisted separation of reflections from a single image using a sparsity prior, IEEE Trans. Pattern Anal. Mach. Intell., 29 (2007), pp. 1647-1654.
31. A. Levin, A. Zomet, S. Peleg, and Y. Weiss, Seamless image stitching in the gradient domain, in Proceedings of the European Conference on Computer Vision, 2004, pp. 377-389.
32. A. Levin, A. Zomet, and Y. Weiss, Separating reflections from a single image using local features, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2004.
33. Y. Li, S. Kang, N. Joshi, S. Seitz, and D. Huttenlocher, Generating sharp panoramas from motionblurred videos, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2010, pp. 2424-2431.
34. M. Lindenbaum, M. Fischer, and A. Bruckstein, On Gabor's contribution to image enhancement, Pattern Recognition, 27 (1994), pp. 1-8.
35. R. Liu, Z. Li, and J. Jia, Image partial blur detection and classification, in Proceedings of the International Conference on Computer Vision and Pattern Recognition, 2008.
36. D. Lowe, Object recognition from local scale-invariant features, in Proceedings of the Seventh IEEE International Conference on Computer Vision, Vol. 2, 1999, pp. 1150-1157.
37. D. Lowe, Distinctive image features from scale-invariant keypoints, Int. J. Comput. Vis., 60 (2004), pp. 91-110.
38. P. Mendapara, R. Minhas, and Q. Wu, Depth map estimation using exponentially decaying focus measure based on SUSAN operator, in Proceedings of the IEEE International Conference on Systems, Man and Cybernetics., 2009, pp. 3705-3708.
39. K. Mikolajczyk and C. Schmid, An affine invariant interest point detector, in Proceedings of the European Conference on Computer Vision (ECCV), 2002, pp. 128-142.
40. K. Mikolajczyk and C. Schmid, Scale and affine invariant interest point detectors, Int. J. Comput. Vis., 60 (2004), pp. 63-68.
41. J. Morel, A. Petro, and C. Sbert, A PDE formalization of retinex theory, IEEE Trans. Image Process., 19 (2010), pp. 2825-2837.
42. J.-M. Morel and G. Yu, ASIFT: A new framework for fully affine invariant image comparison, SIAM J. Imaging Sci., 2 (2009), pp. 438-469.
43. P. Musé, F. Sur, F. Cao, Y. Gousseau, and J. M. Morel, An a contrario decision method for shape element recognition, Int. J. Comput. Vis., 69 (2006), pp. 295-315.
44. S. Nayar, X. Fang, and T. Boult, Removal of specularities using color and polarization, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1993, pp. 583-590.
45. S. Nayar and Y. Nakagawa, Shape from focus, IEEE Trans. Pattern Anal. Mach. Intell., 16 (1994), pp. 824-831.
46. P. Pérez, M. Gangnet, and A. Blake, Poisson image editing, ACM Trans. Graph., 22 (2003), pp. 313-318.
47. G. Piella, Image fusion for enhanced visualization: A variational approach, Int. J. Comput. Vis., 83 (2009), pp. 1-11.
48. P. Pinto, J. Linhares, J. Carvalhal, and S. Nascimento, Psychophysical estimation of the best illumination for appreciation of renaissance paintings, Vis. Neurosci., 23 (2006), pp. 669-674.
49. B. Sarel and M. Irani, Separating transparent layers through layer information exchange, in Proceedings of the European Conference on Computer Vision, 2004, pp. 328-341.
50. F. Sur, F. Cao, P. Musé, and Y. Gousseau, Unsupervised thresholds for shape matchings, in Proceedings of the International Conference on Image Processing, 2003.
51. R. Szeliski, Image alignment and stitching: A tutorial, Found. Trends Comput. Graph. Vis., 2 (2006), pp. 1-104.
52. R. Szeliski, S. Avidan, and P. Anandan, Layer extraction from multiple images containing reflections and transparency, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Vol. 1, 2000, pp. 246-253.
53. C. Vu, T. Phan, and D. Chandler, S3: A spectral and spatial measure of local perceived sharpness in natural images, IEEE Trans. Image Process., 21 (2011), p. 934-945.
54. Y. Weiss, Deriving intrinsic images from image sequences, in Proceedings of the International Conference on Computer Vision, 2001.
55. L. Yuan, J. Sun, L. Quan, and H.-Y. Shum, Image deblurring with blurred/noisy image pairs, ACM Trans. Graph., 26 (2007), article 1.
56. L. Zhang, S. Vaddadi, H. Jin, and S. Nayar, Multiple view image denoising, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2009, pp. 1542-1549.
57. Y. Zhao and R. Berns, Image-based spectral reflectance reconstruction using the matrix r method, Color Res. Appl., 32 (2007), pp. 343-351.