Learning joint demosaicing and denoising based on sequential energy minimization

2016 IEEE International Conference on Computational Photography, ICCP 2016 - Proceedings

Volumn , Issue , 2016, Pages

  Klatzer, Teresa ^a   Hammernik, Kerstin ^a   Knobelreiter, Patrick ^a   Pock, Thomas ^a,b  

^a GRAZ UNIVERSITY OF TECHNOLOGY   (Austria)

^b AIT AUSTRIAN INSTITUTE OF TECHNOLOGY   (Austria)

Author keywords

[No Author keywords available]

Indexed keywords

COLOR PHOTOGRAPHY; IMAGE QUALITY; IMAGE RECONSTRUCTION;

ACTIVATION FUNCTIONS; DEMOSAICING ALGORITHM; ENERGY MINIMIZATION; ENERGY MINIMIZATION PROBLEM; IMAGE RESTORATION PROBLEM; LEARNING-BASED METHODS; PEAK SIGNAL TO NOISE RATIO; VARIATIONAL ENERGIES;

SIGNAL TO NOISE RATIO;

EID: 84979687789     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICCPHOT.2016.7492871     Document Type: Conference Paper

References (45)

1. B. Bayer, "Color Imaging Array, " July 20 1976. US Patent 3, 971, 065.
2. D. Khashabi, S. Nowozin, J. Jancsary, A. W. Fitzgibbon, "Joint Demosaicing and Denoising via Learned Nonparametric Random Fields, " IEEE Transactions on Image Processing, vol. 23, no. 12, pp. 4968-81, 2014.
3. A. Foi, M. Trimeche, V. Katkovnik, K. Egiazarian, "Practical Poissonian-Gaussian Noise Modeling and Fitting for Single-Image Raw-Data, " IEEE Transactions on Image Processing, vol. 17, no. 1, pp. 1737-1754, 2008.
4. X. Li, B. Gunturk, L. Zhang, "Image Demosaicing: A Systematic Survey, " Proceedings of SPIE, vol. 6822, 2008.
5. D. Menon and G. Calvagno, "Color Image Demosaicking: An Overview, " Signal Processing: Image Communication, vol. 26, no. 8-9, pp. 518-533, 2011.
6. D. Cok, "Signal Processing Method and Apparatus for Producing Interpolated Chrominance Values in a Sampled Color Image Signal, " Feb. 10 1987. US Patent 4, 642, 678.
7. C. Laroche and M. Prescott, "Apparatus and Method for Adaptively Interpolating a Full Color Image Utilizing Chrominance Gradients, " Dec. 13 1994. US Patent 5, 373, 322.
8. J. Hamilton and J. Adams, "Adaptive Color Plane Interpolation in Single Sensor Color Electronic Camera, " May 13 1997. US Patent 5, 629, 734.
9. K. Hirakawa and T. W. Parks, "Adaptive Homogeneity-Directed Demosaicing Algorithm, " IEEE Transactions on Image Processing, vol. 14, no. 3, pp. 360-369, 2005.
10. L. Zhang and X. Wu, "Color Demosaicking via Directional Linear Minimum Mean Square-Error Estimation, " IEEE Transactions on Image Processing, vol. 14, no. 12, pp. 2167-2178, 2005.
11. C. Su, "Highly Effective Iterative Demosaicing Using Weighted-Edge and Color-Difference Interpolations, " IEEE Transactions on Consumer Electronics, vol. 52, no. 2, pp. 639-645, 2006.
12. D. Paliy, V. Katkovnik, R. Bilcu, S. Alenius, K. Egiazarian, "Spatially Adaptive Color Filter Array Interpolation for Noiseless and Noisy Data, " International Journal of Imaging Systems and Technology, vol. 17, no. 3, pp. 105-122, 2007.
13. D. Menon, S., riani, G. Calvagno, "Demosaicing With Directional Filtering and a Posteriori Decision, " IEEE Transactions on Image Processing, vol. 16, no. 1, pp. 132-141, 2007.
14. P. Getreuer, "Contour Stencils for Edge-Adaptive Image Interpolation, " Proceedings of SPIE, vol. 7257, 2009.
15. Y. M. Lu, M. Karzand, M. Vetterli, "Demosaicking by Alternating Projections: Theory and Fast One-Step Implementation, " IEEE Transactions on Image Processing, vol. 19, no. 8, pp. 2085-2098, 2010.
16. A. Buades, B. Coll, J. M. Morel, C. Sbert, "Self-Similarity Driven Color Demosaicking, " IEEE Transactions on Image Processing, vol. 18, no. 6, pp. 1192-1202, 2009.
17. L. Zhang, X. Wu, A. Buades, X. Li, "Color Demosaicking by Local Directional Interpolation and Nonlocal Adaptive Thresholding, " Journal of Electronic Imaging, vol. 20, no. 2, 2011.
18. J. Duran and A. Buades, "Self-similarity and Spectral Correlation Adaptive Algorithm for Color Demosaicking, " IEEE transactions on image processing, vol. 23, no. 9, pp. 4031-4040, 2014.
19. K. Chang, P. L. K. Ding, B. Li, "Color Image Demosaicking Using Inter-Channel Correlation and Nonlocal Self-Similarity, " Signal Processing: Image Communication, vol. 39, pp. 264-279, 2015.
20. K. Hirakawa and X.-L. Meng, "An Empirical Bayes EMWavelet Unification for Simultaneous Denoising, Interpolation,/or Demosaicing, " IEEE Transactions on Image Processing, 2006.
21. L. Zhang, X. Wu, D. Zhang, "Color Reproduction from Noisy CFA Data of Single Sensor Digital Cameras, " IEEE Transactions on Image Processing, vol. 16, no. 9, pp. 2184-2197, 2007.
22. D. Paliy, A. Foi, R. Bilcu, V. Katkovnik, "Denoising and Interpolation of Noisy Bayer Data with Adaptive Cross-Color Filters, " Proceedings of SPIE, vol. 6822, 2008.
23. L. Condat, "A Simple, Fast and Efficient Approach to Denoisaicking: Joint Demosaicking and Denoising, " IEEE International Conference on Image Processing, 2010.
24. O. Kapah and H. Z. Hel-Or, "Demosaicking Using Artificial Neural Networks, " Applications of Artificial Neural Networks in Image Processing, pp. 112-120, 2000.
25. F.-L. He, Y.-C. F. Wang, K.-L. Hua, "A Self-Learning Approach to Color Demosaicking via Support Vector Regression, " in IEEE International Conference on Image Processing, 2012.
26. J. Sun and M. F. Tappen, "Separable Markov Random Field Model and its Applications in Low Level Vision, " IEEE transactions on image processing, vol. 22, no. 1, pp. 402-8, 2013.
27. J. Mairal, M. Elad, G. Sapiro, "Sparse Representation for Color Image Restoration, " IEEE transactions on image processing, vol. 17, no. 1, pp. 53-69, 2008.
28. J. Mairal, F. Bach, J. Ponce, G. Sapiro, A. Zisserman, "Non-local Sparse Models for Image Restoration, " IEEE International Conference on Computer Vision, vol. 2, pp. 2272-2279, 2009.
29. W. C. Karl, "Regularization in Image Restoration and Reconstruction, " Handbook of Image and Video Processing, pp. 141-160, 2000.
30. T. Saito and T. Komatsu, "Demosaicing Approach Based on Extended Color Total-Variation Regularization, " IEEE International Conference on Image Processing, pp. 885-888, 2008.
31. D. Menon and G. Calvagno, "Regularization Approaches to Demosaicking, " IEEE Transactions on Image Processing, vol. 18, no. 10, pp. 2209-2220, 2009.
32. K. Dabov, A. Foi, K. Egiazarian, "Image Denoising by Sparse 3D Transform-domain Collaborative Filtering, " IEEE Transactions on Image Processing, vol. 16, no. 8, 2007.
33. F. Heide, M. Steinberger, Y.-T. Tsai, R. Mushfiqur, D. Pajk, D. Reddy, O. Gallo, J. Liu, W. Heidrich, K. Egiazarian, J. Kautz, K. Pulli, "FlexISP : A Flexible Camera Image Processing Framework, " ACM Transactions on Graphics (Proceedings SIGGRAPH Asia), vol. 33, no. 6, 2014.
34. Y. Chen, W. Yu, T. Pock, "On Learning Optimized Reaction Diffusion Processes for Effective Image Restoration, " in International Conference on Computer Vision and Pattern Recognition, pp. 5261-5269, 2015.
35. B. Colson, P. Marcotte, G. Savard, "An Overview of Bilevel Optimization, " Annals of Operations Research, vol. 153, no. 1, pp. 235-256, 2007.
36. K. Kunisch and T. Pock, "A Bilevel Optimization Approach for Parameter Learning in Variational Models, " SIAM Journal on Imaging Sciences, vol. 6, no. 2, pp. 938-983, 2013.
37. D. P. Bertsekas, Nonlinear programming. Athena Scientific, 1999.
38. Y. LeCun, L. Bottou, Y. Bengio, P. Haffner, "Gradientbased Learning Applied to Document Recognition, " Proceedings of the IEEE, vol. 86, no. 11, pp. 2278-2323, 1998.
39. S. Roth and M. J. Black, "Fields of experts, " International Journal of Computer Vision, vol. 82, no. 2, pp. 205-229, 2009.
40. H. S. Malvar, L.-W. He, R. Cutler, "High-quality Linear Interpolation for Demosaicing of Bayer-Patterned Color Images, " IEEE International Conference on Acoustics, Speech, Signal Processing, vol. 3, pp. 5-8, 2004.
41. Z. Wang, A. C. Bovik, H. R. Sheikh, E. P. Simoncelli, "Image Quality Assessment: From Error Visibility to Structural Similarity, " IEEE Transactions on Image Processing, vol. 13, no. 4, pp. 600-612, 2004.
42. R. Byrd, P. Lu, J. Nocedal, C. Zhu, "A Limited Memory Algorithm for Bound Constrained Optimization, " SIAM Journal on Scientific Computing, vol. 16, no. 5, pp. 1190-1208, 1995.
43. J. Bergstra, O. Breuleux, F. F. Bastien, P. Lamblin, R. Pascanu, G. Desjardins, J. Turian, D. Warde-Farley, Y. Bengio, "Theano: a CPU and GPU Math Compiler in Python, " Proceedings of the Python for Scientific Computing Conference, 2010.
44. A. van den Oord and B. Schrauwen, "The Student-t Mixture as a Natural Image Patch Prior with Application to Image Compression, " Journal of Machine Learning Research, vol. 15, pp. 2061-2086, 2014.
45. Y. Chen, R. Ranftl, T. Pock, "Insights Into Analysis Operator Learning: From Patch-Based Sparse Models to Higher Order MRFs, " IEEE Transactions on Image Processing, vol. 23, no. 3, pp. 1060-1072, 2014.