Joint demosaicing and denoising via learned nonparametric random fields

IEEE Transactions on Image Processing

Volumn 23, Issue 12, 2014, Pages 4968-4981

  Khashabi, Daniel ^a   Nowozin, Sebastian ^b   Jancsary, Jeremy ^c   Fitzgibbon, Andrew W ^b  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^b MICROSOFT RESEARCH   (United Kingdom)

^c Nuance Communications ^*  (Austria)

Author keywords

[No Author keywords available]

Indexed keywords

DE-NOISING; JOINT DEMOSAICING; NON-PARAMETRIC; RANDOM FIELDS;

IMAGE PROCESSING; NONPARAMETRIC TEST; PROCEDURES; REGRESSION ANALYSIS; SIGNAL NOISE RATIO;

IMAGE PROCESSING, COMPUTER-ASSISTED; REGRESSION ANALYSIS; SIGNAL-TO-NOISE RATIO; STATISTICS, NONPARAMETRIC;

EID: 84908245897     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2359774     Document Type: Article

References (59)

1. B. E. Bayer, "Color imaging array," U.S. Patent 3 971 065, Jul. 20, 1976
2. J. Jancsary, S. Nowozin, T. Sharp, and C. Rother, "Regression tree fields-An efficient, non-parametric approach to image labeling problems," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2012, pp. 2376-2383
3. J. Jancsary, S. Nowozin, and C. Rother, "Loss-specific training of nonparametric image restoration models: A new state of the art," in Proc. 12th Eur. Conf. Comput. Vis. (ECCV), 2012, pp. 112-125
4. Q. Huynh-Thu and M. Ghanbari, "Scope of validity of PSNR in image/video quality assessment," Electron. Lett., vol. 44, no. 13, pp. 800-801, Jun. 2008
5. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity," IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004
6. H.-C. Lee, Introduction to Color Imaging Science. Cambridge, U.K.: Cambridge Univ. Press, 2009
7. M. Stokes, M. Anderson, S. Chandrasekar, and R. Motta. (1996). A Standard Default Color Space for the Internet-sRGB. [Online]. Available: http://www.color.org/contrib/sRGB.html
8. Y. Li, P. Hao, Z. Lin, Y. Li, P. Hao, and Z. Lin, "Color filter arrays: Representation and analysis," Dept. Sci., QMUL, London, U.K., Tech. Rep. RR-08-04, 2008
9. J. Wang, C. Zhang, and P. Hao, "New color filter arrays of high light sensitivity and high demosaicking performance," in Proc. 18th IEEE Int. Conf. Image Process. (ICIP), Sep. 2011, pp. 3153-3156
10. B. K. Gunturk, Y. Altunbasak, and R. M. Mersereau, "Color plane interpolation using alternating projections," IEEE Trans. Image Process., vol. 11, no. 9, pp. 997-1013, Sep. 2002
11. D. R. Cok, "Signal processing method and apparatus for producing interpolated chrominance values in a sampled color image signal," U.S. Patent 4 642 678, Feb. 10, 1987
12. J. F. Hamilton, Jr., and J. E. Adams, Jr., "Apparatus for utilizing a digitized image signal," U.S. Patent 5 629 734, May 13, 1997
13. C. A. Laroche and M. A. Prescott, "Apparatus and method for adaptively interpolating a full color image utilizing chrominance gradients," U.S. Patent 5 373 322, Dec. 13, 1994
14. R. Lukac, K. N. Plataniotis, and D. Hatzinakos, "Color image zooming on the Bayer pattern," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 11, pp. 1475-1492, Nov. 2005
15. R. Kimmel, "Demosaicing: Image reconstruction from color CCD samples," Trans. Image Process., vol. 8, no. 9, pp. 1221-1228, Sep. 1999
16. R. H. Hibbard, "For processing a digitized image signal," U.S. Patent 5 382 976, Jan. 17, 1995
17. K. Hirakawa and T. W. Parks, "Adaptive homogeneity-directed demosaicing algorithm," IEEE Trans. Image Process., vol. 14, no. 3, pp. 360-369, Mar. 2005
18. D. Menon, S. Andriani, and G. Calvagno, "Demosaicing with directional filtering and a posteriori decision," IEEE Trans. Image Process., vol. 16, no. 1, pp. 132-141, Jan. 2007
19. D. Zhang and X. Wu, "Color demosaicking via directional linear minimum mean square-error estimation," IEEE Trans. Image Process., vol. 14, no. 12, pp. 2167-2178, Dec. 2005
20. D. Taubman, "Generalized Wiener reconstruction of images from colour sensor data using a scale invariant prior," in Proc. Int. Conf. Image Process. (ICIP), vol. 3. 2000, pp. 801-804
21. Y. M. Lu, M. Karzand, and M. Vetterli, "Demosaicking by alternating projections: Theory and fast one-step implementation," IEEE Trans. Image Process., vol. 19, no. 8, pp. 2085-2098, Aug. 2010
22. D. Alleysson, S. Susstrunk, and J. Hérault, "Linear demosaicing inspired by the human visual system," IEEE Trans. Image Process., vol. 14, no. 4, pp. 439-449, Apr. 2005
23. E. Dubois, "Frequency-domain methods for demosaicking of Bayer-sampled color images," IEEE Signal Process. Lett., vol. 12, no. 12, pp. 847-850, Dec. 2005
24. E. Dubois, "Filter design for adaptive frequency-domain Bayer demosaicking," in Proc. IEEE Int. Conf. Image Process. (ICIP), Oct. 2006, pp. 2705-2708
25. E. Dubois and M. Urlea, "Color-filter-array sampling of color images: Frequency-domain analysis and associated demosaicking algorithms: Additional results," in Single-Sensor Imaging: Methods and Applications for Digital Cameras, R. Lukac, Ed. Boca Raton, FL, USA: CRC Press, 2009
26. A. A. Moghadam, M. Aghagolzadeh, M. Kumar, and H. Radha, "Compressive framework for demosaicing of natural images," IEEE Trans. Image Process., vol. 22, no. 6, pp. 2356-2371, Jun. 2013
27. A. A. Moghadam, M. Aghagolzadeh, M. Kumar, and H. Radha, "Compressive demosaicing," in Proc. IEEE Int. Workshop Multimedia Signal Process. (MMSP), Oct. 2010, pp. 105-110
28. M. Aghagolzadeh, A. A. Moghadam, M. Kumar, and H. Radha, "Bayer and panchromatic color filter array demosaicing by sparse recovery," Proc. SPIE, Digital Photogr. VII, vol. 7876, p. 787603, Jan. 2011
29. J. Mairal, M. Elad, and G. Sapiro, "Sparse representation for color image restoration," IEEE Trans. Image Process., vol. 17, no. 1, pp. 53-69, Jan. 2008
30. C.-Y. Su, "Highly effective iterative demosaicing using weighted-edge and color-difference interpolations," IEEE Trans. Consum. Electron., vol. 52, no. 2, pp. 639-645, May 2006
31. L. Zhang, X. Wu, A. Buades, and X. Li, "Color demosaicking by local directional interpolation and nonlocal adaptive thresholding," J. Electron. Imag., vol. 20, no. 2, p. 023016, Jun. 2011
32. P. Milanfar, "A tour of modern image filtering: New insights and methods, both practical and theoretical," IEEE Signal Process. Mag., vol. 30, no. 1, pp. 106-128, Jan. 2013
33. P. Getreuer, "Color demosaicing with contour stencils," in Proc. 17th Int. Conf. Digit. Signal Process. (DSP), Jul. 2011, pp. 1-6
34. J. Sun and M. F. Tappen, "Separable Markov random field model and its applications in low level vision," IEEE Trans. Image Process., vol. 22, no. 1, pp. 402-407, Jan. 2013
35. F.-L. He, Y.-C. F. Wang, and K.-L. Hua, "Self-learning approach to color demosaicking via support vector regression," in Proc. 19th IEEE ICIP, Sep./Oct. 2012, pp. 2765-2768
36. D. R. Cok, "Single-chip electronic color camera with color-dependent birefringent optical spatial frequency filter and red and blue signal interpolating circuit," U.S. Patent 4 605 956, Aug. 12, 1986
37. D. Paliy, V. Katkovnik, R. Bilcu, S. Alenius, and K. Egiazarian, "Spatially adaptive color filter array interpolation for noiseless and noisy data," Int. J. Imag. Syst. Technol., vol. 17, no. 3, pp. 105-122, 2007
38. A. Foi, M. Trimeche, V. Katkovnik, and K. Egiazarian, "Practical Poissonian-Gaussian noise modeling and fitting for single-image rawdata," IEEE Trans. Image Process., vol. 17, no. 10, pp. 1737-1754, Oct. 2008
39. J. Takamatsu, Y. Matsushita, T. Ogasawara, and K. Ikeuchi, "Estimating demosaicing algorithms using image noise variance," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2010, pp. 279-286
40. L. Zhang, X. Wu, and D. Zhang, "Color reproduction from noisy CFA data of single sensor digital cameras," IEEE Trans. Image Process., vol. 16, no. 9, pp. 2184-2197, Sep. 2007
41. K. Hirakawa and T. W. Parks, "Joint demosaicing and denoising," IEEE Trans. Image Process., vol. 15, no. 8, pp. 2146-2157, Aug. 2006
42. B. Leung, G. Jeon, and E. Dubois, "Least-squares luma-chroma demultiplexing algorithm for Bayer demosaicking," IEEE Trans. Image Process., vol. 20, no. 7, pp. 1885-1894, Jul. 2011
43. L. Condat and S. Mosaddegh, "Joint demosaicking and denoising by total variation minimization," in Proc. 19th IEEE Int. Conf. Image Process. (ICIP), Sep./Oct. 2012, pp. 2781-2784
44. A. Danielyan, M. Vehvilainen, A. Foi, V. Katkovnik, and K. Egiazarian, "Cross-color BM3D filtering of noisy raw data," in Proc. Int. Workshop Local Non-Local Approx. Image Process., Aug. 2009, pp. 125-129
45. D. Menon and G. Calvagno, "Joint demosaicking and denoisingwith space-varying filters," in Proc. 16th IEEE Int. Conf. Image Process. (ICIP), Nov. 2009, pp. 477-480
46. O. Kalevo and H. Rantanen, "Noise reduction techniques for Bayer-matrix images," Proc. SPIE, vol. 4669, pp. 348-359, Apr. 2002
47. S. H. Park, H. S. Kim, S. Lansel, M. Parmar, and B. A. Wandell, "A case for denoising before demosaicking color filter array data," in Proc. Conf. Rec. 43rd Asilomar Conf. Signals, Syst. Comput., Nov. 2009, pp. 860-864
48. P. Chatterjee, N. Joshi, S. B. Kang, and Y. Matsushita, "Noise suppression in low-light images through joint denoising and demosaicing," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2011, pp. 321-328
49. L. Zhang, R. Lukac, X. Wu, and D. Zhang, "PCA-based spatially adaptive denoising of CFA images for single-sensor digital cameras," IEEE Trans. Image Process., vol. 18, no. 4, pp. 797-812, Apr. 2009
50. K. Hirakawa and T. W. Parks, "Image denoising for signal-dependent noise," in Proc. IEEE ICASSP, vol. 2. Mar. 2005, pp. 29-32
51. L. Condat, "A simple, fast and efficient approach to denoisaicking: Joint demosaicking and denoising," in Proc. 17th IEEE Int. Conf. Image Process. (ICIP), Sep. 2010, pp. 905-908
52. G. Jeon and E. Dubois, "Demosaicking of noisy Bayer-sampled color images with least-squares luma-chroma demultiplexing and noise level estimation," IEEE Trans. Image Process., vol. 22, no. 1, pp. 146-156, Jan. 2013
53. D. Zoran and Y. Weiss, "Scale invariance and noise in natural images," in Proc. IEEE 12th Int. Conf. Comput. Vis. (ICCV), Sep./Oct. 2009, pp. 2209-2216
54. F. R. Kschischang, B. J. Frey, and H.-A. Loeliger, "Factor graphs and the sum-product algorithm," IEEE Trans. Inf. Theory, vol. 47, no. 2, pp. 498-519, Feb. 2001
55. S. Nowozin and C. H. Lampert, "Structured learning and prediction in computer vision," Found. Trends Comput. Graph. Vis., vol. 6, nos. 3-4, pp. 185-365, Mar. 2011
56. D. Koller and N. Friedman, Probabilistic Graphical Models: Principles and Techniques. Cambridge, MA, USA: MIT Press, 2009
57. U. Schmidt, C. Rother, S. Nowozin, J. Jancsary, and S. Roth, "Discriminative non-blind deblurring," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2013, pp. 604-611
58. S. J. Kim, H. T. Lin, Z. Lu, S. Süsstrunk, S. Lin, and M. S. Brown, "A new in-camera imaging model for color computer vision and its application," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 12, pp. 2289-2302, Dec. 2012
59. J. Jiang, D. Liu, J. Gu, and S. Süsstrunk, "What is the space of spectral sensitivity functions for digital color cameras?" in Proc. IEEE Workshop Winter Conf. Appl. Comput. Vis., Jan. 2013, pp. 168-179.