Beyond Color Difference: Residual Interpolation for Color Image Demosaicking

IEEE Transactions on Image Processing

Volumn 25, Issue 3, 2016, Pages 1288-1300

  Kiku, Daisuke ^a   Monno, Yusuke ^a   Tanaka, Masayuki ^a   Okutomi, Masatoshi ^a  

^a TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

Author keywords

Bayer color filter array; demosaicking; guided upsampling; residual interpolation

Indexed keywords

ALGORITHMS; COLOR IMAGE PROCESSING; COLORIMETRY; INTERPOLATION; LAPLACE TRANSFORMS; PIXELS;

BAYER COLOR FILTER ARRAY; COLOR DIFFERENCE; DEMOSAICKING; GRADIENT BASED; IMAGE INTERPOLATIONS; STATE OF THE ART; STATE-OF-THE-ART ALGORITHMS; UP SAMPLING;

COLOR;

EID: 84962741321     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2016.2518082     Document Type: Article

References (42)

1. R. Lukac, Single-Sensor Imaging: Methods and Applications for Digital Cameras. Boca Raton, FL, USA: CRC Press, 2008.
2. B. E. Bayer, "Color imaging array, " U. S. Patent 3 971 065, Jul. 20, 1976.
3. B. K. Gunturk, J. Glotzbach, Y. Altunbasak, R. W. Schafer, and R. M. Mersereau, "Demosaicking: Color filter array interpolation, " IEEE Signal Process. Mag., vol. 22, no. 1, pp. 44-54, Jan. 2005.
4. X. Li, B. Gunturk, and L. Zhang, "Image demosaicing: A systematic survey, " Proc. SPIE, vol. 6822, pp. 68221J-1-68221J-15, Jan. 2008.
5. D. Menon and G. Calvagno, "Color image demosaicking: An overview, " Signal Process., Image Commun., vol. 26, nos. 8-9, pp. 518-533, Oct. 2011.
6. R. Kimmel, "Demosaicing: Image reconstruction from color CCD samples, " IEEE Trans. Image Process., vol. 8, no. 9, pp. 1221-1228, Sep. 1999.
7. R. Lukac and K. N. Plataniotis, "Normalized color-ratio modeling for CFA interpolation, " IEEE Trans. Consum. Electron., vol. 50, no. 2, pp. 737-745, May 2004.
8. D. R. Cok, "Signal processing method and apparatus for producing interpolated chrominance values in a sampled color image signal, " U. S. Patent 4 642 678, Feb. 10, 1987.
9. R. H. Hibbard, "Apparatus and method for adaptively interpolating a full color image utilizing luminance gradients, " U. S. Patent 5 382 976, Jan. 17, 1995.
10. J. F. Hamilton, Jr., and J. E. Adams, Jr., "Adaptive color plan interpolation in single sensor color electronic camera, " U. S. Patent 5 629 734, May 13, 1997.
11. D. Alleysson, S. Süsstrunk, and J. Hérault, "Linear demosaicing inspired by the human visual system, " IEEE Trans. Image Process., vol. 14, no. 4, pp. 439-449, Apr. 2005.
12. E. Dubois, "Frequency-domain methods for demosaicking of Bayer-sampled color images, " IEEE Signal Process. Lett., vol. 12, no. 12, pp. 847-850, Dec. 2005.
13. N.-X. Lian, L. Chang, Y.-P. Tan, and V. Zagorodnov, "Adaptive filtering for color filter array demosaicking, " IEEE Trans. Image Process., vol. 16, no. 10, pp. 2515-2525, Oct. 2007.
14. B. Leung, G. Jeon, and E. Dubois, "Least-squares luma-chroma demultiplexing algorithm for Bayer demosaicking, " IEEE Trans. Image Process., vol. 20, no. 7, pp. 1885-1894, Jul. 2011.
15. J. Mairal, F. Bach, J. Ponce, G. Sapiro, and A. Zisserman, "Non-local sparse models for image restoration, " in Proc. Conf. Comput. Vis. Pattern Recognit. (CVPR), Sep. /Oct. 2009, pp. 2272-2279.
16. A. A. Moghadam, M. Aghagolzadeh, M. Kumar, and H. Radha, "Compressive framework for demosaicing of natural images, " IEEE Trans. Image Process., vol. 22, no. 6, pp. 2356-2371, Jun. 2013.
17. K. Hirakawa and T. W. Parks, "Adaptive homogeneity-directed demosaicing algorithm, " IEEE Trans. Image Process., vol. 14, no. 3, pp. 360-369, Mar. 2005.
18. D. Menon, S. Andriani, and G. Calvagno, "Demosaicing with directional filtering and a posteriori decision, " IEEE Trans. Image Process., vol. 16, no. 1, pp. 132-141, Jan. 2007.
19. I. Pekkucuksen and Y. Altunbasak, "Gradient based threshold free color filter array interpolation, " in Proc. IEEE Int. Conf. Image Process. (ICIP), Sep. 2010, pp. 137-140.
20. I. Pekkucuksen and Y. Altunbasak, "Multiscale gradients-based color filter array interpolation, " IEEE Trans. Image Process., vol. 22, no. 1, pp. 157-165, Jan. 2013.
21. L. Zhang and X. Wu, "Color demosaicking via directional linear minimum mean square-error estimation, " IEEE Trans. Image Process., vol. 14, no. 12, pp. 2167-2178, Dec. 2005.
22. K.-H. Chung and Y.-H. Chan, "Color demosaicing using variance of color differences, " IEEE Trans. Image Process., vol. 15, no. 10, pp. 2944-2955, Oct. 2006.
23. D. Paliy, V. Katkovnik, R. Bilcu, S. Alenius, and K. Egiazarian, "Spatially adaptive color filter array interpolation for noiseless and noisy data, " Int. J. Imag. Syst. Technol., vol. 17, no. 3, pp. 105-122, 2007.
24. B. K. Gunturk, Y. Altunbasak, and R. M. Mersereau, "Color plane interpolation using alternating projections, " IEEE Trans. Image Process., vol. 11, no. 9, pp. 997-1013, Sep. 2002.
25. X. Li, "Demosaicing by successive approximation, " IEEE Trans. Image Process., vol. 14, no. 3, pp. 370-379, Mar. 2005.
26. A. Buades, B. Coll, J.-M. Morel, and C. Sbert, "Self-similarity driven color demosaicking, " IEEE Trans. Image Process., vol. 18, no. 6, pp. 1192-1202, Jun. 2009.
27. L. Zhang, X. Wu, A. Buades, and X. Li, "Color demosaicking by local directional interpolation and nonlocal adaptive thresholding, " J. Electron. Imag., vol. 20, no. 2, pp. 023016-1-023016-16, Jun. 2011.
28. J. Duran and A. Buades, "Self-similarity and spectral correlation adaptive algorithm for color demosaicking, " IEEE Trans. Image Process., vol. 23, no. 9, pp. 4031-4040, Sep. 2014.
29. D. Kiku, Y. Monno, M. Tanaka, and M. Okutomi, "Residual interpolation for color image demosaicking, " in Proc. IEEE Int. Conf. Image Process. (ICIP), Sep. 2013, pp. 2304-2308.
30. D. Kiku, Y. Monno, M. Tanaka, and M. Okutomi, "Minimized-Laplacian residual interpolation for color image demosaicking, " Proc. SPIE, vol. 9023, pp. 90230L-1-90230L-8, Mar. 2014.
31. K. He, J. Sun, and X. Tang, "Guided image filtering, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 6, pp. 1397-1409, Jun. 2013.
32. True Color Kodak Images. [Online]. Available: http: //r0k. us/graphics/ kodak/
33. Bradley J. Lucier's Page. [Online]. Available: http: //www. math. purdue. edu/~lucier/
34. Kodak Image Dataset (High-Resolution Version). [Online]. Available: http: //www. math. purdue. edu. /~lucier/PHOTO-CD/BMP-IMAGES/
35. S. Andriani, H. Brendel, T. Seybold, and J. Goldstone, "Beyond the Kodak image set: A new reference set of color image sequences, " in Proc. IEEE Int. Conf. Image Process. (ICIP), Sep. 2013, pp. 2289-2293.
36. C. Tomasi and R. Manduchi, "Bilateral filtering for gray and color images, " in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Jan. 1998, pp. 839-846.
37. Y. Monno, M. Tanaka, and M. Okutomi, "Multispectral demosaicking using adaptive kernel upsampling, " in Proc. IEEE Int. Conf. Image Process. (ICIP), Sep. 2011, pp. 3157-3160.
38. Y. Monno, M. Tanaka, and M. Okutomi, "Multispectral demosaicking using guided filter, " Proc. SPIE, vol. 8299, pp. 82990O-1-82990O-7, Jan. 2012.
39. S-CIELAB Page. [Online]. Available: http: //white. stanford. edu/~brian/ scielab/
40. X. Zhang and B. A. Wandell, "A spatial extension of CIELAB for digital color-image reproduction, " J. Soc. Inf. Display, vol. 5, no. 1, pp. 61-63, Mar. 1997.
41. K. Hirakawa and P. J. Wolfe, "Spatio-spectral color filter array design for optimal image recovery, " IEEE Trans. Image Process., vol. 17, no. 10, pp. 1876-1890, Oct. 2008.
42. L. Condat, "A new color filter array with optimal properties for noiseless and noisy color image acquisition, " IEEE Trans. Image Process., vol. 20, no. 8, pp. 2200-2210, Aug. 2011.