PCA-based spatially adaptive denoising of CFA images for single-sensor digital cameras

IEEE Transactions on Image Processing

Volumn 18, Issue 4, 2009, Pages 797-812

  Zhang, Lei ^a   Lukac, Rastislav ^b   Wu, Xiaolin ^c   Zhang, David ^a  

^a HONG KONG POLYTECHNIC UNIVERSITY   (Hong Kong)

^b Epson Canada Ltd   (Canada)

^c MCMASTER UNIVERSITY   (Canada)

Author keywords

Adaptive denoising; Bayer pattern; Color filter array (CFA); Demosaicking; Principle component analysis (PCA)

Indexed keywords

ADAPTIVE ALGORITHMS; CAMERAS; COLOR; COLOR IMAGE PROCESSING; FEEDBACK AMPLIFIERS; IMAGE ACQUISITION; IMAGE ENHANCEMENT; SENSORS;

ADAPTIVE DENOISING; BAYER PATTERN; COLOR FILTER ARRAY (CFA); DEMOSAICKING; PRINCIPLE COMPONENT ANALYSIS (PCA);

EDGE DETECTION;

EID: 63749133248     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2008.2011384     Document Type: Article

References (39)

1. "Color Imaging Array," U.S. patent 3 971 065, 1975.
2. P. Longère, X. Zhang, P. B. Delahunt, and D. H. Brainard, "Perceptual assessment of demosaicing algorithm performance," Proc. IEEE, vol. 90, no. 1, pp. 123-132, Jan. 2002.
3. J. E. Adams, "Intersections between color plane interpolation and other image processing functions in electronic photography," Proc. SPIE vol. 2416, pp. 144-151, 1995.
4. J. E. Adams and J. F. Hamilton, Jr., "Adaptive Color Plane Interpolation in Single Color Electronic Camera," U.S. Patent, 5 506 619, 1996.
5. E. Chang, S. Cheung, and D. Y. Pan, "Color filter array recovery using a threshold-based variable number of gradients," Proc. SPIE, vol. 3650, pp. 36-43, 1999.
6. R. Kimmel, "Demosaicing: Image reconstruction from CCD samples," IEEE Trans. Image Process., vol. 8, no. 9, pp. 1221-1228, Sep. 1999.
7. B. K. Gunturk, Y. Altunbasak, and R. M. Mersereau, "Color plane interpolation using alternating projections," IEEE Trans. Image Process., vol. 11, no. 9, pp. 997-1013, Sep. 2002.
8. B. K. Gunturk, J. Glotzbach, Y. Altunbasak, R. W. Schafer, and R. M. Mersereau, "Demosaicking: Color filter array interpolation in single-chip digital cameras," IEEE Signal Process. Mag., vol. 22, no. 1, pp. 44-54, Jan. 2005.
9. L. Zhang and X. Wu, "Color demosaicking via directional linear minimum mean square-error estimation," IEEE Trans. Image Process., vol. 14, no. 12, pp. 2167-2178, Dec. 2005.
10. K. Hirakawa and T. W. Parks, "Adaptive homogeneity-directed demosaicing algorithm," IEEE Trans. Image Process., vol. 14, no. 3, pp. 360-369, Mar. 2005.
11. R. Lukac and K. N. Plataniotis, "Color filter arrays: Design and performance analysis," IEEE Trans. Consum. Electron., vol. 51, no. 11, pp. 1260-1267, Nov. 2005.
12. R. Lukac and K. N. Plataniotis, "A taxonomy of color image filtering and enhancement solutions," in Advances in Imaging and Electron Physics, P. W. Hawkes, Ed. New York: Elsevier/Academic, 2006, vol. 140, pp. 187-264.
13. R. Lukac, B. Smolka, K. Martin, K. N. Plataniotis, and A. N. Venetsanopoulos, "Vector filtering for color imaging," IEEE Signal Process. Mag., vol. 22, no. 1, pp. 74-86, Jan. 2005.
14. R. Lukac, K. Martin, and K. N. Plataniotis, "Demosaicked image post-processing using local color ratios," IEEE Trans. Circuits Syst. Video Technol., vol. 14, no. 6, pp. 914-920, Jun. 2004.
15. X. Li, "Demosaicing by successive approximation," IEEE Trans. Image Process., vol. 14, no. 3, pp. 370-379, Mar. 2005.
16. D. Alleysson, S. Susstrunk, and J. Herault, "Linear demosaicing inspired by the human visual system," IEEE Trans. Image Process., vol. 14, no. 4, pp. 439-449, Apr. 2005.
17. D. D. Muresan and T. W. Parks, "Demosaicing using optimal recovery," IEEE Trans. Image Process., vol. 14, no. 2, pp. 267-278, Feb. 2005.
18. S. Mallat, A Wavelet Tour of Signal Processing. New York: Academic, 1998.
19. D. L. Donoho and I. M. Johnstone, "Ideal spatial adaptation via wavelet shrinkage," Biometrika, vol. 81, pp. 425-455, 1994.
20. R. R. Coifman and D. L. Donoho, "Translation-invariant de-noising," in Wavelet and Statistics, A. Antoniadis and G. Oppenheim, Eds., 1st ed. Berlin, Germany: Springer-Verlag, 1995.
21. S. G. Chang, B. Yu, and M. Vetterli, "Spatially adaptive wavelet thresholding with context modeling for image denoising," IEEE Trans. Image Process., vol. 9, no. 9, pp. 1522-1531, Sep. 2000.
22. L. Zhang, P. Bao, and X. Wu, "Multiscale LMMSE-based image denoising with optimal wavelet selection," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 4, pp. 469-481, Apr. 2005.
23. M. K. Mihçak, I. Kozintsev, K. Ramchandran, and P. Moulin, "Low-complexity image denoising based on statistical modeling of wavelet coefficients," IEEE Signal Process. Lett., vol. 6, no. 12, pp. 300-303, Dec. 1999.
24. A. Pizurica and W. Philips, "Estimating the probability of the presence of a signal of interest in multiresolution single- and multiband image denoising," IEEE Trans. Image Process., vol. 15, no. 3, pp. 654-665, Mar. 2006.
25. J. Portilla, V. Strela, M. J. Wainwright, and E. P. Simoncelli, "Image denoising using scale mixtures of gaussians in the wavelet domain," IEEE Trans. Image Process., vol. 12, no. 11, pp. 1338-1351, Nov. 2003.
26. D. D. Muresan and T. W. Parks, "Adaptive principal components and image denoising," in Proc. Int. Conf. Image Processing, Sep. 14-17, 2003, vol. 1, pp. I101-I104.
27. K. Hirakawa and T. W. Parks, "Joint demosaicking and denoising," IEEE Trans. Image Process., vol. 15, no. 8, pp. 2146-2157, Aug. 2006.
28. K. Hirakawa, X.-L. Meng, and P. J.Wolfe, "A framework for wavelet-based analysis and processing of color filter array images with applications to denoising and demosaicing," in Proc. ICASSP, Apr. 2007, vol. 1, pp. I-597-I-600.
29. K. Hirakawa and X.-L. Meng, "An empirical bayes EM-wavelet unification for simultaneous denoising, interpolation, and/or demosaicing," in Proc. Int. Conf. Image Process., Oct. 2006, pp. 1453-1456.
30. L. Zhang, X. Wu, and D. Zhang, "Color reproduction from noisy CFA data of single sensor digital cameras," IEEE Trans. Image Process., vol. 16, no. 9, pp. 2184-2197, Sep. 2007.
31. D. Paliy, V. Katkovnik, R. Bilcu, S. Alenius, and K. Egiazarian, "Spatially adaptive color filter array interpolation for noiseless and noisy data," Int. J. Imaging Systems and Technology, Special Issue on Applied Color Image Processing, vol. 17, pp. 105-122, 2007.
32. D. Paliy, M. Trimeche, V. Katkovnik, and S. Alenius, "Demosaicing of noisy data: Spatially adaptive approach," Proc. SPIE, vol. 6497, pp. 64970K-64970K, 2007.
33. H. J. Trussell and R. E. Hartwig, "Mathematics for demosaicking," IEEE Trans. Image Process., vol. 11, no. 4, pp. 485-492, Apr. 2002.
34. R. Ramanath and W. E. Snyder, "Adaptive demosaicking," J. Electron. Imag., vol. 12, no. 4, pp. 633-642, Oct. 2003.
35. A. Foi, S. Alenius, V. Katkovnik, and K. Egiazarian, "Noise measurement for raw-data of digital imaging sensors by automatic segmentation of nonuniform targets," IEEE Sensors J., vol. 7, pp. 1456-1461, 2007.
36. A. Foi, V. Katkovnik, D. Paliy, K. Egiazarian, M. Trimeche, S. Alenius, R. Bilcu, and M. Vehvilainen, "Apparatus, Method, Mobile Station and Computer Program Product for Noise Estimation, Modeling and Filtering of a Digital Image," U.S. Patent Application No. 11/426,128, 2006.
37. C. C. Koh, J. Mukherjee, and S. K. Mitra, "New efficient methods of image compression in digital cameras with color filter array," IEEE Trans. Consum. Electron., vol. 49, no. 11, pp. 1448-1456, Nov. 2003.
38. S. Haykin, Neural Networks: A Comprehensive Foundation, 2nd ed. Englewood Cliffs, NJ: Prentice-Hall, 1999.
39. K. Fukunaga, Introduction to Statistical Pattern Recognition, 2nd ed. New York: Academic, 1991.