Adaptive multispectral demosaicking based on frequency-domain analysis of spectral correlation

IEEE Transactions on Image Processing

Volumn 26, Issue 2, 2017, Pages 953-968

  Jaiswal, Sunil Prasad ^a   Fang, Lu ^a   Jakhetiya, Vinit ^a   Pang, Jiahao ^b   Mueller, Klaus ^c,d   Au, Oscar Chi ^a  

^a HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

^b SENSETIME RESEARCH   (China)

^c Stony Brook University   (United States)

^d State University of New York   (South Korea)

Author keywords

Color difference; demosaicking; frequency analysis; multispectral color filter array; spectral correlation

Indexed keywords

ANTI-ALIASING; COLOR; COLORIMETRY; IMAGE PROCESSING; IMAGE RECONSTRUCTION; INTERPOLATION;

COLOR DIFFERENCE; DEMOSAICKING; FREQUENCY ANALYSIS; MULTI-SPECTRAL COLORS; SPECTRAL CORRELATION;

FREQUENCY DOMAIN ANALYSIS;

EID: 85015182692     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2016.2634120     Document Type: Article

References (57)

1. C. Yang, J. H. Everitt, Q. Du, B. Luo, and J. Chanussot, " Using highresolution airborne and satellite imagery to assess crop growth and yield variability for precision agriculture, " Proc. IEEE, vol. 101, no. 3, pp. 582-592, Mar. 2013.
2. A. Zia, J. Liang, J. Zhou, and Y. Gao, " 3D reconstruction from hyperspectral images, " in Proc. IEEE Winter Conf. Appl. Comput. Vis. (WACV), Jan. 2015, pp. 318-325.
3. G. Lu and B. Fei, " Medical hyperspectral imaging: A review, " J. Biomed. Opt., vol. 19, no. 1, p. 010901, Jan. 2014.
4. Y. Monno, M. Tanaka, and M. Okutomi, " Multispectral demosaicking using adaptive kernel upsampling, " in Proc. IEEE Int. Conf. Image Process. (ICIP), Sep. 2011, pp. 3157-3160.
5. H. Fukuda, T. Uchiyama, H. Haneishi, M. Yamaguchi, and N. Ohyama, " Development of a 16-band multispectral image archiving system, " Proc. SPIE, vol. 5667, pp. 136-145, Jan. 2005.
6. C. Chi, H. Yoo, and M. Ben-Ezra, " Multi-spectral imaging by optimized wide band illumination, " Int. J. Comput. Vis., vol. 86, nos. 2-3, pp. 140-151, 2010.
7. S. Han, I. Sato, T. Okabe, and Y. Sato, " Fast spectral reflectance recovery using DLP projector, " in Proc. Asian Conf. Comput. Vis. (ACCV), 2010, pp. 318-330.
8. K. Ohsawa, et al., " Six band HDTV camera system for spectrum-based color reproduction, " J. Imag. Sci. Technol., vol. 48, no. 2, pp. 85-92, 2004.
9. P.-J. Lapray, X. Wang, J.-B. Thomas, and P. Gouton, " Multispectral filter arrays: Recent advances and practical implementation, " Sensors, vol. 14, no. 11, pp. 21626-21659, 2014.
10. B. Geelen, N. Tack, and A. Lambrechts, " A compact snapshot multispectral imager with a monolithically integrated per-pixel filter mosaic, " Proc. SPIE, vol. 8974, p. 89740L, Mar. 2014.
11. M. A. Martínez, E. M. Valero, J. Hernández-Andrés, J. Romero, and G. Langfelder, " Combining transverse field detectors and color filter arrays to improve multispectral imaging systems, " Appl. Opt., vol. 53, no. 13, pp. C14-C24, 2014.
12. Y. Monno, S. Kikuchi, M. Tanaka, and M. Okutomi, " A practical oneshot multispectral imaging system using a single image sensor, " IEEE Trans. Image Process., vol. 24, no. 10, pp. 3048-3059, Oct. 2015.
13. J.-B. Thomas, P.-J. Lapray, P. Gouton, and C. Clerc, " Spectral characterization of a prototype SFA camera for joint visible and NIR acquisition, " Sensors, vol. 16, p. 993, Jun. 2016.
14. Y. Murakami, M. Yamaguchi, and N. Ohyama, " Hybrid-resolution multispectral imaging using color filter array, " Opt. Exp., vol. 20, no. 7, pp. 7173-7183, 2012.
15. X. Li, B. Gunturk, and L. Zhang, " Image demosaicing: A systematic survey, " Proc. SPIE, vol. 6822, p. 68221J, Jan. 2008.
16. L. Miao and H. Qi, " The design and evaluation of a generic method for generating mosaicked multispectral filter arrays, " IEEE Trans. Image Process., vol. 15, no. 9, pp. 2780-2791, Sep. 2006.
17. J. Brauers and T. Aach, " A color filter array based multispectral camera, " in Proc. Workshop Farbbildverarbeitung, 2006, pp. 1-11.
18. H. K. Aggarwal and A. Majumdar, " Compressive sensing multispectral demosaicing from single sensor architecture, " in Proc. IEEE China Summit Int. Conf. Signal Inf. Process. (ChinaSIP), Jul. 2014, pp. 334-338.
19. F. Yasuma, T. Mitsunaga, D. Iso, and S. K. Nayar, " Generalized assorted pixel camera: Postcapture control of resolution, dynamic range, and spectrum, " IEEE Trans. Image Process., vol. 19, no. 9, pp. 2241-2253, Sep. 2010.
20. X. Wang, J.-B. Thomas, J. Y. Hardeberg, and P. Gouton, " Median filtering in multispectral filter array demosaicking, " Proc. SPIE, vol. 8660, p. 86600E, Feb. 2013.
21. L. Miao, H. Qi, R. Ramanath, and W. E. Snyder, " Binary tree-based generic demosaicking algorithm for multispectral filter arrays, " IEEE Trans. Image Process., vol. 15, no. 11, pp. 3550-3558, Nov. 2006.
22. Y. Monno, M. Tanaka, and M. Okutomi, " Multispectral demosaicking using guided filter, " Proc. SPIE, vol. 8299, p. 82990O, Jan. 2012.
23. C. Wang, X. Wang, and J. Hardeberg, " A linear interpolation algorithm for spectral filter array demosaicking, " in Image and Signal Processing, A. Elmoataz, O. Lezoray, F. Nouboud, and D. Mammass, Eds., Cham, Switzerland: Springer International, vol. 8509, 2014, pp. 151-160.
24. B. C. de Lavarènea, D. Alleysson, and J. Hérault, " Practical implementation of LMMSE demosaicing using luminance and chrominance spaces, " Comput. Vis. Image Understand., vol. 107, nos. 1-2, pp. 3-13, 2007.
25. D. Kiku, Y. Monno, M. Tanaka, and M. Okutomi, " Residual interpolation for color image demosaicking, " in Proc. IEEE Int. Conf. Image Process. (ICIP), Sep. 2013, pp. 2304-2308.
26. S. Mihoubi, O. Losson, B. Mathon, and L. Macaire, " Multispectral demosaicing using intensity-based spectral correlation, " in Proc. Int. Conf. Image Process. Theory, Tools Appl. (IPTA), Nov. 2015, pp. 461-466.
27. X. Wang, J.-B. Thomas, J. Y. Hardeberg, and P. Gouton, " Discrete wavelet transform based multispectral filter array demosaicking, " in Proc. Colour Vis. Comput. Symp. (CVCS), Sep. 2013, pp. 1-6.
28. S. P. Jaiswal, L. Fang, V. Jakhetiya, M. Kuse and O. C. Au, " Optimized high-frequency based interpolation for multispectral demosaicking, " in Proc. IEEE Int. Conf. Image Process. (ICIP), Sept. 2016, pp. 2851-2855.
29. Y. Monno, D. Kiku, S. Kikuchi, M. Tanaka, and M. Okutomi, " Multispectral demosaicking with novel guide image generation and residual interpolation, " in Proc. IEEE Int. Conf. Image Process. (ICIP), Oct. 2014, pp. 645-649.
30. W. Ye and K.-K. Ma, " Color image demosaicing using iterative residual interpolation, " IEEE Trans. Image Process., vol. 24, no. 12, pp. 5879-5891, Dec. 2015.
31. S.-C. Pei and I.-K. Tam, " Effective color interpolation in CCD color filter arrays using signal correlation, " IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 6, pp. 503-513, Jun. 2003.
32. B. K. Gunturk, J. Glotzbach, Y. Altunbasak, R. W. Schafer, and R. M. Mersereau, " Demosaicking: Color filter array interpolation, " IEEE Signal Process. Mag., vol. 22, no. 1, pp. 44-54, Jan. 2005.
33. D. Zhang and X. Wu, " Color demosaicking via directional linear minimum mean square-error estimation, " IEEE Trans. Image Process., vol. 14, no. 12, pp. 2167-2178, Dec. 2005.
34. X. Li, " Demosaicing by successive approximation, " IEEE Trans. Image Process., vol. 14, no. 3, pp. 370-379, Mar. 2005.
35. C.-Y. Su, " Highly effective iterative demosaicing using weighted-edge and color-difference interpolations, " IEEE Trans. Consum. Electron., vol. 52, no. 2, pp. 639-645, Mar. 2006.
36. K.-H. Chung and Y.-H. Chan, " Low-complexity color demosaicing algorithm based on integrated gradients, " J. Electron. Imag., vol. 19, no. 2, p. 021104, 2010.
37. I. Pekkucuksen and Y. Altunbasak, " Gradient based threshold free color filter array interpolation, " in Proc. 17th IEEE Int. Conf. Image Process. (ICIP), Sep. 2010, pp. 137-140.
38. A. Buades, B. Coll, J.-M. Morel, and C. Sbert, " Self-similarity driven color demosaicking, " IEEE Trans. Image Process., vol. 18, no. 6, pp. 1192-1202, Jun. 2009.
39. L. Zhang, X. Wu, A. Buades, and X. Li, " Color demosaicking by local directional interpolation and nonlocal adaptive thresholding, " J. Electron. Imag., vol. 20, no. 2, p. 023016, 2011.
40. J. Duran and A. Buades, " Self-similarity and spectral correlation adaptive algorithm for color demosaicking, " IEEE Trans. Image Process., vol. 23, no. 9, pp. 4031-4040, Sep. 2014.
41. S. P. Jaiswal, O. C. Au, V. Jakhetiya, Y. Yuan, and H. Yang, " Exploitation of inter-color correlation for color image demosaicking, " in Proc. IEEE Int. Conf. Image Process. (ICIP), Oct. 2014, pp. 1812-1816.
42. D. Alleysson, S. Süsstrunk, and J. Hérault, " Linear demosaicing inspired by the human visual system, " IEEE Trans. Image Process., vol. 14, no. 4, pp. 439-449, Apr. 2005.
43. K. Hirakawa and P. J. Wolfe, " Spatio-spectral color filter array design for optimal image recovery, " IEEE Trans. Image Process., vol. 17, no. 10, pp. 1876-1890, Oct. 2008.
44. K. Hirakawa and T. W. Parks, " Adaptive homogeneity-directed demosaicing algorithm, " IEEE Trans. Image Process., vol. 14, no. 3, pp. 360-369, Mar. 2005.
45. E. Dubois, " Frequency-domain methods for demosaicking of Bayersampled color images, " IEEE Signal Process. Lett., vol. 12, no. 12, pp. 847-850, Dec. 2005.
46. B. Leung, G. Jeon, and E. Dubois, " Least-squares luma-Chroma demultiplexing algorithm for Bayer demosaicking, " IEEE Trans. Image Process., vol. 20, no. 7, pp. 1885-1894, Jul. 2011.
47. G. Jeon and E. Dubois, " Demosaicking of noisy Bayer-sampled color images with least-squares luma-chroma demultiplexing and noise level estimation, " IEEE Trans. Image Process., vol. 22, no. 1, pp. 146-156, Jan. 2013.
48. N.-X. Lian, L. Chang, Y.-P. Tan, and V. Zagorodnov, " Adaptive filtering for color filter array demosaicking, " IEEE Trans. Image Process., vol. 16, no. 10, pp. 2515-2525, Oct. 2007.
49. L. Fang, O. C. Au, K. Tang, and A. K. Katsaggelos, " Antialiasing filter design for subpixel downsampling via frequency-domain analysis, " IEEE Trans. Image Process., vol. 21, no. 3, pp. 1391-1405, Mar. 2012.
50. L. Fang, O. C. Au, Y. Chen, A. K. Katsaggelos, H. Wang, and X. Wen, " Joint demosaicing and subpixel-based down-sampling for Bayer images: A fast frequency-domain analysis approach, " IEEE Trans. Multimedia, vol. 14, no. 4, pp. 1359-1369, Aug. 2012.
51. J. Zhou and O. C. Au, " Determining the capacity parameters in PEEbased reversible image watermarking, " IEEE Signal Process. Lett., vol. 19, no. 5, pp. 287-290, May 2012.
52. CIE-International Commission on Illumination, accessed on Dec. 13, 2016. [Online]. Available: http://www.cie.co. at/index.php/LEFTMENUE/DOWNLOADS
53. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, " Image quality assessment: From error visibility to structural similarity, " IEEE Trans. Image Pro cess., vol. 13, no. 4, pp. 600-612, Apr. 2004.
54. Y. Kim and J. Jeong, " Four-direction residual interpolation for demosaicking, " IEEE Trans. Circuits Syst. Video Technol., vol. 26, no. 5, pp. 881-890, May 2016.
55. D. Kiku, Y. Monno, M. Tanaka, and M. Okutomi, " Minimized-laplacian residual interpolation for color image demosaicking, " Proc. SPIE, vol. 9023, p. 90230L, Mar. 2014.
56. J. Kopf, M. F. Cohen, D. Lischinski, and M. Uyttendaele, " Joint bilateral upsampling, " ACM Trans. Graph., vol. 26, no. 3, 2007, Art. no. 96.
57. K. He, J. Sun, and X. Tang, " Guided image filtering, " in Proc. 11th Eur. Conf. Comput. Vis. (ECCV), 2010, pp. 1-14.