A prism-mask system for multispectral video acquisition

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 33, Issue 12, 2011, Pages 2423-2435

  Cao, Xun ^a   Du, Hao ^b   Tong, Xin ^c   Dai, Qionghai ^a   Lin, Stephen ^c  

^a TSINGHUA UNIVERSITY   (China)

^b University of Washington   (United States)

^c MICROSOFT RESEARCH ASIA   (China)

Author keywords

Multispectral imaging; multispectral video; occlusion mask; prism

Indexed keywords

FOCAL LENGTHS; FRAME RATE; HIGH SPECTRAL RESOLUTION; HUMAN SKIN DETECTION; INCOMING LIGHT; MATERIAL RECOGNITION; MONOCHROME CAMERA; MULTI-SPECTRAL; MULTISPECTRAL IMAGING; MULTISPECTRAL VIDEO; OCCLUSION MASK; SPATIAL RESOLUTION; TRIANGULAR PRISM; VIDEO GENERATION; VIDEO RATES; VIDEO SEGMENTATION;

CAMERAS; SPECTRAL RESOLUTION;

PRISMS;

ALGORITHM; ANATOMY AND HISTOLOGY; CALIBRATION; COLOR; DEVICES; ENGINEERING; FLUORESCENCE IMAGING; HUMAN; ILLUMINATION; IMAGE PROCESSING; LIGHT; SKIN; SKIN PIGMENTATION; STATISTICS AND NUMERICAL DATA; VIDEORECORDING;

ALGORITHMS; CALIBRATION; COLOR; ENGINEERING; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; LIGHT; LIGHTING; OPTICAL IMAGING; SKIN; SKIN PIGMENTATION; VIDEO RECORDING;

EID: 80054946918     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2011.80     Document Type: Article

References (45)

1. J. James, Spectrograph Design Fundamentals. Cambridge Univ. Press, 2007.
2. N. Gat, "Imaging Spectoscopy Using Tunable Filters: A Review," Proc. SPIE Conf. Wavelet Appl. VII, vol. 4056, 2000.
3. Y.Y. Schechner and S.K. Nayar, "Generalized Mosaicing: Wide Field of View Multispectral Imaging," IEEE Trans. Pattern Analayis and Machine Intelligence, vol. 24, no. 10, pp. 1334-1348, Oct. 2002. (Pubitemid 35327455)
4. M. Descour and E. Dereniak, "Computed-Tomography Imaging Spectrometer: Experimental Calibration and Reconstruction Results," Applied Optics, vol. 34, pp. 4817-4826, 1995.
5. C. Vandervlugt, H. Masterson, N. Hagen, and E.L. Dereniak, "Reconfigurable Liquid Crystal Dispersing Element for a Computed Tomography Imaging Spectrometer," Proc. Conf. SPIE, vol. 6565, 2007.
6. M.E. Gehm, S.T. McCain, N.P. Pitsianis, D.J. Brady, P. Potuluri, and M.E. Sullivan, "Static Two-Dimensional Aperture Coding for Multimodal, Multiplex Spectroscopy," Applied Optics, vol. 45, pp. 2965-2974, 2006. (Pubitemid 43874651)
7. D.J. Brady and M.E. Gehm, "Compressive Imaging Spectrometers Using Coded Apertures," Proc. Conf. SPIE, vol. 6246, 2006.
8. J.-I. Park, M.-H. Lee, M.D. Grossberg, and S.K. Nayar, "Multispectral Imaging Using Multiplexed Illumination," Proc. IEEE Int'l Conf. Computer Vision, pp. 1-8, 2007.
9. K. Kidono and Y. Ninomiya, "Visibility Estimation under Night-Time Conditions Using a Multiband Camera," Proc. IEEE Intelligent Vehicles Symp., 2007.
10. H. Du, X. Tong, X. Cao, and S. Lin, "A Prism-Based System for Multispectral Video Acquisition," Proc. IEEE Int'l Conf. Computer Vision, pp. 175-182, 2009.
11. M. Yamaguchi, H. Haneishi, H. Fukuda, J. Kishimoto, H. Kanazawa, M. Tsuchida, R. Iwama, and N. Ohyama, "High-Fidelity Video and Still-Image Communication Based on Spectral Information: Natural Vision System and Its Applications," Proc. Conf. SPIE/IS&T Electronic Imaging, vol. 6062, 2006.
12. M. Rosen and X. Jiang, "Lippmann2000: A Spectral Image Database under Construction," Proc. Int'l Symp. Multispectral Imaging and Color Reproduction for Digital Archives, pp. 117-122, 1999.
13. H. Morris, C. Hoyt, and P. Treado, "Imaging Spectrometers for Fluorescence and Raman Microscopy: Acousto-Optic and Liquid Crystal Tunable Filters," Proc. Conf. Applied Spectroscopy, vol. 48, pp. 857-866, 1994.
14. Spectral Imaging LTD, http://www.specim.fi, 2011.
15. R.O. Green, M.L. Eastwood, C.M. Sarture, T.G. Chrien, M. Aronsson, B.J. Chippendale, J.A. Faust, B.E. Pavri, C.J. Chovit, M. Solis, M.R. Olah, and O. Williams, "Imaging Spectroscopy and the Airborne Visible Infrared Imaging Spectrometer (AVIRIS)," Proc. Remote Sensing Environment Conf., vol. 65, pp. 227-248, 1998. (Pubitemid 29360700)
16. E. Herrala, J.T. Okkonen, T.S. Hyvarinen, M. Aikio, and J. Lammasniemi, "Imaging Spectrometer for Process Industry Applications," Proc. Conf. SPIE, vol. 2248, pp. 33-40, 1994.
17. A. Mohan, R. Raskar, and J. Tumblin, "Agile Spectrum Imaging: Programmable Wavelength Modulation for Cameras and Projectors," Computer Graphics Forum, vol. 27, no. 2, pp. 709-717, 2008. (Pubitemid 351612885)
18. A.R. Harvey, D. Fletcher-Holmes, and A. Gorman, "Spectral Imaging in a Snapshot," Proc. Conf. SPIE, vol. 5694, 2005.
19. W. Liu, G. Barbastathis, and D. Psaltis, "Volume Holographic Hyperspectral Imaging," Applied Optics, vol. 43, pp. 3581-3599, 2004.
20. Z. Li, D. Psaltis, W. Liu, W.R. Johnson, and G. Bearman, "Volume Holographic Spectral Imaging," Proc. Conf. SPIE, vol. 5694, no. 33, Jan. 2005.
21. D.W. Fletcher-Holmes and A.R. Harvey, "Real-Time Imaging with a Hyperspectral Fovea," J. Optics A: Pure Applied Optics, vol. 7, no. 6, pp. S298-S302, Jun. 2005. (Pubitemid 40673130)
22. T. Okamoto, A. Takahashi, and I. Yamaguchi, "Simultaneous Acquisition of Spectral and Spatial Intensity Distribution," Applied Spectroscopy, vol. 47, pp. 1198-1202, 1993.
23. M.R. Descour, C.E. Volin, E.L. Dereniak, T.M. Gleeson, M.F. Hopkins, D.W. Wilson, and P.D. Maker, "Demonstration of a Computed-Tomography Imaging Spectrometer Using a Computer-Generated Hologram Disperser," Applied Optics, vol. 36, pp. 3694-3698, 1997. (Pubitemid 127613670)
24. J.M. Mooney, V.E. Vickers, M. An, and A.K. Brodzik, "High Throughput Hyperspectral Infrared Camera," J. Optical Soc. Am. A, vol. 14, pp. 2951-2961, 1997. (Pubitemid 127573840)
25. C. Volin, MWIR Spectrometer Operating Theory. Univ. of Arizona Press, 2000.
26. W.R. Johnson, D.W. Wilson, and G. Bearman, "Spatial-Spectral Modulating Snapshot Hyperspectral Imager," Applied Optics, vol. 45, pp. 1898-1908, 2006.
27. N.A. Hagen, E.L. Dereniak, and D.T. Sass, "Maximizing the Resolution of a CTIS Instrument," Proc. Conf. SPIE, vol. 6302, 2006.
28. N. Hagen and E.L. Dereniak, "Analysis of Computed Tomographic Imaging Spectrometers. I. Spatial and Spectral Resolution," Applied Optics, vol. 47, pp. F85-F95, 2008.
29. M.J.E. Golay, "Multislit Spectrometry," J. Optical Soc. Am, vol. 39, pp. 437-444, 1949.
30. S.B. Mende, E.S. Claflin, R.L. Rairden, and G.R. Swenson, "Hadamard Spectroscopy with a Two-Dimensional Detecting Array," Applied Optics, vol. 32, pp. 7095-7105, 1993.
31. Q. Hanley, P. Verveer, D. Arndt-Jovin, and T. Jovin, "Three Dimensional Spectral Imaging by Hadamard Transform Spectroscopy in a Programmable Array Microscope," J. Microscopy, vol. 197, pp. 5-14, 2000. (Pubitemid 30070461)
32. M.E. Gehm, R. John, R. Willett, T. Schultz, and D. Brady, "Single-Shot Compressive Spectral Imaging with a Dual Disperser Architecture," Optics Express, vol. 15, pp. 14 013-14 027, 2007. (Pubitemid 47608612)
33. A. Wagadarikar, R. John, R. Willett, and D. Brady, "Single Disperser Design for Coded Aperture Snapshot Spectral Imaging," Applied Optics, vol. 47, no. 10, pp. B44-B51, 2008.
34. A.A. Wagadarikar, N.P. Pitsianis, X.B. Sun, and D.J. Brady, "Video Rate Spectral Imaging Using a Coded Aperture Snapshot Spectral Imager," Optics Express, vol. 17, no. 8, pp. 6368-6388, 2009.
35. J. James, Spectrograph Design Fundamentals. Cambridge Univ. Press, 2007.
36. J. Allington-Smith, R. Content, and R. Haynes, "New Developments in Integral Field Spectroscopy," Proc. Conf. SPIE, vol. 3355, 1998.
37. R. Content, "Image Slicer for Integral Field Spectroscopy with Ngst," Proc. Conf. SPIE, vol. 3356, 1998.
38. Photo Research, "PR-650 Spectra Scan Spectra Colorimeter Instruction Manual," Proc. Conf. Photo Research, 1999.
39. G.D. Finlayson, S.D. Hordley, and P.M. Morovic, "Using the Spectra Cube to Build a Multispectral Image Database," Proc. Second Computer Graphics, Imaging and Vision Conf. IS and T/STD, Apr. 2004.
40. D.J. Schroeder, Astronomical Optics. Academic Press, 1987.
41. Wikipedia, http://en.wikipedia.org/wiki/Keystone-effect, 2011.
42. Wiki, http://en.wikipedia.org/wiki/Depth-of-field, 2011.
43. Wikipedia, http://en.wikipedia.org/wiki/Fluorescent-lamp, 2011.
44. E. Angelopoulou, "Understanding the Color of Human Skin," Proc. SPIE Conf. Human Vision and Electronic Imaging, vol. 4299, pp. 243-251, 2001.
45. N.J.W. Morris, S. Avidan, W. Matusik, and H. Pfister, "Statistics of Infrared Images," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-7, 2007.