Acquisition of High Spatial and Spectral Resolution Video with a Hybrid Camera System

International Journal of Computer Vision

Volumn 110, Issue 2, 2014, Pages 141-155

  Ma, Chenguang ^a   Cao, Xun ^b   Tong, Xin ^c   Dai, Qionghai ^a   Lin, Stephen ^c  

^a TSINGHUA UNIVERSITY   (China)

^b NANJING UNIVERSITY   (China)

^c MICROSOFT RESEARCH ASIA   (China)

Author keywords

Hybrid camera system; Multispectral video capture

Indexed keywords

DATA FLOW ANALYSIS; IMAGE RESOLUTION; SECURITY SYSTEMS; SPECTRAL RESOLUTION; VIDEO STREAMING;

CAMERA SYSTEMS; HIGH SPATIAL RESOLUTION; ILLUMINATION SOURCES; PROPAGATION ALGORITHM; REAL-TIME VIDEO ANALYSIS; SPECTRAL DATA ANALYSIS; TRACKING AND SURVEILLANCE; VIDEO CAPTURE;

VIDEO CAMERAS;

EID: 84920251764     PISSN: 09205691     EISSN: 15731405     Source Type: Journal    
DOI: 10.1007/s11263-013-0690-4     Document Type: Article

References (34)

1. Angelopoulou, E. (2001). Understanding the color of human skin. SPIE Conference on Human Vision and Electronic Imaging, 4299, 243–251.
2. Brady, D. J., & Gehm, M. E. (2006). Compressive imaging spectrometers using coded apertures. In SPIE (Vol. 6246).
3. Brox, T., Bruhn, A., Papenberg, N., & Weickert, J. (2004). High accuracy optical flow estimation based on a theory for warping. In ECCV.
4. Buchsbaum, G. (1980). A spatial processor model for object colour perception. Journal of the Franklin Institute, 310, 1–26.
5. Cao, X., Du, H., Tong, X., Dai, Q., & Lin, S. (2011a). A prism-mask system for multispectral video acquisition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(12), 2423–2435.
6. Cao, X., Tong, X., Dai, Q., & Lin, S. (2011b). High resolution multispectral video capture with a hybrid camera system. In 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Colorado Springs, CO, pp. 297–304.
7. Chi, C., Yoo, H., & Ben-Ezra, M. (2010). Multi-spectral imaging by optimized wide band illumination. International Journal of Computer Vision, 86(2), 140–151.
8. Darling, B. A., Ferwerda, J. A., Berns, R. S., & Chen, T. (2011). Real-time multispectral rendering with complex illumination. In Color and Imaging Conference (Vol. 2011, pp. 345–351). Springfield, VA: Society for Imaging Science and Technology.
9. Descour, M., & Dereniak, E. (1995). Computed-tomography imaging spectrometer: Experimental calibration and reconstruction results. Applied Optics, 34, 4817–4826.
10. Du, H., Tong, X., Cao, X., & Lin, S. (2009). A prism-based system for multispectral video acquisition. In Proceedings of the ICCV.
11. Fletcher-Holmes, D. W., & Harvey, A. R. (2005). Real-time imaging with a hyperspectral fovea. Journal of Optics A: Pure and Applied Optics, 7, S298–S302.
12. Habel, R., Kudenov, M., & Wimmer, M. (2012). Practical spectral photography. Computer Graphics Forum, 31, 449–458. Wiley Online Library.
13. Hagen, N., & Dereniak, E. L. (2008). Analysis of computed tomographic imaging spectrometers. I. Spatial and spectral resolution. Applied Optics, 47, F85–F95.
14. Han, S., Sato, I., Okabe, T., & Sato, Y. (2010). Fast spectral reflectance recovery using DLP projector. In Computer Vision: ACCV, 2010 (pp. 323–335).
15. James, J. (2007). Spectrograph design fundamentals. Cambridge, MA: Cambridge University Press.
16. Johnson, W. R., Wilson, D. W., & Bearman, G. (2006). Spatial–spectral modulating snapshot hyperspectral imager. Applied Optics, 45, 1898–1908.
17. Kim, M. H., Rushmeier, H., Dorsey, J., Harvey, T. A., Prum, R. O., Kittle, D. S., et al. (2012). 3D imaging spectroscopy for measuring hyperspectral patterns on solid objects. ACM Transactions on Graphics (TOG), 31(4), 38.
18. Kittle, D. S., Marks, D. L., & Brady, D. J. (2012). Design and fabrication of an ultraviolet-visible coded aperture snapshot spectral imager. Optical Engineering, 51(7), 071403-1.
19. Mooney, J. M., Vickers, V. E., An, M., & Brodzik, A. K. (1997). High throughput hyperspectral infrared camera. Journal of Optical Society of America A, 14, 2951–2961.
20. Mrozack, A., Marks, D. L., & Brady, D. J. (2012). Coded aperture spectroscopy with denoising through sparsity. Optics Express, 20(3), 2297–2309.
21. Nvidia, C. (2007). Compute unified device architecture programming guide. Santa Clara, CA: NVIDIA Corp.
22. Park, J. I., Lee, M. H., Grossberg, M. D., & Nayar, S. K. (2007). Multispectral imaging using multiplexed illumination. In ICCV.
23. Ross, D., Lim, J., Lin, R. S., & Yang, M. H. (2008). Incremental learning for robust visual tracking. IJCV, 77, 125–141.
24. Schechner, Y. Y., & Nayar, S. K. (2002). Generalized mosaicing: Wide field of view multispectral imaging. IEEE PAMI, 24(10), 1334–1348.
25. Shen, L., Tan, P., & Lin, S. (2008). Intrinsic image decomposition with non-local texture cues. In IEEE Conference on Computer Vision and Pattern Recognition, 2008 (CVPR 2008), Anchorage, AK, pp. 1–7.
26. Smits, B. (1999). An RGB to spectrum conversion for reflectances. Journal of Graphics Tools, 4(4), 11–22.
27. University of Joensuu Color Group. (2005). Spectral database. http://spectral.joensuu.fi/.
28. Vandervlugt, C., Masterson, H., Hagen, N., & Dereniak, E. L. (2007). Reconfigurable liquid crystal dispersing element for a computed tomography imaging spectrometer. In SPIE (Vol. 6565).
29. Volin, C. (2000). MWIR spectrometer operating theory. Tucson, AZ: University of Arizona Press.
30. Wagadarikar, A., John, R., Willett, R., & Brady, D. (2008). Single disperser design for coded aperture snapshot spectral imaging. Applied Optics, 47, B44–B51.
31. Wagadarikar, A., Pitsianis, N., Sun, X., & Brady, D. (2009). Video rate spectral imaging using a coded aperture snapshot spectral imager. Optics Express, 17(8), 6368–6388.
32. Wenger, A., Gardner, A., Tchou, C., Unger, J., Hawkins, T., & Debevec, P. (2005). Performance relighting and reflectance transformation with time-multiplexed illumination. ACM Transactions on Graphics (TOG), 24(3), 756–764.
33. Yamaguchi, M., Haneishi, H., Fukuda, H., Kishimoto, J., Kanazawa, H., Tsuchida, M., et al. (2006). High-fidelity video and still-image communication based on spectral information: Natural vision system and its applications. In SPIE/IS &T Electronic Imaging (Vol. 6062).
34. Yang, Q., Tan, K. H., & Ahuja, N. (2009). Real-time o(1) bilateral filtering. In CVPR.