Multiplexing for optimal lighting

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 29, Issue 8, 2007, Pages 1339-1354

  Schechner, Yoav Y ^a   Nayar, Shree K ^b   Belhumeur, Peter N ^b  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

^b Columbia University ^*  (United States)

Author keywords

Hadamard codes; Image based rendering; Multiplexed illumination; Photon noise; Physics based vision

Indexed keywords

HADAMARD CODES; HADAMARD MULTIPLEXING; PHOTON NOISE; SIGNAL-INDEPENDENT NOISE;

COMPUTER VISION; DEMULTIPLEXING; IMAGING SYSTEMS; REFLECTION; SPURIOUS SIGNAL NOISE;

LIGHTING;

EID: 34447271522     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2007.1151     Document Type: Article

References (47)

1. H.H. Barrett and W. Swindell, Radiological Imaging, vol. 1, pp. 82-98, 285-290. Academic Press, 1981.
2. R. Basri and D. Jacobs, "Lambertian Reflectance and Linear Subspaces," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, pp. 218-233, 2003.
3. O.G. Cula, K.J. Dana, D.K. Pai, and D. Wang, "Polarization Multiplexing for Bidirectional Imaging," Proc. Computer Vision and Pattern Recognition, vol. 2, pp. 1116-1123, 2005.
4. K.J. Dana and J. Wang, "Device for Convenient Measurement of Spatially Varying Bidirectional Reflectance," J. Optical Soc. Am. A, vol. 21, pp. 1-12, 2004.
5. P. Debevec, T. Hawkins, C. Tchou, H.P. Duiker, W. Sarokin, and M. Sagar, "Acquiring the Reflectance Field of a Human Face," Proc. ACM SIGGRAPH, pp. 145-156, 2000.
6. P.E. Debevec and J. Malik, "Recovering High Dynamic Range Radiance Maps from Photographs," Proc. ACM SIGGRAPH, pp. 369-378, 1997.
7. R. Epstein, P.W. Hallinan, and A.L. Yuille, "5 ± 2 Eigenimages Suffice: An Empirical Investigation of Low-Dimensional Lighting Models," Proc. Physics-Based Modeling in Computer Vision, pp. 108-116, 1995.
8. H. Farid and E.H. Adelson, "Separating Reflections and Lighting Using Independent Components Analysis," Proc. Computer Vision and Pattern Recognition, vol. I, pp. 262-267, 1999.
9. W.G. Fateley, R.M. Hammaker, R.A. DeVerse, R.R. Coifman, and F.B. Geshwind, "The Other Spectroscopy: Demonstration of a New De-Dispersion Imaging Spectrograph," Vibrational Spectroscopy, vol. 29, pp. 163-170, 2002.
10. T.J. Fellers and M.W. Davidson, "CCD Noise Sources and Signal-to-Noise Ratio," Optical Microscopy Primer, (Molecular Expressions, Florida State Univ.), http://micro.magnet.fsu.edu/primer/, 2004.
11. D. Goldman, B. Curless, A. Hertzmann, and S.M. Seitz, "Shape and Spatially-Varying BRDFs from Photometric Stereo," Proc. IEEE Int'l Conf. Computer Vision, pp. 341-348, 2005.
12. Q.S. Hanley, P.J. Verveer, and T.M. Jovin, "Spectral Imaging in a Programmable Array Microscope by Hadamard Transform Fluorescence Spectroscopy," Applied Spectroscopy, vol. 53, pp. 1-10, 1999.
13. Hamamatsu Photnics K.K., "Xenon Flash Lamps," Catalog TLSX1008E04, (Electron Tube Center, Japan), 1998.
14. Hamamatsu Photnics K.K., "Super-Quiet Xenon Lamps," Catalog TLSX1002E06, (Electron Tube Center, Japan), 2000.
15. M. Harwit and N.J.A. Sloane, Hadamard Transform Optics. Academic Press, 1979.
16. M. Hatzitheodorou, "Shape from Shadows, A Hilbert Space Setting," J. Complexity, vol. 14, pp. 63-84, 1998.
17. G. Healey and T.O. Binford, "Local Shape from Specularity," Proc. Int'l Conf. Computer Vision, pp. 151-160, 1987.
18. B.P.K. Horn, Robot Vision, chapter 10. MIT Press, 1986.
19. S. Ioué and K.R. Spring, Video Microscopy, second ed., chapters 6, 7, and 8. Plenum Press, 1997.
20. A.K. Jain, Fundamentals of Digital Image Processing, pp. 155-159. Prentice-Hall, 1989.
21. Eastman Kodak Co., "Interline Image Sensor Photodiode Charge Capacity and Antiblooming," Application Note DS 01-001, Revision 2, 2000.
22. Eastman Kodak Co., "CCD Image Sensor Noise Sources," Application Note MTD/PS-0233, Revision 2, 2003.
23. M. Koudelka, P. Belhumeur, S. Magda, and D. Kriegman, "Image-Based Modeling and Rendering of Surfaces with Arbitrary BRDF's," Proc. IEEE Computer Vision and Pattern Recognition, pp. 568-575, 2001.
24. K.C. Lee, J. Ho, and D. Kriegman, "Acquiring Linear Subspaces for Face Regognition under Variable Lighting," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, pp. 684-698, 2005.
25. H. Lensch, J. Kautz, M. Gosele, W. Heidrich, and H. Seidel, "Image-Based Reconstruction of Spatial Appearance and Geometric Detail," ACM Trans. Graphics, vol. 22, pp. 234-257, 2003.
26. M. Levoy, B. Chen, V. Vaish, M. Horowitz, I. McDowall, and M. Bolas, "Synthetic Aperture Confocal Imaging," ACM Trans. Graphics, vol. 23, pp. 825-834, 2004.
27. Q.T. Luong, P. Fua, and Y. Leclerc, "Recovery of Reflectances and Varying Illuminants from Multiple Views," Proc. European Conf. Computer Vision, pp. 163-179, 2002.
28. T. Malzbender, D. Gelb, and H. Wolters, "Polynomial Texture Maps," Proc. ACM SIGGRAPH, pp. 519-528, 2001.
29. S. Mann and R.W. Picard, "On Being "Undigital" with Digital Cameras: Extending Dynamic Range by Combining Differently Exposed Pictures," Proc. IS&T Ann. Conf., pp. 422-428, 1995.
30. S.R. Marschner, S.H. Westin, E.P.F. Lafortune, and K.E. Torrance, "Image-Based Bidirectional Reflectance Distribution Function Measurement," Applied Optics, vol. 39, pp. 2592-2600, 2000.
31. V. Masselus, P. Dutré, and F. Anrys, "The Free Form Light Stage," Proc. ACM Eurographics Workshop Rendering, pp. 247-256, 2002.
32. W. Matusik, M. Loper, and H. Pfister, "Progressively-Refined Reflectance Functions from Natural Illumination," Proc. Eurographics Symp. Rendering, 2004.
33. W. Matusik, H. Pfister, A. Ngan, P. Beardsley, R. Ziegler, and L. McMillan, "Image-Based 3D Photography Using Opacity Hulls," ACM Trans. Graphics, vol. 21, pp. 427-437, 2002.
34. Y. Moses, S. Ullman, and S. Edelman, "Generalization to Novel Images in Upright and Inverted Faces," Perception, vol. 25, pp. 443-461, 1996.
35. G. Nitzsche and R. Riesenberg, "Noise, Fluctuation, and Hadamard-Transform Spectrometry," Proc. SPIE, vol. 5111, pp. 273-282, 2003.
36. M. Osadchy and D. Keren, "Efficient Detection under Varying Illumination Conditions and Image Plane Rotations," Computer Vision & Image Understanding, vol. 93, pp. 245-259, 2004.
37. R. Ramamoorthi and P. Hanrahan, "Frequency Space Environment Map Rendering," ACM Trans. Graphics, vol. 21, pp. 517-526, 2002.
38. I. Sato, T. Okabe, Y. Sato, and K. Ikeuchi, "Using Extended Light Sources for Modeling Object Apperance under Varying Illumination," Proc. Int'l Conf. Computer Vision, vol. I, pp. 325-332, 2005.
39. Y.Y. Schechner, S.K. Nayar, and P.N. Belhumeur, "A Theory of Multiplexed Illumination," Proc. Int'l Conf. Computer Vision, vol. 2, pp. 808-815, 2003.
40. Y.Y. Schechner, S.K. Nayar, P.N. Belhumeur, and H.S. Peri, "Imaging in Multiplexed Illumination," Proc. SPIE, vol. 5529, pp. 198-205, 2004.
41. P. Sen, B. Chen, G. Garg, S.R. Marschner, M. Horowitz, M. Levoy, and H.P.A. Lensch, "Dual Photography," ACM Trans. Graphics, vol. 24, pp. 745-755, 2005.
42. A. Shashua, "On Photometric Issues in 3D Visual Recognition from a Single 2D Image," Int'l J. Computer Vision, vol. 21, pp. 99-122, 1997.
43. T. Sim, S. Baker, and M. Bsat, "The CMU Pose, Illumination, and Expression Database," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, pp. 1615-1618, 2003.
44. J.F. Turner II and P.J. Treado, "Near-Infrared Acousto-Optic Tunable Filter Hadamard Transform Spectroscopy," Applied Spectroscopy, vol. 50, no. 2, pp. 277-284, 1996.
45. A. Wenger, A. Gardner, C. Tchou, J. Unger, T. Hawkins, and P. Debevec, "Performance Relighting and Reflectance Transformation with Time-Multiplexed Illumination," ACM Trans. Graphics, vol. 24, pp. 756-764, 2005.
46. A. Wuttig, R. Riesenberg, and G. Nitzsche, "Subpixel Analysis of a Double Array Grating Spectrometer," Proc. SPIE, vol. 4480, pp. 334-344, 2002.
47. A. Yuille, J.M. Coughlan, and S. Konishi, "The KGBR Viewpoint-Lighting Ambiguity," J. Optical Soc. Am. A, vol. 20, pp. 24-31, 2003.