Three-dimensional optical sensing and visualization using integral imaging

Proceedings of the IEEE

Volumn 99, Issue 4, 2011, Pages 556-575

  Cho, Myungjin ^a   Daneshpanah, Mehdi ^a   Moon, Inkyu ^b   Javidi, Bahram ^a  

^a UNIVERSITY OF CONNECTICUT   (United States)

^b Chosun University   (South Korea)

Author keywords

3 D visualization; Computational volumetric reconstruction; integral imaging

Indexed keywords

DISPLAY DEVICES; GEOMETRICAL OPTICS; IMAGE RECONSTRUCTION; MEDICAL IMAGING; UNDERWATER IMAGING; VISUALIZATION;

3D VISUALIZATION; EXPONENTIAL INCREASE; INTEGRAL IMAGING; PERFORMANCE METRICS; RANGE ESTIMATION; THREEDIMENSIONAL (3-D); VISUALIZATION TECHNOLOGIES; VOLUMETRIC RECONSTRUCTION;

THREE DIMENSIONAL COMPUTER GRAPHICS;

EID: 79952985150     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/JPROC.2010.2090114     Document Type: Conference Paper

References (85)

1. B. Javidi, F. Okano, and J.-Y. Son, Three-Dimensional Imaging, Visualization, and Display Technology. New York: Springer-Verlag, 2008.
2. S. A. Benton and V. M. Bove, Holographic Imaging. New York: Wiley-Interscience, 2008.
3. A. Stern and B. Javidi, " Three-dimensional image sensing, visualization, and processing using integral imaging," Proc. IEEE, vol. 94, no. 3, pp. 591-607, Mar. 2006.
4. C. Wheatstone, " On some remarkable, and hitherto unobserved, phenomena of binocular vision," Phil. Trans. R. Soc. London, vol. 128, pp. 371-394, 1838.
5. L. Lypton, Foundation of Stereoscopic Cinema. New York: Van Nostrand Reinhold, 1982.
6. G. Lippmann, " La Photographie Integrale," Comptes-Rendus Academie des Sciences, vol. 146, pp. 446-451, 1908.
7. A. P. Sokolov, Autostereoscopy and Integral Photography by Professor Lippmann's Method. Moscow, Russia: Moscow State Univ. Press, 1911.
8. H. E. Ives, " Optical properties of a lippmann lenticuled sheet," J. Opt. Soc. Amer., vol. 21, pp. 171-176, 1931.
9. C. B. Burckhardt, " Optimum parameters and resolution limitation of integral photography," J. Opt. Soc. Amer., vol. 58, pp. 71-76, 1968.
10. T. Okoshi, Three-Dimensional Imaging Techniques. New York: Academic, 1976.
11. T. Okoshi, " Three-dimensional displays," Proc. IEEE, vol. 68, no. 5, pp. 548-564, May 1980.
12. L. Yang, M. McCornick, and N. Davies, " Discussion of the optics of a new 3-D imaging system," Appl. Opt., vol. 27, pp. 4529-4534, 1988.
13. F. Okano, J. Arai, K. Mitani, and M. Okui, " Real-time integral imaging based on extremely high resolution video system," Proc. IEEE, vol. 94, no. 3, pp. 490-501, Mar. 2006.
14. J. Arai, F. Okano, H. Hoshino, and I. Yuyama, " Gradient index lens array method based on real time integral photography for three dimensional images," Appl. Opt., vol. 37, pp. 2034-2045, 1998.
15. H. Hoshino, F. Okano, H. Isono, and I. Yuyama, " Analysis of resolution limitation of integral photography," J. Opt. Soc. Amer. A, vol. 15, pp. 2059-2065, 1998. (Pubitemid 128572174)
16. O. Matoba, E. Tajahuerce, and B. Javidi, " Real-time three-dimensional object recognition with multiple perspectives imaging," Appl. Opt., vol. 40, pp. 3318-3325, 2001.
17. S.-H. Hong, J.-S. Jang, and B. Javidi, " Three-dimensional volumetric object reconstruction using computational integral imaging," Opt. Exp., vol. 12, pp. 483-491, 2004.
18. B. Javidi, I. Moon, and S. Yeom, " Three-dimensional identification of biological microorganism using integral imaging," Opt. Exp., vol. 14, pp. 12 095-12 107, 2006.
19. Y. Frauel and B. Javidi, " Digital three-dimensional image correlation using computer-reconstructed integral imaging," Appl. Opt., vol. 41, pp. 5488-5496, 2002.
20. S. Kishk and B. Javidi, " Improved resolution 3-D object sensing and recognition using time multiplexed computational integral imaging," Opt. Exp., vol. 11, pp. 3528-3541, 2003.
21. S.-H. Hong and B. Javidi, " Distortion-tolerant 3D recognition of occluded objects using computational integral imaging," Opt. Exp., vol. 14, pp. 12 085-12 095, 2006.
22. M. Daneshpanah and B. Javidi, " Profilometry and optical slicing by passive three-dimensional imaging," Opt. Lett., vol. 34, pp. 1105-1107, 2009.
23. S. Yeom, B. Javidi, and E. Watson, " Photon counting passive 3D image sensing for automatic target recognition," Opt. Exp., vol. 13, pp. 9310-9330, 2005. (Pubitemid 41611964)
24. S. Yeom, B. Javidi, C.-W. Lee, and E. Watson, " Photon-counting passive 3D image sensing for reconstruction and recognition of partially occluded objects," Opt. Exp., vol. 15, pp. 16 189-16 195, 2007.
25. S. Yeom, B. Javidi, and E. Watson, " Three-dimensional distortion-tolerant object recognition using photon-counting integral imaging," Opt. Exp., vol. 15, pp. 1513-1533, 2007. (Pubitemid 46280204)
26. B. Tavakoli, B. Javidi, and E. Watson, " Three dimensional visualization by photon counting computational integral imaging," Opt. Exp., vol. 16, pp. 4426-4436, 2008. (Pubitemid 351483407)
27. I. Moon and B. Javidi, " Three dimensional imaging and recognition using truncated photon counting model and parametric maximum likelihood estimator," Opt. Exp., vol. 17, pp. 15 709-15 715, 2009.
28. I. Moon and B. Javidi, " Three-dimensional recognition of photon-starved events using computational integral imaging and statistical sampling," Opt. Lett., vol. 34, pp. 731-733, 2009.
29. S.-H. Hong and B. Javidi, " Three-dimensional visualization of partially occluded objects using integral imaging," IEEE/OSA J. Display Technol., vol. 1, no. 2, pp. 354-359, Dec. 2005. (Pubitemid 43001035)
30. V. Vaish, M. Levoy, R. Szeliski, C. L. Zitnick, and S. B. Kang, " Reconstructing occluded surfaces using synthetic apertures: Stereo, focus and robust measures," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., 2006, vol. 2, pp. 2331-2338. (Pubitemid 44931602)
31. I. Moon and B. Javidi, " Three-dimensional visualization of objects in scattering medium by use of computational integral imaging," Opt. Exp., vol. 16, pp. 13 080-13 089, 2008.
32. R. Schulein and B. Javidi, " Underwater multiview three-dimensional imaging," IEEE/OSA J. Display Technol, vol. 4, no. 4, pp. 351-353, Dec. 2008.
33. J.-S. Jang and B. Javidi, " Three-dimensional integral imaging of micro-objects," Opt. Lett., vol. 29, pp. 1230-1232, 2004.
34. M. Levoy, Z. Zhang, and I. McDowall, " Recording and controlling the 4D light field in a microscope using microlens arrays," J. Microscopy, vol. 235, pp. 144-162, 2009.
35. J.-S. Jang and B. Javidi, " Improved viewing resolution of three-dimensional integral imaging by use of nonstationary micro-optics," Opt. Lett., vol. 27, pp. 324-326, 2002. (Pubitemid 34617988)
36. F. Okano, H. Hoshino, J. Arai, and I. Yuyama, " Three-dimensional video system based on integral photography," Opt. Eng., vol. 38, pp. 1072-1077, 1999.
37. J.-S. Jang and B. Javidi, " Improvement of viewing angle in integral imaging by use of moving lenslet arrays with low fill factor," Appl. Opt., vol. 42, pp. 1996-2002, 2003.
38. J.-S. Jang, F. Jin, and B. Javidi, " Three-dimensional integral imaging with large depth of focus by use of real and virtual image fields," Opt. Lett., vol. 28, pp. 1421-1423, 2003.
39. J.-S. Jang and B. Javidi, " Large depth-of-focus time-multiplexed three-dimensional integral imaging by use of lenslets with nonuniform focal lengths and aperture sizes," Opt. Lett., vol. 28, pp. 1924-1926, 2003.
40. J. W. Goodman, Introduction to Fourier Optics. New York: McGraw-Hill, 1996.
41. J.-S. Jang and B. Javidi, " Three-dimensional integral imaging with electronically synthesized lenslet array," Opt. Lett., vol. 27, pp. 1767-1769, 2002. (Pubitemid 35328904)
42. J.-S. Jang and B. Javidi, " Three-dimensional synthetic aperture integral imaging," Opt. Lett., vol. 27, pp. 1144-1146, 2002. (Pubitemid 34799167)
43. M. Levoy, " Light fields and computational imaging," IEEE Comput. Mag., vol. 39, no. 8, pp. 46-55, Aug. 2006. (Pubitemid 44275791)
44. M. Daneshpanah, B. Javidi, and E. Watson, " Three dimensional imaging with randomly distributed sensors," Opt. Exp., vol. 16, pp. 6368-6377, 2008. (Pubitemid 351623350)
45. R. Schelein, M. Daneshpanah, and B. Javidi, B3D imaging with axially distributed sensing,[ Opt. Lett., vol. 34, pp. 2012-2014, 2009.
46. B. Javidi, S.-H. Hong, and O. Matoba, " Multidimensional optical sensor and imaging system," Appl. Opt., vol. 45, pp. 2986-2994, 2006. (Pubitemid 43874653)
47. J.-S. Jang and B. Javidi, " Three-dimensional projection integral imaging using micro-convex-mirror arrays," Opt. Exp., vol. 12, pp. 1077-1083, 2004.
48. J.-S. Jang, Y.-S. Oh, and B. Javidi, " Spatiotemporally multiplexed integral imaging projector for large-scale high-resolution three-dimensional display," Opt. Exp., vol. 12, pp. 557-563, 2004.
49. B. Javidi and Y. S. Hwang, " Passive near-infrared 3D sensing and computational reconstruction with synthetic aperture integral imaging," IEEE/OSA J. Display Technol., vol. 4, no. 1, pp. 3-5, Mar. 2008. (Pubitemid 351681458)
50. M. Cho and B. Javidi, " Three-dimensional tracking of occluded objects using integral imaging," Opt. Lett., vol. 33, pp. 2737-2739, 2008.
51. R. Martinez-Cuenca, G. Saavedra, M. Martinez-Corral, and B. Javidi, " Progress in 3-D multiperspective display by integral imaging," Proc. IEEE, vol. 97, no. 6, pp.1067-1077, Jun. 2009.
52. R. Schulein, C. Do, and B. Javidi, " Distortion-tolerant 3D recognition of underwater objects using neural networks," J. Opt. Soc. Amer. A, vol. 27, pp. 461-468, Mar. 2010.
53. H. Arimoto and B. Javidi, " Integral three-dimensional imaging with computed reconstruction," Opt. Lett., vol. 26, no. 3, pp. 157-159, 2001. (Pubitemid 33693317)
54. T. Okoshi, A. Yano, and Y. Fukumori, " Curved triple-mirror screen for projection-type three-dimensional display," Appl. Opt., vol. 10, pp. 482-489, 1971.
55. S. Yeom and B. Javidi, " Three-dimensional distortion-tolerant object recognition using integral imaging," Opt. Exp., vol. 12, pp. 5795-5809, Nov. 2004.
56. S. Manolache, A. Aggoun, M. McCormick, N. Davies, and S. Y. Kung, " Analytical model of a three-dimensional integral image recording system that uses circular- and hexagonal-based spherical surface microlenses," J. Opt. Soc. Amer. A., vol. 18, pp. 1814-1821, Aug. 2001.
57. L. Hongen, N. Hata, S. Nakajima, M. Iwahara, I. Sakuma, and T. Dohi, " Surgical navigation by autostereoscopic image overlay of integral videography," IEEE Trans. Inf. Technol. Biomed., vol. 8, no. 2, pp. 114-121, Jun. 2004.
58. Y. Igarishi, H. Murata, and M. Ueda, B3D display system using a computer-generated integral photograph,[ Jpn. J. Appl. Phys., vol. 17, pp. 1683-1684, 1978.
59. M. Martínez-Corral, B. Javidi, R. Martínez-Cuenca, and G. Saavedra, " Integral imaging with improved depth of field by use of amplitude modulated microlens array," Appl. Opt., vol. 43, pp. 5806-5813, Nov. 2004.
60. B. Lee, S. Jung, and J.-H. Park, " Viewing-angle-enhanced integral imaging using lens switching," Opt. Lett., vol. 27, pp. 818-820, May 2002. (Pubitemid 34618053)
61. J. S. Jang and B. Javidi, " Very-large scale integral imaging (VLSII) for 3D display," Opt. Eng., vol. 44, no. 1, pp. 01400-1-01400-6, Jan. 2005.
62. J.-Y. Son, S.-H. Kim, D.-S. Kim, B. Javidi, and K.-D. Kwack, " Image-forming principle of integral photography," IEEE J. Display Technol., vol. 4, no. 3, pp. 324-331, Sep. 2008.
63. A. Castro, Y. Frauel, and B. Javidi, " Integral imaging with large depth of field using an asymmetric phase mask," Opt. Exp., vol. 15, pp. 10 266-10 273, 2007.
64. S. Bagheri and B. Javidi, " Extension of depth of field in integral imaging using amplitude and phase modulation of the pupil function," in Proc. SPIEVInt. Soc. Opt. Eng., Apr. 2008, vol. 6983, DOI: 10.1117/12.786887.
65. S. Vassiliadis, E. A. Hakkennes, J. S. S. M. Wong, and G. G. Pechanek, " The sum-absolute-difference motion estimation accelerator Proc. Euromicro Conf., 1998, vol. 2, pp. 559-566.
66. J. W. Lichtman, BConfocal microscopy," Sci. Amer., vol. 271, pp. 40-45, 1994.
67. J.-H. Park, K. Hong, and B. Lee, " Recent progress in three-dimensional information processing based on integral imaging," Appl. Opt., vol. 48, pp. H77-H94, 2009.
68. M. Martínez-Corral, B. Javidi, R. Martínez-Cuenca, and G. Saavedra, " Formation of real, orthoscopic integral images by smart pixel mapping," Opt. Exp., vol. 13, pp. 9175-9180, 2005. (Pubitemid 41611948)
69. D.-C. Hwang, J.-S. Park, D.-H. Shin, and E.-S. Kim, " Depth-controlled reconstruction of 3D integral image using synthesized intermediate sub-images," Opt. Commun., vol. 281, pp. 5991-5997, 2008.
70. G. Saavedra, R. Martínez-Cuenca, M. Martínez-Corral, H. Navarro, M. Daneshpanah, and B. Javidi, " Digital slicing of 3D scenes by Fourier filtering of integral images," Opt. Exp., vol. 16, pp. 17 154-17 160, 2008.
71. H. M. Ozaktas and L. Onural, Eds., Three-Dimensional Television: Capture, Transmission, and Display. New York: Springer-Verlag, 2007.
72. S. W. Min, B. Javidi, and B. Lee, " Enhanced 3D integral imaging system by use of double display devices," Appl. Opt.VInf. Process., vol. 42, pp. 4186-4195, Jul. 10, 2003.
73. B. Javidi, S. Min, and B. Lee, " Enhanced 3D color integral imaging using multiple display devices," in Proc. Annu. Meeting IEEE Lasers Electro-Optics Soc., San Diego, CA, Nov. 2001, vol. 2, pp. 491-492. (Pubitemid 34006526)
74. A. Stern and B. Javidi, " Ray phase space approach for 3D imaging and 3D optical data representation," IEEE J. Display Technol., vol. 1, no. 1, pp. 141-150, Sep. 2005. (Pubitemid 41584132)
75. A. Stern and B. Javidi, " Information capacity gain by time-division multiplexing in 3D integral imaging," Opt. Lett., vol. 30, pp. 1135-1137, 2005. (Pubitemid 40795085)
76. R. Martinez, A. Pons, G. Saavedra, M. Martinez-Corral, and B. Javidi, " Optically-corrected elemental images for undistorted integral image display," Opt. Exp., vol. 14, pp. 9657-9663, 2006.
77. R. Martinez-Cuenca, G. Saavedra, M. Martinez-Corral, and B. Javidi, " Enhanced depth of field integral imaging with sensor resolution constraints," Opt. Exp., vol. 12, pp. 5237-5242, 2004.
78. W. Furlan, M. Martinez-Corral, B. Javidi, and G. Saavedra, " Analysis of 3D integral imaging displays using the Wigner distribution," IEEE J. Display Technol., vol. 2, no. 2, pp. 180-185, Jun. 2006.
79. R. Martinez-Cuenca, G. Saavedra, M. Martinez-Corral, and B. Javidi, " Extended depth-of-field 3-D display and visualization by combination of amplitude-modulated microlenses and deconvolution tools," IEEE J. Display Technol., vol. 1, no. 2, pp. 321-327, Dec. 2005.
80. M. Martinez-Corral, B. Javidi, R. Martinez-Cuenca, and G. Saavedra, " Integral imaging with improved depth of field by use of amplitude-modulated microlens arrays," Appl. Opt., vol. 43, pp. 5806-5813, 2004.
81. R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, 2nd ed. Cambridge, U.K.: Cambridge Univ. Press, 2004.
82. Y.-T. Lim, J.-H. Park, K.-C. Kwon, and N. Kim, " Resolution-enhanced integral imaging microscopy that uses lens array shifting," Opt. Exp., vol. 17, no. 21, pp. 19 253-19 263, 2009.
83. D. H. Shin, M. Cho, and B. Javidi, " Three-dimensional optical microscopy using axially distributed image sensing," Opt. Lett., vol. 35, no. 21, pp. 3646-3648, 2010.
84. B. Javidi, I. Moon, S. Yeom, and E. Carapezza, " Three-dimensional imaging and recognition of microorganism using single-exposure on-line (SEOL) digital holography," Opt. Exp., vol. 13, no. 12, pp. 4492-4506, 2005. (Pubitemid 41029370)
85. B. Javidi, I. Moon, and S. Yeom, " Real-time 3D sensing and identification of microorganisms," Opt. Photon. News Mag., vol. 17, no. 2, pp. 16-21, 2006.