Three-dimensional image sensing, visualization, and processing using integral imaging

Proceedings of the IEEE

Volumn 94, Issue 3, 2006, Pages 591-606

  Stern, Adrian ^b   Javidi, Bahram ^a,c,d,e  

^a IEEE   (United States)

^b BEN GURION UNIVERSITY OF THE NEGEV   (Israel)

^c UNIVERSITY OF CONNECTICUT   (United States)

^d OPTICAL SOCIETY OF AMERICA   (United States)

^e International Society for Optical Engineering SPIE   (United States)

Author keywords

Computational integral imaging (CII), integral imagi (II), tnghree dimensional (3 D) imaging.; Computer generated integral imaging (CGII),

Indexed keywords

IMAGE PROCESSING; IMAGING TECHNIQUES; LIGHT SOURCES; OPTICAL PROPERTIES; VISUALIZATION;

COMPUTER-GENERATED INTEGRAL IMAGING (CGII); DIGITAL CAPTURE; NONCOMPROMISING;

IMAGE SENSORS;

EID: 33644901600     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/JPROC.2006.870696     Document Type: Article

References (84)

1. L. Lypton, Foundation of Stereoscopic Cinema, A Study in Depth. New York: Van Nostrand Reinhold, 1982.
2. T. Okoshi, 'Three-dimensional displays," Proc. IEEE, vol. 68, no. 5, pp. 548-564, May 1980.
3. T. Yamazaki, K. Kamijo, and S. Fukuzumi, "Quantitative evaluation of visual fatigue encountered in viewing stereoscopic 3-D display - near point distance and visual evoked potential study," in Proc. Japan Display '89, pp. 606-609.
4. A. Stern and B. Javidi, "Ray phase space approach for 3-D imaging and 3-D optical data representation," IEEE/OSA J. Display Technol., to be published.
5. _, "3-D imaging with lenslet arrays," Proc. SPIE, Optical Information Systems III, vol. 5908, pp. 118-131, 2005.
6. M. G. Lippmann, "Epreuves reversibles donnant la sensation du relief," J. Phys., vol. 7, pp. 821-825, Nov. 1908.
7. H. Arimoto and B. Javidi, "Integral three-dimensional imaging with digital reconstruction," Opt. Lett., vol. 26, pp. 157-159, Feb. 2001.
8. T. Okoshi, Three-Dimensional Imaging Techniques. New York: Academic, 1976.
9. A. P. Sokolov, Autostereoscpy and Integral Photography by Professor Lippmann's Method. Moscow, Russia: Moscow State Univ. Press, 1911.
10. H. E. Ives, "Optical properties of a Lippmann lenticuled sheet," J. Opt. Soc. Amer., vol. 21, pp. 171-176, Mar. 1931.
11. F. Okano, H. Hoshino, J. Arai, and I. Yuyama, "Real-time pickup method for a there-dimensional image based on integral photography," Appl. Opt., vol. 36, pp. 1598-1603, Jul. 1997.
12. J. Arai, F. Okano, H. Hoshino, and I. Yuyama, "Gradient-index lenss-array method based on real time integral photography for three-dimensional images," Appl. Opt., vol. 7, pp. 2034-2045, Jul. 1998.
13. J. S. Jang and B. Javidi, "Improved viewing resolution of 3-D integral imaging with nonstationary micro-optics," Opt. Lett., vol. 27, pp. 324-326, Mar. 2002.
14. _, "Three-dimensional synthetic aperture integral imaging," Opt. Lett., vol. 27, pp. 1144-1146, Jul. 2002.
15. _, "Depth and lateral size control of three-dimensional images in projection integral imaging," Opt. Express, vol. 12, pp. 3778-3790, Jul. 2004.
16. Y. Frauel and B. Javidi, "Digital three-dimensional image correlation using computer-reconstructed integral imaging," Appl. Opt., vol. 41, pp. 5488-5496, Sep. 2002.
17. T. Naemura, T. Yoshida, and H. Harashima, "3-D computer graphics based on integral photography," Opt. Express, vol. 8, pp. 255-262, Feb. 2001.
18. A. Stern and B. Javidi, "Three-dimensional image sensing and reconstruction with time-division multiplexed computational integral imaging," Appl. Opt., vol. 42, pp. 7036-7042, Dec. 2003.
19. J. S. Jang and B. Javidi, "Three-dimensional volumetric object reconstruction using computational integral imaging," Opt. Express, vol. 12, pp. 483-491, Feb. 2004.
20. S. H. Hong and B. Javidi, "Improved resolution 3-D object reconstruction using computational integral imaging with time multiplexing," Opt. Express, vol. 12, pp. 4579-4588, Sep. 2004.
21. S. Kishk and B. Javidi, "Improved resolution 3-D object sensing and recognition using time multiplexed computational integral imaging," Opt. Express, vol. 11, pp. 3528-3541, Dec. 2003.
22. J. H. Park, Y. Kim, J. Kim, S. W. Min, and B. Lee, "Three- dimensional display scheme based on integral imaging with three-dimensional information processing," Opt. Express, vol. 12, pp. 2032-6020, Nov. 2004.
23. R. Zaharia, A. Aggoun, and M. McCormick, "Adaptive 3D-DCT compression algorithm for continuous parallax 3-D integral imaging," Signal Process. Image Commun., vol. 17, pp. 231-242, Sep. 2002.
24. S. Yeom, A. Stern, and B. Javidi, "Compression of color integral images using MPEG 2," Opt. Express, vol. 12, pp. 1632-1642, Mar.. 2004.
25. Y. Frauel, E. Tajahuerce, O. Matoba, A. Castro, and B. Javidi, "Comparison of passive ranging integral imaging and active imaging digital holography for three-dimensional object recognition," Appl. Opt., vol. 43, p. 452, 2004.
26. S. Yeom and B. Javidi, "Three-dimensional distortion-tolerant object recognition using integral imaging," Opt. Express, vol. 12, pp. 5795-5809, Nov. 2004.
27. Y. Heiser, A. Stern, and B. Javidi, Recognition of Three-Dimensional Objects Having Arbitrary Orientation Using Integral Imaging in preparation.
28. O. Matoba, E. Tajahuerce, and B. Javidi, "Real-time three-dimensional object recognition with multiple perspectives imaging," Appl. Opt., vol. 40, pp. 3318-3326, Jul. 2001.
29. _, "Tree-dimensional display and recognitions system based on multiple perspectives integral imaging," in Three-Dimensional Television, Video, and Display TechnologyB. Javidi and F. Okano, Eds. Berlin Heidelberg, NY: Springer-Verlag, 2002, pp. 241-256.
30. S. H. Shin and B. Javidi, "Real time three dimensional integral imaging display and object recognition using volume optical storage," in Three-Dimensional Television, Video, and Display Technology, B. Javidi and F. Okano, Eds. Berlin Heidelberg, NY: Springer-Verlag, 2002, pp. 143-166.
31. J.-S. Jang and B. Javidi, "Three-dimensional integral imaging of micro-objects," Opt. Lett., vol. 29, pp. 1230-1232, 2004.
32. T. Wilson, Ed., Confocal Microscopy. London, U.K.: Academic, 1990.
33. L. Hongen, N. Hata, S. Nakajima, M. Iwahara, I. Sakuma, and T. Dohi, "Surgical navigation by autostereoscopic image overlay of integral videography "IEEE Trans. Inf. Technol. Biomed., vol. 8, pp. 114-121, Jun. 2004.
34. J.-S. Jang and B. Javidi, "Three-dimensional projection integral imaging using micro-convex-mirror arrays," Opt. Express, vol. 12, pp. 1077-1086, Mar. 2004.
35. _, "Two-step integral imaging for orthoscopic three-dimensional imaging with improved viewing resolution," Opt. Eng, vol. 41, pp. 2568-2571, Oct. 2002.
36. N. Davies, M. McCormick, and L. Yang, "Three-dimensional imaging systems: a new development," Appl. Opt., vol. 27, pp. 4520-4528, 1988.
37. J.-H. Park, S.-W. Min, S. Jung, and B. Lee, "Analysis of viewing parameters for two display methods based on integral photography," Appl. Opt., vol. 40, pp. 5217-5232, Oct. 2001.
38. J.-S. Jang and B. Javidi, "Formation of orthoscopic three-dimensional real images in direct pickup one-step integral imaging," Opt. Eng., vol. 42, pp. 1869-1870, Mar. 2003.
39. Y. Igarishi, H. Murata, and M. Ueda, "3D display system using a computer-generated integral photograph," Jpn. J. Appl. Phys., vol. 17, pp. 1683-1684, 1978.
40. S.-W. Min, S. Jung, J.-H. Park, and B. Lee, "Three-dimensional display system based on computer generated integral photography," in Proc. SPIE, Stereoscopic Displays and Virtual Reality Systems VIIIA. J. Woods, J. O. Merritt, and S.A. Benton, Eds., 2001, vol. 4297, pp. 187-195.
41. J.-S. Jang, F. Jin, and B. Javidi, "Three-dimensional integral imaging with large depth of focus by use of real and virtual image fields," Opt. Lett., vol. 28, pp. 1421-1423, Aug. 2003.
42. J.-S. Jang and B. Javidi, "Time-multiplexed integral imaging: for 3-D sensing and display," Opt. Photon. News, vol. 15, pp. 36-43, Apr. 2004.
43. Y. Kim, J.-H. Park, H. Choi, S. Jung, S.-W. Min, and B. Lee, "Viewing-angle-enhanced integral imaging system using a curved lens array," Opt. Express, vol. 12, pp. 421-329, Feb. 2004.
44. C.B. Burckhardt, "Optimum parameters and resolution limitation of integral photography," J. Opt. Soc. Amer., vol. 58, pp. 71-76, Jan. 1968.
45. H. Hoshino, F. Okano, H. Isono, and I. Yuyama, "Analysis of resolution limitation of integral photography," J. Opt. Soc. Amer. A., vol. 15, pp. 2059-2065, Aug. 1998.
46. J. Arai, H. Hoshino, M. Okui, and F. Okano, "Effects of focusing on the resolution characteristics of integral photography," J. Opt. Soc. Amer. A., vol. 20, pp. 996-1004, Jun. 2003.
47. J. Arai, M. Okui, M. Kobayashi, and F. Okano, "Geometrical effects of positional errors in integral photography," J. Opt. Soc. Amer. A., vol. 21, pp. 951-958, Jun. 2004.
48. M. C. Forman, N. Davies, and M. McCormick, "Continuous parallax in discrete pixelated integral three-dimensional displays," J. Opt. Soc. Amer. A., vol. 20, pp. 411-421, Mar. 2003.
49. M. Martínez-Corral, B. Javidi, R. Martínez-Cuenca, and G. Saavedra, "Multi-facet structure of observed reconstructed integral images," J. Opt. Soc. Amer. A., vol. 22, pp. 597-603, Mar. 2005.
50. _, "Integral imaging with improved depth of field by use of amplitude modulated microlens array," Appl. Opt., vol. 43, pp. 5806-5813, Nov. 2004.
51. J.-Y. Son, V.V. Saveljev, Y.-J. Choi,J.-E. Bahn,S.-K. Kim, and H. Choi, "Parameters for designing autostereoscopic imaging systems based on lenticular, parallax barrier, and integral photography plates," Opt. Eng., vol. 42, pp. 3326-3333, Nov. 2003.
52. S.-W. Min, J. Hong, and B. Lee, "Analysis of an optical depth Converter used in a three-dimensional integral imaging system," Appl. Opt., vol. 43, pp. 4539-4549, Aug. 2004.
53. J.-Y. Son, V. V. Saveljev, J.-S. Kim, S.-S. Kim, and B. Javidi, "Viewing zones in three-dimensional imaging systems based on lenticular, parallax-barrier, and microlens-array plates," Appl. Opt., vol. 43, pp. 4985-4992, Sep. 2004.
54. S. Manolache, A. Aggoun, M. McCormick, N. Davies, and S. Y. Kung, "Analytical model of a three-dimensional integral image recording system that uses circular- and hexagonal-based spherical surface microlenses," J. Opt. Soc. Amer. A., vol. 18, pp. 1814-1821, Aug. 2001.
55. A. Stern and B. Javidi, "Shannon number and information capacity of integral images," J. Opt. Soc. Amer. A., vol. 21, pp. 1602-1612, Sep. 2004.
56. _, "3-D computational synthetic aperture integral imaging (COMPSAII)," Opt. Express, vol. 11, no. 19, pp. 2446-2451, Sep. 2003.
57. F. Okano, H. Hoshino, J. Arai, M. Yamada, and I. Yuyama, "Tree-dimensional television system based on integral photography," in Three-Dimensional Television, Video, and Display Technology, B. Javidi and F. Okano, Eds. Berlin, Germany: Springer-Verlag, 2002, pp. 101-124.
58. M. Martínez-Corral, B. Javidi, R. Martínez-Cuenca, and G. Saavedra, "Integral imaging with improved depth of field by use of amplitude modulated microlens array," Appl. Opt., vol. 43, pp. 5806-5813, Nov. 2004.
59. R. Martínez-Cuenca, G. Saavedra, M. Martínez-Corral, and B. Javidi, "Enhanced depth of field integral imaging with sensor resolution constraints," Opt. Express, vol. 12, pp. 5237-5242, Oct. 2004.
60. L. Erdmann and K. J. Gabriel, "High resolution digital photography by use of a scanning microlens array," Appl. Opt., vol. 40, pp. 5592-5599, Nov. 2001.
61. J.-S. Jang and B. Javidi, "Improved-quality three-dimensional Integral imaging and projection using nonstationary optical components," in Three-Dimensional Television, Video, and Display Technology, B. Javidi and F. Okano, Eds. Berlin, Germany: Springer-Verlag, 2002, pp. 123-142.
62. _, "Improvement of viewing angle in integral imaging by use of moving lenslet arrays with low fill factor," Appl. Opt., vol. 42, pp. 1996-2002, Apr. 2003.
63. A. Stern, Y. Porat, A. Ben-Dor, and N. S. Kopeika, "Enhanced- resolution image restoration from a sequence of low-frequency vibrated images using convex projections," Appl. Opt., vol. 40, pp. 4706-4715, Sep. 2001.
64. J.-S. Jang and B. Javidi, "Large depth-of-focus time-multiplexed three-dimensional integral imaging using lenslets with nonuniform focal lengths and aperture sizes," Opt. Lett., vol. 28, pp. 1924-1926, 2003.
65. A. Stern and B. Javidi, "Information capacity gain by time-division multiplexing in three-dimensional integral imaging," Opt. Lett., vol. 30, pp. 1135-1137, May 2005.
66. B. Lee, S.-W. Min, and B. Javidi, "Theoretical analysis for three-dimensional integral imaging systems with double devices," Appl. Opt., vol. 41, pp. 4856-4865, Aug. 2002.
67. S. Jung, J.-H. Park, B. Lee, and B. Javidi, Viewing-Angle-Enhanced Integral 3-D Imaging Using Double Display Devices With Masks vol. 41, pp. 2389-2390, Oct. 2002.
68. J.-S. Jang and B. Javidi, "Real-time all-optical three-dimensional integral imaging projector," Appl. Opt., vol. 41, pp. 4866-4869, Aug. 2002.
69. _, "Spatiotemporally multiplexed integral imaging projector for large-scale high-resolution three-dimensional display," Opt. Express, vol. 12, pp. 557-563, Feb. 2004.
70. H. Liao, M. Iwahara, N. Hata, and T. Dohi, "High-quality integral videography using a multiprojector," Opt. Express, vol. 12, pp. 1067-107622, Mar. 2004.
71. H. Choi, S.-W. Min, S. Jung, J.-H. Park, and B. Lee, "Multiple- viewing-zone integral imaging using a dynamic barrier array for three-dimensional displays," Opt. Express, vol. 11, pp. 927-932, Apr. 2003.
72. A. R. L. Travis, "'The display of three dimensional video images," Proc. IEEE, vol. 85, no. 11, pp. 1817-1832, Nov. 1997.
73. S.-W. Min, S. Jung, J.-H. Park, and B. Lee, "Study for wide-viewing integral photography using an aspheric Fresnel-lens array," Opt. Eng., vol. 41, pp. 2572-2576, Oct. 2002.
74. B. Lee, S. Jung, and J.-H. Park, "Viewing-angle-enhanced integral imaging using lens switching," Opt. Lett., vol. 27, pp. 818-820, May 2002.
75. J.-H. Park, S. Jung, H. Choi, and B. Lee, "Viewing-angle-enhanced integral imaging by elemental image resizing and elemental lens switching," Appl. Opt., vol. 41, pp. 6875-6883, Nov. 2002.
76. S. Jung, J.-H. Park, H. Choi, and B. Lee, "Wide-viewing integral three-dimensional imaging by use of orthogonal polarization switching," Appl. Opt., vol. 42, pp. 2513-2520, May 2003.
77. _, "Viewing-angle-enhanced integral three-dimensional imaging along all directions without mechanical movement," Opt. Express, vol. 11, pp. 1346-1356, Jun. 2003.
78. S.-H. Shin and B. Javidi, "Viewing-angle enhancement of speckle-reduced volume holographic three-dimensional display by use of integral imaging," Appl. Opt., vol. 41, pp. 5562-5567, Sep. 2002.
79. Y. Jeong, S. Jung, J.-H. Park, and B. Lee, "Reflection-type integral imaging scheme for displaying three-dimensional images," Opt. Lett., vol. 27, pp. 704-706, May 2002.
80. J.-S. Jang and B. Javidi, "Large depth-of-focus time-multiplexed three-dimensional integral imaging using lenslets with nonuniform focal lengths and aperture sizes," Opt. Lett., vol. 28, pp. 1924-1926, Oct. 2003.
81. _, "Three-dimensional integral imaging with electronically synthesized lenslet arrays," Opt. Lett., vol. 27, pp. 1767-1769, Oct. 2002.
82. J.-Y. Son, "3D display," IEEE LEOS Newslett., vol. 18, pp. 13-14, Feb. 2004.
83. J.-Y. Son, V. V. Saveljev, B. Javidi, and K. D. Kwack, "A method of building pixel cells with an arbitrary vertex angle," Opt. Eng., vol. 44, pp. 3326-3333, Feb. 2005.
84. E. Elharar, A. Stern, O. Hadar, and B. Javidi, A Hybrid Compression Method for Integral Images Using Discrete Wavelet Transform and Discrete Cosine Transform in preparation.