Three-dimensional imaging for creating real-world-like environments

Proceedings of the IEEE

Volumn 101, Issue 1, 2013, Pages 190-205

  Son, Jung Young ^a   Son, Wook Ho ^b   Kim, Sung Kyu ^c   Lee, Kwang Hoon ^c   Javidi, Bahram ^d  

^a Konyang University   (South Korea)

^b Next Generation Visual Computing Research Team   (South Korea)

^c Korea Institute of Science and Technology   (South Korea)

^d University of Connecticut   (United States)

Author keywords

3 D image; Electroholography; eye fatigue; focusable depth information; interactive technology; multiview and integral photography; real world like environment; super multiview image

Indexed keywords

GEOMETRICAL OPTICS; IMAGING SYSTEMS; VISUAL COMMUNICATION;

3-D IMAGE; DEPTH INFORMATION; ELECTRO-HOLOGRAPHY; EYE FATIGUE; INTEGRAL PHOTOGRAPHY; INTERACTIVE TECHNOLOGY; MULTI-VIEW IMAGE; REAL-WORLD;

ELECTRON HOLOGRAPHY;

EID: 84871734507     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/JPROC.2011.2178052     Document Type: Article

References (65)

1. C. Cruz-Neira, D. J. Sandin, and T. A. Defanti, "Surround-screen projection-based virtual reality: The design and implementation of the CAVE," in Proc. Comput. Graph. (SIGGRAPH), 1993, vol. 27, pp. 135-142.
2. S. Peleg, M. Ben-Ezra, and Y. Pitch, "Omnistereo: Panoramic stereo imaging," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 3, pp. 279-290, Mar. 2001. (Pubitemid 32286634)
3. H. Shum and R. Szeliski, "Stereo reconstruction from multi-perspective panoramas," in Proc. 7th Int. Conf. Comput. Vis., 2001, pp. 14-21.
4. Y. P. Huang, G. Z. Wang, M. C. Ma, S. Y. Tung, S. Y. Huang, H. W. Tseng, C. H. Kuo, and C. H. Li, "Virtual touched 3D interactive system for auto-stereoscopic display with embedded optical sensor," Proc. SPIEVInt. Soc. Opt. Photon., vol. 8043, pp. 80430O-02-80430O-18, 2011.
5. K. Enami, "Research on ultra-realistic communications," ECTI Trans. Electr. Eng. Electron. Commun., vol. 6, no. 1, pp. 22-25, 2008.
6. T. Izumi (Supervisor), "Fundamental of 3-D imaging techniques," (in Japanese), NHK Sci. Technol. Lab., Ohmsa, Tokyo, Japan, 1995, pp. 33-34.
7. J.-Y. Son, B. Javidi, and K.-D. Kwack, "Methods for displaying three-dimensional images," Proc. IEEE, vol. 94, no. 3, pp. 502-523, Mar. 2006.
8. Nash Information Services, The Numbers: Movie Avatar, (retrieved Oct. 15, 2010). [Online]. Available: http://www. the-numbers.com/movies/2009/AVATR.php.
9. D. Suzuki, T. Fukmi, E. Higano, N. Kubota, T. Higano, S. Kawaguchi, Y. Nishimoto, K. Nishiyama, and K. Nakao, "Crosstalk-free 3D display with time-sequential OCB LCD," in Soc. Inf. Display (SID) Symp. Dig. Tech. Papers, 2009, pp. 428-431.
10. J. Schultz, R. Brott, M. Sykora, W. Bryan, T. Fukami, K. Nakao, and A. Takimoto, "Full resolution autostereoscopic 3D display for mobile applications," in Soc. Inf. Display (SID) Symp. Dig. Tech. Papers, 2009, pp. 127-130.
11. S. Kim, B. You, H. Choi, B. Berkeley, D. Kim, and N. Kim, "World's first 240 Hz TFT-LCD technology for full-HD LCD-TV and its application to 3D display," in Soc. Inf. Display (SID) Symp. Dig. Tech. Papers, 2009, pp. 424-438.
12. Entertainment Technology Center, Glasses-Free 3D Display Using Integral ImagingVToshiba (9-view Lenticular), Sep. 11, 2010. [Online]. Available: http://www.etcenter.org/2010/09/glasses-free-3d-display-using-integralimaging- toshiba-9-view-lenticular/.
13. J.-Y. Son, B. Javidi, S. Yano, and K.-H. Choi, "Recent developments in 3-D imaging technologies," J. Display Technol., vol. 6, no. 10, pp. 394-403, Oct. 2010.
14. C. Chen, Y. Huang, S. Chuang, C. Wu, H. Shieh, W. Mphepo, C. Hsieh, and S. Hsu, "Liquid crystal panel for high efficiency barrier type autostereoscopic three-dimensional displays," Appl. Opt., vol. 48, no. 18, pp. 3446-3454, 2009.
15. J.-Y. Son and B. Javidi, "Three-dimensional imaging systems based on multiview images," J. Display Technol., vol. 1, no. 1, pp. 125-140, Jan. 2005. (Pubitemid 41584131)
16. F. Okano, H. Hoshino, and I. Yuyama, "Real time pickup method for a three dimensional image based on integral photography," Appl. Opt., vol. 36, pp. 1598-1603, 1997. (Pubitemid 127638580)
17. P. D. Panabaker, G. W. Harris, and W. C. Shaw, "Large format 3D motion picture systems," in Proc. Symp. Three-Dimensional Image Technol. Art, 1992, pp. 49-55.
18. Y. Kajiki, H. Yoshikawa, and T. Honda, "Ocular accommodation by super multi-view stereogram and 45-view stereoscopic display," in Proc. 11th Int. Display Workshop, 1996, pp. 489-492.
19. Y. Takaki and H. Nakanuma, "Improvement of multiple imaging system used for natural 3D display which generates high-density directional images," Proc. SPIEVInt. Soc. Opt. Photon., vol. 5243, pp. 43-49, 2003.
20. M. A. Klug, C. Newswanger, Q. Huang, and M. E. Holzbach, "Active digital hologram displays," Zebra Imaging Inc., U.S. Patent 7 227 674, Jun. 2007.
21. H. E. Ives, "Optical properties of Lippmann lenticulated sheet," J. Opt. Soc. Amer., vol. 21, pp. 171-176, 1931.
22. A. R. L. Travis, S. R. Lang, J. R. Moore, and N. A. Dodgson, "Time-multiplexed three-dimensional video display," in Soc. Inf. Display (SID) Symp. Dig. Tech. Papers, 1995, pp. 851-852.
23. J.-Y. Son, V. G. Komar, Y.-S. Chun, S. Sabo, V. Mayorov, L. Balasny, S. Belyaev, M. Semin, M. Krutik, and H.-W. Jeon, "A multiview 3 dimensional imaging system with full color capabilities," Proc. SPIEVInt. Soc. Opt. Photon., vol. 3295A, pp. 218-225, 1998.
24. S. A. Shestak, J.-Y. Son, H.-W. Jeon, and V. G. Komar, "Sliding aperture multiview 3-D camera-projector system and its application for 3-D image transmission and IR to visible conversion," Proc. SPIEVInt. Soc. Opt. Photon., vol. 3012, pp. 96-106, 1997.
25. S.-S. Kim, K.-H. Sohn, V. Savaljev, E. F. Pen, J.-Y. Son, and J.-H. Chun, "A full parallax three-dimensional imaging system based on a point light source array," Jpn. J. Appl. Phys., vol. 40, pp. 4913-4915, 2001. (Pubitemid 32991299)
26. V. I. Bobrinev, J.-Y. Son, S. A. Shestak, and H.-W. Jeon, "The achromatized transmission type holographic screen for the stereo imaging and the multiview projection," Proc. SPIEVInt. Soc. Opt. Photon., vol. 2951, pp. 168-172, 1996.
27. Y. Kajiki, H. Yoshikawa, and T. Honda, "Hologram like video images by 45-view stereoscopic display," Proc. SPIEVInt. Soc. Opt. Photon., vol. 3012, pp. 154-166, 1997.
28. Y. Takaki and H. Nakanuma, "Improvement of multiple imaging system used for natural 3D display which generates high-density directional images," Proc. SPIEVInt. Soc. Opt. Photon., vol. 5243, pp. 43-49, 2003.
29. J.-Y. Son, S.-H. Kim, D.-S. Kim, and B. Javidi, "Image forming principle of integral photography," J. Display Technol., vol. 4, no. 3, pp. 324-331, Sep. 2008.
30. J.-Y. Son, V. V. Saveljev, Y.-J. Choi, J.-E. Bahn, and H.-H. Choi, "Parameters for designing autostereoscopic imaging systems based on lenticular, parallax barrier and IP plates," Opt. Eng., vol. 42, no. 11, pp. 3326-3333, 2003.
31. E. Hecht and A. Zazac, Optics. Reading, MA: Addison-Wesley, 1979.
32. J.-Y. Son, V. V. Saveljev, D.-S. Kim, Y.-M. Kwon, and S.-H. Kim, "A three dimensional imaging system based on LED array," Opt. Eng., vol. 46, no. 10, p. 103205-4, 2007.
33. "A display module in 2-D/3-D compatible multiview 3-D imaging system," Korea, Patent 10-0567401-0000.
34. T. Balogh, "The Holovizio system," Proc. SPIEVInt. Soc. Opt. Photon., vol. 6055, pp. 60550U-1-60550U-12, 2006.
35. M. C. Forman, N. Davies, and M. McCormick, "Continuous parallax in discrete pixelated integral three-dimensional displays," J. Opt. Soc. Amer. A, vol. 20, no. 3, pp. 411-420, 2003.
36. F. Speranza, W. J. Tam, T. Martin, and L. Stelmach, "Perceived smoothness of viewpoint transition in multi-viewpoint stereoscopic," Proc. SPIEVInt. Soc. Opt. Photon., vol. 5664, pp. 72-82, 2005. (Pubitemid 40949101)
37. Y. Takaki and N. Nago, "Multi-projection of lenticular displays to construct a 256-view super multi-view display," Opt. Exp., vol. 18, no. 9, pp. 8824-8835, 2010.
38. S.-K. Kim, D.-W. Kim, Y.-M. Kwon, and J.-Y. Son, "Evaluation of the monocular depth cue in 3D displays," Opt. Exp., vol. 16, no. 26, pp. 21415-21422, 2008.
39. "Display device based on point image array," Korea Patent Application No. 10-2009-0010302.
40. [Online]. Available: http://www.amazon.com/AAXA-M2-Projector-1024x768- Resolution/dp/B004BM2OS4
41. L. Bogaert, Y. Meuret, S. Roelandt, A. Avci, H. De Smet, and H. Thienpont, "Single projector multiview displays: Directional illumination compared to beam steering," Proc. SPIEVInt. Soc. Opt. Photon., vol. 7524, pp. 75241R-1-75241R-10, 2009.
42. C. Slinger, C. Cameron, and M. Stanley, "Computer-generated holography as a generic display technology," IEEE Computer, vol. 38, no. 8, pp. 46-53, Aug. 2005. (Pubitemid 41245043)
43. K. Beev, S. Sainov, T. Angelov, and A. G. Petrov, "Investigation of Bragg gratings recorded in polymer-dispersed liquid crystal," J. Optoelectron. Adv. Mater., vol. 6, pp. 799-803, 2004. (Pubitemid 39326313)
44. S.-H. Pierre, M. Lucentea, J. D. Sutter, R. Pappu, C. D. Sparrell, and S. A. Benton, "Scaling up the MIT holographic video system," Proc. SPIEVInt. Soc. Opt. Photon., vol. 2333, pp. 374-380, 1994.
45. J. Y. Son, S. Shestak, S. K. Kim, and V. Epikhan, "A multichannel AOM for real time electroholography," Appl. Opt., vol. 38, no. 14, pp. 3101-3104, 1999. (Pubitemid 129306997)
46. H. H. Choi, S.-K. Kim, J.-Y. Son, and J. W. Wu, "Pulse laser electro-holography using interference fringe pattern captured by a CCD," Appl. Opt., vol. 43, no. 30, pp. 5600-5606, 2004.
47. T. Senoh, T. Mishina, K. Yamamoto, O. Ryutaro, and T. Kurita, "Viewing-zone-angle-expanded color electronic holography system using ultra-high-definition liquid-crystal displays with undesirable light elimination," J. Display Technol., vol. 7, no. 7, pp. 382-390, Jul. 2011.
48. L. M. Myers, "The Scophony system: An analysis of its possibilities," TV and Shortwave World, pp. 201-294, Apr. 1936.
49. S. A. Benton and M. Lucente, "Interactive computation of display holograms," Proc. Comput. Graph. Int., T. Kunii, Ed., 1992, pp. 129-149.
50. D. R. Pape, O. B. Gusev, S. V. Kulakov, and V. V. Molotok, "Design of acousto-optic deflectors," in Design and Fabrication of Acousto-Optic Devices, A. P. Goutzoulis and D. R. Pape, Eds. New York: Marcel Dekker, 1994, pp. 77-102.
51. Q. Y. J. Smithwick, D. E. Smalley, V. M. Bove, Jr., and J. Barabas, "Progress in holographic video displays based on guided-wave acousto-optic devices," Proc. SPIEVInt. Soc. Opt. Photon., vol. 6912, pp. 69120H-1-69120H-10, 2008.
52. N. T. Shaked, J. Rosen, and A. Stern, "Integral photography: White-light single-shot hologram acquisition," Opt. Exp., vol. 15, pp. 5754-5760, 2007. (Pubitemid 46698986)
53. T. Senoh, K. Yamamoto, R. Oi, T. Mishina, andM. Okui, "Computer generated electronic holography of natural scene from 2D multi-view images and depth map," in Proc. 2nd Int. Symp. Universal Commun., 2008, pp. 126-133.
54. W. J. Dallas, "Computer generated holograms," in The Computer in Optical Research. Berlin, Germany: Springer-Verlag, 1980, pp. 291-366.
55. T. C. Poon, K. B. Doh, B. W. Schilling, M. H. Wu, K. Shinoda, and Y. Suzuki, "Three-dimensional microscopy by optical scanning holography," Opt. Eng., vol. 34, pp. 1338-1344, 1995.
56. T. Shimobaba, A. Shiraki, N. Masuda, and T. Ito, "Electroholographic display unit for three-dimensional display by use of special-purpose computational chip for holography and reflective LCD panel," Opt. Exp., vol. 13, no. 11, pp. 4196-4201, 2005. (Pubitemid 40899318)
57. K. Maeno, N. Fukaya, O. Nishikawa, K. Sato, and T. Honda, "Electro-holographic display using 15-megapixel LCD," Proc. SPIEVInt. Soc. Opt. Photon., vol. 2652, pp. 15-23, 1996.
58. F. Yaras, H. Kang, and L. Onurai, "State of the art in holographic displays: A survey," J. Display Technol., vol. 6, no. 10, pp. 443-454, Oct. 2010.
59. T. Ito, T. Shimobaba, H. Godo, and M. Horiuchi, "Hologram reconstruction with a 10 m Pixel-pitch refractive liquid-crystal display by use of a light-emitting diode reference beam," Opt. Lett., vol. 27, pp. 1406-1408, 2002. (Pubitemid 34951014)
60. K. Takano and K. Sato, "Color electro-holographic display using a single white light source and a focal adjustment method," Opt. Eng., vol. 41, pp. 2427-2433, 2002. (Pubitemid 35369727)
61. T. Nagai, Y. Yabe, and Y. Sakamoto, "A system of enlarging visual field and viewing zone simultaneously for electro-holography," Proc. SPIEVInt. Soc. Opt. Photon., vol. 6488, pp. 64880w1-64880w8, 2007.
62. T. Ito and K. Okano, "Color electroholography by three colored reference lights simultaneously incident upon one hologram panel," Opt. Exp., vol. 12, pp. 4320-4325, 2004.
63. S. Reichelt, H. Sahm, N. Leister, and A. Schwerdtner, "Capabilities of diffractive optical elements for real-time holographic displays," Proc. SPIEVInt. Soc. Opt. Photon., vol. 6912, pp. 69120P-1-69120P-11, 2008.
64. U. Schnars and W. P. O. Juptner, "Digital recording and numerical reconstruction of holograms," Meas. Sci. Technol., vol. 13, pp. R85-R101, 2002.
65. R. Buschmann, PANORAMA: Package for New OpeRational Autostereoscopic Multiview Systems and Applications, Report No. AC092/SIE/Final Demo/DS/P/032/b1 of Project No. AC092, Oct. 1998.