BiDi screen: A thin, depth-sensing LCD for 3D interaction using light fields

ACM Transactions on Graphics

Volumn 28, Issue 5, 2009, Pages

  Hirsch, Matthew ^a   Lanman, Douglas ^b   Holtzman, Henry ^a   Raskar, Ramesh ^a  

^a MIT MEDIA LAB   (United States)

^b BROWN UNIVERSITY   (United States)

Author keywords

3D interaction; 3D reconstruction; Depth from focus; Image based relighting; LCD; Lensless imaging; Light field

Indexed keywords

3D INTERACTIONS; 3D RECONSTRUCTION; DEPTH FROM FOCUS; IMAGE-BASED RELIGHTING; LENS-LESS IMAGING; LIGHT FIELDS;

CAMERAS; DIGITAL IMAGE STORAGE; IMAGE RECONSTRUCTION; IMAGE SENSORS; INTERACTIVE COMPUTER GRAPHICS; LIGHT MODULATION; LIQUID CRYSTAL DISPLAYS; LIQUID CRYSTALS; MILITARY PHOTOGRAPHY; TWO DIMENSIONAL;

THREE DIMENSIONAL;

EID: 77949306263     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/1661412.1618505     Document Type: Conference Paper

References (38)

1. ABILEAH, A., DEN BOER, W., TUENGE, R. T., AND LARSSON, T. S., 2006. Integrated optical light sensitive active matrix liquid crystal display. United States Patent 7,009,663.
2. BENKO, H., AND ISHAK, E. W. 2005. Cross-dimensional gestural interaction techniques for hybrid immersive environments. In IEEE VR, 209-216, 327.
3. BENKO, H., AND WILSON, A. D. 2009. DepthTouch: Using depth-sensing camera to enable freehand interactions on and above the interactive surface. Tech. Report MSR-TR-2009-23.
4. BISHOP, T., ZANETTI, S., AND FAVARO, P. 2009. Light field superresolution. In IEEE ICCP.
5. BROWN, C. J., KATO, H., MAEDA, K., AND HADWEN, B. 2007. A continuous-grain silicon-system LCD with optical input function. IEEE J. of Solid-State Circuits 42, 12.
6. COSSAIRT, O., NAYAR, S., AND RAMAMOORTHI, R. 2008. Light field transfer: Global illumination between real and synthetic objects. ACM Trans. Graph. 27, 3.
7. DIETZ, P., AND LEIGH, D. 2001. DiamondTouch: A multi-user touch technology. In ACM UIST, 219-226.
8. FARID, H. 1997. Range Estimation by Optical Differentiation. PhD thesis, University of Pennsylvania.
9. FENIMORE, E. E., AND CANNON, T. M. 1978. Coded aperture imaging with uniformly redundant arrays. Appl. Optics 17, 3, 337-347.
10. FORLINES, C., AND SHEN, C. 2005. DTLens: Multi-user tabletop spatial data exploration. In ACM UIST, 119-122.
11. FUCHS, M., RASKAR, R., SEIDEL, H.-P., AND LENSCH, H. P. A. 2008. Towards passive 6D reflectance field displays. ACMTrans. Graph. 27, 3.
12. GOTTESMAN, S. R., AND FENIMORE, E. E. 1989. New family of binary arrays for coded aperture imaging. Appl. Optics 28, 20, 4344-4352.
13. HAN, J. Y. 2005. Low-cost multi-touch sensing through frustrated total internal reflection. ACM UIST, 115-118.
14. HECHT, E. 2001. Optics (4th Edition). Addison Wesley.
15. HILLIS, W. D. 1982. A high-resolution imaging touch sensor. Int'l. J. of Robotics Research 1, 2, 33-44.
16. IZADI, S., HODGES, S., BUTLER, A., RRUSTEMI, A., AND BUXTON, B. 2007. ThinSight: Integrated optical multi-touch sensing through thin form-factor displays. In Workshop on Emerging Display Technologies.
17. IZADI, S., HODGES, S., TAYLOR, S., ROSENFELD, D., VILLAR, N., BUTLER, A., AND WESTHUES, J. 2008. Going beyond the display: A surface technology with an electronically switchable diffuser. In ACM UIST, 269-278.
18. LANMAN, D., RASKAR, R., AGRAWAL, A., AND TAUBIN, G. 2008. Shield fields: Modeling and capturing 3D occluders. ACM Trans. Graph. 27, 5.
19. LEE, S., BUXTON, W., AND SMITH, K. C. 1985. A multi-touch three dimensional touch-sensitive tablet. In ACM SIGCHI, 21-25.
20. LEVIN, A., FERGUS, R., DURAND, F., AND FREEMAN, W. T. 2007. Image and depth from a conventional camera with a coded aperture. ACM Trans. Graph. 26, 3, 70.
21. LEVOY, M., AND HANRAHAN, P. 1996. Light field rendering. In ACM SIGGRAPH, 31-42.
22. LIANG, C.-K., LIN, T.-H., WONG, B.-Y., LIU, C., AND CHEN, H. H. 2008. Programmable aperture photography: Multiplexed light field acquisition. ACM Trans. Graph. 27, 3.
23. LOKHORST, D. M., AND ALEXANDER, S. R., 2004. Pressure sensitive surfaces. United States Patent 7,077,009.
24. LUMSDAINE, A., AND GEORGIEV, T. 2009. The focused plenoptic camera. In IEEE ICCP.
25. MALIK, S., AND LASZLO, J. 2004. Visual touchpad: A two-handed gestural input device. In Int'l. Conf. on Multimodal Interfaces, 289-296.
26. MATSUSHITA, N., AND REKIMOTO, J. 1997. HoloWall: Designing a finger, hand, body, and object sensitive wall. In ACM UIST, 209-210.
27. NAYAR, S. K., AND NAKAGAWA, Y. 1994. Shape from focus. IEEE Trans. Pattern Anal. Mach. Intell. 16, 8, 824-831.
28. NAYAR, S. K., BELHUMEUR, P. N., AND BOULT, T. E. 2004. Lighting sensitive display. ACM Trans. Graph. 23, 4, 963-979.
29. NG, R. 2005. Fourier slice photography. In ACM SIGGRAPH, 735-744.
30. REKIMOTO, J. 2002. SmartSkin: An infrastructure for freehand manipulation on interactive surfaces. In ACMSIGCHI, 113-120.
31. ROSENTHAL, A. H., 1947. Two-way television communication unit. United States Patent 2,420,198, May.
32. VAISH, V., LEVOY, M., SZELISKI, R., ZITNICK, C. L., AND KANG, S. B. 2006. Reconstructing occluded surfaces using synthetic apertures: Stereo, focus and robust measures. In IEEE CVPR, 2331-2338.
33. VEERARAGHAVAN, A., RASKAR, R., AGRAWAL, R., MOHAN, A., AND TUMBLIN, J. 2007. Dappled photography: Mask enhanced cameras for heterodyned light fields and coded aperture refocusing. ACM Trans. Graph. 26, 3, 69.
34. WATANABE, M., AND NAYAR, S. K. 1998. Rational filters for passive depth from defocus. Int. J. Comput. Vision 27, 3.
35. WESTERMAN, W., AND ELIAS, J. G. 2001. Multi-Touch: A new tactile 2-D gesture interface for human-computer interaction. In Human Factors And Ergonomics Society, 632-636.
36. WILSON, A. D. 2004. TouchLight: An imaging touch screen and display for gesture-based interaction. In Int'l. Conf. on Multimodal Interfaces, 69-76.
37. ZHANG, C., AND CHEN, T. 2005. Light field capturing with lensless cameras. In IEEE ICIP, 792-795.
38. ZOMET, A., AND NAYAR, S. 2006. Lensless imaging with a controllable aperture. IEEE CVPR 1, 339-346.