From Motion to Photons in 80 Microseconds: Towards Minimal Latency for Virtual and Augmented Reality

IEEE Transactions on Visualization and Computer Graphics

Volumn 22, Issue 4, 2016, Pages 1367-1376

  Lincoln, Peter ^a   Blate, Alex ^a   Singh, Montek ^a   Whitted, Turner ^a,b   State, Andrei ^a,c   Lastra, Anselmo ^a   Fuchs, Henry ^a  

^a UNIVERSITY OF NORTH CAROLINA   (United States)

^b NVIDIA   (United States)

^c InnerOptic Technology Inc   (United States)

Author keywords

Augmented reality; display modulation; latency

Indexed keywords

BINS; DISPLAY DEVICES; ECONOMIC AND SOCIAL EFFECTS; FIELD PROGRAMMABLE GATE ARRAYS (FPGA); MODULATION; PHOTONS; RECONFIGURABLE HARDWARE;

DISPLAY MODULATION; END TO END LATENCIES; LATENCY; MECHANICAL TRACKING; NEAR-ZERO LATENCIES; OPTICAL SEE-THROUGH DISPLAY; PROCESSING ELEMENTS; VIRTUAL AND AUGMENTED REALITY;

AUGMENTED REALITY;

EID: 84963814165     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVCG.2016.2518038     Document Type: Article

References (31)

1. AMD. AMD FreeSyncTM technology. http://www.amd.com/en-us/innovations/software-technologies/technologies-gaming/freesync, 2015.
2. P. Aziz, H. Sorensen, J. van der Spiegel. An overview of sigma-delta converters. Signal Processing Magazine, IEEE, 13(1):61-84, Jan 1996.
3. R. T. Azuma. Predictive Tracking for Augmented Reality. PhD thesis, University of North Carolina at Chapel Hill, 1995.
4. R. T. Azuma. A survey of augmented reality. Presence, 6(4):355-385, 1997.
5. M. Bajura and U. Neumann. Dynamic registration correction in video-based augmented reality systems. Computer Graphics and Applications, IEEE, 15(5):52-60, 1995.
6. V. R. Bhakta, J. Richuso, A. Jain. DLP(R) technology for near eye display. White Paper DLPA051, Texas Instruments, September 2014.
7. G. Bishop, H. Fuchs, L. McMillan, E. J. S. Zagier. Frameless rendering: Double buffering considered harmful. In Proc. of the 21st Annual Conference on Computer Graphics and Interactive Techniques, SIG-GRAPH '94, pages 175-176, New York, NY, USA, 1994. ACM.
8. J. Bresenham. Algorithm for computer control of a digital plotter. IBM Systems Journal, 4(1):25-30, 1965.
9. T. J. Buker, D. A. Vincenzi, J. E. Deaton. The effect of apparent latency on simulator sickness while using a see-through helmet-mounted display: Reducing apparent latency with predictive compensation. Human Factors: The Journal of the Human Factors and Ergonomics Society, 54(2):235-249, 2012.
10. A. Dayal, C. Woolley, B. Watson, D. Luebke. Adaptive frameless rendering. In Proc. Eurographics Conference on Rendering Techniques, pages 265-275, 2005.
11. R. L. Holloway. Registration Error Analysis for Augmented Reality. Presence, 6(4):413-432, 1997.
12. L. J. Hornbeck. Digital light processingTM for high brightness, high-resolution applications. In Proc. SPIE, Projection Displays III, pages 27-40, 1997.
13. L. J. Hornbeck. A digital driving technique for an 8b QVGA AMOLED display using modulation. In Proc. IEEE International Solid State Circuits Conference, pages 270-272, 2009.
14. M. C. Jacobs, M. A. Livingston, A. State. Managing latency in complex augmented reality systems. In Proceedings of the 1997 symposium on Interactive 3D graphics, I3D '97, pages 49-ff., New York, NY, USA, 1997. ACM.
15. J. J. Jerald. Scene-Motion-and Latency-Perception Thresholds for Head-Mounted Displays. PhD thesis, University of North Carolina at Chapel Hill, 2009.
16. J. T. Kajiya and J. Torborg. Talisman: Commodity realtime 3d graphics for the PC. Association for Computing Machinery, Inc., January 1996.
17. J. Koeter. Whats an LFSR. Technical Report SCTA036A, Texas Instruments, December 1996.
18. M. Livingston and Z. Ai. The effect of registration error on tracking distant augmented objects. In Proc. IEEE/ACM International Symposium on Mixed and Augmented Reality (ISMAR), pages 77-86, Sept 2008.
19. W. R. Mark, L. McMillan, G. Bishop. Post-Rendering 3D Warping. In Proc. ACM I3D, pages 7-16, 1997.
20. L. McMillan and G. Bishop. Plenoptic modeling: An image-based rendering system. In Proceedings of the 22Nd Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH '95, pages 39-46, New York, NY, USA, 1995. ACM.
21. M. Mine and G. Bishop. Just-in-time pixels. Technical report, Chapel Hill, NC, USA, 1995.
22. NVIDIA Corporation. G-SYNC-Technology-GeForce. http://www. geforce.com/hardware/technology/g-sync/technology, October 2013.
23. M. Olano, J. D. Cohen, M. R. Mine, G. Bishop. Combatting rendering latency. In Proc. ACM I3D, pages 19-24, 1995.
24. V. Popescu, J. Eyles, A. Lastra, J. Steinhurst, N. England, L. Ny-land. The WarpEngine: An architecture for the post-polygonal age. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH '00, pages 433-442, New York, NY, USA, 2000. ACM Press/Addison-Wesley Publishing Co.
25. M. Regan and R. Pose. Priority rendering with a virtual reality address recalculation pipeline. In Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH '94, pages 155-162, New York, NY, USA, 1994. ACM.
26. M. J. P. Regan, G. S. P. Miller, S. M. Rubin, C. Kogelnik. A realtime low-latency hardware light-field renderer. In Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH '99, pages 287-290, New York, NY, USA, 1999. ACM Press/Addison-Wesley Publishing Co.
27. J. Shade, S. Gortler, L.-w. He, R. Szeliski. Layered depth images. In Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH '98, pages 231-242, New York, NY, USA, 1998. ACM.
28. F. Smit, R. van Liere, B. Froehlich. A programmable display layer for virtual reality system architectures. Visualization and Computer Graphics, IEEE Transactions on, 16(1):28-42, Jan 2010.
29. F. A. Smit, R. van Liere, B. Fröhlich. An image-warping VR-architecture: Design, implementation and applications. In Proceedings of the 2008 ACM Symposium on Virtual Reality Software and Technology, VRST '08, pages 115-122, New York, NY, USA, 2008. ACM.
30. B. Walter, G. Drettakis, S. Parker. Interactive rendering using the render cache. In D. Lischinski and G. Larson, editors, Rendering techniques '99 (Proceedings of the 10th Eurographics Workshop on Rendering), volume 10, pages 235-246, New York, NY, Jun 1999. Springer-Verlag/Wien.
31. F. Zheng, T. Whitted, A. Lastra, P. Lincoln, A. State, A. Maimone, H. Fuchs. Minimizing latency for augmented reality displays: Frames considered harmful. In Mixed and Augmented Reality (ISMAR), 2014 IEEE International Symposium on, pages 195-200, Sept 2014.