Designing for depth perceptions in augmented reality

Proceedings of the 2017 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2017

Volumn , Issue , 2017, Pages 111-122

  Diaz, Catherine ^a,b   Walker, Michael ^a,b   Szafir, Danielle Albers ^a,b   Szafir, Daniel ^a  

^a UNIVERSITY OF COLORADO   (United States)

^b Department of Computer Science ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DEPTH PERCEPTION; ECONOMIC AND SOCIAL EFFECTS; VIRTUAL REALITY;

AUGMENTED REALITY APPLICATIONS; AUGMENTED REALITY TECHNOLOGY; DESIGN DECISIONS; PERCEPTUAL MATCHING; PHYSICAL OBJECTS; USER PERCEPTIONS; VIRTUAL OBJECTS; VISUAL ABILITIES;

AUGMENTED REALITY;

EID: 85041694731     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISMAR.2017.28     Document Type: Conference Paper

References (83)

1. W. J. Adams and J. H. Elder. Effects of specular highlights on perceived surface convexity. PLoS Computational Biology, 10(5):e1003576, 2014.
2. M. Al-Kalbani, I. Williams, and M. Frutos-Pascual. Analysis of Medium Wrap Freehand Virtual Object Grasping in Exocentric Mixed Reality. In Proceedings of the International Symposium on Mixed and Augmented Reality (ISMAR) 2016, pages 84-93, 2016.
3. M. Al-Kalbani, I. Williams, and M. Frutos-Pascual. Improving Freehand Placement for Grasping Virtual Objects via Dual View Visual Feedback in Mixed Reality. In ACM Conference on Virtual Reality Software and Technology, pages 279-282, 2016.
4. K. Berbaum, D. Tharp, and K. Mroczek. Depth perception of surfaces in pictures: Looking for conventions of depiction in pandora's box. Perception, 12(1):5-20, 1983.
5. M. Berning, D. Kleinert, T. Riedel, and M. Beigl. A study of depth perception in hand-held augmented reality using autostereoscopic displays. In Proceedings of the International Symposium on Mixed and Augmented Reality (ISMAR) 2014, pages 93-98. IEEE, 2014.
6. C. Bichlmeier, T. Sielhorst, S. M. Heining, and N. Navab. Improving depth perception in medical ar. In Bildverarbeitung für die Medizin 2007, pages 217-221. Springer, 2007.
7. J. F. Blinn. Models of Light Reflection for Computer Synthesized Pictures. In Proceedings of the ACM SIGGRAPH Conference on Computer Graphics and Interactive Techniques 1977, volume 11, pages 192-198. ACM, 1977.
8. M. F. Bradshaw, A. Glennerster, and B. J. Rogers. The effect of display size on disparity scaling from differential perspective and vergence cues. Vision Research, 36(9):1255-1264, 1996.
9. H. H. Bülthoff and H. A. Mallot. Integration of depth modules: stereo and shading. Josa a, 5(10):1749-1758, 1988.
10. H.-L. Chi, S.-C. Kang, and X. Wang. Research Trends and Opportunities of Augmented Reality Applications in Architecture, Engineering, and Construction. Automation in Construction, 33:116-122, 2013.
11. M. A. Cidota, R. M. Clifford, S. G. Lukosch, and M. Billinghurst. Using Visual Effects to Facilitate Depth Perception for Spatial Tasks in Virtual and Augmented Reality. In Proceedings of the International Symposium on Mixed and Augmented Reality (ISMAR) 2016, pages 172-177, 2016.
12. Z. Cipiloglu, A. Bulbul, and T. Capin. A framework for enhancing depth perception in computer graphics. In Proceedings of the 7th Symposium on Applied Perception in Graphics and Visualization, pages 141-148. ACM, 2010.
13. J. Cutting and P. Vishton. Perception of space and motion. handbook of perception and cognition, 1995.
14. A. Dey, G. Jarvis, C. Sandor, and G. Reitmayr. Tablet versus Phone: Depth Perception in Handheld Augmented Reality. In Proceedings of the International Symposium on Mixed and Augmented Reality (ISMAR) 2012, pages 187-196, 2012.
15. A. Dey and C. Sandor. Lessons learned: Evaluating Visualizations for Occluded Objects in Handheld Augmented Reality. International Journal of Human-Computer Studies, 72(10):704-716, 2014.
16. J. Díaz, T. Ropinski, I. Navazo, E. Gobbetti, and P.-P. Vázquez. An Experimental Study on the Effects of Shading in 3D Perception of Volumetric Models. The Visual Computer, pages 1-15, 2015.
17. D. Drascic and P. Milgram. Perceptual Issues in Augmented Reality. In Electronic Imaging: Science & Technology, pages 123-134. International Society for Optics and Photonics, 1996.
18. A. Dünser, R. Grasset, and M. Billinghurst. A Survey of Evaluation Techniques used in Augmented Reality Studies. Human Interface Technology Laboratory New Zealand, 2008.
19. S. R. Ellis and U. J. Bucher. Distance perception of stereoscopically presented virtual objects optically superimposed on physical objects by a head-mounted see-through display. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, volume 38, pages 1300-1304. SAGE Publications, 1994.
20. S. R. Ellis, U. J. Bucher, and B. M. Menges. The Relationship of Binocular Convergence and Errors in Judged Distance to Virtual Objects. In Proceedings of the International Federation of Automatic Control, volume 95, pages 297-301, 1995.
21. S. R. Ellis and B. M. Menges. Localization of Virtual Objects in the Near Visual Field. Human Factors: The Journal of the Human Factors and Ergonomics Society, 40(3):415-431, 1998.
22. H. Fang, S. Ong, and A. Nee. Interactive Robot Trajectory Planning and Simulation using Augmented Reality. Robotics and Computer- Integrated Manufacturing, 28(2):227-237, 2012.
23. A. R. Fernandes. Billboarding Tutorial, 2001. http://lighthouse3d. com/opengl/billboarding/billboardingtut.pdf.
24. C. Furmanski, R. Azuma, and M. Daily. Augmented-reality Visualizations Guided by Cognition: Perceptual Heuristics for Combining Visible and Obscured Information. In Proceedings of the International Symposium on Mixed and Augmented Reality (ISMAR) 2002, pages 215-320. IEEE, 2002.
25. B. Gillam. The perception of spatial layout from static optical information. Perception of space and motion, pages 23-67, 1995.
26. T. Hartzell, M. Thompson, and B. Kim. The influence of graphics effects on perceiving depth in minimized virtual environments. In Computer Applications for Communication, Networking, and Digital Contents, pages 235-242. Springer, 2012.
27. M. Hedrich, M. Bloj, and A. I. Ruppertsberg. Color constancy improves for real 3d objects. Journal of Vision, 9(4):16-16, 2009.
28. M. Hou. User experience with alignment of real and virtual objects in a stereoscopic augmented reality interface. In Proceedings of the 2001 Conference of the Centre for Advanced Studies on Collaborative Research, page 6. IBM Press, 2001.
29. I. P. Howard and B. J. Rogers. Seeing in depth, volume 2: Depth perception. Ontario, Canada: I. Porteous, 2002.
30. J. Jacobson and S. Werner. Why Cast Shadows are Expendable: Insensitivity of Human Observers and the Inherent Ambiguity of Cast Shadows in Pictorial Art. Perception, 33(11):1369-1383, 2004.
31. C. Jerome and B.Witmer. The Perception and Estimation of Egocentric Distance in Real and Augmented Reality Environments. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, volume 49, pages 2249-2252, 2005.
32. P. Kán and H. Kaufmann. High-quality Reflections, Refractions, and Caustics in Augmented Reality and their Contribution to Visual Coherence. In Proceedings of the International Symposium on Mixed and Augmented Reality (ISMAR) 2012, pages 99-108. IEEE, 2012.
33. D. Kersten. Inverse 3-d graphics: A metaphor for visual perception. Behavior Research Methods, Instruments, & Computers, 29(1):37-46, 1997.
34. M. Kersten, J. Stewart, N. Troje, and R. Ellis. Enhancing depth perception in translucent volumes. IEEE Transactions on Visualization and Computer Graphics, 12(5), 2006.
35. S. E. H. Kirkley Jr. Augmented Reality Performance Assessment Battery (ARPAB): Object Recognition, Distance Estimation and Size Estimation using Optical See-through Head-worn Displays. 2003.
36. C. Koch, M. Neges, M. König, and M. Abramovici. Natural Markers for Augmented Reality-based Indoor Navigation and Facility Maintenance. Automation in Construction, 48:18-30, 2014.
37. E. Kruijff, J. E. Swan, and S. Feiner. Perceptual Issues in Augmented Reality Revisited. In Proceedings of the International Symposium on Mixed and Augmented Reality (ISMAR) 2010, pages 3-12. IEEE, 2010.
38. D. R. Lampton, D. P. McDonald, M. Singer, and J. P. Bliss. Distance Estimation in Virtual Environments. In Proceedings of the Human Factors and Ergonomics Society Annual Meetings, volume 39, pages 1268-1272, 1995.
39. M. S. Langer and H. H. Bülthoff. A prior for global convexity in local shape-from-shading. Perception, 30(4):403-410, 2001.
40. F. Lindemann and T. Ropinski. About the influence of illumination models on image comprehension in direct volume rendering. IEEE Transactions on Visualization and Computer Graphics, 17(12):1922- 1931, 2011.
41. M. A. Livingston, Z. Ai, K. Karsch, and G. O. Gibson. User Interface Design for Military AR Applications. Virtual Reality, 15(2-3):175-184, 2011.
42. M. A. Livingston, Z. Ai, J. E. Swan, and H. S. Smallman. Indoor vs. Outdoor Depth Perception for Mobile Augmented Reality. In IEEE Virtual Reality Conference, pages 55-62, 2009.
43. M. A. Livingston, A. Dey, C. Sandor, and B. H. Thomas. Pursuit of "X-ray vision" for Augmented Reality. In Human Factors in Augmented Reality Environments, pages 67-107. 2013.
44. M. A. Livingston, J. E. Swan II, J. L. Gabbard, T. H. Höllerer, D. Hix, S. J. Julier, Y. Baillot, and D. Brown. Resolving Multiple Occluded Layers in Augmented Reality. In Proceedings of the International Symposium on Mixed and Augmented Reality (ISMAR) 2016, page 56. IEEE, 2003.
45. J. M. Loomis and J. M. Knapp. Visual Perception of Egocentric Distance in Real and Virtual Environments. Virtual and Adaptive Environments, 11:21-46, 2003.
46. P. Mamassian, D. C. Knill, and D. Kersten. The perception of cast shadows. Trends in Cognitive Sciences, 2(8):288-295, 1998.
47. G. Mather and D. R. Smith. Combining depth cues: effects upon accuracy and speed of performance in a depth-ordering task. Vision Research, 44(6):557-562, 2004.
48. J. W. McCandless, S. R. Ellis, and B. D. Adelstein. Localization of a Time-delayed, Monocular Virtual Object Superimposed on a Real Environment. Presence, 9(1):15-24, 2000.
49. D. Medeiros, M. Sousa, D. Mendes, A. Raposo, and J. Jorge. Perceiving Depth: Optical Versus Video See-Through. In ACM Conference on Virtual Reality Software and Technology, pages 237-240, 2016.
50. M. Mikkola, A. Boev, and A. Gotchev. Relative importance of depth cues on portable autostereoscopic display. In Proceedings of the 3rd Workshop on Mobile Video Delivery, pages 63-68. ACM, 2010.
51. A. Nee, S. Ong, G. Chryssolouris, and D. Mourtzis. Augmented Reality Applications in Design and Manufacturing. CIRP Annals- Manufacturing Technology, 61(2):657-679, 2012.
52. J. F. Norman, J. T. Todd, and G. A. Orban. Perception of threedimensional shape from specular highlights, deformations of shading, and other types of visual information. Psychological Science, 15(8):565-570, 2004.
53. I. Oruç, L. T. Maloney, and M. S. Landy. Weighted linear cue combination with possibly correlated error. Vision Research, 43(23):2451-2468, 2003.
54. R. P. O'shea, S. G. Blackburn, and H. Ono. Contrast as a Depth Cue. Vision Research, 34(12):1595-1604, 1994.
55. B. T. Phong. Illumination for Computer Generated Pictures. Communications of the ACM, 18(6):311-317, 1975.
56. A. G. Rempel, W. Heidrich, and R. Mantiuk. The role of contrast in the perceived depth of monocular imagery. In Proceedings of the Symposium on Applied Perception in Graphics and Visualization, pages 115-115. ACM, 2011.
57. J. P. Rolland, W. Gibson, and D. Ariely. Towards Quantifying Depth and Size Perception in Virtual Environments. Presence: Teleoperators & Virtual Environments, 4(1):24-49, 1995.
58. J. P. Rolland, C. Meyer, K. Arthur, and E. Rinalducci. Method of Adjustments versus Method of Constant Stimuli in the Quantification of Accuracy and Precision of Rendered Depth in Head-Mounted Displays. Presence: Teleoperators and Virtual Environments, 11(6):610-625, 2002.
59. M. E. C. Santos, I. de Souza Almeida, G. Yamamoto, T. Taketomi, C. Sandor, and H. Kato. Exploring Legibility of Augmented Reality X-ray. Multimedia Tools and Applications, 75(16):9563-9585, 2016.
60. M. Sattler, R. Sarlette, T. Mücken, and R. Klein. Exploitation of Human Shadow Perception for Fast Shadow Rendering. In Proceedings of the Symposium on Applied Perception in Graphics and Visualization, pages 131-134. ACM, 2005.
61. M. Segal and K. Akeley. The OpenGL Graphics Interface. California: Silicon Graphics Systems, 1994.
62. P. Shirley, M. Ashikhmin, and S. Marschner. Fundamentals of Computer Graphics. CRC Press, 2015.
63. G. Singh, J. E. Swan II, J. A. Jones, and S. R. Ellis. Depth Judgment Measures and Occluding Surfaces in Near-field Augmented Reality. In Proceedings of the 7th Symposium on Applied Perception in Graphics and Visualization, pages 149-156. ACM, 2010.
64. M. Stone, D. A. Szafir, and V. Setlur. An engineering model for color difference as a function of size. In Color and Imaging Conference, volume 2014, pages 253-258. Society for Imaging Science and Technology, 2014.
65. N. Sugano, H. Kato, and K. Tachibana. The Effects of Shadow Representation of Virtual Objects in Augmented Reality. In Proceedings of the International Symposium on Mixed and Augmented Reality (ISMAR) 2003, pages 76-83. IEEE, 2003.
66. R. T. Surdick, E. T. Davis, R. A. King, and L. F. Hodges. The perception of distance in simulated visual displays: A comparison of the effectiveness and accuracy of multiple depth cues across viewing distances. Presence: Teleoperators and Virtual Environments, 6(5):513-531, 1997.
67. I. E. Sutherland. The Ultimate Display. Proceedings of the International Information Security and Privacy Conference Congress, 65(2):506-508, 1965.
68. J. E. Swan and J. L. Gabbard. Survey of User-based Experimentation in Augmented Reality. In Proceedings of the International Conference on Virtual Rehabilitation 2005, pages 1-9, 2005.
69. J. E. Swan, A. Jones, E. Kolstad, M. A. Livingston, and H. S. Small- man. Egocentric Depth Judgments in Optical, See-through Augmented Reality. IEEE Transactions on Visualization and Computer Graphics, 13(3):429-442, 2007.
70. J. E. Swan, G. Singh, and S. R. Ellis. Matching and Reaching Depth Judgments with Real and Augmented Reality Targets. IEEE Transactions on Visualization and Computer Graphics, 21(11):1289-1298, 2015.
71. J. E. Swan II, L. Kuparinen, S. Rapson, and C. Sandor. Visually Perceived Distance Judgments: Tablet-Based Augmented Reality Versus the RealWorld. International Journal of Human-Computer Interaction, pages 1-16, 2017.
72. W. Thompson, R. Fleming, S. Creem-Regehr, and J. K. Stefanucci. Visual perception from a computer graphics perspective. CRC Press, 2011.
73. W. B. Thompson, P. Willemsen, A. A. Gooch, S. H. Creem-Regehr, J. M. Loomis, and A. C. Beall. Does the Quality of the Computer Graphics Matter when Judging Distances in Visually Immersive Environments? Presence, 13(5):560-571, 2004.
74. J. T. Todd, J. F. Norman, J. J. Koenderink, and A. M. Kappers. Effects of texture, illumination, and surface reflectance on stereoscopic shape perception. Perception, 26(7):807-822, 1997.
75. K. Uratani, T. Machida, K. Kiyokawa, and H. Takemura. A study of depth visualization techniques for virtual annotations in augmented reality. In Virtual Reality, pages 295-296. IEEE, 2005.
76. J. Wang, H. Suenaga, K. Hoshi, L. Yang, E. Kobayashi, I. Sakuma, and H. Liao. Augmented Reality Navigation with Automatic Marker-free Image Registration using 3-D Image Overlay for Dental Surgery. IEEE Transactions on Biomedical Engineering, 61(4):1295-1304, 2014.
77. P. Willemsen, M. B. Colton, S. H. Creem-Regehr, and W. B. Thompson. The Effects of Head-mounted Display Mechanics on Distance Judgments in Virtual Environments. In Proceedings of the Symposium for Applied Perception in Graphics and Visualization, pages 35-38, New York, NY, USA, 2004. ACM.
78. B. G. Witmer and P. B. Kline. Judging Perceived and Traversed Distance in Virtual Environments. Presence, 7(2):144-167, 1998.
79. B. G. Witmer and W. J. Sadowski. Nonvisually Guided Locomotion to a Previously Viewed Target in Real and Virtual Environments. Human Factors: The Journal of the Human Factors and Ergonomics Society, 40(3):478-488, 1998.
80. B. Wu, T. L. Ooi, and Z. J. He. Perceiving Distance Accurately by a Directional Process of Integrating Ground Information. Nature, 428(6978):73-77, 2004.
81. A. Yonas, L. T. Goldsmith, and J. L. Hallstrom. Development of sensitivity to information provided by cast shadows in pictures. Perception, 7(3):333-341, 1978.
82. L. Zheng, Y. Wu, and K.-L. Ma. Perceptually-based depth-ordering enhancement for direct volume rendering. IEEE Transactions on Visualization and Computer Graphics, 19(3):446-459, 2013.
83. S. Zollmann, C. Hoppe, T. Langlotz, and G. Reitmayr. FlyAR: Augmented Reality Supported Micro Aerial Vehicle Navigation. IEEE Transactions on Visualization and Computer Graphics, 20(4):560-568, 2014.