Stereoscopic depth perception in video see-through augmented reality within action space

Journal of Electronic Imaging

Volumn 23, Issue 1, 2014, Pages

  Kyto, Mikko ^a   Makinen, Aleksi ^a   Tossavainen, Timo ^a   Oittinen, Pirkko ^a  

^a AALTO UNIVERSITY   (Finland)

Author keywords

action space.; augmented reality; depth perception; head mounted display; stereoscopy

Indexed keywords

BINOCULARS; DEPTH PERCEPTION; HELMET MOUNTED DISPLAYS;

ACTION SPACES; AUGMENTED REALITY APPLICATIONS; BINOCULAR DISPARITY; HEAD MOUNTED DISPLAYS; STEREOSCOPIC DEPTH PERCEPTION; STEREOSCOPIC PERCEPTIONS; STEREOSCOPIC VIDEO; STEREOSCOPY;

AUGMENTED REALITY;

EID: 84896376782     PISSN: 10179909     EISSN: 1560229X     Source Type: Journal    
DOI: 10.1117/1.JEI.23.1.011006     Document Type: Article

References (61)

1. J. E. Cutting and P. M. Vishton, "Perceiving layout and knowing distances: the integration, relative potency, and contextual use of different information about depth," in Handbook of Perception and Cognition, W. Epstein and S. Rogers, Eds., Vol. 5, pp. 69-117, Academic Press, San Diego, CA (1995).
2. J. P. Rolland et al., "Method of adjustments versus method of constant stimuli in the quantification of accuracy and precision of rendered depth in head-mounted displays," Presence 11(6), 610-625 (2002).
3. T. Oskam et al., "Fast and stable color balancing for images and augmented reality," in Int. Conf. 3D Imaging, Modeling, Processing, Visualization & Transmission, pp. 49-56, IEEE Computer Society, Washington, DC (2012).
4. L. Xueting and T. Ogawa, "A depth cue method based on blurring effect in augmented reality," in Augmented Human Int. Conf., pp. 81-88, ACM Press, New York (2013).
5. J. P. Rolland and H. Fuchs, "Optical versus video see-through headmounted displays in medical visualization," Presence 9(3), 287-309 (2000).
6. A. Takagi et al., "Development of a stereo video see-through HMD for AR systems," in IEEE and ACM Int. Symposium on Augmented Reality, pp. 68-77, IEEE Computer Society, Washington, DC (2000).
7. M. A. Livingston et al., "Resolving multiple occluded layers in augmented reality," in IEEE/ACM Int. Symposium on Mixed and Augmented Reality, Washington, DC, pp. 56-65, IEEE Computer Society, Tokyo (2003).
8. J. Wither and T. Hollerer, "Pictorial depth cues for outdoor augmented reality," in IEEE Int. Symposium on Wearable Computers, Osaka, pp. 92-99, IEEE Computer Society, Washington, DC (2005). (Pubitemid 44867500)
9. J. E. Swan, II et al., "A perceptual matching technique for depth judgments in optical, see-through augmented reality," in Virtual Reality Conf., pp. 19-26, IEEE Computer Society, Washington, DC (2006).
10. J. Swan II, A. Jones, and E. Kolstad, "Egocentric depth judgments in optical, see-through augmented reality," IEEE Trans. Visual. Comput. Graph. 13(3), 429-442 (2007). (Pubitemid 46479762)
11. J. A. Jones et al., "The effects of virtual reality, augmented reality, and motion parallax on egocentric depth perception," in Symp. Appl. Percept. Graph. Visual., pp. 9-14, ACM, New York (2008).
12. M. A. Livingston et al., "Indoor vs. outdoor depth perception for mobile augmented reality," in IEEE Virtual Reality Conf., pp. 55-62, IEEE Computer Society, Washington, DC (2009).
13. T. Y. Grechkin et al., "How does presentation method and measurement protocol affect distance estimation in real and virtual environments?" ACM Trans. Appl. Percept. 7(4), 1-18 (2010).
14. A. Dey, A. Cunningham, and C. Sandor, "Evaluating depth perception of photorealistic mixed reality visualizations for occluded objects in outdoor environments," in ACM Symposium on Virtual Reality Software and Technology, pp. 211-218, ACM, New York (2010).
15. A. Dey et al., "Tablet versus phone: depth perception in handheld augmented reality," in IEEE Int. Symposium on Mixed and Augmented Reality, pp. 187-196, IEEE Computer Society,Washington, DC (2012).
16. S. Nagata, "How to reinforce perception of depth in single two-dimensional pictures," in Pictorial Communication in Virtual and Real Environments, S. R. Ellis, M. K. Kaiser, and A. C. Grunwald, Eds., pp. 527-544, Taylor & Francis, Mahwah, New Jersey (1991).
17. J. P. Rolland et al., "Quantification of adaptation to virtual-eye location in see-thru head-mounted displays," in Proc. Virtual Reality Annual Int. Symposium '95, pp. 56-66, IEEE Computer Society, Washington, DC (1995).
18. S. R. Ellis and B. M. Menges, "Localization of virtual objects in the near visual field," Hum. Factors 40(3), 415-431 (1998). (Pubitemid 28551220)
19. V. Jurgens, A. Cockburn, and M. Billinghurst, "Depth cues for augmented reality stakeout," in Proc. 7th ACM SIGCHI New Zealand Chapter's Int. Conf. Computer-Human Interaction: Design Centered HCI, pp. 117-124, ACM, New York (2006). (Pubitemid 47140902)
20. M. A. Livingston, A. Zhuming, and J.W. Decker, "A user study towards understanding stereo perception in head-worn augmented reality displays," in IEEE Int. Symposium on Mixed and Augmented Reality, pp. 53-56, IEEE Computer Society, Washington, DC (2009).
21. G. Singh, J. E. Swan, II, and J. A. Jones, "Depth judgment measures and occluding surfaces in near-field augmented reality," in Symp. Appl. Percept. Graph. Visual., pp. 149-156, ACM, New York (2010).
22. R. S. Allison, B. J. Gillam, and E. Vecellio, "Binocular depth discrimination and estimation beyond interaction space," J. Vision 9(1), 10.1-14 (2009).
23. E. Kruijff, J. E. Swan, and S. Feiner, "Perceptual issues in augmented reality revisited," in IEEE Int. Symposium on Mixed and Augmented Reality, Seoul, pp. 3-12, IEEE Computer Society, Washington, DC (2010).
24. M. Kytö et al., "Improving relative depth judgments in augmented reality with auxiliary augmentations," ACM Trans. Appl. Percept. 10(1), 1-22 (2013).
25. T. L. Ooi, B. Wu, and Z. J. He, "Distance determined by the angular declination below the horizon," Nature 414(6860), 197-200 (2001). (Pubitemid 33051232)
26. C. M. Schor, "Spatial constraints of stereopsis in video displays," in Pictorial Communication in Virtual and Real Environments, S. R. Ellis, Ed., pp. 546-557, Taylor & Francis, Bristol, PA (1993).
27. I. P. Howard and B. J. Rogers, Perceiving in Depth. Volume 2: Stereoscopic Vision, p. 635, Oxford University Press, New York (2012).
28. C. Schor and I.Wood, "Disparity range for local stereopsis as a function of luminance spatial frequency," Vision Res. 23(12), 1649-1654 (1983). (Pubitemid 14222118)
29. M. Lambooij et al., "Visual discomfort and visual fatigue of stereoscopic displays: a review," J. Imaging Sci. Technol. 53(3), 030201 (2009).
30. T. Shibata et al., "The zone of comfort: predicting visual discomfort with stereo displays," J. Vision 11(8), 11:1-29 (2011).
31. J. M. Foley, "Binocular distance perception," Psychol. Rev. 87(5), 411-434 (1980).
32. K. W. Arthur, "Effects of field of view on performance with headmounted displays," Doctoral Dissertation, University of North Carolina (2000).
33. J. Gibson, The Perception of the Visual World, p. 235, Houghton Mifflin, Oxford, England (1950).
34. Z. Bian and G. J. Andersen, "Environmental surfaces and the compression of perceived visual space," J. Vision 11(7), 1-14 (2011).
35. W. B. Thompson, V. Dilda, and S. H. Creem-Regehr, "Absolute distance perception to locations off the ground plane," Perception 36(11), 1559-1571 (2007).
36. Z. Yang and D. Purves, "A statistical explanation of visual space," Nat. Neurosci. 6(6), 632-640 (2003). (Pubitemid 36648805)
37. B. Wu, T. L. Ooi, and J. H. Zijiang, "Perceiving distance accurately by a directional process of integrating ground information," Nature 428, 73-77 (2004).
38. J. M. Knapp and J. M. Loomis, "Limited field of view of head-mounted displays is not the cause of distance underestimation in virtual environments," Presence Teleoperators Virtual Environ. 13(5), 572-577 (2004). (Pubitemid 39580071)
39. S. H. Creem-Regehr et al., "The influence of restricted viewing conditions on egocentric distance perception: implications for real and virtual environments," Perception 34(2), 191-204 (2005). (Pubitemid 40482629)
40. P. Burt and B. Julesz, "A disparity gradient limit for binocular fusion," Science 208(4444), 615-617 (1980). (Pubitemid 10041980)
41. L. R. Wanger, J. A. Ferwerda, and D. P. Greenberg, "Perceiving spatial relationships in computer-generated images," IEEE Comput. Graph. Appl. 12(3), 44-58 (1992).
42. G. S. Hubona et al., "The relative contributions of stereo, lighting, and background scenes in promoting 3D depth visualization," ACM Trans. Comput. Hum. Interaction (TOCHI) 6(3), 214-242 (1999).
43. N. Sugano, H. Kato, and K. Tachibana, "The effects of shadow representation of virtual objects in augmented reality," in IEEE and ACM Int. Symposium on Mixed and Augmented Reality, Tokyo, pp. 76-83, IEEE Computer Society, Washington, DC (2003).
44. E. R. Tufte, The Visual Display of Quantitative Information, Graphics Press, Cheshire, CT (1983).
45. H. Egusa, "Effects of brightness, hue, and saturation on perceived depth between adjacent regions in the visual field," Perception 12(2), 167-175 (1983).
46. J. J. Vos, "The color stereoscopic effect," Vision Res. 6(1), 105-107 (1966).
47. R. Sousa, J. B. J. Smeets, and E. Brenner, "The effect of variability in other objects' sizes on the extent to which people rely on retinal image size as a cue for judging distance," J. Vision 12(10), 6:1-8 (2012).
48. W. B. Thompson et al., "Does the quality of the computer graphics matter when judging distances in visually immersive environments?," Presence Teleoperators Virtual Environ. 13(5), 560-571 (2004). (Pubitemid 39580070)
49. H. Bay, T. Tuytelaars, and L. Van Gool, "Surf: speeded up robust features," in Computer Vision ECCV 2006, Vol. 3951, pp. 404-417, Springer, Berlin (2006). (Pubitemid 44029795)
50. R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, Cambridge University Press, Cambridge, United Kingdom (2000).
51. N. Snavely, S. M. Seitz, and R. Szeliski, "Photo tourism: exploring photo collections in 3D," ACM Trans. Graph. 25(3), 835-846 (2006). (Pubitemid 44481045)
52. J. Shi and C. Tomasi, "Good features to track," in Proc. CVPR'94, pp. 593-600, IEEE Computer Society, Washington, DC (1994).
53. G. Kleinand and D. Murray, "Parallel tracking and mapping for small AR workspaces," in IEEE and ACM Int. Symposium on Mixed and Augmented Reality, pp. 1-10, IEEE Computer Society, Washington, DC (2007).
54. P. Willemsen et al., "Effects of stereo viewing conditions on distance perception in virtual environments," Presence Teleoperators Virtual Environ. 17(1), 91-101 (2008).
55. H. J. Howard, "A test for the judgment of distance," Trans. Am. Ophthalmol. Soc. 17, 195-235 (1919).
56. Bernell, "Howard-Dolman Type Test," http://www.bernell.com/ product/2013/126 (4 April 2013).
57. B. I. Wilner, F. W. Weymouth, and M. J. Hirsch, "Influence of initial position of rods in Howard-Dolman test," Arch. Ophthalmol. 44(3), 365-369 (1950).
58. D. L. Halpern and R. B. Blake, "How contrast affects stereoacuity," Perception 17(4), 483-495 (1988). (Pubitemid 19060799)
59. R. P. O'Shea, S. G. Blackburn, and H. Ono, "Contrast as a depth cue," Vision Res. 34(12), 1595-1604 (1994). (Pubitemid 24159951)
60. M. Hou, "User experience with alignment of real and virtual objects in a stereoscopic augmented reality interface," in Centre for Advanced Studies on Collaborative Research, p. 6, ACM, New York (2001).
61. J. W. McCandless, S. R. Ellis, and B. D. Adelstein, "Localization of a time-delayed, monocular virtual object superimposed on a real environment," Presence (Cambridge, Mass.) 9(1), 15-24 (2000).