Improving relative depth judgments in augmented reality with auxiliary augmentations

ACM Transactions on Applied Perception

Volumn 10, Issue 1, 2013, Pages

  Kytö, Mikko ^a   Mäkinen, Aleksi ^a   Häkkinen, Jukka ^a   Oittinen, Pirkko ^a  

^a AALTO UNIVERSITY   (Finland)

Author keywords

Design; Experimentation; Human factors; Performance

Indexed keywords

BINOCULAR DISPARITY; DEPTH CUE; EXPERIMENTATION; GRAPHICAL OBJECTS; MOTION PARALLAX; PERFORMANCE; REAL-WORLD OBJECTS; RELATIVE SIZES;

AUGMENTED REALITY; DESIGN; ERRORS; GEOMETRICAL OPTICS; HUMAN ENGINEERING;

VISUALIZATION;

EID: 84874857381     PISSN: 15443558     EISSN: 15443965     Source Type: Journal    
DOI: 10.1145/2422105.2422111     Document Type: Article

References (68)

1. ALLISON, R., GILLAM, B., AND VECELLIO, E. 2009. Binocular depth discrimination and estimation beyond interaction space. J. Vision 9, 1, 10, 1-14.
2. AVERY, B., SANDOR, C., AND THOMAS, B. H. 2009. Improving spatial perception for augmented reality X-ray vision. In Proceedings of the Virtual Reality Conference. IEEE, Los Alamitos, CA, 79-82.
3. AVERY, B., THOMAS, B. H., AND PIEKARSKI, W. 2008. User evaluation of see-through vision for mobile outdoor augmented reality. In Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality (ISMAR '08) IEEE, Los Alamitos, CA, 69-72.
4. BANE, R. AND HOLLERER, T. 2004. Interactive tools for virtual X-ray vision in mobile augmented reality. In Proceedings of the 3rd IEEE/ACM International Symposium on Mixed and Augmented Reality (ISMAR '04), IEEE, Los Alamitos, CA, 231-239. (Pubitemid 40682404)
5. BIRKFELLNER, W., FIGL, M., HUBER, K., WATZINGER, F., WANSCHITZ, F., HUMMEL, J., HANEL, R., GREIMEL, W., HOMOLKA, P., EWERS, R., AND BERGMANN, H. 2002. A head-mounted operating binocular for augmented reality visualization in medicine - Design and initial evaluation. IEEE Trans. Medical Imag. 21, 8, 991-997. (Pubitemid 35476602)
6. COLLETT, T. S. 1985. Extrapolating and interpolating surfaces in depth. In Proc. Royal Soc. London. Series B. Biol. Sci. 224, 1234, 43-56.
7. CUTTING, J. E. AND VISHTON, P. M. 1995. Perceiving layout and knowing distances: The integration, relative potency, and contextual use of different information about depth. In Handbook of Perception and Cognition, W. Epstein and S. Rogers Eds., vol. 5, Academic Press, San Diego, CA., 69-117.
8. DE SILVA, V., FERNANDO, A., WORRALL, S., ARACHCHI, H. K., AND KONDOZ, A. 2011. Sensitivity analysis of the human visual system for depth cues in stereoscopic 3-D displays. IEEE Trans. Multimedia 13, 3, 498-506.
9. DEY, A., CUNNINGHAM, A., AND SANDOR, C. 2010. Evaluating depth perception of photorealistic mixed reality visualizations for occluded objects in outdoor environments. In Proceedings of the 17th ACM Symposium on Virtual Reality Software and Technology (VRST '10). 211-218.
10. DRASCIC, D. AND MILGRAM, P. 1991. Pointing accuracy of a virtual stereographic pointer in a real stereoscopic video world. In Proceedings of the SPIE Stereoscopic Displays and Applications II. Vol. 1457, 623-626.
11. DRASCIC, D. AND MILGRAM, P. 1996. Perceptual Issues in augmented reality. In Proceedings of the SPIE Stereoscopic Displays and Applications. Vol. 2653, 123-134.
12. ELLIS, S. R. AND MENGES, B. M. 1998. Localization of virtual objects in the near visual field. Hum. Factors 40, 3, 415-431. (Pubitemid 28551220)
13. ERKELENS, C. J. AND COLLEWIJN, H. 1985. Motion perception during dichoptic viewing of moving random-dot stereograms. Vision Res. 25, 4, 583-588. (Pubitemid 15115549)
14. FAUBERT, J. 2001. Motion parallax, stereoscopy, and the perception of depth: Practical and theoretical issue. In Proceedings of the SPIE on Three-Dimensional Video and Display: Devices and Systems. 168-191.
15. FEINER, S., WEBSTER, A., KRUEGER, T., MACINTYRE, B., AND KELLER, E. 1995. Architectural Anatomy. Presence: Teleoper. Virtual Environ. 4, 3, 318-325.
16. FOLEY, J. M. 1991. Stereoscopic distance perception. In Pictorial Communication in Real and Virtual Environments, S. Ellis et al. Eds., Taylor & Francis.
17. FURMANSKI, C., AZUMA, R., AND DAILY, M. 2002. Augmented-reality visualizations guided by cognition: perceptual heuristics for combining visible and obscured information. In Proceedings of the International Symposium on Mixed and Augmented Reality. IEEE, Los Alamitos, CA, 215-225.
18. GILINSKY, A. S. 1951. Perceived size and distance in visual space. Psychol. Rev. 58, 460-482.
19. GRECHKIN, T. Y., NGUYEN, T. D., PLUMERT, J. M., CREMER, J. F., AND KEARNEY, J. K. 2010. How does presentation method and measurement protocol affect distance estimation in real and virtual environments? ACM Trans. Appl. Percept. 7, 4, 1-18.
20. HÄKKINEN, J. AND NYMAN, G. 1996. Depth asymmetry in Da Vinci stereopsis. Vision Res. 36, 23, 3815-3819. (Pubitemid 26390392)
21. HOWARD, H. J. 1919. A test for the judgment of distance. Trans. Amer. Ophthalmological Soc. 17, 195-235.
22. HUBONA, G. S., WHEELER, P. N., SHIRAH, G.W., AND BRANDT, M. 1999. The relative contributions of stereo, lighting, and background scenes in promoting 3D depth visualization. ACM Trans. Comput.-Hum. Interact. 6, 3, 214-242.
23. IMAGE ENGINEERING. 2012. LED-PANEL. http://www.imageengineering.de/index. php?option=comcontent&view=article&id=76&Itemid=68.
24. JOHNSTON, E. B. 1991. Systematic distortions of shape from stereopsis. Vision Res. 31, 7-8, 1351-1360.
25. JURGENS, V., COCKBURN, A., AND BILLINGHURST, M. 2006. Depth cues for augmented reality stakeout. In Proceedings of the 7th ACM SIGCHI New Zealand Chapter International Conference on Computer-Human Interaction: Design Centered HCI (CHINZ '06). ACM, New York, 117-124. (Pubitemid 47140902)
26. KANIZSA, G. 1979. Organization in Vision: Essays on Gestalt Perception. Praeger, New York.
27. KRUIJFF, E., SWAN, J., AND FEINER, S. 2010. Perceptual issues in augmented reality revisited. In Proceedings of the 9th IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, Los Alamitos, CA, 3-12.
28. KYTÖ, M., HÄKKINEN, J., AND OITTINEN, P. 2011. Stereoscopic viewing facilitates the perception of crowds. In Proceedings of the IEEE International Conference on Advanced Video and Signal-Based Surveillance (AVSS). IEEE, Los Alamitos, 49-53.
29. KYTÖ, M., NUUTINEN, M., AND OITTINEN, P. 2011. Method for measuring stereo camera depth accuracy based on stereoscopic vision. In SPIE/IS&T Electronic Imaging Three-Dimensional Imaging, Interaction, and Measurement. Vol. 7864, 1-9.
30. LAMBOOIJ, M., IJSSELSTEIJN, W., FORTUIN, M., AND HEYNDERICKX, I. 2009. Visual discomfort and visual fatigue of stereoscopic displays: A review. J. Imag. Sci. Technol. 53, 3, 030201-14.
31. LANDY, M. S., MALONEY, L. T., JOHNSTON, E. B., AND YOUNG, M. 1995. Measurement and modeling of depth cue combination: in defense of weak fusion. Vision Res. 35, 3, 389-412.
32. LIU, Y., BOVIK, A. C., AND CORMACK, L. K. 2008. Disparity statistics in natural scenes. J. Vision 8, 11, 19, 1-14.
33. LIVINGSTON, M., ZHUMING, A., AND DECKER, J. 2009. A user study towards understanding stereo perception in head-worn augmented reality displays. In Proceedings of the IEEE International Symposium on Mixed and Augmented Reality. IEEE, Los Alamitos, CA, 53-56.
34. LIVINGSTON, M. A., SWAN, J. E., II., GABBARD, J. L., HÖLLERER, T. H., HIX, D., JULIER, S. J., BAILLOT, Y., AND BROWN, D. 2003. Resolving multiple occluded layers in augmented reality. In Proceedings of the 2nd IEEE/ACM International Symposium on Mixed and Augmented Reality. IEEE, Los Alamitos, CA, 56-65.
35. LOOMIS, J. M., DA SILVA, J. A., FUJITA, N., AND FUKUSIMA, S. S. 1992. Visual space perception and visually directed action. J. Experiment. Psychol. Human Percept. Perform. 18, 4, 906-921.
36. MCCANDLESS, J.W., ELLIS, S. R., AND ADELSTEIN, B. D. 2000. Localization of a time-delayed, monocular virtual object superimposed on a real environment. Presence 9, 1, 15-24.
37. MCKEE, S. P. AND TAYLOR, D. G. 2010. The precision of binocular and monocular depth judgments in natural settings. J. Vision 10, 5, 1-13.
38. NAGATA, S. 1991. How to reinforce perception of depth in single two-dimensional pictures. In Pictorial Communication in Virtual and Real Environments, S. R. Ellis Eds., Taylor & Francis, 527-544.
39. NAKAYAMA, K. 1996. Binocular visual surface perception. In Proc. Nat. Acad. Sci. 93, 2, 634-639. (Pubitemid 26041140)
40. NAKAYAMA, K., SHIMOJO, S., AND SILVERMAN, G. H. 1989. Stereoscopic depth: Its relation to image segmentation, grouping, and the recognition of occluded objects. Perception 18, 1, 55-68. (Pubitemid 19187194)
41. NAPIERALSKI, P. E., ALTENHOFF, B. M., BERTRAND, J. W., LONG, L. O., BABU, S. V., PAGANO, C. C., KERN, J., AND DAVIS, T. A. 2011. Near-field distance perception in real and virtual environments using both verbal and action responses. ACM Trans. Appl. Percept. 8, 3, 1-19.
42. OOI, T. L., WU, B., AND HE, Z. J. 2001. Distance determined by the angular declination below the horizon. Nature 414, 6860, 197-200. (Pubitemid 33051232)
43. OPENCV. 2011. Version 2.3. http://opencv.willowgarage.com/.
44. O'SHEA, R. P., BLACKBURN, S. G., AND ONO, H. 1994. Contrast as a depth cue. Vision Res. 34, 12, 1595-1604. (Pubitemid 24159951)
45. PALMISANO, S., GILLAM, B., GOVAN, D. G., ALLISON, R. S., AND HARRIS, J. M. 2010. Stereoscopic perception of real depths at large distances. J. Vision 10, 6, 19, 1-16.
46. PETERSON, S., AXHOLT, M., AND ELLIS, S. R. 2008. Managing visual clutter: A generalized technique for label segregation using stereoscopic disparity. In IEEE Virtual Reality, 169-176.
47. PETERSON, S. D., AXHOLT, M., AND ELLIS, S. R. 2009. Objective and subjective assessment of stereoscopically separated labels in augmented reality. Comput. Graph. 33, 1, 23-33.
48. PHILBECK, J. W. AND LOOMIS, J. M. 1997. Comparison of two indicators of perceived egocentric distance under full-cue and reduced-cue conditions. J. Exper. Psychol. Hum. Percept. Perform. 23, 1, 72-85. (Pubitemid 127456156)
49. POLYS, N. F., BOWMAN, D. A., AND NORTH, C. 2011. The role of depth and gestalt cues in information-rich virtual environments. Int. J. Hum.-Comput. Stud. 69, 1-2, 30-51.
50. REINHART, W. F. 1990. Comparison of depth cues for relative depth judgments. In Proceedings of the. SPIE on Stereoscopic Displays and Applications. Vol. 1256, 12-21.
51. REINHART, W. F. 1991. Depth cueing for visual search and cursor positioning. In Proceedings of the SPIE on Stereoscopic Displays and Applications. Vol. 1457, 221-232.
52. ROGERS, B. J. AND COLLETT, T. S. 1989. The appearance of surfaces specified by motion parallax and binocular disparity. Quart. J. Hum. Exper. Psychol. 41, 4, 697-717.
53. ROLLAND, J. P. AND FUCHS, H. 2000. Optical versus video see-through head-mounted displays in medical visualization. Presence 9, 3, 287-309.
54. SANDOR, C., CUNNINGHAM, A., DEY, A., AND MATTILA, V. V. 2010. An augmented reality X-ray system based on visual saliency. In Proceedings of the IEEE International Symposium on Mixed and Augmented Reality. IEEE, Los Alamitos, CA, 27-36.
55. SIELHORST, T., BICHLMEIER, C., HEINING, S., AND NAVAB, N. 2006. Depth perception - A major issue in medical AR: Evaluation study by twenty surgeons. In Proceedings of the International Conference on Medical Image Computing and Computer Assisted Intervention. 364-372. (Pubitemid 44609126)
56. SINGH, G. J. S., AND JONES, J. 2010. Depth judgment measures and occluding surfaces in near-field augmented reality. In Proceedings of the 7th Symposium on Applied Perception in Graphics and Visualization. Vol. 1, 149-156.
57. SUGANO, N., KATO, H., AND TACHIBANA, K. 2003. The effects of shadow representation of virtual objects in augmented reality. In Proceedings of the Second IEEE and ACM International Symposium on Mixed and Augmented Reality. IEEE, Los Alamitos, CA, 76-83.
58. SUNDET, J. M. 1978. Effects of colour on perceived depth: Review of experiments and evaluation of theories. Scandinavian J. Psychol. 19, 1, 133-143.
59. SUZUKI, S. AND BE, K. 1985. Topological structural analysis of digitized binary images by border following. Comput. Vision, Graph. Image Process. 30, 1, 32-46. (Pubitemid 15490080)
60. SWAN, J. AND LIVINGSTON, M. 2006. A perceptual matching technique for depth judgments in optical, see-through augmented reality. In Virtual Reality. 19-26.
61. TAKASHI, S., KIM, J., HOFFMAN, D. M., AND BANKS, M. S. 2011. The zone of comfort : Predicting visual discomfort with stereo displays. J. Vision 11, 8, 1-29.
62. TAKEICHI, H., WATANABE, T., AND SHIMOJO, S. 1992. Illusory occluding contours and surface formation by depth propagation. Perception 21, 2, 177-184.
63. TSUDA, T., YAMAMOTO, H., KAMEDA, Y., AND OHTA, Y. 2005. Visualization methods for outdoor see-through vision. In Proceedings of the International Conference on Augmented Tele-Existence. ACM, New York, 62-69.
64. WARE, C. 2004. Information Visualization: Perception for Design. Morgan Kaufmann, San Francisco, CA.
65. WILLEMSEN, P., GOOCH, A. A., THOMPSON, W. B., AND CREEM-REGEHR, S. H. 2008. Effects of stereo viewing conditions on distance perception in virtual environments. Presence: Teleoper. Virtual Environ. 17, 1, 91-101.
66. WITHER, J. AND HOLLERER, T. 2005. Pictorial depth cues for outdoor augmented reality. In Proceedings of the IEEE International Symposium on Wearable Computers. IEEE, Los Alamitos, CA, 92-99. (Pubitemid 44867500)
67. YEH, Y.-Y. AND SILVERSTEIN, L. 1990. Limits of fusion and depth judgment in stereoscopic color displays. Hum. Factors 32, 1, 45-60. (Pubitemid 20298907)
68. ZHAI, S., BUXTON, W., AND MILGRAM, P. 1996. The partial-occlusion effect: Utilizing semitransparency in 3D human-computer interaction. ACM Trans. Comput. Hum. Interact. 3, 3, 254-284.