Lessons learned: Evaluating visualizations for occluded objects in handheld augmented reality

International Journal of Human Computer Studies

Volumn 72, Issue 10-11, 2014, Pages 704-716

  Dey, Arindam ^a,b   Sandor, Christian ^a,c  

^a UNIVERSITY OF SOUTH AUSTRALIA   (Australia)

^b JAMES COOK UNIVERSITY   (Australia)

^c NARA INSTITUTE OF SCIENCE AND TECHNOLOGY   (Japan)

Author keywords

Augmented reality; Experiments; Handheld devices; Outdoor environments; Visualizations for occluded objects

Indexed keywords

AUGMENTED REALITY; COGNITIVE SYSTEMS; DEPTH PERCEPTION; DISPLAY DEVICES; EXPERIMENTS; HAND HELD COMPUTERS; USER EXPERIENCE; VISIBILITY;

DESIGN RECOMMENDATIONS; HAND HELD DEVICE; HANDHELD AUGMENTED REALITIES; HEAD-WORN DISPLAYS; INDOOR ENVIRONMENT; OCCLUDED OBJECTS; OUTDOOR ENVIRONMENT; VIRTUAL REALITY INTERFACES;

VISUALIZATION;

EID: 84902682758     PISSN: 10715819     EISSN: 10959300     Source Type: Journal    
DOI: 10.1016/j.ijhcs.2014.04.001     Document Type: Article

References (58)

1. E.J. Acosta, and S.J. Richard The effect of irrelevant information on the stages of processing J. Motor Behav. 8 September (3) 1976 181 187
2. Avery, B.; Sandor, C.; Thomas, B.; 2009. Improving spatial perception for augmented reality x-ray vision. In: Proceedings of the IEEE Virtual Reality Conference. IEEE, pp. 79-82.
3. R.T. Azuma A survey of augmented reality Presence 6 1997 355 385
4. Bane, R.; Hollerer, T.; 2004. Interactive tools for virtual X-Ray vision in mobile augmented reality. In: Proceedings of the 3rd IEEE/ACM International Symposium on Mixed and Augmented Reality. IEEE Computer Society, pp. 231-239. URL http://portal.acm.org/citation.cfm?id=1032652.1033720 . (Pubitemid 40682404)
5. Barten, P.; 1988. Effect of picture size and definition on perceived image quality. In: Conference Record of the 1988 International Display Research Conference, 1988. pp. 142-145.
6. M. Bradshaw, A. Parton, and R. Eagle The interaction of binocular disparity and motion parallax in determining perceived depth and perceived size Perception 27 11 1998 1317 1331 (Pubitemid 128445405)
7. M.F. Bradshaw, and B.J. Rogers The interaction of binocular disparity and motion parallax in the computation of depth Vis. Res. 36 21 1996 3457 3468 (Pubitemid 26377164)
8. Dey, A.; Cunningham, A.; Sandor, C.; 2010. Evaluating depth perception of photorealistic mixed reality visualizations for occluded objects in outdoor environments. In: Proceedings of ACM Symposium on Virtual Reality Software and Technology. Hong Kong, China, November. pp. 211-218.
9. Dey, A.; Jarvis, G.; Sandor, C.; Reitmayr, G.; 2012. Tablet vs. phone: depth perception in handheld augmented reality. In: Proceedings of the International Symposium on Mixed and Augmented Reality. pp. 187-196.
10. Dey, A.; Jarvis, G.; Sandor, C.; Wibowo, A.; Mattila, V.-V.; 2011. An evaluation of augmented reality X-ray vision for outdoor navigation. In: Proceedings of International Conference on Artificial Reality and Telexistence. Osaka, Japan, November, pp. 28-32.
11. J. DiCarlo, D. Zoccolan, and N. Rust How does the brain solve visual object recognition? Neuron 73 February (3) 2012 415 434
12. Dünser, A.; Grasset, R.; Billinghurst, M.; 2008. A survey of evaluation techniques used in augmented reality studies. In: ACM SIGGRAPH ASIA 2008 Courses. ACM, New York, NY, USA, pp. 5:1-5:27. URL http://dl.acm.org/ citation.cfm?doid=1508044.1508049 .
13. S.R. Ellis, and B.M. Menges Localization of virtual objects in the near visual field Hum. Factors 40 3 1998 415 431 (Pubitemid 28551220)
14. Feiner, S.; MacIntyre, B.; Hollerer, T.; Webster, A.; 1997. A touring machine: prototyping 3d mobile augmented reality systems for exploring the urban environment. In: First International Symposium on Wearable Computers, October 1997. Digest of Papers, pp. 74-81.
15. J.M. Foley, N.P. Ribeiro-Filho, and J.A.D. Silva Visual perception of extent and the geometry of visual space Vis. Res. 44 2 2004 147 156 (Pubitemid 37452406)
16. S. Ganapathy Design guidelines for mobile augmented reality: User experience L.A. Tony Huang, M. Livingston, Human Factors in Augmented Reality Environments 2013 Springer USA 165 180
17. B. Gillam, S. Palmisano, and D. Govan Depth interval estimates from motion parallax and binocular disparity beyond interaction space Perception 40 1 2011 39 49
18. Jones, J.A.; II, J. E.S.; Singh, G.; Ellis, S.R.; 2011. Peripheral visual information and its effect on distance judgments in virtual and augmented environments. In: McDonnell, R.; Thorpe, S.J.; Spencer, S.N.; Gutierrez, D.; Giese, M. (Eds.), APGV. ACM, pp. 29-36.
19. Jones, J.A.; Swan, J.; Singh, G.; Kolstad, E.; Ellis, S. R.; 2008. The effects of virtual reality, augmented reality, and motion parallax on egocentric depth perception. In: APGV 08: Proceedings of the 5th Symposium on Applied Perception in Graphics and Visualization. ACM, New York, NY, USA, pp. 9-14.
20. Kruijff, E.; Swan, J.; Feiner, S.; 2010. Perceptual issues in augmented reality revisited. In: 9th IEEE International Symposium on Mixed and Augmented Reality (ISMAR), October 2010, pp. 3-12.
21. S.A. Kuhl, W.B. Thompson, and S.H. Creem-Regehr HMD calibration and its effects on distance judgments ACM Trans. Appl. Percept. 6 September (3) 2009 19:1 19:20 URL http://doi.acm.org/10.1145/1577755.1577762
22. J. Lappin, A. Shelton, and J. Rieser Environmental context influences visually perceived distance Percept. Psychophys. 68 4 2006 571 581 URL http://dx.doi.org/10.3758/BF03208759 (Pubitemid 44870300)
23. C. Levin, and R. Haber Visual angle as a determinant of perceived interobject distance Percept. Psychophys. 54 1993 250 259
24. Livingston, M.A.; Ai, Z.; Swan, J.; Smallman, H.S.; 2009. Indoor vs. outdoor depth perception for mobile augmented reality. In: VR 09: Proceedings of the IEEE Conference on Virtual Reality. IEEE Computer Society, Washington, DC, USA, pp. 55-62.
25. M.A. Livingston, A. Dey, C. Sandor, and B.H. Thomas Pursuit of x-ray vision for augmented reality L.A. Tony Huang, M. Livingston, Human Factors in Augmented Reality Environments 2013 Springer USA 67 107
26. M.A. Livingston, K. Karsch, Z. Ai, and G.O. Gibson User interface design for military AR applications Virtual Real. 15 2-3 2011 175 184
27. Livingston, M.A.; Swan, J.; Gabbard, J. L.; Höllerer, T.H.; Hix, D.; Julier, S.J.; Baillot, Y.; Brown, D.; 2003. Resolving multiple occluded layers in augmented reality. In: ISMAR 03: Proceedings of the 2nd IEEE/ACM International Symposium on Mixed and Augmented Reality. IEEE Computer Society, Washington, DC, USA, p. 56.
28. J.M. Loomis, J.A. DaSilva, J.W. Philbeck, and S.S. Fukusima Visual perception of location and distance Curr. Dir. Psychol. Sci. 5 3 1996 72 77 (Pubitemid 126174397)
29. Loomis, J.M.; Knapp, J.M.; 2003. Visual Perception of Egocentric Distance in Real and Virtual Environments. No. 11. Erlbaum, pp. 21-46.
30. J.M. Loomis, J.W. Philbeck, and P. Zahorik Dissociation between location and shape in visual space J. Exp. Psychol.: Hum. Percept. Perform. 28 5 2002 1202 1212
31. J. McCandless, S.R. Ellis, and B.D. Adelstein Localization of a time-delayed, monocular virtual object superimposed on a real environment Presence 9 1 2000 15 24
32. E. Mikhailova, A. Slavutskaya, and N. Gerasimenko Gender differences in the recognition of spatially transformed figures behavioral data and event-related potentials (ERPS) Neurosci. Lett. 524 2 2012 74 78
33. Milgram, P.; Takemura, H.; Utsumi, A.; Kishino, F.; 1994. Augmented Reality: a Class of Displays on the Reality-Virtuality Continuum, pp. 282-292.
34. Y. Naya, M. Yoshida, and Y. Miyashita Backward spreading of memory-retrieval signal in the primate temporal cortex Science 291 5504 2001 661 664 URL http://www.sciencemag.org/content/291/5504/661.abstract (Pubitemid 32150426)
35. Piekarski, W.; Thomas, B.; 2001. Tinmith-metro: new outdoor techniques for creating city models with an augmented reality wearable computer. In: ISWC apos01: Proceedings of the 5th International Symposium on Wearable Computers, pp. 31-38. (Pubitemid 33075420)
36. B. Pollock, M. Burton, J. Kelly, S. Gilbert, and E. Winer The right view from the wrong location depth perception in stereoscopic multi-user virtual environments IEEE Trans. Vis. Comput. Graph. 18 April (4) 2012 581 588
37. M.S. Pratte, S. Ling, J.D. Swisher, and F. Tong How attention extracts objects from noise J. Neurophysiol. 110 6 2013 1346 1356 10.1152/jn.00127.2013 http://jn.physiology.org/content/early/2013/06/21/jn.00127.2013.abstract
38. J. Predebon Spatial judgments of exocentric extents in an open-field situation: familiar versus unfamiliar size Atten. Percept. Psychophys. 50 1991 361 366 10.3758/BF03212228
39. J.P. Rolland, D. Ariely, and W. Gibson Towards quantifying depth and size perception in virtual environments Presence: Teleoper. Virtual Environ. 4 Winter (1) 1995 24 49
40. Sandor, C.; Cunningham, A.; Dey, A.; Mattila, V.; 2010. An augmented reality x-ray system based on visual saliency. In: Proceedings of the IEEE International Symposium of Mixed and Augmented Reality. IEEE, Seoul, Koria, pp. 27-36.
41. Sandor, C.; Cunningham, A.; Eck, U.; Urquhart, D.; Jarvis, G.; Dey, A.; Barbier, S.; Marner, M.; Rhee, S.; 2009. Egocentric space distortion visualizations for rapid environment exploration in mobile mixed reality. In: Proceedings of the IEEE Virtual Reality Conference 2010. IEEE, Waltham, MA, USA, pp. 47-50.
42. D.L. Sheinberg, and N.K. Logothetis Noticing familiar objects in real world scenes the role of temporal cortical neurons in natural vision J. Neurosci. 21 4 2001 1340 1350 URL http://www.jneurosci.org/content/21/4/1340. abstract (Pubitemid 32128779)
43. J. Simon, P.E. Sly, and S. Vilapakkam Effect of compatibility of s-r mapping on reactions toward the stimulus source Acta Psychol. 47 1 1981 63 81
44. Singh, G.; II, J.E.S.; Jones, J.A.; Ellis, S.R.; 2012. Depth judgments by reaching and matching in near-field augmented reality. In: Coquillart, S.; Feiner, S.; Kiyokawa, K. (Eds.), VR. IEEE, pp. 165-166.
45. F. Steinicke, G. Bruder, and S. Kuhl Realistic perspective projections for virtual objects and environments ACM Trans. Graph. 30 October (5) 2011 112-1 112-10 URL http://doi.acm.org/10.1145/2019627.2019631
46. G. Stix See-through view. virtual reality may guide physicians hands Sci. Am. 267 3 1992 166
47. E. Stoffels, M.V.D. Molen, and P. Keuss Intersensory facilitation and inhibition immediate arousal and location effects of auditory noise on visual choice reaction time Acta Psychol. 58 1 1985 45 62
48. Y. Sugase-Miyamoto, N. Matsumoto, and K. Kawano Role of temporal processing stages by inferior temporal neurons in facial recognition Front. Psychol. 2 141 2011
49. Swan, J.; Gabbard, J.; 2005. Survey of user-based experimentation in augmented reality. In: Proceedings of 1st International Conference on Virtual Reality, HCI International, July 2005. pp. 1-9.
50. J. Swan, A. Jones, E. Kolstad, M. Livingston, and H. Smallman Egocentric depth judgments in optical, see-through augmented reality IEEE Trans. Vis. Comput. Graph. 13 May-June (3) 2007 429 442 (Pubitemid 46479762)
51. Swan, J.I.; Livingston, M.A.; Smallman, H.S.; Brown, D.; Baillot, Y.; Gabbard, J.L.; Hix, D.; 2006. A perceptual matching technique for depth judgments in optical, see-through augmented reality. In: VR 06: Proceedings of the IEEE Conference on Virtual Reality. IEEE Computer Society, Washington, DC, USA, pp. 19-26.
52. D.S. Tan, M.P. Czerwinski, and G.G. Robertson Large displays enhance optical flow cues and narrow the gender gap in 3d virtual navigation. human factors the J. Hum. Factors Ergon. Soc. 48 2006
53. Tsuda, T.; Yamamoto, H.; Kameda, Y.; Ohta, Y.; 2005. Visualization methods for outdoor see-through vision. In: ICAT 05: Proceedings of the International Conference on Augmented Tele-Existence. ACM, New York, NY, USA, pp. 62-69.
54. S. Ullman Recognizing visual classes and individual objects by semantic hierarchies S.J. Dickinson, A. Leonardis, B. Schiele, M.J. Tarr, Object Categorization 2009 Cambridge University Press San Francisco, CA, USA
55. D.W.F. van Krevelen, and R. Poelman A survey of augmented reality technologies, applications and limitations Int. J. Virtual Real. 9 June (2) 2010 1 20
56. R. Vanrullen, and S.J. Thorpe The time course of visual processing from early perception to decision-making J. Cogn. Neurosci. 13 May (4) 2001 454 461 URL http://dx.doi.org/10.1162/08989290152001880 (Pubitemid 32500254)
57. D. Waller, and A.R. Richardson Correcting distance estimates by interacting with immersive virtual environments effects of task and available sensory information J. Exp. Psychol.: Applied 14 1 2008 61 72
58. Wither J., Hollerer T. Pictorial depth cues for outdoor augmented reality. Proceedings - International Symposium on Wearable Computers, ISWC 2005 2005 92-99 DOI 10.1109/ISWC.2005.41, 1550792, Proceedings - Ninth IEEE International Symposium on Wearable Computers, ISWC 2005