Audio, visual, and audio-visual egocentric distance perception by moving subjects in virtual environments

ACM Transactions on Applied Perception

Volumn 9, Issue 4, 2012, Pages

  Rebillat, Marc ^a   Boutillon, Xavier ^b   Corteel, E Tienne ^c   Katz, Brian F G ^d  

^a UNIVERSITÉ PARIS DESCARTES   (France)

^b LABORATOIRE DE MÉCANIQUE DES SOLIDES   (France)

^c Sonic Emotion Labs   (France)

^d CNRS   (France)

Author keywords

Distance estimation; Large screen immersive displays; Spatial perception; Spatialized audio; Virtual environments; Wave field synthesis

Indexed keywords

DISTANCE ESTIMATION; LARGE-SCREEN IMMERSIVE DISPLAYS; SPATIAL PERCEPTION; SPATIALIZED AUDIO; WAVE FIELD SYNTHESIS;

ACOUSTIC FIELDS; DEPTH PERCEPTION; SOUND REPRODUCTION; SPEECH RECOGNITION;

VIRTUAL REALITY;

EID: 84878503285     PISSN: 15443558     EISSN: 15443965     Source Type: Journal    
DOI: 10.1145/2355598.2355602     Document Type: Article

References (42)

1. ALEXANDROVA, I. V., TENEVA, P. T., DE LA ROSA, S., KLOOS, U., BULTHOFF, H. H., AND MOHLER, B. J. 2010. Egocentric distance judgments in a large screen display immersive virtual environment. In Proceedings of the 7th Symposium on Applied Perception in Graphics and Visualization (APGV '10). ACM, New York, 57-60.
2. ANDRE, J. AND ROGERS, S. 2006. Using verbal and blind-walking distance estimates to investigate the two visual systems hypothesis. Percept. Psychophys. 68, 3, 353-361. (Pubitemid 44870312)
3. ARMBRUSTER, C.,WOLTER, M., KUHLEN, T., SPIJKERS, W., AND FIMM, B. 2008. Depth perception in virtual reality: Distance estimations in peri-and extrapersonal space. Cyberpsychol. Behav.11, 1, 9-15. (Pubitemid 351271584)
4. ASHMEAD, D. H., DAVIS, D. L., AND NORTHINGTON, A. 1995. Contribution of listeners approaching motion to auditory distance perception. J. Experiment. Psychol.-Hum. Percept. Perform. 21, 2, 239-256.
5. BEALL, A. C., LOOMIS, J. M., AND PHILBECK, J. W. 1994. Absolute motion parallax weakly determines visual scale. Investigative Ophthalmology Visual Sci. 35, 4, 2111-2111.
6. BERKHOUT, A. J., DE VRIES, D., AND VOGEL, P. 1993. Acoustic control by wave field synthesis. J. Acoustical Soc. Amer. 93, 5, 2764-2778. (Pubitemid 23143504)
7. BLAUERT, J. 1999. Spatial Hearing, The Psychophysics of Human Sound Localization. MIT Press, Cambridge, MA.
8. BORMANN, K. 2005. Presence and the utility of audio spatialization. Presence-Teleoper. Virtual Environ. 14, 3, 278-297. (Pubitemid 41016935)
9. BRONKHORST, A. W. AND HOUTGAST, T. 1999. Auditory distance perception in rooms. Nature 397, 6719, 517-520.
10. BROOKS, F. P. 1999. What's real about virtual reality? IEEE Comput. Graph. Appl. 19, 6, 16-27.
11. CORTEEL, E. 2004. Caracterisation et extensions de la wave field synthesis en conditions reelles. Ph.D. dissertation, Universite de Paris 6.
12. CORTEEL, E., NGUYEN, K. V.,WARUSFEL, O., CAULKINS, T., AND PELLEGRINI, R. 2007. Objective and subjective comparison of electrodynamic and MAP loudspeakers for wave field synthesis. In Proceedings of the 30th International Conference of the Audio Engineering Society.
13. CREEM-REGEHR, S. H.,WILLEMSEN, P., GOOCH, A. A., AND THOMPSON, W. B. 2005. The influence of restricted viewing conditions on egocentric distance perception: Implications for real and virtual indoor environments. Perception 34, 2, 191-204. (Pubitemid 40482629)
14. COTE, N.,KOEHL, V.,PAQUIER, M., AND DEVILLERS, F. 2011. Interaction between auditory and visual distance cues in virtual reality applications. In Proceedings of the Forum Acusticum.
15. CUTTING, J. E. 1997. How the eye measures reality and virtual reality. Behav. Res. Meth. Instr. Comput. 29, 1, 27-36. (Pubitemid 127710715)
16. FARIA, R. R. A., ZUFFO, M. K., AND ZUFFO, J. A. 2005. Improving spatial perception through sound field simulation in VR. In Proceedings of the IEEE International Conference on Virtual Environments, Human-Computer Interfaces and Measurement Systems. IEEE, Los Alamitos, CA, 103-108. (Pubitemid 46170350)
17. FUKUSIMA, S. S., LOOMIS, J. M., AND DASILVA, J. A. 1997. Visual perception of egocentric distance as assessed by triangulation. J. Exper. Psychol. Hum. Percept. Perform. 23, 1, 86-100. (Pubitemid 127456157)
18. GERZON, M. A. 1985. Ambisonics in multichannel broadcasting and video. J. Audio Eng. Soc. 33, 11, 859-871.
19. GRECHKIN, T. Y., NGUYEN, T. D., PLUMERT, J. M., CREMER, J. F., AND KEARNEY, J. K. 2010. How does presentation method and measurement protocol affect distance estimation in real and virtual environments? ACM Trans. Appl. Percept. 7, 4, 26.
20. HOFFMAN, D.M., GIRSHICK, A. R., AKELEY, K., AND BANKS, M. S. 2008. Vergence-accommodation conflicts hinder visual performance and cause visual fatigue.
21. J. Vision 8, 3, 33. HOWARTH, P. A. 2011. Potential hazards of viewing 3-D stereoscopic television, cinema and computer games: a review. Ophthalmic Physiol. Optics 31, 2, 111-122.
22. INTERRANTE, V., RIES, B., LINDQUIST, J., KAEDING, M., AND ANDERSON, L. 2008. Elucidating factors that can facilitate veridical spatial perception in immersive virtual environments. Presence-Teleoper. Virtual Environ.17, 2, 176-198.
23. KEARNEY, G., GORZEL, M., RICE, H., AND BOLAND, F. 2012. Distance perception in interactive virtual acoustic environments using first and higher order ambisonic sound fields. Acta Acustica with Acustica 98, 1, 61-71.
24. KLEIN, E., SWAN, J. E., SCHMIDT, G. S., LIVINGSTON, M. A., AND STAADT, O. G. 2009. Measurement protocols for medium-field distance perception in large-screen immersive displays. In Proceedings of the IEEE Conference on Virtual Reality. IEEE, Los Alamitos, CA, 107-113.
25. KOMIYAMA, S.,MORITA, A., KUROZUMI, K., AND NAKABAYASHI, K. 1991. Distance control system for a sound image. In Proceedings of the 9th Audio Engineering Society International Conference on Television Sound Today and Tomorrow.
26. LOOMIS, J. M., KLATZKY, R. L., PHILBECK, J. W., AND GOLLEDGE, R. G. 1998. Assessing auditory distance perception using perceptually directed action. Percept. Psychophys. 60, 6, 966-980. (Pubitemid 128462145)
27. LOOMIS, J. M. AND KNAPP, J. M. 2003. Virtual and Adaptive Environments: Applications, Implications, and Human Performance t5rIssues. Lawrence Erlbaum.
28. NACERI, A., CHELLALI, R., DIONNET, F., AND TOMA, S. 2009. Depth perception within virtual environments: A comparative study between wide screen stereoscopic displays and head mounted devices. In Computation World. Future Computing, Service Computation, Cognitive, Adaptive, Content, Patterns, 460-466.
29. NAWROT, M. AND STROYAN, K. 2009. The motion/pursuit law for visual depth perception from motion parallax. Vision Res. 49, 15, 1969-1978.
30. PLUMERT, J. M., KEARNEY, J. K., CREMER, J. F., AND RECKER, K. 2005. Distance perception in real and virtual environments. ACM Trans. Appl. Percept. 2, 216-233.
31. PORSCHMANN, C. AND STORIG, C. 2009. Investigations into the velocity and distance perception of moving sound sources. Acta Acustica with Acustica 95, 4, 696-706.
32. REBILLAT, M., CORTEEL, E., AND KATZ, B. F. 2008. SMART-I2: Spatial multi-user audio-visual real-time interactive interface. In Proceedings of the 125th Convention of the Audio Engineering Society.
33. REBILLAT, M., KATZ, B. F., AND CORTEEL, E. 2009. SMART-I2: Spatial multi-user audio-visual real-time interactive interface. A broadcast application context. In Proceedings of the IEEE 3D-TV Conference. IEEE, Los Alamitos, CA.
34. RUSSELL, M. K. AND SCHNEIDER, A. L. 2006. Sound source perception in a two-dimensional setting: Comparison of action and nonaction-based response tasks. Ecological Psychol. 18, 3, 223-237. (Pubitemid 44367662)
35. RYU, J.,HASHIMOTO, N., AND SATO, M. 2005. Influence of resolution degradation on distance estimation in virtual space displaying static and dynamic image. In Proceedings of the International Conference on Cyberworlds. 43-50. (Pubitemid 43897898)
36. SANSON, J.,CORTEEL, E., ANDWARUSFEL,O. 2008. Objective and subjective analysis of localisation accuracy in wave field synthesis. In Proceedings of the 124th Convention of the Audio Engineering Society.
37. SLATER, M. AND WILBUR, S. 1997. A framework for immersive virtual environments (FIVE): Speculations on the role of presence in virtual environments. Presence-Teleoper. Virtual Environ. 6, 6, 603-616.
38. SPEIGLE, J. M. AND LOOMIS, J. M. 1993. Auditory distance perception by translating observers. In Proceedings of IEEE Symposium on Research Frontiers in Virtual Reality. IEEE, Los Alamitos, CA, 25-26.
39. SPRINGER, J. R., SLADECZEK, C., SCHEFFLER, M., HOCHSTRATE, J., MELCHIOR, F., AND FROHLICH, B. 2006. Combining wave field synthesis and multi-viewer stereo displays. In Proceedings of the IEEE Virtual Reality Conference. IEEE, Los Alamitos, CA, 237-+.
40. WATT, S. J., AKELEY, K., ERNST, M. O., AND BANKS, M. S. 2005. Focus cues affect perceived depth. J. Vision 5, 10, 834-862. (Pubitemid 43013353)
41. WIEST, W. M. AND BELL, B. 1985. Stevens exponent for psychophysical scaling of perceived, remembered, and inferred distance. Psychol. Bull. 98, 3, 457-470.
42. ZAHORIK, P., BRUNGART, D. S., AND BRONKHORST, A. W. 2005. Auditory distance perception in humans: A summary of past and present research. Acta Acustica with Acustica 91, 3, 409-420. .