Perspectives on potential of sound in virtual environments

HAVE 2007 - The 6th IEEE International Workshop on Haptic, Audio and Visual Environments and Games, Proceedings

Volumn , Issue , 2007, Pages 15-20

  Dodiya, Janki ^a   Alexandrov, Vassil N ^a  

^a UNIVERSITY OF READING   (United Kingdom)

Author keywords

3D Sound spatial sound; Haptics; Multi sensory muti modal; Music; Sonification; Sound; Virtual environments; Virtual reality

Indexed keywords

GAME THEORY; HUMAN COMPUTER INTERACTION; HUMAN ENGINEERING; INFORMATION MANAGEMENT; KNOWLEDGE MANAGEMENT; REAL TIME SYSTEMS;

3D SOUND/SPATIAL SOUND; FUTURE DIRECTIONS; HAPTICS; LITERATURE SURVEYS; MULTI-SENSORY/MUTI-MODAL; MUSIC; SONIFICATION; SOUND; SYNTHETIC ENVIRONMENT; VIRTUAL ENVIRONMENTS; VIRTUAL REALITY (VR); VISUAL ENVIRONMENTS; VISUALIZATION TECHNOLOGIES;

VIRTUAL REALITY;

EID: 48049105030     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/HAVE.2007.4371579     Document Type: Conference Paper

References (81)

1. Perry R. Cook, " Sound and Production Modeling", IEEE Computer Graphics and Applications, pp. 23- 27, 2002
2. Durand R. Begault. "3D Sound for Virtual Reality and Multimedia.", Academic Press Professional, 1994.
3. Anderson, D.B.; Casey, M.A, The sound dimension, IEEE Spectrum, Vol 34, Issue 3, pp. 46-50, March 1997
4. th Annual International Conf. of the IEEE Engineering in Medical and Biology Society, Vol. 20, No 3, pp.1105 -1107, 1998
5. Hans G. Kaper, Elizabeth Wiebel, "Data Sonification and Sound Visualization", IEEE Computing in Science and Engineering, pp. 48-58, 1999
6. Slater, M., Usoh, M., Linakis, V., and Kooper, R. Immersion, presence and performance in virtual environments: An experiment with tridimensional chess". In VRST '96:Proceedings of the ACM Symposium n Virtual Reality Software and Technology, pp 63-172, 1996
7. Russell D. Shilling, Barbara Shinn-Cunningham, "Chapter 4: Virtual Auditory Displays", Handbook of Virtual Environment Technology. K. Stanney (ed), Lawrence Erlbaum, Associates, Inc., in press., 2000
8. Ellis, S. Nature and origins of virtual environments: A bibliographic essay. Computer Systems in Engineering, 2(4):321-347. 1991
9. Steuer, J., "Defining Virtual Reality: Dimensions Determining Telepresence", Journal of Communication, 42(4), pp. 73-93, 1992,
10. Marco Lanzagorta, Larry Rosenblum, Eddy Kuo, Rob Rosenberg, "Using Virtual Reality to Visualize Scientific, Engineering, and Medical Data", Proceedings of the Conference on Scientific Visualization DAGSTUHL, pp. 161, June 1997
11. Wenzel, E.M. Stone, P.K. Fisher, S.S. Foster, S.H.Foster, "A system for three-dimensional acoustic 'visualization' in a virtual environment workstation", Proceedings of the 1st conference on Visualization '90, pp., 329-337, 1990
12. th IEEE Visualization Conference, pp. 110-117, 1995
13. M.L. Brown, S.L.Newsome, E.P.Glinert, "An experiment into the use of auditory cues to reduce visual workload", Proceedings of the SIGCHI conference on Human factors in computing systems, pp -339-346, 1989
14. V. Salvador, R. Minghim, M. Pacheco, "Sonification to support Visualization Tasks", Proceedings of the International Symposium on Computer Graphics, Image Processing, and Vision - Volume 00, pp. 150, Jan 1998
15. Sara A. Bly, Steven P. Frysinger, David Lunney, Douglass L. Mansur, Joseph J. Mezrich, Robert C. Morrison," Communicating with Sound", ACM SIGCHI Bulletin, Proceedings of the SIGCHI conference on Human factors in computing systems CHI, Vol 16, Issue 4, pp- 115-119, April 1985
16. S H Kurniawan1, A Sporka, V Nemec,P Slavik," Design and user evaluation of a spatial audio system for blind users", Proc. 5th Intl Conf. Disability, Virtual Reality & Assoc. Tech., pp. 175-182, 2004
17. Lecuyer, A.; Mobuchon, P.; Megard, C.; Perret, J.; Andriot, C.; Colinot, J.-P. HOMERE: a multimodal system for visually impaired people to explore virtual environments, Virtual Reality, Proceedings. IEEE, pp., 251 - 258, March 2003
18. Thomas Hermann, Helge Ritter, "Sound and Meaning in Auditory Data Display", Proc. Of the IEEE, Vol 92, Issue 4, pp. 730-740
19. R. Iglesias, S. Casado, T. Gutiérrez, J.I. Barbero, C.A. Avizzano, S. Marcheschi, M.Bergamasco " Computer Graphics Access for Blind People through a Haptic and Audio Virtual Environment", Proc. The 3rd IEEE International Workshop on Haptic, Audio and Visual Environments and Their Applications, pp- 13-18, Oct 2004
20. Dinh, H.Q.; Walker, N.; Hodges, L.F.; Chang Song; Kobayashi, A., " Evaluating the importance of multi-sensory input on memory and the sense of presence in virtual environments", Proc. IEEE Virtual Reality, pp.222-228, March 1999
21. Hendrix, C., & Barfield, W. "The sense of presence within auditory virtual environments." Presence: Teleoperators and Virtual Environments, Vol. 5, pp., 290-301. 1996
22. Janet M. Weisenberger, Gayla L. Poling, "Multisensory Roughness Perception of Virtual Surfaces: Effects of Correlated Cues", IEEE Proc. of 12th Int. Symp. On Haptic Interfaces for Virtual Environment and Teleoperator Systems, pp. 161-168, 2004
23. th Symp on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003
24. th Symp on Haptic Interfaces for Virtual Environment and Teloperator Systems, 2003
25. th Int. Symp. On Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2004
26. Iris Herbst, Jörg Startk, "Comparing Force Magnitude by Means of Vibro- tactile, Auditory, and Visual Feedback", IEEE Workshop on Haptic, Audio, Visual Environments and their Applications, pp. 67-71, Oct 2005
27. Davis, E. T., Scott, K., Hailston, K. W., Pair, J., & Hodges, L. (2006). Ambient sounds can enhance visual perception and memory performance in virtual environments Journal of Vision, 6(6):170, 170a,
28. th Annual Int. Conf. of the IEEE Eng. In Medicine and Biology, Vol 20, Issue 3, 1998
29. Durand R. Begault, "Perceptual Effect of Reverberation on Three Dimensional Audio Systems", Journal of Audio Eng Soc, Vol 40, Issue 11, pp. 895-903, Nov 1992
30. Durand R. Begault, "Preferred Sound Intensity Increase for Sensation of Half Distance", Perceptual and Motor Skills, Vol 72, pp. 1019-1029
31. Durand R. Begault, "Challenges to Succesful Implementation of 3D Sound", Journal of Audio Eng Soc, Vol 39, Issue 11, Nov 1999
32. th International Symposium ELMAR, pp. 278-282, 2004
33. Alois Sontacchi, Robert Holdrich, "Investigations on control and perception of virtual distance using loudspeakers", Int. Symposium on Virtual Environments, Human computer interfaces and measurement systems, pp. 170-173, July 2003
34. Kai-Uwe Doerr, Holger Rademacher, Silke Huesgen, Wolfgang Kubbat, "Evaluation of a Low-Cost 3D Sound System for Immersive Virtual Reality Training Systems", IEEE Trans. On Visualization and Comp. Graphics, Vol 13, Issue 2, March/April 2007
35. Ying Zhang, Terence Fernando, "3D Sound Feedback Act as Task Aid in a Virtual Assembly Environment", Proc. of the Theory and Practice of Computer Graphics, 2003
36. th Int. Conf. on Information Visualization, 2005
37. st Int. Symp. On 3D Data Processing Visualization and Transmission, pp 1-10, 2002
38. The Use of 3D Audio in a Synthetic Environment: An Aural Rendrer for a Distributed Virtual Reality System", IEEE VRAIS Virtual Reality Annual International Symposium, pp. 176-182, 1993
39. Jaka Sodnik, Saso Tomazic, Raphael Grasset, Andreas Duenser, Mark Billinghurst, "Spatial Sound Localization in an Augmented Reality Environment", ACM Int Conference Proc Series; Proc. of the 20th conf. of the CHISIG of Australia on Computer-human interaction: design: activities, artefacts and environment, Vol. 206, pp. 111-118, 2006
40. Michael Cohen, Shigeaki Aoki, Nobuo Koizumi, "Augmented Audio Reality: Telepresence/VR Hybrid Acoustics Environments", IEEE Workshop on Robot and Human Communication, pp.361-364, 1993
41. th Int Conf. on Telecommunications, pp 729-731, 2003
42. Alois Sontacchi, Michael StrauB, Robert Holdrich, "Audio Interface for Immersive 3D - Audio Desktop Applications", Int. Symposium on Virtual Environments, Human computer interfaces and measurement systems, pp. 179-182, July 2003
43. T Funkhouser, J M Jot and N Tsingos (2002), Sounds Good to Me!, Computational Sound for Graphics, Virtual Reality, and Interactive Systems, SIGGRAPH 2002 Course Notes. http://www.cs.princeton.edu/gfx/papers/funk02course. pdf.
44. Tapio Lokki, Matti Grohn, "Navigation with Auditory Cues in a Virtual Environment", Published by IEEE Comp. Soc., pp. 80-86, 2005
45. Stephen A. Brewster, "Using Non- Speech Sounds to Provide Navigation cues", ACM Transactions on Computer-Human Interaction (TOCHI). Volume 5 Issue 3, pp. 224 - 259, Sept 1998
46. David K. McGookin, Stephen A. Brewster," Understanding concurrent earcons: Applying auditory scene analysis principles to concurrent earcon recognition", ACM Transactions on Applied Perception (TAP), Volume 1 Issue 2, pp. 130-155, Oct 2004
47. Chris Schmandt, "Audio hallway: a virtual acoustic environment for browsing", Proceedings of the 11th annual ACM symposium on User interface software and technology UIST, pp. 163-170, Nov 1998
48. Cai, Y. Y.,u, B. F., Fan, Z. W.,Chan, C. W., Lim, K. T., Qi, L, Li, L, "Proteins, Immersive Games and Music", Leonardo, Volume 39, Number 2, April 2006, pp. 135-137
49. Leplatre, G., Brewster, S.A. (1998). An Investigation of Using Music to Provide Navigation Cues, In Proceedings of ICAD'98 (Glasgow, UK), British Computer Society.
50. S. Saue, "A model for interaction in exploratory sonification displays," in Proceedings of ICAD 2000, available at: http://www.icad.org/websiteV2.0/Conferences/ICAD2000/ICAD2000.html
51. Heuten, W., Wichmann, D., and Boll, S., Interactive. 3D Sonification for the Exploration of City Maps. In. Proc. NordiCHI 2006, 155-164.
52. Edwards, A. D. and Mitsopoulos, E. 2005. Perceptual auditory design: Comments on Edwards and Mitsopoulos, ICAD 1998. ACM Trans. Appl. Percept.Vol 2, Issue 4pp., 450-454. (Oct. 2005),
53. Brewster, S.A. (2005) Sonically-enhanced widgets: comments on Brewster and Clarke, ICAD 1997. ACM Transactions in Applied Perception 2(4):pp. 462-466.
54. Brewster, S. A, Murray Crease, Making menus musical, Proceedings of the IFIP TC13 Interantional Conference on Human-Computer Interaction, p.389-396, July 14-18, 1997
55. Jason Daly, Bryan Kline, Glenn A. Martin, "VESS: Coordinating Graphics, Audio, and User Interaction in Virtual Reality Applications", Proc. of the IEEE Virtual Reality, 2002
56. Davide Rocchesso, Roberto Bresin, Mikael Fernström, " Sounding Objects", Published by IEEE Comp Society, pp. 42-52, 2003
57. Elizabeth M. Wenzel, Perceptual vs. hardware performance in advanced acoustic interface design',Proceedings of the INTERACT '93 and CHI '93 conference on Human factors in computing systems, pp., 363-366, 1993
58. G. Kramer, B. Walker, T. Bonebright, P. Cook, J. Flowers, N. Miner, J. Neuho, R. Bargar, S. Barrass, J. Berger, G. Evreinov, M. Grohn, S. Handel, H. Kaper, H. Levkowitz, S. Lodha, B. Shinn-Cunningham, M. Simoni, W. Tecumseh Fitch, and S. Tipei, Sonification Report: Status of the Field and Research Agenda., ICAD, 1999.
59. Sylvain Le Groux, Jônatas Manzolli, Paul F. M. J. Verschure, "VR-RoBoser: real-time adaptive sonification of virtual environments based on avatar behavior", Proceedings of the 7th international conference on New interfaces for musical expression, pp., 371-374, 2007
60. Frohlich, B.; Barrass, S.; Zehner, B.; Plate, J.; Gobel, M.." Exploring Geo-Scientific Data in Virtual Environments", Proceedings of the conference on Visualization '99, pp.,169 - 173, 1999
61. Harding, C., "Modeling Geoscience Data in a Multisensory Virtual Environment", Computing in Science & Engineering Volume 6, Issue 1, pp., 89-92, Jan 2004
62. Marti Gröhn, Tapio Lokki, Tapio Takala, "Comparison of auditory, visual, and audiovisual navigation in a 3D space", ACM Transactions on Applied Perception (TAP) Volume 2, Issue 4, pp., 564 - 570, Oct 2005
63. Marti Grohn, "Localization, accuracy and utilization of spatial audio in virtual environemtns", 2004
64. M. Grohn, T. Lokki, L. Savioja, and T. Takala. Some aspects of role of audio in immersive visualization. In Proc. SPIE, volume 4302, San Jose, California, January 2001
65. A. Mouchtaris, P. Reveliotis, C. Kyriakakis, "Non-Minimum Phase Inverse Filter Methods for Immersive Audio Rendering", Published by IEEE, pp-3077-3080, 1999
66. Martin Naef, Oliver Staadt, Markus Gross, "Spatialized Audio Rendering for Immersive Virtual Environments", Proceedings of the ACM symposium on Virtual reality software and technology VRST, pp. 65-72, Nov 2002
67. Jiann-Rong Wu, Cha-Dong Duh, Ming Ouhyoung, Jei-Tun Wu, "Head motion and latency compensation on localization of 3D sound in virtual reality", Proceedings of the ACM symposium on Virtual reality software and technology VRST, pp. 15-20, Sept 1997
68. Chris Joslin, Nadia Magnenat-Thalmann," Significant facet retrieval for real-time 3D sound rendering in complex virtual environments", Proceedings of the ACM symposium on Virtual reality software and technology VRST pp.15-21, Oct 2003
69. Gregory Kramer, Bruce N. Walker, "Sound science: Marking ten international conferences on auditory display", ACM Transactions on Applied Perception (TAP), Vol 2 Issue 4, pp. 383-388 Oct 2005.
70. Nicolas Tsingos, Emmanuel Gallo, George Drettakis, "Perceptual Audio Rendering of Complex Virtual Environments", ACM Transactions on Graphics (TOG), ACM SIGGRAPH 2004, Vol 23 Issue 3, pp: 249-258 Aug 2004.
71. Barbara G. Shinn-Cunningham, Timothy Streeter, "Spatial Auditory Display: Comments on Shinn-Cunningham et al., ICAD 2001", ACM Transactions on Applied Perception (TAP), Vol 2 Issue 4, pp. 426-429, Oct 2005
72. A. Gonot, N. Chateau et M. Emerit. Usability of 3D-Sound for Navigation in a Constrained Virtual Environment. In120th AES Convention, Paris, May 20-23, 2006.
73. Susnik, R. Sodnik, J. Bobojevic, G. Tomazic, S. Measurements of auditory navigation in virtual acoustic space, TENCON 2004. 2004 IEEE Region 10 Conference, Vol. 1, pp., 108- 111, Nov 2004
74. Costabile, M., De Angeli, A., Pittarello, F., Ardito, C., Can audio help navigating in virtual environments? An experimental evaluation, In Proc. of INTERACT 2003, Zurich, Switzerland, September 1-5, 2003, 733-736.
75. C. Hendrix, W., Barfield, "Presence in virtual environments as a function of visual and auditory cues", Proceedings of the Virtual Reality Annual International Symposium, pp 74, 1995
76. Brungart, D.S., Distance simulation in virtual audio displays, Aerospace Proceedings of the IEEE 1993 National and Electronics Conference,Volume 2, pp., 612-617, 1993
77. Mouchtaris, A. Lim, J.-S. Holman, T. Kyriakakis, C., "Head-related transfer function synthesis for immersive audio", IEEE Second Workshop on Multimedia Signal Processing, pp., 155-160, 1998
78. T. Lokki, M. Gröhn, L. Savioja, and T. Takala, "A case study of auditory navigation in virtual acoustic environments," in Proc. ICAD 2000, Atlanta GA, Apr 2000, pp. 145-150.
79. Noisternig, M. Musil, T. Sontacchi, A. Holdrich, R., 3D Binaural Sound Reproduction using a Virtual Ambisonic Approach, pp., IEEE International Symposium on Virtual Environments, Human-Computer Interfaces and Measurement Systems, pp., 174-178, 2003
80. M. Wand, W. Straßer: A Real-Time Sound Rendering Algorithm for Complex Scenes. Technical Report WSI-2003-5, Wilhelm Schickard Institute for Computer Science, Graphical-Interactive Systems (WSI/GRIS), University of Tübingen, 2003.
81. Jean Vroomen, Beatrice de Gelder, "Sound Enhances Visual Perception: Cross-modal Effects of Auditory Organization on Vision", In Journal of Experimental Psychology: Human Perception and Performance, vol 26, pp 1583-1590