The Allobrain: An interactive, stereographic, 3D audio, immersive virtual world

International Journal of Human Computer Studies

Volumn 67, Issue 11, 2009, Pages 934-946

  Thompson, John ^a   Kuchera Morin, JoAnn ^a   Novak, Marcos ^a   Overholt, Dan ^a   Putnam, Lance ^a   Wakefield, Graham ^a   Smith, Wesley ^a  

^a Santa Barbara   (United States)

Author keywords

Ambisonic spatialization; Human computer interaction; Immersive environments; Sonification; Wireless controller

Indexed keywords

3D AUDIO; AMBISONIC SPATIALIZATION; BRAIN DATA; IMMERSIVE; IMMERSIVE ENVIRONMENTS; LARGE DATASETS; PROTOTYPING; SONIFICATION; TECHNOLOGICAL INFRASTRUCTURE; VIRTUAL WORLDS; WIRELESS CONTROLLER;

KNOWLEDGE MANAGEMENT; SOFTWARE PROTOTYPING; THREE DIMENSIONAL; VIRTUAL REALITY;

HUMAN COMPUTER INTERACTION;

EID: 70349501980     PISSN: 10715819     EISSN: 10959300     Source Type: Journal    
DOI: 10.1016/j.ijhcs.2009.05.005     Document Type: Article

References (54)

1. Amatriain X., Castellanos J., Hollerer T., Kuchera-Morin J., Pope S.T., Wakefield G., and Wolcott W. Experiencing Audio and Music in a Fully Immersive Environment. Lecture Notes in Computer Science (2007), Springer, Berlin
2. Amatriain, X., Kuchera-Morin, J., Hollerer, T., Pope, S., 2008. The AlloSphere: an immersive multimedia instrument for scientific data discovery and artistic exploration. 2008 IEEE Multimedia VR Magazine.
3. Ars Electronica|FutureLab 〈http://www.aec.at/futurelab_references_en.php〉 Retrieved February 2009.
4. Berkhout A. A holographic approach to acoustic control. Journal of the Audio Engineering Society 36 (1988) 977-995
5. BioPac: 〈http://www.biopac.com〉 Retrieved December 2007.
6. Borman K. Presence and the utility of audio spatialization. Presence 14 3 (2005) 278-297
7. Brewster S.A., and Murray R. Presenting information on mobile computers. Technologies 4 2 (2000) 209-212
8. Cakmakci O., and Rolland J. Head-worn displays: a review. Journal of Display Technology 2 3 (2006) 199-216
9. Chowning J. The simulation of moving sound sources. Journal of the Audio Engineering Society 19 1 (1971)
10. Conant D., Hoover T., Pope S., and McNally K. The acoustics of a large 3D immersive environment: the Allosphere at UCSB. Proceedings of the 2008 ASA-EAA Joint Conference on Acoustics (2008), ASA, Paris
11. ®: audio visual experience automatic virtual environment. Communications of the ACM, 06/01/1992-06/01/1992
12. Daniel, J., 2003. Spatial sound encoding including near-field effect: introducing distance coding filters and a viable, new ambisonic format. Preprints of the 23rd Int. Conf. of the Audio Eng. Soc.; Copenhagen, Denmark.
13. DMN, 2006. The Denver Museum of Nature and Science Gates Planetarium. URL: 〈http://www.dmns.org/〉.
14. Dannenberg, R., Fisher, R., 2001. An Audience-Interactive Multimedia Production on the Brain. In: Proceedings of the Symposium for Arts and Technology, Connecticut College, (March 2001).
15. Dolisnky, M., Anstey, J., Pape, D., Aguilera, J., Kostis, H., Tsoupikova, D., 2005. Collaborative virtual environmnents, art exhibition. In: Proceedings of the SPIE-IS&T Electronic Imaging, Stereoscopic Displays and Virtual Reality Systems XII, San Jose, CA, 01/20/2005-01/20/2005
16. Eilemann, S., An Analysis of Parallel Rendering Systems, 〈http://www.equalizergraphics.com/documents/WhitePapers/ParallelRenderingSystems.pdf〉.
17. evl|art 〈http://www.evl.uic.edu/core.php?mod=1&type=2〉 Retrieved February 2009.
18. Gröhn, M., 2006. application of spatial sound reproduction in virtual environments-experiments in localization, navigation, and orientation. Ph.D. Thesis, Department of Computer Science and Engineering, Helsinki University of Technology, Espoo, Finland.
19. Gaitatzes A., Papaioannou G., Christopoulos D., and Zyba G. Media productions for a dome display system. VRST '06: Proceedings of the ACM Symposium on Virtual Reality Software and Technology (2006), ACM Press, New York, USA 261-264
20. Gerzon M.A. Periphony: with-height sound reproduction. Journal of the Audio Engineering Society 21 1 (1973) 2-10
21. Hollerer T., Kuchera-Morin J., and Amatriain X. The Allosphere: a large-scale immersive surround-view instrument. EDT '07: Proceedings of the 2007 Workshop on Emerging Displays Technologies (2007), ACM Press, New York, USA p. 3
22. Hollerweger, F., 2006. Periphonic sound spatialization in multi-user virtual environments. Master's Thesis, Austrian Institute of Electronic Music and Acoustics (IEM).
23. Ihren, J., Frisch, K., 1999. The fully immersive cave. In: Proceedings of the Third International Immersive Projection Technology Workshop, pp. 59-63.
24. Ji, H., Wakefield, G., 2009. Artificial nature. In: Conference on Media Arts Science and Technology, University of California Santa Barbara.
25. In: Johnson C.R., Moorehead R., Munzner T., Pfister H., Rheingans P., and Yoo T.S. (Eds). NIH-NSF Visualization Research Challenges Report (2006), IEEE Press. http://tab.computer.org/vgtc/vrc/index.html (〈http://tab.computer.org/vgtc/vrc/index.html〉)
26. Kalawsky R. The Science of Virtual Reality and Virtual Environments (1993), Addison-Wesley, Boston
27. Kostis, H., Kooima, R., Kannenberg, J., 2007. Skin: an interactive hyperstereoscopic electro installation. In: IS&T/SPIE Electronic Imaging 2007 Conference Proceedings, 01/28/2007-02/01/2007.
28. Kuchera-Morin, J., Overholt, D., Bell, B., Kleban, J., Putnam, L., Thompson, J., 2007. The multimodal music stand. In: New Interfaces for Musical Expression Conference, New York.
29. LANL, 2006. Fakespace Delivers Highest Resolution Visualization Room (Advanced Simulation and Computing (ASC) Program, Los Alamos National Laboratory). URL: 〈http://www.tenlinks.com/NEWS/PR/fakespace/110905room.htm〉.
30. Malham, D., 1999. Higher order Ambisonic systems for the spatialisation of sound. In: Proceedings of the 1999 ICMC.
31. Malham D., and Myatt A. 3-d sound spatialization using ambisonic techniques. Computer Music Journal (CMJ) 19 4 (1995) 58-70
32. Malkawi A., and Srinivasan R. Multimodal human-computer interaction for immersive visualization: integrating speech-gesture recognitions and augmented reality for indoor environments. Proceedings of the Seventh IASTED Conference on Computer Graphics and Imaging (2004), ACTA Press, Kauai, HI 171-175
33. McGurk H., and McDonald T. Hearing lips and seeing voices. Nature 264 (1976) 746-748
34. Menzies D. Ambisonic synthesis of complex sources. Journal of Audio Engineering Society (2007)
35. Nesbitt, K.V., Barrass, S., 2002. Evaluation of a multimodal sonification and visualisation of depth of market stock data. In: International Conference on Auditory Display-ICAD 2002, Kyoto, Japan.
36. Novak, M., 1991. Liquid architectures in cyberspace. In: Benedikt, M. (Ed.), First Steps. Cyberspace.
37. Overholt, D., 2006. Musical interaction design with the CREATE USB interface teaching HCI with CUIs instead of GUIs. In: Proceedings of the 2006 ICMC.
38. Overholt, D., Sphere Spatializer: 〈http://create.ucsb.edu/~dano/sphere〉 Retrieved February 2009.
39. Pape D., Anstey J., Dolinsky M., and Dambik E. Ygdrasil-a framework for composing shared virtual worlds. Future Generation Computer Systems (2003)
40. Paradiso J., and Gershenfeld. Musical applications of electric field sensing. Computer Music Journal 21 2 (1997)
41. Patel, D., Eliassen, I.K., Langeland, T., 2003. A Framework architecture for virtual environments. In: CAVE Programming Workshop, August.
42. Puckette M. Max at seventeen. Computer Music Journal 26 4 (2002) 31-43
43. Pulkki V. Virtual sound source positioning using vector base amplitude panning. Journal of Audio Engineering Society (JAES) 45 6 (1997) 456-466
44. Shiboano, N., Hareesh, P., Hoshino, H., Kawamura, R., Yamamoto, A., Kashiwagi, M., Sawada, K., 2003. Cyberdome: Pc clustered hemi spherical immersive projection display. In: Proceedings of the 2003 International Conference on Artificial Reality and Telexistence, pp. 1-7.
45. Smith J.R. Field mice: extracting hand geometry from electric field measurements. IBM Systems Journal 35 3 and 4 (1996) 587-608
46. Smith, J., et al., 1998. Electric field sensing for graphical interfaces, Special Issue on Input Devices, IEEE Computer Graphics and Applications, May 1998.
47. Spors, S., Teutsch, H., Rabenstein, R., 2002. High-quality acoustic rendering with wave field synthesis. In: Proceedings Vision, Modeling, and Visualization Workshop. pp. 101-108.
48. The Allobrain at TU Delft iWeb and Protospace: 〈http://www.tudelft.nl/live/pagina.jsp?id=429fa10f-a830-4944-90de-9a326e419b54〉 Retrieved December 2007.
49. © 2007, Association for the Advancement of Artificial Intelligence (www.aaai.org). All rights reserved.
50. Wakefield, G., 2006. Third-order Ambisonic extensions for Max/MSP with musical applications. In: Proceedings of the 2006 ICMC.
51. Wegman E., and Symanzik J. Immersive projection technology for visual data mining. Journal of Computational and Graphical Statistics (2002)
52. Witmer B., and Singer M. Measuring presence in virtual environments: a presence questionnaire. Presence: Teleoperators and Virtual Environments 7 3 (1998) 225-240
53. Yelistratov, V., Strauss, W., Fleischmann, M., 1999. Two approaches for intuitive navigation in virtual environments. In: Proceedings of GraphiCon-99, the Ninth International Conference on Computer Graphics and Vision, Moscow, Russia, 26 August-1 September 1999.
54. ZCorp: 〈http://www.zcorp.com〉 Retrieved February 2009.