The role of 3-D sound in human reaction and performance in augmented reality environments

IEEE Transactions on Systems, Man, and Cybernetics Part A:Systems and Humans

Volumn 37, Issue 2, 2007, Pages 262-272

  Zhou, Zhi Ying ^a   Cheok, Adrian David ^a   Qiu, Yan ^a   Yang, Xubo ^b  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^b SHANGHAI JIAO TONG UNIVERSITY   (China)

Author keywords

3 D sound; Augmented reality (AR); Collaboration; Depth perception; Task performance; User study

Indexed keywords

ACOUSTIC WAVES; AUDIO SYSTEMS; COMPUTER SIMULATION; DEPTH PERCEPTION; HUMAN ENGINEERING; NEURAL NETWORKS; TRACKING (POSITION); VIRTUAL REALITY;

AUDIO REALITY ENVIRONMENT; COLABORATION; TASK PERFORMANCE; USER STUDY;

CYBERNETICS;

EID: 33947602390     PISSN: 10834427     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCA.2006.886376     Document Type: Article

References (32)

1. P. Milgram, H. Takemura, A. Utsumi, and F. Kishino, "Augmented reality: A class of displays on the reality-virtuality continuum," Telemanipulator and Telepresence, vol. 2351, 1994.
2. R. T. Azuma, "A survey of augmented reality," Presence: Teleoperators Virtual Environ., vol. 6, no. 4, pp. 3.55-3.85, Aug. 1997.
3. I. E. Sutherland, "A head-mounted three dimensional display," in Proc. AFIPS Fall Joint Comput. Conf., 1968, vol. 33, pp. 7.57-7.64.
4. M. Cohen, S. Aoki, and N. Koizumi, "Augmented audio reality: Telepresence/VR hybrid acoustic environments," in Proc. Workshop Robot and Human Commun., 1993, pp. 3.61-3.64.
5. E. D. Mynatt, M. Back, R. Want, and R. Frederick, "Audio aura: Lightweight audio augmented reality," in Proc. UIST User Interface Softw. and Technol. Symp., 1997, pp. 21.1-21.2.
6. I. Poupyrev, C. Airola, M. Billinghurst, and H. Kato, "Augmented groove: Collaborative jamming in augmented reality," in Proc. ACM SIGGRAPH Abstracts and Appl., 2000, p. 77.
7. G. Eckel, B. Banissi, F. Khosrowshahi, M. Sarfraz, and A. Ursyn, "Immersive audio-augmented environments - The LISTEN project," in Proc. 5th Int. Conf. IV, 2001, p. 571.
8. W. W. Gaver, R. B. Smith, and T. O'Sheak, "Effective sounds in complex systems: The ARKola simulation," in Proc. CHI, 1991, pp. 85-90.
9. D. Begault, 3-D Sound for Virtual Reality and Multimedia. Boston, MA: AP Professional, 1994.
10. S. W. Mereu, "Improving depth perception in 3D interfaces with sound," Univ. Waterloo, Waterloo, ON, Canada, Tech. Rep. CS95-35, 1995.
11. H. Makino, I. Ishii, and M. Nakashizuka, "Development of navigation system for the blind using GPS and mobile phone combination," in Proc. 18th Conf. IEEE, EMBS, 1996, vol. 18, pp. 1-5.
12. P. Flanagan, K. I. McAnally, R. L. Martin, J. W. Meehan, and S. R. Oldfield, "Aurally and visually guided visual search in a virtual environment," Hum. Factors, vol. 40, no. 3, pp. 461-468, 1998.
13. S. Feiner, B. MacIntyre, M. Haupt, and E. Solomon, "Windows on the world: 2D windows for 3D augmented reality," in Proc. UIST, 1993, pp. 1.45-1.55.
14. G. Bill and M. Keith, "Hrtf measurements of a kemar dummy-head microphone," MIT Media Lab. Perceptual Comput. Tech. Rep., Cambridge, MA, Tech. Rep. 280, May 1994.
15. E. M. Wenzel, F. L. Wightman, and S. H. Foster, "A virtual display system for conveying three-dimensional acoustic information," in Proc. Hum. Factors Soc., 1988, vol. 32, pp. 86-90.
16. OpenAL Cross Platform 3D Audio. [Online]. Available: http://www.openal.org
17. M. Billinghurst, J. Bowskill, M. Jessop, and J. Morphett, "A wearable spatial conferencing space," in Proc. ISWC, 1998, pp. 76-83.
18. H. Kato and M. Billinghurst, "Marker tracking and HMD calibration for a video-based augmented reality conferencing system," in Proc. 2nd IEEE and ACM Int. Workshop Augmented Reality, 1999, pp. 85-94.
19. M. Kanbara and N. Yokoya, "Geometric and photometric registration for real-time augmented reality," in Proc. IEEE and ACM Int. Symp. Mixed and Augmented Reality, 2002, pp. 279-280.
20. M. W. Matthias and G. A. Brian, "Resolving occlusion in augmented reality," in Proc. Symp. Interactive 3D Graphics, 1995, pp. 5-12.
21. A. Fuhrmann, G. Hesian, F. Faure, and M. Gervautz, "Occlusion in collaborative augmented environments," Comput. Graph., vol. 23, no. 6, pp. 809-819, Dec. 1999.
22. D. W. Stockburger, Introductory Statistics: Concepts, Models and Applications. [Online]. Available: http://www.psychstat.missouristate.edu/sbk00.htm
23. M. Kanbara, H. Fujii, H. Takemura, and N. Yokoya, "A stereo vision-based augmented reality system with an inertial sensor," in Proc. IEEE and ACM ISAR, 2000, pp. 97-100.
24. A. Takagi, S. Yamazaki, Y. Saito, and N. Taniguchi, "Development of a stereo video see-through HMD for AR systems," in Proc. IEEE and ACM ISAR, 2000, pp. 68-77.
25. D. S. Brungart and W. M. Rabinowitz, "Auditory localization of nearby sources: Head-related transfer functions," J. Acoust. Soc. Amer., vol. 106, no. 3, pp. 1465-1479, 1999.
26. D. S. Brungart, "Auditory localization of nearby sources - Part III: Stimulus effects," J. Acoust. Soc. Amer., vol. 106, no. 6, pp. 3589-3602, 1999.
27. U. Neumann and S. You, "Natural feature tracking for augmented reality," IEEE Trans. Multimedia, vol. 1, no. 1, pp. 53-64, Mar. 1999.
28. InterSense, IS-900. [Online]. Available: http://www.isense.com/ uploadedFiles/Products/White_Papers/IS900_Tech_Overview_Enhanced.pdf
29. C. Schmandt, "Audio hallway: A virtual acoustic environment for browsing," in Proc. UIST, 1998, pp. 1.63-1.70.
30. W. R. Thurlow and T. M. Rosenthal, "Further study of existence regions for the ventriloquism effect," J. Acoust. Soc. Amer., vol. 1, no. 6, pp. 280-286, 1976.
31. W. Barfield, M. Cohen, and C. Rosenberg, "Visual, auditory, and combined visual-auditory displays for enhanced situational awareness," Int. J. Aviat. Psychol., vol. 7, no. 2, pp. 1.23-1.38, 1997.
32. W. Gaver, "Auditory icons: Using sound in computer interfaces," Hum.-Comput. Interact., vol. 2, no. 1, pp. 1.66-1.77, 1986.