Audio narrowcasting and privacy for multipresent avatars on workstations and mobile phones

IEICE Transactions on Information and Systems

Volumn E89-D, Issue 1, 2006, Pages 73-86

  Fernando, Owen Noel Newton ^a,b,c   Adachi, Kazuya ^a   Duminduwardena, Uresh ^a,d   Kawaguchi, Makoto ^a,e   Cohen, Michael ^a,b,c,f,g,h  

^a UNIVERSITY OF AIZU   (Japan)

^b ACM   (Japan)

^c IEEE

^d Dialog Telekom   (Sri Lanka)

^e Japan Research Institute   (Japan)

^f Japan Research Institute ^*

^g TUG (TeX Users Group)

^h Virtual Reality Society of Japan (VRSJ)   (Japan)

Author keywords

Audibility permissions; Chatspaces; Groupware; Mobile computting; Multipresence; Multiuser interface; Narrowcasting (selection) functions; Soundscape superposition; Spatial sound; Teleconferencing

Indexed keywords

AUDIO ACOUSTICS; BROADCASTING; COMPUTER WORKSTATIONS; GROUPWARE; TELECONFERENCING; USER INTERFACES; VIRTUAL REALITY;

AUDIBILITY PERMISSIONS; CHATSPACES; MOBILE COMPUTTING; MULTIPRESENCE; MULTIUSER INTERFACE; NARROWCASTING (SELECTION) FUNCTIONS; SOUNDSCAPE SUPERPOSITION; SPATIAL SOUND;

MOBILE TELECOMMUNICATION SYSTEMS;

EID: 32244446603     PISSN: 09168532     EISSN: 17451361     Source Type: Journal    
DOI: 10.1093/ietisy/e89-d.1.73     Document Type: Conference Paper

References (65)

1. N.A. Bolhassan, M. Cohen, O.N.N. Fernando, T. Kamada, W.L. Martens, H. Osaka, and T. Yoshikawa, ""Just Look at Yourself!": Stereographic exocentric visualization and emulation of stereographic panoramic dollying," Proc. ICAT: Int. Conf. on Artificial Reality and Tele-Existence, University of Tokyo, pp. 146-153, Dec. 2002. vrsj.t.u-tokyo.ac.jp/ic-at/ ICAT2003/papers/02146.pdf
2. M. Cohen, T. Azumi, Y. Yatsuyanagi, M. Sasaki, S. Yamaoka, and O. Takeichi, "Networked speaker array streaming back to client: The world's most expensive sound spatializer?," Proc. ICAT: Int. Conf. on Artificial Reality and Tele-Existence, Tokyo, pp.162-169, Dec. 2002. vrsj.t.u-tokyo.ac.jp/ ic-at/ICAT2003/papers/02162.pdf
3. T. Okoshi, S. Wakayama, Y. Sugita, T. Iwamoto, J. Nakazawa, T. Nagata, D. Furusaka, M. Iwai, A. Kusumoto, N. Harshima, J. Yura, N. Nishio, Y. Tobe, Y. Ikeda, and H. Tokuda, "Smart space laboratory project: Toward the next generation computing environment," 1WNA: Proc. IEEE Third Int. Wkshp. on Networked Appliances, Singapore, March 2001.
4. E. Kolbert, "Pimps and dragons: How an online world survived a social breakdown," The New Yorker, pp.88-98, May 2001.
5. M. Naef, O. Staadt, and M. Gross, "Spatialized audio rendering for immersive virtual environments," Proc. ACM Symp. on Virtual Reality Software and Technology, Hong Kong, pp.65-72, ACM Press, 2002. ISBN 1-58113-530-0.
6. M. Cohen, "Exclude and include for audio sources and sinks: Analogs of mute & solo are deafen & attend," Presence: Teleoperators and Virtual Environments, vol.9, no.1, pp.84-96, Feb. 2000. ISSN 1054-7460; www.u-aizu.ac.jp/~mcohen/welcome/publications/iel.pdf
7. O.N.N. Fernando, K. Adachi, U.C. Duminduwardena, M. Kawaguchi, and M. Cohen, "Audio narrowcasting for multipresent avatars on workstations and mobile phones," Proc. ICAT: Thirteenth Int. Conf. on Artificial Reality and Telexistence, Tokyo, pp. 106-113, Dec. 2003. ISSN 1345-1278, http://vrsj.t.u-tokyo.ac.jp/ic-at/ICAT2003/php/program.php
8. M.S. Ackerman, "Privacy in pervasive environments: next generation labeling protocols," Personal Ubiquitous Comput., vol.8, no.6, pp.430-439, 2004.
9. M. Cohen and L.F. Ludwig, "Multidimensional audio window management," LTMMS: the J. of Person-Computer Interaction, vol.34, no.3, pp.319-336, March 1991. Special Issue on Computer Supported Cooperative Work and Groupware. ISSN 0020-7373.
10. M. Cohen and L.F. Ludwig, "Multidimensional audio window management," in Computer Supported Cooperative Work and Groupware, ed. S. Greenberg, ch. 10, pp. 193-210, Academic Press, London, 1991. ISBN 0-12-299220-2.
11. M. Cohen and N. Koizumi, "Virtual gain for audio windows," Presence: Teleoperators and Virtual Environments, vol.7, no.1, pp.53-66, Feb. 1998. ISSN 1054-7460.
12. S. Benford, J. Bowers, L.E. Fahlén, J.A. Mariani, and T. Rodden, "Supporting cooperative work in virtual environments," Comput. J., vol.37, no.8, pp.653-668, 1994.
13. C. Greenhalgh and S. Benford, "Massive: A collaborative virtual environment for teleconferencing," ACM Trans. Computer-Human Interaction, vol.2, no.3, pp.239-261, Sept. 1995.
14. S. Benford, J. Bowers, L. Fahlen, C. Greenhalgh, J. Mariani, and T. Rodde, "Networked virtual reality and cooperative work," Presence: Teleoperators and Virtual Environments, vol.4, no.4, pp.364 386, 1995. ISSN 1054-7460.
15. S. Benford, C. Greenhalgh, and D. Lloyd, "Crowded collaborative virtual environments," CHI'97: Proc. SIGCHI Conf. on Human Factors in Computing Systems, pp.59-66, ACM Press, Atlanta, 1997.
16. C. Greenhalgh and S. Benford, "Boundaries, awareness and interaction in collaborative virtual environments," WET-ICE '97: Proc. 6th Int. Wkshp. on Enabling Technologies: Infrastructure for Collaborative Enterprises, pp.193-198, IEEE Computer Society, 1997. ISBN 0-8186-7967-0.
17. S. Benford, C. Greenhalgh, G. Reynard, C. Brown, and B. Koleva, "Understanding and constructing shared spaces with mixed-reality boundaries," ACM Trans. Computer-Human Interaction, vol.5, no.3, pp. 185-223, Sept. 1998.
18. M. Garau, M. Slater, D.P. Pertaub, and S. Razzaque, "The responses of people to virtual humans in an immersive virtual environment," Presence: Teleoperators and Virtual Environments, vol.14, no.1, pp. 104-116, 2005.
19. M. Cohen, "Quantity of presence: Beyond person, number, and pronouns," in Cyberworlds, ed. T.L. Kunii and A. Luciani, ch. 19, pp.289-308, Springer-Verlag, Tokyo, 1998. ISBN 4-431-70207-5; www.u-aizu.ac.jp/~mcohen/welcome/publications/bil.pdf
20. H. Christein and P. Schulthess, "A general purpose model for presence awareness," Proc. Forth Int. Conf. on Distributed Communities on the Web, pp.24-34, Sydney, 2002.
21. H. Wallach, E.B. Newman, and M.R. Rosenzweig, "The precedence effect in sound localization," American J. of Psychology, vol.57, pp.315-336, 1949.
22. H. Haas, 'The influence of a single echo on the audibility of speech," J. Aud. Eng. Soc., vol.20, pp. 146-159, 1972.
23. J. Blauert, Spatial Hearing: The Psychophysics of Human Sound Localization, revised ed., MIT Press, 1997. ISBN 0-262-02413-6.
24. R.H. Gilkey and T.R. Anderson, eds., Binaural and Spatial Hearing in Real and Virtual Environments, Lawrence Erlbaum Associates, Mahway, NJ, 1997. ISBN 0-8058-1654-2.
25. D virtual environment for social telepresence," Proc. Western Computer Graphics Symp., Vernon, BC, Canada, March 2002.
26. N. Tsingos, "Perceptual audio rendering of complex virtual environments," Proc. of S1GGRAPH, pp.249-258, San Diego, Aug. 2004.
27. T. Kanno and M. Cohen, "An architecture for collaborative virtual environments," Proc. HC2001: 4th Int. Conf. on Human and Computer, pp.31-38, Aizu-Wakamatsu, Japan, Sept. 2001.
28. T. Kanno, M. Cohen, Y. Nagashima, and T. Hoshino, "Mobile control of multimodal groupware in a distributed virtual environment," Proc. ICAT: Int. Conf. on Artificial Reality and Tele-Existence, eds. S. Tachi, M. Hirose, R. Nakatsu, and H. Takemura, pp. 147-154, University of Tokyo, Tokyo, Dec. 2001. ISSN 1345-1278; sklabwww.pi.titech.ac.jp/~hase/ICATPHP/upload/39-camera.pdf; vrsj.t.u-tokyo.ac.jp/ic-at/ICAT2003/papers/01147.pdf.
29. T. Mikuriya, M. Shimizu, and M. Cohen, "A collaborative virtual environment featuring multimodal information controlled by a dynamic map," 3D Forum: J. of Three Dimensional Images, vol.15, no.1, pp.133-136, 3 2001. ISSN 1342-2189.
30. T. Kanno and M. Cohen, "An architecture for collaborative virtual environments," 3D Forum: J. of Three Dimensional Images, vol.16, no.1, pp.166-174, March 2002. ISSN 1342-2189.
31. O.N.N. Fernando, M. Cohen, N.A. Bolhassan, D. Wanasinghe, and T. Kanno, "Mobile control in Cyberspace of image-based & computer graphic scenes and spatial audio using stereo QTVR and Java3D," 3D Forum: J. of Three Dimensional Images, vol.16, no.4, pp. 101-106, Dec. 2002. ISSN 1342-2189.
32. E.F. Churchill, D.N. Snowdon, and A.J. Munro, eds., Collaborative Virtual Environments: Digital Places and Spaces for Interaction, Computer Supported Cooperative Work (CSCW), Springer, 2001. ISBN 1-85233-244-1.
33. M. Cohen and W.L. Martens, "Spatial media research at the University of Aizu," JVRSJ: J. of the Virtual Reality Society of Japan, vol.6, no.2, pp.52-57, Sept. 2001. ISSN 1342-6680.
34. R. Gordon and S. Talley, Essential JMF -Java Media Framework, Prentice Hall, 1999. ISBN0130801046.
35. T. Maremaa and W. Stewart, QuickTime for Java: a Programmer's Guide to Building Multimedia Applications with Java, 2nd ed., Morgan Kaufmann, 2005. ISBN 155860927X.
36. C. Adamson, QuickTime for Java: a Developer's Notebook, O'Reilly, 2005. ISBN0-596-00822-8.
37. H. Sowizral, K. Rushforth, and M. Deering, The Java 3D API Specification, second ed., Addison-Wesley, 2000. ISBN 0-201-71041-2.
38. I. Palmer, Essential Java 3D fast: developing 3D graphics applications, Springer, 2001. ISBN 1-85233-394-4.
39. J. Barrilleaux, 3D User Interfaces with Java 3D, Manning Publications, 2001. ISBN 1-88477-790-2.
40. A.E. Walsh and D. Gehringer, Java 3D API jump-start, Prentice-Hall, 2002. ISBN 0-13-034076-6.
41. A. Ota, Yasasiku wakaru Java 3D, Software Technology, Gijutsu Hyoron Sya, 2003. ISBN 4-7741-1669-6.
42. T. Hirouchi, Java 3D Graphics, Serendhippu, 2004. ISBN 4-7978-2055-1.
43. J. Knudsen, Wireless Java: Developing with Java 2, Micro Edition, Apress, 2001. ISBN 1-893115-50-X.
44. Y. Feng and J. Zhu, Wireless Java Programming with J2ME, Sams, 2001. ISBN 0-67232135-1.
45. ASCII Editing Group, iMode Java Programming, ASCII, 2001. ISBN 4-7561-3727-X.
46. Y. Yamazaki, How to make an iAppli, SOFTBANK, 2001. ISBN 4-7973-1573-3.
47. K. Topley, J2ME in a Nutshell, O'Reilly, 2002. ISBN 0-596-00253-X.
48. J.R. Vacca, I-Mode Crash Course, McGraw-Hill, 2002. ISBN 0-07-138187-2.
49. M. Kontio, Mobile Java with J2ME, IT Press, 2003. ISBN 951-826-554-2.
50. K. Walrath and M. Campione, The JFC Swing Tutorial, Addison-Wesley, 1999.ISBN 0-201-43321-4.
51. O.N.N. Fernando, K. Adachi, and M. Cohen, "Phantom sources for separation of listening and viewing positions for multipresent avatars in narrowcasting collaborative virtual environments," Proc. MNSA: Int. Wkshp. on Multimedia Network Systems and Applications (in conjunction with ICDCS: 24th Int. Conf. on Distributed Computing Systems), Hachiōji, Tokyo, pp. 170-175, March 2004. ISBN 0-7695-2087-1, ieeexplore.ieee.org/ie15/9027/28651/ 01284027.pdf.
52. O.N.N. Fernando, Java3D-based Development of a Spatial Audio Multipresence Application Featuring Narrowcasting Functions and Rotatable Loudspeaker Axis (Pairwise-Selected Speakers) for a Collaborative Virtual Environment, Master's thesis, University of Aizu, 2003.
53. Y. Nagashima and M. Cohen, "Distributed virtual environment interface for a mobile phone," 3D Forum: J. of Three Dimensional Images, vol.15, no.4, pp.102-106, 12 2001. ISSN 1342-2189.
54. O.N.N. Fernando, M. Cohen, U.C. Dumindawardana, and M. Kawaguchi, "Duplex narrowcasting operations for multipresent groupware avatars on mobile devices," IJWMC: Int. J. of Wireless and Mobile Computing (Special Issue on Mobile Multimedia Systems and Applications), vol.1, no.5, 2005. ISSN 1741-1084, 1741-1092.
55. O. Kirkeby, P.A. Nelson, and H. Hamada, 'The stereo dipole - binaural sound reproduction using two closely spaced loudspeakers," AES: Audio Engineering Society Conv., Munich, March 1997. Preprint 4463 (16).
56. Y. Yasuda, T. Ohya, D. McGrath, and P. Flanagan, "3-D audio communications services for future mobile networks," AES: Audio Engineering Society Conv. (23rd Int. Conf.), Helsingør, Copenhagen, Denmark, May 2003. 4-2.
57. Y. Yasuda, T. Ohya, D. McGrath, and P. Flanagan, "Reality speech/audio communications technologies," NTT Technical Review, vol.1, no.8, pp.95-100, Nov. 2004.
58. S. Roberts, Essential JTAPI: Java telephony, Prentice Hall, 1999. ISBN0-13-080360-X.
59. M. Kobayashi and C. Schmandt, "Dynamic soundscape: Mapping time to space for audio browsing," Proc. SIGCHI: Conf. on Human Factors in Computing Systems, pp.194-201, ACM Press, Atlanta, 1997.
60. P.M. Aoki, M. Romaine, M.H. Szymanski, J.D. Thornton, D. Wilson, and A. Woodruff, 'The mad hatter's cocktail party: a social mobile audio space supporting multiple simultaneous conversations," CHI: Proc. Conf. on Human Factors in Computing Systems, pp.425-432, ACM Press, Ft. Lauderdale, Florida, 2003.
61. A.S. Pentland, "Socially aware computation and communication," Computer, vol.38, no.3, pp.33-40, 2005.
62. S.J. Vaughan-Nichols, "Presence technology: More than just instant messaging," Computer, vol.36, no. 10, pp. 11-13, Oct. 2003. ISSN 0018-9162.
63. L. Dang, C. Jennings, and D. Kelly, Practical VoIP Using VOCAL, O'Reilly Media, Inc., Sebastopol, 2002. ISBN 0596000782.
64. A.B. Johnston, SIP: Understanding the Session Initiation Protocol, Artech House, London, 2004. ISBN 1580531687.
65. M. Radenkovic, C. Greenhalgh, and S. Benford, "Deployment issues for multi-user audio support in CVEs," Proc. ACM Symp. on Virtual Reality Software and Technology, pp. 179-185, ACM Press, Hong Kong, 2002.