Object-based sound synthesis for virtual environments

IEEE Signal Processing Magazine

Volumn 17, Issue 6, 2000, Pages 37-57

  Pedersini, Federico ^a   Sarti, Augusto ^a,b,c   Tubaro, Stefano ^d  

^a POLITECNICO DI MILANO   (Italy)

^b UNIVERSITY OF PADOVA   (Italy)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d NONE

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTIC GENERATORS; COMPUTER AIDED DESIGN; COMPUTER SIMULATION; COMPUTER VISION; HUMAN COMPUTER INTERACTION; IMAGE PROCESSING; INFORMATION RETRIEVAL; INTERNET; MULTIMEDIA SYSTEMS; THREE DIMENSIONAL COMPUTER GRAPHICS; VIRTUAL REALITY;

MOTION PICTURE EXPERT GROUP; OBJECT BASED SOUND SYNTHESIS; POTENTIAL INTERACTION TOPOLOGY; SOUND GENERATION; WAVE DIGITAL STRUCTURES;

SOUND REPRODUCTION;

EID: 85032752324     PISSN: 10535888     EISSN: None     Source Type: Journal    
DOI: 10.1109/79.888863     Document Type: Article

References (73)

1. J. Allen and D, Berkley, "Image method for efficiently simulating small-room acoustics," J. Acoustical Soc. Amer., vol. 65, no. 4, pp. 912-915, Apr. 1979.
2. P. Beardsley, P. Torr, and A. Zisserman, "3-D model acquisition from extended image sequences," in Proc. ECCV '96, Cambridge, UK, Apr. 14-18, 1996, vol. 2, pp. 683-695.
3. V. Belevitch, Classical Network Theory. San Francisco, CA: Holden Day, 1968.
4. A. Blake and A. Zisserman, Visual Reconstruction. Cambridge, MA: MIT Press, 1987.
5. G. Borin, G. De Poli, and A. Sarti, "A modular approach to excitator-resonator interaction in physical models synthesis," in Proc. Int. Computer Music Conf., Columbus, OH, Nov. 1990, pp. 46-50.
6. G. Borin, G. De Poli, and A. Sarti, "Sound synthesis by dynamic systems interaction," in Readings in Computer-Generated Music, D. Baggi, Ed. Los Alamitos, CA: IEEE Computer Society Press, 1992, pp. 139-160.
7. G. Borin, G. De Poli, and A. Sarti, "Algorithms and structures for synthesis using physical models," Computer Music J., vol. 19, no. 4, pp. 30-42, 1992.
8. G. Borin, G. De Poli, and A. Sarti, "Musical signal synthesis," in Musical Signal Processing, C. Roads, S. Pope, A. Piccialli, and G. DePoli, Eds. Lisse, Netherlands: Swets and Zeitlinger, 1996, pp. 5-30.
9. J. Borish, "Extension of the image model to arbitrary polyhedra," J. Acoust. Soc. Amer., vol. 75, no. 6, pp. 1827-1836, June 1984.
10. K. Brandenburg, "Perceptual coding of high quality digital audio," in Applications of Digital Signal Processing to Audio and Acoustics, M. Kahrs and K. Brandenburg, Eds. Norwell, MA: Kluwer, 1998, pp. 85-131.
11. L.O. Chua, "Synthesis of new nonlinear network elements," Proc. IEEE, vol. 56, pp. 1325-1340, Aug. 1968.
12. L.O. Chua, Introduction to Nonlinear Network Theory. New York: McGraw-Hill, 1969.
13. L.O. Chua, "Memristor - The missing circuit element," IEEE Trans. Circuit Theory, vol. CT-18, pp. 507-519, Sept. 1971.
14. L.O. Chua, "Device modeling via basic nonlinear circuit elements," IEEE Trans. Circuits Syst., vol. CAS-27, pp. 1014-1044, Nov. 1980.
15. L.O. Chua, "Dynamic nonlinear networks: State-of-the-art," IEEE Trans. Circuits Syst., vol. CAS-27, pp. 1059-1087, Nov. 1980.
16. L.O. Chua, "Nonlinear circuits," IEEE Trans. Circuits Syst., vol. CAS-31, pp. 69-87, Jan. 1984.
17. M.F. Cohen and J.K. Wallace, Radiosity and Realistic Image Synthesis. Reading, MA: Academic, 1993.
18. R.L. Cook, T. Porter, and L. Carpenter. "Distributed ray tracing," in Proc. SIGGRAPH'84, vol. 18, pp. 137-146.
19. N. Dadoun, D.G. Kirkpatrick, and J.P. Walsh. "The geometry of beam tracing," in Proc. Symp. Computational Geometry, Baltimore, MD, June, 1985, pp. 55-71.
20. G. De Poli, "A tutorial on digital sound synthesis techniques," in The Music Machine, C. Roads, Ed. Cambridge, MA: MIT Press, 1992, pp. 429-447.
21. T. Felderhoff, "Simulation of nonlinear circuits with period doubling and chaotic behavior by wave digital principles," IEEE Trans. Circuits Syst. I, vol. CAS-41, pp. 485-491, July 1994.
22. T. Felderhoff, ØA new wave description for nonlinear elements,Ø IEEE Int. Symp. Circuits and Systems, Atlanta, GA, May 12-15, 1996, pp. 221-224.
23. A. Fettweis, ØWave digital filters: Theory and practice,Ø Proc. IEEE, vol. 74, pp. 327-270, Feb. 1986.
24. A. Fettweis, ØSome principles of designing digital filters imitating classical filter structures,Ø IEEE Trans. Circuit Theory, vol. CT-18, pp. 314-316, Mar. 1971.
25. A. Fettweis, ØPseudopassivity, sensitivity, and stability of wave digital filters,Ø IEEE Trans. Circuit Theory, vol. CT-19, pp. 668-673, Nov. 1972.
26. A. Fettweis and K. Meerkötter, "On adaptors for wave digital filters," IEEE Trans. Acoustic, Speech, Signal Processing, vol. ASSP-23, pp. 516-525, Dec. 1975.
27. J.D. Foley, A. van Dam, S.K. Feiner, and J.F. Hughes, Computer Graphics: Principles and Practice. 2nd ed. in C, Reading, MA: Addison-Wesley, 1996.
28. F. Fontana and D. Rocchesso, "Physical modeling of membranes for percussion instruments," Acustica - Acta Acustica, vol. 84. no. 3, pp. 529-542, May-June 1998.
29. T. Funkhouser, I. Carlbom, G. Elko, G. Pingali, M. Sondhi, and J. West, "A beam tracing approach to acoustic modeling for interactive virtual environments," in Proc. SIGGRAPH'98, pp. 21-32.
30. W. Gardner, "Reverberation algorithms," in Applications of Digital Signal Processing to Audio and Acoustics, M. Kahrs and K. Brandenburg, Eds. Norwell, MA: Kluwer, 1998, pp. 85-131.
31. A.S. Glassner, An Introduction to Ray Tracing. New York: Academic, 1989.
32. C.M. Goral, K.E. Torrance, D.P. Greenberg, and B. Battaile, "Modeling the interaction of light between diffuse surfaces." in Proc. SIGGRAPH'84, vol. 18, pp. 213-222.
33. R. Hall, Illumination and Color in Computer-Generated Imaging. New York: Springer-Verlag, 1989.
34. P. Heckbert and P. Hanrahan, "Beam tracing polygonal objects," in Proc. SIGGRAPH'84, vol. 18, pp. 119-127.
35. M. Hodgson, "Evidence of diffuse surface reflections in rooms," J. Acoust. Soc. Amer., vol. 89, pp. 765-771, 1991.
36. J. Huopaniemi, L. Savioja, and T. Takala, "DIVA virtual audio reality system," in Proc. Int. Conf. Auditory Display, (ICAD'96), Palo Alto, CA, Nov. 4-6, 1996, pp. 111-116.
37. C.B. Jones, "A new approach to the 'hidden line' problem," Computer J., vol. 14, no. 3, pp. 232-237, Aug. 1971.
38. J.T. Kajiya, "The rendering equation," in Proc. SIGGRAPH'86, vol. 20, pp. 143-150.
39. T. Kanade, P. Rander, and P.J. Narayanan, "Virtualized reality: Constructing virtual worlds from real scenes." IEEE Multimedia, vol. 4, pp. 34-47, Jan.-Mar. 1997.
40. H. Krauß and R. Rabenstein, "Application of multidimensional wave digital filters to boundary value problems," IEEE Signal Processing Lett., vol. 2, pp. 138-140, July 1995.
41. H. Krauß, R. Rabenstein, and M. Gerken, "Simulation of wave propagation by multidimensional digital filters," J. Simulation Practice Theory, vol. 4, pp. 361-382, 1996.
42. U.R. Krockstadt, "Calculating the acoustical room response by the use of a ray tracing technique," J. Sound Vibr., no. 8, vol. 18, 1968.
43. H. Kuttruff, Room Acoustics, 3rd ed. New York: Elsevier Science, 1991.
44. H. Kuttruff, "A simple iteration scheme for the computation of decay constants in enclosures with diffusely reflecting boundaries," J. Acoustic Soc. Amer., vol. 98, no. 1, pp. 288-293, July 1995.
45. H. Lehnert, "Systematic errors of the ray-tracing algorithm," J. Applied Acoustics, vol. 38, nos. 2-4, pp. 207-221, 1993.
46. T. Lewers, "A combined beam tracing and radiant exchange computer model of room acoustics," J. Applied Acoustics, vol. 38, nos. 2-4, pp. 161-178, 1993.
47. T. Lokki, L. Savioja, and J. Hiipakka, "Immersive 3-D sound reproduction in virtual room," in Proc. AES 16th Int. Conf. Spatial Sound Reproduction, Rovaniemi, Finland, Apr. 10-12, 1999, pp. 172-177.
48. D.C. Massie, "Wavetable sampling synthesis," in Applications of Digital Signal Processing to Audio and Acoustics, M. Kahrs and K. Brandenburg, Eds. Norwell, MA: Kluwer, 1998, pp. 85-131.
49. K. Meerkötter and R. Scholtz. "Digital simulation of nonlinear circuits by wave digital filter principles," in Proc. IEEE Int. Symp. Circuits and Systems, Portland, OR, May 8-11, 1989, vol. 1, pp. 720-723.
50. F. Pedersini, A. Sarti, and S. Tubaro, "Block-wise physical model synthesis for musical acoustics," IEE Electron. Lett., vol. 35, no. 17, pp. 1418-1419, Aug. 1999.
51. F. Pedersini, A. Sarti, S. Tubaro, and R. Zattoni, "Toward the automatic synthesis of nonlinear wave digital models for musical acoustics," in Proc. IX Euro. Signal Processing Conf., Sept. 8-11, 1998, Rhodes, Greece, vol. IV, pp. 2361-2364.
52. F. Pedersini, P. Pigazzini, A. Sarti, and S. Tubaro, "3-D area marching with arbitrary multiview geometry," in Proc. EURASIP Signal Processing: Image Communications, vol. 14, nos. 1-2, pp. 71-94, 1998.
53. F. Pedersini, A. Sarti, and S. Tubaro, "multicamera systems: calibration and applications," IEEE Signal Processing Map., vol. 16, pp. 55-65, May 1999.
54. F. Pedersini, A. Sarti, and S. Tubaro, "Visible surface reconstruction with accurate localization of object boundaries," IEEE Trans. Circuits Syst. Video Technol., vol. 10, pp. 278-291, Mar. 2000.
55. F. Pedersini, P. Pigazzini, A. Sarti, and S. Tubaro, "Multicamera motion estimation for high-accuracy 3-D reconstruction." EURASIP Signal Processing, vol. 80, no. 1, pp. 1-21, Jan. 2000.
56. R. Rabenstein and H. Krauß: "Discrete simulation of uniform transmission lines by multidimensional digital filters." Int. J. Numer. Model., vol. 9, pp. 271-294, 1996.
57. D. Rocchesso J and O. Smith: "Circulant and elliptic feedback delay networks for artificial reverberation," IEEE Trans. Speech Audio Processing, vol. 5, no. 1, pp. 51-63, Jan. 1997.
58. D. Rocchesso, "Maximally diffusive yet efficient feedback delay networks for artificial reverberation," IEEE Signal Processing Lett., vol. 4, no. 9, pp. 252-255, Sept. 1997.
59. D. Rocchesso and F. Scalcon, "Bandwidth of perceived inharmonicity for physical modeling of dispersive strings," IEEE Trans. Speech Audio Processing, vol. 7, pp. 597-601, Sept. 1999.
60. A. Sarti and G. De Poli, "Generalized adaptors with memory for nonlinear wave digital structures." in Proc. VIII European Signal Processing Conf., Trieste, Italy, 1996, vol. 3, pp. 1773-1776.
61. A. Sarti and G. De Poli, "Toward nonlinear wave digital filters," IEEE Trans. Signal Processing, vol. 47, pp. 1654-1668, June 1999.
62. L. Savioja, J. Huopaniemi, T. Lokki, and R. Väänänen, "Virtual environment simulation advances in the DIVA project," in Proc. Int. Conf. Auditory Display (ICAD'97), Palo Alto, CA, Nov. 3-5, 1997, pp. 43-46.
63. J.O. Smith, "Acoustic modeling using digital waveguides,ß in Musical Signal Processing, C. Roads, S.T. Pope, A. Piccialli, and G. DePoli, Eds. Lisse, The Netherlands: Swets and Zeitlinger, 1997, pp. 221-263.
64. J.O. Smith, "Principles of digital waveguide models of musical instruments," in Applications of Digital Signal Processing to Audio and Acoustics, M. Kahrs and K. Brandenburg, Eds. Norwell, MA: Kluwer, 1998, pp. 417-466.
65. S.J. Teller and C.H. Séquin, "Visibility preprocessing for interactive walkthroughs," in Proc. SIGGRAPH'91, vol. 25, pp. 61-69.
66. D. Terzopoulos and A. Witkin, "Physically based models with rigid and deformable components," IEEE Computer Graphics and Applications, vol. 8, no. 6, pp. 41-51, 1988.
67. D. Terzopoulos and D. Thalmann, Computer Animation and Simulation. New York: Springer-Verlag, 1995.
68. http://www.3-Dscanners.com/
69. N. Tsingos and J. Gascuel, "A general model for simulation of room acoustics based on hierarchical radiosity, technical sketches," in SIGGRAPH 97 Visual Proc., 1997.
70. Väänänen, V. Välimäki, J. Huopaniemi, and M. Karjalainen, "Efficient and parametric reverberator for room acoustics modeling," in Proc. Int. Computer Music Conf. (ICMC'97), Thessaloniki, Greece, Sept. 25-30, 1997, pp. 200-203.
71. S.A. Van Duyne, J.R. Pierce, and J.O. Smith, "Traveling-wave implementation of a lossless mode-coupling filter and the wave digital hammer," in Proc. 1994 Intl. Computer Music Conf., 1994, pp. 411-418.
72. E. Van Gool and A. Zisserman, "Automatic 3-D model building from video sequences," Euro. Trans. Telecommun., vol. 8, no. 4, pp. 369-378, July-Aug. 1997.
73. T. Whitted, "An improved illumination model for shaded display," Commun. ACM, vol. 23, no. 6, pp. 343-349, June 1980.