A multichannel recurrent network analysis/synthesis model for coupled-string instruments

IEEE Transactions on Audio, Speech and Language Processing

Volumn 14, Issue 6, 2006, Pages 2233-2241

  Chang, Wei Chen ^a   Su, Alwin W Y ^a  

^a NATIONAL CHENG KUNG UNIVERSITY   (Taiwan)

Author keywords

Coupling phenomenon; Parameter estimation; Recurrent neural networks; Sound synthesis

Indexed keywords

ANALYSIS/SYNTHESIS; COMPLEX MODULATIONS; COMPLEX TONES; COUPLING PHENOMENON; INFINITE IMPULSE RESPONSE; MULTICHANNEL; NEURAL-NETWORK; RECURRENT NETWORKS; SOUND SYNTHESIS; STRING INSTRUMENTS; STRING MODELS; STRONG COUPLINGS; SYNTHESIS METHODS; SYNTHESIS MODELS; SYNTHESIS PARAMETERS;

COMPLEXATION; IMPULSE RESPONSE; METAL ANALYSIS; MUSICAL INSTRUMENTS; PARAMETER ESTIMATION; SYNTHESIS (CHEMICAL);

RECURRENT NEURAL NETWORKS;

EID: 64549163611     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2006.872610     Document Type: Article

References (40)

1. G. Weinreich, "Coupled piano string," J. Acoust. Soc. Amer., vol. 62, no. 6, pp. 1474-1484, Dec. 1977.
2. J. O. Smith, III, "Waveguide filter tutorial," in Proc. Int. Comput. Music Conf., Champaign-Urbana, IL, 1987, pp. 9-16.
3. -, "Efficient synthesis of stringed musical instruments," in Proc. 1993 Int. Comput. Music Conf., Tokyo, Japan, Sep. 1993, pp. 64-71.
4. A. V. Oppenheim and R. W. Schafer, Discrete-Time Signal Processing. Englewood Cliffs, NJ: Prentice-Hall, 1989.
5. J. O. Smith, III and S. A. Van Duyne, "Commuted piano synthesis," in Proc. 1995 Int. Comput. Music Conf., Banff, AB, Canada, 1995, pp. 319-326.
6. M. Karjalainen, V. Välimäki, and T. Tolonen, "Plucked-string models: from Karplus-strong algorithm to digital waveguides and beyond," Comput. Music J., vol. 22, no. 3, pp. 17-32, 1998.
7. M. Aramaki, J. Bensa, L. Daudet, P. Guillemain, and R. Kronland-Martinet, "Resynthesis of coupled piano string vibrations based on physical modeling," J. New Music Res., vol. 30, no. 3, pp. 213-226, 2002.
8. J. Bensa, "Analyze et synthèse de sons de piano par modèles physiques et de signaux" PhD dissertation, Laboratoire de Micanique et d'Acoustique , Centre National de la Recherche Scientifique, Marseille, France, 2003 [Online]. Available: http://www.lma.cnrs-mrs.fr/ ̃ebensa/
9. B. Bank, "Accurate and efficient modeling of beating and two-stage decay for string instrument synthesis," in Proc. MOSART Workshop Current Res. Directions in Comput. Music, Barcelona, Spain, 2001, pp. 134-137.
10. M. Karjalainen, V. Välimäki, and Z. Jánosy, "Toward high-quality sound synthesis of the guitar and string instruments," in Proc. Int. Comput. Music Conf., 1993, pp. 56-63.
11. J. O. Smith, III, Music Application of Digital Waveguide Stanford Univ., CCRMA Tech. Rep. STAN-M-39, 1987 [Online]. Available: http://ccrma.stanford.edu/ STANM/
12. V. Välimäki, J. Huopaniemi, M. Karjalainen, and Z. Jánosy, "Physical modeling of plucked string instruments with application to real-time sound synthesis," J. Audio Eng. Soc., vol. 44, no. 5, pp. 331-353, 1996.
13. M. A. Casey, "Understanding musical sound with forward models and physical models," Connect. Sci., vol. 6, pp. 355-371, 1994.
14. A. Nackaerts, B. De Moor, and R. Lawereins, "Parameter estimation for dual-polarized plucked string models," in Proc. Int. Comput. Music Conf., Havana, Cuba, Sep. 2001, pp. 203-206.
15. C. Traube and J. O. Smith, "Estimating the plucked point on guitar string," in Conf. Digital Audio Effects, Dec. 2000, pp. 153-158.
16. J. Riionheimo and V. Välimäki, "Parameter estimation of a plucked string synthesis model using genetic algorithm with perceptual fitness calculation," EURASIP J. Appl. Signal Process., vol. 2003, no. 8, pp. 791-805, Jul. 2003.
17. S. Serafin, J. O. Smith, III, and H. Thornburg, "A pattern recognition approach to invert a bowed string physical model," in Proc. Int. Symp. Mus. Acoust., Perugia, Italy, Sep. 2001, pp. 241-244.
18. S. Serafin, J. O. Smith, III, H. Thornburg, F. Mazzella, A. Tellier, and G. Thonier, "Data driven identification and computer animation of a bowed string model," in Proc. Int. Comput. Music Conf.,Havana, Cuba, Sep. 2001.
19. W. D'haes and X. Rodet, "Automatic estimation of control parameters: an instance-based learning approach," in Proc. Int. Comput. Music Conf., Sep. 2001, pp. 199-202.
20. T. Helie, C. Vergez, J. Levine, and X. Rodet, "Inversion of a physical model of a trumpet," in Proc. Int. Comput. Music Conf., 1999, pp. 149-152.
21. A. W. Y. Su, S. F. Liang, and C. T. Lin, "Model-based synthesis of plucked string instruments by using a class of scattering recurrent networks," IEEE Trans. Neural Netw., vol. 11, no. 1, pp. 1-16, Jan. 2000.
22. S. F. Liang and A. W. Y. Su, "Recurrent neural network based physical model for the chin and other plucked-string instruments," J. Audio Eng. Soc., vol. 48, pp. 1045-1059, Nov. 2000.
23. A. W. Y. Su and S. F. Liang, "A new automatic IIR analysis/synthesis technique for plucked-string instruments," IEEE. Trans. Speech Audio Process., vol. 9, no. 7, pp. 747-754, Oct. 2001.
24. E. D. Scheirer, "Structured audio and effects processing in the MPEG-4 multimedia standard," Multimedia Syst., vol. 7, pp. 11-22, 1999.
25. B. L. Vercoe, W. G. Gardner, and E. D. Scheirer, "Structured audio: Creation, transmission, and rendering of parametric sound representations," Proc. IEEE, vol. 86, no. 5, pp. 922-940, May 1998.
26. A. W. Y. Su, Y.-S. Xiao, J.-L. Yeh, and J.-L. Wu, "Real-time internet MPEG-4 SA player and the streaming engine," presented at the 116th Convention Audio Eng. Soc., Berlin, Germany, May 2004, Paper 6025.
27. T. Tolonen, V. Välimäki, and M. Karjalainen, "Modeling of tension modulation nonlinearity in plucked string," IEEE. Trans. Speech Audio Process., vol. 8, no. 3, p. 300, May 2000.
28. J. O. Smith, III, "Physical modeling synthesis update," Comput. Music J., vol. 20, no. 2, pp. 44-56, Summer 1996.
29. W.-C. Chang and A. W. Y. Su, "Synthesizing coupled-string musical instruments with a multichannel recurrent network," presented at the 116th Convention Audio Eng. Soc., Berlin, Germany, May 2004, Paper 6042.
30. L. E. Kinsler, A. R. Frey, A. B. Coppens, and J. V. Sanders, Fundamentals of Acoustics. New York: Wiley, 1980.
31. P. Magnusson, Transmission Lines and Wave Propagation. Boston, MA: Allyn and Bacon, 1970.
32. T. W. Parks and C. S. Burrus, Digital Filter Design. New York: Wiley, 1987.
33. Z. Nehari, Conformal Mapping. New York: McGraw-Hill, 1952.
34. J. R. Pierce and S. A. Van Duyne, "A passive nonlinear digital filter design which facilitates physics-based sound synthesis of highly nonlinear musical instruments," J. Acoust. Soc. Amer., vol. 101, no. 2, pp. 1120-1126, Feb. 1997.
35. R. J. Williams and D. Zipser, "A learning algorithm for continually running fully recurrent neural networks," Neural Comput., vol. 1, pp. 270-280, 1989.
36. R. J. Williams and J. Peng, "An efficient gradient-based algorithm for on-line training of recurrent network trajectories," Neural Comput., vol. 2, pp. 490-501, 1990.
37. H. D. Bodman, Chinese Musical Iconography: A History of Musical Instrument Depicted in Chinese Art. Taipei, Taiwan, R.O.C.: Asian- Pacific Cultural Center, 1987.
38. B. Bank, F. Avanzini, G. Borin, G. De Poli, F. Fontana, and D. Rocchesso, "Physically informed signal-processing methods for piano sound synthesis: a research overview," EURASIP J. Appl. Signal Process., vol. 2003, no. 10, pp. 941-952, 2003.
39. A. Askenfelt, Five Lectures on the Acoustics of the Piano Royal Swedish Academy of Music, Publication no. 64. Stockholm, Sweden, 1990 [Online]. Available: http://www.speech.kth.se/music/ 5-lectures/
40. H. Suzuki, "Model analysis of a hammer-string interaction," J. Acoust. Soc. Amer., vol. 4, pp. 1145-1151, Oct. 1987.