Singing synthesis with an evolved physical model

IEEE Transactions on Audio, Speech and Language Processing

Volumn 14, Issue 4, 2006, Pages 1454-1461

  Cooper, Crispin ^b   Murphy, Damian ^b   Howard, David ^b   Tyrrell, Andy ^a,b  

^a IEEE   (United Kingdom)

^b UNIVERSITY OF YORK   (United Kingdom)

Author keywords

2 MUSI; Digital waveguide mesh; Finite difference; Genetic algorithms (GAs); Optimization methods; Singing synthesis; Speech synthesis; Voice analysis I

Indexed keywords

DIGITAL WAVEGUIDE MESH; SINGING SYNTHESIS; VOCAL TRACT; VOICE ANALYSIS;

FINITE DIFFERENCE METHOD; GENETIC ALGORITHMS; MEDICAL IMAGING; OPTIMIZATION; SPEECH ANALYSIS; SPEECH RECOGNITION;

SPEECH SYNTHESIS;

EID: 34047247720     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSA.2005.860844     Document Type: Article

References (35)

1. P. R. Cook, "Singing voice synthesis: History, current work, and future directions," Comput. Music J., vol. 20, no. 3, pp. 38-46, 1996.
2. H. Dudley, "The vocoder," Bell Lab. Rec., Dec. 1939.
3. G. Fant, Acoustic Theory of Speech Production. The Hague, The Netherlands: Mouton, 1960.
4. B. Atal, "Speech analysis and synthesis by linear prediction of the speech wave," J. Acoust. Soc. Amer., vol. 47, pp. 65(A)-65(A), 1970.
5. D. H. Klatt, "Review of text-to-speech conversion for English," J. Acoust. Soc. Amer., vol. 82, no. 3, pp. 737-793, 1987.
6. J. Kelly and C. Lochbaum, "Speech synthesis," in Proc. 4th Int. Congr. Acoustics, 1962, pp. 1-4.
7. P. Cook, "SPASM: A real-time vocal tract physical model editor/controller and singer; the companion software synthesis system," Comput. Music J., vol. 17, no. 1, pp. 30-44, 1992.
8. J. O. Smith, "Physical modeling using digital waveguides," Comput. Music J., vol. 16, no. 4, pp. 74-87, 1992.
9. J. Mullen, D. M. Howard, and D. T. Murphy, "Acoustical simulations of the human vocal tract using the 1D and 2D digital waveguide software model," in Proc. DAFx-04, Naples, Italy, Oct. 5-8, 2004, pp. 311-314.
10. _, "Waveguide physical modeling of vocal tract acoustics: Improved formant bandwidth control from increased model dimensionality," IEEE Trans. Speech Audio Process., vol. 14, no. 4, Jul. 2006, to be published.
11. _, "Digital waveguide mesh modeling of the vocal tract acoustics," in Proc. IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, 2003, pp. 119-122.
12. B. H. Story, I. R. Titze, and E. A. Hoffman, "Vocal tract area functions from magnetic resonance imaging," J. Acoust. Soc. Amer., vol. 104, no. 1, pp. 471-487, 1996.
13. B. H. Story, "Using imaging and modeling techniques to understand the relation between vocal tract shape to acoustic characteristics," in Proc. Stockholm Music Acoustics Conf., 2003, SMAC-03, pp. 435-438.
14. Markel and Gray, Linear Prediction of Speech. New York: Springer-Verlag, 1976.
15. D. P. Rossiter, D. M. Howard, and M. Downes, "A real-time LPC-based vocal tract area display for voice development," J. Voice, vol. 8, no. 4, pp. 314-319, 1995.
16. J. Schroeter and M. M. Sondhi, "Techniques for estimating vocal-tract shapes from the speech signal," IEEE Trans. Speech Audio Process., pt. II, vol. 2, no. 1, pp. 133-150, Jan. 1994.
17. C. Cooper, D. Howard, and A. Tyrrell, "Using GA's to create a waveguide model of the oral vocal tract," in Proc. Applications of Evolutionary Computing, EvoWorkshops, 2004, pp. 280-288.
18. T. Baeck, D. Fogel, and Z. Michalewicz, Evolutionary Computation. New York: Inst. Phys, 2000.
19. E. R. M. Abberton, D. M. Howard, and A. J. Fourcin, "Laryngographic assessment of normal voice: A tutorial," Clin. Linguist. Phon., vol. 3, pp. 281-296, 1989.
20. A. Tyrrell, E. Sanchez, D. Floreano, G. Tempesti, D. Mange, J.-M. Moreno, J. Rosenberg, and A. E. P. Villa, "POEtic tissue: An integrated architecture for bio-inspired hardware," in Lecture Notes in Computer Science, 2003, vol. 2606, pp. 129-140.
21. Garcia and A. Ricardo, "Automating the design of sound synthesis techniques using evolutionary methods," in Proc. DAFX, Limerick, Ireland, 2001, pp. 1-6.
22. J. E. Baker, "Reducing bias and inefficiency in the selection algorithm," in Proc. 2nd Int. Conf. Genetic Algorithms, 1987, pp. 14-21.
23. FAQ for Usenet Group comp.ai.genetic, Part 6. [Online]. Available: http://www-2.cs.cmu.edu/Groups/AI/html/faqs/ai/genetic/part6/faq-doc-6.html
24. Audio Clips. [Online]. Available: http://www.bioinspired.com/users/cc26/ poeticaudio
25. G. Campos and D. M. Howard, "A paralell 3-D digital waveguide mesh model with tetrahedral topology for toom acoustic simulation," in Proc. DAFX, Verona, Italy, 2000, pp. 73-78.
26. S. A. Van Duyne and J. O. Smith, "The 3D tetrahedral digital waveguide mesh with musical applications," in Proc. Int. Computer Music Conf., Hong Kong, 1996, pp. 9-16.
27. A. Kelloniemi, D. T. Murphy, L. Savioja, and V. Välimäki, "Boundary conditions in a multi-dimensional digital waveguide mesh," in Proc. IEEE Int. Conf. Acoustics, Speech and Signal Processing (ICASSP), Montreal, QC, Canada, May 17-21, 2004, pp. IV-25-IV-28.
28. A. Kelloniemi, L. Savioja, and V. Vlimki, "Spatial filter-based absorbing boundary for the 2-D digital waveguide mesh," IEEE Signal Process. Lett., vol. 12, pp. 126-129, Feb. 2005.
29. L. Savioja and V. Valimaki, "Interpolated rectangular 3-D digital waveguide mesh algorithms with frequency warping," IEEE Trans. Speech Audio Process., vol. 11, no. 6, pp. 783-789, Nov. 2003.
30. _, "Reducing the dispersion error in the digital waveguide mesh using interpolation and frequency warping techniques," IEEE Trans. Speech Audio Process., vol. 8, no. 2, pp. 184-194, Mar. 2000.
31. S. A. Van Duyne and J. O. Smith, "Physical modeling with the 2-D digital waveguide mesh," in Proc. Int. Computer Music Conf., Tokyo, Japan, 1993, pp. 40-47.
32. M. Karjalainen and C. Erkut, "Digital waveguides versus finite difference structures: Equivalence and mixed modeling," EURASIP J. Appl. Signal Process., vol. 7, pp. 978-989, 2004.
33. J. O. Smith. (2004) On the Equivalence of Digital Waveguide and Finite Difference Time Domain Schemes. [Online]. Available: http://arxiv.org/abs/ physics/0407032.
34. M. J. Beeson and D. T. Murphy, "Roomweaver: A digital waveguide mesh based room acoustics research tool," in Proc. 7th Int. Conf. Digital Audio Effects (DAFX), Naples, Italy, Oct. 5-8, 2004, pp. 268-273.
35. L. Savioja, T. J. Rinne, and T. Takala, "Simulation of room acoustics with a 3-D finite difference mesh," in Proc. Int. Computer Music Conf., 1994, pp. 463-466.