Expressive concatenative synthesis by reusing samples from real performance recordings

Computer Music Journal

Volumn 33, Issue 4, 2009, Pages 23-42

  Maestre, Esteban ^a   Ramírez, Rafael ^a   Kersten, Stefan ^a   Serra, Xavier ^a  

^a UNIVERSITAT POMPEU FABRA   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

PERFORMANCE CHARACTERISTICS; PERFORMANCE MODEL; SYNTHESIS PROCESS;

ACOUSTIC DEVICES;

SYNTHESIS (CHEMICAL);

EID: 73649087629     PISSN: 01489267     EISSN: 15315169     Source Type: Journal    
DOI: 10.1162/comj.2009.33.4.23     Document Type: Article

References (44)

1. Amatriain, X., et al. 2002. "Spectral Processing." In U. Zoelzer, ed. DAFX Digital Audio Effects. New York: Wiley, pp. 373-438.
2. Arcos, J., R. de Mantaras, and X. Serra. 1997. "SaxEx: A Case-Based Reasoning System for Generating Expressive Musical Performances." Proceedings of the 1997 International Computer Music Conference. San Francisco, California: International Computer Music Association, pp. 329-336.
3. Aucouturier, J. J., and F. Pachet. 2006. "Jamming with Plunderphonics: Interactive Concatenative Synthesis of Music." Journal of New Music Research 35(1):35-50.
4. Beller, G., et al. 2005. "A Hybrid Concatenative Synthesis System on the Intersection of Music and Speech." Proceedings of 2005 Jounées d'Informatique Musicale. Lyon, France: GRAME, pp. 41-45.
5. Bernstein, A. D., and E. D. Cooper. 1976. "The Piecewise Linear Technique of Electronic Music Synthesis." Journal of the Audio Engineering Society 24(6):446-454.
6. Blockeel, H., L. De Raedt, and J. Ramon. 1998. "Top-down Induction of Clustering Trees." Proceedings of the 15th International Conference on Machine Learning. San Francisco, California: Morgan Kaufmann, pp. 55-63.
7. Bonada, J., and A. Loscos. 2003. "Sample-Based Singing Voice Synthesis Based in Spectral Concatenation." Proceedings of the 2003 Stockholm Music and Acoustics Conference. Stockholm: KTH, pp. 439-442.
8. Bonada, J., and X. Serra. 2007. "Synthesis of the Singing Voice by Performance Sampling and Spectral Models." IEEE Signal Processing Magazine 24(2):67-78.
9. Bresin, R. 2002. "Articulation Rules for Automatic Music Performance." Proceedings of the 2001 International Computer Music Conference. San Francisco, California: International Computer Music Association, pp. 294-297.
10. Canazza, S., et al. 2004. "Modelling and Control of Expressiveness in Music Performance." Proceedings of the IEEE 92(4):686-701.
11. Danneberg, R. B., and I. Derenyi. 1998. "Combining Instrument and Performance Models for High Quality Music Synthesis." Journal of New Music Research 27(3):211-238.
12. Dannenberg, R. B., A. Pellerin, and I. Derenyi. 1998. "A Study of Trumpet Envelopes." Proceedings of the 1998 International Computer Music Conference. San Francisco, California: International Computer Music Association, pp. 57-61.
13. Dubnov, S., and X. Rodet. 1998. "Study of Spectro-Temporal Parameters in Musical Performance, With Applications for Expressive Instrument Synthesis." Proceedings of the 1998 IEEE International Conference on Systems Man and Cybernetics. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, pp. 1091-1094.
14. Friberg, A., et al. 1998. "Musical Punctuation on the Microlevel: Automatic Identification and Performance of Small Melodic Units." Journal of New Music Research 27(3):217-292.
15. Gabrielsson, A. 1999. "The Performance of Music." In D. Deutsch, ed. The Psychology of Music, 2nd ed. New York: Academic Press, pp. 501-602.
16. Gomez, E., et al. 2003. "Melodic Characterization of Monophonic Recordings for Expressive Tempo Transformations." Proceedings of the 2003 Stockholm Music and Acoustics Conference. Stockholm: KTH, pp. 203-206.
17. Hunt, A. J., and A. W. Black. 1996. "Unit Selection in a Concatenative Speech Synthesis System Using a Large Speech Database." Proceedings of the 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, pp. 373-376.
18. Jensen, K. 1999. "Envelope Model of Isolated Musical Sounds." Proceedings of the 1999 DAFx (Digital Audio Effects) Conference. Trondheim, Norway, pp. 35-40.
19. Klapuri, A. 1999. "Sound Onset Detection by Applying Psychoacoustic Knowledge." Proceedings of the 1999 IEEE International Conference on Acoustics, Speech and Signal Processing. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, pp. 3089-3092.
20. Klatt, D. H. 1983. "Review of Text-to-Speech Conversion for English." Journal of the Acoustics Society of America 82(3):737-793.
21. Laroche, J. 2003. "Frequency-Domain Techniques for High-Quality Voice Modification." Proceedings of the 2003 DAFx (Digital Audio Effects) Conference. London: Queen Mary, University of London, pp. 328-332.
22. Lindemann, E. 2007. "Music Synthesis with Reconstructive Phrase Modeling." IEEE Signal Processing Magazine 24(2):80-91.
23. Lopez de Mantaras, R., and J. L. Arcos. 2002. "AI and Music, from Composition to Expressive Performance. AI Magazine 23(3):43-57.
24. Maestre, E., and E. Gomez. 2005. "Automatic Characterization of Dynamics and Articulation of Monophonic Expressive Recordings." Proceedings of the 118th AES Convention. New York: Audio Engineering Society, paper number 6364.
25. Maestre, E., et al. 2006. "Using Concatenative Synthesis for Expressive Performance in Jazz Saxophone." Proceedings of the 2006 International Computer Music Conference. San Francisco, California: International Computer Music Association, pp. 219-222.
26. Narmour, E. 1990. The Analysis and Cognition of Basic Melodic Structures: The Implication Realization Model. Chicago, Illinois: University of Chicago Press.
27. Peeters, G. 2004. "A Large Set of Audio Features for Similarity and Classification." CUIDADO IST Project Report. IRCAM.
28. Prudon, R. 2003. "A Selection/Concatenation TTS Synthesis System." PhD Thesis, LIMSI, University of Paris XI.
29. Ramirez, R., A. Hazan, and E. Maestre. 2005. "Intra-Note Features Prediction Model for Jazz Saxophone Performance." Proceedings of the 2005 International Computer Music Conference. San Francisco, California: International Computer Music Association, pp. 373-376.
30. Ramirez, R., A. Hazan, and E. Maestre. 2006a. "A Tool for Generating and Explaining Expressive Music Performances of Monophonic Jazz Melodies." International Journal on Artificial Intelligence Tools 15(4):673-691.
31. Ramirez, R., A. Hazan, and E. Maestre. 2006b. "A Data Mining Approach to Expressive Music Performance Modeling." In V. A. Petrushin and L. Khan, eds. Multimedia Data Mining and Knowledge Discovery. London: Springer, pp. 362-379.
32. Ramirez R., et al. 2007. "Performance-based Interpreter Identification in Saxophone Audio Recordings." IEEE Transactions on Circuits and Systems for Video Technology 7(3):356-364.
33. Ramirez, R., et al. 2008. "A Genetic Rule-based Expressive Performance Model for Jazz Saxophone." Computer Music Journal 32(1):338-350.
34. Repp, B. H. 1992. "Diversity and Commonality in Music Performance: An Analysis of Timing Microstructure in Schumann's Traumerei." Journal of the Acoustical Society of America 92(5):2546-2568.
35. Sagisaka, T. 1988. "Speech Synthesis by Rule Using an Optimal Selection of Non-Uniform Synthesis Units." Proceedings of the 1988 IEEE International Conference on Acoustics, Speech, and Signal Processing. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, pp. 679-682.
36. Schwarz, D. 2000. "A System for Data-Driven Concatenative Sound Synthesis." Proceedings of the 2000 DAFx (Digital Audio Effects) Conference. Verona: University of Verona, pp. 97-102.
37. Schwarz, D. 2004. "Data-Driven Concatenative Sound Synthesis." PhD Thesis, University of Paris VI, France.
38. Schwarz, D. 2006. "Concatenative Sound Synthesis: The Early Years." Journal of New Music Research 35(1):3-22.
39. Schwarz, D. 2007. "Corpus-Based Concatenative Synthesis." IEEE Signal Processing Magazine 24(2):92-104.
40. Seashore, C. E., ed. 1936. Objective Analysis of Music Performance. Iowa City: University of Iowa Press.
41. Simon, I., et al. 2005. "Audio Analogies: Creating New Music from an Existing Performance by Concatenative Synthesis." Proceedings of the 2005 International Computer Music Conference. San Francisco, California: International Computer Music Association, pp. 65-72.
42. Todd, N. 1992. "The Dynamics of Dynamics: A Model of Musical Expression." Journal of the Acoustical Society of America 91(6):3540-3550.
43. Viterbi, A. J. 1967. "Error Bounds for Convolutional Codes and an Asymptotically Optimum Decoding Algorithm." IEEE Transactions on Information Theory 13(2):260-269.
44. Widmer, G. 2001. "Discovering Strong Principles of Expressive Music Performance with the PLCG Rule Learning Strategy." Proceedings of the 12th European Conference on Machine Learning (ECML'01). Berlin: Springer-Verlag, pp. 552-563.