Performance control driven violin timbre model based on neural networks

IEEE Transactions on Audio, Speech and Language Processing

Volumn 20, Issue 3, 2012, Pages 1007-1021

  Pérez Carrillo, Alfonso ^a   Bonada, Jordi ^a   Maestre, Esteban ^a,b   Guaus, Enric ^a   Blaauw, Merlijn ^a  

^a UNIVERSITAT POMPEU FABRA   (Spain)

^b STANFORD UNIVERSITY   (United States)

Author keywords

Control; gesture; model; performance; spectral; synthesis; timbre; violin

Indexed keywords

GESTURE; PERFORMANCE; SPECTRAL; TIMBRE; VIOLIN;

CONTROL; MODELS; NEURAL NETWORKS; SENSORS; SYNTHESIS (CHEMICAL);

QUALITY CONTROL;

EID: 84856303729     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2011.2170970     Document Type: Article

References (55)

1. J. O. Smith, "Viewpoints on the history of digital synthesis," in Proc. Int. Comput. Music Conf., Montreal, QC, Canada, Oct. 1991, pp. 1-10.
2. E. Maestre, M. Blaauw, J. Bonada, E. Guaus, and A. Pérez, "Statistical modeling of bowing control applied to sound synthesis," IEEE Trans. Audio, Speech, Lang. Process. Special Iss. Virtual Analog Audio Effects and Musical Instrum., vol. 18, no. 4, pp. 855-872, May 2010.
3. J. O. Smith, "Techniques for digital filter design and system identification with application to the violin," Ph.D. dissertation, CCRMA, Stanford Univ., Stanford, CA, 1983.
4. M. Demoucron, "On the control of virtual violins: Physical modelling and control of bowed string instruments," Ph.D. dissertation, Univ. Pierre et Marie Curie and the Stockholm Royal Inst. of Technol., Paris, France and Stockholm, Sweden, 2008.
5. S. Serafin, "The sound of friction: Real-time models, playability and musical applications," Ph.D. dissertation, CCRMA, Stanford Univ., Stanford, CA, USA, Jun. 2004.
6. Vienna Symphonic Library, [Online]. Available: http://www.vsl.co.at
7. Garritan Stradivari, [Online]. Available: http://www.garritan.com
8. Tascam Gigaviolin, [Online]. Available: http://www.tascam.com
9. X. Serra, "A system for sound analysis/transformation/synthesis based on a deterministic plus stochastic decomposition," Ph.D. dissertation, Stanford Univ., Stanford, CA, 1989.
10. J. Bonada and X. Serra, "Synthesis of the singing voice by performance sampling and spectral models," IEEE Signal Process. Mag., vol. 24, no. 2, pp. 67-80, Mar. 2007.
11. J. Bonada, "Voice processing and synthesis by performance sampling and spectral models," Ph.D. dissertation, Univ. Pompeu Fabra, Barcelona, Spain, 2008.
12. E. Lindemann, "Musical synthesizer capable of expresive phrasing," J. Acoust. Soc. Amer., vol. 117, pp. 2700-2730, 2005.
13. B. Schoner, "Probabilistic characterization and synthesis of complex driven systems," Ph.D. dissertation, MIT Media Lab, Cambridge, MA, 2000.
14. M. Lee, A. Freed, and D. Wessel, "Real-time neural network processing of gestural and acoustic signals," in Proc. ICMC, 1991, pp. 277-280.
15. M. M. Wanderley and P. Depalle, "Gestural control of sound synthesis," in Proc. IEEE - Special Iss. Eng. Music-Supervisory Control and Auditory Commun., G. Johannsen, Ed., Apr. 2004, vol. 94, no. 4, pp. 632-644. (Pubitemid 40890739)
16. A. Hunt, M. M. Wanderley, and M. Paradis, "The importance of parameter mapping in electronic instrument design," J. New Music Res., vol. 32, no. 4, pp. 429-440, 2003.
17. A. Hunt and M. M. Wanderley, "Mapping performer parameters to synthesis engines," Organized Sound, vol. 7, no. 2, pp. 97-108, 2002.
18. A. Perez and J. Bonada, "The bowed tube: A virtual violin," in Proc. NIME Conf., Sydney, Australia, 2010, pp. 229-232.
19. C. Nichols, "The vbow: An expressive musical controller haptic human-computer interface," Ph.D. dissertation, Stanford Univ., Stanford, CA, 2003.
20. D. Trueman and P. Cook, "Bossa: The deconstructed violin reconstructed," in Proc. ICMC Conf., Beijing, China, 1999, pp. 232-239.
21. S. Serafin, R. Dudas, M. Wanderley, and X. Rodet, "Gestural control of a real-time physical model of a bowed string instrument," in Proc. ICMC, Beijing, China, 1999, pp. 375-378.
22. S. Serafin and D. Young, "Recent advances in real-time bowed string synthesis: Evaluation of the models," in Proc. 19th Int. Congr. Acoust., Madrid, Spain, 2007.
23. D. Schwarz, "Data-driven concatenative sound synthesis," Ph.D. dissertation, IRCAM, Paris, France, 2004.
24. A. Perez, "Enhancing spectral synthesis techniques with performance gestures using the violin as a case study,' Ph.D. dissertation, Univ. Pompeu Fabra, Barcelona, Spain, 2009.
25. Polhemus Liberty System, [Online]. Available: http://www.pol-hemus.com
26. E. Maestre, J. Bonada, M. Blaauw, A. Pérez, and E. Guaus, "Acquisition of violin instrumental gestures using a commercial EMF device," in Proc. Int. Comput. Music Conf., Copenhagen, Denmark, 2007, pp. 386-393.
27. E. Schoonderwaldt and M. Demoucron, "Extraction of bowing parameters from violin performance combining motion capture and sensors," J. Acoust. Soc. Amer., vol. 126, no. 5, pp. 2695-2708, 2009.
28. E. Guaus, J. Bonada, E. Maestre, A. Perez, and M. Blaauw, "Calibration method to measure accurate bow force for real violin performances," in Proc. Int. Comput. Music Conf., Montreal, QC, Canada, 2009, pp. 251-254, 16/08/2009.
29. E. Guaus, J. Bonada, A. Perez, E. Maestre, and M. Blaauw, "Measuring the bow pressing force in a real violin performance," in Proc. Int. Symp. Musical Acoust., Barcelona, Spain, 2007, pp. 10-12.
30. C. E. Gough, "Measurement, modelling and synthesis of violin vibrato sounds," Acust. Acta Acust., vol. 91, no. 2, pp. 229-240, 2005. (Pubitemid 40496571)
31. M. Karjalainen, H. Penttinen, and V. Valimaki, "Acoustic sound from the electric guitar using dsp techniques," in Proc. IEEE ICASSP, Istanbul, Turkey, 2000, vol. 2, pp. 773-776.
32. M. Karjalainen, V. Välimäki, H. Penttinen, and H. Saastamoinen, "DSP equalization of electret film pickup for the acoustic guitar," J. Audio Eng. Soc., vol. 48, no. 12, pp. 1183-1193, Dec. 2000. (Pubitemid 32168738)
33. Yamaha VNP1 Bridge Pickup System, [Online]. Available: http://www.yamaha.com
34. H. Helmholtz, On the Sensations of Tone. New York: Dover, 1885, reprint 1954.
35. L. Cremer, Physics of the Violin. Cambridge, MA: MIT Press, Nov. 1984, pp. 201-382.
36. A. Askenfelt, "Measurement of bow motion and bow force in violin playing," J. Acoust. Soc. Amer., vol. 80, no. 4, pp. 1007-1015, Oct. 1986.
37. J. Schelleng, "The bowed string and the player," J. Acoust. Soc. Amer., vol. 53, no. 1, pp. 26-41, 1973.
38. E. Schoonderwaldt, "Mechanics and acoustics of violin bowing," Ph.D. dissertation, Stockholm Royal Inst. of Technol., Stockholm, Sweden, 2009.
39. J. Woodhouse, "Bowed string simulation using a thermal friction model," Acust. Acta Acust., vol. 89, pp. 355-368, 2003.
40. S. Serafin, F. Avanzini, and D. Rocchesso, "Bowed string simulation using an elasto-plastic friction model," in Proc. Stockholm Music Acoust. Conf., Stockholm, Sweden, 2003.
41. R. Plomp, "Timbre as a multidimensional attribute of complex tones," in Frequency Analysis and Periodicity Detection in Hearing. Leiden, The Netherlands: Sijthoff, 1970, pp. 397-414.
42. A. Caclin, S. McAdams, B. K. Smith, and S. Winsberg, "Acoustic correlates of timbre space dimensions: A confirmatory study using synthetic tones," J. Acoust. Soc. Amer., vol. 118, no. 1, pp. 471-482, 2005. (Pubitemid 40981501)
43. E. V. Jansson, "Violin timbre and the picket fence," Quarterly Progress and Status Report, KTH, Stockholm, vol. 35, pp. 79-84, 1994.
44. K. Guettler and A. Askenfelt, "Acceptance limits for the duration of pre-helmholtz transients in bowed string attacks," J. Acoust. Soc. Amer., vol. 101, no. 5, pp. 2903-2913, 1997.
45. J. Charles, D. Fitzgerald, and E. Coyle, "Violin timbre space features," IET Conf. Publications, vol. 2006, no. CP519, pp. 471-476, 2006.
46. E. Schoonderwaldt, "The violinist's sound palette: Spectral centroid, pith flattening and anomalous low frequencies," Acust. Acta Acust., vol. 95, no. 5, pp. 901-914, 2009.
47. J. Laroche, "Frequency-domain techniques for high-quality voice modification," in Proc. 6th Digital Audio Effects Conf., London, U.K., Sep. 2003, pp. 72-76.
48. D. Schwarz, 'Spectral envelopes in sound analysis and synthesis," M.S. thesis, IRCAM, Paris, France, 1998.
49. D. Boor, A Practical Guide to Splines (Revised Edition). Berlin, Germany: Springer Verlag, 2001.
50. E. Schoonderwaldt, K. Guettler, and A. Askenfelt, "An empirical investigation of bow-force limits in the Schelleng diagram," Acust. Acta Acust., vol. 94, no. 4, pp. 604-622, 2008.
51. J. Meyer, "The tonal quality of violins," in Proc. Stockholm Music Acoust. Conf., Stockholm, Sweden, 1983, pp. 69-78.
52. D. Loeffler, "Instrument timbres and pitch estimation in polyphonic music," M.S. thesis, Dept. of Elect. and Comput. Eng., Georgia Inst. of Technol., Atlanta, Apr. 2006.
53. K. Guettler, E. Schoonderwaldt, and A. Askenfelt, "Bow speed or bowing position-which one influences spectrum the most?," in Proc. Stockholm Music Acoust. Conf., Stockholm, Sweden, 2003, pp. 67-70.
54. E. Maestre, A. Pérez, and R. Ramírez, "Gesture sampling for instrumental sound synthesis: Violin bowing as a case study," in Proc. Int. Comput. Music Conf., 2010.
55. A. Perez Carrillo, J. Bonada, J. Pätynen, and V. Välimäki, "Method for measuring violin sound radiation based on bowed glissandi and its application to sound synthesis," J. Acoust. Soc. Amer., vol. 130, no. 2, pp. 1020-1029, 2011.