Extraction of bowing parameters from violin performance combining motion capture and sensors

Journal of the Acoustical Society of America

Volumn 126, Issue 5, 2009, Pages 2695-2708

  Schoonderwaldt, E ^a,b   Demoucron, M ^c  

^a ROYAL INSTITUTE OF TECHNOLOGY   (Sweden)

^b MCGILL UNIVERSITY   (Canada)

^c CNRS   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURATE MEASUREMENT; BOWING PARAMETERS; MOTION CAPTURE; OPTICAL MOTION CAPTURE; SECONDARY CONTROL; STRING INSTRUMENTS;

CONTROL SYSTEM ANALYSIS; MUSICAL INSTRUMENTS;

SENSORS;

ACCELERATION; ARTICLE; INSTRUMENT; KINEMATICS; MOTION; MUSIC; PARAMETER; PERFORMANCE; PRIORITY JOURNAL; SENSOR; VIOLIN;

ACOUSTICS; BIOMECHANICS; GESTURES; HUMANS; MODELS, BIOLOGICAL; MOTOR SKILLS; MUSIC; PSYCHOMOTOR PERFORMANCE;

EID: 70449357433     PISSN: 00014966     EISSN: None     Source Type: Journal    
DOI: 10.1121/1.3227640     Document Type: Article

References (57)

1. W. Goebl and R. Bresin, " Measurement and reproduction accuracy of computer-controlled grand pianos.," J. Acoust. Soc. Am. 0001-4966 114, 2273-2283 (2003). 10.1121/1.1605387 (Pubitemid 37266652)
2. P. Hodgson, Motion Study and Violin Bowing (American String Teachers Association, Urbana, IL, 1958), first published in 1934 by J. H. Lavender & Co., London.
3. A polemic review of Hodgson's book was published in The Musical Times (Ref.), followed by a reaction of the author (Ref.).
4. A. Askenfelt, " Measurement of bow motion and bow force in violin playing.," J. Acoust. Soc. Am. 0001-4966 80, 1007-1015 (1986). 10.1121/1.393841
5. A. Askenfelt, " Measurement of the bowing parameters in violin playing. II: Bow-bridge distance, dynamic range, and limits of bow force.," J. Acoust. Soc. Am. 0001-4966 86, 503-516 (1989). 10.1121/1.398230
6. T. Machover, " Hyperinstruments-A progress report 1987-1991.," MIT Technical Report, MIT Media Laboratory, Cambridge, MA (1992).
7. D. L. Trueman, " Reinventing the violin.," Ph.D. thesis, Princeton University, Princeton, NJ (1999).
8. C. Nichols, " The vBow: A virtual violin bow controller for mapping gesture to synthesis with haptic feedback.," Organised Sound 7, 215-220 (2002). 10.1017/S135577180200211X
9. D. Young, " New frontiers of expression through real-time dynamics measurement of violin bows.," MS thesis, Massachusetts Institute of Technology, Cambridge, MA (2001).
10. D. Young, " The Hyperbow controller: Real-time dynamics measurement of violin performance.," in Proceedings of the NIME-02 Conference on New Instruments for Musical Expression (2002).
11. D. Young, P. Nunn, and A. Vassiliev, " Composing for Hyperbow: A collaboration between MIT and the Royal Academy of Music.," in Proceedings of the 2006 International Conference on New Interfaces for Musical Expression (NIME06) (2006).
12. D. Overholt, " The overtone violin.," in Proceedings of the 2005 International Conference on New Interfaces for Musical Expression (NIME05), Vancouver, BC, Canada (2005), pp. 34-37.
13. F. Bevilacqua, N. Rasamimanana, E. Fĺty, S. Lemouton, and F. Baschet, " The augmented violin project: Research, composition and performance report.," in Proceedings of the 6th International Conference on New Interfaces for Musical Expression (NIME06), Paris, France (2006).
14. M. T. Marshall, J. Malloch, and M. M. Wanderley, " Non-conscious control of sound spatialization.," in Proceedings of the 4th International Conference on Enactive Interfaces (ENACTIVE07), Grenoble, France (2007), pp. 377-380.
15. D. Young, " A methodology for investigation of bowed string performance through measurement of violin bowing technique.," Ph.D. thesis, Massachusetts Institute of Technology, Cambridge, MA (2007).
16. J. A. Paradiso and N. Gershenfeld, " Musical applications of electric field sensing.," Comput. Music J. 0148-9267 21, 69-89 (1997). 10.2307/3681109
17. S. Serafin and D. Young, " Bowed string physical model validation through use of a bow controller and examination of bow strokes.," in Proceedings of the Stockholm Music Acoustics Conference (SMAC 03), Stockholm, Sweden (2003).
18. N. Rasamimanana, " Gesture analysis of bow strokes using an augmented violin.," MS thesis, Universit́ Pierre et Marie Curie, Paris VI, France (2003).
19. N. Rasamimanana, E. Fĺty, and F. Bevilacqua, " Gesture analysis of violin bow strokes.," in Gesture in Human-Computer Interaction and Simulation: 6th International Gesture Workshop, Revised Selected Papers (Springer, Berlin, 2006), pp. 145-155.
20. N. Rasamimanana, " Geste instrumental du violoniste en situation de jeu: Analyse et mod́lisation (Violin player instrumental gesture: Analysis and modelling).," Ph.D. thesis, Universit́ Pierre et Marie Curie (UPMC), Paris VI, France (2008).
21. A. P. Baader, O. Kazennikov, and M. Wiesendanger, " Coordination of bowing and fingering in violin playing.," Brain Res. Cognit. Brain Res. 0926-6410 23, 436-443 (2005). 10.1016/j.cogbrainres.2004.11.008 (Pubitemid 40488183)
22. H. Winold, E. Thelen, and B. D. Ulrich, " Coordination and control in the bow arm movements of highly skilled cellists.," Ecological Psychol. 6, 1-31 (1994). 10.1207/s15326969eco0601-1
23. G. Shan and P. Visentin, " A quantitative three-dimensional analysis of arm kinematics in violin performance.," Med. Probl. Perform. Art. 18, 3-10 (2003). 0885-1158
24. P. Visentin and G. Shan, " The kinetic characteristics of the bow arm during violin performance: An examination of internal loads as a function of tempo.," Med. Probl. Perform. Art. 18, 91-97 (2003). 0885-1158
25. L. Turner-Stokes and K. Reid, " Three-dimensional motion analysis of upper limb movement in the bowing arm of string-playing musicians.," Clin. Biomech. (Bristol, Avon) 0268-0033 14, 426-433 (1999). 10.1016/S0268-0033(98) 00110-7 (Pubitemid 29229655)
26. C. Peiper, D. Warden, and G. Garnett, " An interface for real-time classification of articulations produced by violin bowing.," in Proceedings of the 2003 Conference on New Interfaces for Musical Expression (NIME-03), Montreal, QC, Canada (2003).
27. F. Rabbath and H. Sturm, " Art of the bow with Francois Rabbath.," http://www.artofthebow.com (Last viewed 7/1/ 2009).
28. K. Ng, O. Larkin, T. Koerselmans, B. Ong, D. Schwartz, and F. Bevilacqua, " The 3D augmented mirror: Motion analysis for string practice training.," in Proceedings of the 2007 International Computer Music Conference (ICMC07) (The International Computer Music Association, San Francisco, CA, 2007), Vol. II, pp. 53-56.
29. E. Maestre, J. Bonada, M. Blaauw, A. Ṕrez, and E. Guaus, " Acquisition of violin instrumental gestures using a commercial EMF tracking device.," in Proceedings of the 2007 International Computer Music Conference (ICMC07) (The International Computer Music Association, San Francisco, CA, 2007), Vol. I, pp. 386-393.
30. A. Perez, J. Bonada, E. Maestre, E. Guaus, and M. Blaauw, " Combining performance action with spectral models for violin sound transformation.," in Proceedings of the 19th International Congress on Acoustics (ICA07), Madrid, Spain (2007).
31. A. Perez, J. Bonada, E. Maestre, E. Guaus, and M. Blaauw, " Score level timbre transformations of violin sounds.," in Proceedings of the 11th International Conference on Digital Audio Effects (DAFx-08), Espoo, Finland (2008).
32. E. Schoonderwaldt, " The player and the bowed string: Coordination of bowing parameters in violin and viola performance.," J. Acoust. Soc. Am. 0001-4966 126, 2709-2720 (2009).
33. http://www.vicon.com (Last viewed 7/1/ 2009).
34. Alternatively, digital probing techniques could be used, e.g., as described in Ref
35. M. Demoucron, A. Askenfelt and R. Causse, " Measuring bow force in bowed string performance: Theory and implementation of a bow force sensor.," Acta Acust. Acust. 1022-4793 95, 718-732 (2009). 10.3813/AAA.918200
36. A. Askenfelt, " Observations on the violin bow and the interaction with the string.," in Proceedings of the International Symposium on Musical Acoustics (ISMA95), Dourdan, France (1995), pp. 197-212.
37. N. Pickering, " Physical properties of violin bows.," J. Violin Society of America 0148-6845 8, 41-57 (1987).
38. http://www.mathworks.com (Last viewed 7/1/ 2009).
39. For an extensive overview of conversions between different representations of orientation, see Ref.
40. J. Diebel, " Representing attitude: Euler angles, unit quaternions, and rotation vectors.," Stanford University Technical Report, Stanford University, Stanford, CA, 2006.
41. To obtain the acoustically more relevant relative bow-bridge distance Β, ybb should be divided by the effective length of the string. This requires knowledge of the position where the string is stopped by the player, which could be obtained, e.g., by pitch analysis of the audio recording.
42. To avoid possible confusion around this subject it should be noted that the bow angles as defined here do not exactly equal the Tait-Bryan (or Euler) angles of the relative orientation of the bow and the violin, as suggested in Ref
43. E. Schoonderwaldt, S. Sinclair, and M. Wanderley, " Why do we need 5-DOF force feedback? An analysis of violin bowing.," in Proceedings of the ENACTIVE07 (2007).
44. F. E. Veldpaus, H. J. Woltring, and L. J. M. G. Dortmans, " A least-squares algorithm for the equiform transformation from spatial marker co-ordinates.," J. Biomech. 0021-9290 21, 45-54 (1988). 10.1016/0021-9290(88)90190-X (Pubitemid 18546159)
45. E. Schoonderwaldt, N. Rasamimanana, and F. Bevilacqua, " Combining accelerometer and video camera: Reconstruction of bow velocity profiles.," in Proceedings of the 6th International Conference on New Interfaces for Musical Expression (NIME06), Paris, France (2006), pp. 200-203.
46. A. Y. Benbasat, " An inertial measurement unit for user interfaces.," MS thesis, Massachusetts Institute of Technology, Cambridge, MA (2000).
47. D. D. Frantz, A. D. Wiles, S. E. Leis, and S. R. Kirsch, " Accuracy assessment protocols for electromagnetic tracking systems.," Phys. Med. Biol. 0031-9155 48, 2241-2251 (2003). 10.1088/0031-9155/48/14/314 (Pubitemid 36926711)
48. N. B. Schuler, M. J. Bey, J. T. Shearn, and D. L. Butler, " Evaluation of an electromagnetic position tracking device for measuring in vivo, dynamic joint kinematics.," J. Biomech. 0021-9290 38, 2113-2117 (2005). 10.1016/j.jbiomech.2004.09.015 (Pubitemid 41111756)
49. T. K. Ho, " A computer-assisted approach to the teaching of violin tone production.," ACM SIGCUE Outlook 21, 73-83 (1991). 10.1145/122463.122472
50. E. Schoonderwaldt and M. M. Wanderley, " Visualization of bowing gestures for feedback: The Hodgson plot.," in Proceedings of the 3rd International Conference on Automated Production of Cross Media Content for Multi-channel Distribution (AXMEDIS07) (2007), Vol. II, pp. 65-70, for examples, see http://www.youtube.com/schoondw (Last viewed 7/1/ 2009).
51. M. Demoucron and R. Causś, " Sound synthesis of bowed string instruments using a gesture based control of a physical model.," in Proceedings of the International Symposium on Musical Acoustics (ISMA07) (2007).
52. D. Young and S. Serafin, " Investigation the performance of a violin physical model: Recent real player studies.," in Proceedings of the 2007 International Computer Music Conference (ICMC07) (The International Computer Music Association, 2007), Vol. I, pp. 394-397.
53. M. Demoucron, " On the control of virtual violins: Physical modelling and control of bowed string instruments.," Ph.D. thesis, Universit́ Pierre et Marie Curie (UPMC), Paris, France and Royal Institute of Technology (KTH), Stockholm, Sweden (2008).
54. Arguably, tilt has a certain influence on the spectrum, as shown in Ref., but the effect is small compared to that of, e.g., bow force.
55. F. B., " Motion study and violin bowing. By Percival Hodgson.," The Musical Times 0027-4666 76, 131 (1935), anonymous review of Hodgson's book "Motion study and violin bowing" (Ref.).
56. P. Hodgson, " Motion study and violin bowing.," The Musical Times 76, 347-348 (1935). 10.2307/918916
57. E. Schoonderwaldt, K. Guettler, and A. Askenfelt, " Effect of the width of the bow hair on the violin string spectrum.," in Proceedings of the Stockholm Music Acoustics Conference (SMAC03), Stockholm, Sweden (2003), pp. 91-94.