Low-latency audio pitch tracking: A multi-modal sensor-assisted approach

Proceedings of the International Conference on New Interfaces for Musical Expression

Volumn , Issue , 2014, Pages 54-59

  Pardue, Laurel S ^a   Nian, Dongjuan ^a   Harte, Chris ^a   McPherson, Andrew P ^a  

^a QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

Audio analysis; Fingerboard; Multi modal; Pitch tracking; Position sensing; Violin

Indexed keywords

AUDIO ACOUSTICS; MODAL ANALYSIS; MUSICAL INSTRUMENTS; TRACKING (POSITION);

AUDIO ANALYSIS; FINGERBOARD; LOW LATENCY; MULTI-MODAL; MULTI-MODAL APPROACH; MULTIMODAL SENSOR; PITCH TRACKING ALGORITHMS; PITCH-TRACKING; POSITION SENSING; VIOLIN;

MUSIC;

EID: 84949531106     PISSN: 22204792     EISSN: 22204806     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (27)

1. [9] A. Freed, A. Chaudhary, and B. Davila. Operating systems latency measurement and analysis for sound synthesis and processing applications. In Proc. ICMC, pages 479–81, 1997.
2. A. Freed, F.-M. Uitti, S. Mansfield, and J. MacCallum. “old” is the new “new”: a fingerboard case study in recrudescence as a nime development strategy. In Proc. NIME, 2013.
3. T. Grosshauser, S. Feese, and G. Tröster. Capacitive left hand finger and bow sensors for synchronization and rhythmical regularity analysis in string ensembles. In Stockholm Music Acoustics Conference, 2013.
4. T. Grosshauser and G. Tröster. Further finger position and pressure sensing techniques for stringed and keyboard instruments. In Proc. NIME, 2013.
5. A. Jensenius and V. Johnson. Performing the electric violin in a sonic space. Computer Music J., 36(4), 2012.
6. A. Kapur, A. J. Lazier, P. Davidson, R. S. Wilson, and P. R. Cook. The electronic sitar controller. In Proc. NIME, 2004.
7. M. Lahat, R. Niederjohn, and D. Krubsack. A spectral autocorrelation method for measurement of the fundamental frequency of noise-corrupted speech. Acoustics, Speech and Signal Processing, IEEE Transactions on, 35(6):741–750, 1987.
8. E. Maestre, J. Bonada, M. Blaauw, A. Perez, and E. Guaus. Acquisition of violin instrumental gestures using a commercial EMF tracking device. In Proc. ICMC, volume 1, pages 386–393, 2007.
9. T. Mäki-Patola and P. Hämäläinen. Latency tolerance for gesture controlled continuous sound instrument without tactile feedback. In Proc. ICMC, 2004.
10. M. V. Mathews and J. Kohut. Electronic simulation of violin resonances. J. Acoustical Society of America, 53:1620, 1973.
11. A. M. Noll. Cepstrum pitch determination. J. Acoustical Society of America, 41:293, 1967.
12. D. Overholt. The overtone violin: A new computer music instrument. In Proc. ICMC, pages 604–607, 2005.
13. D. Overholt. The overtone fiddle: an actuated acoustic instrument. In Proc. NIME, 2011.
14. J. Paradiso and N. Gershenfeld. Musical applications of electric field sensing. Computer Music J., 21(2):69–89, 1997.
15. L. S. Pardue and A. P. McPherson. Near-field optical reflective sensing for bow tracking. In Proc. NIME, 2013.
16. C. Poepel and D. Overholt. Recent developments in violin-related digital musical instruments: where are we and where are we going? In Proc. NIME, 2006.
17. L. Rabiner. On the use of autocorrelation analysis for pitch detection. Acoustics, Speech and Signal Processing, IEEE Transactions on, 25(1):24–33, 1977.
18. N. Rasamimanana, E. Fléty, and F. Bevilacqua. Gesture analysis of violin bow strokes. Gesture in Human-Computer Interaction and Simulation, pages 145–155, 2006.
19. E. Schoonderwaldt and M. Demoucron. Extraction of bowing parameters from violin performance combining motion capture and sensors. J. Acoustical Society of America, 126:2695, 2009.
20. B. D. Adelstein, D. R. Begault, M. R. Anderson, and E. M. Wenzel. Sensitivity to haptic-audio asynchrony. In Proc. Multimodal Interfaces, pages 73–76, 2003.
21. A. Askenfelt. Measurement of bow motion and bow force in violin playing. J. Acoustical Society of America, 80:1007, 1986.
22. E. Benetos. Automatic transcription of polyphonic music exploiting temporal evolution. PhD thesis, 2012.
23. J. C. Brown. Musical fundamental frequency tracking using a pattern recognition method. J. Acoustical Society of America, 92:1394, 1992.
24. C. Cannam, C. Landone, M. B. Sandler, and J. P. Bello. The sonic visualiser: A visualisation platform for semantic descriptors from musical signals. In ISMIR, pages 324–327, 2006.
25. A. de Cheveigné and H. Kawahara. Comparative evaluation of f0 estimation algorithms. In INTERSPEECH, pages 2451–2454, 2001.
26. A. De Cheveigné and H. Kawahara. Yin, a fundamental frequency estimator for speech and music. J. Acoustical Society of America, 111:1917, 2002.
27. A. Freed. Novel and forgotten current-steering techniques for resistive multitouch, duotouch, and