Real-time hit classification in a smart cajón

Frontiers in ICT

Volumn 5, Issue , 2018, Pages

  Turchet, Luca ^a   McPherson, Andrew ^a   Barthet, Mathieu ^a  

^a QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

Embedded systems; Gesture classification; Internet of musical things; Machine learning; Sensor fusion; Smart musical instruments

Indexed keywords

EID: 85056927558     PISSN: None     EISSN: 2297198X     Source Type: Journal    
DOI: 10.3389/fict.2018.00016     Document Type: Article

References (53)

1. Aimi, R. M. (2007). Hybrid Percussion: Extending Physical Instruments Using Sampled Acoustics. Ph.D. thesis, Massachusetts Institute of Technology
2. Barthet, M., Depalle, P., Kronland-Martinet, R., and Ystad, S. (2010). Acoustical correlates of timbre and expressiveness in clarinet performance. Music Percept. 28, 135-154. doi: 10.1525/mp.2010.28.2.135
3. Bello, J., Daudet, L., Abdallah, S., Duxbury, C., Davies, M., and Sandler, M. (2005). A tutorial on onset detection in music signals. IEEE Trans. Speech Audio Process. 13, 1035-1047. doi: 10.1109/TSA.2005.8 51998
4. Bello, J., and Sandler, M. (2003). 'Phase-based note onset detection for music signals' in Proceedings of the IEEE International Conference on Acoustics Speech and Signal Processing (Hong Kong). 441-444
5. Benetos, E., Dixon, S., Giannoulis, D., Kirchhoff, H., and Klapuri, A. (2013). Automatic music transcription: challenges and future directions. J. Intell. Inform. Syst. 41, 407-434. doi: 10.1007/s10844-013-0258-3
6. Brent, W. (2009). 'Cepstral analysis tools for percussive timbre identification' in Proceedings of the International Pure Data Convention (São Paulo)
7. Brent, W. (2010). 'A timbre analysis and classification toolkit for pure data' in Proceedings of the International Computer Music Conference (New York, NY)
8. Brossier, P. (2006). Automatic Annotation ofMusical Audio for Interactive Systems. Ph.D. thesis, Queen Mary University of London
9. Brossier, P., Bello, J., and Plumbley, M. (2004). 'Real-time temporal segmentation of note objects in music signals' in Proceedings of the International Computer Music Conference (Miami, FL)
10. Burgoyne, J., Fujinaga, I., and Downie, J. (2016). 'Music information retrieval' in A New Companion to Digital Humanities, eds S. Schreibman, R. Siemens, and J. Unsworth (Hoboken, NJ: John Wiley & Sons, Ltd.), 213-228. doi: 10.1002/9781118680605
11. Dixon, S. (2006). 'Onset detection revisited' in Proceedings of the International Conference on Digital Audio Effects (Montréal, QC), 133-137
12. Driessen, P., and Tzanetakis, G. (2018). 'Digital sensing of musical instruments' in Springer Handbook of Systematic Musicology, ed R. Bader (Berlin; Heidelberg: Springer), 923-933
13. Duxbury, C., Bello, J., Davies, M., and Sandler, M. (2003). 'Complex domain onset detection for musical signals' in Proceedings of the Digital Audio Effects Conference (London), 1-4
14. Finney, S. A. (1997). Auditory feedback and musical keyboard performance.Music Percept. 15, 153-174
15. Foote, J., and Uchihashi, S. (2001). 'The beat spectrum: a new approach to rhythm analysis' in Proceedings of IEEE International Conference on Multimedia and Expo (Tokyo), 881-884
16. Goto, M. (2001). An audio-based real-time beat tracking system for music with or without drum-sounds. J. New Music Res. 30, 159-171. doi: 10.1076/jnmr.30.2.159.7114
17. Gouyon, F., and Herrera, P. (2001). 'Exploration of techniques for automatic labeling of audio drum tracks instruments' in Proceedings of MOSART: Workshop on Current Directions in Computer Music
18. Hainsworth, S., and Macleod, M. (2003). 'Onset detection in musical audio signals' in Proceedings of the International Computer Music Conference (Singapore)
19. Hartigan, J. A., and Wong, M. A. (1979). Algorithm as 136: a k-means clustering algorithm. J. R. Stat. Soc. Ser. C Appl. Stat. 28, 100-108
20. Herzog, S. (2013). 'Efficient DSP implementation of median filtering for real-time audio noise reduction' in Proceedings of the International Conference on Digital Audio Effects (Maynooth), 1-6
21. Holfelt, J., Csapo, G., Andersson, N., Zabetian, S., Castenieto, M., Dahl, S., et al. (2017). 'Extraction, mapping, and evaluation of expressive acoustic features for adaptive digital audio effects' in Proceedings of the Sound & Music Computing Conference (Espoo)
22. Jathal, K. (2017). Real-time timbre classification for tabletop hand drumming. Comput. Music J. 41, 38-51. doi: 10.1162/COMJ_a_00419
23. Jensenius, A. R., and Wanderley, M. M. (2010). 'Musical gestures: concepts and methods in research' in Musical Gestures, eds R. I. Godøy and M. Leman (London; New York, NY: Routledge), 24-47
24. Kapur, A., Davidson, P., Cook, P., Driessen, P., and Schloss,W. (2004). 'Digitizing North Indian Performance' in Proceedings of the International ComputerMusic Conference (Miami, FL)
25. Liggins, M., Hall, D., and Llinas, J. (eds.). (2017). Handbook Multisensor Data Fusion: Theory and Practice, 2nd Edn. Boca Raton, FL: CRC Press
26. Ludwigsen, D. (2017). 'Acoustic and structural resonances of the cajon' in Proceedings of Meetings on Acoustics 170 ASA (Jacksonville, FL)
27. MacRitchie, J., and McPherson, A. P. (2015). Integrating optical finger motion tracking with surface touch events. Front. Psychol. 6:702. doi: 10.3389/fpsyg.2015.00702
28. Masri, P. (1996). Computer Modelling of Sound for Transformation and Synthesis of Musical Signals. Ph.D. thesis, University of Bristol, Department of Electrical and Electronic Engineering
29. McPherson, A., and Zappi, V. (2015). 'An environment for Submillisecond-Latency audio and sensor processing on BeagleBone black' in Audio Engineering Society Convention 138 (New York, NY)
30. McPherson, A. P., Jack, R. H., and Moro, G. (2016). 'Action-sound latency: are our tools fast enough?' in Proceedings of the Conference on New Interfaces for Musical Expression (Brisbane, QLD)
31. Michalakos, C. (2012). 'The augmented drum kit: an intuitive approach to live electronic percussion performance' in Proceedings of the International Computer Music Conference (Ljubljana)
32. Miranda, E., andWanderley, M. (2006). New Digital Musical Instruments: Control and Interaction Beyond the Keyboard, Vol. 21.Middleton,WI: AR Editions, Inc. Miron, M., Davies, M., and Gouyon, F. (2013a). 'Improving the realtime performance of a causal audio drum transcription system' in Proceedings of the Sound and Music Computing Conference (Stockholm), 402-407
33. Miron, M., Davies, M., and Gouyon, F. (2013b). 'An open-source drum transcription system for pure data and MAX MSP' in IEEE International Conference on Acoustics, Speech and Signal Processing (Vancouver, BC), 221-225
34. Mitchell, T., Madgwick, S., Rankine, S., Hilton, G., Freed, A., and Nix, A. (2014). 'Making the most of wi-fi: Optimisations for robust wireless live music performance' in Proceedings of the Conference on New Interfaces for Musical Expression (London), 251-256
35. Moore, B. (2012). An Introduction to the Psychology of Hearing. Bingley: Brill
36. Moore, F. R. (1988). The dysfunctions of midi. Comput. Music J. 12, 19-28
37. Odowichuk, G., Trail, S.,Driessen, P.,Nie,W., and Page,W. (2011). 'Sensor fusion: towards a fully expressive 3d music control interface' in IEEE Pacific Rim Conference on Communications, Computers and Signal Processing (Victoria, BC), 836-841
38. Pardue, L., Harte, C., and McPherson, A. (2015). A low-cost real-time tracking systemfor violin. J. NewMusic Res. 44, 305-323. doi: 10.1080/09298215.2015.10 87575
39. Puckette,M., Apel, T., and Ziccarelli, D. (1998). 'Real-time audio analysis tools for PD and MSP' in Proceedings of the International Computer Music Conference (Ann Arbor, MI)
40. Stowell, D., and Plumbley, M. (2007). 'Adaptive whitening for improved realtime audio onset detection' in Proceedings of the International ComputerMusic Conference (Copenhagen), 312-319
41. Tian, M., Fazekas, G., Black, D., and Sandler, M. (2014). 'Design and evaluation of onset detectors using different fusion policies' in Proceedings of International Society for Music Information Retrieval Conference (Taipei), 631-636
42. Tindale, A., Kapur, A., and Tzanetakis, G. (2011). Training surrogate sensors in musical gesture acquisition systems. IEEE Trans. Multimedia 13, 50-59. doi: 10.1109/TMM.2010.2089786
43. Tindale, A. R., Kapur, A., Schloss, W. A., and Tzanetakis, G. (2005). 'Indirect acquisition of percussion gestures using timbre recognition' in Proceedings of the Conference on Interdisciplinary Musicology (Montréal, QC)
44. Tindale, A. R., Kapur, A., Tzanetakis, G., and Fujinaga, I. (2004). 'Retrieval of percussion gestures using timbre classification techniques' in Proceedings of International Society for Music Information Retrieval Conference (Barcelona)
45. Tompkins,W. D. (2007). 'Afro-peruvian traditions' in The Garland Handbook of Latin American Music, eds D. A. Olsen and D. E. Sheeh (London; New York, NY: Routledge), 474-487
46. Traunmüller, H. (1990). Analytical expressions for the tonotopic sensory scale. J. Acoust. Soc. Am. 88, 97-100
47. Turchet, L. (2018). 'Hard real time onset detection for percussive sounds' in Proceedings of the Digital Audio Effects Conference (Aveiro)
48. Turchet, L., and Barthet,M. (2017). 'Envisioning smart musical haptic wearables to enhance performers' creative communication' in Proceedings of International Symposium on Computer Music Multidisciplinary Research (Porto), 538-549
49. Turchet, L., Fischione, C., and Barthet,M. (2017). 'Towards the internet of musical things' in Proceedings of the Sound and Music Computing Conference (Espoo), 13-20
50. Turchet, L., McPherson, A., and Barthet, M. (2018). Co-design of a smart Cajón. J. Audio Eng. Soc. 66, 220-230. doi: 10.17743/jaes.201 8.0007
51. Turchet, L.,McPherson, A., and Fischione, C. (2016). 'Smart instruments: towards an ecosystem of interoperable devices connecting performers and audiences' in Proceedings of the Sound and Music Computing Conference (Hamburg), 498-505
52. Witten, I. H., Frank, E., Hall, M. A., and Pal, C. J. (2016). Data Mining: Practical Machine Learning Tools and Techniques. Burlington: Morgan Kaufmann
53. Young, D., and Fujinaga, I. (2004). 'Aobachi: a new interface for japanese drumming' in Proceedings of the Conference on New Interfaces for Musical Expression (Hamamatsu), 23-26