An end-to-end machine learning system for harmonic analysis of music

IEEE Transactions on Audio, Speech and Language Processing

Volumn 20, Issue 6, 2012, Pages 1771-1783

  Ni, Yizhao ^a   McVicar, Matt ^a   Santos Rodriguez, Ral ^b   De Bie, Tijl ^a  

^a UNIVERSITY OF BRISTOL   (United Kingdom)

^b UNIVERSIDAD CARLOS III DE MADRID   (Spain)

Author keywords

Audio chord estimation; harmony progression analyzer (HPA); loudness based chromagram; machine learning; meta song evaluation

Indexed keywords

AUDIO FILES; EXPERT KNOWLEDGE; FIRST SYSTEMS; GROUND TRUTH; HARMONY PROGRESSION ANALYZER (HPA); HUMAN PERCEPTION; JOINT ESTIMATION; LOUDNESS-BASED CHROMAGRAM; MEMORY EFFICIENT; META-SONG EVALUATION; MUSICAL AUDIO;

AUDIO ACOUSTICS; ESTIMATION; HARMONIC ANALYSIS;

LEARNING SYSTEMS;

EID: 84859762016     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2012.2188516     Document Type: Article

References (45)

1. W. Piston, Harmony, 4th ed. New York: Norton, 1978.
2. K. Lee, "A system for acoustic chord transcription and key extraction from audio using hidden Markov models trained on synthesized audio," Ph.D. dissertation, Stanford Univ., Stanford, CA, 2008.
3. C. L. Krumhansl, Cognitive Foundations of Musical Pitch. Oxford, U.K.: Oxford Univ. Press, 1990.
4. T. Fujishima, "Real time chord recognition of musical sound: A system using common lisp music," in Proc. ICMC, 1999, pp. 464-467.
5. A. Sheh and D. Ellis, "Chord segmentation and recognition using EM-trained hidden Markov models," in Proc. ISMIR, 2003.
6. T. Yoshioka, T. Kitahara, K. Komatani, T. Ogata, and H. Okuno, "Automatic chord transcription with concurrent recognition of chord symbols and boundaries," in Proc. ISMIR, 2004.
7. J. P. Bello and J. Pickens, "A robust mid-level representation for harmonic content in music signals," in Proc. ISMIR, 2005.
8. K. Sumi, K. Itoyama, K. Yoshii, K. Komatani, T. Ogata, and H. Okuno, "Automatic chord recognition based on probabilistic integration of chord transition and bass pitch estimation," in Proc. ISMIR, 2008.
9. A. Weller, D. Ellis, and T. Jebara, "Structured prediction models for chord transcription of music audio," in Proc. ICMLA, 2009.
10. D. Ellis and A. Weller, "The 2010 LABROSA chord recognition system," in Proc. ISMIR (MIREX), 2010.
11. M. Mauch, "Automatic chord transcription from audio using computational models of musical context," Ph.D. dissertation, Queen Mary Univ. of London, London, U.K., 2010.
12. S. Pauws, "Musical key extraction from audio," in Proc. ISMIR, Barcelona, Spain, 2004, pp. 96-99.
13. K. Noland and M. Sandler, "Key estimation using a hidden Markov model," in Proc. ISMIR, 2006.
14. K. Lee and M. Slaney, "Acoustic chord transcription and key extraction from audio using key-dependent HMMs trained on synthesized audio," IEEE Trans. Audio, Speech, Lang. Process., vol. 16, no. 2, pp. 291-301, Feb. 2008.
15. K. Lee and M. Slaney, "A unified system for chord transcription and key extraction using hidden Markov models," in Proc. ISMIR, 2007.
16. M. P. Ryynäen and A. P. Klapuri, "Automatic transcription of melody, bass line, and chords in polyphonic music," Comput. Music J. , no. 3, pp. 72-86, 2008.
17. H. Papadopoulous and G. Peeters, "Local key estimation based on harmonic and metric structures," in Proc. DAFX, 2009.
18. M. Khadkevich and M. Omologo, "Use of hidden Markov models and factored language models for automatic chord recognition," in Proc. ISMIR, 2009.
19. T. Rocher,M. Robine, P. Hanna, L. Oudre, Y. Grenier, and C. Févotte, "Concurrent estimation of chords and keys from audio," in Proc. ISMIR, 2010.
20. T. Cho and J. P. Bello, "A feature smoothing method for chord recognition using recurrence plots," in Proc. ISMIR, 2011.
21. O. Lartillot and P. Toiviainen, "A Matlab toolbox for musical feature extraction from audio," in Proc. Int. Conf. Digital Audio Effects, 2007.
22. J. Brown, "Calculation of a constant q spectral transform," J. Acoust. Soc. Amer., vol. 89, no. 1, pp. 425-434, 1991.
23. M. Mauch and S. Dixon, "Approximate note transcription for the improved identification of difficult chords," in Proc. ISMIR, 2010.
24. N. Ono, K. Miyamoto, J. Roux, H. Kameeoka, and S. Sagayama, "Separation of a monaural audio signal into harmonic/percussive components by complimentary diffusion on spectrogram," in Proc. EUSIPCO, 2008.
25. T. Cho, R. J. Weiss, and J. P. Bello, "Exploring common variations in state of the art chord recognition systems," in Proc. Sound Music Comput. Conf., 2010, pp. 1-8.
26. D. Ellis and G. Poliner, "Identifying 'cover songs' with chroma features and dynamic programming beat tracking," in Proc. ICASSP, 2007, pp. 1429-1433.
27. C. Harte, M. Sandler, and M. Gasser, "Detecting harmonic change in musical audio," in Proc. Audio Music Comput. for Multimedia Workshop, Santa Barbara, CA, 2006.
28. M. Müller and S. Ewert, "Towards timbre-invariant audio features for harmony-based music," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 3, pp. 649-662, Mar. 2010.
29. M. T. Smith, Audio Engineer's Reference Book. Waltham, MA: Focal Press, 1999.
30. L. R. Rabiner, "A tutorial on hidden Markov models and selected application in speech recognition," Proc. IEEE, vol. 77, no. 8, pp. 257-286, Feb. 1989.
31. B. Su and S. Jeng, "Multi-timbre chord classification using wavelet transform and self-organized map neural networks," in Proc. ICASSP, 2001, pp. 3377-3380. (Pubitemid 32838671)
32. G. Cabral, F. Pachet, J. Briot, and S. Paris, "Automatic x traditional descriptor extraction: The case of chord recognition," in Proc. ISMIR, 2005.
33. M. R. Gupta and Y. Chen, "Theory and use of the EM algorithm," Found. Trends Signal Process., vol. 4, pp. 223-296, Mar. 2011.
34. Y. Altun, I. Tsochantaridis, and T. Hofmann, "Hidden Markov support vector machines," Proc. ICML, 2003.
35. C. Harte and M. Sandler, "Automatic chord identification using a quantised chromagram," in Proc. AES Conf., 2005.
36. M. McVicar, Y. Ni, R. Santos-Rodriguez, and T. De Bie, "Using online chord databases to enhance chord recognition," J. New Music Res., vol. 40, no. 2, pp. 139-152, 2011.
37. M. McVicar, Y. Ni, R. Santos-Rodriguez, and T. De Bie, "Leveraging noisy online databases for use in chord recognition," in Proc. ISMIR, 2011.
38. H. Fletcher, "Loudness, its definition, measurement and calculation," J. Acoust. Soc. Amer., vol. 5, no. 2, pp. 82-82, 1933.
39. T. D. Rossing, The Science of Sound (Second Edition). Boston, MA: Addison-Wesley, 1990.
40. N. Jiang, P. Grosche, V. Konz, and M. Müller, "Analyzing chroma feature types for automated chord recognition," in Proc. 42nd AES Conf., 2011.
41. R. Bisiani, "Beam search," Encycl. Artif. Intell., pp. 56-58, 1987.
42. Y. Ni, M. Mcvicar, R. Santos-Rodriguez, and T. De Bie, "Meta-song evaluation for chord recognition,' 2011, arXiv:1109.0420v1, Tech. Rep.
43. Y. Ni, M. McVicar, R. Santos-Rodriguez, and T. De Bie, "Meta-song evaluation for chord recognition," in Proc. ISMIR (Late Breaking Demo), 2011.
44. M. Müller and S. Ewert, "Chroma toolbox: Pitch, chroma, CENS, CRP," in Proc. ISMIR, 2011.
45. I. Tsochantaridis, T. Hofmann, T. Joachims, and Y. Altun, "Support vector machine learning for interdependent and structured output spaces," in Proc. ICML, 2004.