Essentia: An audio analysis library for music information retrieval

Proceedings of the 14th International Society for Music Information Retrieval Conference, ISMIR 2013

Volumn , Issue , 2013, Pages 493-498

  Bogdanov, Dmitry ^a   Wack, Nicolas ^a   Gómez, Emilia ^a   Gulati, Sankalp ^a   Herrera, Perfecto ^a   Mayor, Oscar ^a   Roma, Gerard ^a   Salamon, Justin ^a   Zapata, José ^a   Serra, Xavier ^a  

^a UNIVERSITAT POMPEU FABRA   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

C++ (PROGRAMMING LANGUAGE); COMPUTER OPERATING SYSTEMS; DIGITAL SIGNAL PROCESSING; INDUSTRIAL RESEARCH; INFORMATION RETRIEVAL;

AUDIO ANALYSIS; COMPUTATIONAL COSTS; FAST PROTOTYPING; MUSIC INFORMATION RETRIEVAL; RE-USABLE ALGORITHMS; SIGNAL PROCESSING ALGORITHMS; STATISTICAL CHARACTERIZATION; WINDOWS SYSTEM;

AUDIO ACOUSTICS;

EID: 85019537868     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (75)

1. V. Akkermans, J. Serrà, and P. Herrera. Shape-based spectral contrast descriptor. In Sound and Music Computing Conf. (SMC’09), page 143–148, 2009.
2. X. Amatriain, J. Massaguer, D. Garcia, and I. Mosquera. The clam annotator: A cross-platform audio descriptors editing tool. In Int. Conf. on Music Information Retrieval (ISMIR’05), volume 5, 2005.
3. E. Aylon and N. Wack. Beat detection using plp. In Music Information Retrieval Evaluation Exchange (MIREX’10), 2010.
4. J. P. Bello, C. Duxbury, M. Davies, and M. Sandler. On the use of phase and energy for musical onset detection in the complex domain. Signal Processing Letters, IEEE, 11(6):553–556, 2004.
5. D. Bogdanov. From music similarity to music recommendation: Computational approaches based on audio and metadata analysis. PhD thesis, UPF, Barcelona, Spain, 2013. In press.
6. D. Bogdanov, M. Haro, F. Fuhrmann, A. Xambó, E. Gómez, and P. Herrera. Semantic audio content-based music recommendation and visualization based on user preference examples. Information Processing & Management, 49(1):13–33, Jan. 2013.
7. D. Bogdanov, J. Serrà, N. Wack, and P. Herrera. Hybrid similarity measures for music recommendation. In Music Information Retrieval Evaluation Exchange (MIREX’09), 2009.
8. D. Bogdanov, J. Serrà, N. Wack, and P. Herrera. Hybrid music similarity measure. In Music Information Retrieval Evaluation Exchange (MIREX’10), 2010.
9. D. Bogdanov, J. Serrà, N. Wack, P. Herrera, and X. Serra. Unifying low-level and high-level music similarity measures. IEEE Trans. on Multimedia, 13(4):687–701, 2011.
10. P. Brossier, J. P. Bello, and M. D. Plumbley. Fast labelling of notes in music signals. In Int. Symp. on Music Information Retrieval (ISMIR’04), page 331–336, 2004.
11. P. M. Brossier. Automatic Annotation of Musical Audio for Interactive Applications. PhD thesis, QMUL, London, UK, 2007.
12. J. Bullock and U. Conservatoire. Libxtract: A lightweight library for audio feature extraction. In Int. Computer Music Conf. (ICMC’07), volume 9, 2007.
13. C. Cannam, C. Landone, and M. Sandler. Sonic visualiser: An open source application for viewing, analysing, and annotating music audio files. In ACM Int. Conf. on Multimedia (MM’05), page 1467–1468, 2010.
14. O. Celma, P. Cano, and P. Herrera. Search sounds an audio crawler focused on weblogs. In 7th Int. Conf. on Music Information Retrieval (ISMIR), 2006.
15. M. E. P. Davies, M. Plumbley, and D. Eck. Towards a musical beat emphasis function. In IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, 2009. WASPAA’09, pages 61–64, 2009.
16. N. Degara, E. A. Rua, A. Pena, S. Torres-Guijarro, M. E. Davies, and M. D. Plumbley. Reliability-informed beat tracking of musical signals. IEEE Trans. on Audio, Speech, and Language Processing, 20(1):290–301, 2012.
17. S. Dixon. Onset detection revisited. In Int. Conf. on Digital Audio Effects (DAFx’06), volume 120, page 133–137, 2006.
18. D. P. W. Ellis. Beat tracking by dynamic programming. Journal of New Music Research, 36(1):51–60, 2007.
19. F. Fuhrmann and P. Herrera. Quantifying the relevance of locally extracted information for musical instrument recognition from entire pieces of music. In Int. Society for Music Information Retrieval Conf. (ISMIR’11), 2011.
20. F. Fuhrmann, P. Herrera, and X. Serra. Detecting solo phrases in music using spectral and pitch-related descriptors. Journal of New Music Research, 38(4):343–356, 2009.
21. T. Ganchev, N. Fakotakis, and G. Kokkinakis. Comparative evaluation of various MFCC implementations on the speaker verification task. In Int. Conf. on Speach and Computer (SPECOM’05), volume 1, page 191–194, 2005.
22. F. Gouyon. A computational approach to rhythm description: Audio features for the computation of rhythm periodicity functions and their use in tempo induction and music content processing. PhD thesis, UPF, Barcelona, Spain, 2005.
23. F. Gouyon and P. Herrera. Exploration of techniques for automatic labeling of audio drum tracks instruments. In MOSART: Workshop on Current Directions in Computer Music, 2001.
24. G. Gravier, M. Betser, and M. Ben. Audio segmentation toolkit, release 1.2. Technical report, 2010. Available online: https://gforge.inria.fr/frs/download.php/25187/audioseg-1.2.pdf.
25. P. Grosche and M. Müller. A mid-level representation for capturing dominant tempo and pulse information in music recordings. In Int. Society for Music Information Retrieval Conf. (ISMIR’09), page 189–194, 2009.
26. E. Guaus and P. Herrera. The rhythm transform: towards a generic rhythm description. In Int. Computer Music Conf. (ICMC’05), 2005.
27. E. Gómez. Key estimation from polyphonic audio. In Music Information Retrieval Evaluation Exchange (MIREX’05), 2005.
28. E. Gómez. Tonal description of polyphonic audio for music content processing. INFORMS Journal on Computing, 18(3):294–304, 2006.
29. E. Gómez and P. Herrera. Comparative analysis of music recordings from western and non-western traditions by automatic tonal feature extraction. Empirical Musicology Review, 3(3):140–156, 2008.
30. E. Gómez, P. Herrera, P. Cano, J. Janer, J. Serrà, J. Bonada, S. El-Hajj, T. Aussenac, and G. Holmberg. Music similarity systems and methods using descriptors, 2009. WIPO Patent No. 2009001202.
31. M. Haro, J. Serrà, P. Herrera, and A. Corral. Zipf’s law in short-time timbral codings of speech, music, and environmental sound signals. PLoS ONE, 7(3):e33993, 2012.
32. J. Janer, M. Haro, G. Roma, T. Fujishima, and N. Kojima. Sound object classification for symbolic audio mosaicing: A proof-of-concept. In Sound and Music Computing Conf. (SMC’09), pages 297–302, 2009.
33. K. Jensen and T. H. Andersen. Beat estimation on the beat. In IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA’03), page 87–90, 2003.
34. C. F. Julià and S. Jordà. SongExplorer: a tabletop application for exploring large collections of songs. In Int. Society for Music Information Retrieval Conf. (ISMIR’09), 2009.
35. G. K. Koduri, S. Gulati, P. Rao, and X. Serra. Raga recognition based on pitch distribution methods. Journal of New Music Research, 41(4):337–350, 2012.
36. G. K. Koduri, J. Serrà, and X. Serra. Characterization of intonation in carnatic music by parametrizing pitch histograms. In Int. Society for Music Information Retrieval Conf. (ISMIR’12), pages 199–204, 2012.
37. S. Koelsch, S. Skouras, T. Fritz, P. Herrera, C. Bonhage, M. Kuessner, and A. M. Jacobs. Neural correlates of music-evoked fear and joy: The roles of auditory cortex and superficial amygdala. Neuroimage. In press.
38. J. Laroche. Efficient tempo and beat tracking in audio recordings. Journal of the Audio Engineering Society, 51(4):226–233, 2003.
39. O. Lartillot, P. Toiviainen, and T. Eerola. A matlab toolbox for music information retrieval. In C. Preisach, P. D. H. Burkhardt, P. D. L. Schmidt-Thieme, and P. D. R. Decker, editors, Data Analysis, Machine Learning and Applications, Studies in Classification, Data Analysis, and Knowledge Organization, pages 261–268. Springer Berlin Heidelberg, 2008.
40. C. Laurier. Automatic Classification of Musical Mood by Content-Based Analysis. PhD thesis, UPF, Barcelona, Spain, 2011.
41. C. Laurier, O. Meyers, J. Serrà, M. Blech, P. Herrera, and X. Serra. Indexing music by mood: design and integration of an automatic content-based annotator. Multimedia Tools and Applications, 48(1):161–184, 2009.
42. C. Laurier, M. Sordo, and P. Herrera. Mood cloud 2.0: Music mood browsing based on social networks. In Int. Society for Music Information Retrieval Conf. (ISMIR’09), 2009.
43. J. Makhoul. Spectral analysis of speech by linear prediction. IEEE Trans. on Audio and Electroacoustics, 21(3):140–148, 1973.
44. K. D. Martin and Y. E. Kim. Musical instrument identification: A pattern-recognition approach. The Journal of the Acoustical Society of America, 104(3):1768–1768, 1998.
45. P. Masri and A. Bateman. Improved modelling of attack transients in music analysis-resynthesis. In Int. Computer Music Conf. (ICMC’96), page 100–103, 1996.
46. O. Mayor, J. Llop, and E. Maestre. RepoVizz: a multimodal on-line database and browsing tool for music performance research. In Int. Society for Music Information Retrieval Conf. (ISMIR’11), 2011.
47. C. McKay and I. Fujinaga. jMIR: tools for automatic music classification. In Int. Computer Music Conf. (ICMC’09), page 65–68, 2009.
48. C. McKay, I. Fujinaga, and P. Depalle. jAudio: a feature extraction library. In Int. Conf. on Music Information Retrieval (ISMIR’05), page 600–3, 2005.
49. B. C. Moore and B. R. Glasberg. Suggested formulae for calculating auditory-filter bandwidths and excitation patterns. The Journal of the Acoustical Society of America, 74(3):750–753, 1983.
50. K. R. Page, B. Fields, D. De Roure, T. Crawford, and J. S. Downie. Reuse, remix, repeat: the workflows of MIR. In Int. Society for Music Information Retrieval Conf. (ISMIR’12), 2012.
51. G. Peeters. A large set of audio features for sound description (similarity and classification) in the CUIDADO project. CUIDADO Project Report, 2004. Available online: http://recherche.ircam.fr/equipes/analysesynthese/peeters/ARTICLES/.
52. R. Plomp and W. J. M. Levelt. Tonal consonance and critical bandwidth. The Journal of the Acoustical Society of America, 38(4):548–560, 1965.
53. G. Roma, J. Janer, S. Kersten, M. Schirosa, P. Herrera, and X. Serra. Ecological acoustics perspective for content-based retrieval of environmental sounds. EURASIP Journal on Audio, Speech, and Music Processing, 2010.
54. A. Röbel and X. Rodet. Efficient spectral envelope estimation and its application to pitch shifting and envelope preservation. In Int. Conf. on Digital Audio Effects (DAFx’05), 2005.
55. J. Salamon, S. Gulati, and X. Serra. A multipitch approach to tonic identification in indian classical music. In Int. Society for Music Information Retrieval Conf. (ISMIR’12), 2012.
56. J. Salamon and E. Gómez. Melody extraction from polyphonic music signals using pitch contour characteristics. IEEE Trans. on Audio, Speech, and Language Processing, 20(6):1759–1770, 2012.
57. J. Serrà, E. Gómez, P. Herrera, and X. Serra. Chroma binary similarity and local alignment applied to cover song identification. IEEE Trans. on Audio, Speech, and Language Processing, 16(6):1138–1151, 2008.
58. Y. Shao, Z. Jin, D. Wang, and S. Srinivasan. An auditory-based feature for robust speech recognition. In IEEE Int. Conf. on Acoustics, Speech, and Signal Processing (ICASSP’09), pages 4625–4628, 2009.
59. E. Skovenborg and S. H. Nielsen. Evaluation of different loudness models with music and speech material. In The 117th AES Convention, 2004.
60. M. Slaney. Auditory toolbox. Interval Research Corporation, Technical Report, 10, 1998. Available online: http://www.tka4.org/materials/lib/ArticlesBooks/Speech%20Recognition/AuditoryToolboxTechReport.pdf.
61. M. Sordo. Semantic Annotation of Music Collections: A Computational Approach. PhD thesis, UPF, Barcelona, Spain, 2012.
62. M. Sordo, O. Celma, and D. Bogdanov. MIREX 2011: Audio tag classification using weighted-vote nearest neighbor classification. In Music Information Retrieval Evaluation Exchange (MIREX’11), 2011.
63. M. Sordo, G. K. Koduri, S. Şentürk, S. Gulati, and X. Serra. A musically aware system for browsing and interacting with audio music collections. In The 2nd CompMusic Workshop, 2012.
64. G. A. Soulodre. Evaluation of objective loudness meters. In The 116th AES Convention, 2004.
65. S. S. Stevens. Psychophysics. Transaction Publishers, 1975.
66. S. Streich. Music complexity: a multi-faceted description of audio content. PhD thesis, UPF, Barcelona, Spain, 2007.
67. S. Streich and P. Herrera. Detrended fluctuation analysis of music signals: Danceability estimation and further semantic characterization. In The 118th AES Convention, 2005.
68. G. Tzanetakis and P. Cook. Multifeature audio segmentation for browsing and annotation. In IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA’99), page 103–106, 1999.
69. G. Tzanetakis and P. Cook. Marsyas: A framework for audio analysis. Organised sound, 4(3):169–175, 2000.
70. E. Vickers. Automatic long-term loudness and dynamics matching. In The 111th AES Convention, 2001.
71. N. Wack, E. Guaus, C. Laurier, R. Marxer, D. Bogdanov, J. Serrà, and P. Herrera. Music type groupers (MTG): generic music classification algorithms. In Music Information Retrieval Evaluation Exchange (MIREX’09), 2009.
72. N. Wack, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serra, E. Gomez, and P. Herrera. Music classification using high-level models. In Music Information Retrieval Evaluation Exchange (MIREX’10), 2010.
73. Y. Yang, D. Bogdanov, P. Herrera, and M. Sordo. Music retagging using label propagation and robust principal component analysis. In Int. World Wide Web Conf. (WWW’12). Int. Workshop on Advances in Music Information Research (AdMIRe’12), 2012.
74. J. Zapata, M. Davies, and E. Gómez. MIREX 2012: Multi feature beat tracker (ZDG1 and ZDG2). In Music Information Retrieval Evaluation Exchange (MIREX’12), 2012.
75. J. R. Zapata, A. Holzapfel, M. E. Davies, J. L. Oliveira, and F. Gouyon. Assigning a confidence threshold on automatic beat annotation in large datasets. In Int. Society for Music Information Retrieval Conf. (ISMIR’12), 2012.