Modeling music as a dynamic texture

IEEE Transactions on Audio, Speech and Language Processing

Volumn 18, Issue 3, 2010, Pages 602-612

  Barrington, Luke ^a   Chan, Antoni B ^a   Lanckriet, Gert ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Automatic segmentation; Dynamic texture model (DTM); Music modeling; Music similarity

Indexed keywords

AUDIO FEATURES; AUTOMATIC SEGMENTATIONS; DYNAMIC TEXTURE MODEL (DTM); DYNAMIC TEXTURES; LINEAR DYNAMICAL SYSTEMS; MUSIC ANALYSIS; MUSIC INFORMATION RETRIEVAL; MUSIC SIMILARITY; MUSICAL AUDIO; TRANSITION BOUNDARIES;

COMPUTER MUSIC; DYNAMIC MODELS; DYNAMICAL SYSTEMS; ELECTRONIC MUSICAL INSTRUMENTS; INFORMATION SERVICES; LINEAR CONTROL SYSTEMS; TEMPERATURE CONTROL; TEXTURES;

AUDIO ACOUSTICS;

EID: 76949083546     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2009.2036306     Document Type: Article

References (48)

1. D. Turnbull, L. Barrington, D. Torres, and G. Lanckriet, "Semantic annotation and retrieval of music and sound effects," IEEE Trans. Acoust., Speech, Lang. Process., vol.16, no.2, pp. 467-476, Feb. 2008.
2. L. Barrington, A. Chan, D. Turnbull, and G. Lanckriet, "Audio information retrieval using semantic similarity," in Proc. Proc. IEEE ICASSP, 2007, vol.2, pp. 725-728.
3. J.-J. Aucouturier, F. Pachet, and M. Sandler, "'The Way It Sounds': Timbre models for analysis and retrieval of music signals," IEEE Trans. Multimedia, vol.7, no.6, pp. 1028-1035, Dec. 2005.
4. L. Barrington, A. B. Chan, and G. Lanckriet, "Dynamic texture models of music," in Proc. IEEE ICASSP, 2009, pp. 1589-1592.
5. G. Doretto, A. Chiuso, Y. N. Wu, and S. Soatto, "Dynamic textures," Int. J. Comput. Vis., vol.51, no.2, pp. 91-109, 2003.
6. A. B. Chan and N.Vasconcelos, "Modeling, clustering, and segmenting video with mixtures of dynamic textures," IEEE Trans. Pattern Anal. Mach. Intell., vol.30, no.5, pp. 909-926, May 2008.
7. J. Foote, "Visualizing music and audio using self-similarity," in Proc. Int. Multimedia Conf., 1999, pp. 77-80.
8. J. Paulus and A. Klapuri, "Music structure analysis using a probabilistic fitness measure and an integrated musicological model," in Proc. 9th Conf. Music Inf. Retrieval (ISMIR), 2008, pp. 369-374.
9. M. Levy, M. Sandler, and M. Casey, "Extraction of high-level musical structure from audio data and its application to thumbnail generation," in Proc. IEEE ICASSP, May 2006, vol.5, p. V-V.
10. B. Logan and S. Chu, "Music summarization using key phrases," in Proc. IEEE ICASSP, 2000, pp. 749-752.
11. J. Reed and C. Lee, "A study on music genre classification based on universal acoustic models," in Proc. 7th Conf. Music Information Retrieval (ISMIR), 2006.
12. S. Abdallah, M. Sandler, C. Rhodes, and M. Casey, "Using duration models to reduce fragmentation in audio segmentation," Mach. Learn.: Special Iss. Mach. Learn. in and for Music, vol.65, no.2-3, pp. 485-515, Dec. 2006.
13. M. Levy and M. Sandler, "Structural segmentation of musical audio by constrained clustering," IEEE Trans. Audio, Speech, Lang. Process., vol.16, no.2, pp. 318-326, Feb. 2008.
14. G. Peeters, A. Burthe, and X. Rodet, "Toward automatic music audio summary generation from signal analysis," in Proc. 3rd Conf. Music Inf. Retrieval (ISMIR), 2002, pp. 94-100.
15. W. Chai and B. Vercoe, "Music thumbnailing via structural analysis," in Proc. 11th ACM Int. Conf. Multimedia, 2003, pp. 223-226.
16. J. Hsu, C. Liu, and L. Chen, "Discovering nontrivial repeating patterns in music data," IEEE Trans. Multimedia, vol.3, no.3, pp. 311-325, Sep. 2001.
17. M. Bartsch and G.Wakefield, "To catch a chorus: Using chroma-based representations for audio thumbnailing," in Proc. IEEE Workshop Applicat. Signal Process. Audio Acoust., 2001, pp. 15-19.
18. M. Goto, "A chorus-section detection method for musical audio singals and its application to a music listening station," IEEE Trans. Audio, Speech, Lang. Process., vol.14, no.1, pp. 1783-1794, Jan., 2006.
19. D. Turnbull, G. Lanckriet, E. Pampalk, and M. Goto, "A supervised approach for detecting boundaries in music using difference features and boosting," in Proc. 8th Conf. Music Inf. Retrieval (ISMIR), 2007.
20. B. Ong and P. Herrera, "Semantic segmentation of music audio contents," in Proc. Int. Comput. Music Conf. (ICMC), 2005.
21. P. Saisan, G. Doretto, Y. Wu, and S. Soatto, "Dynamic texture recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recognition, 2001, vol.2, pp. 58-63.
22. A. B. Chan and N. Vasconcelos, "Probabilistic kernels for the classification of auto-regressive visual processes," in Proc. IEEE Conf. Comput. Vis. Pattern Recognition, 2005, vol.1, pp. 846-851. (Pubitemid 43897281)
23. G. Doretto, D. Cremers, P. Favaro, and S. Soatto, "Dynamic texture segmentation," in Proc. IEEE ICCV, 2003, vol.2, pp. 1236-1242.
24. R. H. Shumway and D. S. Stoffer, "An approach to time series smoothing and forecasting using the EM algorithm," J. Time Series Anal., vol.3, no.4, pp. 253-264, 1982.
25. P. V. Overschee and B. D. Moor, "N4SID: Subspace algorithms for the identification of combined deterministic-stochastic systems," Automatica, vol.30, pp. 75-93, 1994.
26. W. E. Larimore, "Canonical variate analysis in identification, filtering, and adaptive control," in Proc. IEEE Conf. Decision Control, 1990, vol.2, pp. 596-604.
27. D. Bauer, "Comparing the CCA subspace method to pseudo maximum likelihood methods in the case of no exogenous inputs," J. Time Series Anal., vol.26, pp. 631-668, 2005.
28. S. M. Kay, Fundamentals of Statistical Signal Processing: Estimation Theory. Englewood Cliffs, NJ: Prentice-Hall, 1993.
29. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. R. Statist. Soc. B, vol.39, pp. 1-38, 1977.
30. L. Rabiner and B. H. Juang, Fundamentals of Speech Recognition. Englewood Cliffs, NJ: Prentice-Hall, 1993.
31. B. Ong, E. Gómez, and S. Streich, "Automatic extraction of musical structure using pitch class distribution features," inWorkshop Learning the Semantics of Audio Signals, 2006.
32. M. Goto, "Development of the RWC music database," in Proc. Int. Congr. Acoust., April 2004, pp. 553-556.
33. M. Goto, "AIST annotation for RWC music database," in Proc. 7th Int. Conf. Music Inf. Retrieval (ISMIR), Oct. 2006, pp. 359-360.
34. L. Hubert and P. Arabie, "Comparing partitions," J. Classification, vol.2, pp. 193-218, 1985.
35. "EchoNest." [Online]. Available: http://the.echonest.com
36. D. Eck, P. Lamere, T. Bertin-Mahieux, and S. Green, "Automatic generation of social tags for music recommendation," Adv. Neural Inf. Process. Syst. , vol.20, pp. 385-392, 2007.
37. B. Whitman and D. Ellis, "Automatic record reviews," in Proc. 5th Conf. Music Inf. Retrieval (ISMIR), 2004.
38. P. Knees, T. Pohle, M. Schedl, and G.Widmer, "A music search engine built upon audio-based and web-based similarity measures," in Proc. ACM SIGIR, 2007, pp. 447-454.
39. D. Turnbull, R. Liu, L. Barrington, and G. Lanckriet, "Using games to collect semantic information about music," in Proc. 8th Conf. Music Inf. Retrieval (ISMIR), 2007.
40. D. Turnbull, L. Barrington, and G. Lanckriet, "Five approaches to collecting tags for music," in Proc. 9th Conf. Music Inf. Retrieval (ISMIR), 2008, pp. 225-230.
41. L. Barrington, D. Turnbull, and G. Lanckriet, "Auto-tagging music content with semantic multinomials." [Online]. Available: http://www. music-ir.org/mirex/2008/abs/AT-barrington.pdf Oct. 2008
42. S. Dixon, "Mirex 2006 audio beat tracking evaluation: Beatroot." [Online]. Available: http://www.elec.qmul.ac.uk/people/simond/ pub/2006/mirex-beat.pdf 2006
43. F. Gouyon, A. Klapuri, S. Dixon, M. Alonso, G. Tzanetakis, C. Uhle, and P. Cano, "An experimental comparison of audio tempo induction algorithms," IEEE Trans. Audio, Speech, Lang. Process., vol.5, pp. 1832-1844, Sep. 2006.
44. S. Roweis and L. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol.290, no.5500, pp. 2323-2326, 2000.
45. J. Russell, "Core affect and the psychological construction of emotion," Psychol. Rev., vol.110, no.1, pp. 145-172, 2003.
46. Z. Ghahramani and G. E. Hinton, "Variational learning for switching state-space models," Neural Comput., vol.12, no.4, pp. 831-864, 2000.
47. A. B. Chan and N. Vasconcelos, "Layered dynamic textures," IEEE Trans. Pattern Anal. Mach. Intell., vol.31, no.10, pp. 1862-1879, Oct. 2009.
48. A. B. Chan and N. Vasconcelos, "Variational layered dynamic textures," in Proc. IEEE Conf. Comput. Vis. Pattern Recognition, 2009.