Transcribing multi-instrument polyphonic music with hierarchical eigeninstruments

IEEE Journal on Selected Topics in Signal Processing

Volumn 5, Issue 6, 2011, Pages 1159-1169

  Grindlay, Graham ^a   Ellis, Daniel P W ^a  

^a Columbia University ^*  (United States)

Author keywords

Eigeninstruments; Music; Non negative matrix factorization (NMF); Polyphonic transcription; Subspace

Indexed keywords

EIGENINSTRUMENTS; LEVELS OF ABSTRACTION; LINEAR MANIFOLD; MODEL PARAMETERS; MUSIC; MUSIC RECORDING; NON-NEGATIVE MATRIX FACTORIZATION (NMF); NON-NEGATIVE MATRIX FACTORIZATION ALGORITHMS; POLYPHONIC MUSIC; PRIOR KNOWLEDGE; PROBABILISTIC MODELS; SINGLE-CHANNEL; SUBSPACE;

BLIND SOURCE SEPARATION; FACTORIZATION; MATRIX ALGEBRA; MIXTURES; TRANSCRIPTION;

INSTRUMENTS;

EID: 80053031254     PISSN: 19324553     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSTSP.2011.2162395     Document Type: Article

References (44)

1. P. Paatero and U. Tapper, "Positive matrix factorization: A non-negative factor model with optimal utilization of error estimates of data values," Environmetrics, vol. 5, no. 2, pp. 111-126, 1994.
2. D. D. Lee and H. S. Seung, "Learning the parts of objects by nonnegative matrix factorization," Nature, vol. 401, no. 6755, pp. 788-791, 1999.
3. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. R. Statist. Soc., vol. 39, no. 1, pp. 1-38, 1977.
4. D. D. Lee and H. S. Seung, "Algorithms for non-negative matrix factorization," in Proc. Adv. Neural Inf. Process. Syst., 2001, pp. 556-562.
5. P. O. Hoyer, "Non-negative matrix factorization with sparseness constraints," J. Mach. Learn. Res., vol. 5, pp. 1457-1469, 2004.
6. J. Eggert and E. Körner, "Sparse coding and NMF," in Proc. IEEE Int. Joint Conf. Neural Netw., 2004, vol. 4, pp. 2529-2533. (Pubitemid 40011434)
7. M. Shashanka, B. Raj, and P. Smaragdis, "Probabilistic latent variable models as non-negative factorizations," Comput. Intell. Neurosci., vol. 2008, 2008, Article ID 947438.
8. T. Virtanen, "Monaural sound source separation by nonnegative matrix factorization with temporal continuity and sparseness criteria," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 3, pp. 1066-1074, Mar. 2007.
9. T. Virtanen, A. T. Cemgil, and S. Godsill, "Bayesian extensions to nonnegative matrix factorization for audio signal modeling," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 2008, pp. 1825-1828.
10. C. Févotte, N. Bertin, and J. L. Durrieu, "Nonnegative matrix factorization with the Itakura-Saito divergence. With application to music analysis," Neural Comput., vol. 21, no. 3, pp. 793-830, 2009.
11. M. N. Schmidt and R. K. Olsson, "Single-channel speech separation using sparse non-negative matrix factorization," in Proc. Int. Conf. Spoken Lang. Process., 2006.
12. P. Smaragdis, M. Shashanka, and B. Raj, "A sparse non-parametric approach for single channel separation of known sounds," in Proc. Adv. Neural Inf. Process. Syst., 2009, pp. 1705-1713.
13. P. Smaragdis and J. C. Brown, "Non-negative matrix factorization for polyphonic music transcription," in Proc. IEEE Workshop Applicat. Signal Process. Audio Acoust., 2003, pp. 177-180.
14. E. Vincent, N. Bertin, and R. Badeau, "Harmonic and inharmonic non-negative matrix factorization for polyphonic pitch transcription," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 2008, pp. 109-112.
15. G. Grindlay and D. P. W. Ellis, "Multi-voice polyphonic music transcription using eigeninstruments," in Proc. IEEE Workshop Applicat. Signal Process. Audio Acoust., 2009, pp. 53-56.
16. G. Grindlay and D. P. W. Ellis, "A probabilistic subspace model for polyphonic music transcription," in Int. Conf. Music Inf. Retrieval, 2010, pp. 21-26.
17. V. Y. F. Tan and C. Févotte, "Automatic relevance determination in nonnegative matrix factorization," in Proc. Workshop Signal Process. with Adaptive Sparse Structured Represent., 2009.
18. M. Helén and T. Virtanen, "Separation of drums from polyphonic music using non-negative matrix factorization and support vector machine," in Proc. Eur. Signal Process. Conf., 2005.
19. K. Murao, M. Nakano, Y. Kitano, N. Ono, and S. Sagayama, "Monophonic instrument sound segregation by clustering NMF components based on basis similarity and gain disjointness," in Proc. Int. Soc. Music Inf. Retrieval Conf., 2010, pp. 375-380.
20. T. Virtanen and A. Klapuri, "Analysis of polyphonic audio using source-filter model and non-negative matrix factorization," in Proc. Adv. Neural Inf. Process. Syst., 2006.
21. T. Heittola, A. Klapuri, and T. Virtanen, "Musical instrument recognition in polyphonic audio using source-filter model for sound separation," in Proc. Int. Conf. Music Inf. Retrieval, 2009, pp. 327-332.
22. E. Vincent, N. Bertin, and R. Badeau, "Adaptive harmonic spectral decomposition for multiple pitch estimation," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 3, pp. 528-537, Mar. 2010.
23. N. Bertin, R. Badeau, and E. Vincent, "Enforcing harmonicity and smoothness in Bayesian non-negative matrix factorization applied to polyphonic music transcription," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 3, pp. 538-549, Mar. 2010.
24. A. de Cheveigné and H. Kawahara, "YIN, A fundamental frequency estimator for speech and music," The J. Acoust. Soc. Amer., vol. 111, no. 1917, pp. 1917-1930, 2002. (Pubitemid 34297247)
25. A. Klapuri, "Multiple fundamental frequency estimation based on harmonicity and spectral smoothness," IEEE Trans. Speech Audio Process., vol. 11, no. 6, pp. 804-816, Nov. 2003.
26. S. A. Abdallah and M. D. Plumbley, "Polyphonic music transcription by non-negative sparse coding of power spectra," in Proc. Int. Conf. Music Inf. Retrieval, 2004, pp. 318-325.
27. M. Goto, "Areal-timemusic-scene-descriptionsystem:Predominant-F0 estimation for detecting melody and bass lines in real-world audio signals," Speech Commun., vol. 43, no. 4, pp. 311-329, 2004.
28. G. Poliner and D. P. W. Ellis, "A discriminative model for polyphonic piano transcription," EURASIP J. Adv. Signal Process., 2007, Article ID 48317.
29. K. Kashino, K. Nakadai, T. Kinoshita, and H. Tanaka, "Organization of hierarchical perceptual sounds: Music scene analysis with autonomous processing modules and a quantitative information integration mechanism," in Proc. Int. Joint Conf. Artif. Intell., 1995, pp. 158-164.
30. E. Vincent and X. Rodet, "Music transcription with ISA and HMM," in Proc. Int. Symp. Ind. Compon. Anal. Blind Signal Separat., 2004, pp. 1197-1204. (Pubitemid 39751157)
31. P. Leveau, E. Vincent, G. Richard, and L. Daudet, "Instrument- specific harmonic atoms for mid-level music representation," IEEE Trans. Audio, Speech, Lang. Process., vol. 16, no. 1, pp. 116-128, Jan. 2008.
32. H. Kameoka, T. Nishimoto, and S. Sagayama, "A multipitch analyzer based on harmonic temporal structured clustering," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 3, pp. 982-994, Mar. 2007.
33. W. C. Chang, W. Y. Su, C. Yeh, A. Roebel, and X. Rodet, "Multiple-F0 tracking based on a high-order hmm model," in Proc. Int. Conf. Digital Audio Effects, 2008, pp. 379-386.
34. Z. Duan, J. Han, and B. Pardo, "Harmonically informed multi-pitch tracking," in Proc. Int. Soc. Music Inf. Retrieval Conf., 2009, pp. 333-338.
35. Z. Duan, J. Han, and B. Pardo, "Song-level multi-pitch tracking by heavily constrained clustering," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 2010, pp. 57-60.
36. E. Gaussier and C. Goutte, "Relation between PLSA and NMF and implications," in Proc. Int. ACMSIGIR Conf. Res. Develop. Inf. Retrieval, 2005, pp. 601-602.
37. T. Hofmann, "Probabilistic latent semantic analysis," in Proc. Conf. Uncertainty Artif. Intell., 1999, pp. 289-296.
38. R. Kuhn, J. Junqua, P. Nguyen, and N. Niedzielski, "Rapid speaker identification in eigenvoice space," IEEE Trans. Speech Audio Process., vol. 8, no. 6, pp. 695-707, Nov. 2000. (Pubitemid 32025317)
39. R. J. Weiss and D. P. W. Ellis, "Speech separation using speakeradapted eigenvoice speech models," Comput. Speech Lang., vol. 24, no. 1, pp. 16-29, 2010.
40. G. E. Hinton, P. Dayan, and M. Revow, "Modelling the manifolds of images and handwritten digits," IEEE Trans. Neural Netw., vol. 8, no. 1, pp. 65-74, Jan. 1997. (Pubitemid 127767781)
41. S. Zhang, W. Wang, J. Ford, and F. Makedon, "Learning from incomplete ratings using non-negative matrix factorization," in Proc. SIAM Int. Conf. Data Mining, 2006, pp. 549-553. (Pubitemid 43955577)
42. C. J. van Rijsbergen, Information Retrieval, 2nd ed. London, U.K.: Butterworths, 1979.
43. M. Ryynänen and A. Klapuri, "Polyphonic music transcription using note event modeling," in Proc. IEEE Workshop Applicat. Signal Process. Audio Acoust., 2005, pp. 319-322. (Pubitemid 44461857)
44. T. Fawcett, "An introduction to ROC analysis," Pattern Recognit. Lett., vol. 27, no. 2006, pp. 861-874, 2005.