Musical instrument sound multi-excitation model for non-negative spectrogram factorization

IEEE Journal on Selected Topics in Signal Processing

Volumn 5, Issue 6, 2011, Pages 1144-1158

  Carabias Orti, J J ^a   Virtanen, T ^b   Vera Candeas, P ^a   Ruiz Reyes, N ^a   Canadas Quesada, F J ^a  

^a UNIVERSITY OF JAÉN   (Spain)

^b TAMPERE UNIVERSITY OF TECHNOLOGY   (Finland)

Author keywords

Automatic music transcription; Excitation modeling; Excitation filter model; Non negative matrix factorization (NMF); Source filter model; Spectral analysis

Indexed keywords

AUTOMATIC MUSIC TRANSCRIPTION; BASIS FUNCTIONS; DATA SETS; EXCITATION-FILTER MODEL; MODEL APPROACH; MODEL PARAMETERS; MUSIC TRANSCRIPTION; MUSICAL INSTRUMENT SOUNDS; NON-NEGATIVE MATRIX FACTORIZATION (NMF); NONNEGATIVE MATRIX FACTORIZATION; RESONANCE STRUCTURE; SOURCE-FILTER MODEL; SPECTROGRAMS; STATE-OF-THE-ART METHODS; VIBRATING OBJECTS; WEIGHTED SUM; WOODWIND INSTRUMENTS;

BLIND SOURCE SEPARATION; FACTORIZATION; INSTRUMENTS; MUSICAL INSTRUMENTS; RELIABILITY ANALYSIS; SPECTRUM ANALYSIS; TRANSCRIPTION;

MATRIX ALGEBRA;

EID: 80053034549     PISSN: 19324553     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSTSP.2011.2159700     Document Type: Article

References (47)

1. A. Klapuri, T. Virtanen, and T. Heittola, "Sound source separation in monaural music signals using excitation-filter model and em algorithm," in Proc. Int. Conf. Acoust., Speech, Signal Process. (ICASSP), Dallas, TX, 2010, pp. 5510-5513.
2. J. L. Durrieu, G. Richard, B. David, and C. Fevotte, "Source/filter model for unsupervised main melody extraction from polyphonic audio signals," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 3, pp. 564-575, Mar. 2010.
3. E. Vincent, N. Bertin, and R. Badeau, "Adaptive harmonic spectral decomposition for multiple pitch estimation," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 3, pp. 528-537, Mar. 2010.
4. T. Heittola, A. Klapuri, and T. Virtanen, "Musical instrument recognition in polyphonic audio using source-filter model for sound separation," in Proc. 10th Int. Soc. Music Inf. Retrieval Conf. (ISMIR), Kobe, Japan, 2009.
5. M. Plumbley, "Algorithms for nonnegative independent component analysis," IEEE Trans. Neural Netw., vol. 14, no. 3, pp. 534-543, Mar. 2003.
6. S. Abdallah and M. Plumbley, "Polyphonic music transcription by nonnegative sparse coding of power spectra," in Proc. 5th Int. Soc. Music Inf. Retrieval Conf. (ISMIR), Barcelona, Spain, 2004.
7. P. Leveau, E. Vincent, G. Richard, and L. Daudet, "Instrument- specific harmonic atoms for mid-level music representation," IEEE Trans. Audio, Speech, Lang. Process., vol. 16, no. 1, pp. 116-128, Jan. 2008.
8. D. D. Lee and H. S. Seung, "Learning the parts of objects by non-negative matrix factorization," Nature, vol. 401, pp. 788-791, Oct. 1999.
9. T. Virtanen, "Monaural sound source separation by nonnegative matrix factorization with temporal continuity and sparseness criteria," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 3, pp. 1066-1074, Mar. 2007.
10. P. Smaragdis and J. Brown, "Non-negative matrix factorization for polyphonic music transcription," in Proc. IEEE Workshop Applicat. Signal Process. Audio Acoust. (WASPAA), New Paltz, NY, 2003.
11. S. A. Raczyński, N. Ono, and S. Sagayama, "Multipitch analysis with harmonic nonnegative matrix approximation," in Proc. 8th Int. Soc. for Music Inf. Retrieval Conf. (ISMIR), Vienna, Austria, 2007, pp. 177-180.
12. T. Virtanen, A. T. Cemgil, and S. Godsill, "Bayesian extensions to nonnegative matrix factorization for audio signal modeling," in Proc. Int. Conf. Acoust., Speech, Signal Process. (ICASSP), LasVegas,NV, 2008, pp. 1825-1828.
13. N. Bertin, R. Badeau, and E. Vincent, "Enforcing harmonicity and smoothness in Bayesian non-negative matrix factorization applied to polyphonic music transcription," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 3, pp. 538-549, Mar. 2010.
14. P. Hoyer, "Non-negative matrix factorization with sparseness constraints," J. Mach. Learn. Res., vol. 5, pp. 1457-1469, Nov. 2004.
15. J. Paulus and T. Virtanen, "Drum transcription with non-negative spectrogram factorisation," in Proc. 13th Eur. Signal Process. Conf. (EUSIPCO), Antalaya, Turkey, 2005.
16. J. J. Carabias-Orti, P. Vera-Candeas, F. J. Cañadas-Quesada, and N. Ruiz-Reyes, "Music scene-adaptive harmonic dictionary for unsupervised note-event detection," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 3, pp. 473-486, Mar. 2010.
17. E. Vincent, "Musical source separation using time-frequency source priors," IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 1, pp. 91-98, Jan. 2006. (Pubitemid 43863456)
18. C. Fevotte, N. Bertin, and J.-L. Durrieu, "Nonnegative matrix factorization with the Itakura-Saito divergence. With application to music analysis," Neural Comput., vol. 21, no. 3, pp. 793-830, Mar. 2009.
19. T. Virtanen and A. Klapuri, "Analysis of polyphonic audio using source-filter model and non-negative matrix factorization," in Proc. Adv. Models for Acoust. Process., Neural Inf. Process. Syst. Workshop, 2006.
20. D. FitzGerald, M. Cranitch, and E. Coyle, "Extended nonnegative tensor factorization models for musical source separation," Computat. Intell. Neurosci., vol. 2008, p. 15, 2008, Article ID 872425.
21. R. Badeau, V. Emiya, and B. David, "Expectation-maximization algorithm for multi-pitch estimation and separation of overlapping harmonic spectra," in Proc. Int. Conf. Acoust., Speech, Signal Process. (ICASSP), Taipei, Taiwan, 2009, pp. 3073-3076.
22. E. Vincent, N. Bertin, and R. Badeau, "Harmonic and inharmonic nonnegative matrix factorization for polyphonic pitch transcription," in Proc. Int. Conf. Acoust., Speech, Signal Process. (ICASSP), Las Vegas, NV, 2008, pp. 109-112.
23. R. Rabiner and R. W. Schafer, Digital Processing of Speech Signals. Upper Saddle River, NJ: Prentice-Hall, 1978.
24. V. Välimäki, J. Pakarinen, C. Erkut, and M. Karjalainen, "Discretetime modeling of musical instruments," Rep. Progress Phys., vol. 69, no. 1, pp. 1-78, 2006.
25. J. Woodhouse, "On the synthesis of guitar plucks," Acta Acustica United With Acustica, vol. 90, no. 5, pp. 928-944, 2004.
26. N. H. Fletcher and T. D. Rossing, The Physics of Musical Instruments, 2nd ed. New York: Springer, Jun. 19, 1998, ISBN: 978-0387983745.
27. D. D. Lee and H. S. Seung, "Algorithms for non-negative matrix factorization," in Proc. Neural Inf. Process. Syst., Denver, CO, 2000.
28. M. P. Ryynänen and A. P. Klapuri, "Automatic transcription of melody, bass line, and chords in polyphonic music," Comput. Music J., vol. 32, no. 3, pp. 72-86, 2008.
29. M. R. Every and J. E. Szymanski, "Separation of synchronous pitched notes by spectral filtering of harmonics," IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 5, pp. 1845-1856, Sep. 2006. (Pubitemid 46547603)
30. J. Eggink and G. J. Brown, "Application of missing feature theory to the recognition of musical instruments in polyphonic audio," in Proc. Int. Conf. Music Inf. Retrieval (ISMIR), 2003, pp. 125-131.
31. W. DeLiang and G. Brown, Computational Auditory Scene Analysis. New York: Wiley, 2006.
32. M. Goto, H. Hashiguchi, T. Nishimura, and R. Oka, "RWCmusic database: Popular, classical, and jazz music databases," in Proc. 3rd Int. Soc. Music Inf. Retrieval Conf. (ISMIR), Paris, France, Oct. 2002.
33. M. Goto, "Development of the RWC music database," in Proc. 18th Int. Congr. Acoust. (ICA'04), Apr. 2004, pp. I-553-I-556, (Invited Paper).
34. V. Emiya, R. Badeau, and B. David, "Multipitch estimation of piano sounds using a new probabilistic spectral smoothness principle," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 6, pp. 1643-1654, Aug. 2010.
35. V. Emiya, "Transcription Automatique de la Musique de Piano," Ph.D. dissertation, Institut TELECOM; TELECOM ParisTech, Paris, France, 2008.
36. Mirex 2007: Music Information Retrieval Evaluation Exchange, [Online]. Available: http://www.music-ir.org/mirex/wiki/ 2007:MIREX-HOME
37. S. G. Mallat and Z. Zhang, "Matching pursuits with time-frequency dictionaries," IEEE Trans. Signal Process., vol. 41, no. 12, pp. 3397-3415, Dec. 1993.
38. N. Ruiz-Reyes and P. Vera-Candeas, "Adaptive signal modeling based on sparse approximations for scalable parametric audio coding," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 3, pp. 447-460, Mar. 2010.
39. S. van de Par, A. Kohlrausch, G. Charestan, and R. Heusdens, "A new psycho-acoustical masking model for audio coding applications," in Proc. Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2002, pp. 1805-1808.
40. R. Heusdens, R. Vafin, and W. B. Kleijn, "Sinusoidal modeling using psychoacoustic-adaptive matching pursuits," IEEE Signal Process. Lett., vol. 9, no. 8, pp. 262-265, Aug. 2002. (Pubitemid 35170367)
41. C. van Rijsbergen, Information Retrieval, 2nd ed. London, U.K.: Butterworths, 1979.
42. R. V. Hogg and A. T. Craig, Introduction to Mathematical Statistics, 4th ed. New York: Macmillan, 1989.
43. M. Marolt, "A connectionist approach to automatic transcription of polyphonic piano music," IEEE Trans. Multimedia, vol. 6, no. 3, pp. 439-449, Jun. 2004.
44. A. de Cheveigné and H. Kawahara, "YIN, a fundamental frequency estimator for speech and music," J. Acoust. Soc. Amer., vol. 111, no. 4, pp. 1917-1930, 2002. (Pubitemid 34297247)
45. T. Tolonen and M. Karjalainen, "A computationally efficient multipitch analysis model," IEEE Trans. Speech Audio Process, vol. 8, no. 6, pp. 708-716, Nov. 2000.
46. A. Pertusa and J. M. Iesta, "Multiple fundamental frequency estimation using Gaussian smoothness," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2008, pp. 105-108.
47. A. Klapuri, "Multiple fundamental frequency estimation by summing harmonic amplitudes," in Proc. Int. Conf. Music Inf. Retrieval (ISMIR), 2006, pp. 216-221.