Multipitch estimation of piano music by exemplar-based sparse representation

IEEE Transactions on Multimedia

Volumn 14, Issue 3 PART1, 2012, Pages 608-618

  Lee, Cheng Te ^a   Yang, Yi Hsuan ^b   Chen, Homer H ^a  

^a NATIONAL TAIWAN UNIVERSITY   (Taiwan)

^b RESEARCH CENTER FOR INFORMATION TECHNOLOGY INNOVATION   (Taiwan)

Author keywords

Content retrieval; l 1 regularized minimization; music transcription; pitch estimation; sparse representation

Indexed keywords

CANDIDATE SELECTION; CONTENT RETRIEVAL; ESTIMATION PROCESS; HIGH LEVEL SEMANTICS; LINEAR COMBINATIONS; LOW-LEVEL FEATURES; MUSIC RECORDING; MUSIC TRANSCRIPTION; MUSIC UNDERSTANDING; PIANO MUSIC; PIANO NOTES; PITCH ESTIMATION; SEMANTIC GAP; SPARSE REPRESENTATION; STATE-OF-THE-ART SYSTEM;

ACOUSTIC VARIABLES MEASUREMENT; SEMANTICS;

ESTIMATION;

EID: 84861135715     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2012.2191398     Document Type: Article

References (49)

1. M. Casey, R. Veltkamp, M. Goto, M. Leman, C. Rhodes, and M. Slaney, "Content-based music information retrieval: Current directions and future challenges," Proc. IEEE, vol. 96, no. 4, pp. 668-696, Apr. 2008.
2. S. Bregman, Auditory Scene Analysis: The Perceptual Organization of Sound. Cambridge, MA: MIT Press, 1990.
3. H. F. Olson, Music, Physics and Engineering. NewYork:Dover, 1967.
4. A. de Cheveigné and H. Kawahara, "Yin, a fundamental frequency estimator for speech and music," J. Acoust. Soc. Amer., vol. 111, pp. 1917-1930, 2002. (Pubitemid 34297247)
5. G. Peeters, "Music pitch representation by periodicity measures based on combined temporal and spectral representations," in Proc. Int. Conf. Acoust., Speech, Signal Process., Toulouse, France, May 2006, pp. 53-56.
6. M. Marolt, "A connectionist approach to automatic transcription of polyphonic piano music," IEEE Trans. Multimedia, vol. 6, no. 3, pp. 439-449, Jun. 2004.
7. J. Bello, L. Daudet, and M. S and ler, "Automatic piano transcription using frequency and time-domain information," IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 6, pp. 2242-2251, Nov. 2006.
8. G. Poliner and D. Ellis, "A discriminative model for polyphonic piano transcription," EURASIP J. Adv. Signal Process., vol. 8, pp. 1-9, 2007.
9. V. Emiya, R. Badeau, and B. David, "Multipitch estimation of piano sounds using a new probabilistic spectral smoothness principle," IEEE Trans. Audio, Speech Lang. Process., vol. 18, no. 6, pp. 1643-1654, Aug. 2010.
10. A. Klapuri, "Multiple fundamental frequency estimation based on harmonicity and spectral smoothness," IEEE Trans. Speech Audio Process., vol. 11, no. 6, pp. 804-816, Nov. 2003.
11. C. Yeh and A. Roebel, "Multiple-F0 estimation for MIREX 2010," Music Information Retrieval Evaluation eXchange 2010. [Online]. Available: http://www.music-ir.org/mirex/abstracts/2010/AR1.pdf
12. C. Yeh, A. Roebel, and X. Rodet, "Multiple fundamental frequency estimation and polyphony inference of polyphonic music signals," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 6, pp. 1116-1126, Aug. 2010.
13. A. Klapuri, "Multiple fundamental frequency estimation by summing harmonic amplitudes," in Proc. Int. Conf. Music Inf. Retrieval, Victoria, BC, Canada, Oct. 2006, pp. 216-221.
14. Z. Duan, B. Pardo, and C. Zhang, "Multiple fundamental frequency estimation by modeling spectral peaks and non-peak regions," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 8, pp. 2121-2133, Nov. 2010.
15. P. Smaragdis and J. C. Brown, "Non-negative matrix factorization for polyphonic music transcription," in Proc. Workshop Applicat. Signal Process. Audio Acoust., New Paltz, NY, Oct. 2003, pp. 177-180.
16. S. A. Abdallah and M. D. Plumbley, "Polyphonic transcription by nonnegative sparse coding of power spectra," in Proc. Int. Conf. Music Inf. Retrieval, Barcelona, Spain, Oct. 2004, pp. 318-325.
17. T. Blumensath and M. Davies, "Sparse and shift-invariant representations of music," IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 1, pp. 50-57, Jan. 2006. (Pubitemid 43863452)
18. A. Cont, "Realtime multiple pitch observation using sparse non-negative constraints," in Proc. Int. Conf. Music Inf. Retrieval, Victoria, BC, Canada, Oct. 2006, pp. 206-212.
19. C. Févotte, N. Bertin, and J.-L. Durrieu, "Nonnegative matrix factorization with the Itakura-Saito divergence: With application to music analysis," Neural Comput., vol. 21, no. 3, pp. 793-830, Mar. 2009.
20. A. Dessein, A. Cont, and G. Lemaitre, "Real-time polyphonic music transcription with non-negative matrix factorization and beta-divergence," in Proc. Int. Conf. Music Inf. Retrieval, Utrecht, The Netherl and s, Aug. 2010, pp. 489-494.
21. E. Vincent, N. Bertin, and R. Badeau, "Adaptive harmonic spectral decomposition for multiple pitch estimation," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 3, pp. 528-537, Mar. 2010.
22. J. A. Moorer, "On the transcription of musical sound by computer," Comput. Music J., vol. 1, no. 4, pp. 32-38, 1977.
23. MIDI Manufacturers Association, Complete MIDI 1.0 Detailed Specification. Nov. 2001.
24. C. Yeh, N. Bogaards, and A. Roebel, "Synthesized polyphonic music database with verifiable ground truth for multiple-F0 estimation," in Proc. Int. Conf. Music Inf. Retrieval, Vienna, Austria, 2007, pp. 393-398.
25. C. Dodge and T. A. Jerse, ComputerMusic: Synthesis Composition and Performance. New York: Schirmer, 1997, pp. 80-84.
26. J. Wright, A. Yang, A. Ganesh, S. Sastry, and Y. Ma, "Robust face recognition via sparse representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 210-227, Feb. 2009.
27. Y. Panagakis, C. Kotropoulos, and G. R. Arce, "Music genre classification via sparse representations of auditory temporal modulations," presented at the 17th Eur. Signal Process. Conf., Glasgow, Scotl and , Aug. 2009.
28. J. F. Gemmeke, T. Virtanen, and A. Hurmalainen, "Exemplar-based sparse representations for noise robust automatic speech recognition," IEEE Trans. Audio, Speech, Lang. Process., vol. 19, no. 7, pp. 2067-2080, Sep. 2011.
29. C.-T. Lee, Y.-H. Yang, K.-S. Lin, and H. H. Chen, "Multiple fundamental frequency estimation of piano signals via sparse representation of Fourier Coefficients," Music Information Retrieval Evaluation eXchange. 2010. [Online]. Available: http://www.music-ir.org/mirex/abstracts/2010/LYLC1. pdf
30. C.-T. Lee, Y.-H. Yang, and H. H. Chen, "Automatic transcription of piano music by sparse representation of magnitude spectra," in Proc. IEEE Int. Conf. Multimedia Expo., Barcelona, Spain, Jul. 2011.
31. "Multiple F0 estimation," in Computational Auditory Scene Analysis: Principles, Algorithms and Applications, A. de Cheveigné, D. Wang, and G. J. Brown, Eds. Piscataway, NJ: IEEE/Wiley, 2006.
32. Z. Duan, Y. Zhang, C. Zhang, and Z. Shi, "Unsupervised single-channel music source separation by average harmonic structure modeling," IEEE Trans. Audio, Speech, Lang. Process., vol. 16, no. 4, pp. 766-778, May 2008.
33. A. Klapuri and M. Davy, Signal Processing Methods for Music Transcription. New York: Springer, 2006.
34. S. A. Abdallah and M. D. Plumbley, "An independent component analysis approach to automatic music transcription," presented at the Audio Eng. Soc. 114th Convention, Amsterdam, The Netherl and s, Mar. 2003.
35. D. D. Lee and H. S. Seung, "Algorithms for non-negative matrix factorization," Adv. Neural Inf. Process. Syst., vol. 13, pp. 556-562, 2001.
36. S. A. Abdallah, "Towards music perception by redundancy reduction and unsupervised learning in probabilistic models," Ph.D. dissertation, Dept. Elect. Eng., King's College, London, U.K., 2002.
37. S. Chu, S. Narayanan, and C.-C. J. Kuo, "Environmental sound recognition with time-frequency audio features," IEEE Trans. Audio, Speech Lang. Process., vol. 17, no. 6, pp. 1142-1158, Aug. 2009.
38. M. D. Plumbley, T. Blumensath, L. Daudet, R. Gribonval, and M. Davies, "Sparse representations in audio and music: From coding to source separation," Proc. IEEE, vol. 98, no. 6, pp. 995-1005, Jun. 2010.
39. D. Donoho, "For most large underdetermined systems of linear equations the minimal-norm solution is also the sparsest solution," Commun. Pure Appl. Math., vol. 59, no. 6, pp. 797-829, 2006. (Pubitemid 43667226)
40. E. C and ès, J. Romberg, and T. Tao, "Stable signal recovery from incomplete and inaccurate measurements," Commun. Pure Appl. Math., vol. 59, no. 8, pp. 1207-1223, Aug. 2006. (Pubitemid 43988295)
41. E. C and es and J. Romberg,-Magic: recovery of sparse signals via convex programming, 2005. [Online]. Available: http://users.ece. gatech.edu/~justin/ l1magic/
42. S. Kim, K. Koh, M. Lustig, S. Boyd, and D. Gorinvesky, "An interiorpoint method for large-scale-regularized least squares," IEEE J. Sel. Topics Signal Process., vol. 1, no. 4, pp. 606-617, Dec. 2007. (Pubitemid 351266626)
43. IBM Corporation and Microsoft Corporation, Multimedia Programming Interface and Data Spec. 1.0 Aug. 1991.
44. K. Dressler and S. Streich, "Tuning frequency estimation using circular statistics," in Proc. Int. Conf. Music Inf. Retrieval, Vienna, Austria, Sep. 2007, pp. 357-360.
45. M. Br and , "Coupled Hidden Markov Models for modeling interacting processes, mit media lab vision and modeling," Tech. Rep. 405, Nov. 1996.
46. V. Emiya, "Transcription automatique de la musique de piano," Ph.D. dissertation, TELECOM ParisTech, Paris, France, 2008.
47. C. J. van Rijsbergen, Information Retrieval. London, U.K.: Butterworth, 1979.
48. J. Wright, Y. Ma, J. Mairal, G. Sapiro, T. Huang, and S. Yan, "Sparse representation for computer vision and pattern recognition," Proc. IEEE, vol. 98, no. 6, pp. 1031-1044, Jun. 2010.
49. J. Bello, L. Daudet, S. Abdallah, C. Duxbury,M. Davies, and M. S and ler, "A tutorial on onset detection in music signals," IEEE Trans. Audio, Speech, Lang. Process., vol. 13, no. 5, pp. 1035-1047, Sep. 2005.