An RNN-based music language model for improving automatic music transcription

Proceedings of the 15th International Society for Music Information Retrieval Conference, ISMIR 2014

Volumn , Issue , 2014, Pages 53-58

  Sigtia, Siddharth ^a   Benetos, Emmanouil ^b   Cherla, Srikanth ^b   Weyde, Tillman ^b   d’Avila Garcez, Artur S ^b   Dixon, Simon ^a  

^a QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

^b CITY UNIVERSITY   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; INFORMATION RETRIEVAL; SPEECH RECOGNITION; STATISTICAL TESTS; TRANSCRIPTION;

AUTOMATIC MUSIC TRANSCRIPTION; AUTOMATIC SPEECH RECOGNITION; MULTIPLE INSTRUMENTS; PRIOR INFORMATION; PRIOR PROBABILITY; PROBABILISTIC LATENT COMPONENT ANALYSIS; RECURRENT NEURAL NETWORK (RNN); TEMPORAL STRUCTURES;

RECURRENT NEURAL NETWORKS;

EID: 84946061003     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (27)

1. Music Information Retrieval Evaluation eXchange (MIREX). http://music-ir.org/mirexwiki/.
2. E. Benetos, S. Cherla, and T. Weyde. An effcient shiftinvariant model for polyphonic music transcription. In 6th International Workshop on Machine Learning and Music, 2013.
3. E. Benetos and S. Dixon. A shift-invariant latent variable model for automatic music transcription. Computer Music Journal, 36(4):81–94, 2012.
4. E. Benetos, S. Dixon, D. Giannoulis, H. Kirchhoff, and A. Klapuri. Automatic music transcription: challenges and future directions. Journal of Intelligent Information Systems, 41(3):407–434, December 2013.
5. Y. Bengio, N. Boulanger-Lewandowski, and R. Pascanu. Advances in optimizing recurrent networks. In ICASSP, pages 8624–8628, May 2013.
6. Y. Bengio, P. Simard, and P. Frasconi. Learning long-term dependencies with gradient descent is difficult. IEEE Trans. Neural Networks, 5(2):157–166, 1994.
7. N. Bertin, R. Badeau, and E. Vincent. Enforcing harmonicity and smoothness in Bayesian non-negative matrix factorization applied to polyphonic music transcription. IEEE Trans. Audio, Speech, and Language Processing, 18(3):538–549, March 2010.
8. S. Böck and M. Schedl. Polyphonic piano note transcription with recurrent neural networks. In ICASSP, pages 121–124, March 2012.
9. N. Boulanger-Lewandowski, Y. Bengio, and P. Vincent. Modeling temporal dependencies in high-dimensional sequences: Application to polyphonic music generation and transcription. In 29th Int. Conf. Machine Learning, 2012.
10. N. Boulanger-Lewandowski, Y. Bengio, and P. Vincent. High-dimensional sequence transduction. In ICASSP, pages 3178–3182, May 2013.
11. A. T. Cemgil. Bayesian Music Transcription. PhD thesis, Radboud University of Nijmegen, 2004.
12. A. P. Dempster, N. M. Laird, and D. B. Rubin. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, 39(1):1–38, 1977.
13. Z. Duan, B. Pardo, and C. Zhang. Multiple fundamental frequency estimation by modeling spectral peaks and non-peak regions. IEEE Trans. Audio, Speech, and Language Processing, 18(8):2121–2133, November 2010.
14. M. Goto, H. Hashiguchi, T. Nishimura, and R. Oka. RWC music database: music genre database and musical instrument sound database. In ISMIR, Baltimore, USA, October 2003.
15. S. Hochreiter and J. Schmidhuber. Long short-term memory. Neural computation, 9(8):1735–1780, 1997.
16. H. Jaeger. Adaptive nonlinear system identification with echo state networks. In Advances in neural information processing systems, pages 593–600, 2002.
17. H. Larochelle and I. Murray. The neural autoregressive distribution estimator. Journal of Machine Learning Research, 15:29–37, 2011.
18. D. D. Li and H. S. Seung. Learning the parts of objects by non-negative matrix factorization. Nature, 401:788–791, October 1999.
19. J. Martens and I. Sutskever. Learning recurrent neural networks with Hessian-free optimization. In 28th Int. Conf. Machine Learning, pages 1033–1040, 2011.
20. J. Nam, J. Ngiam, H. Lee, and M. Slaney. A classification-based polyphonic piano transcription approach using learned feature representations. In ISMIR, pages 175–180, October 2011.
21. L. Rabiner and B.-H. Juang. Fundamentals of speech recognition. 1993.
22. S.A. Raczynski, E. Vincent, and S. Sagayama. Dynamic Bayesian networks for symbolic polyphonic pitch modeling. IEEE Transactions on Audio, Speech, and Language Processing, 21(9):1830–1840, 2013.
23. C. Schörkhuber and A. Klapuri. Constant-Q transform toolbox for music processing. In 7th Sound and Music Computing Conf., Barcelona, Spain, July 2010.
24. P. Smaragdis and G. Mysore. Separation by “humming”: user-guided sound extraction from monophonic mixtures. In IEEE WASPAA, pages 69–72, October 2009.
25. P. Smaragdis, B. Raj, and M. Shashanka. A probabilistic latent variable model for acoustic modeling. In Neural Information Processing Systems Workshop, Whistler, Canada, December 2006.
26. I. Sutskever, G. E. Hinton, and G. W. Taylor. The recurrent temporal restricted Boltzmann machine. In Advances in Neural Information Processing Systems, pages 1601–1608, 2008.
27. P. J. Werbos. Backpropagation through time: what it does and how to do it. Proceedings of the IEEE, 78(10):1550–1560, 1990.