High-dimensional sequence transduction

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2013, Pages 3178-3182

  Boulanger Lewandowski, Nicolas ^a   Bengio, Yoshua ^a   Vincent, Pascal ^a  

^a UNIVERSITÉ DE MONTRÉAL   (Canada)

Author keywords

polyphonic transcription; recurrent neural network; restricted Boltzmann machine; Sequence transduction

Indexed keywords

HIGH-DIMENSIONAL; OUTPUT DISTRIBUTION; OUTPUT SEQUENCES; POLYPHONIC TRANSCRIPTIONS; PROBABILISTIC MODELING; RESTRICTED BOLTZMANN MACHINE; SEQUENCE TRANSDUCTION; SYNTHESIZED SOUNDS;

ALGORITHMS; AUDIO SYSTEMS; BACTERIOPHAGES; PROBABILITY DISTRIBUTIONS; RECURRENT NEURAL NETWORKS; SIGNAL PROCESSING;

TRANSCRIPTION;

EID: 84890448143     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2013.6638244     Document Type: Conference Paper

References (24)

1. D.E. Rumelhart, G.E. Hinton, and R.J. Williams, "Learning internal representations by error propagation," in Parallel Dist. Proc., pp. 318-362. MIT Press, 1986.
2. A. Graves, "Sequence transduction with recurrent neural networks," in ICML 29, 2012.
3. P. Smolensky, "Information processing in dynamical systems: Foundations of harmony theory," in Parallel Dist. Proc., pp. 194-281. MIT Press, 1986.
4. H. Larochelle and I. Murray, "The neural autoregressive distribution estimator," JMLR: W&CP, vol. 15, pp. 29-37, 2011.
5. Y. Bengio and S. Bengio, "Modeling high-dimensional discrete data with multi-layer neural networks," in NIPS 12, 2000, pp. 400-406.
6. N. Boulanger-Lewandowski, Y. Bengio, and P. Vincent, "Modeling temporal dependencies in high-dimensional sequences: Application to polyphonic music generation and transcription," in ICML 29, 2012.
7. I. Sutskever, G. Hinton, and G. Taylor, "The recurrent temporal restricted Boltzmann machine," in NIPS 20, 2008, pp. 1601-1608.
8. J. Martens and I. Sutskever, "Learning recurrent neural networks with Hessian-free optimization," in ICML 28, 2011.
9. S. Hochreiter and J. Schmidhuber, "Long short-term memory," Neural Computation, vol. 9, no. 8, pp. 1735-1780, 1997.
10. M. Bay, A.F. Ehmann, and J.S. Downie, "Evaluation of multiple-F0 estimation and tracking systems," in ISMIR, 2009.
11. A.T. Cemgil, H.J. Kappen, and D. Barber, "A generative model for music transcription," IEEE Transactions on Audio, Speech, and Language Processing, vol. 14, no. 2, pp. 679-694, 2006.
12. S. Böck and M. Schedl, "Polyphonic piano note transcription with recurrent neural networks," in ICASSP, 2012, pp. 121-124.
13. G.E. Hinton, "Training products of experts by minimizing contrastive divergence," Neural Computation, vol. 14, no. 8, pp. 1771-1800, 2002.
14. S. Richter, J.T. Thayer, and W. Ruml, "The joy of forgetting: Faster anytime search via restarting," in ICAPS, 2010, pp. 137-144.
15. R. Zhou and E.A. Hansen, "Beam-stack search: Integrating backtracking with beam search," in ICAPS, 2005, pp. 90-98.
16. J. Nam, J. Ngiam, H. Lee, and M. Slaney, "A classificationbased polyphonic piano transcription approach using learned feature representations," in ISMIR, 2011.
17. Y. Bengio, "Learning deep architectures for AI," Foundations and Trends in Machine Learning, vol. 2, no. 1, pp. 1-127, 2009.
18. G.E. Poliner and D.P.W. Ellis, "A discriminative model for polyphonic piano transcription," JASP, vol. 2007, no. 1, pp. 154-164, 2007.
19. J. Bergstra and Y. Bengio, "Random search for hyperparameter optimization," Journal of Machine Learning Research, vol. 13, pp. 281-305, 2012.
20. P. Vincent, H. Larochelle, Y. Bengio, and P.A. Manzagol, "Extracting and composing robust features with denoising autoencoders," in ICML 25, 2008, pp. 1096-1103.
21. K.J. Palomäki, G.J. Brown, and J.P. Barker, "Techniques for handling convolutional distortion with 'missing data' automatic speech recognition," Speech Communication, vol. 43, no. 1, pp. 123-142, 2004.
22. M. Marolt, "A connectionist approach to automatic transcription of polyphonic piano music," IEEE Transactions on Multimedia, vol. 6, no. 3, pp. 439-449, 2004.
23. M.P. Ryynänen and A. Klapuri, "Polyphonic music transcription using note event modeling," in ASPAA, 2005, pp. 319-322.
24. C.G. Boogaart and R. Lienhart, "Note onset detection for the transcription of polyphonic piano music," in ICME, 2009, pp. 446-449.