Editorial introduction to the Neural Networks special issue on Deep Learning of Representations

Neural Networks

Volumn 64, Issue , 2015, Pages 1-3

  Bengio, Yoshua ^a   Lee, Honglak ^a  

^a NONE

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; DEEP LEARNING; EDITORIAL; LEARNING ALGORITHM; MACHINE LEARNING; RESTRICTED BOLTZMANN MACHINE; SPEECH DISCRIMINATION; SUPERVISED LEARNING; SUPPORT VECTOR MACHINE; UNSUPERVISED LEARNING; VISUAL MEMORY;

NEURAL NETWORKS (COMPUTER);

EID: 84922364946     PISSN: 08936080     EISSN: 18792782     Source Type: Journal    
DOI: 10.1016/j.neunet.2014.12.006     Document Type: Editorial

References (33)

1. Bahdanau, D., Cho, K., Bengio, Y. (2014). Neural machine translation by jointly learning to align and translate. Technical report, arXiv preprint arxiv:1409.0473.
2. Bengio Y. Learning deep architectures for AI 2009, Now Publishers.
3. Bengio, Y., Lamblin, P., Popovici, D., Larochelle, H. (2007). Greedy layer-wise training of deep networks. In NIPS.
4. Ciresan D., Meier U., Masci J., Schmidhuber J. Multi-column deep neural network for traffic sign classification. Neural Networks 2012, 32:333-338.
5. Dahl, G.E., Ranzato, M., Mohamed, A., Hinton, G.E. (2010). Phone recognition with the mean-covariance restricted Boltzmann machine. In NIPS.
6. Deng, L., Seltzer, M., Yu, D., Acero, A., Mohamed, A., Hinton, G. (2010). Binary coding of speech spectrograms using a deep auto-encoder. In Interspeech.
7. Devlin, J., Zbib, R., Huang, Z., Lamar, T., Schwartz, R., Makhoul, J. (2014). Fast and robust neural network joint models for statistical machine translation. In ACL.
8. Erhan D., Bengio Y., Courville A., Manzagol P.-A., Vincent P., Bengio S. Why does unsupervised pre-training help deep learning?. The Journal of Machine Learning Research 2010, 11:625-660.
9. Farabet C., Couprie C., Najman L., LeCun Y. Learning hierarchical features for scene labeling. IEEE Transactions on Pattern Analysis and Machine Intelligence 2013, 35(8):1915-1929.
10. Glorot, X., Bordes, A., Bengio, Y. (2011a). Deep sparse rectifier neural networks. In AISTATS.
11. Glorot, X., Bordes, A., Bengio, Y. (2011b). Domain adaptation for large-scale sentiment classification: A deep learning approach. In ICML.
12. Goodfellow, I.J., Courville, A., Bengio, Y. (2011). Spike-and-slab sparse coding for unsupervised feature discovery. In NIPS Workshop on Challenges in Learning Hierarchical Models.
13. Hinton G., Deng L., Dahl G.E., Mohamed A., Jaitly N., Senior A., Vanhoucke V., Nguyen P., Sainath T., Kingsbury B. Deep neural networks for acoustic modeling in speech recognition. IEEE Signal Processing Magazine 2012, 29(6):82-97.
14. Hinton G.E., Osindero S., Teh Y. A fast learning algorithm for deep belief nets. Neural Computation 2006, 18:1527-1554.
15. Jarrett K., Kavukcuoglu K., Ranzato M., LeCun Y. What is the best multi-stage architecture for object recognition?. International Conference on Computer Vision 2009, 2146-2153. IEEE.
16. Krizhevsky, A., Sutskever, I., Hinton, G. (2012). ImageNet classification with deep convolutional neural networks. In NIPS.
17. Le, Q., Ranzato, M., Monga, R., Devin, M., Corrado, G., Chen, K., Dean, J., Ng, A. (2012). Building high-level features using large scale unsupervised learning. In ICML.
18. LeCun Y., Boser B., Denker J.S., Henderson D., Howard R.E., Hubbard W., Jackel L.D. Backpropagation applied to handwritten zip code recognition. Neural Computation 1989.
19. LeCun, Y., Bottou, L., Bengio, Y., Haffner, P. (1998). Gradient based learning applied to document recognition. In Proc. IEEE.
20. Lee, H., Ekanadham, C., Ng, A.Y. (2008). Sparse deep belief network model for visual area V2. In NIPS.
21. Lee, H., Grosse, R., Ranganath, R., Ng, A.Y. (2009a). Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. In ICML.
22. Lee, H., Largman, Y., Pham, P., Ng, A.Y. (2009b). Unsupervised feature learning for audio classification using convolutional deep belief networks. In NIPS.
23. Mesnil, G., Dauphin, Y., Glorot, X., Rifai, S., Bengio, Y., Goodfellow, I., Lavoie, E., Muller, X., Desjardins, G., Warde-Farley, D., Vincent, P., Courville, A., Bergstra, J. (2011). Unsupervised and transfer learning challenge: a deep learning approach. In JMLR W&CP: Proc. Unsupervised and Transfer Learning, Vol. 7.
24. Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J. (2013). Distributed representations of words and phrases and their compositionality. In NIPS.
25. Nair, V., Hinton, G. (2010). Rectified linear units improve restricted Boltzmann machines. In ICML.
26. Raina, R., Battle, A., Lee, H., Packer, B., Ng, A.Y. (2007). Self-taught learning: Transfer learning from unlabeled data. In ICML.
27. Ranzato, M., Poultney, C., Chopra, S., LeCun, Y. (2007). Efficient learning of sparse representations with an energy-based model. In NIPS.
28. Salakhutdinov, R., Mnih, A., Hinton, G. (2007). Restricted Boltzmann machines for collaborative filtering. In ICML.
29. Schmidhuber, J. (2014). Deep learning in neural networks: An overview. arXiv preprint arxiv:1404.7828.
30. Seide, F., Li, G., Yu, D. (2011). Conversational speech transcription using context-dependent deep neural networks. In Interspeech (pp. 437-440).
31. Sermanet, P., Kavukcuoglu, K., Chintala, S., LeCun, Y. (2013). Pedestrian detection with unsupervised multi-stage feature learning. In International Conference on Computer Vision and Pattern Recognition, June.
32. Sutskever, I., Vinyals, O., Le, Q.V. (2014). Sequence to sequence learning with neural networks. Technical report, arXiv preprint arxiv:1409.3215.
33. Weston, J., Ratle, F., Collobert, R. (2008). Deep learning via semi-supervised embedding. In ICML.