Deep learning: yesterday, today, and tomorrow

Jisuanji Yanjiu yu Fazhan/Computer Research and Development

Volumn 50, Issue 9, 2013, Pages 1799-1804

  Yu, Kai ^a   Jia, Lei ^a   Chen, Yuqiang ^a   Xu, Wei ^a  

^a BAIDU INC   (China)

Author keywords

Deep learning; Image recognition; Machine learning; Natural language processing; Online advertising; Speech recognition

Indexed keywords

DEEP LEARNING; HIERARCHICAL STRUCTURES; LEARNING PARADIGMS; MACHINE LEARNING COMMUNITIES; NATURAL LANGUAGE PROCESSING; ONLINE ADVERTISING; RESEARCH COMMUNITIES; TECHNOLOGY TRENDS;

ARTIFICIAL INTELLIGENCE; DATA HANDLING; IMAGE RECOGNITION; LEARNING SYSTEMS; MARKETING; NATURAL LANGUAGE PROCESSING SYSTEMS; SEMANTICS; SPEECH RECOGNITION;

LEARNING ALGORITHMS;

EID: 84885069866     PISSN: 10001239     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (14)

1. Markoff J. How many computers to identify a cat? [N] The New York Times, 2012-06-25
2. Markoff J. Scientists see promise in deep-learning programs [N]. The New York Times, 2012-11-23
3. Li Yanhong. To believe in the power of technology [R]. Beijing: Baidu, 2013 (in Chinese)
4. 10 Breakthrough Technologies 2013 [N]. MIT Technology Review, 2013-04-23
5. Rumelhart D, Hinton G, Williams R. Learning representations by back-propagating errors [J]. Nature, 1986, 323 (6088): 533-536
6. Hinton G, Salakhutdinov R. Reducing the dimensionality of data with neural networks [J]. Science, 2006, 313 (504). Doi: 10.1126/science.1127647
7. Dahl G, Yu Dong, Deng Li, et al. Context-dependent pre-trained deep neural networks for large vocabulary speech recognition [J]. IEEE Trans on Audio, Speech, and Language Processing. 2012, 20 (1): 30-42
8. Jaitly N, Nguyen P, Nguyen A, et al. Application of pretrained deep neural networks to large vocabulary speech recognition [C] //Proc of Interspeech, Grenoble, France: International Speech Communication Association, 2012
9. LeCun Y, Boser B, Denker J S, et al. Backpropagation applied to handwritten zip code recognition [J]. Neural Computation, 1989, 1: 541-551
10. Large Scale Visual Recognition Challenge 2012 (ILSVRC2012) [OL]. [2013-08-01]. http://www.image-net.org/challenges/LSVRC/2012/
11. Xu W, Rudnicky A. Can artificial neural network learn language models [C] //Proc of Int Conf on Statistical Language Processing. 2000: 1-13
12. Bengio Y, Ducharme R, Vincent P, et al. A neural probabilistic language model [J]. Journal of Machine Learning Research, 2003, 3: 1137-1155
13. Collobert R, Weston J, Bottou L, et al. Natural language processing (Almost) from scratch [J]. Journal of Machine Learning Research, 2011, 12: 2493-2537
14. Socher R, Lin C, Ng A. Parsing natural scenes and natural language with recursive neural Networks [C] //Proc of the 28th Int Conf on Machine Learning. Garmany: International Machine Learning Society, 2011