Fast dropout training

30th International Conference on Machine Learning, ICML 2013

Volumn , Issue PART 1, 2013, Pages 777-785

  Wang, Sida I ^a   Manning, Christopher D ^a  

^a Stanford University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

MULTILAYER NEURAL NETWORKS;

CENTRAL LIMIT THEOREM; GAUSSIAN APPROXIMATIONS; IMAGE TRANSFORMATIONS; INDEPENDENT CONTRIBUTIONS; INPUT FEATURES; MONTE CARLO OPTIMIZATION; OBJECTIVE FUNCTIONS; RANDOM SUBSETS;

LEARNING SYSTEMS;

EID: 84897495440     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (17)

1. Bishop, Christopher M. Training with noise is equivalent to Tikhonov regularization. Neural Computation, 7(1):108-116, 1995.
2. Goodfellow, Ian J., Warde-Farley, David, Mirza, Mehdi, Courville, Aaron C., and Bengio, Yoshua. Maxout networks. CoRR, abs/1302.4389, 2013.
3. Hinton, Geoffrey E., Srivastava, Nitish, Krizhevsky, Alex, Sutskever, Ilya, and Salakhutdinov, Ruslan. Improving neural networks by preventing co-adaptation of feature detectors. CoRR, abs/1207.0580, 2012.
4. Krizhevsky, Alex, Sutskever, Ilya, and Hinton, Geoffrey E. ImageNet classification with deep convolutional neural networks. In Proceedings of NIPS, 2012.
5. Lehmann, Erich L. Elements of Large-Sample Theory. Springer, 1998. ISBN 03873985956.
6. Maas, Andrew L., Daly, Raymond E., Pham, Peter T., Huang, Dan, Ng, Andrew Y., and Potts, Christopher. Learning word vectors for sentiment analysis. In Proceedings of the ACL, 2011.
7. MacKay, David J.C. The evidence framework applied to classification networks. Neural Computation, 5 (4):720-736, 1992.
8. Matsuoka, Kiyotoshi. Noise injection into inputs in back-propagation learning. IEEE Transactions on Systems, Man, and Cybernetics, 22(3):436-440, 1992.
9. Nakagawa, Tetsuji, Inui, Kentaro, and Kurohashi, Sadao. Dependency tree-based sentiment classification using CRFs with hidden variables. In Proceedings of ACL:HLT, 2010.
10. Ng, Andrew Y. and Jordan, Michael I. On discriminative vs. generative classifiers: A comparison of logistic regression and naive bayes. In Proceedings of NIPS, volume 2, pp. 841-848, 2002.
11. Ross, Andrew. Computing bounds on the expected maximum of correlated normal variables. Methodology and Computing in Applied Probability, 12:111-138, 2010. ISSN 1387-5841.
12. Simard, Patrice, LeCun, Yann, Denker, John, and Victorri, Bernard. Transformation invariance in pattern recognition-tangent distance and tangent propagation. In Neural Networks: Tricks of the Trade, pp. 239-27, 1996.
13. Smith, Andrew, Cohn, Trevor, and Osborne, Miles. Logarithmic opinion pools for conditional random fields. In Proceedings of the ACL, pp. 18-25, 2005.
14. Socher, Richard, Pennington, Jeffrey, Huang, Eric H., Ng, Andrew Y., and Manning, Christopher D. Semi-Supervised Recursive Autoencoders for Predicting Sentiment Distributions. In Proceedings of EMNLP, 2011.
15. Sutton, Charles, Sindelar, Michael, and McCallum, Andrew. Reducing weight undertraining in structured discriminative learning. In Proceedings of HLT-NAACL), 2006.
16. van der Maaten, Laurens, Chen, Minmin, Tyree, Stephen, and Weinberger, Kilian. Learning with marginalized corrupted features. In Proceedings of ICML, 2013.
17. Wang, Sida and Manning, Christopher. Baselines and bigrams: Simple, good sentiment and topic classification. In Proceedings of the ACL, pp. 90-94, 2012.