Learning with marginalized corrupted features

30th International Conference on Machine Learning, ICML 2013

Volumn , Issue PART 1, 2013, Pages 410-418

  Van Der Maaten, Laurens ^a   Chen, Minmin ^b   Tyree, Stephen ^b   Weinberger, Kilian Q ^b  

^a DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

^b WASHINGTON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

LEARNING SYSTEMS;

DATA DISTRIBUTION; EFFECTIVE SOLUTION; EXPECTED VALUES; EXPONENTIAL FAMILY; FEATURE DELETIONS; LOSS FUNCTIONS; TRAINING DATA SETS; TRAINING EXAMPLE;

LEARNING ALGORITHMS;

EID: 84896535000     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (31)

1. Bhattacharyya, C., Pannagadatta, K.S., and Smola, A.J. A second order cone programming formulation for classifying missing data. In Advances in Neural Information Processing Systems, pp. 153-160, 2004.
2. Bishop, C.M. Training with noise is equivalent to tikhonov regularization. Neural Computation, 7(1):108-116, 1995.
3. Blitzer, J., Dredze, M., and Pereira, F. Biographies, Bollywood, boom-boxes and blenders: Domain adaptation for sentiment classification. In Association for Computational Linguistics, volume 45, pp. 440, 2007.
4. Brückner, M., Kanzow, C., and Scheffer, T. Static prediction games for adversarial learning problems. Journal of Machine Learning Research, 12:2617-2654, 2012.
5. Burges, C.J.C. and Scholkopf, B. Improving the accuracy and speed of support vector machines. Advances in Neural Information Processing Systems, 9:375-381, 1997.
6. Chapelle, O., Weston, J., Bottou, L., and Vapnik, V. Vicinal risk minimization. In Advances in Neural Information Processing Systems, pp. 416-422, 2000.
7. Chechik, G., Heitz, G., Elidan, G., Abbeel, P., and Roller, D. Max-margin classification of data with absent features. Journal of Machine Learning Research, 9(Jan):1-21, 2008.
8. Chen, M., Xu, Z., Weinberger, K.Q., and Sha, F. Marginalized denoising autoencoders for domain adaptation. In Proceedings of the International Conference on Machine Learning, pp. 767-774, 2012.
9. Coates, A., Lee, H., and Ng, A.Y. An analysis of single-layer networks in unsupervised feature learning. In Proceedings of the International Conference on Artificial Intelligence & Statistics, JMLR W&CP 15, pp. 215-223, 2011.
10. Cover, T. and Hart, P. Nearest neighbor pattern classification. IEEE Transactions on Information Theory, 13(1):21-27, 1967.
11. Dekel, O. and Shamir, O. Learning to classify with missing and corrupted features. In Proceedings of the International Conference on Machine Learning, pp. 216-223, 2008.
12. Duda, R.O., Hart, P.E., and Stork, D.G. Pattern Classification. Wiley Interscience Inc., 2001.
13. Globerson, A. and Roweis, S. Nightmare at test time: Robust learning by feature deletion. In Proceedings of the International Conference on Machine Learning, pp. 353-360, 2006.
14. Glorot, X., Bordes, A., and Bengio, Y. Domain adaptation for large-scale sentiment classification: A deep learning approach. In Proceedings of the International Conference on Machine Learning, pp. 513-520, 2011.
15. Herbrich, R. and Graepel, T. Invariant pattern recognition by semidefinite programming machines. In Advances in Neural Information Processing Systems, volume 16, pp. 33, 2004.
16. Hinton, G.E., Srivastava, N., Krizhevsky, A., Sutskever, I., and Salakhutdinov, R.R. Improving neural networks by preventing co-adaptation of feature detectors, 2012.
17. Krizhevsky, A. Learning multiple layers of features from tiny images. Technical report, University of Toronto, 2009.
18. Lawrence, N.D. and Schölkopf, B. Estimating a kernel Fisher discriminant in the presence of label noise. In Proceedings of the International Conference in Machine Learning, pp. 306-313, 2001.
19. LeCun, Y., Denker, J.S., and Sofia, S.A. Optimal brain damage. In Advances in Neural Information Processing Systems, pp. 598-605, 1990.
20. Ng, A.Y. Feature selection, 11 vs. 12 regularization, and rotational invariance. In Proceedings of International Conference on Machine Learning, pp. 78-85, 2004.
21. Ranzato, M. and Hinton, G.E. Modeling pixel means and covariances using factorized third-order Boltzmann machines. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2551-2558, 2010.
22. Shivaswamy, P.K., Bhattacharyya, C., and Smola, A.J. Second order cone programming approaches for handling missing and uncertain data. Journal of Machine Learning Research, 7:1283-1314, 2006. (Pubitemid 44024599)
23. Sietsma, J. and Dow, R.J.F. Creating artificial neural networks that generalize. Neural Networks, 4:67-79, 1991.
24. Sutton, C., Sindelar, M., and McCallum, A. Feature bagging: Preventing weight undertraining in structured discriminative learning. Technical Report IR-402, University of Massachusetts, 2005.
25. Teo, C.H., Globerson, A., Roweis, S., and Smola, A. Convex learning with invariances. Advances in Neural Information Processing Systems, 20:1489-1496, 2008.
26. Torralba, A., Fergus, R., and Freeman, W.T. 80 million tiny images: A large dataset for non-parametric object and scene recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30(11):1958-1970, 2008.
27. Trafalis, T. and Gilbert, R. Robust support vector machines for classification and computational issues. Optimization Methods and Software, 22(1):187-198, 2007. (Pubitemid 44878966)
28. Vincent, P., Larochelle, H., Bengio, Y., and Manzagol, P.A. Extracting and composing robust features with denoising autoencoders. In Proceedings of the International Conference on Machine Learning, pp. 1096-1103, 2008.
29. Webb, A.R. Functional approximation by feed-forward networks: a least-squares approach to generalization. IEEE Transactions on Neural Networks, 5(3):363-371, 1994.
30. Xu, H., Caramanis, C., and Mannor, S. Robustness and regularization of support vector machines. Journal of Machine Learning Research, 10:1485-1510, 2009.
31. Zhu, J., Rosset, S., Zou, H., and Hastie, T. Multi-class AdaBoost. Technical Report 430, Department of Statistics, University of Michigan, 2006.