Marginalized denoising autoencoders for domain adaptation

Proceedings of the 29th International Conference on Machine Learning, ICML 2012

Volumn 1, Issue , 2012, Pages 767-774

  Chen, Minmin ^a   Xu, Zhixiang ^a   Weinberger, Kilian Q ^a   Sha, Fei ^b  

^a WASHINGTON UNIVERSITY   (United States)

^b UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOENCODERS; CLOSED FORM; COMPUTATIONAL COSTS; DE-NOISING; DOMAIN ADAPTATION; HIGH-DIMENSIONAL; OPTIMIZATION ALGORITHMS; ORDERS OF MAGNITUDE; ROBUST DATUM; SENTIMENT ANALYSIS; STOCHASTIC GRADIENT DESCENT;

ALGORITHMS;

LEARNING SYSTEMS;

EID: 84867129067     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (26)

1. Baldi, P. and Hornik, K. Neural networks and principal component analysis: Learning from examples without local minima. Neural networks, 2(1):53-58, 1989.
2. Ben-David, S., Blitzer, J., Crammer, K., and Pereira, F. Analysis of representations for domain adaptation. NIPS, 19:137,2007.
3. Ben-David, S., Blitzer, J., Crammer, K., Kulesza, A., Pereira, F., and Wortman, Jenn. A Theory of Learning from Different Domains. Machine Learning, 2009.
4. Bergstra, J., Breuleux, O., Bastien, F., Lamblin, P., Pascanu, R., Desjardins, G., Turian, J., Warde-Farley, D., and Bengio, Y. Theano: a CPU and GPU Math Expression Compiler. In SciPy, June 2010.
5. Bishop, Christopher. Pattern Recognition and Machine Learning. Springer, 2006.
6. Blitzer, J., McDonald, R., and Pereira, F. Domain adaptation with structural correspondence learning. In Proceedings of the 2006 Conference on EMNLP, pp. 120-128, 2006.
7. Chang, C.C. and Lin, C.J. LIBSVM: a library for support vector machines. ACM Transactions on IST, 2(3):27, 2011.
8. Chen, M., Weinberger, K.Q., and Blitzer, J.C. Co-Training for Domain Adaptation. In NIPS, 2011a.
9. Chen, M., Weinberger, K.Q., and Chen, Y. Automatic Feature Decomposition for Single View Co-training. In ICML, 2011b.
10. Daume III, H. Frustratingly Easy Domain Adaptation. In ACL, 2007.
11. Dauphin Y., Glorot X., Bengio Y. Large-Scale Learning of Embeddings with Reconstruction Sampling. In ICML, 2011.
12. Glorot, X., Bordes, A., and Bengio, Y. Domain adaptation for large-scale sentiment classification: A deep learning approach. In ICML, 2011.
13. Huang, J., Smola, A.J., Gretton, A., Borgwardt, K. M., and Scholkopf, B. Correcting Sample Selection Bias by Unlabeled Data. In NIPS 19, pp. 601-608. MIT Press, 2007.
14. Kavukcuoglu, K., Ranzato, M.A., Fergus, R., and Le-Cun, Y. Learning invariant features through topographic filter maps. In CVPR 2009. IEEE Conference on, pp. 1605-1612. IEEE, 2009.
15. Lee, Honglak, Largman, Yan, Pham, Peter, and Ng, Andrew Y. Unsupervised Feature Learning for Audio Classification using Convolutional Deep Belief Networks. In NIPS. 2009.
16. Liu, Qian, Mackey, Aaron, Roos, David, and Pereira, Fernando. Evigan: a hidden variable model for integrating gene evidence for eukaryotic gene prediction. Bioinformatics, 2008.
17. Mansour, T, Mohri, M., and Rostamizadeh, A. Domain Adaptation with Multiple Sources. In NIPS. 2009.
18. McClosky, D., Charniak, E., and Johnson, M. Reranking and self-training for parser adaptation. In ACL, pp. 337-344, 2006.
19. Nair, V. and Hinton, G.E. Rectified linear units improve restricted boltzmann machines. In ICML 27, 2010.
20. Rifai, S., Vincent, P., Muller, X., Glorot, X., and Bengio, Y. Contractive auto-encoders: Explicit invariance during feature extraction. In ICML, 2011.
21. Rumelhart, D.E., Hintont, G.E., and Williams, R.J. Learning representations by back-propagating errors. Nature, 323(6088): 533-536,1986.
22. Saenko, K., Kulis, B., Fritz, M., and Darrell, T. Adapting visual category models to new domains. Computer Vision-ECCV 2010, pp. 213-226, 2010.
23. Salton, G. and Buckley, C. Term-weighting approaches in automatic text retrieval. Information processing & management, 24 (5):513-523, 1988.
24. Vincent, P., Larochelle, H., Bengio, Y, and Manzagol, P.A. Extracting and composing robust features with denoising autoencoders. In ICML, 2008.
25. Weinberger, K.Q., Dasgupta, A., Langford, J., Smola, A., and Attenberg, J. Feature hashing for large scale multitask learning. In ICML 26, pp. 1113-1120. ACM, 2009.
26. Xue, G., Dai, W., Yang, Q., and Yu, Y Topic-bridged PLSA for cross-domain text classication. In SIGIR, 2008.