Unsupervised and transfer learning challenge

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2011, Pages 793-800

  Guyon, Isabelle ^a   Dror, Gideon ^b   Lemaire, Vincent ^a   Taylor, Graham ^c   Aha, David W ^a  

^a Labs Haifa ^*  (United States)

^b Labs Haifa   (Israel)

^c NAVAL RESEARCH LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPLICATION DOMAINS; BUILDING MODEL; DATA REPRESENTATIONS; DEEP LEARNING; GOOD DATA; HANDWRITING RECOGNITION; INPUT SPACE; LABELED DATA; LARGE DATASETS; SECOND PHASE; TRANSFER LEARNING; UNLABELED DATA; VIDEO PROCESSING;

CHARACTER RECOGNITION; IMAGE RECOGNITION; TEXT PROCESSING; WORD PROCESSING;

NEURAL NETWORKS;

EID: 80054729728     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2011.6033302     Document Type: Conference Paper

References (27)

1. R. Caruana, "Multitask learning," Machine Learning, vol. 28, no. 1, pp. 41-75, 1997.
2. S. J. Pan and Q. Yang, "A survey on transfer learning," IEEE Transactions on Knoweledge and Data Engineering, vol. 22, no. 10, pp. 1345-1359, October 2010.
3. R. Collobert and J. Weston, "A unified architecture for natural language processing: Deep neural networks with multitask learning," in International Conference on Machine Learning, ICML, 2008.
4. Y. Bengio, "Learning deep architectures for AI," Foundations and Trends in Machine Learning, vol. 2, no. 1, pp. 1-127, 2009, also published as a book. Now Publishers, 2009.
5. S. M. Gutstein, "Transfer learning techniques for deep neural nets," Ph.D. dissertation, The University of Texas at El Paso, 2010.
6. D. Erhan, Y. Bengio, A. Courville, P.-A. Manzagol, P. Vincent, and S. Bengio, "Why does unsupervised pre-training help deep learning?" JMLR, vol. 11, pp. 625-660, 2010.
7. H. Lee, A. Battle, R. Raina, and A. Y. Ng, "Efficient sparse coding algorithms," in Advances in Neural Information Processing Systems 19, B. Schölkopf, J. Platt, and T. Hoffman, Eds. Cambridge, MA: MIT Press, 2007, pp. 801-808.
8. R. Raina, A. Battle, H. Lee, B. Packer, and A. Y. Ng, "Self-taught learning: Transfer learning from unlabeled data," in Proceedings of the Twenty-fourth International Conference on Machine Learning, 2007.
9. J. Bromley, I. Guyon, Y. LeCun, E. S̈ckinger, and R. Shah, "Signature verification using a "siamese" time delay neural network," in In NIPS Proc, 1994.
10. G. Lanckriet, N. Cristianini, P. Bartlett, and L. E. Ghaoui, "Learning the kernel matrix with semi-definite programming," Journal of Machine Learning Research, vol. 5, pp. 27-72, 2004.
11. K. Q. Weinberger and L. K. Saul, "Distance metric learning for large margin nearest neighbor classification," J. Mach. Learn. Res., vol. 10, pp. 207-244, June 2009. [Online]. Available: http://portal.acm.org/citation.cfm? id=1577069.1577078
12. L. Yang and R. Jin, "Distance metric learning: A comprehensive survey," Michigan State University, Tech. Rep., 2006. [Online]. Available: http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.J.J.9J.4732
13. L. Yang, "An overview of distance metric learning," Carnegie Mellon University, Tech. Rep., 2007. [Online]. Available: http://www.cse.msu. edu/~yangliu1/frame survey v2.pdf
14. S. Thrun and L.Y. Pratt, editors, Learning to Learn. Boston, MA: Kluwer Academic Publishers, 1998.
15. A. J. Smola, S. Mika, B. Schlkopf, and R. C. Williamson, "Regularized principal manifolds," JMLR, vol. 1, pp. 179-209, 200J.
16. Y. Bengio, J.-F. Paiement, P. Vincent, O. Delalleau, N. L. Roux, and M. Ouimet, "Out-of-sample extensions for lle, isomap, mds, eigenmaps, and spectral clustering." in NIPS03, 2003.
17. A. Globerson and N. Tishby, "Sufficient dimensionality reduction," J. Mach. Learn. Res., vol. 3, pp. 1307-1331, March 2003. [Online]. Available: http://portal.acm.org/citation.cfm?id=944919.944975
18. Z. Ghahramani, Unsupervised Learning. Berlin: Springer-Verlag, 2004, vol. 3176, pp. 72-112.
19. U. Luxburg, "A tutorial on spectral clustering," Statistics and Computing, vol. 17, pp. 395-416, December 2007. [Online]. Available: http://portal.acm.org/citation.cfm?id=1288822.1288832
20. A. K. Jain, M. N. Murty, and P. J. Flynn, "Data clustering: A review," 1999.
21. I. Laptev, "On space-time interest points," International Journal of Computer Vision, vol. 64, no. 2/3, pp. 107-123, 2005.
22. A. Krizhevsky, "Learning multiple layers of features from tiny images," University of Toronto, Tech. Rep., 2009. [Online]. Available: http://www.cs.toronto.edu/~kriz/learning-features-2009-TR.pdf
23. D. D. Lewis, Y. Yang, T. G. Rose, F. Li, G. Dietterich, and F. Li, "Rcv1: A new benchmark collection for text categorization research," Journal of Machine Learning Research, vol. 5, pp. 361-397, 2004.
24. Clopinet, "Challenges in machine learning." [Online]. Available: http://clopinet.cm/challenges
25. I. Guyon, A. Saffari, G. Dror, and J. Buhmann, "Performance prediction challenge," in IEEE/INNS conference IJCNN 2006, Vancouver, Canada, July 16-21 2006.
26. J. Shawe-Taylor and N. Cristianini, Kernel Methods for Pattern Analysis. New York, NY, USA: Cambridge University Press, 2004.
27. L. Breiman, "Random forests," Machine Learning, vol. 45, no. 1, pp. 5-32, 200J.