Mutual exclusivity loss for semi-supervised deep learning

Proceedings - International Conference on Image Processing, ICIP

Volumn 2016-August, Issue , 2016, Pages 1908-1912

  Sajjadi, Mehdi ^a   Javanmardi, Mehran ^a   Tasdizen, Tolga ^a  

^a University of Utah   (United States)

Author keywords

Deep Learning; Neural Networks; Semi supervised Learning

Indexed keywords

BACKPROPAGATION; IMAGE PROCESSING; NEURAL NETWORKS; OBJECT RECOGNITION;

CONVOLUTIONAL NEURAL NETWORK; DECISION BOUNDARY; DEEP LEARNING; LEARNING METHODS; MUTUAL EXCLUSIVITIES; REGULARIZATION TERMS; SEMI- SUPERVISED LEARNING; SEMI-SUPERVISED;

SUPERVISED LEARNING;

EID: 85006801861     PISSN: 15224880     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICIP.2016.7532690     Document Type: Conference Paper

References (31)

1. B Boser Le Cun, John S Denker, D Henderson, Richard E Howard, W Hubbard, and Lawrence D Jackel, "Handwritten digit recognition with a back-propagation network, " in Advances in neural information processing systems. Citeseer, 1990.
2. Yann LeCun, Léon Bottou, Yoshua Bengio, and Patrick Haffner, "Gradient-based learning applied to document recognition, " Proceedings of the IEEE, vol. 86, no. 11, pp. 2278-2324, 1998.
3. Pierre Sermanet, David Eigen, Xiang Zhang, Michaël Mathieu, Rob Fergus, and Yann LeCun, "Overfeat: Integrated recognition, localization and detection using convolutional networks, " arXiv preprint arXiv: 1312. 6229, 2013.
4. Alex Berg, Jia Deng, and L Fei-Fei, "Large scale visual recognition challenge 2010, " 2010.
5. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton, "Imagenet classification with deep convolutional neural networks, " in Advances in neural information processing systems, 2012, pp. 1097-1105.
6. Christian Szegedy, Wei Liu, Yangqing Jia, Pierre Sermanet, Scott Reed, Dragomir Anguelov, Dumitru Erhan, Vincent Vanhoucke, and Andrew Rabinovich, "Going deeper with convolutions, " arXiv preprint arXiv: 1409. 4842, 2014.
7. Honglak Lee, Roger Grosse, Rajesh Ranganath, and Andrew Y Ng, "Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations, " in Proceedings of the 26th Annual International Conference on Machine Learning. ACM, 2009, pp. 609-616.
8. Geoffrey E Hinton, Simon Osindero, and Yee-Whye Teh, "A fast learning algorithm for deep belief nets, " Neural computation, vol. 18, no. 7, pp. 1527-1554, 2006.
9. Yann LeCun, Koray Kavukcuoglu, and Clément Farabet, "Convolutional networks and applications in vision, " in Circuits and Systems (ISCAS), Proceedings of 2010 IEEE International Symposium on. IEEE, 2010, pp. 253-256.
10. Kevin Jarrett, Koray Kavukcuoglu, Marc'Aurelio Ranzato, and Yann LeCun, "What is the best multi-stage architecture for object recognition, " in Computer Vision, 2009 IEEE 12th International Conference on. IEEE, 2009, pp. 2146-2153.
11. Koray Kavukcuoglu, Marc'Aurelio Ranzato, and Yann LeCun, "Fast inference in sparse coding algorithms with applications to object recognition, " arXiv preprint arXiv: 1010. 3467, 2010.
12. Antti Rasmus, Mathias Berglund, Mikko Honkala, Harri Valpola, and Tapani Raiko, "Semi-supervised learning with ladder networks, " in Advances in Neural Information Processing Systems, 2015, pp. 3532-3540.
13. Rie Johnson and Tong Zhang, "Semi-supervised convolutional neural networks for text categorization via region embedding, " in Advances in Neural Information Processing Systems, 2015, pp. 919-927.
14. Olivier Chapelle, Bernhard Schölkopf, Alexander Zien, et al., "Semi-supervised learning, " 2006.
15. Xiaojin Zhu, "Semi-supervised learning literature survey, " 2005.
16. Avrim Blum and Tom Mitchell, "Combining labeled and unlabeled data with co-training, " in Proceedings of the eleventh annual conference on Computational learning theory. ACM, 1998, pp. 92-100.
17. Virginia R de Sa, "Learning classification with unlabeled data, " in Advances in neural information processing systems, 1994, pp. 112-119.
18. David J Miller and Hasan S Uyar, "A mixture of experts classifier with learning based on both labelled and unlabelled data, " in Advances in neural information processing systems, 1997, pp. 571-577.
19. Thorsten Joachims, "Transductive inference for text classification using support vector machines, " in ICML, 1999, vol. 99, pp. 200-209.
20. Kristin Bennett, Ayhan Demiriz, et al., "Semi-supervised support vector machines, " Advances in Neural Information processing systems, pp. 368-374, 1999.
21. Avrim Blum and Shuchi Chawla, "Learning from labeled and unlabeled data using graph mincuts, " 2001.
22. Xiaojin Zhu, Zoubin Ghahramani, John Lafferty, et al., "Semisupervised learning using Gaussian fields and harmonic functions, " in ICML, 2003, vol. 3, pp. 912-919.
23. M Hazewinkel, Ed., Encylopedia of Mathematics, Springer, 2001.
24. Vittori Castelli and Thomas M Cover, "The relative value of labeled and unlabeled samples in pattern recognition with an unknown mixing parameter, " Information Theory, IEEE Transactions on, vol. 42, no. 6, pp. 2102-2117, 1996.
25. Terence J O'neill, "Normal discrimination with unclassified observations, " Journal of the American Statistical Association, vol. 73, no. 364, pp. 821-826, 1978.
26. Yves Grandvalet and Yoshua Bengio, "Semi-supervised learning by entropy minimization, " in Advances in neural information processing systems, 2004, pp. 529-536.
27. Alex Krizhevsky and Geoffrey Hinton, "Learning multiple layers of features from tiny images, " 2009.
28. Yann LeCun, Fu Jie Huang, and Leon Bottou, "Learning methods for generic object recognition with invariance to pose and lighting, " in Computer Vision and Pattern Recognition, 2004. CVPR 2004. Proceedings of the 2004 IEEE Computer Society Conference on. IEEE, 2004, vol. 2, pp. II-97.
29. Yuval Netzer, Tao Wang, Adam Coates, Alessandro Bissacco, Bo Wu, and Andrew Y Ng, "Reading digits in natural images with unsupervised feature learning, " in NIPS workshop on deep learning and unsupervised feature learning. Granada, Spain, 2011, vol. 2011, p. 5.
30. A Krizhevskey, "Cuda-convnet, " code. google. com/p/cudaconvnet, 2014.
31. Dan Ciresan, Ueli Meier, and Jürgen Schmidhuber, "Multicolumn deep neural networks for image classification, " in Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on. IEEE, 2012, pp. 3642-3649.