Learning to propagate labels: Transductive propagation network for few-shot learning

7th International Conference on Learning Representations, ICLR 2019

Volumn , Issue , 2019, Pages

  Liu, Yanbin ^a,c   Lee, Juho ^b,c   Park, Minseop ^c   Kim, Saehoon ^c   Yang, Eunho ^c,d   Hwang, Sung Ju ^c,d   Yang, Yi ^a,e  

^a UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

^b UNIVERSITY OF OXFORD   (United Kingdom)

^c Aitrics   (South Korea)

^d Korea Advanced Institute of Science and Technology (KAIST)   (South Korea)

^e BAIDU INC   (China)

Author keywords

[No Author keywords available]

Indexed keywords

BENCHMARK DATASETS; CLASSIFICATION TASKS; GRAPH CONSTRUCTION; MANIFOLD STRUCTURES; META-LEARNING APPROACH; META-LEARNING FRAMEWORKS; MULTI-CLASS CLASSIFICATION; TRANSDUCTIVE INFERENCE;

CLASSIFICATION (OF INFORMATION);

EID: 85083950649     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (36)

1. Fan RK Chung and Fan Chung Graham. Spectral graph theory. American Mathematical Soc., 1997.
2. Chelsea Finn, Pieter Abbeel, and Sergey Levine. Model-agnostic meta-learning for fast adaptation of deep networks. In International Conference on Machine Learning, pages 1126-1135, 2017.
3. Yanwei Fu, Timothy M Hospedales, Tao Xiang, and Shaogang Gong. Transductive multi-view zero-shot learning. IEEE transactions on pattern analysis and machine intelligence, 37(11):2332-2345, 2015.
4. Yasuhiro Fujiwara and Go Irie. Efficient label propagation. In International Conference on Machine Learning, pages 784-792, 2014.
5. Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recognition. In Computer Vision and Pattern Recognition, pages 770-778, 2016.
6. Sergey Ioffe and Christian Szegedy. Batch normalization: Accelerating deep network training by reducing internal covariate shift. In International Conference on Machine Learning, pages 448-456, 2015.
7. Yangqing Jia, Evan Shelhamer, Jeff Donahue, Sergey Karayev, Jonathan Long, Ross Girshick, Sergio Guadar-rama, and Trevor Darrell. Caffe: Convolutional architecture for fast feature embedding. In ACM International Conference on Multimedia, pages 675-678. ACM, 2014.
8. Thorsten Joachims. Transductive inference for text classification using support vector machines. In International Conference on Machine Learning, volume 99, pages 200-209, 1999.
9. Diederik P Kingma and Jimmy Ba. Adam: A method for stochastic optimization. In International Conference on Learning Representations (ICLR), volume 5, 2015.
10. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. Imagenet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems, pages 1097-1105, 2012.
11. Brenden Lake, Ruslan Salakhutdinov, Jason Gross, and Joshua Tenenbaum. One shot learning of simple visual concepts. In Conference of the Cognitive Science Society, volume 33, 2011.
12. Yoonho Lee and Seungjin Choi. Gradient-based meta-learning with learned layerwise metric and subspace. In International Conference on Machine Learning, pages 2933-2942, 2018.
13. De-Ming Liang and Yu-Feng Li. Lightweight label propagation for large-scale network data. In IJCAI, pages 3421-3427, 2018.
14. ´ atkowski, Bernhard Schölkopf, and Richard E Turner. Discriminative k-shot learning using probabilistic models. arXiv preprint arXiv:1706.00326, 2017.
15. Nikhil Mishra, Mostafa Rohaninejad, Xi Chen, and Pieter Abbeel. A simple neural attentive meta-learner. In International Conference on Learning Representations, 2018.
16. Tsendsuren Munkhdalai, Xingdi Yuan, Soroush Mehri, and Adam Trischler. Rapid adaptation with conditionally shifted neurons. In International Conference on Machine Learning, pages 3661-3670, 2018.
17. Alex Nichol, Joshua Achiam, and John Schulman. On first-order meta-learning algorithms. arXiv preprint arXiv:1803.02999, 2018.
18. Boris N Oreshkin, Alexandre Lacoste, and Pau Rodriguez. Tadam: Task dependent adaptive metric for improved few-shot learning. In Advances in Neural Information Processing Systems, 2018.
19. Sachin Ravi and Hugo Larochelle. Optimization as a model for few-shot learning. International Conference on Learning Representations, 2017.
20. Mengye Ren, Eleni Triantafillou, Sachin Ravi, Jake Snell, Kevin Swersky, Joshua B Tenenbaum, Hugo Larochelle, and Richard S Zemel. Meta-learning for semi-supervised few-shot classification. International Conference on Learning Representations, 2018.
21. Marcus Rohrbach, Sandra Ebert, and Bernt Schiele. Transfer learning in a transductive setting. In Advances in Neural Information Processing Systems, pages 46-54, 2013.
22. Jürgen Schmidhuber. Evolutionary principles in self-referential learning, or on learning how to learn: the meta-meta-... hook. PhD thesis, Technische Universität München, 1987.
23. Karen Simonyan and Andrew Zisserman. Very deep convolutional networks for large-scale image recognition. International Conference on Learning Representations, 2015.
24. Jake Snell, Kevin Swersky, and Richard Zemel. Prototypical networks for few-shot learning. In Advances in Neural Information Processing Systems, pages 4080-4090, 2017.
25. Masashi Sugiyama. Dimensionality reduction of multimodal labeled data by local fisher discriminant analysis. Journal of Machine Learning Research, 8:1027-1061, 2007.
26. Flood Sung, Yongxin Yang, Li Zhang, Tao Xiang, Philip HS Torr, and Timothy M Hospedales. Learning to compare: Relation network for few-shot learning. In Computer Vision and Pattern Recognition, 2018.
27. Sebastian Thrun and Lorien Pratt. Learning to learn. Springer Science & Business Media, 2012.
28. Vladimir Naumovich Vapnik. An overview of statistical learning theory. IEEE transactions on neural networks, 10(5):988-999, 1999.
29. Oriol Vinyals, Charles Blundell, Tim Lillicrap, Daan Wierstra, et al. Matching networks for one shot learning. In Advances in Neural Information Processing Systems, pages 3630-3638, 2016.
30. Fei Wang and Changshui Zhang. Label propagation through linear neighborhoods. In International Conference on Machine Learning, pages 985-992. ACM, 2006.
31. Yu-Xiong Wang, Ross Girshick, Martial Hebert, and Bharath Hariharan. Low-shot learning from imaginary data. In Computer Vision and Pattern Recognition, 2018.
32. Zhongwen Xu, Linchao Zhu, and Yi Yang. Few-shot object recognition from machine-labeled web images. In Computer Vision and Pattern Recognition, 2017.
33. Zhilin Yang, William Cohen, and Ruslan Salakhudinov. Revisiting semi-supervised learning with graph embeddings. In International Conference on Machine Learning, pages 40-48, 2016.
34. Lihi Zelnik-Manor and Pietro Perona. Self-tuning spectral clustering. In Advances in Neural Information Processing Systems, 2004.
35. Denny Zhou, Olivier Bousquet, Thomas N Lal, Jason Weston, and Bernhard Schölkopf. Learning with local and global consistency. In Advances in Neural Information Processing Systems, pages 321-328, 2004.
36. Xiaojin Zhu and Zoubin Ghahramani. Learning from labeled and unlabeled data with label propagation. Tech. Rep., Technical Report CMU-CALD-02-107, Carnegie Mellon University, 2002.