Label Propagation via Teaching-to-Learn and Learning-to-Teach

IEEE Transactions on Neural Networks and Learning Systems

Volumn 28, Issue 6, 2017, Pages 1452-1465

  Gong, Chen ^a,b   Tao, Dacheng ^b   Liu, Wei ^c   Liu, Liu ^b   Yang, Jie ^a  

^a SHANGHAI JIAO TONG UNIVERSITY   (China)

^b UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

^c Didi Research   (China)

Author keywords

Label propagation; machine teaching; semisupervised learning

Indexed keywords

ALGORITHMS; GRAPHIC METHODS; ITERATIVE METHODS; VIRTUAL REALITY;

DISCRIMINABILITY; GRAPH CONSTRUCTION; LABEL INFORMATION; LABEL PROPAGATION; NEIGHBORHOOD GRAPHS; PROPAGATION ALGORITHM; PROPAGATION SEQUENCES; TUNING PARAMETER;

TEACHING;

EID: 84963704558     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2016.2514360     Document Type: Article

References (46)

1. X. Zhu, A. B. Goldberg, R. Brachman, and T. Dietterich, Introduction to Semi-Supervised Learning. San Rafael, CA, USA: Morgan & Claypool Pub., 2009.
2. K. C. A. Kumar and C. De Vleeschouwer, "Discriminative label propagation for multi-object tracking with sporadic appearance features," in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Sydney, NSW, Australia, Dec. 2013, pp. 2000-2007.
3. C. Yang, L. Zhang, H. Lu, X. Ruan, and M.-H. Yang, "Saliency detection via graph-based manifold ranking," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Portland, OR, USA, Jun. 2013, pp. 3166-3173.
4. J. Ugander and L. Backstrom, "Balanced label propagation for partitioning massive graphs," in Proc. 6th ACM Int. Conf. Web Search Data Mining, Rome, Italy, Feb. 2013, pp. 507-516.
5. X. Zhu and Z. Ghahramani, "Learning from labeled and unlabeled data with label propagation," School Comput. Sci., Carnegie Mellon Univ., Pittsburgh, PA, USA, Tech. Rep. CMU-CALD-02-107, 2002.
6. M. Szummer and T. Jaakkola, "Partially labeled classification with Markov random walks," in Proc. Adv. Neural Inf. Process. Syst., Vancouver, BC, Canada, Dec. 2002, pp. 945-952.
7. X.-M. Wu, Z. Li, A. M. So, J. Wright, and S.-F. Chang, "Learning with partially absorbing random walks," in Proc. Adv. Neural Inf. Process. Syst., Lake Tahoe, NV, USA, Dec. 2012, pp. 3077-3085.
8. D. Zhou, O. Bousquet, T. N. Lal, J. Weston, and B. Scholkopf, "Learning with local and global consistency," in Proc. Adv. Neural Inf. Process. Syst., Vancouver, BC, Canada, Dec. 2003, pp. 321-328.
9. J. Wang, F. Wang, C. Zhang, H. C. Shen, and L. Quan, "Linear neighborhood propagation and its applications," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 9, pp. 1600-1615, Sep. 2009.
10. B. Wang, Z. Tu, and J. K. Tsotsos, "Dynamic label propagation for semi-supervised multi-class multi-label classification," in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Sydney, NSW, Australia, Dec. 2013, pp. 425-432.
11. W. Liu, J. He, and S.-F. Chang, "Large graph construction for scalable semi-supervised learning," in Proc. 27th Int. Conf. Mach. Learn., Haifa, Israel, Jun. 2010, pp. 679-686.
12. Y. Fujiwara and G. Irie, "Efficient label propagation," in Proc. Int. Conf. Mach. Learn., Beijing, China, Jun. 2014, pp. 784-792.
13. C. Gong, D. Tao, K. Fu, and J. Yang, "Fick's law assisted propagation for semisupervised learning," IEEE Trans. Neural Netw. Learn. Syst., vol. 26, no. 9, pp. 2148-2162, Sep. 2015.
14. M. Karasuyama and H. Mamitsuka, "Multiple graph label propagation by sparse integration," IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 12, pp. 1999-2012, Dec. 2013.
15. C. Gong, T. Liu, D. Tao, K. Fu, E. Tu, and J. Yang, "Deformed graph Laplacian for semisupervised learning," IEEE Trans. Neural Netw. Learn. Syst., vol. 26, no. 10, pp. 2261-2274, Oct. 2015.
16. S. Mehrkanoon, C. Alzate, R. Mall, R. Langone, and J. A. K. Suykens, "Multiclass semisupervised learning based upon kernel spectral clustering," IEEE Trans. Neural Netw. Learn. Syst., vol. 26, no. 4, pp. 720-733, Apr. 2015.
17. J. L. Elman, "Learning and development in neural networks: The importance of starting small," Cognition, vol. 48, no. 1, pp. 71-99, Jul. 1993.
18. F. Khan, B. Mutlu, and X. Zhu, "How do humans teach: On curriculum learning and teaching dimension," in Proc. Adv. Neural Inf. Process. Syst., Granada, Spain, Dec. 2011, pp. 1449-1457.
19. Y. Bengio, J. Louradour, R. Collobert, and J. Weston, "Curriculum learning," in Proc. Int. Conf. Mach. Learn., Montreal, QC, Canada, Jun. 2009, pp. 41-48.
20. M. P. Kumar, B. Packer, and D. Koller, "Self-paced learning for latent variable models," in Proc. Adv. Neural Inf. Process. Syst., Vancouver, BC, Canada, Dec. 2010, pp. 1189-1197.
21. L. Jiang, D. Meng, S.-I. Yu, Z. Lan, S. Shan, and A. G. Hauptmann, "Self-paced learning with diversity," in Proc. Adv. Neural Inf. Process. Syst., Montreal, QC, Canada, Dec. 2014, pp. 2078-2086.
22. L. Jiang, D. Meng, Q. Zhao, S. Shan, and A. G. Hauptmann, "Self-paced curriculum learning," in Proc. AAAI Conf. Artif. Intell. (AAAI), Austin, TX, USA, Jan. 2015, pp. 2078-2086.
23. A. Shinohara and S. Miyano, "Teachability in computational learning," New Generat. Comput., vol. 8, no. 4, pp. 337-347, Feb. 1991.
24. F. J. Balbach and T. Zeugmann, "Teaching randomized learners," in Proc. Annu. Conf. Learn. Theory, Pittsburgh, PA, USA, Jun. 2006, pp. 229-243.
25. A. Singla, I. Bogunovic, G. Bartók, A. Karbasi, and A. Krause, "Nearoptimally teaching the crowd to classify," in Proc. Int. Conf. Mach. Learn., Beijing, China, Jun. 2014, pp. 154-162.
26. S. Zilles, S. Lange, R. Holte, and M. Zinkevich, "Models of cooperative teaching and learning," J. Mach. Learn. Res., vol. 12, pp. 349-384, Feb. 2011.
27. X. Zhu, "Machine teaching for Bayesian learners in the exponential family," in Proc. Adv. Neural Inf. Process. Syst., Lake Tahoe, NV, USA, Dec. 2013, pp. 1905-1913.
28. K. R. Patil, X. Zhu, L. Kopeć, and B. C. Love, "Optimal teaching for limited-capacity human learners," in Proc. Adv. Neural Inf. Process. Syst., Montreal, QC, Canada, Dec. 2014, pp. 2465-2473.
29. X. Zhu, "Machine teaching: An inverse problem to machine learning and an approach toward optimal education," in Proc. AAAI Conf. Artif. Intell. (AAAI), Austin, TX, USA, Jan. 2015, pp. 2078-2086.
30. S. Mei and X. Zhu, "Using machine teaching to identify optimal training-set attacks on machine learners," in Proc. AAAI Conf. Artif. Intell. (AAAI), Austin, TX, USA, Jan. 2015, pp. 1-7.
31. X. Zhu, J. D. Lafferty, and Z. Ghahramani, "Semi-supervised learning: From Gaussian fields to Gaussian processes," Dept. Comput. Sci., Carnegie Mellon Univ., Pittsburgh, PA, USA, Tech. Rep. CMU-CS-03-175, Aug. 2003.
32. T. M. Cover and J. A. Thomas, Elements of Information Theory, 2nd ed. New York, NY, USA: Wiley, 2006.
33. H. Qiu and E. R. Hancock, "Clustering and embedding using commute times," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 11, pp. 1873-1890, Nov. 2007.
34. D. P. Bertsekas, Constrained Optimization and Lagrange Multiplier Methods. San Francisco, CA, USA: Academic, 2014.
35. Z. Wen and W. Yin, "A feasible method for optimization with orthogonality constraints," Math. Program., vol. 142, no. 1, pp. 397-434, Dec. 2013.
36. P.-A. Absil and J. Malick, "Projection-like retractions on matrix manifolds," SIAM J. Optim., vol. 22, no. 1, pp. 135-158, Jan. 2012.
37. R. Fletcher, "On the Barzilai-Borwein method," in Optimization and Control With Applications. New York, NY, USA: Springer, 2005, pp. 235-256.
38. A. R. Conn, N. Gould, A. Sartenaer, and P. L. Toint, "Convergence properties of an augmented Lagrangian algorithm for optimization with a combination of general equality and linear constraints," SIAM J. Optim., vol. 6, no. 3, pp. 674-703, Jul. 1996.
39. X. Zhu, Z. Ghahramani, and J. Lafferty, "Semi-supervised learning using Gaussian fields and harmonic functions," in Proc. Int. Conf. Mach. Learn., Washington, DC, USA, Aug. 2003, pp. 912-919.
40. G. H. Golub and C. F. Van Loan, Matrix Computations, 3rd ed. Baltimore, MD, USA: The Johns Hopkins Univ. Press, 2012.
41. C. Fowlkes, S. Belongie, F. Chung, and J. Malik, "Spectral grouping using the Nystrom method," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 2, pp. 214-225, Feb. 2004.
42. W. W. Hager, "Updating the inverse of a matrix," SIAM Rev., vol. 31, no. 2, pp. 221-239, Jun. 1989.
43. M. Karasuyama and H. Mamitsuka, "Manifold-based similarity adaptation for label propagation," in Proc. Adv. Neural Inf. Process. Syst., Lake Tahoe, NV, USA, Dec. 2013, pp. 1547-1555.
44. J. R. Taylor and W. Thompson, An Introduction to Error Analysis: The Study of Uncertainties in Physical Measurements. Bristol, PA, USA: IOP Pub., 1998.
45. J. Wang, T. Jebara, and S.-F. Chang, "Graph transduction via alternating minimization," in Proc. Int. Conf. Mach. Learn., Helsinki, Finland, Jul. 2008, pp. 1144-1151.
46. M. Lichman. (2013). UCI Machine Learning Repository. [Online]. Available: http://archive.ics.uci.edu/ml