Scalable Semi-Supervised Learning by Efficient Anchor Graph Regularization

IEEE Transactions on Knowledge and Data Engineering

Volumn 28, Issue 7, 2016, Pages 1864-1877

  Wang, Meng ^a   Fu, Weijie ^a   Hao, Shijie ^a   Tao, Dacheng ^b   Wu, Xindong ^a,c  

^a HEFEI UNIVERSITY OF TECHNOLOGY   (China)

^b UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

^c University of Vermont ^*  (United States)

Author keywords

anchor graph; local weight estimation; Semi supervised learning

Indexed keywords

ANCHORS; GRAPHIC METHODS; LAPLACE TRANSFORMS;

CLASSIFICATION ACCURACY; COMPUTATIONAL COSTS; GRAPH CONSTRUCTION; NORMALIZED GRAPH LAPLACIAN; REGULARIZATION FRAMEWORK; SEMI- SUPERVISED LEARNING; SEMI-SUPERVISED LEARNING METHODS; WEIGHT ESTIMATION;

SUPERVISED LEARNING;

EID: 84976348877     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2016.2535367     Document Type: Article

References (55)

1. J. S. Beis and D. G. Lowe, "Shape indexing using approximate nearest-neighbour search in high-dimensional spaces," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 1997, pp. 1000- 1006.
2. M. Belkin and P. Niyogi, "Semi-supervised learning on riemannian manifolds," Mach. Learning, vol. 56, nos. 1-3, pp. 209-239, 2004.
3. C. M. Bishop, Pattern Recognition and Machine Learning. New York, NY, USA: Springer, 2006.
4. A. Blum and T. Mitchell, "Combining labeled and unlabeled data with co-training," in Proc. 11th Annu. Conf. Comput. Learning Theory, 1998, pp. 92-100.
5. D. Cai and X. Chen, "Large scale spectral clustering with landmark- based representation," IEEE Trans. Cybern., vol. 45, no. 8, pp. 1669-1680, Aug. 2015.
6. V. Castelli and T. M. Cover, "On the exponential value of labeled samples," Pattern Recog. Lett., vol. 16, no. 1, pp. 105-111, 1995.
7. J. Cheng, C. Leng, P. Li, M. Wang, and H. Lu, "Semi-supervised multi-graph hashing for scalable similarity search," Comput. Vis. Image Understanding, vol. 124, pp. 12-21, 2014.
8. C. Deng, R. Ji, W. Liu, D. Tao, and X. Gao, "Visual reranking through weakly supervised multi-graph learning," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 2600-2607.
9. C. Deng, R. Ji, D. Tao, X. Gao, and X. Li, "Weakly supervised multi-graph learning for robust image reranking," IEEE Trans. Multimedia, vol. 16, no. 3, pp. 785-795, Apr. 2014.
10. C. Elkan, "Using the triangle inequality to accelerate k-means," in Proc. 20th Int. Conf. Mach. Learning, 2003, vol. 3, pp. 147-153.
11. R. Fergus, Y. Weiss, and A. Torralba, "Semi-supervised learning in gigantic image collections," in Proc. Conf. Adv. Neural Inform. Process. Syst., 2009, pp. 522-530.
12. P. Foggia, G. Percannella, and M. Vento, "Graph matching and learning in pattern recognition in the last 10 years," Int. J. Pattern Recog. Artif. Intell., vol. 28, no. 1, pp. 1-40, 2014.
13. L. Gao, J. Song, F. Nie, Y. Yan, N. Sebe, and H. T. Shen, "Optimal graph learning with partial tags and multiple features for image and video annotation," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2015, pp. 4371-4379.
14. M. Guillaumin, J. Verbeek, and C. Schmid, "Multimodal semisupervised learning for image classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2010, pp. 902-909.
15. S. Gupta, J. Kim, K. Grauman, and R. Mooney, "Watch, listen & learn: Co-training on captioned images and videos," in Proc. Eur. Conf. Mach. Learning Knowl. Discovery Databases, 2008, pp. 457-472.
16. L. Huang, X. Liu, B. Ma, and B. Lang, "Online semi-supervised annotation via proxy-based local consistency propagation," Neurocomputing, vol. 149, pp. 1573-1586, 2015.
17. M. S. T. Jaakkola and M. Szummer, "Partially labeled classification with Markov random walks," in Proc. Conf. Adv. Neural Inform. Process. Syst., 2002, vol. 14, pp. 945-952.
18. T. Joachims, "Transductive inference for text classification using support vector machines," in Proc. 16th Int. Conf. Mach. Learning, 1999, pp. 200-209.
19. S. Kim and S. Choi, "Multi-view anchor graph hashing," in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., May 2013, pp. 3123- 3127.
20. P. Li, J. Bu, L. Zhang, and C. Chen, "Graph-based local concept coordinate factorization," Knowl. Inform. Syst., vol. 43, no. 1, pp. 103-126, 2015.
21. W. Liu, J. He, and S.-F. Chang, "Large graph construction for scalable semi-supervised learning," in Proc. 27th Int. Conf. Mach. Learning, 2010, pp. 679-686.
22. W. Liu, J. Wang, and S.-F. Chang, "Robust and scalable graphbased semisupervised learning," Proc. IEEE, vol. 100, no. 9, pp. 2624-2638, Sep. 2012.
23. W. Liu, J. Wang, S. Kumar, and S.-F. Chang, "Hashing with graphs," in Proc. 28th Int. Conf. Mach. Learning, 2011, pp. 1-8.
24. X. Liu and B. Huet, "Concept detector refinement using social videos," in Proc. Int. Workshop Very-Large-Scale Multimedia Corpus, Mining Retrieval, 2010, pp. 19-24.
25. F. D. Malliaros, V. Megalooikonomou, and C. Faloutsos, "Estimating robustness in large social graphs," Knowl. Inform. Syst., vol. 45, no. 3, pp. 645-678, 2015.
26. S. Melacci and M. Belkin, "Laplacian support vector machines trained in the primal," J. Mach. Learning Res., vol. 12, pp. 1149- 1184, 2011.
27. B. Mohar, Y. Alavi, G. Chartrand, and O. Oellermann, "The laplacian spectrum of graphs," Graph Theory, Combinatorics, Appl., vol. 2, pp. 871-898, 1991.
28. Y. Nesterov, Introductory Lectures on Convex Optimization. New York, NY, USA: Springer, 2004, vol. 87.
29. M. Norouzi, A. Punjani, and D. J. Fleet, "Fast exact search in hamming space with multi-index hashing," IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 6, pp. 1107-1119, Jun. 2014.
30. M. Okabe and S. Yamada, "Semisupervised query expansion with minimal feedback," IEEE Trans. Knowl. Data Eng., vol. 19, no. 11, pp. 1585-1589, Nov. 2007.
31. S. T. Roweis and L. K. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol. 290, no. 5500, pp. 2323- 2326, 2000.
32. J. Song, Y. Yang, Z. Huang, H. T. Shen, and J. Luo, "Effective multiple feature hashing for large-scale near-duplicate video retrieval," IEEE Trans. Multimedia, vol. 15, no. 8, pp. 1997-2008, Dec. 2013.
33. Z. Tian and R. Kuang, "Global linear neighborhoods for efficient label propagation," in Proc. SIAM Int. Conf. Data Mining, 2012, pp. 863-872.
34. I. Triguero, S. García, and F. Herrera, "Self-labeled techniques for semi-supervised learning: Taxonomy, software and empirical study," Knowl. Inform. Syst., vol. 42, no. 2, pp. 245-284, 2015.
35. R. R. Vatsavai, S. Shekhar, and T. E. Burk, "A semi-supervised learning method for remote sensing data mining," in Proc. 17th IEEE Int. Conf. Tools Artif. Intell., Nov. 2005, pp. 207-211.
36. D. Wang, F. Nie, and H. Huang, "Large-scale adaptive semisupervised learning via unified inductive and transductive model," in Proc. 20th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2014, pp. 482-491.
37. F. Wang and C. Zhang, "Label propagation through linear neighborhoods," IEEE Trans. Knowl. Data Eng., vol. 20, no. 1, pp. 55-67, Jan. 2008.
38. J. Wang, J. Wang, G. Zeng, Z. Tu, R. Gan, and S. Li, "Scalable k- NN graph construction for visual descriptors," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2012, pp. 1106-1113.
39. J. Wang, J. Yang, K. Yu, F. Lv, T. Huang, and Y. Gong, "Localityconstrained linear coding for image classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2010, pp. 3360-3367.
40. M. Wang, X.-S. Hua, R. Hong, J. Tang, G.-J. Qi, and Y. Song, "Unified video annotation via multigraph learning," IEEE Trans. Circuits Syst. Video Technol., vol. 19, no. 5, pp. 733-746, May 2009.
41. Y. Wu, M. Pei, M. Yang, J. Yuan, and Y. Jia, "Robust discriminative tracking via landmark-based label propagation," IEEE Trans. Image Process., vol. 24, no. 5, pp. 1510-1523, May 2015.
42. Y. Xiong, W. Liu, D. Zhao, and X. Tang, "Face recognition via archetype hull ranking," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 585-592.
43. B. Xu, J. Bu, C. Chen, C. Wang, D. Cai, and X. He, "EMR: A scalable graph-based ranking model for content-based image retrieval," IEEE Trans. Knowl. Data Eng., vol. 27, no. 1, pp. 102- 114, Jan. 2015.
44. Z. Yang and E. Oja, "Clustering by low-rank doubly stochastic matrix decomposition," in Proc. 29th Int. Conf. Mach. Learning, 2012, pp. 831-838.
45. G. Yu, G. Zhang, Z. Zhang, Z. Yu, and L. Deng, "Semi-supervised classification based on subspace sparse representation," Knowl. Inform. Syst., vol. 43, no. 1, pp. 81-101, 2015.
46. L. Zelnik-Manor and P. Perona, "Self-tuning spectral clustering," in Proc. Conf. Adv. Neural Inform. Process. Syst., 2004, pp. 1601- 1608.
47. K. Zhang, J. T. Kwok, and B. Parvin, "Prototype vector machine for large scale semi-supervised learning," in Proc. 26th Annu. Int. Conf. Mach. Learning, 2009, pp. 1233-1240.
48. K. Zhang, L. Lan, J. T. Kwok, S. Vucetic, and B. Parvin, "Scaling up graph-based semi-supervised learning via prototype vector machines," IEEE Trans. Neural Netw. Learning Syst., vol. 26, no. 3, pp. 444-457, Mar. 2015.
49. L. Zhang, Y. Yang, M. Wang, R. Hong, L. Nie, and X. Li, "Detecting densely distributed graph patterns for fine-grained image categorization," IEEE Trans. Image Process., vol. 25, no. 2, pp. 553-565, Feb. 2016.
50. S. Zhao, H. Yao, Y. Yang, and Y. Zhang, "Affective image retrieval via multi-graph learning," in Proc. 22nd ACM Int. Conf. Multimedia, 2014, pp. 1025-1028.
51. D. Zhou, O. Bousquet, T. N. Lal, J. Weston, and B. Schölkopf, "Learning with local and global consistency," in Proc. Conf. Adv. Neural Inform. Process. Syst., 2004, vol. 16, no. 16, pp. 321-328.
52. Z.-H. Zhou and M. Li, "Semi-supervised regression with cotraining- style algorithms," IEEE Trans. Knowl. Data Eng., vol. 19, no. 11, pp. 1479-1493, Nov. 2007.
53. Z. Zhou and M. Li, "Tri-training: Exploiting unlabeled data using three classifiers," IEEE Trans. Knowl. Data Eng., vol. 17, no. 11, pp. 1529-1541, Nov. 2005.
54. X. Zhu, Z. Ghahramani, J. Lafferty et al., "Semi-supervised learning using Gaussian fields and harmonic functions," in Proc. 20th Int. Conf. Mach. Learning, 2003, vol. 3, pp. 912-919.
55. X. Zhu and A. B. Goldberg, "Introduction to semi-supervised learning," Synthesis Lectures Artif. Intell. Mach. Learning, vol. 3, no. 1, pp. 1-130, 2009.