Multiple graph label propagation by sparse integration

IEEE Transactions on Neural Networks and Learning Systems

Volumn 24, Issue 12, 2013, Pages 1999-2012

  Karasuyama, Masayuki ^a   Mamitsuka, Hiroshi ^a  

^a KYOTO UNIVERSITY   (Japan)

Author keywords

Graph based semisupervised learning; label propagation; multiple graph integration; sparsity

Indexed keywords

DATA REPRESENTATIONS; LABEL PROPAGATION; MULTIPLE HETEROGENEOUS DATA SOURCE; OPTIMIZATION ALGORITHMS; PREDICTION PERFORMANCE; PREDICTIVE PERFORMANCE; SEMI- SUPERVISED LEARNING; SPARSITY;

ALGORITHMS; SUPERVISED LEARNING; VIRTUAL REALITY;

GRAPHIC METHODS;

EID: 84887988371     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2013.2271327     Document Type: Article

References (50)

1. A. Blum and S. Chawla, "Learning from labeled and unlabeled data using graph mincuts," in Proc. 18th Int. Conf. Mach. Learn., 2001, pp. 19-26.
2. M. Szummer and T. Jaakkola, "Partially labeled classification with Markov random walks," in Advances in Neural Information Processing Systems, vol. 14, T. G. Dietterich, S. Becker, and Z. Ghahramani, Eds. Cambridge, MA, USA: MIT Press, 2001, pp. 945-952.
3. T. Joachims, "Transductive learning via spectral graph partitioning," in Proc. 20th Int. Conf. Mach. Learn., 2003, pp. 290-297.
4. X. Zhu, Z. Ghahramani, and J. Lafferty, "Semi-supervised learning: From Gaussian fields to Gaussian processes," in Proc. 20th Annu. Int. Conf. Mach. Learn., 2003.
5. D. Zhou, O. Bousquet, T. N. Lal, J. Weston, and B. Schölkopf, "Learning with local and global consistency," in Advances in Neural Information Processing Systems, vol. 16, S. Thrun, L. Saul, and B. Schölkopf, Eds. Cambridge, MA, USA: MIT Press, 2004.
6. M. Herbster, M. Pontil, and L. Wainer, "Online learning over graphs," in Proc. 22nd Annu. Int. Conf. Mach. Learn., 2005, pp. 305-312. (Pubitemid 43183347)
7. V. Sindhwani, P. Niyogi, and M. Belkin, "Beyond the point cloud: From transductive to semi-supervised learning," in Proc. 22nd Int. Conf. Mach. Learn., 2005, pp. 824-831.
8. M. Belkin, P. Niyogi, and V. Sindhwani, "Manifold regularization: A geometric framework for learning from labeled and unlabeled examples," J. Mach. Learn. Res., vol. 7, pp. 2399-2434, Jan. 2006. (Pubitemid 44708005)
9. Y. Bengio, O. Delalleau, and N. Le Roux, "Label propagation and quadratic criterion," in Semi-Supervised Learning, O. Chapelle, B. Schölkopf, and A. Zien, Eds. Cambridge, MA, USA: MIT Press, 2006, pp. 193-216.
10. K. Tsuda, H. Shin, and B. Scholkopf, "Fast protein classification with multiple networks," Bioinformatics, vol. 21, pp. 59-65, Sep. 2005.
11. T. Kato, H. Kashima, and M. Sugiyama, "Robust label propagation on multiple networks," IEEE Trans. Neural Netw., vol. 20, no. 1, pp. 35-44, Jan. 2009.
12. M. Wang, X.-S. Hua, R. Hong, J. Tang, G.-J. Qi, and Y. Song, "Unified video annotation via multigraph learning," IEEE Trans. Circuits Syst. Video Technol., vol. 19, no. 5, pp. 733-746, May 2009.
13. H. Zou and T. Hastie, "Regularization and variable selection via the elastic net," J. R. Stat. Soc. Ser. B, vol. 67, no. 2, pp. 301-320, 2005. (Pubitemid 40465877)
14. G. R. G. Lanckriet, N. Cristianini, P. Bartlett, L. E. Ghaoui, and M. I. Jordan, "Learning the kernel matrix with semidefinite programming," J. Mach. Learn. Res., vol. 5, pp. 27-72, Dec. 2004.
15. A. Argyriou, M. Herbster, and M. Pontil, "Combining graph Laplacians for semi-supervised learning," in Advances in Neural Information Processing Systems, vol. 18, Y. Weiss, B. Schölkopf, and J. Platt, Eds. Cambridge, MA, USA: MIT Press, 2006, pp. 67-74.
16. S. Boyd and L. Vandenberghe, Convex Optimization. Cambridge, U.K.: Cambridge Univ. Press, 2004.
17. J. Friedman, T. Hastie, H. Höfling, and R. Tibshirani, "Pathwise coordinate optimization," Ann. Appl. Stat., vol. 1, no. 2, pp. 302-332, 2007.
18. A. L. Yuille and A. Rangarajan, "The concave-convex procedure," Neural Comput., vol. 15, no. 4, pp. 915-936, 2003. (Pubitemid 37049812)
19. B. Sriperumbudur and G. Lanckriet, "On the convergence of the concave-convex procedure," in Advances in Neural Information Processing Systems, vol. 22, Y. Bengio, D. Schuurmans, J. Lafferty, C. K. I. Williams, and A. Culotta, Eds. Cambridge, MA, USA: MIT Press, 2009, pp. 1759-1767.
20. D. A. Spielman and S.-H. Teng, "Nearly-linear time algorithms for graph partitioning, graph sparsification, and solving linear systems," in Proc. 36th Annu. ACM Symp. Theory Comput., 2004, pp. 81-90.
21. A. Argyriou, C. A. Micchelli, and M. Pontil, "Learning convex combinations of continuously parameterized basic kernels," in Proc. 18th Annu. Conf. Learn. Theory, vol. 3559. 2005, pp. 338-352.
22. X. Zhu, "Semi-supervised learning literature survey," Dept. Comput. Sci., Univ. Wisconsin-Madison, Madison, WI, USA, Tech. Rep. 1530, 2005.
23. P. P. Talukdar, "Topics in graph construction for semi-supervised learning," Dept. Comput. Inf. Sci., Univ. Pennsylvania, Philadelphia, PA, USA, Tech. Rep. MS-CIS-09-13, 2009.
24. W. Tang, Z. Lu, and I. S. Dhillon, "Clustering with multiple graphs," in Proc. 9th IEEE ICDM, Dec. 2009, pp. 1016-1021.
25. S. Yu, X. Liu, L.-C. Tranchevent, W. Glänzel, J. A. K. Suykens, B. De Moor, and Y. Moreau, "Optimized data fusion for k-means Laplacian clustering," Bioinformatics, vol. 27, no. 1, pp. 118-126, Jan. 2011.
26. T. Joachims, "Transductive inference for text classification using support vector machines," in Proc. 16th Annu. Int. Conf. Mach. Learn., 1999, pp. 200-209.
27. O. Chapelle and A. Zien, "Semi-supervised classification by low density separation," in Proc. 10th Int. Workshop Artif. Intell. Stat., 2005, pp. 57-64.
28. R. Raina, A. Battle, H. Lee, B. Packer, and A. Ng, "Self-taught learning: Transfer learning from unlabeled data," in Proc. 24th Annu. Int. Conf. Mach. Learn., 2007, pp. 759-766.
29. Y. Huang, D. Xu, and F. Nie, "Semi-supervised dimension reduction using trace ratio criterion," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 3, pp. 519-526, Mar. 2012.
30. R. Soares, H. Chen, and X. Yao, "Semisupervised classification with cluster regularization," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 11, pp. 1779-1792, Nov. 2012.
31. Y. Wang, S. Chen, and Z.-H. Zhou, "New semi-supervised classification method based on modified cluster assumption," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 5, pp. 689-702, May 2012.
32. V. R. de Sa, "Learning classification with unlabeled data," in Advances in Neural Information Processing Systems, J. D. Cowan, G. Tesauro, and J. Alspector, Eds. San Francisco, CA, USA: Morgan Kaufmann, 1993, pp. 112-119.
33. J. D. R. Farquhar, D. Hardoon, H. Meng, J. Shawe-Taylor, and S. Szedmak, "Two view learning: SVM-2K, theory and practice," in Advances in Neural Information Processing Systems, vol. 18, Y. Weiss, B. Schölkopf, and J. Platt, Eds. Cambridge, MA, USA: MIT Press, 2006, pp. 355-362.
34. U. Brefeld, T. Gärtner, T. Scheffer, and S. Wrobel, "Efficient coregularised least squares regression," in Proc. 23rd Int. Conf. Mach. Learn., 2006, pp. 137-144.
35. V. Sindhwani, P. Niyogi, and M. Belkin, "A co-regularization approach to semi-supervised learning with multiple views," in Proc. 22nd ICML Workshop Learn. Multiple Views, 2005, pp. 1-6.
36. D. Zhou and C. J. C. Burges, "Spectral clustering and transductive learning with multiple views," in Proc. 24th Int. Conf. Mach. Learn., 2007, pp. 1159-1166.
37. M. Culp, G. Michailidis, and K. Johnson, "On multi-view learning with additive models," Ann. Appl. Stat., vol. 3, no. 1, pp. 292-318, Mar. 2009.
38. M. Culp, "On propagated scoring for semisupervised additive models," J. Amer. Stat. Assoc., vol. 106, no. 493, pp. 248-259, 2011.
39. S. Mostafavi, D. Ray, D. Warde-Farley, C. Grouios, and Q. Morris, "GeneMANIA: A real-time multiple association network integration algorithm for predicting gene function," Genome Biol., vol. 9, pp. S4-S15, Jun. 2008.
40. S. Mostafavi and Q. Morris, "Fast integration of heterogeneous data sources for predicting gene function with limited annotation," Bioinformatics, vol. 26, no. 14, pp. 1759-1765, 2010.
41. D. Warde-Farley, S. L. Donaldson, O. Comes, K. Zuberi, R. Badrawi, P. Chao, M. Franz, C. Grouios, F. Kazi, C. T. Lopes, A. Maitland, S. Mostafavi, J. Montojo, Q. Shao, G. Wright, G. D. Bader, and Q. Morris, "The GeneMANIA prediction server: Biological network integration for gene prioritization and predicting gene function," Nucleic Acids Res., vol. 38, pp. W214-W220, May 2010.
42. N. Cristianini, J. Shawe-Taylor, and J. Kandola, "On kernel target alignment," in Advances in Neural Information Processing Systems, vol. 14, T. G. Dietterich, S. Becker, and Z. Ghahramani, Eds. Cambridge, MA, USA: MIT Press, 2002, pp. 367-373.
43. J. Shawe-Taylor, "Kernel learning for novelty detection," in Proc. NIPS Workshop, Kernel Learn., Autom. Sel. Optim. Kernels, 2008, pp. 1-45.
44. R. Tomioka and T. Suzuki, "Sparsity-accuracy trade-off in MKL," in Proc. NIPS Workshop, Understand. Multiple Kenrel Learn., 2009, pp. 1-8.
45. F. Orabona and J. Luo, "Ultra-fast optimization algorithm for sparse multi kernel learning," in Proc. 28th ICML, Jun. 2011, pp. 249-256.
46. Z.-P. Wu and X.-G. Zhang, "Elastic multiple kernel learning," Acta Autom. Sinica, vol. 37, no. 6, pp. 693-699, 2011.
47. O. Chapelle, B. Schölkopf, and A. Zien, Semi-Supervised Learning. Cambridge, MA, USA: MIT Press, 2006.
48. W. Liu and S.-F. Chang, "Robust multi-class transductive learning with graphs," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Jun. 2009, pp. 381-388.
49. G. R. G. Lanckriet, T. D. Bie, N. Cristianini, M. I. Jordan, and W. S. Noble, "A statistical framework for genomic data fusion," Bioinformatics, vol. 20, no. 16, pp. 2626-2635, 2004. (Pubitemid 39530149)
50. T. Suzuki and R. Tomioka, "SpicyMKL: A fast algorithm for multiple kernel learning with thousands of kernels," Mach. Learn., vol. 85, nos. 1-2, pp. 77-108, 2011.