A shared-subspace learning framework for multi-label classification

ACM Transactions on Knowledge Discovery from Data

Volumn 4, Issue 2, 2010, Pages

  Ji, Shuiwang ^a   Tang, Lei ^a   Yu, Shipeng ^b   Ye, Jieping ^a  

^a ARIZONA STATE UNIVERSITY   (United States)

^b Siemens Medical Solutions ^*  (United States)

Author keywords

Gene expression pattern image annotation; Kernel methods; Least squares loss; Multi label classification; Shared subspace; Singular value decomposition; Web page categorization

Indexed keywords

GENE EXPRESSION PATTERNS; KERNEL METHODS; LEAST SQUARE; LEAST SQUARES LOSS; MULTI-LABEL; SHARED SUBSPACE; WEB PAGE;

ALGORITHMS; COMPUTATIONAL EFFICIENCY; EIGENVALUES AND EIGENFUNCTIONS; GENE EXPRESSION; IMAGE ANALYSIS; SECURITY OF DATA; SINGULAR VALUE DECOMPOSITION; WORLD WIDE WEB;

LABELS;

EID: 77953216761     PISSN: 15564681     EISSN: 1556472X     Source Type: Journal    
DOI: 10.1145/1754428.1754431     Document Type: Article

References (63)

1. AMIT, Y., FINK, M., SREBRO, N., AND ULLMAN, S. 2007. Uncovering shared structures in multiclass classification. In Proceedings of the 24th International Conference on Machine Learning. 17-24.
2. ANDERSEN, E. D. AND ANDERSEN, K. D. 2000. The MOSEK interior point optimizer for linear programming: An implementation of the homogeneous algorithm. In High Performance Optimization. Kluwer Academic Publishers, 197-232.
3. ANDO, R. K. AND ZHANG, T. 2005. A framework for learning predictive structures from multiple tasks and unlabeled data. J. Mach. Learn. Resear. 6, 1817-1853.
4. ARENAS-GARĆIA, J., PETERSEN, K. B., AND HANSEN, L. K. 2007. Sparse kernel orthonormalized PLS for feature extraction in large data sets. Adv. Neural Inform. Proces. Syst. 19. 33-40.
5. ARGYRIOU, A., MAURER, A., AND PONTIL, M. 2008. An algorithm for transfer learning in a heterogeneous environment. In Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases. 71-85.
6. BAKKER, B. AND HESKES, T. 2003. Task clustering and gating for Bayesian multitask learning. J. Mach. Learn. Resear. 4, 83-99.
7. BARNARD, K.,DUYGULU, P.,FORSYTH, D., D. FREITAS, N.,BLEI, D.M., AND JORDAN,M. I. 2003. Matching words and pictures. J. Mach. Learn. Resear. 3, 1107-1135.
8. BARUTCUOGLU, Z.,SCHAPIRE, R. E., AND TROYANSKAYA,O.G. 2006. Hierarchical multi-label prediction of gene function. Bioinformatics 22, 7, 830-836.
9. CARNEIRO, G., CHAN, A. B., MORENO, P. J., AND VASCONCELOS, M.-N. 2007. Supervised learning of semantic classes for image annotation and retrieval. IEEE Trans. Patt. Anal. Mach. Intel. 29, 3, 394-410.
10. CHANG, C.-C. AND LIN, C.-J. 2001. LIBSVM: A Library for Support Vector Machines. http://www.csie.ntu.edu.tw/?cjlin/libsvm.
11. ELISSEEFF, A. ANDWESTON, J. 2002. A kernel method for multi-labelled classification. Adv. Neural Inform. Proces. Syst. 14. 681-687.
12. FAN, R.-E. AND LIN, C.-J. 2007. A study on threshold selection for multi-label classification. Tech. rep., Department of Computer Science and Information Engineering, National Taiwan University.
13. FUKUNAGA, K. 1990. Introduction to Statistical Pattern Recognition 2nd Ed. Academic Press Professional.
14. FUNG, G. M. AND MANGASARIAN, O. L. 2005. Multicategory proximal support vector machine classifiers. Mach. Learn. 59, 1-2, 77-97.
15. GHAMRAWI, N. AND MCCALLUM, A. 2005. Collective multi-label classification. In Proceedings of the 14th ACM International Conference on Information and Knowledge Management. 195-200.
16. GOLUB, G. H. AND VAN LOAN, C. F. 1996. Matrix Computations 3rd Ed. The Johns Hopkins University Press.
17. GRAUMAN, K. AND DARRELL, T. 2006. Approximate correspondences in high dimensions. Adv. Neural Inform. Proces. Syst. 19. 505-512.
18. GRAUMAN, K. AND DARRELL, T. 2007. The pyramid match kernel: Efficient learning with sets of features. J. Mach. Learn. Res. 8, 725-760.
19. HOERL, A. AND KENNARD, R. 1970. Ridge regression: Biased estimation for nonorthogonal problems. Technometrics 12, 3, 55-67.
20. HOTELLING, H. 1936. Relations between two sets of variates. Biometrika 28, 3-4, 321-377.
21. JACOB, L., BACH, F., AND VERT, J.-P. 2009. Clustered multi-task learning: A convex formulation. Adv. Neural Inform. Proces. Syst. 21, D. Koller, D. Schuurmans, Y. Bengio, and L. Bottou, Eds. 745-752.
22. JI, S., LI, Y.-X., ZHOU, Z.-H., KUMAR, S., AND YE, J. 2009a. A bag-of-words approach for Drosophila gene expression pattern annotation. Bioinformatics 10, 1, 119.
23. JI, S., SUN, L., JIN, R., KUMAR, S., AND YE, J. 2008. Automated annotation of Drosophila gene expression patterns using a controlled vocabulary. Bioinformatics 24, 17, 1881-1888.
24. JI, S. AND YE, J. 2009. Linear dimensionality reduction for multi-label classification. In Proceedings of the 21st International Joint Conference on Artificial Intelligence. 1077-1082.
25. JI, S., YUAN, L., LI, Y.-X., ZHOU, Z.-H., KUMAR, S., AND YE, J. 2009b. Drosophila gene expression pattern annotation using sparse features and term-term interactions. In Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 407-416.
26. JIN, R. AND GHAHRAMANI, Z. 2002. Learning with multiple labels. Adv. Neural Inform. Proces. Syst. 15. 897-904.
27. JOACHIMS, T. 1998. Text categorization with support vector machines: Learning with many relevant features. In Proceedings of the 10th European Conference on Machine Learning. 137-142.
28. JOACHIMS, T. 2005. A support vector method for multivariate performance measures. In Proceedings of the 22nd International Conference on Machine Learning. 377-384.
29. JOACHIMS, T. 2006. Training linear SVMs in linear time. In Proceedings of the 12th ACMSIGKDD International Conference on Knowledge Discovery and Data Mining. 217-226.
30. KANG, F., JIN, R., AND SUKTHANKAR, R. 2006. Correlated label propagation with application to multi-label learning. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 1719-1726.
31. KAZAWA, H., IZUMITANI, T.,TAIRA, H., ANDMAEDA, E. 2005. Maximalmargin labeling for multi-topic text categorization. Adv. Neural Inform. Proces. Syst. 17. 649-656.
32. KIM, S., SOHN, K.-A., AND XING, E. P. 2008. A multivariate regression approach to association analysis of quantitative trait network. Tech. rep. CMU-ML-08-113, Carnegie Mellon University.
33. KUMAR, S., JAYARAMAN, K., PANCHANATHAN, S.,GURUNATHAN, R.,MARTI-SUBIRANA, A., AND NEWFELD, S. J. 2002. BEST: A novel computational approach for comparing gene expression patterns from early stages of Drosophlia melanogaster develeopment. Genetics 169, 2037-2047.
34. LARSEN, R. M. 2000. Computing the SVD for large and sparse matrices. http://soi.stanford.edu/?rmunk/PROPAC.
35. LEWIS, D. D., YANG, Y., ROSE, T. G., AND LI, F. 2004. RCV1: A new benchmark collection for text categorization research. J. Mach. Learn. Res. 5, 361-397
36. LI, J. AND WANG, J. Z. 2008. Real-time computerized annotation of pictures. IEEE Trans. Patt. Anal. Mach. Intel. 3, 6, 985-1002.
37. LI, Y.-X., JI, S., KUMAR, S., YE, J., AND ZHOU, Z.-H. 2009. Drosophila gene expression pattern annotation through multi-instance multi-label learning. In Proceedings of the 21st International Joint Conference on Artificial Intelligence. 1445-1450.
38. MCCALLUM, A. 1999. Multi-label text classification with a mixture model trained by EM. In Proceedings of the AAAI Workshop on Text Learning.
39. MIKOLAJCZYK, K. AND SCHMID, C. 2005. A performance evaluation of local descriptors. IEEE Trans. Patt. Anal. Mach. Intel. 27, 10, 1615-1630.
40. MONAY, F. AND GATICA-PEREZ, D. 2007. Modeling semantic aspects for cross-media image indexing. IEEE Trans. Patt. Anal. Mach. Intel. 29, 10.
41. PARK, H., JEON, M., AND ROSEN, J. B. 2003. Lower dimensional representation of text data based on centroids and least squares. BIT 43, 2, 1-22.
42. RIFKIN, R. AND KLAUTAU, A. 2004. In defense of one-vs-all classification. J. Mach. Learn. Res. 5, 101-141.
43. ROTH, V. AND FISCHER, B. 2007. Improved functional prediction of proteins by learning kernel combinations in multilabel settings. Bioinformatics 8, S12.
44. SCHÖLKOPF, S. AND SMOLA, A. 2002. Learning with Kernels: Support Vector Machines, Regularization, Optimization and Beyond. MIT Press.
45. SUN, L., JI, S., AND YE, J. 2008a. Hypergraph spectral learning for multi-label classification. In Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.
46. SUN, L., JI, S., AND YE, J. 2008b. A least squares formulation for canonical correlation analysis. In Proceedings of the 25th International Conference on Machine Learning. 1024-1031.
47. SUN, L., JI, S., AND YE, J. 2009. On the equivalence between canonical correlation analysis and orthonormalized partial least squares. In Proceedings of the 21st International Joint Conference on Artificial Intelligence. 1230-1235.
48. TANG, L., CHEN, J., AND YE, J. 2009. On multiple kernel learning with multiple labels. In Proceedings of the 21st International Joint Conference on Artificial Intelligence.
49. TANG, L., RAJAN, S., AND NARAYANAN, V. K. 2009. Large scale multi-label classification via MetaLabeler. In Proceedings of the 18th International World Wide Web Conference.
50. TOMANCAK, P., BEATON, A.,WEISZMANN, R.,KWAN, E., SHU, S. Q., LEWIS, S. E., RICHARDS, S., ASHBURNER, M., HARTENSTEIN, V.,CELNIKER, S. E., AND RUBIN, G. 2002. Systematic determination of patterns of gene expression during Drosophila embryogenesis. Genome Biol. 3, 12.
51. TOMANCAK, P., BERMAN, B., BEATON, A., WEISZMANN, R., KWAN, E., HARTENSTEIN, V., CELNIKER, S., AND RUBIN, G. 2007. Global analysis of patterns of gene expression during Drosophila embryogenesis. Genome Biol. 8, 7, R145.
52. UEDA, N. AND SAITO, K. 2002a. Parametric mixture models for multi-labeled text. Adv. Neural Inform. Proces. Syst. 15. 721-728.
53. UEDA, N. AND SAITO, K. 2002b. Single-shot detection of multiple categories of text using parametric mixture models. In Proceedings of the 8th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 626-631.
54. WOLD, H. 1966. Estimation of principal components and related models by iterative least squares. P. R. Krishnaiah, Ed., Multivariate Analysis. Academic Press, New York, 391-420.
55. YAN, R., TESIC, J., AND SMITH, J. R. 2007. Model-shared subspace boosting for multi-label classification. In Proceedings of the 13th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 834-843.
56. YANG, Y. AND PEDERSEN, J. O. 1997. A comparative study on feature selection in text categorization. In Proceedings of the 14th International Conference on Machine Learning. 412-420.
57. YE, J. 2005. Characterization of a family of algorithms for generalized discriminant analysis on undersampled problems. J. Mach. Learn. Resear. 6, 483-502.
58. YE, J. 2007. Least squares linear discriminant analysis. In Proceedings of the 24th International Conference on Machine Learning. 1087-1093. (Pubitemid 47275175)
59. YU, K., YU, S., AND TRESP, V. 2005. Multi-label informed latent semantic indexing. In Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Informaion Retrieval. 258-265.
60. ZHANG, J., MARSZALEK, M., LAZEBNIK, S., AND SCHMID, C. 2007. Local features and kernels for classification of texture and object categories: A comprehensive study. Int. J. Comput. Vision 73, 2, 213-238.
61. ZHANG, M.-L. AND ZHOU, Z.-H. 2006. Multilabel neural networks with applications to functional genomics and text categorization. IEEE Trans. Knowl. Data Engin. 18, 10, 1338-1351.
62. ZHANG, M.-L. AND ZHOU, Z.-H. 2007. ML-KNN: A lazy learning approach to multi-label learning. Patt. Recog. 40, 7, 2038-2048.
63. ZHOU, Z.-H. AND ZHANG,M.-L. 2007. Multi-instance multi-label learning with application to scene classification. Adv. Neural Inform. Process. Syst. 19. 1609-1616.