Multi-label output codes using canonical correlation analysis

Journal of Machine Learning Research

Volumn 15, Issue , 2011, Pages 873-882

  Zhang, Yi ^a   Schneider, Jeff ^a  

^a Carnegie Mellon University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BERNOULLI; BINARY PROBLEMS; CANONICAL CORRELATION ANALYSIS; CODE DESIGNS; CODEWORD; COMPRESSIVE SENSING; EMOTION CLASSIFICATION; EMPIRICAL STUDIES; ENSEMBLE LEARNING; ERROR CORRECTING CODE; ERROR CORRECTING OUTPUT CODE; GAUSSIANS; GRAPHICAL MODEL; LABEL SPACE; MEAN FIELD APPROXIMATION; MULTI-LABEL; MULTICLASS CLASSIFICATION PROBLEMS; OUTDOOR SCENES;

ARTIFICIAL INTELLIGENCE; DECODING;

SPEECH RECOGNITION;

EID: 84862283912     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (32)

1. E. L. Allwein, R. E. Schapire, and Y. Singer. Reducing multiclass to binary: a unifying approach for margin classifiers. J. Mach. Learn. Res., 1:113-141, 2001.
2. L. Breiman. Bagging predictors. Machine Learning, 24(2):123-140, 1996.
3. L. Breiman, J. Friedman, C. J. Stone, and R. A. Olshen. Classification and Regression Trees. Chapman and Hall/CRC, 1 edition, 1984.
4. L. Breiman and E. Schapire. Random forests. Machine Learning, pages 5-32, 2001.
5. E. J. Candes. Compressive Sampling. In Proceed- ings of International Congress of Mathematicians, 2006.
6. D. J. Costello and G. D. Forney. Channel coding: The road to channel capacity. Proceedings of the IEEE, 95(6):1150-1177, 2007.
7. T. M. Cover and J. A. Thomas. Elements of in- formation theory. Wiley-Interscience, New York, NY, USA, 1991.
8. K. Crammer and Y. Singer. On the learnability and design of output codes for multiclass problems. Mach. Learn., 47(2-3):201-233, 2002.
9. T. G. Dietterich and G. Bakiri. Solving multiclass learning problems via error-correcting output codes. Journal of Artificial Intelligence Research, 2:263-286, 1995.
10. D. L. Donoho. Compressed Sensing. IEEE Trans. Information Theory, 52(4):1289-1306, 2006.
11. S. Escalera, O. Pujol, and P. Radeva. On the decoding process in ternary error-correcting output codes. IEEE Trans. Pattern Anal. Mach. Intell., 32(1):120-134, 2010.
12. Y. Freund and R. E. Schapire. Experiments with a new boosting algorithm. In International Conference on Machine Learning, pages 148-156, 1996.
13. J. Fürnkranz, E. Hüllermeier, E. Loza Menćia, and K. Brinker. Multilabel classification via calibrated label ranking. Mach. Learn., 73(2):133-153, 2008.
14. C. Fyfe and P. L. Lai. Kernel and nonlinear canonical correlation analysis. International Journal of Neural Systems, 10:365-374, 2001.
15. D. R. Hardoon and J. Shawe-Taylor. Sparse canonical correlation analysis. http://arxiv.org/abs/0908.2724, 2009.
16. D. R. Hardoon, S. R. Szedmak, and J. R. Shawe-taylor. Canonical correlation analysis: An overview with application to learning methods. Neural Comput., 16(12):2639-2664, 2004.
17. T. Hastie and R. Tibshirani. Classification by pairwise coupling. In NIPS '97, 1997.
18. H. Hotelling. The most predictable criterion. Journal of Educational Psychology, 26:139-142, 1935.
19. H. Hotelling. Relations between two sets of variates. Biometrika, 28:321-377, 1936.
20. D. Hsu, S. Kakade, J. Langford, and T. Zhang. Multi-label prediction via compressed sensing. In NIPS, pages 772-780. 2009.
21. M. I. Jordan, Z. Ghahramani, T. S. Jaakkola, and L. Saul. An introduction to variational methods for graphical models. Machine Learning, 37:183-233, 1999.
22. J. Kittler, M. Hatef, R. P.W. Duin, and J. Matas. On combining classifiers. IEEE Trans. Pattern Anal. Mach. Intell., 20(3):226-239, 1998.
23. D. Koller and N. Friedman. Probabilistic Graphical Models: Principles and Techniques. MIT Press, 2009.
24. D. Needell and J. A. Tropp. Cosamp: Iterative signal recovery from incomplete and inaccurate samples. Applied and Computational Harmonic Analysis, 26(3), 2008.
25. A. Passerini, M. Pontil, and P. Frasconi. New results on error correcting output codes of kernel machines. IEEE Transactions on Neural Networks, pages 45-54, 2004.
26. O. Pujol, P. Radeva, and J. Vitri. Discriminant ecoc: A heuristic method for application dependent design of error correcting output codes. IEEE Transactions on Pattern Analysis and Ma chine Intelligence, 28:1007-1012, 2006.
27. P. Rai and H. Daume. Multi-label prediction via sparse infinite cca. In Y. Bengio, D. Schuurmans, J. Lafferty, C. K. I. Williams, and A. Culotta, editors, Advances in Neural Information Processing Systems 22, pages 1518-1526. 2009.
28. R. Rifkin and A. Klautau. In defense of one-vsall classification. J. Mach. Learn. Res., 5:101-141, 2004.
29. L. Sun, S. Ji, and J. Ye. Canonical correlation analysis for multilabel classification: A least-squares formulation, extensions, and analysis. IEEE Trans. Pattern Anal. Mach. Intell., 33:194-200, 2011.
30. J. A. Tropp. Just relax: convex programming methods for identifying sparse signals in noise. IEEE Transactions on Information Theory,52(3):1030- 1051, 2006.
31. G. Tsoumakas, I. Katakis, and I. Vlahavas. Mining multi-label data. In O. Maimon and L. Rokach, editors, Data Mining and Knowledge Discovery Handbook. Springer, 2 edition, 2010.
32. D. M.Witten, R. Tibshirani, and T. Hastie. A penalized matrix decomposition, with applications to sparse principal components and canonical correlation analysis. Biostatistics, 10(3):515-534, July 2009.