Recursive regularization for large-scale classification with hierarchical and graphical dependencies

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn Part F128815, Issue , 2013, Pages 257-265

  Gopal, Siddharth ^a   Yang, Yiming ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Hierarchical classification; Large scale evaluation; Parallel optimization; Recursive regularization

Indexed keywords

DATA MINING;

HIERARCHICAL CLASSIFICATION; IMPROVING PERFORMANCE; ITERATIVE OPTIMIZATION; LARGE SCALE CLASSIFICATIONS; LARGE-SCALE EVALUATION; PARALLEL OPTIMIZATION; RECURSIVE REGULARIZATION; REGULARIZATION FRAMEWORK;

CLASSIFICATION (OF INFORMATION);

EID: 84991602296     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2487575.2487644     Document Type: Conference Paper

References (40)

1. http://leon.bottou.org/projects/sgd.
2. A. Argyriou, T. Evgeniou, and M. Pontil. Convex multi-Task feature learning. Machine Learning, 73(3):243-272, 2008.
3. A. Argyriou, C.A. Micchelli, M. Pontil, and Y. Ying. A spectral regularization framework for multi-Task structure learning. 2007.
4. S. Bengio, J. Weston, and D. Grangier. Label embedding trees for large multi-class tasks. NIPS, 23:163-171, 2010.
5. P.N. Bennett and N. Nguyen. Refined experts: improving classification in large taxonomies. In SIGIR, 2009.
6. L. Cai and T. Hofmann. Hierarchical document categorization with support vector machines. In CIKM, pages 78-87. ACM, 2004.
7. N. Cesa-Bianchi, C. Gentile, and L. Zaniboni. Incremental algorithms for hierarchical classification. JMLR, 7:31-54, 2006.
8. C. DeCoro, Z. Barutcuoglu, and R. Fiebrink. Bayesian aggregation for hierarchical genre classification. In Proceedings of the International Conference on Music Information Retrieval, pages 77-80, 2007.
9. O. Dekel, J. Keshet, and Y. Singer. Large margin hierarchical classification. In ICML, page 27. ACM, 2004.
10. I. Dimitrovski, D. Kocev, L. Suzana, and S. Dzeroski. Hierchical annotation of medical images. In IMIS, 2008.
11. S. Dumais and H. Chen. Hierarchical classification of web content. In ACM SIGIR, 2000.
12. T. Evgeniou and M. Pontil. Regularized multi-Task learning. In SIGKDD, pages 109-117. ACM, 2004.
13. A. Genkin, D.D. Lewis, and D. Madigan. Large-scale bayesian logistic regression for text categorization. 2007.
14. J. Gonzalez, Y. Low, and C. Guestrin. Residual splash for optimally parallelizing belief propagation. Aistats, 2009.
15. S. Gopal and Y. Yang. Multilabel classification with meta-level features. In Proceeding of the 33rd international ACM SIGIR conference on Research and development in information retrieval, pages 315-322. ACM, 2010.
16. Siddharth Gopal, Yiming Yang, Bing Bai, and Alexandru Niculescu-Mizil. Bayesian models for large-scale hierarchical classification. In Advances in Neural Information Processing Systems 25, pages 2420-2428, 2012.
17. C.J. Hsieh, K.W. Chang, C.J. Lin, S.S. Keerthi, and S. Sundararajan. A dual coordinate descent method for large-scale linear svm. In ICML, pages 408-415. ACM, 2008.
18. D. Koller and M. Sahami. Hierarchically classifying documents using very few words. 1997.
19. D.D. Lewis, R.E. Schapire, J.P. Callan, and R. Papka. Training algorithms for linear text classifiers. In SIGIR, pages 298-306. ACM, 1996.
20. D.D. Lewis, Y. Yang, T.G. Rose, and F. Li. Rcv1: A new benchmark collection for text categorization research. JMLR, 5:361-397, 2004.
21. D.C. Liu and J. Nocedal. On the limited memory bfgs method for large scale optimization. Mathematical programming, 45(1):503-528, 1989.
22. T.Y. Liu, Y. Yang, H. Wan, H.J. Zeng, Z. Chen, and W.Y. Ma. Support vector machines classification with a very large-scale taxonomy. ACM SIGKDD, pages 36-43, 2005.
23. Z.Q. Luo and P. Tseng. On the convergence of the coordinate descent method for convex difierentiable minimization. Journal of Optimization Theory and Applications, 72(1):7-35, 1992.
24. A. McCallum, R. Rosenfeld, T. Mitchell, and A.Y. Ng. Improving text classification by shrinkage in a hierarchy of classes. In ICML, pages 359-367, 1998.
25. T.P. Minka. A comparison of numerical optimizers for logistic regression. Unpublished draft, 2003.
26. J. Rousu, C. Saunders, S. Szedmak, and J. Shawe-Taylor. Kernel-based learning of hierarchical multilabel classification models. The Journal of Machine Learning Research, 7:1601-1626, 2006.
27. B. Shahbaba and R.M. Neal. Improving classification when a class hierarchy is available using a hierarchy-based prior. Bayesian Analysis, 2(1):221-238, 2007.
28. S. Shalev-Shwartz, Y. Singer, and N. Srebro. Pegasos: Primal estimated sub-gradient solver for svm. In ICML, pages 807-814. ACM, 2007.
29. A. Smola and R. Kondor. Kernels and regularization on graphs. Learning theory and kernel machines, pages 144-158, 2003.
30. P. Tseng. Convergence of a block coordinate descent method for nondifierentiable minimization. Journal of optimization theory and applications, 109(3):475-494, 2001.
31. I. Tsochantaridis, T. Joachims, T. Hofmann, and Y. Altun. Large margin methods for structured and interdependent output variables. JMLR, 6(2):1453, 2006.
32. C. Widmer, J. Leiva, Y. Altun, and G. Ratsch. Leveraging sequence classification by taxonomy-based multitask learning. In Research in Computational Molecular Biology, pages 522-534. Springer, 2010.
33. IPC WIPO. http://www.wipo.int/classi-cations/ipc/en/support/.
34. G.R. Xue, D. Xing, Q. Yang, and Y. Yu. Deep classification in large-scale text hierarchies. In SIGIR, pages 619-626. ACM, 2008.
35. Y. Yang. A study of thresholding strategies for text categorization. In SIGIR, pages 137-145. ACM, 2001.
36. Y. Yang, J. Zhang, and B. Kisiel. A scalability analysis of classifiers in text categorization. In SIGIR, pages 96-103. ACM, 2003.
37. Yiming Yang. An evaluation of statistical approaches to text categorization. Information Retrieval, 1:67-88, 1999.
38. T. Zhang and F.J. Oles. Text categorization based on regularized linear classification methods. Information retrieval, 4(1):5-31, 2001.
39. T. Zhang, A. Popescul, and B. Dom. Linear prediction models with graph regularization for web-page categorization. In SIGKDD, pages 821-826. ACM, 2006.
40. D. Zhou, L. Xiao, and M. Wu. Hierarchical classification via orthogonal transfer. Technical report, MSR-TR-2011-54, 2011.