Infinite predictor subspace models for multitask learning

Journal of Machine Learning Research

Volumn 9, Issue , 2010, Pages 613-620

  Rai, Piyush ^a   Daumé III, Hal ^a  

^a Department of Electrical and Computer Engineering   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

FEATURE MODELS; LEARNING TASKS; MIXTURE OF LINEAR SUBSPACES; MULTITASK LEARNING; NON-PARAMETRIC; NON-PARAMETRIC BAYESIAN; NONLINEAR MANIFOLDS; PARAMETER SUBSPACE; SUBSPACE MODELS; TASK RELATEDNESS;

BAYESIAN NETWORKS;

ARTIFICIAL INTELLIGENCE;

EID: 84862271988     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (28)

1. Ando, R. K. and Zhang, T. A Framework for Learning Predictive Structures from Multiple Tasks and Unlabeled Data. The Journal of Machine Learning Research, 6: 1817-1853, 2005.
2. Antoniak, C. E. Mixtures of Dirichlet Processes with Applications to Bayesian Nonparametric Problems. The Annals of Statistics, 2(6), 1974.
3. Bartholomew, D. J. and Knott, M. Latent Variable Models and Factor Analysis (2nd ed.). Oxford University Press, 1999.
4. Baxter, J. A Model of Inductive Bias Learning. Journal of Artificial Intelligence Research, 12:149-198, 2000.
5. Bishop, C. M. Bayesian PCA. In Neural Information Processing Systems 11. MIT Press, 1999.
6. Bishop, C.M. Pattern recognition and machine learning. Springer New York., 2006.
7. Breiman, L. and Friedman, J.H. Predicting Multivariate Responses in Multiple Linear Regression. Journal of the Royal Statistical Society. Series B (Methodological), pp. 3-54, 1997.
8. Caruana, R. Multitask Learning. Machine Learning, 28 (1):41-75, 1997.
9. Daumé III, H. Bayesian Multitask Learning with Latent Hierarchies. In Conference on Uncertainty in Artificial Intelligence, Montreal, Canada, 2009.
10. Doshi, F. and Ghahramani, Z. Accelerated Gibbs Sampling for the Indian Buffet Process. In ICML, 2009.
11. Evgeniou, T., Micchelli, C.A., and Pontil, M. Learning Multiple Tasks with Kernel Methods. Journal of Machine Learning Research, 2006.
12. Ghahramani, Z. and Hinton, G. E. The EM Algorithm for Mixtures of Factor Analyzers. Technical report, Technical Report, 1997.
13. Ghahramani, Z., Griffiths, T.L., and Sollich, P. Bayesian Nonparametric Latent Feature Models. In Bayesian Statistics 8. Oxford University Press, 2007.
14. Heskes, T. Empirical Bayes for Learning to Learn. In Proc. of the 17th ICML, 2000.
15. Holmes, Chris C. and Held, Leonhard. Bayesian Auxiliary Variable Models for Binary and Multinomial Regression. In Bayesian Statistics 8. Oxford University Press, 2006.
16. Jaakkola, T. S. and Jordan, M. I. A Variational Approach to Bayesian Logistic Regression Models and Their Extensions. In Proceedings of the International Conference on Artificial Intelligence and Statistics, 1996.
17. Ji, S., Tang, L., Yu, S., and Ye, J. Extracting Shared Subspace for Multi-label Classification. In 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2008.
18. Lawrence, N.D. and Platt, J.C. Learning to Learn with the Informative Vector Machine. In Proceedings of the twenty-first international conference on Machine learning. ACM New York, NY, USA, 2004.
19. Lounici, K., Pontil, M., Tsybakov, A. B., and Geer, S. Taking Advantage of Sparsity in Multi-Task Learning. In arXiv:0903.1468v1 [stat.ML], 2009.
20. Rai, P. and Daumé III, H. The Infinite Hierarchical Factor Regression Model. In Neural Information Processing Systems 21. MIT Press, 2009.
21. Schölkopf, B., Herbrich, R., and Smola, A. J. A Generalized Representer Theorem. In Proceedings of the 14th Annual Conference on Computational Learning Theory and and 5th European Conference on Computational Learning Theory, 2001.
22. Teh, Y. W., Görür, D., and Ghahramani, Z. Stick-breaking Construction for the Indian Buffet Process. In Proceedings of the International Conference on Artificial Intelligence and Statistics, volume 11, 2007.
23. Teh, Y.W., Seeger, M., and Jordan, M.I. Semiparametric Latent Factor Models. In Conference on Artificial Intelligence and Statistics, volume 10, 2005.
24. Xue, Y., Dunson, D., and Carin, L. The Matrix Stickbreaking Process for Flexible Multi-task Learning. In ICML '07: Proceedings of the 24th international conference on Machine learning, 2007a.
25. Xue, Y., Liao, X., Carin, L., and Krishnapuram, B. Multitask Learning for Classification with Dirichlet Process Priors. The Journal of Machine Learning Research, 8: 35-63, 2007b.
26. Yang, Y. An Evaluation of Statistical Approaches to Text Categorization. Journal of Information Retrieval, 1:67-88, 1997.
27. Zhang, J., Ghahramani, Z., and Yang, Y. Learning multiple related tasks using latent independent component analysis. In In Advances in Neural Information Processing Systems 18. MIT Press, 2006.
28. Zhang, J., Ghahramani, Z., and Yang, Y. Flexible Latent Variable Models for Multi-task Learning. Machine Learning Journal, 73(3), 2008.