A probabilistic model for dirty multi-task feature selection

32nd International Conference on Machine Learning, ICML 2015

Volumn 2, Issue , 2015, Pages 1073-1082

  Hernández Lobato, Daniel ^a   Hernández Lobato, José Miguel ^b   Ghahramani, Zoubin ^c  

^a UNIVERSIDAD AUTÓNOMA DE MADRID   (Spain)

^b HARVARD UNIVERSITY   (United States)

^c UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; BENCHMARKING; LEARNING SYSTEMS; STATISTICS;

APPROXIMATE INFERENCE; EXPECTATION PROPAGATION; FEATURE SELECTION METHODS; LATENT VARIABLE; LEARNING TASKS; MODEL-BASED OPC; PREDICTIVE PERFORMANCE; PROBABILISTIC MODELING;

FEATURE EXTRACTION;

EID: 84969900712     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (28)

1. Argyriou, A., Evgeniou, T., and Pontil, M. Multi-task feature learning. In Neural Information Processing Systems, pp. 41-48. 2007.
2. Armagan, A., Dunson, D., and Clyde, M. Generalized beta mixtures of Gaussians. In Neural Information Processing Systems, pp. 523-531. 2011.
3. Barretina et al. The cancer cell line encyclopedia enables predictive modelling of anticancer drug sensitivity. Nature, 483:603-307, 2012.
4. Berger, J. A robust generalized Bayes estimator and confidence region for a multivariate normal mean. The Annals of Statistics, 8:716-761, 1980.
5. Bishop, C. M. Pattern Recognition and Machine Learning. Springer, 2006.
6. Carvalho, C.M., Poison, N.G., and Scott, J.G. Handling sparsity via the horseshoe. J. Mach. Learn. Res. W&CP, 5:73-80, 2009.
7. Fawcett, T. An introduction to ROC analysis. Pattern recognition letters, 27:861-874, 2006.
8. Gong, P., Ye, J., and Zhang, C. Robust multi-task feature learning. In International Conference on Knowledge Discovery and Data Mining, pp. 895-903, 2012.
9. Hernández-Lobato, D. and Hernández-Lobato, J. M. Learning feature selection dependencies in multi-task learning. In Neural Information Processing Systems, pp. 746-754. 2013.
10. Hernández-Lobato, D., Hernández-Lobato, J. M., Helleputte, T., and Dupont, P. Expectation propagation for Bayesian multi-task feature selection. In European Conference on Machine Learning, pp. 522-537, 2010.
11. Hernández-Lobato, D., Hernández-Lobato, J. M., and Dupont, P. Generalized spike-and-slab priors for Bayesian group feature selection using expectation propagation. J. Mach. Learn. Res., 14:1891-1945, 2013.
12. Hernández-Lobato, J. M., Hernández-Lobato, D., and Suárez, A. Expectation propagation in linear regression models with spike-and-slab priors. Machine Learning, 99:437-487, 2015.
13. Huynh-Thu, V. A., Irrthum, A., Wehenkel, L., and Geurts, P. Inferring regulatory networks from expression data using tree-based methods. PLoS ONE, 5:el2776, 2010.
14. Jalali, A., Ravikumar, P., Sanghavi, S., and Ruan, C. A dirty model for multi-task learning. In Neural Information Processing Systems, pp. 964-972. 2010.
15. Jebara, T. Multi-task feature and kernel selection for SVMs. In International Conference on Machine Learning, pp. 55-62, 2004.
16. Johnstone, I. M. and Silverman, B. W. Empirical Bayes selection of wavelet thresholds. Annals of Statistics, 33: 1700-1752, 2005.
17. Minka, T. Expectation propagation for approximate Bayesian inference. In Annual Conference on Uncertainty in Artificial Intelligence, pp. 362-36, 2001.
18. Mitchell, T. J. and Beauchamp, J. J. Bayesian variable selection in linear regression. Journal of the American Statistical Association, 83:1023-1032, 1988.
19. Obozinski, G., Taskar, B., and Jordan, M.I. Joint covariate selection and joint subspace selection for multiple classification problems. Statistics and Computing, pp. 1-22, 2009.
20. Passos, A., Rai, P., Wainer, J., and Daumé III, H. Flexible modeling of latent task structures in multitask learning. In International Conference on Machine Learning, 2012.
21. Schaffter, T., Marbach, D., and Floreano, D. Genenetweaver: In silico benchmark generation and performance profiling of network inference methods. Bioinformatics, 27:2263-2270, 2011.
22. Seeger, M. Expectation propagation for exponential families. Technical report, UC, Berkeley, 2006.
23. Strawderman, W. E. Proper Bayes minimax estimators of the multivariate normal mean. The Annals of Mathematical Statistics, 42:385-388, 1971.
24. Titsias, M. and Lázaro-Gredilla, M. Spike and slab variational inference for multi-task and multiple kernel learning. In Neural Information Processing Systems, pp. 2339-2347, 2011.
25. 1.2 regularization. In 32nd Anual Symposium of the German Association for Pattern Recognition, volume 6376, pp. 252-261, 2010.
26. Xiong, T., Bi, J., Rao, B., and Cherkassky, V. Probabilistic joint feature selection for multi-task learning. In Seventh SIAM International Conference on Data Mining, pp. 332-342, 2007.
27. Xue, Y., Liao, X., Carin, L., and Krishnapuram, B. Multitask learning for classification with Dirichlet process priors. J. Mach. Learn. Res., 8:35-63, 2007.
28. Zhang, J., Ghahramani, Z., and Yang, Y. Flexible latent variable models for multi-task learning. Machine Learning, 73:221-242, 2008.