Bayesian multitask classification with gaussian process priors

IEEE Transactions on Neural Networks

Volumn 22, Issue 12 PART 1, 2011, Pages 2011-2021

  Skolidis, Grigorios ^a   Sanguinetti, Guido ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

Bayesian inference; classification; Gaussian processes; multitask learning

Indexed keywords

BAYESIAN INFERENCE; DATA POINTS; DATA SETS; EXPECTATION PROPAGATION; GAUSSIAN PROCESS; GAUSSIAN PROCESS PRIORS; GAUSSIAN PROCESSES; GIBBS SAMPLING; KRONECKER PRODUCT; MULTITASK LEARNING; REAL DATA SETS; SAMPLING TECHNIQUE; STATE-OF-THE-ART APPROACH; VARIATIONAL BAYES;

BAYESIAN NETWORKS; CLASSIFICATION (OF INFORMATION); GAUSSIAN NOISE (ELECTRONIC); INFERENCE ENGINES;

GAUSSIAN DISTRIBUTION;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BAYES THEOREM; COMPUTER SIMULATION; METHODOLOGY; NORMAL DISTRIBUTION; STATISTICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BAYES THEOREM; COMPUTER SIMULATION; MODELS, STATISTICAL; NORMAL DISTRIBUTION; PATTERN RECOGNITION, AUTOMATED;

EID: 83855165736     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2011.2168568     Document Type: Article

References (43)

1. R. Caruana, "Multi-task learning," Mach. Learn., vol. 28, no. 1, pp. 41-75, 1997.
2. K. Yu, V. Tresp, and A. Schwaighofer, "Learning Gaussian processes from multiple tasks," in Proc. 22nd Int. Conf. Mach. Learn., Bonn, Germany, Aug. 2005, pp. 1012-1019.
3. E. V. Bonilla, F. V. Agakov, and C. K. I. Williams, "Kernel multi-task learning using task-specific features," in Proc. 11th Int. Workshop Artif. Intell. Stat., San Juan, Puerto Rico, Mar. 2007, pp. 43-50.
4. T. Jebara, "Multi-task feature and kernel selection for SVMs," in Proc. 21st Int. Conf. Mach. Learn., Banff, AB, Canada, Jul. 2004, pp. 55-62.
5. A. Argyriou, T. Evgeniou, and M. Pontil, "Convex multi-task feature learning," Mach. Learn., vol. 73, no. 3, pp. 243-272, 2008.
6. S. Yu, V. Tresp, and K. Yu, "Robust multi-task learning with t-processes," in Proc. 24th Int. Conf. Mach. Learn., Corvallis, OR, Jun. 2007, pp. 1103-1110.
7. B. Bakker and T. Heskes, "Task clustering and gating for Bayesian multitask learning," J. Mach. Learn. Res., vol. 4, pp. 83-99, Jan. 2003.
8. J. Baxter, "A model of inductive bias learning," J. Artif. Intell. Res., vol. 12, pp. 149-198, Mar. 2000.
9. S. Ben-David and R. Schuller, "Exploiting task relatedness for multiple task learning," in Proc. 16th Annu. Conf. Comp. Learn. Theory, Washington D.C., Aug. 2003, pp. 567-580. (Pubitemid 37053230)
10. S. Ben-David and R. S. Borbely, "A notion of task relatedness yielding provable multiple-task learning guarantees," Mach. Learn., vol. 73, no. 3, pp. 273-287, Jan. 2008.
11. K. M. A. Chai, "Generalization errors and learning curves for regression with multi-task Gaussian processes," in Proc. Adv. Neural Inf. Process. Syst., Vancouver, BC, Canada, Dec. 2009, pp. 279-287.
12. N. Lawrence and J. Platt, "Learning to learn with the informative vector machine," in Proc. 21st Int. Conf. Mach. Learn., Banff, AB, Canada, Jul. 2004, pp. 65-72.
13. A. Schwaighofer, V. Tresp, and K. Yu, "Learning Gaussian process kernels via hierarchical Bayes," in Proc. Adv. Neural Inf. Process. Syst., Vancouver, BC, Canada, Dec. 2005, pp. 1209-1216.
14. E. Bonilla, K. M. Chai, and C. Williams, "Multi-task Gaussian process prediction," in Proc. Adv. Neural Inf. Process. Syst., Vancouver, BC, Canada, Dec. 2008, pp. 153-160.
15. Q. Liu, X. Liao, H. Li, J. R. Stack, and L. Carin, "Semisupervised multitask learning," IEEE Trans. Pattern. Anal. Mach. Intell., vol. 31, no. 6, pp. 1074-1086, Jun. 2009.
16. A. G. Journel and C. J. Huijbregts, Mining Geostatistics. London, U.K.: Academic, 1978.
17. M. Opper and O. Winther, "Gaussian processes for classification: Mean-field algorithms," Neural Comput., vol. 12, no. 11, pp. 2655-2684, 2000.
18. M. Girolami and S. Rogers, "Variational Bayesian multinomial probit regression with Gaussian process priors," Neural Comput., vol. 18, no. 8, pp. 1790-1817, 2006. (Pubitemid 44036395)
19. J. H. Albert and S. Chib, "Bayesian analysis of binary and polychoto-mous response data," J. Amer. Stat. Assoc., vol. 88, no. 422, pp. 669-679, 1993.
20. C. E. Rasmussen and C. K. Williams, Gaussian Processing Machine Learning. Cambridge, MA: MIT Press, 2005.
21. T. P. Minka, "Expectation propagation for approximate Bayesian inference," in Proc. 17th Conf. Uncert. Artif. Intell., Seattle, WA, Aug. 2001, pp. 362-369.
22. A. Gelman, J. B. Carlin, H. S. Stern, and D. B. Rubin, Bayesian Data Analysis. Chapman and Hall/CRC, 2004.
23. A. K. Gupta and D. K. Nagar, Matrix Variate Distributions. London, U.K.: Chapman & Hall, 2000.
24. M. Titsias, N. Lawrence, and M. Rattray, "Efficient sampling for Gaussian process inference using control variables," in Proc. Adv. Neural Inf. Process. Syst., Vancouver, BC, Canada, Dec. 2009, pp. 1681-1688.
25. K. Yu, W. Chu, S. Yu, V. Tresp, and Z. Xu, "Stochastic relational models for discriminative link prediction," in Proc. Adv. Neural Inf. Process. Syst., Vancouver, BC, Canada, Dec. 2007, pp. 1553-1560.
26. R. Rebonato and P. Jäckel, "The most general methodology to create a valid correlation matrix for risk management and option pricing purposes," J. Risk, vol. 2, no. 2, pp. 1-12, 2000.
27. R. M. Neal, Bayesian Learning for Neural Networks (Lecture Notes in Statistics). New York: Springer-Verlag, 1996, p. 118.
28. J. A. Hanley and B. J. Mcneil, "The meaning and use of the area under a receiver operating characteristic curve," Radiology, vol. 143, no. 1, pp. 29-36, Apr. 1982. (Pubitemid 12142173)
29. G. Skolidis, R. H. Clayton, and G. Sanguinetti, "Automatic classification of arrhytmic beats using Gaussian processes," Comput. Cardiol., vol. 35, pp. 921-924, Sep. 2008.
30. A. L. Goldberger, L. A. N. Amaral, L. Glass, J. M. Hausdorff, P. C. Ivanov, R. G. Mark, J. E. Mietus, G. B. Moody, C.-K. Peng, and H. E. Stanley, "Physiobank, physiotoolkit, and physionet: Components of a new research resource for complex physiologic signals," Circulation, vol. 101, no. 23, pp. 215-220, 2000.
31. Y. Xue, X. Liao, L. Carin, and B. Krishnapuram, "Multi-task learning for classification with Dirichlet process priors," J. Mach. Learn. Res., vol. 8, pp. 35-63, Jan. 2007. (Pubitemid 46155123)
32. S. J. Pan and Q. Yang, "A survey on transfer learning," IEEE Trans. Knowl. Data Eng., vol. 22, no. 10, pp. 1345-1359, Oct. 2010.
33. Y. Zhang and D.-Y. Yeung, "Multi-task learning using generalized t process," in Proc. 14th Int. Workshop Artif. Intell. Stat., Sardinia, Italy, May 2010, pp. 964-971.
34. S. Zhu, K. Yu, and Y. Gong, "Stochastic relational models for large-scale dyadic data using MCMC," in Proc. Adv. Neural Inf. Process. Syst., Vancouver, BC, Canada, Dec. 2009, pp. 1993-2000.
35. K. Yu and W. Chu, "Gaussian process models for link analysis and transfer learning," in Proc. Adv. Neural Inf. Process. Syst., Vancouver, BC, Canada, Dec. 2008, pp. 1657-1664.
36. Y. Teh, M. Seeger, and M. Jordan, "Semiparametric latent factor models," in Proc. 10th Int. Workshop Artif. Intell. Stat., Jan. 2005, pp. 333-340.
37. A. Birlutiu, P. Groot, and T. Heskes, "Multi-task preference learning with an application to hearing aid personalization," Neurocomputing, vol. 73, nos. 7-9, pp. 1177-1185, 2010.
38. G. Pillonetto, F. Dinuzzo, and G. De Nicolao, "Bayesian online multitask learning of Gaussian processes," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 2, pp. 193-205, Feb. 2010.
39. M. Alvarez and N. D. Lawrence, "Sparse convolved Gaussian process for multi-output regression," in Proc. Adv. Neural Inf. Process. Syst., Vancouver, BC, Canada, Dec. 2009, pp. 57-64.
40. N. D. Lawrence, G. Sanguinetti, and M. Rattray, "Modelling tramscrip-tional regulation using Gaussian processes," in Proc. Adv. Neural Inf. Process. Syst., Vancouver, BC, Canada, Dec. 2007, pp. 785-792.
41. M. Boutell, J. Luo, X. Shen, and C. Brown, "Learning multi-label scene classification," Pattern Recognit., vol. 37, no. 9, pp. 1757-1771, 2004. (Pubitemid 38804465)
42. Z. Barutcuoglu, R. E. Schapire, and O. G. Troyanskaya, "Hierarchical multi-label prediction of gene function," Bioinformatics, vol. 22, no. 7, pp. 830-836, 2006.
43. M. Adankon, M. Cheriet, and A. Biem, "Semisupervised learning using bayesian interpretation: Application to LS-SVM," IEEE Trans. Neural Netw., vol. 22, no. 4, pp. 513-524, Apr. 2011.