Adaptive spherical Gaussian kernel in sparse Bayesian learning framework for nonlinear regression

Expert Systems with Applications

Volumn 36, Issue 2 PART 2, 2009, Pages 3982-3989

  Yuan, Jin ^a,d   Bo, Liefeng ^b   Wang, Kesheng ^c   Yu, Tao ^a  

^a SHANGHAI UNIVERSITY   (China)

^b XIDIAN UNIVERSITY   (China)

^c NORWEGIAN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Norway)

^d SHANDONG AGRICULTURAL UNIVERSITY   (China)

Author keywords

Bayesian evidence; Gaussian kernel function; Gradient descent algorithm; Regression; Relevance vector machine (RVM)

Indexed keywords

ARTIFICIAL INTELLIGENCE; BENCHMARKING; GAUSSIAN DISTRIBUTION; LEARNING SYSTEMS;

BAYESIAN EVIDENCE; GAUSSIAN KERNEL FUNCTIONS; GRADIENT DESCENT ALGORITHMS; REGRESSION; RELEVANCE VECTOR MACHINE;

REGRESSION ANALYSIS;

EID: 56349151737     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2008.02.055     Document Type: Article

References (25)

1. Agarwal, A., & Triggs, B. (2004). 3D human pose from silhouettes by relevance vector regression. In Proceedings of the 2004 IEEE computer society conference on computer vision and pattern recognition (Vol. 882, pp. II-882-II-888).
2. Bo L., Wang L., and Jiao L. Feature scaling for kernel fisher discriminant analysis using leave-one-out cross validation. Neural Computation 18 4 (2006) 961-978
3. Bo L.F., Wang L., and Jiao L.C. Sparse gaussian processes using backward elimination. Advances in Neural Networks 3971 1 (2006) 1083-1088
4. Cawley G.C., and Talbot N.L.C. Preventing over-fitting during model selection via bayesian regularisation of the hyper-parameters. Journal of Machine Learning Research 8 (2007) 841-861
5. Chapelle O., Vapnik V., Bousquet O., and Mukherjee S. Choosing multiple parameters for support vector machines. Machine Learning 46 1/3 (2002) 131
6. Csato L., and Opper M. Sparse on-line gaussian processes. Neural Computation 14 3 (2002) 641-668
7. Harrison, D., & Rubinfeld, D. L. (1978). Hedonic prices and the demand for clean air.
8. MacKay D. The evidence framework applied to classification networks. Neural Computation 4 5 (1992) 720-736
9. Muller M., Ratsch T., and Scholkopf B. An introduction to kernel-based learning algorithms. IEEETNN: IEEE Transactions on Neural Networks 12 (2001)
10. Newman, D. J., & Asuncion, A. (2007). UCI machine learning repository. Available from http://www.ics.uci.edu/~mlearn/MLRepository.html.
11. Quiñonero Candela, J. (2004). Learning with uncertainty - Gaussian processes and relevance vector machines. PhD thesis, Technical University of Denmark, Lyngby, Denmark.
12. Rasmussen C.E., and Williams C. Gaussian processes for machine learning (2006), MIT Press
13. Roweis, S. (1999). Matrix identities. Available from http://www.cs.toronto.edu/~roweis/notes/matrixid.pdf.
14. Schmolck A., and Everson R. Smooth relevance vector machine: A smoothness prior extension of the RVM. Machine Learning 68 2 (2007) 107-135
15. Smola A., and Schölkopf B. A tutorial on support vector regression. Statistics and Computing 14 3 (2004) 199-222
16. Smola A., and Schölkopf B. Sparse greedy matrix approximation for machine learning. In: Langley P. (Ed). Proceedings of the 17th international conference on machine learning (2000), Morgan Kaufmann, San Francisco 911-918
17. Sundararajan S., Shevade S.K., and Sathiya Keerthi S. Fast generalized cross-validation algorithm for sparse model learning. Neural Computation 19 1 (2007) 283-301
18. Tipping M. The relevance vector machine. In: Solla A., Leen T., and Mller K.-R. (Eds). Advances in neural information processing systems Vol. 12 (2000), MIT, Cambridge 652-658
19. Tipping M. Bayesian inference: An introduction to principles and practice in machine learning. Advanced Lectures on Machine Learning 3176 (2004) 41-62
20. Tipping M.E. Sparse bayesian learning and the relevance vector machine. Journal of Machine Learning Research 1 (2001) 211-244
21. Tipping, M. E. & Faul, A. C. (2003). Fast marginal likelihood maximization for sparse bayesian models. In Proceedings of the ninth international workshop on artificial intelligence and statistics.
22. Vapnik V. Statistical learning theory (1998), Wiley
23. Williams O., Blake A., and Cipolla R. Sparse Bayesian learning for efficient visual tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence 27 8 (2005) 1292-1304
24. Williams C., and Rasmussen C. Gaussian processes for regression. Advances in Neural Information Processing Systems 8 (1996) 598-604
25. Yuan J., Wang K., Yu T., and Fang M. Integrating relevance vector machines and genetic algorithms for optimization of seed-separating process. Engineering Applications of Artificial Intelligence 20 7 (2007) 970-979