Sparse kernel learning with LASSO and Bayesian inference algorithm

Neural Networks

Volumn 23, Issue 2, 2010, Pages 257-264

  Gao, Junbin ^a   Kwan, Paul W ^b   Shi, Daming ^c  

^a CHARLES STURT UNIVERSITY   (Australia)

^b UNIVERSITY OF NEW ENGLAND   (Australia)

^c NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

Bayesian inference; Kernel models; LASSO; RVM

Indexed keywords

BAYESIAN INFERENCE; BAYESIAN LEARNING; COMPUTATIONAL ADVANTAGES; HYPERPARAMETERS; KERNEL MODELS; LEARNING KERNELS; LECTURE NOTES; LOCAL REGULARIZATION; ORTHOGONAL LEAST SQUARES; PUERTO RICO; RELEVANCE VECTOR MACHINE; ROBUST LEARNING ALGORITHM; SPARSE KERNELS; SPARSE REGRESSION; STATE-OF-THE-ART METHODS;

ARTIFICIAL INTELLIGENCE; BAYESIAN NETWORKS; LEARNING ALGORITHMS; MATHEMATICAL OPERATORS; REGRESSION ANALYSIS;

INFERENCE ENGINES;

ALGORITHM; ARTICLE; BAYES THEOREM; BAYESIAN LEARNING; CONTROLLED STUDY; KERNEL METHOD; LEARNING ALGORITHM; PRIORITY JOURNAL; REGRESSION ANALYSIS; RELEVANCE VECTOR MACHINE;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BAYES THEOREM; COMPUTER SIMULATION; DATABASES, FACTUAL; LEAST-SQUARES ANALYSIS; NORMAL DISTRIBUTION; REGRESSION ANALYSIS;

EID: 73949113489     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neunet.2009.07.001     Document Type: Article

References (36)

1. Bae K., and Mallick B. Gene selection using a two-level hierarchical Bayesian model. Bioinformatics 20 18 (2004) 3423-3430
2. Billings S., Chen S., and Backhouse R. The identification of linear and nonlinear models of a turbocharged automotive diesel engine. Mechanical Systems and Signal Processing 3 2 (1989) 123-142
3. Chen S. Local regularization assisted orthogonal least squares regression. NeuroComputing 69 (2006) 559-585
4. Chen S., Hong X., and Harris C. An orthogonal forward regression technique for sparse kernel density estimation. Neurocomputing 71 (2008) 931-943
5. Coleman T.F., and Hulbert L.A. A direct active set algorithm for large sparse quadratic programs with simple bounds. Mathematical Programming 45 1-3 (1989) 373-406
6. Daubechies I., Defrise M., and DeMol C. An iterative thresholding algorithm for linear inverse problems with a sparsity constraint. Communications on Pure and Applied Mathematics 57 11 (2004) 1413-1457
7. Drezet, P., & Harrison, R. (1998). Support vector machines for system identification. In Proceeding of UKACC int. conf. control'98 (pp. 688-692)
8. Dror G., Sorek R., and Shamir S. Accurate identification of alternatively spliced exons using support vector machine. Bioinformatics 21 7 (2005) 897-901
9. Efron B., Hastie T., Johnstone I., and Tibshirani R. Least angle regression. Annals of Statistics 32 (2004) 407-451
10. Figueiredo M., Nowak R., and Wright S. Gradient projection for sparse reconstruction: Application to compressed sensing and other inverse problems. IEEE Journal of Selected Topics in Signal Processing 1 4 (2007) 586-597
11. Friedman J. Multivariable adaptive regression splines. The Annals of Statistics 19 1 (1991) 1-57
12. Fu W. Penalized regression: The Bridge versus the LASSO. Journal of Computational and Graphical Statistics 7 (1998) 397-416
13. Gao J. Robust L1 principal component analysis and its Bayesian variational inference. Neural Computation 20 (2008) 555-572
14. Gao J., Antolovich M., and Kwan P.H. L1 LASSO and its Bayesian inference. In: Wobcke W., and Zhang M. (Eds). Lecture notes in computer science Vol. 5360 (2008) 318-324
15. Gao J., Gunn S., and Kandola J. Adapting kernels by variational approach in SVM. In: McKay B., and Slaney J. (Eds). Lecture notes on artificial intelligence Vol. 2557 (2002), Springer, Berlin 395-406
16. Gao J., Harris C., and Gunn S. On a class of support vector kernels based on frames in function hilbert spaces. Neural Computation 13 9 (2001) 1975-1994
17. Gao J., Shi D., and Liu X. Critical vector learning to construct sparse kernel regression modelling. Neural Networks 20 7 (2007) 791-798
18. Gao J., and Xu R. Mixture of the robust L1 distributions and its applications. Lecture notes in artificial intelligence Vol. 4830 (2007) 26-35
19. Hastie T., Tibshirani R., and Friedman J. The elements of statistical learning: Data mining, inference, and prediction. Springer series in statistics (2001), Springer, Berlin
20. Hidalgo H., Sosa S., and Gómez-Trevino E. Application of the kernel method to the inverse geosounding problem. Neural Networks 16 (2003) 349-353
21. MacKay D. Bayesian interpolation. Neural Computation 4 3 (1992) 415-447
22. Mardia K., Kent J., and Bibby J. Multivariate analysis. Probability and mathematical statistics (1979), Academic Press
23. Meinshausena N. Relaxed LASSO. Computational Statistics & Data Analysis 52 1 (2007) 374-393
24. Osborne M., Presnell B., and Turlach B. On the LASSO and its dual. Journal of Computational and Graphical Statistics 9 2 (2000) 319-337
25. Park T., and Casella G. The Bayesian LASSO. Journal of the American Statistical Association 103 482 (2008) 681-686
26. Perkins S., Lacker K., and Theiler J. Grafting: Fast, incremental feature selection by gradient descent in function space. Journal of Machine Learning Research 3 (2003) 1333-1356
27. Pontil M., Mukherjee S., and Girosi F. On the noise model of support vector machine regression. A.I. Memo Vol. 1651 (1998), AI Laboratory, MIT
28. Roth V. The generalized LASSO. IEEE Transactions on Neural Networks 15 1 (2004) 16-28
29. Schmidt M., Fung F., and Rosales R. Fast optimization methods for L1 regularization: A comparative study and two new approaches. Lecture Notes in Computer Science 4701 (2007) 286-297
30. Schölkopf B., and Smola A. Learning with kernels (2002), The MIT Press, Cambridge, MA
31. Suykens J., Gestel T., DeBrabanter J., DeMoor B., and Vandewalle J. Least square support vector machines (2002), World Scientific, Singapore
32. Tibshirani R. Regression shrinkage and selection via the LASSO. Journal of the Royal Statistical Society B 58 (1996) 267-288
33. Tipping M. Sparse Bayesian learning and the relevance vector machine. Journal of Machine Learning Research 1 (2001) 211-244
34. Vapnik V. Statistical learning theory (1998), Wiley, New York
35. Wang G., Yeung D.Y., and Lochovsky F. The kernel path in kernelized LASSO. International conference on artificial intelligence and statistics (2007), MIT Press, San Juan, Puerto Rico 580-587
36. Zhang N., and Zeng S. A gradient descending solution to the LASSO criteria. Proceedings of 2005 IEEE international joint conference on neural networks Vol. 5 (2005), IEEE Computer Soceity 2942-2947