Online feature selection algorithm with bayesian ℓ 1 regularization

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 5476 LNAI, Issue , 2009, Pages 401-413

  Cai, Yunpeng ^a   Sun, Yijun ^b   Li, Jian ^a   Goodison, Steve ^c  

^a Department of Electrical and Computer Engineering ^*

^b UNIVERSITY OF FLORIDA   (United States)

^c UNIVERSITY OF FLORIDA COLLEGE OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANALYTIC SOLUTION; AUTOMATIC ESTIMATION; BATCH LEARNING; BAYESIAN; BAYESIAN LEARNING; BENCHMARK DATA; FEATURE SELECTION ALGORITHM; LOCAL LEARNING; NONLINEAR PROBLEMS; NUMERICAL EXPERIMENTS; ONLINE FEATURE SELECTION; ONLINE LEARNING; REGULARIZATION PARAMETERS; TRAINING DATA; VARIATIONAL METHODS;

BAYESIAN NETWORKS; EDUCATION; FEATURE EXTRACTION; INTERNET; LINEARIZATION; MINING; PARAMETER ESTIMATION; SET THEORY;

LEARNING ALGORITHMS;

EID: 67650661623     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-01307-2_37     Document Type: Conference Paper

References (21)

1. Lafferty, J., Wasserman, L.: Challenges in statistical machine learning. Stat. Sinica 16, 307-322 (2006) (Pubitemid 44085505)
2. Guyon, I., Elisseeff, A.: An introduction to variable and feature selection. J. Mach. Learn. Res 3, 1157-1182 (2003)
3. Pudil, P., Novovicova, J.: Novel methods for subset selection with respect to problem knowledge. IEEE Intell. Sys. 13(2), 66-74 (1998)
4. Gilad-Bachrach, R., Navot, A., Tishby, N.: Margin based feature selection-theory and algorithms. In: Proc. 21st Int. Conf. Mach. Learn., pp. 43-50 (2004)
5. Sun, Y., Todorovic, S., Goodison, S.: A feature selection algorithm capable of handling extre-mely large data dimensionality. In: Proc. 8th SIAM Conf. Data Mining, pp. 530-540 (2008)
6. Collins, R.T., Liu, Y., Leordeanu, M.: Online selection of discriminative tracking features. IEEE Trans. Pattern Anal. Mach. Intell. 27(10), 1631-1643 (2005) (Pubitemid 41555407)
7. Jiang, W., Er, G., Dai, Q., Gu, J.: Similarity-based online feature selection in content-based image retrieval. IEEE Trans. Image Proc. 15(3), 702-712 (2006) (Pubitemid 43257568)
8. Kira, K., Rendell, L.: A practical approach to feature selection. In: Proc. 9th Int. Conf.Mach. Learn., pp. 249-256 (1992)
9. Vapnik, V.: Statistical Learning Theory. Wiley, Chichester (1998)
10. Dempster, A., Laird, N., Rubin, D.: Maximum likelihood from incomplete data via the EM algorithm. J. R. Stat. Soc. Ser. B 39(1), 1-38 (1977)
11. Sun, Y., Goodison, S., Li, J., Liu, L., Farmerie,W.: Improved breast cancer prognosis through the combination of clinical and genetic markers. Bioinformatics 23(1), 30-37 (2007) (Pubitemid 46017852)
12. Ng, A.Y.: Feature selection, L1 vs. L2 regularization, and rotational invariance. In: Proc. 21st Int. Conf. Mach. Learn., pp. 78-86 (2004)
13. Tibshirani, R.: Regression shrinkage and selection via the lasso. J. R. Stat. Soc. Ser. B 58(1), 267-288 (1996)
14. Kress, R.: Numerical Analysis. Springer, Heidelberg (1998)
15. Spall, J.C.: Introduction to Stochastic Search and Optimization: Estimation, Simulation and Control. John Wiley, Chichester (2003)
16. Bishop, C.M.: Pattern Recognition and Machine Learning. Springer, Heidelberg (2006)
17. MacKay, D.J.: The evidence framework applied to classification networks. Neural Comp. 4(5), 720-736 (1992)
18. Cawley, G.C., Talbot, N.L.: The evidence framework applied to sparse kernel logistic regression. Neurocomputing 64, 119-135 (2005) (Pubitemid 40425315)
19. MacKay, D.J.: Bayesian interpolation. Neural Comp. 4(3), 415-447 (1992)
20. Jaakkola, T.S., Jordan, M.I.: Bayesian parameter estimation via variational methods. Stat. and Comp. 10, 25-37 (2000)
21. Sun, Y.: Iterative RELIEF for feature weighting: Algorithms, theories, and applications. IEEE Trans. Pattern Anal. Mach. Intell. 29, 1035-1051 (2007) (Pubitemid 46667414)