Bayesian error estimation and model selection in sparse logistic regression

IEEE International Workshop on Machine Learning for Signal Processing, MLSP

Volumn , Issue , 2013, Pages

  Huttunen, Heikki ^a   Manninen, Tapio ^a   Tohka, Jussi ^a  

^a TAMPERE UNIVERSITY OF TECHNOLOGY   (Finland)

Author keywords

Bayesian MMSE estimator; Linear classifiers; Logistic regression; Regularization

Indexed keywords

BAYESIAN ERROR ESTIMATION; EMBEDDED FEATURE SELECTIONS; LINEAR CLASSIFIERS; LOGISTIC REGRESSION MODELS; LOGISTIC REGRESSIONS; MMSE ESTIMATORS; REGULARIZATION; REGULARIZATION PARAMETERS;

ERROR ANALYSIS; LEARNING SYSTEMS; SIGNAL PROCESSING;

REGRESSION ANALYSIS;

EID: 84893264345     PISSN: 21610363     EISSN: 21610371     Source Type: Conference Proceeding    
DOI: 10.1109/MLSP.2013.6661987     Document Type: Conference Paper

References (22)

1. Yvan Saeys, Iaki Inza, and Pedro Larraaga, "A review of feature selection techniques in bioinformatics, " Bioinformatics, vol. 23, pp. 2507-17, 2007.
2. Francisco Pereira, Tom Mitchell, and Matthew Botvinick, "Machine learning classifiers and fMRI: A tutorial overview, " NeuroImage, vol. 45, no. Suppl 1, pp. S199 - S209, 2009.
3. Robert Tibshirani, "Regression shrinkage and selection via the LASSO, " J. R. Stat. Soc., Series B, vol. 58, pp. 267-288, 1994.
4. Balaji Krishnapuram, Lawrence Carin, Mario AT Figueiredo, and Alexander J Hartemink, "Sparse multinomial logistic regression: Fast algorithms and generalization bounds, " IEEE Trans Patt Anal Mach Intell, vol. 27, no. 6, pp. 957-968, 2005.
5. Jerome H. Friedman, Trevor Hastie, and Rob Tibshirani, "Regularization paths for generalized linear models via coordinate descent, " Journal of Statistical Software, vol. 33, no. 1, pp. 1-22, 2010.
6. Edward R Dougherty, Chao Sima, Blaise Hanczar, Ulisses M Braga-Neto, et al., "Performance of error estimators for classification, " Current Bioinformatics, vol. 5, no. 1, pp. 53, 2010.
7. Ned Glick, "Additive estimators for probabilities of correct classification, " Pattern recognition, vol. 10, no. 3, pp. 211-222, 1978.
8. Hirotogu Akaike, "Information theory and an extension of the maximum likelihood principle, " in Selected Papers of Hirotugu Akaike, pp. 199-213. Springer, 1998.
9. Gideon Schwarz, "Estimating the dimension of a model, " The annals of statistics, vol. 6, no. 2, pp. 461- 464, 1978.
10. Jiahua Chen and Zehua Chen, "Extended BIC for smalln-large-P sparse GLM, " Statistica Sinica, vol. 22, no. 2, pp. 555, 2012.
11. Lori A Dalton and Edward R Dougherty, "Bayesian minimum mean-square error estimation for classification error-part I: Definition and the Bayesian MMSE error estimator for discrete classification, " IEEE Trans. Signal Process, vol. 59, no. 1, pp. 115-129, 2011.
12. Lori A Dalton and Edward R Dougherty, "Bayesian minimum mean-square error estimation for classification error-part II: The Bayesian MMSE error estimator for linear classification of Gaussian distributions, " IEEE Trans. Signal Process, vol. 59, no. 1, pp. 130-144, 2011.
13. Bradley Efron, "The efficiency of logistic regression compared to normal discriminant analysis, " J. Amer. Stat. Assoc., vol. 70, no. 352, pp. 892-898, 1975.
14. Christopher M. Bishop, Pattern Recognition and Machine Learning, Springer-Verlag New York, Inc., Secaucus, NJ, USA, 2006.
15. Pavel K řížek, Josef Kittler, and Václav Hlaváč, "Improving stability of feature selection methods, " in Computer Analysis of Images and Patterns. Springer, 2007, pp. 929-936.
16. Thomas P Conrads, Vincent A Fusaro, Sally Ross, Don Johann, Vinodh Rajapakse, Ben A Hitt, Seth M Steinberg, Elise C Kohn, David A Fishman, Gordon Whitely, et al., "High-resolution serum proteomic features for ovarian cancer detection., " Endocrine-Related Cancer, vol. 11, no. 2, pp. 163-178, 2004.
17. Sarunas J Raudys and Anil K. Jain, "Small sample size effects in statistical pattern recognition: Recommendations for practitioners, " IEEE Trans Patt Anal Mach Intell, vol. 13, no. 3, pp. 252-264, 1991.
18. Geoffrey J McLachlan, "The bias of the apparent error rate in discriminant analysis, " Biometrika, vol. 63, no. 2, pp. 239-244, 1976.
19. Arto Klami, Pavan Ramkumar, Seppo Virtanen, Lauri Parkkonen, Riitta Hari, and Samuel Kaski, "ICANN/PASCAL2 Challenge: MEG Mind-Reading -Overview and Results, " 2011.
20. Heikki Huttunen, Tapio Manninen, Jukka-Pekka Kauppi, and Jussi Tohka, "Mind reading with regularized multinomial logistic regression, " Machine Vision and Applications, vol. 24, no. 6, pp. 1311-1325, 2013.
21. Hui Zou and Trevor Hastie, "Regularization and variable selection via the elastic net, " J. R. Stat. Soc.: Series B, vol. 67, no. 2, pp. 301-320, 2005.
22. François Caron and Arnaud Doucet, "Sparse Bayesian nonparametric regression, " in Proceedings of the 25th International Conference on Machine learning. ACM, 2008, pp. 88-95.