Fast, exact model selection and permutation testing for ℓ2-regularized logistic regression

Journal of Machine Learning Research

Volumn 22, Issue , 2012, Pages 246-254

  Conroy, Bryan ^a   Sajda, Paul ^a  

^a Och Spine at New York Presbyterian Hospitals   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; ITERATIVE METHODS; LEARNING SYSTEMS;

CLASSIFICATION METHODS; COMPLEXITY REDUCTION; COMPUTATIONAL PROBLEM; ITERATIVE TECHNIQUE; LOGISTIC REGRESSIONS; PERMUTATION TESTING; REGULARIZED LEAST SQUARES; STATISTICAL SIGNIFICANCE;

REGRESSION ANALYSIS;

EID: 84896548020     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (20)

1. M. Belkin, I. Matveeva and P. Niyogi (2004). Reg-ularization and Semi-supervised Learning on Large Graphs. In J. Shawe-Taylor, Y. Singer (eds.), Learning Theory, 17th Annual Conference on Learning Theory, COLT. Banff, Canada.
2. D. Bohning and B.G. Lindsay (1988). Monotonicity of Quadratic Approximation Algorithms. Annals Institute of Statistical Mathematics 40(4): 641-663.
3. G.C. Cawley and N.L.C. Talbot (2004). Efficient model selection for kernel logistic regression. In Proceedings of the 17th International Conference on Pattern Recognition (ICPR). Cambridge, UK.
4. J. Friedman, T. Hastie and R. Tibshirani (2010). Reg-ularization Paths for Generalized Linear Models via Coordinate Descent. Journal of Statistical Software 33(1):1-22.
5. A. Genkin, D.D. Lewis and D. Madigan (2007). Large-Scale Bayesian Logistic Regression for Text Categorization. Technometrics 49(3): 291-304.
6. R.I. Goldman, C.Y. Wei, M.G. Philiastides, A.D. Ger-son, D. Friedman, T.R. Brown and P. Sajda (2009). Single-trial discrimination for integrating simultaneous EEG and fMRI: Identifying cortical areas contributing to trial-to-trial variability in the auditory oddball task. NeuroImage 47(1) 136-147.
7. G.H. Golub and C.F. Van Loan (1996). Matrix Computations. Baltimore, MD: Johns Hopkins University Press.
8. L.A. Hageman and D.M. Young (1981). Applied Iterative Methods. Mineola, NY: Dover Publications.
9. R.A. Horn and C.R. Johnson (1990). Matrix Analysis. New York, NY: Cambridge University Press.
10. D.W. Hosmer and S. Lemeshow (2000). Applied Logistic Regression. USA: John Wiley & Sons, Inc.
11. P.R. Komarek and A.W. Moore (2003). Fast Robust Logistic Regression for Large Sparse Datasets with Binary Outputs. In C.M. Bishop, B.J. Frey (eds.), Proceedings of the 9th International Workshop on Artificial Intelligence and Statistics (AISTATS). Key West, Florida.
12. P. Komarek and A. Moore (2005). Making Logistic Regression A Core Data Mining Tool: A Practical Investigation of Accuracy, Speed, and Simplicity. CMU Tech. Report CMU-RI-TR-05-27, Robotics Institute, Carnegie Mellon University.
13. R. Kohavi (1995). A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection. In Proceedings of the 14th International Joint Conference on Artificial Intelligence. Montreal, Quebec.
14. B. Krishnapuram, L. Carin, M.A.T. Figueiredo and A.J. Hartemink (2005). Sparse Multinomial Logistic Regression: Fast Algorithms and Generalization Bounds. IEEE Transactions on Pattern Analysis and Machine Intelligence 27(6):957-968.
15. Y. LeCun, L. Bottou, Y. Bengio and P. Haffner (1998). Gradient-based learning applied to document recognition. Proceedings of the IEEE 86(11):2278-2324.
16. M. Ojala and G. C. Garriga (2010). Permutation Tests for Studying Classifier Performance. Journal of Machine Learning Research 11:1833-1863.
17. R.M. Rifkin and R.A. Lippert (2007). Notes on Regularized Least Squares. MIT Computer Science and Artificial Intelligence Laboratory (CSAIL) Technical Report.
18. D.M. Young (1971). Iterative solution of large linear systems. Mineola, NY: Dover Publications.
19. T. Zhang and F. Oles (2001). Text Categorization Based on Regularized Linear Classifiers. Information Retrieval 4:5-31.
20. T. Zhang (2003). Leave-One-Out Bounds for Kernel Methods. Neural Computation 15(6):1397-1437.