Feature selection and weighting by nearest neighbor ensembles

Chemometrics and Intelligent Laboratory Systems

Volumn 99, Issue 1, 2009, Pages 30-38

  Gertheiss, Jan ^a   Tutz, Gerhard ^a  

^a UNIVERSITY OF MUNICH   (Germany)

Author keywords

Classification; Ensemble methods; Nearest neighbor methods; Variable selection

Indexed keywords

ANALYTIC METHOD; ARTICLE; CLASSIFICATION; CLASSIFIER; COVARIANCE; DISCRIMINANT ANALYSIS; MATHEMATICAL COMPUTING; NEAREST NEIGHBOR ENSEMBLE; NOISE; PREDICTION; PRIORITY JOURNAL; PROBABILITY; STATISTICAL ANALYSIS;

EID: 70349808005     PISSN: 01697439     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.chemolab.2009.07.004     Document Type: Article

References (33)

1. Fix E., and Hodges J.L. Discriminatory Analysis - Nonparametric Discrimination: Consistency Properties (1951), US Air Force School of Aviation Medicine, Randolph Field Texas
2. Lukasiak B.M., Zomer S., Brereton R.G., Faria R., and Duncan J.C. Pattern recognition and feature selection for the discrimination between grades of commercial plastics. Chemometrics and Intelligent Laboratory Systems 87 (2007) 18-25
3. Japon-Lujan R., Ruiz-Jimenez J., and Luque De Castro M.D. Discrimination and classification of olive tree varieties and cultivation zones by biophenol contents. Journal of Agricultural and Food Chemistry 54 (2006) 9706-9712
4. Forina M., Armanino C., Lanteri S., and Tiscornia E. Classifiaction of olive oils from their fatty acid composition. In: Martens H., and Russwurm H. (Eds). Food Research and Data Analysis. Proceedings from the IUFoST Symposium (1982), Applied Science Publishers LTD, London/New York 189-214
5. Kowalski B.R., and Bender C.F. The k-nearest neighbor classification rule (pattern recognition) applied to nuclear magnetic resonance spectral interpretation. Analytical Chemistry 44 (1972) 1405-1411
6. Cover T.M., and Hart P.E. Nearest neighbor pattern classification. IEEE Transactions on Information Theory 13 (1967) 21-27
7. Ripley B.D. Pattern Recognition and Neural Networks (1996), University Press, Cambridge
8. Silverman B.W., and Jones M.C. Commentary on Fix and Hodges (1951): An important contribution to nonparametric discriminant analysis and density estimation. International Statistical Review 57 (1989) 233-238
9. Hechenbichler K., and Schliep K. Weighted k-nearest-neighbor techniques and ordinal classification. SFB 386 Discussion Paper 399 (2004), Ludwig-Maximilians-Universität München
10. Domeniconi C., and Yan B. Nearest neighbor ensemble. Proceedings of the 17th International Conference on Pattern Recognition. Cambridge, UK (2004)
11. Yankov D., DeCoste D., and Keogh E. Ensembles of nearest neighbor forecasts. In: Fürnkranz J., Scheffer T., and Spiliopoulou M. (Eds). Lecture Notes in Computer Science. Proceedings of the 17th European Conference on Machine Learning (2006), Springer, Berlin/Heidelberg 545-556
12. Le Cessie S., and van Houwelingen J.C. Ridge estimators in logistic regression. Applied Statistics 41 (1992) 191-201
13. Selten R. Axiomatic characterization of the quadratic scoring rule. Experimental Economics 1 (1998) 43-62
14. Brier G.W. Verification of forecasts expressed in terms of probability. Monthly Weather Review 78 (1950) 1-3
15. Turlach B.A. quadprog: Functions to solve Quadratic Programming Problems (2007) R package version 1.4-11, S original by Berwin A. Turlach, R port by Andreas Weingessel
16. Karatzoglou A., Smola A., Hornik K., and Zeileis A. kernlab - an S4 package for kernel methods in R. Journal of Statistical Software 11 9 (2004) 1-20
17. Fan J., and Li R. Variable selection via nonconcave penalized likelihood and its oracle properties. Journal of the American Statistical Association 96 (2001) 1348-1360
18. Hastie T., Tibshirani R., and Friedman J.H. The Elements of Statistical Learning (2001), Springer, New York
19. Tibshirani R. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society B 58 (1996) 267-288
20. Efron B., Hastie T., Johnstone I., and Tibshirani R. Least angle regression. Annals of Statistics 32 (2004) 407-499
21. Kudo M., and Sklansky J. Comparison of algorithms that selected features for pattern classifiers. Pattern Recognition 33 (2000) 25-41
22. Breiman L., Friedman J.H., Olshen R.A., and Stone J.C. Classification and Regression Trees (1984), Wadsworth, Monterey, CA
23. Breiman L. Random forests. Machine Learning 45 (2001) 5-32
24. Venables W.N., and Ripley B.D. Modern Applied Statistics with S. fourth edition (2002), Springer, New York
25. Therneau T.M., and Atkinson B. rpart: Recursive Partitioning (2007) R package version 3.1-36, R port by Brian Ripley
26. Liaw A., and Wiener M. Classification and regression by random forest. R News 2 3 (2002) 18-22
27. R Development Core Team. R: a Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria, 2009. ISBN 3-900051-07-0.
28. Hastie T., and Tibshirani R. Discriminant adaptive nearest neighbor classification. IEEE Transactions on Pattern Analysis and Machine Intelligence 18 (1996) 607-616
29. Friedman J.H. Flexible metric nearest neighbor classification (1994), Stanford University, Technical report
30. Gertheiss J., and Tutz G. Variable scaling and nearest neighbor methods. Journal of Chemometrics 23 (2009) 149-151
31. Leisch F., and Dimitriadou E. mlbench: machine learning benchmark problems (2007) R package version 1.1-3
32. Newman D.J., Hettich S., Blake C.L., and Merz C.J. UCI repository of machine learning databases (1998), University of California, Department of Information and Computer Science, Irvine, CA
33. Ferraty F., and Vieu P. Nonparametric Functional Data Analysis (2006), Springer, New York