Nearest neighbor ensembles for functional data with interpretable feature selection

Chemometrics and Intelligent Laboratory Systems

Volumn 146, Issue , 2015, Pages 186-197

  Fuchs, Karen ^a,c   Gertheiss, Jan ^b   Tutz, Gerhard ^c  

^a SIEMENS AG   (Germany)

^b UNIVERSITY OF GÖTTINGEN   (Germany)

^c UNIVERSITY OF MUNICH   (Germany)

Author keywords

Cell chip data; Ensemble method; Functional classification; Functional data analysis; Nearest neighbor method; Variable selection

Indexed keywords

ACCURACY; ALGORITHM; ARTICLE; CALCULATION; DATA ANALYSIS; DISCRIMINANT ANALYSIS; K NEAREST NEIGHBOR; LINEAR SYSTEM; MATHEMATICAL ANALYSIS; MATHEMATICAL MODEL; PREDICTION; PRIORITY JOURNAL; PROBABILITY; SCORING SYSTEM; SIMULATION; SUPPORT VECTOR MACHINE; WATER QUALITY;

EID: 84930684442     PISSN: 01697439     EISSN: 18733239     Source Type: Journal    
DOI: 10.1016/j.chemolab.2015.04.019     Document Type: Article

References (55)

1. Fix E., Hodges J.L. Discriminatory analysis-nonparametric discrimination: consistency properties. Tech. rep. 1951, US Air Force School of Aviation Medicine, Randolph Field Texas.
2. Alonso-Salces R.M., Guyot S., Herrero C., Berrueta L.A., Drilleau J.-F., Gallo B., Vicente F. Chemometric classification of Basque and French ciders based on their total polyphenol contents and CIELab parameters. Food Chem. 2005, 91:91-98.
3. Japon-Lujan R., Ruiz-Jiménez J., de Castro M.D.L. Discrimination and classification of olive tree varieties and cultivation zones by biophenol contents. J. Agric. Food Chem. 2006, 54:9706-9712.
4. Lukasiak B.M., Zomer S., Brereton R.G., Faria R., Duncan J.C. Pattern recognition and feature selection for the discrimination between grades of commercial plastics. Chemom. Intell. Lab. Syst. 2007, 87:18-25.
5. Kruzlicova D., Mocak J., Katsoyannos E., Lankmayr E. Classification and characterization of olive oils by UV-Vis absorption spectrometry and sensorial analysis. J. Food Nutr. Res. 2008, 47(4):181-188.
6. Fdez-Ortiz de Vallejuelo S., Arana G., de Diego A., Madariaga J.M. Pattern recognition and classification of sediments according to their metal content using chemometric tools. A case study: the estuary of Nerbioi-Ibaizabal River, Bilbao, Basque Country. Chemosphere 2011, 85:1347-1352.
7. Berrueta L.A., Alonso-Salces R.M., Héberger K. Supervised pattern recognition in food analysis. J. Chromatogr. A 2007, 1158:196-214.
8. Melvin I., Weston J., Leslie C.S., Noble W.S. Combining classifiers for improved classification of proteins from sequence or structure. BMC Bioinforma. 2008, 9:389-397.
9. Wong C., Li Y., Lee C., Huang C.H. Ensemble learning algorithms for classification of mtDNA into haplogroups. Brief. Bioinform. 2010, 12(1):1-9.
10. Przewozniczek M., Walkowiak K., Wozniak M. Optimizing distributed computing systems for k-nearest neighbours classifiers - evolutionary approach. Log. J. IGPL 2011, 19(2):357-372.
11. Nava R., Escalante-Ramirez B., Cristóbal G., Estépar R.S.J. Extended Gabor approach applied to classification of emphysematous patterns in computed tomography. Med. Biol. Eng. Comput. 2014, 52:393-403.
12. Hastie T., Tibshirani R., Friedman J. The Elements of Statistical Learning 2011, Springer Science and Business Media, New York.
13. Gertheiss J., Tutz G. Feature selection and weighting by nearest neighbor ensembles. Chemom. Intell. Lab. Syst. 2009, 99:30-38.
14. Ji J., Zhao Q. A hybrid SVM based on nearest neighbor rule. Int. J. Wavelets Multiresolution Inf. Process. 2013, 11(6).
15. Hayat M., Tahir M., Khan S.A. Prediction of protein structure classes using hybrid space of multi-profile Bayes and bi-gram probability feature spaces. J. Theor. Biol. 2014, 346:8-15.
16. Bischl B., Schiffner J., Weihs C. Benchmarking local classification methods. Comput. Stat. 2013, 28:2599-2619.
17. Ramsay J., Silverman B. Functional Data Analysis 2005, New York, Springer.
18. Wolpert D.H. Stacked generalization. Neural Netw. 1992, 5:241-259.
19. LeBlanc M., Tibshirani R. Combining estimates in regression and classification. J. Am. Stat. Assoc. 1996, 91(436):1641-1650.
20. van der Laan M., Dudoit S. Unified cross-validation methodology for selection among estimators and a general cross-validated adaptive epsilon-net estimator: finite sample oracle inequalities and examples, Paper 130 2003, University of California, Berkeley, Division of Biostatistics.
21. Goldsmith J., Scheipl F. Estimator selection and combination in scalar-on-function regression. Comput. Stat. Data Anal. 2014, 70:362-372.
22. Müller H.G., Stadtmüller U. Generalized functional linear models. Ann. Stat. 2005, 33(2):774-805.
23. Ferraty F., Vieu P. Nonparametric Functional Data Analysis 2006, Springer Science and Business Media, New York.
24. Alonso A.M., Casado D., Romo J. Supervised classification for functional data: a weighted distance approach. Comput. Stat. Data Anal. 2012, 56:2334-2346.
25. Soetaert K., den Meersche K.V., van Oevelen D. limSolve: solving: linear inverse models. R package version 1.5.5 2013.
26. Di C., Crainiceanu C.M., Caffo B.S., Punjabi N.M. Multilevel functional principal component analysis. Ann. Appl. Stat. 2009, 3(1):458-488.
27. Goldsmith J., Greven S., Crainiceanu C. Corrected confidence bands for functional data using principal components. Biometrics 2013, 69(1):41-51.
28. Hall P., Park B.U., Samworth R.J. Choice of neighbor order in nearest-neighbor classification. Ann. Stat. 2008, 36(5):2135-2152.
29. Brier G.W. Verification of forecasts expressed in terms of probability. Mon. Weather Rev. 1950, 78(1):1-3.
30. Gneiting T., Raftery A.E. Strictly proper scoring rules prediction, and estimation. J. Am. Stat. Assoc. 2007, 102(477):359-378.
31. Selten R. Axiomatic characterization of the quadratic scoring rule. Exp. Econ. 1998, 1:43-62.
32. Tibshirani R. Regression shrinkage and selection via the Lasso. J. R. Stat. Soc. Ser. B 1996, 58(1):267-288.
33. R.Core Team R: A language and environment for statistical computing 2014, R Foundation for Statistical Computing, Vienna, Austria, (URL http://www.R-project.org).
34. Epifanio I. Shape descriptors for classification of functional data. Technometrics 2008, 50(3):284-294.
35. Rossi F., Villa N. Support vector machine for functional data classification. Neurocomputing 2006, 69:730-742.
36. James G.M. Functional linear discriminant analysis for irregularly sampled curves. J. R. Stat. Soc. B 2001, 63(3):533-550.
37. Ramsay J.O., Silverman B.W. Applied Functional Data Analysis 2002, Springer-Verlag Inc., New York.
38. C. Crainiceanu, P. Reiss, J. Goldsmith, L. Huang, L. Huo, F. Scheipl, B. Swihart, S. Greven, J. Harezlak, M. G. Kundu, Y. Zhao, M. McLean, L. Xiao, refund: Regression with functional data, R package version 0.1-9, 2013.
39. Ferraty F., Vieu P. Curves discrimination: a nonparametric functional approach. Comput. Stat. Data Anal. 2003, 44:161-173.
40. Reiss P.T., Ogden R.T. Smoothing parameter selection for a class of semiparametric linear models. J. R. Stat. Soc. B 2009, 71(2):505-523.
41. Wood S. Fast stable restricted maximum likelihood and marginal likelihood estimation of semiparametric generalized linear models. J. R. Stat. Soc. B 2011, 73(1):3-36.
42. Gertheiss J., Maity A., Staicu A.-M. Variable selection in generalized functional linear models. Stat. 2013, 2:86-101.
43. S. Wood, mgcv: Mixed Gam Computation Vehicle with GCV/ AIC/ REML Smoothness Estimation, R package version 1.8-4, 2014.
44. D. Meyer, E. Dimitriadou, K. Hornik, A. Weingessel, F. Leisch, C.-C. Chang, C.-C. Lin, e1071: Misc Function of the Department of Statistic (e1071), TU Wien, R package version 0.1-9, 2013.
45. L. Breiman, A. Cutler, A. Liaw, M. Wiener, random Forest: Breiman and Cutler's random forest for classification and regression, R package version 4.6-7, 2012.
46. B. Ripley, B. Venables, D. M. Bates, K. Hornik, A. Gebhardt, D. Firth, MASS Support Functions and Datasets for Venables and Ripley's MASS, R package version 7.3-30, 2014.
47. Hastie T., Buja A., Tibshirani R. Penalized discriminant analysis. Ann. Stat. 1995, 23(1):73-102.
48. T. Hastie, R. Tibshirani, F. Leisch, K. Hornik, B. D. Ripley, mda: mixture and flexible discriminant analysis, R package version 0.4-4.
49. T. P. Jurka, Y. Tsuruoka, maxent Low - memory Multinomial Logistic Regression with Support for Text Classification, R package version 1.3.3.1, 2013.
50. Breiman L., Friedman J., Olshen R., Stone C. Classification and Regression Trees 1984, New York, Chapman & Hall.
51. Bohrn U., Stütz E., Fuchs K., Fleischer M., Schöning M.J., Wagner P. Monitoring of irritant gas using a whole-cell-based sensor system. Sensor Actuator B Chem. 2012, 175:208-217.
52. Kubisch R., Bohrn U., Fleischer M., Stütz E. Cell-based sensor system using L6 cells for broad band continuous pollutant monitoring in aquatic environments. Sensors 2012, 12(3):3370-3393.
53. Thedinga E., Kob A., Holst H., Keuer A., Drechsler S., Niendorf R., Baumann W., Freund I., Lehmann M., Ehret R. Online monitoring of cell metabolism for studying pharmacodynamic effects. Toxicol. Appl. Pharmacol. 2007, 220:33-44.
54. Ceriotti L., Kob A., Drechsler S., Ponti J., Thedinga E., Colpo P., Ehret R., Rossi F. Online monitoring of BALB/3T3 metabolism and adhesion with multiparametric chip-based system. Anal. Biochem. 2007, 371:92-104.
55. Bohrn U., Mucha A., Werner C., Trattner B., Bäcker M., Krumbe C., Schienle M., Stütz E., Schmitt-Landsiedel D., Fleischer M., Wagner P., Schöning M. A critical comparison of cell-based sensor systems for the detection of Cr(VI) in aquatic environment. Sensors Actuators B 2013, 182:58-65.