Validation of soft classification models using partial class memberships: An extended concept of sensitivity & co. applied to grading of astrocytoma tissues

Chemometrics and Intelligent Laboratory Systems

Volumn 122, Issue , 2013, Pages 12-22

  Beleites, Claudia ^a,b   Salzer, Reiner ^c   Sergo, Valter ^a  

^a UNIVERSITY OF TRIESTE   (Italy)

^b LEIBNIZ INSTITUTE OF PHOTONIC TECHNOLOGY   (Germany)

^c DRESDEN UNIVERSITY OF TECHNOLOGY   (Germany)

Author keywords

Biomedical spectroscopy; Borderline cases ambiguous reference; Classifier validation; Partial class membership; Soft classification

Indexed keywords

ARTICLE; ASTROCYTOMA; CANCER GRADING; CANCER TISSUE; CHEMOMETRICS; CLASSIFICATION; CLASSIFIER; CONTROLLED STUDY; DIAGNOSTIC TEST ACCURACY STUDY; ERROR; HUMAN; HUMAN TISSUE; MAJOR CLINICAL STUDY; MEAN ABSOLUTE ERROR; PARTIAL CLASS MEMBRESHIP; PREDICTION; PREDICTIVE VALUE; PRIORITY JOURNAL; ROOT MEAN SQUARED ERROR; SAMPLE; SENSITIVITY AND SPECIFICITY; SOFT CLASSIFICATION; TUMOR CLASSIFICATION; VALIDATION PROCESS;

EID: 84873191832     PISSN: 01697439     EISSN: 18733239     Source Type: Journal    
DOI: 10.1016/j.chemolab.2012.12.003     Document Type: Article

References (51)

1. Esbensen K.H., Geladi P. Principles of proper validation: use and abuse of re-sampling for validation. Journal of Chemometrics 2010, 24(3-4):168-187. (URL http://dx.doi.org/10.1002/cem.1310).
2. Beleites C., Geiger K., Kirsch M., Sobottka S.B., Schackert G., Salzer R. Raman spectroscopic grading of astrocytoma tissues: using soft reference information. Analytical and Bioanalytical Chemistry 2011, 400(9):2801-2816. (URL http://dx.doi.org/10.1007/s00216-011-4985-4). 10.1007/s00216-011-4985-4.
3. VandenBerg S.R. Current diagnostic concepts of astrocytic tumors. Journal of Neuropathology and Experimental Neurology 1992, 51(6):644-657.
4. Louis D.N., Ohgaki H., Wiestler O.D., Cavenee W.K., Burger P.C., Jouvet A., Scheithauer B.W., Kleihues P. The 2007 WHO classification of tumours of the central nervous system. Acta Neuropathologica 2007, 114(2):97-109. (URL http://dx.doi.org/10.1007/s00401-007-0243-4). 10.1007/s00401-007-0243-4.
5. Kros J.M., Gorlia T., Kouwenhoven M.C., Zheng P.-P., Collins V.P., Figarella-Branger D., Giangaspero F., Giannini C., Mokhtari K., Mørk S.J., Paetau A., Reifenberger G., van den Bent M.J. Panel review of anaplastic oligodendroglioma from european organization for research and treatment of cancer trial 26951: assessment of consensus in diagnosis, influence of 1p/19q loss, and correlations with outcome. Journal of Neuropathology and Experimental Neurology 2007, 66(6):545-551. (URL http://dx.doi.org/10.1097/01.jnen.0000263869.84188.72). 10.1097/01.jnen.0000263869.84188.72.
6. Duran I., Raizer J.J. Low-grade gliomas: management issues. Expert Review of Anticancer Therapy 2007, 7(12 Suppl):S15-S21. (URL http://dx.doi.org/10.1586/14737140.7.12s.S15). 10.1586/14737140.7.12s.S15.
7. Stupp R., Reni M., Gatta G., Mazza E., Vecht C. Anaplastic astrocytoma in adults. Critical Reviews in Oncology/Hematology 2007, 63(1):72-80. (URL http://www.sciencedirect.com/science/article/B6T5S-4NMKVGF-1/1/ac49534c446a7b8446af7f1b250be7fe).
8. Neurochirurgie, Schattauer. Ch. Intrakranielle Tumoren 2004, 407-488. D. Moskopp, H. Wassmann (Eds.).
9. Schwartzbaum J.A., Fisher J.L., Aldape K.D., Wrensch M. Epidemiology and molecular pathology of glioma. Nature Clinical Practice Neurology 2006, 2(9):494-503. (URL http://dx.doi.org/10.1038/ncpneuro0289). 10.1038/ncpneuro0289.
10. Marko N.F., Quackenbush J., Weil R.J. Why is there a lack of consensus on molecular subgroups of glioblastoma? understanding the nature of biological and statistical variability in glioblastoma expression data. PLoS One 2011, 6(7):e20826. (URL http://dx.doi.org/10.1371/journal.pone.0020826). 10.1371/journal.pone.0020826.
11. Brereton R.G. One-class classifiers. Journal of Chemometrics 2011, 25:225-246. 10.1002/cem.1397.
12. Brereton R. Chemometrics for Pattern Recognition 2009, Wiley, Chichester, U.K.
13. D. M. Tax, One-class classification-concept-learning in the absence of counter-examples, Ph.D. thesis, Technische Universiteit Delft (2001).
14. Foody G.M. Status of land cover classification accuracy assessment. Remote Sensing of Environment 2002, 80(1):185-201. (URL http://www.sciencedirect.com/science/article/B6V6V-44SJGRK-J/2/8309267975fbc9b6715b54e381125035).
15. Binaghi E., Brivio P.A., Ghezzi P., Rampini A. A fuzzy set-based accuracy assessment of soft classification. Pattern Recognition Letters 1999, 20(9):935-948. (URL http://www.sciencedirect.com/science/article/B6V15-3XFTF4X-8/2/598498275f1c46697177542a9cb79d70).
16. Pontius R.G., Cheuk M.L. A generalized cross-tabulation matrix to compare soft-classified maps at multiple resolutions. International Journal of Geographical Information Science 2006, 20(1):1-30. (URL http://www.informaworld.com/10.1080/13658810500391024).
17. Silván-Cardenás J., Wang L. Sub-pixel confusion-uncertainty matrix for assessing soft classifications. Remote Sensing of Environment 2008, 112(3):1081-1095. (URL http://www.sciencedirect.com/science/article/B6V6V-4PS5FC7-2/2/08190946607e36f1d175ff78be859ee1). 10.1016/j.rse.2007.07.017.
18. Chen J., Zhu X., Imura H., Chen X. Consistency of accuracy assessment indices for soft classification: simulation analysis. ISPRS Journal of Photogrammetry and Remote Sensing 2010, 65(2):156-164. (URL http://www.sciencedirect.com/science/article/B6VF4-4XK31SG-1/2/641ba09ee2e9d5d28fcfa24e85ee93b1). 10.1016/j.isprsjprs.2009.10.003.
19. Wold S., Sjöström M. SIMCA: a method for analyzing chemical data in terms of similarity and analogy 1977, 243-282. (Ch.12:http://pubs.acs.org/doi/pdf/10.1021/bk-1977-0052.ch012, URL http://pubs.acs.org/doi/abs/10.1021/bk-1977-0052.ch012). 10.1021/bk-1977-0052.ch012.
20. de Juan A., Mäder M., Martínez M., Tauler R. Combining hard- and soft-modelling to solve kinetic problems. Combining Hard- and Soft-Modelling to Solve Kinetic Problems 2000, 54:123-141. (URL http://www.cid.csic.es/homes/rtaqam/Romavos/themostcitedpapers2_archivos/chemolab_kinetic.pdf). 10.1016/S0169-7439(00)00112-X.
21. Varmuza K. Introduction to Multivariate Statistical Analysis in Chemometrics 2009, CRC Press, Boca Raton.
22. Oliveri P., Downey G. Multivariate class modeling for the verification of food-authenticity claims. Trends in Analytical Chemistry 2012, 35:74-86. 10.1016/j.trac.2012.02.005.
23. Krafft C., Shapoval L., Sobottka S.B., Geiger K.D., Schackert G., Salzer R. Identification of primary tumors of brain metastases by simca classification of ir spectroscopic images. Biochimica et Biophysica Acta 2006, 1758(7):883-891. (URL http://dx.doi.org/10.1016/j.bbamem.2006.05.001). 10.1016/j.bbamem.2006.05.001.
24. Khanmohammadi M., Garmarudi A.B., Ghasemi K., Jaliseh H.K., Kaviani A. Diagnosis of colon cancer by attenuated total reflectance-fourier transform infrared microspectroscopy and soft independent modeling of class analogy. Medical Oncology 2009, 26(3):292-297. (URL http://dx.doi.org/10.1007/s12032-008-9118-3). 10.1007/s12032-008-9118-3.
25. Heraud P., Wood B.R., Beardall J., McNaughton D. Effects of pre-processing of Raman spectra on in vivo classification of nutrient status of microalgal cells. Journal of Chemometrics 2006, 20:193-197. 10.1002/cem.990.
26. Brereton R.G., Lloyd G.R. Support vector machines for classification and regression. Analyst 2010, 135(2):230-267. URL http://dx.doi.org/10.1039/b918972f. 10.1039/b918972f.
27. Lasch P., Haensch W., Naumann D., Diem M. Imaging of colorectal adenocarcinoma using FT-IR microspectroscopy and cluster analysis. Biochimica et Biophysica Acta 2004, 1688(2):176-186. (URL http://dx.doi.org/10.1016/j.bbadis.2003.12.006). 10.1016/j.bbadis.2003.12.006.
28. Steller W., Einenkel J., Horn L.-C., Braumann U.-D., Binder H., Salzer R., Krafft C. Delimitation of squamous cell cervical carcinoma using infrared microspectroscopic imaging. Analytical and Bioanalytical Chemistry 2006, 384(1):145-154. (URL http://dx.doi.org/10.1007/s00216-005-0124-4). 10.1007/s00216-005-0124-4.
29. Krafft C., Steiner G., Beleites C., Salzer R. Disease recognition by infrared and Raman spectroscopy. Journal of Biophotonics 2009, 2(1-2):13-28. (URL http://dx.doi.org/10.1002/jbio.200810024). 10.1002/jbio.200810024.
30. Bonifacio A., Beleites C., Vittur F., Marsich E., Semeraro S., Paoletti S., Sergo V. Chemical imaging of articular cartilage sections with Raman mapping, employing uni- and multi-variate methods for data analysis. Analyst 2010, 135(12):3193-3204. (URL http://dx.doi.org/10.1039/c0an00459f). 10.1039/c0an00459f.
31. Fedorov V., Mannino F., Zhang R. Consequences of dichotomization. Pharmaceutical Statistics 2009, 8:50-61. 10.1002/pst.331.
32. Kendall C., Stone N., Shepherd N., Geboes K., Warren B., Bennett R., Barr H. Raman spectroscopy, a potential tool for the objective identification and classification of neoplasia in Barrett's oesophagus. The Journal of Pathology 2003, 200(5):602-609. (URL http://dx.doi.org/10.1002/path.1376). 10.1002/path.1376.
33. Beleites C., Neugebauer U., Bocklitz T., Krafft C., Popp J. Sample Size Planning for Classification Models. Analytica Chimica Acta 2013, 760:25-33. 10.1016/j.aca.2012.11.007.
34. Ellison S., Fearn T. Characterising the performance of qualitative analytical methods: statistics and terminology. TrAC Trends in Analytical Chemistry 2005, 24(6):468-476. (URL http://www.sciencedirect.com/science/article/B6V5H-4GBW3DF-1/2/991edb7cc5f6623eea28aef68a9b4e38).
35. Forthofer R.N., Lee E.S. Introduction to Biostatistics - A Guide to Design, Analysis and Discovery 1995, Academic Press, (doi:ISBN 0-12-262270-7).
36. Gottwald S. Many-valued logic. The Stanford Encyclopedia of Philosophy, spring 2010 Edition 2010, E.N. Zalta (Ed.).
37. Hajek P. Fuzzy logic. The Stanford Encyclopedia of Philosophy, fall 2010 Edition 2010, E.N. Zalta (Ed.).
38. Dubois D., Prade H. A review of fuzzy set aggregation connectives. Information Sciences 1985, 36(1-2):85-121. (URL http://www.sciencedirect.com/science/article/B6V0C-48MXSRD-2V/2/38718780ea3ce24ff3a89900252d0a99).
39. Pontius J., Gilmore Robert, Connors J. Expanding the conceptual, mathematical and practical methods for map comparison. 7th International Symposium on Spatial Accuracy Assessment in Natural Resources and Environmental Sciences, Proceedings of Accuracy 2006 2006, (plenary lecture. URL http://www.clarku.edu/rpontius/pontius_connors_2006_spatialaccuracy.pdf http://spatial-accuracy.org/system/files/Pontius2006accuracy.pdf). M. Caetano, M. Painho (Eds.).
40. Reichenbach H. Wahrscheinlichkeitslogik. Erkenntnis 1935, 5:37-43. (URL http://www.jstor.org/stable/20011737).
41. Lewis H.G., Brown M. A generalized confusion matrix for assessing area estimates from remotely sensed data. International Journal of Remote Sensing 2001, 22(16):3223-3235. (URL http://www.informaworld.com/10.1080/01431160152558332).
42. Brier G.W. Verification of forecasts expressed in terms of probability. Monthly Weather Review 1950, 78(1):1-3.
43. R Development Core Team R: a language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria 2011, (URL http://www.R-project.org/).
44. Grosjean P. SciViews-R: A GUI API for R, UMONS, MONS, Belgium 2012, URL http://www.sciviews.org/SciViews-R.
45. Venables W.N., Ripley B.D. Modern Applied Statistics with S 2002, Springer, New York, (URL http://www.stats.ox.ac.uk/pub/MASS4). 4th edition.
46. Wehrens R., Mevik B.-H. pls: partial least squares regression (PLSR) and principal component regression (PCR), R package version 2.1-0 2007, URL http://mevik.net/work/software/pls.html.
47. Bengtsson H., Riedy J. R.matlab: read and write of MAT files together with R-to-Matlab connectivity, R package version 1.2.4 2008, (URL http://www.braju.com/R/).
48. C. Beleites, V. Sergo, Hyperspec: a package to handle hyperspectral data sets in R, In preparation for Journal of Statistical Software R package version 0.98-20121028. URL http://hyperspec.r-forge.r-project.org.
49. Mevik B.-H., Wehrens R. The pls package: principal component and partial least squares regression in R. Journal of Statistical Software 2007, 18(2):1-24. (URL http://www.jstatsoft.org/v18/i02).
50. Wickham H. ggplot2: Elegant Graphics for Data Analysis 2009, Springer, New York, (URL http://had.co.nz/ggplot2/book).
51. Sing T., Sander O., Beerenwinkel N., Lengauer T. ROCR: visualizing the performance of scoring classifiers. R package version 1.0-4 2009, (URL http://CRAN.R-project.org/package=ROCR).