Class proximity measures - Dissimilarity-based classification and display of high-dimensional data

Journal of Biomedical Informatics

Volumn 44, Issue 5, 2011, Pages 775-788

  Somorjai, R L ^a   Dolenko, B ^a   Nikulin, A ^a   Roberson, W ^a   Thiessen, N ^b  

^a NATIONAL RESEARCH COUNCIL CANADA   (Canada)

^b BRITISH COLUMBIA CANCER AGENCY   (Canada)

Author keywords

Class proximity planes; Classification; Distance dissimilarity measures; High dimensional data; Mappings; Projections; Proximity measures; Visualization

Indexed keywords

CLASS-PROXIMITY PLANES; DISTANCE/DISSIMILARITY MEASURES; HIGH DIMENSIONAL DATA; PROJECTIONS; PROXIMITY MEASURE;

DATA VISUALIZATION; DISPLAY DEVICES; FLOW VISUALIZATION; MAPPING; VISUALIZATION;

CLASSIFICATION (OF INFORMATION);

IONOPHORE;

ARTICLE; BIOMEDICINE; CLASS PROXIMITY PROJECTION DISSIMALARITY BASED CLASSIFICATION; CLASSIFICATION; COLORECTAL CANCER; DATA BASE; DIABETES MELLITUS; INFORMATION PROCESSING; LIVER DISEASE; MATHEMATICAL COMPUTING; MEDICAL INFORMATION; PRIORITY JOURNAL; SENSITIVITY AND SPECIFICITY;

ALGORITHMS; DATABASES, FACTUAL; HUMANS; INFORMATION STORAGE AND RETRIEVAL; PATTERN RECOGNITION, AUTOMATED;

EID: 80955181062     PISSN: 15320464     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jbi.2011.04.004     Document Type: Article

References (45)

1. Anderson T.W., Bahadur R.R. Classification into two multivariate normal distributions with different covariance matrices. Ann Math Statist 1962, 33:420-431.
2. Bao Y, Ishii N, Du X. Combining multiple k-nearest neighbor classifiers using different distance functions. Yang ZR et al. (Eds.) IDEAL 2004, LNCS 3177; 2004. p. 634-41.
3. Bay S.D. Combining nearest neighbor classifiers through multiple feature subsets. Intell Data Anal 1999, 3(3):191-209.
4. Bezabeh T., Somorjai R., Dolenko B., Bryskina N., Levin B., Bernstein C.N., et al. Detecting colorectal cancer by 1H magnetic resonance spectroscopy of fecal extracts. NMR Biomed 2009, 22(6):593-600.
5. Bezdek J.C., Kuncheva L.I. Nearest prototype classifier design: an experimental study. Int J Intell Syst 2001, 16(12):1445-1473.
6. Borg I., Groenen P. Modern multidimensional scaling: theory and applications 2005, Springer-Verlag, New York. 2nd ed.
7. Calò D.G. On a transvariation based measure of group separability. J Classif 2006, 23(1):143-167.
8. Chen Sh-Ch., Lin S.h.-W., Chou Sh-Y Enhancing the classification accuracy by scatter-search ensemble approach. Appl Soft Comput 2011, 11:1021-1028.
9. Cover T.M., Hart P.E. Nearest neighbor instance classification. Trans IEEE Inform Theory 1967, IT-13:21-27.
10. Cuadras C.M., Fortiana J., Oliva F. The proximity of an individual to a population with applications in discriminant analysis. J Classif 1997, 14:117-136.
11. Dasarathy B.V. Nearest neighbor (NN) norms: NN instance classification techniques 1991, IEEE Computer Society Press, Los Alamitos (CA).
12. Eriksson L, Johansson E, Kettaneh-Wold N, Wold S. Multi- and megavariate data analysis - principles and applications. Umetrics AB; 2001.
13. Fages R., Terrenoire M., Tounissoux D., Zighed A. Non supervised classification tools adapted to supervised classification. NATO ASI series. Instance recognition theory and applications 1987, vol. F30:57-62. Springer-Verlag, Berlin (Heidelberg).
14. Frank A, Asuncion A. UCI machine learning repository. Irvine, CA: University of California, School of Information and Computer Science; 2010. http://archive.ics.uci.edu/ml.
15. Frank I.E., Friedman J.H. Classification: oldtimers and newcomers. J Chemometr 1989, 3:463-475.
16. Friedman J.H., Tukey J.W. A projection pursuit algorithm for exploratory data analysis. IEEE Trans Comput 1974, C23(9):881-890.
17. Friedman J.H. Recent advances in predictive (machine) learning. J Classif 2006, 23:175-197.
18. Friedman J.H. Regularized discriminant analysis. J Am Stat Assoc 1989, 84:165-175.
19. Fukunaga K. Introduction to statistical pattern recognition 1990, Academic Press. 2nd ed.
20. Fukunaga K., Mantock J.M. A non-parametric two-dimensional display for classification. Trans IEEE Instance Anal Mach Intell 1982, PAMI-4:427-436.
21. Hastie T., Tibshirani R., Friedman J. The elements of statistical learning: data mining, inference and prediction 2001, Springer.
22. Kim S.-W., Oommen B.J. Enhancing prototype reduction schemes with recursion: a method applicable for " large" data sets. IEEE Trans Syst Man Cybern - Part B: Cybern 2004, 34(3):1384-1897.
23. Kuncheva L.I. Combining instance classifiers - methods and algorithms 2004, Wiley-Interscience.
24. Lozano M., Sotoca J.M., Sánchez J.S., Pla F., Pekalska E., Duin R.P.W. Experimental study on prototype optimisation algorithms for prototype-based classification in vector spaces. Pattern Recognit 2006, 39:1827-1838.
25. Martí R., Laguna M., Glover F. Principles of scatter search. Eur J Oper Res 2006, 169:359-372.
26. Montanari A. Linear discriminant analysis and transvariation. J Classif 2004, 21(1):71-88.
27. Neyman J., Pearson E. On the problem of the most efficient tests of statistical hypotheses. Philos Trans R Soc Lond Ser A 1933, 231:289-337.
28. Nikulin A.E., Dolenko B., Bezabeh T., Somorjai R.L. Near-optimal region selection for feature space reduction: novel preprocessing methods for classifying MR spectra. NMR Biomed 1998, 11:209-217.
29. Páclik P., Duin R.P.W. Dissimilarity-based classification of spectra: computational issues. Real Time Imag 2003, 9(4):237-244.
30. Páclik P, Duin RPW. Classifying spectral data using relational representation. Spectral imaging workshop, Graz, Austria; 2003.
31. Paredes R., Vidal E.A. Class-dependent weighted dissimilarity measure for nearest neighbor classification problems. Pattern Recognit Lett 2000, 21:1027-1036.
32. Paredes R., Vidal E.A. Learning prototypes and distances: a prototype reduction technique based on nearest neighbor error minimization. Pattern Recognit 2006, 39:180-188.
33. Pekalska E., Duin R.P.W. Dissimilarity representations allow for building good classifiers. Pattern Recognit Lett 2002, 23(8):943-956.
34. Pekalska E., Duin R.P.W., Páclik P. Prototype selection for dissimilarity-based classifiers. Pattern Recognit 2006, 39:189-208.
35. Pekalska E., Páclik P., Duin R.P.W. A generalized kernel approach to dissimilarity based classification. J Mach Learn Res 2002, 2(2):175-211.
36. Pekalska E., Duin R.P.W. The dissimilarity representation for instance recognition. Foundations and applications 2005, World Scientific, Singapore.
37. Scott C. Performance measures for Neyman-Pearson classification. IEEE Trans Inform Theory 2007, 53(8):2852-2863.
38. Somorjai R.L., Dolenko B., Baumgartner R. Class prediction and discovery using gene microarray and proteomics mass spectroscopy data: curses, caveats, cautions. Bioinformatics 2003, 19:1484-1491.
39. Somorjai R.L., Demko A., Mandelzweig M., Dolenko B., Nikulin A.E., Baumgartner R., et al. Mapping high-dimensional data onto a relative distance plane - a novel, exact method for visualizing and characterizing high-dimensional instances. J Biomed Inform 2004, 37:366-379.
40. Somorjai RL, Alexander M, Baumgartner R, Booth S, Bowman C, Demko A, et al. A data-driven, flexible machine learning strategy for the classification of biomedical data. In: Dubitzky W, Azuaje F, editors. Artificial intelligence methods and tools for systems biology. Computational biology series, vol. 5. Springer. p. 67-85; 2004 [Chapter 5].
41. Somorjai R.L., Dolenko B., Mandelzweig M. Direct classification of high-dimensional data in low-dimensional projected feature spaces - comparison of several classification methodologies. J Biomed Inform 2007, 40:131-138.
42. Tenenbaum J.B., de Silva V., Langford J.C. A global geometric framework for nonlinear dimensionality reduction. Science 2000, 290:2319-2323.
43. Van Gestel T., Suykens J.A.K., Lanckriet G., Lambrechts A., De Moor B., Vandewalle J. A bayesian framework for least squares support vector machine classifiers, gaussian processes and kernel fisher discriminant analysis. Neural Comput 2002, 14(5):1115-1147.
44. Wilson D.R., Martinez T.R. An integrated instance-based learning algorithm. Comput Intell 2000, 16:1-28.
45. Wilson D.R., Martinez T.R. Reduction techniques for instance-based learning algorithms. Mach Learn 2000, 38(3):257-286.