The impact of feature extraction on the performance of a classifier: kNN, Naïve Bayes and C4.5

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 3501 LNAI, Issue , 2005, Pages 268-279

  Pechenizkiy, Mykola ^a  

^a UNIVERSITY OF JYVÄSKYLÄ   (Finland)

Author keywords

[No Author keywords available]

Indexed keywords

BENCHMARKING; CLASSIFICATION (OF INFORMATION); COMPUTATIONAL COMPLEXITY; ERROR ANALYSIS; FEATURE EXTRACTION; LEARNING ALGORITHMS; PRINCIPAL COMPONENT ANALYSIS; RANDOM PROCESSES;

CLASSIFICATION ERROR; COVARIANCE MATRIX; DIMENSIONALITY REDUCTION; RANDOM PROJECTION;

CLASSIFIERS;

EID: 26944454815     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11424918_28     Document Type: Conference Paper

References (21)

1. Achlioptas, D. Database-friendly random projections. Proceedings of the twentieth ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems, Santa Barbara, California, ACM Press (2001)
2. Aivazyan, S.A. Applied statistics: classification and dimension reduction. Finance and Statistics, Moscow (1989)
3. Aladjem, M. Multiclass discriminant mappings. Signal Processing, Vol. 35, (1994) 1-18
4. Aladjem, M. Parametric and nonparametric linear mappings of multidimensional data. Pattern Recognition, Vol.24(6) (1991) 543-553
5. Bellman, R., Adaptive Control Processes: A Guided Tour, Princeton University Press, (1961)
6. Bingham, E., Mannila, H. Random projection in dimensionality reduction: applications to image and text data. Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining, ACM Press, San Francisco, California, (2001)
7. Blake, C.L., Merz, C.J. UCI Repository of Machine Learning Databases. Dept. of Information and Computer Science, University of California, Irvine CA, (1998)
8. Fayyad, U.M. Data Mining and Knowledge Discovery: Making Sense Out of Data, IEEE Expert, Vol. 11(5), (1996) 20-25
9. Fradkin, D., Madigan, D. Experiments with random projections for machine learning. Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining, ACM Press, Washington, D.C., (2003)
10. Fukunaga, K. Introduction to statistical pattern recognition. Academic Press, London (1990)
11. Jimenez, L., Landgrebe, D. High Dimensional Feature Reduction Via Projection Pursuit. PhD Thesis and School of Electrical & Computer Engineering Technical Report TR-ECE 96-5, (1995)
12. Jolliffe, I.T. Principal Component Analysis. Springer, New York, NY, (1986)
13. Kiang, M. A comparative assessment of classification methods, Decision Support Systems, Vol. 35, (2003) 441-454
14. Kohavi, R., Sommerfield, D., Dougherty, J. Data mining using MLC++: a machine learning library in C++. Tools with Artificial Intelligence, IEEE CS Press, (1996) 234-245
15. Liu, H. Feature Extraction, Construction and Selection: A Data Mining Perspective, ISBN 0-7923-8196-3, Kluwer Academic Publishers (1998)
16. Michalski, R.S.. Seeking Knowledge in the Deluge of Facts, Fundamenta Informaticae, Vol. 30, (1997) 283-297
17. Oza, N.C., Turner, K. Dimensionality Reduction Through Classifier Ensembles. Technical Report NASA-ARC-IC-1999-124, Computational Sciences Division, NASA Ames Research Center, Moffett Field, CA, (1999)
18. Quinlan, J.R. C4.5 Programs for Machine Learning. San Mateo CA: Morgan Kaufmann, (1993)
19. Tsymbal A., Pechenizkiy M., Puuronen S., Patterson D.W. Dynamic integration of classifiers in the space of principal components, In: L.Kalinichenko, R.Manthey, B.Thalheim, U. Wloka (Eds.), Proc. Advances in Databases and Information Systems: 7th East-European Conf. ADBIS'03, Lecture Notes in Computer Science, Vol. 2798, Heidelberg: Springer-Verlag (2003) 278-292
20. Tsymbal A., Puuronen S., Pechenizkiy M., Baumgarten M., Patterson D. Eigenvector-based feature extraction for classification. In Proc. 15th Int. FLAIRS Conference on Artificial Intelligence, Pensacola, FL,:USA, AAAI Press (2002) 354-358
21. Witten I. and Frank E. Data Mining: Practical machine learning tools with Java implementations, Morgan Kaufmann, San Francisco, (2000)