The impact of sample reduction on PCA-based feature extraction for supervised learning

Proceedings of the ACM Symposium on Applied Computing

Volumn 1, Issue , 2006, Pages 553-558

  Pechenizkiy, Mykola ^a   Puuronen, Seppo ^a   Tsymbal, Alexey ^b  

^a UNIVERSITY OF JYVÄSKYLÄ   (Finland)

^b TRINITY COLLEGE DUBLIN   (Ireland)

Author keywords

Feature extraction; Sample reduction; Supervised learning

Indexed keywords

CLASSIFICATION (OF INFORMATION); COMPUTATIONAL COMPLEXITY; FEATURE EXTRACTION; PARAMETER ESTIMATION; PRINCIPAL COMPONENT ANALYSIS; SAMPLING;

KD-TREE BASED SELECTION; SAMPLE REDUCTION; SUPERVISED LEARNING;

LEARNING ALGORITHMS;

EID: 33751032652     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1141277.1141406     Document Type: Conference Paper

References (17)

1. Aivazyan, S.A. Applied statistics: classification and dimension reduction. Finance and Statistics, Moscow, 1989.
2. Aladjem, M. Parametric and nonparametric linear mappings of multidimensional data. Pattern Recognition 24(6), 1991, 543-553.
3. Bellman, R., Adaptive Control Processes: A Guided Tour, Princeton University Press, 1961.
4. Blake, C.L., Merz, C.J. UCI Repository of Machine Learning Databases. Dept. of Information and Computer Science, University of California, Irvine CA, 1998.
5. Domingos P. and Pazzani M. On the optimality of the simple Bayesian classifier under zero-one loss. Machine Learning 29 (2,3), 1997, 103-130.
6. Elkan C. Boosting and naïve Bayesian learning, Tech. Report CS97-557, Department of CS and Engineering, University of California, San Diego, USA, 1997
7. Fayyad, U.M. Data Mining and Knowledge Discovery: Making Sense Out of Data, IEEE Expert 11(5), 1996, 20-25.
8. Fukunaga, K. Introduction to statistical pattern recognition. Academic Press, London, 1990.
9. Gaede V., Günther O. Multidimensional access methods, ACM Comput. Surv. 30 (2), 1998, 170-231.
10. Jimenez, L., Landgrebe, D. High Dimensional Feature Reduction via Projection Pursuit. PhD Thesis and School of Electrical & Computer Engineering Technical Report TR-ECE 96-5, 1995.
11. Jolliffe, IT. Principal Component Analysis. Springer, New York, NY, 1986.
12. Liu H., Motoda H., Yu L. A selective sampling approach to active feature selection, Artificial Intelligence 159 (1-2), 2004, 49-74.
13. Michalski, R.S.. Seeking Knowledge in the Deluge of Facts, Fundamenta Informaticae 30, 1997, 283-297.
14. Oza, N.C., Tumer, K. Dimensionality Reduction Through Classifier Ensembles. Technical Report NASA-ARC-IC-1999-124, Computational Sciences Division, NASA Ames Research Center, Moffett Field, CA, 1999.
15. Pechenizkiy M. Impact of the Feature Extraction on the Performance of a Classifier: kNN, Naïve Bayes and C4.5. In: B.Kegl, G.Lapalme (Eds.): Proc. of 18th CSCSI Conference on Artificial Intelligence AI'05, LNAI3501, Springer-Verlag, 2005, 268-279.
16. Tsymbal A., Pechenizkiy M., Puuronen S., Patterson D.W. Dynamic integration of classifiers in the space of principal components, In: L.Kalinichenko, R.Manthey, B.Thalheim, U.Wloka (Eds.), Proc. Advances in Databases and Information Systems: 7th East-European Conf. ADBIS'03, LNCS 2798, Springer-Verlag, 2003, 278-292.
17. Wirten I. and Frank E. Data Mining: Practical machine learning tools with Java implementations, Morgan Kaufmann, San Francisco, 2000.