Reducing high-dimensional data by principal component analysis vs. random projection for nearest neighbor classification

Proceedings - 5th International Conference on Machine Learning and Applications, ICMLA 2006

Volumn , Issue , 2006, Pages 245-250

  Deegalla, Sampath ^a   Boström, Henrik ^a  

^a STOCKHOLM UNIVERSITY   (Sweden)

Author keywords

[No Author keywords available]

Indexed keywords

DATA REDUCTION; IMAGE ANALYSIS; MICROARRAYS; PRINCIPAL COMPONENT ANALYSIS; RANDOM PROCESSES;

COMPUTATIONAL COST; RANDOM PROJECTION;

CLASSIFICATION (OF INFORMATION);

EID: 38449115187     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICMLA.2006.43     Document Type: Conference Paper

References (17)

1. D. Achlioptas. Database-friendly random projections. In ACM Symposium on the Principles of Database Systems, pages 274-281, 2001.
2. A. A. Alizadeh, M. B. Eisen, R. E. Davis, C. Ma, I. S. Lossos, A. Rosenwald, J. C. Boldrick, H. Sabet, T. Tran, X. Yu, J. I. Powell, L. Yang, G. E. Marti, T. Moore, J. Hudson Jr, L. Lu, D. B. Lewis, R. Tibshirani, G. Sherlock, W. C. Chan, T. C. Greiner, D. D. Weisenburger, J. O. Armitage, R. Warnke, R. Levy, W. Wilson, M. R. Grever, J. C. Byrd, D. Botstein, P. O. Brown, and L. M. Staudt. Distinct types of diffuse large B-cell lymphoma identified by gene expression profiling. Nature, 403:503-511, 2000.
3. U. Alon, N. Barkai, D. Notterman, K. Gish, S. Ybarra, D. Mack, and A. J. Levine. Broad patterns of gene expression revealed by clustering analysis of tumor and normal colon tissues probed by oligonucleotide arrays. In Proc. Natl. Acad. Sei. USA, volume 96, pages 6745- 6750, 1999. Data set : http://sdmc.lit.org.sg/GEDatasets/Datasets.html.
4. E. Bingham and H. Mannila. Random projection in dimensionality reduction: applications to image and text data. In KDD '01: Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining, 2001.
5. S. Dasgupta and A. Gupta. An elementary proof of the Johnson- Lindenstrauss lemma. Technical Report TR-99-006, International Computer Science Institute, Berkeley, California, USA, 1999.
6. X. Z. Fern and C. E. Brodley. Random projection for high dimensional data clustering: A cluster ensemble approach. In Proceedings of the Twentieth International Conference of Machine Learning, 2003.
7. D. Fradkin and D. Madigan. Experiments with random projections for machine learning. In KDD '03: Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining, 2003.
8. T. R. Golub, D. K. Slonim, P. Tamayo, C. Huard, M. Gaasenbeek, J. P. Mesirov, H. Coller, M. Loh, J. R. Downing, M. A. Caligiuri, C. D. Bloomfield, and E. S. Lander. Molecular classification of cancer: Class discovery and class prediction by gene expression monitoring. Science, 286:531-537, 1999. Data set : http://sdmc.lit.org.sg/GEDatasets/Datasets.html.
9. H.Shao, T. Svoboda, and L. V. Gool. Zubud - Zurich building database for image based recognition. Technical report, Computer Vision Lab, Swiss Federal Institute of Technology, Switzerland, 2003. Data set : http://www.vision.ee. ethz.ch/showroom/zubud/index.en.html.
10. J. Kahn, J. S. Wei, M. Ringnér, L. H. Saal, M. Ladanyi, F. Westermann, F. Berthold, M. Schwab, C. Antonescu, C. Peterson, and P. Meltzer. Classification and diagnostic prediction of cancers using gene expression profiling and artificial neural networks. Nature Medicine, 7:673-679, 2001.
11. S. Kaski. Dimensionality reduction by random mapping: Fast similarity computation for clustering. In Proceedings of IJCNN'98, International Joint Conference on Neural Networks, volume 1, pages 413-418, Piscataway, NJ, 1998. IEEE Service Center.
12. T. M. Lehmann, B. B. Wein, J. Dahmen, J. Bredno, F. Vogelsang, and M. Kohnen. Content-based image retrieval in medical applications: a novel multistep approach. In M. M. Yeung, B.-L. Yeo, and C. A. Bouman, editors, Proceedings of SPIE: Storage and Retrieval for Media Databases 2000, volume 3972, pages 312-320, 2000. Data set : http://phobos.imib.rwth-aachen.de/irma/datasets_en. php.
13. MIAS data set : http://www.wiau.man.ac.uk/services/MIAS/-MIASmini.html.
14. S. A. Nene, S. K. Nayar, and H. Murase. Columbia object image library (coil-100). Technical report, CUCS-006-96, February 1996. Data set : http://www1.cs.columbia.edu/CAVE/research/softlib/coil-100.html.
15. T. Ojala, T. Maenpaa, M. Pietikainen, J. Viertela, J. Kyllonen, and S. Huovinen. Outex - new framework for empirical evaluation of texture analysis algorithms. In ICPR '02: Proceedings of the 16 th International Conference on Pattern Recognition (ICPR'02) Volume 1, 2002. Data set : http://www.outex.oulu.fi.
16. S. L. Pomeroy, P. Tamayo, M. Gassenbeek, L. M. Sturla, M. Angelo, M. E. McLaughlin, J. Y Kim, L. C. Goumnerova, P. M. Black, C. Lau, J. C. Allen, D. Zagzag, J. M. Olson, T. Curran, C. Wetmore, J. A. Biegel, T. Poggio, S. Mukherjee, R. Rifkin, A. Califano, G. Stolovitzky, D. N. Louis, J. P. Mesirov, E. S. Lander, and T. R. Golub. Prediction of central nervous system embryonal tumour outcome based on gene expression. Nature, 415:436-442, January 2002.
17. I. H. Witten and E. Frank. Data Mining: Practical machine learning tools and techniques. Morgan Kaufmann, San Francisco, 2005.