Median-based classifiers for high-dimensional data

Journal of the American Statistical Association

Volumn 104, Issue 488, 2009, Pages 1597-1608

  Hall, Peter ^a   Titterington, D M ^b   Xue, Jing Hao ^c  

^a UNIVERSITY OF MELBOURNE   (Australia)

^b UNIVERSITY OF GLASGOW   (United Kingdom)

^c UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

Centroid classifier; Componentwise median; Data depth; Distance based classifier; High dimensional data; Robust method; Sample median; Spatial median; Strength of dependence.; Z4 method

Indexed keywords

EID: 74049094775     PISSN: 01621459     EISSN: None     Source Type: Journal    
DOI: 10.1198/jasa.2009.tm08107     Document Type: Article

References (46)

1. Ahn, H., Moon, H., Fazzari, M. J., Lim, N., Chen, J. J., and Kodell, R. L. (2007), "Classification by Ensembles From Random Partitions of High- Dimensional Data," Computational Statistics & Data Analysis, 51, 6166-6179.
2. Alon, U., Barkai, N., Notterman, D. A., Gish, K., Ybarra, S., Mack, D., and Levine, A. J. (1999), "Broad Patterns of Gene Expression Revealed by Clustering Analysis of Tumor and Normal Colon Tissues Probed by Oligonucleotide Arrays," Proceedings of the National Academy of Sciences of the United States of America, 96, 6745-6750.
3. Baggerly, K. A., and Scott, D. W. (1999), Discussion of "Multivariate Analysis by Data Depth: Descriptive Statistics, Graphics and Inference," by R. Y. Liu, J. M. Parelius, and K. Singh, The Annals of Statistics, 27, 841-843.
4. Bose, P., Maheshwari, A., and Morin, P. (2003), "Fast Approximations for Sums of Distances, Clustering and the Fermat-Weber Problem," Computational Geometry: Theory and Applications, 24, 135-146.
5. Bradley, R. C. (2005), "Basic Properties of Strong Mixing Conditions. A Survey and Some Open Questions," Probability Surveys, 2, 107-144.
6. Breiman, L., Friedman, J. H., Olshen, R. A., and Stone, C. J. (1984), Classification and Regression Trees, Belmont, CA: Wadsworth.
7. Dabney, A. R. (2005), "Classification of Microarrays to Nearest Centroids," Bioinformatics, 21, 4148-4154.
8. Dabney, A. R., and Storey, J. D. (2005), "Optimal Feature Selection for Nearest Centroid Classifiers, With Applications to Gene Expression Microarrays," Working Paper 267, University of Washington.
9. - (2007), "Optimality Driven Nearest Centroid Classification From Genomic Data," PLoS One, 2, e1002.
10. Ding, Y., Dang, X., Peng, H., and Wilkins, D. (2007), "Robust Clustering in High Dimensional Data Using Statistical Depths," BMC Bioinformatics,8, S8.
11. Donoho, D. L., and Gasko, M. (1992), "Breakdown Properties of Location Estimates Based on Halfspace Depth and Projected Outlyingness," The Annals of Statistics, 20, 1803-1827.
12. Dudoit, S., Fridlyand, J., and Speed, T. P. (2002), "Comparison of Discrimination Methods for the Classification of Tumors Using Gene Expression Data," Journal of the American Statistical Association, 97, 77-87.
13. Fan, J., and Fan, Y. (2008), "High Dimensional Classification Using Features Annealed Independence Rules," The Annals of Statistics, 36, 2605-2637.
14. Fan, J., and Lv, J. (2008), "Sure Independence Screening for Ultra-High Dimensional Feature Space" (with discussion), Journal of the Royal Statistical Society, Ser. B, 70, 849-911.
15. Feinerer, I., Hornik, K., and Meyer, D. (2008), "Text Mining Infrastructure in R," Journal ofStatistical Software, 25, 1-54.
16. Gentleman, W. M. (1965), "Robust Estimation of Multivariate Location by Minimizing pth Power Deviations," unpublished Ph.D. thesis, Princeton University.
17. Ghosh, A. K., and Chaudhuri, P. (2005), "On Data Depth and Distribution-Free Discriminant Analysis Using Separating Surfaces," Bernoulli, 11, 1-27.
18. Golub, T. R., Slonim, D. K., Tamayo, P., Huard, C., Gaasenbeek, M., Mesirov, J. P., Coller, H., Loh, M. L., Downing, J. R., Caligiuri, M. A., Bloomfield, C. D., and Lander, E. S. (1999), "Molecular Classification of Cancer: Class Discovery and Class Prediction by Gene Expression Monitoring," Science, 286, 531-537.
19. Gordon, G. J., Jensen, R. V., Hsiao, L. L., Gullans, S. R., Blumenstock, J. E., Ramaswamy, S., Richards, W. G., Sugarbaker, D. J., and Bueno, R. (2002), "Translation of Microarray Data Into Clinically Relevant Cancer Diagnostic Tests Using Gene Expression Ratios in Lung Cancer and Mesothelioma," Cancer Research, 62, 4963-4967.
20. Guyon, I., and Elisseeff, A. (2003), "An Introduction to Variable and Feature Selection," Journal of Machine Learning Research, 3, 1157-1182.
21. Hall, P., Titterington, D. M., and Xue, J.-H. (2009), "Tilting Methods for Assessing the Influence of Components in a Classifier," Journal of the Royal Statistical Society, Ser. B, 71, 783-803.
22. Hand, D. J. (2006), "Classifier Technology and the Illusion of Progress" (with discussion), Statistical Science, 21, 1-34.
23. Hand, D. J., and Yu, K. (2001), "Idiot's Bayes-Not so Stupid After All?" International Statistical Review, 69, 385-398.
24. Hua, J., Tembe, W. D., and Dougherty, E. R. (2009), "Performance of Feature- Selection Methods in the Classification of High-Dimension Data," Pattern Recognition, 42, 409-424.
25. 1 Data Depth," Journal of Multivariate Analysis, 90, 67-89.
26. Kowalski, J., and Powell, J. (2004), "Nonparametric Inference for Stochastic Linear Hypotheses: Application to High-Dimensional Data," Biometrika, 91, 393-408.
27. Lewis, D. (1997), "Reuters-21578 Text Categorization Collection Distribution 1.0," available at http://kdd.ics.uci.edu/databases/ reuters21578/reuters21578.html.
28. Liu, R. Y. (1990), "On a Notion of Data Depth Based on Random Simplices," The Annals of Statistics, 18, 405-414.
29. Liu, R. Y., and Singh, K. (1999), "Rejoinder: Multivariate Analysis by Data Depth: Descriptive Statistics, Graphics and inference," by R. Y. Liu, J. M. Parelius, and K. Singh, The Annals ofStatistics, 27, 854-858.
30. Markatou, M., Tian, H., Biswas, S., and Hripcsak, G. (2005), "Analysis of Variance of Cross-Validation Estimators of the Generalization Error," Journal of Machine Learning Research, 6, 1127-1168.
31. McLachlan, G. J. (1972), "An Asymptotic Expansion for the Variance of the Errors of Misclassification of the Linear Discriminant Function," Australian Journal ofStatistics, 14, 68-72.
32. - (1976), "The Bias of the Apparent Error Rate in Discriminant Analysis," Biometrika, 63, 239-244.
33. Moon, H., Ahn, H., Kodell, R. L., Lin, C. J., Baek, S., and Chen, J. J. (2006), "Classification Methods for the Development of Genomic Signatures From High-Dimensional Data," Genome Biology, 7, R121.1-R121.7.
34. Nadeau, C., and Bengio, Y. (2003), "Inference for the Generalization Error," Machine Learning, 52, 239-281.
35. Nahar, J., Ali, S., and Chen, Y. P. (2007), "Microarray Data Classification Using Automatic SVM Kernel Selection," DNA and Cell Biology, 26, 707-712.
36. Oja, H. (1983), "Descriptive Statistics for Multivariate Distributions," Statistics & Probability Letters, 1, 327-333.
37. Park, M. Y., and Hastie, T. (2008), "Penalized Logistic Regression for Detecting Gene Interactions," Biostatistics, 9, 30-50.
38. Sebastiani, F. (2002), "Machine Learning in Automated Text Categorization," ACM Computing Surveys, 34, 1-47.
39. Singh, D., Febbo, P. G., Ross, K., Jackson, D. G., Manola, J., Ladd, C., Tamayo, P., Renshaw, A. A., D'Amico, A. V., Richie, J. P., Lander, E. S., Loda, M., Kantoff, P. W., Golub, T. R., and Sellers, W. R. (2002), "Gene Expression Correlates of Clinical Prostate Cancer Behavior," Cancer Cell, 1, 203-209.
40. Tibshirani, R., and Hastie, T. (2007), "Margin Trees for High-Dimensional Classification," Journal of Machine Learning Research, 8, 637-652.
41. Tibshirani, R., Hastie, T., Narasimhan, B., and Chu, G. (2002), "Diagnosis of Multiple Cancer Types by Shrunken Centroids of Gene Expression," Proceedings ofthe National Academy of Sciences of the United States of America, 99, 6567-6572.
42. - (2003), "Class Prediction by Nearest Shrunken Centroids, With Applications to DNA Microarrays," Statistical Science, 18, 104-117.
43. Wang, L., Zhu, J., and Zou, H. (2008), "Hybrid Huberized Support Vector Machines for Microarray Classification and Gene Selection," Bioinformatics, 24, 412-419.
44. Wang, S., and Zhu, J. (2007), "Improved Centroids Estimation for the Nearest Shrunken Centroid Classifier," Bioinformatics 23, 972-979.
45. Winter, S. S., Jiang, Z., Khawaja, H. M., Griffin, T., Devidas, M., Asselin, B. L., and Larson, R. S. (2007), "Identification of Genomic Classifiers that Distinguish Induction Failure in T-Lineage Acute Lymphoblastic Leukemia: A Report From the Children's Oncology Group," Blood, 110, 1429-1438.
46. Yeung, K. Y., and Bumgarner, R. E. (2003), "Multiclass Classification of Microarray Data With Repeated Measurements: Application to Cancer," Genome Biology, 4, R83. Zucknick, M., Richardson, S., and Stronach, E. A. (2008), "Comparing the Characteristics of Gene Expression Profiles Derived by Univariate and Multivariate Classification Methods," Statistical Applications in Genetics and Molecular Biology, 7, Article 7.