Weighted distance weighted discrimination and its asymptotic properties

Journal of the American Statistical Association

Volumn 105, Issue 489, 2010, Pages 401-414

  Qiao, Xingye ^a   Zhang, Hao Helen ^b   Liu, Yufeng ^a   Todd, Michael J ^c   Marron, J S ^a  

^a University of North Carolina at Chapel Hill   (United States)

^b NORTH CAROLINA STATE UNIVERSITY   (United States)

^c Cornell University   (United States)

Author keywords

Fisher consistency; High dimensional; Linear discrimination; Low sample size data; Nonstandard asymptotics; Unbalanced data

Indexed keywords

EID: 77952561415     PISSN: 01621459     EISSN: 1537274X     Source Type: Journal    
DOI: 10.1198/jasa.2010.tm08487     Document Type: Article

References (29)

1. Ahn, J., and Marron, J. S. (2010), "The Maximal Data Piling Direction for Discrimination," Biometrika, 97, 254-259. [406]
2. Ahn, J., Marron, J. S.,Muller, K. M., and Chi, Y. (2007), "The High-Dimension, Low-Sample-Size Geometric Representation Holds Under Mild Conditions," Biometrika, 94 (3), 760-766. [402,407,408]
3. Alizadeh, F., and Goldfarb, D. (2003), "Second-Order Cone Programming," Mathematical Programming, 95, 3-51. [403]
4. Bartlett, P. L., Jordan, M. I., and McAuliffe, J. D. (2006), "Convexity, Classification, and Risk Bounds," Journal of the American Statistical Association, 101 (473), 138-156. [411]
5. Bhattacharjee, A., Richards, W. G., Staunton, J., Li, C., Monti, S., Vasa, P., Ladd, C., Beheshti, J., Bueno, R., Gillette, M., Loda, M., Weber, G., Mark, E. J., Lander, E. S., Wong, W., Johnson, B. E., Golub, T. R., Sugarbaker, D. J., and Meyerson, M. (2001), "Classification of Human Lung Carcinomas by mRNA Expression Profiling Reveals Distinct Adenocarcinoma Subclasses," Proceedings of the National Academy of Sciences, 98 (24), 13790-13795. [406]
6. Bickel, P. J., and Levina, E. (2004), "Some Theory for Fisher's Linear Discriminant Function, 'Naive Bayes,' and Some Alternatives When There Are Many More Variables Than Observations," Bernoulli, 10, 989-1010. [401]
7. Chen, P. H., Lin, C. J., and Schölkopf, B. (2005), "A Tutorial on v-Support Vector Machines," Applied Stochastic Models in Business and Industry, 21 (2), 111-136. [403]
8. Dudoit, S., Fridlyand, J., and Speed, T. P. (2002), "Comparison of Discrimination Methods for the Classification of Tumors Using Gene Expression Data," Journal of the American Statistical Association, 97, 77-87. [407]
9. El Karoui, N. (2007), "The Spectrum of Kernel Random Matrices," Technical Report 748, UC Berkeley, Dept. of Statistics. The Annals of Statistics, to appear. [402]
10. Fan, J., and Fan, Y. (2008), "High Dimensional Classification Using Features Annealed Independence Rules," The Annals of Statistics, 36, 2605-2637. [401]
11. Fan, J., and Li, R. (2001), "Variable Selection via Nonconcave Penalized Likelihood and Its Oracle Properties," Journal of the American Statistical Association, 96 (456), 1348-1360. [405]
12. Fung, G. M., and Mangasarian, O. L. (2004), "A Feature Selection Newton Method for Support Vector Machine Classification," Computational Optimization and Applications, 28, 185-202. [405]
13. Ge, N., and Simpson, D. G. (1998), "Correlation and High-Dimensional Consistency in Pattern Recognition," Journal of the American Statistical Association, 93 (443), 995-1006. [401]
14. Hall, P., Marron, J. S., and Neeman, A. (2005), "Geometric Representation of High Dimension, Low Sample Size Data," Journal of the Royal Statistical Society, Ser. B, 67, 427-444. [401,402,407-409,413]
15. Jung, S. K., and Marron, J. S. (2009), "PCA Consistency in High Dimension, Low Sample Size Context," The Annals of Statistics, 37, 4104-4130. [402]
16. Le Cessie, S., and Van Houwelingen, J. (1992), "Ridge Estimators in Logistic Regression," Applied Statistics, 41, 191-201. [405]
17. Lee, A., and Silvapulle, M. (1988), "Ridge Estimation in Logistic Regression," Communications in Statistics, Simulation and Computation, 17, 1231- 1257. [405]
18. Lin, Y., Lee, Y., andWahba, G. (2002), "Support Vector Machine for Classification in Nonstandard Situation," Machine Learning, 46, 191-202. [401,403]
19. Liu, Y. (2007), "Fisher Consistency of Multicategory Support Vector Machines," in Eleventh International Conference on Artificial Intelligence and Statistics, pp. 289-296. Available at http://www.stat.umn.edu/~aistat/ proceedings/ start.htm. [411]
20. Liu, Y., Hayes, D. N., Nobel, A., and Marron, J. S. (2008), "Statistical Significance of Clustering for High Dimension Low Sample Size Data," Journal of the American Statistical Association, 103 (483), 1281-1293. [406]
21. Lokhorst, J. (1999), "The Lasso and Generalised Linear Models," technical report, University of Adelaide, Adelaide. [405]
22. Marron, J. S., Todd, M., and Ahn, J. (2007), "Distance Weighted Discrimination," Journal of the American Statistical Association, 102 (480), 1267- 1271. [401-403,406,411]
23. Qiao, X., and Liu, Y. (2009), "Adaptive Weighted Learning for Unbalanced Multicategory Classification," Biometrics, 65 (1), 159-168. [401,403-405]
24. Qiao, X., Zhang, H. H., Liu, Y., Todd, M. J., and Marron, J. S. (2008), "Asymptotic Properties of Distance-Weighted Discrimination," Technical Report 08-09, UNC Chapel Hill, Dept. of Statistics and OR. [412]
25. Schölkopf, B., and Smola, A. J. (2002), Learning With Kernels, Cambridge: MIT Press. [403]
26. Shevade, S., and Keerthi, S. (2003), "A Simple and Efficient Algorithm for Gene Selection Using Sparse Logistic Regression," Bioinformatics, 19, 2246-2253. [405]
27. Tibshirani, R. (1996), "Regression Shrinkage and Selection via the Lasso," Journal of the Royal Statistical Society, Ser. B, 58, 267-288. [405]
28. Vapnik, V. N. (1995), The Nature of Statistical Learning Theory, Berlin: Springer-Verlag. [401,403]
29. Wahba, G. (1999), "Support Vector Machines, Reproducing Kernel Hilbert Spaces and the Randomized GACV," in Advances in Kernel Methods Support Vector Learning, eds. B. Schölkopf, C. Burges, and A. Smola, Cambridge: MIT Press, pp. 69-88. [411]