Tilting methods for assessing the influence of components in a classifier

Journal of the Royal Statistical Society. Series B: Statistical Methodology

Volumn 71, Issue 4, 2009, Pages 783-803

  Hall, Peter ^b,c   Titterington, D M ^c   Xue, Jing Hao ^a,b,c  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF MELBOURNE   (Australia)

^c UNIVERSITY OF GLASGOW   (United Kingdom)

Author keywords

Biased bootstrap; Bootstrap; Centroid based classifier; Cross validation; Distance based classifiers; Empirical likelihood; Genomic data; High dimensional data; Lasso; Variable selection

Indexed keywords

EID: 68849102598     PISSN: 13697412     EISSN: 14679868     Source Type: Journal    
DOI: 10.1111/j.1467-9868.2009.00701.x     Document Type: Article

References (60)

1. Alon, U., Barkai, N., Notterman, D. A., Gish, K., Ybarra, S., Mack, D. Levine, A. J. (1999) Broad patterns of gene expression revealed by clustering analysis of tumor and normal colon tissues probed by oligonucleotide arrays. Proc. Natn. Acad. Sci. USA, 96, 6745 6750.
2. Amosova, N. N. (1972) Limit theorems for the probabilities of moderate deviations. Vest. Leningrad Univ. Mat. Meh. Astron., 3, 5 14, 148.
3. Baldi, P. Long, A. D. (2001) A Bayesian framework for the analysis of microarray expression data: regularized t-test and statistical inferences of gene changes. Bioinformatics, 17, 509 519.
4. Bickel, P. J. Levina, E. (2004) Some theory of Fisher's linear discriminant function, 'naive Bayes', and some alternatives when there are many more variables than observations. Bernoulli, 10, 989 1010.
5. Bickel, P. J., Ritov, Y. Tsybakov, A. B. (2009) Simultaneous analysis of lasso and Dantzig selector. Ann. Statist., to be published.
6. Bishop, C. M. (2006) Pattern Recognition and Machine Learning. New York : Springer.
7. Bühlmann, P. (2006) Boosting for high-dimensional linear models. Ann. Statist., 34, 559 583.
8. Candes, E. Tao, T. (2007) The Dantzig selector: statistical estimation when p is much larger than n. Ann. Statist., 35, 2313 2351.
9. Cawley, G. C., Talbot, L. C. Girolami, M. (2007) Sparse multinomial logistic regression via Bayesian L1 regularisation. Adv. Neur. Inform. Process. Syst., 19.
10. Chan, N. H., Deng, S. J., Peng, L. Xia, Z. D. (2007) Interval estimation of value-at-risk based on GARCH models with heavy-tailed innovations. J. Econometr., 137, 556 576.
11. Chen, S. S. Donoho, D. L. (1998) Atomic decomposition by basis pursuit. SIAM J. Sci. Comput., 20, 33 61.
12. Critchley, F., Atkinson, R. A., Lu, G. Biazi, E. (2001) Influence analysis based on the case sensitivity function. J. R. Statist. Soc. B, 63, 307 323. (Pubitemid 33397623)
13. Critchley, F. Marriott, P. (2004) Data-informed influence analysis. Biometrika, 91, 125 140.
14. Cui, X. Churchill, G. A. (2003) Statistical test for differential expression in cDNA microarray experiments. Genome Biol., 4, R210.
15. Cui, X., Hwang, J. T. G., Qiu, J., Blades, N. J. Churchill, G. A. (2005) Improved statistical tests for differential gene expression by shrinking variance components estimates. Biostatistics, 6, 59 75.
16. Dabney, A. R. (2005) Classification of microarrays to nearest centroids. Bioinformatics, 21, 4148 4154.
17. Dabney, A. R. Storey, J. D. (2005) Optimal feature selection for nearest centroid classifiers, with applications to gene expression microarrays. Working Paper 267. Department of Biostatistics, University of Washington, Seattle.
18. Dabney, A. R. Storey, J. D. (2007) Optimality driven nearest centroid classification from genomic data. PLoS One, 2.
19. Dudoit, S., Fridlyand, J. Speed, T. P. (2002) Comparison of discrimination methods for the classification of tumors using gene expression data. J. Am. Statist. Ass., 97, 77 87.
20. Efron, B. (1982) The Jackknife, the Bootstrap and Other Resampling Plans. Philadelphia : Society for Industrial and Applied Mathematics.
21. Efron, B., Tibshirani, R., Storey, J.D. Tusher, V. (2001) Empirical Bayes analysis of a microarray experiment. J. Am. Statist. Ass., 96, 1151 1160.
22. Fan, J. Fan, Y. (2008) High dimensional classification using features annealed independence rules. Ann. Statist., 36, 2605 2637.
23. Fan, J. Li, R. (2001) Variable selection via nonconcave penalized likelihood and its oracle properties. J. Am. Statist. Ass., 96, 1348 1360.
24. Fan, J. Lv, J. (2008) Sure independence screening for ultrahigh dimensional feature space (with discussion). J. R. Statist. Soc. B, 70, 849 911.
25. Fox, R. J. Dimmic, M. W. (2006) A two-sample Bayesian t-test for microarray data. BMC Bioinform., 7, no. 126.
26. Ghosh, A. K. Chaudhuri, P. (2004) Optimal smoothing in kernel discriminant analysis. Statist. Sin., 14, 457 483.
27. Golub, T. R., Slonim, D. K., Tamayo, P., Huard, C., Gaasenbeek, M., Mesirov, J. P., Coller, H., Loh, M. L., Downing, J. R., Caligiuri, M. A., Bloomfield, C. D. Lander, E. S. (1999) Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. Science, 286, 531 537.
28. Gordon, G. J., Jensen, R. V., Hsiao, L. L., Gullans, S. R., Blumenstock, J. E., Ramaswamy, S., Richards, W. G., Sugarbaker, D. J. Bueno, R. (2002) Translation of microarray data into clinically relevant cancer diagnostic tests using gene expression ratios in lung cancer and mesothelioma. Cancer Res., 62, 4963 4967.
29. Hall, P. Miller, H. (2009) Using generalised correlation to effect variable selection in very high dimensional problems. J. Computnl Graph. Statist., to be published.
30. Hall, P. Presnell, B. (1999) Biased bootstrap methods for reducing the effects of contamination. J. R. Statist. Soc. B, 61, 661 680.
31. Hall, P., Titterington, D. M. Xue, J.-H. (2009) Median-based classifiers for high-dimensional data. Manuscript.
32. Hall, P. Yao, Q. (2003) Data tilting for time series. J. R. Statist. Soc. B, 65, 425 442.
33. Hazelton, M. L. Turlach, B. A. (2007) Reweighted kernel density estimation. Comput. Statist. Data Anal., 51, 3057 3069.
34. Ideker, T., Thorsson, V., Seigel, A. F. Hood, L. E. (2000) Testing for differentially expressed genes by maximum likelihood analysis of microarray data. J. Computnl Biol., 7, 805 817.
35. Iizuka, N., Oka, M., Yamada-Okabe, H., Nishida, M., Maeda, Y., Mori, N., Takao, T., Tamesa, T., Tangoku, A., Tabuchi, H., Hamada, K., Nakayama, H., Ishitsuka, H., Miyamoto, T., Hirabayashi, A., Uchimura, S. Hamamoto, Y. (2003) Oligonucleotide microarray for prediction of early intrahepatic recurrence of hepato cellular carcinoma after curative resection. Lancet, 361, 923 929.
36. Klotz, J. H. (1978) Maximum entropy constrained balance randomization for clinical trials. Biometrics, 34, 283 287.
37. Lee, Y., Lin, Y. Wahba, G. (2004) Multicategory support vector machines: theory and application to the classification of microarray data and satellite radiance data. J. Am. Statist. Ass., 99, 67 81.
38. Lee, S. M. S. Young, G. A. (2003) Prepivoting by weighted bootstrap iteration. Biometrika, 90, 393 410.
39. Lönnstedt, I. Speed, T. P. (2002) Replicated microarray data. Statist. Sin., 12, 31 46.
40. Mackay, D. J. C. (1995) Probable networks and plausible predictions - a review of practical Bayesian methods for supervised neural networks. Computn Neur. Syst., 6, 469 505.
41. Neal, R. M. (1996) Bayesian Learning for Neural Systems. New York : Springer.
42. Newton, M. A., Kendziorski, C. M., Richmond, C. S., Blattner, F. R. Tsui, K. W. (2001) On differential variability of expression ratios: improving statistical inference about gene expression changes from microarray data. J. Computnl Biol., 8, 37 52.
43. Opgen-Rhein, R. Strimmer, K. (2007) Accurate ranking of differentially expressed genes by a distribution-free shrinkage approach. Statist. Appl. Genet. Molec. Biol., 6, no. 1.
44. Owen, A. B. (1988) Empirical likelihood ratio confidence intervals for a single functional. Biometrika, 75, 237 249.
45. Owen, A. B. (1990) Empirical likelihood ratio confidence regions. Ann. Statist., 18, 90 120.
46. Peng, L. Qi, Y. C. (2006) Confidence regions for high quantiles of a heavy tailed distribution. Ann. Statist., 34, 1964 1986.
47. Read, T. C. Cressie, N. A. C. (1988) Goodness-of-fit Statistics for Discrete Multivariate Data. New York : Springer.
48. Rubin, H. Sethuraman, J. (1965) Probabilities of moderate deviations. Sankhya A, 27, 325 346.
49. Seeger, M. W. (2008) Bayesian inference and optimal design for the sparse linear model. J. Mach. Learn. Res., 9, 759 813.
50. Smyth, G. K. (2004) Linear models and empirical Bayes methods for assessing differential expression in microarray experiments. Statist. Appl. Genet. Molec. Biol., 3, no. 3.
51. Tibshirani, R. (1996) Regression shrinkage and selection via the lasso. J. R. Statist. Soc. B, 58, 267 288.
52. Tibshirani, R., Hastie, T., Narasimhan, B. Chu, G. (2002) Diagnosis of multiple cancer types by shrunken centroids of gene expression. Proc. Natn. Acad. Sci. USA, 99, 6567 6572.
53. Tipping, M. E. (2001) Sparse Bayesian learning and the Relevance Vector Machine. J. Mach. Learn. Res., 1, 211 244.
54. Titterington, D. M. (1983) On constrained balance randomization for clinical trials. Biometrics, 39, 1083 1086.
55. Tusher, V. G., Tibshirani, R. Chu, G. (2001) Significance analysis of microarrays applied to the ionizing radiation response. Proc. Natn. Acad. Sci. USA, 98, 5116 5121.
56. van der Vaart, A. W., Dudoit, S. van der Laan, M. J. (2006) Oracle inequalities for multi-fold cross validation. Statist. Decsns, 24, 351 371.
57. Wang, S. Zhu, J. (2007) Improved centroids estimation for the nearest shrunken centroid classifier. Bioinformatics, 23, 972 979.
58. Wipf, D. P. Rao, B. D. (2007) An empirical Bayesian strategy for solving the simultaneous sparse approximation problem. IEEE Trans. Signal Process., 55, 3704 3716.
59. Wright, G. W. Simon, R. M. (2003) A random variance model for detection of differential gene expression in small microarray experiments. Bioinformatics, 19, 2448 2455.
60. Wu, B. (2005) Differential gene expression detection using penalized linear regression models: the improved SAM statistic. Bioinformatics, 21, 1565 1571.