Testing the statistical significance of an ultra-high-dimensional naïve bayes classifier

Statistics and its Interface

Volumn 6, Issue 2, 2013, Pages 223-229

  An, Baiguo ^a   Wang, Hansheng ^b   Guo, Jianhua ^a  

^a NORTHEAST NORMAL UNIVERSITY   (China)

^b Peking University   (China)

Author keywords

Binary predictor; Hypothesis testing; Na ve bayes; Supervised learning; Text classification; Ultra High Dimensional data

Indexed keywords

EID: 84880142860     PISSN: 19387989     EISSN: 19387997     Source Type: Journal    
DOI: 10.4310/SII.2013.v6.n2.a6     Document Type: Article

References (19)

1. Agresti, A. (1990). Categorical Data Analysis, John Wiley, New York. MR1044993
2. Bouckaert, R. (2004). Naïve Bayes classifiers that perform well with continuous variables. In: Proc. of the 17th Australian Conference on AI (AI 04), Lecture Notes AI.
3. Fan, J. and Lv, J. (2008). Sure independence screening for ultrahigh dimensional feature space (with discussion). Journal of the Royal Statistical Society, Series B. 70 849-911. MR2530322
4. Feng, G., Guo, J., Jing, B. and Hao, L. (2012). A Bayesian feature selection paradigm for text classification. Information Processing and Management. 48 283-302.
5. Goeman, J., Geer, S., Kort, F. and Houwelingen, J. (2004). A global test for groups of genes: Testing association with a clinical outcome. Bioinformatics. 20 93-99.
6. Goeman, J., Geer, S. and Houwelingen, J. (2006). Testing against a high-dimensional alternative. Journal of the Royal Statistical Society, Series B. 68 477-493. MR2278336
7. Goeman, J., Houwelingen, H. and Finos, L. (2011). Testing against a high-dimensional alternative in generalized linear models: Asymptotic type I error control. Biometrika. 98 381-390. MR2806435
8. Hastie, T., Tibshirani, R. and Friedman, J. (2001). The Elements of Statistical Learning, Springer, New York. MR1851606
9. Higgins, J. E. and Koch, G. G. (1977). Variable selection and generalized chi-square analysis of categorical data applied to a large cross-sectional occupational health survey. International Statistical Review. 45 51-62.
10. Joachims, T. (2002). Learning to Classify Text Using Support Vector Machines: Methods, Theory and Algorithms, Springer.
11. Kosala, R. and Blockeel, H. (2000). Web mining research: A survey. ACM SIGKDD Explorations Newsletter. 2 1-15.
12. Kussul, E. and Baidyk, T. (2004). Improved method of handwritten digit recognition tested on MNIST database. Image and Vision Computing. 22 971-981.
13. Lee, D. L., Chuang, H. and Seamons, K. (1997). Document ranking and the vector-space model. Software, IEEE. 14 67-75.
14. Lewis, D. D. (1998). Naïve Bayes at forty: The independence assumption in information retrieval. In: Proc. of ECML-98, 10th European Conference on Machine Learning., pp. 4-15.
15. Milliken, G. A. and Johnson, D. E. (1993). Analysis of Messy Data, Volume I: Designed Experiments, Chapman and Hall, New York.
16. Schneider, K. M. (2005). Techniques for improving the performance of naïve Bayes for text classification. Lecture Notes in Computer Science. 3406 682-693.
17. Stamey, T., Kablin, J., McNeal, J., Johnston, I., Freiha, F., Redwine, E. and Yang, N. (1989). Prostate specific antigen in the diagnosis and treatment of adenocarcinoma of the prostate II. Radical prostatectomy treated patients. Journal of Urology. 16 1076-1083.
18. Wu, X. and Kumar, V. (2008). The top ten algorithms in data mining. Knowledge and Information Systems. 14 1-37.
19. Yang, Y. and Pedersen, J. O. (1997). A comparative study on feature selection in text categorization. In: Proc. of the Fourteenth International Conference on Machine Learning. 412-420.