Beware the null hypothesis: Critical value tables for evaluating classifiers

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 3720 LNAI, Issue , 2005, Pages 133-145

  Forman, George ^a   Cohen, Ira ^a  

^a HEWLETT PACKARD LABORATORIES   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BINARY SEQUENCES; NORMAL DISTRIBUTION; RANDOM PROCESSES; RISK ASSESSMENT; STATISTICAL METHODS;

BINARY CLASSIFICATION; NULL HYPOTHESIS; RANDOM CLASSIFIERS; T-DISTRIBUTION;

LEARNING SYSTEMS;

EID: 33646433421     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11564096_17     Document Type: Conference Paper

References (8)

1. Abroise, C. & McLachlan, G.: Selection bias in gene extraction on the basis of microarray gene-expression data. Proc. Natl. Acad. Sci. USA, 99, 10 (2002), 6562-6566.
2. Blake, C.L. & Merz, C.J.: UCI Repository of machine learning databases. University of California, Dept. of Information and Computer Science, Irvine, CA. (1998).
3. Fawcett, T.: ROC Graphs: Notes and Practical Considerations for Data Mining Researchers. Tech. Report HPL-2003-4, Hewlett-Packard, (2003).
4. Forman, G.: A Method for Discovering the Insignificance of One's Best Classifier and the Unleamability of a Classification Task. Data Mining Lessons Learned Workshop, 19th International Conference on Machine Learning (ICML), Sydney, Australia, (2002).
5. Forman, G. & Cohen, I.: Beware the Null Hypothesis: Critical Value Tables for Evaluating Classifiers. Tech. Report HPL-2005-70, Hewlett-Packard, (2005). http://www.hpl.hp.com/techreports/2005/HPL-2005-70.html
6. Jensen, D. & Cohen, P.: Multiple Comparisons in Induction Algorithms. Machine Learning, 38, 3 (2000), 309-338.
7. Mangasarian, O. L. & Wolberg, W. H.: Cancer diagnosis via linear programming. SIAM News, 23, 5 (Sept. 1990), 1-18.
8. Pemeger, T. V.: What is wrong with Bonferroni adjustments. British Medical Journal, 136 (1998), 1236-1238.