Predicting sample size required for classification performance

BMC Medical Informatics and Decision Making

Volumn 12, Issue 1, 2012, Pages

  Figueroa, Rosa L ^a   Zeng Treitler, Qing ^b   Kandula, Sasikiran ^b   Ngo, Long H ^c  

^a UNIVERSITY OF CONCEPCIÓN   (Chile)

^b UNIVERSITY OF UTAH SCHOOL OF MEDICINE   (United States)

^c HARVARD MEDICAL SCHOOL   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ARTICLE; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; HUMAN; LEARNING; LEARNING CURVE; METHODOLOGY; NONLINEAR SYSTEM; PREDICTIVE VALUE; PROBLEM BASED LEARNING; REPRODUCIBILITY; SAMPLE SIZE; STATISTICAL ANALYSIS; STATISTICAL MODEL; STATISTICS;

ALGORITHMS; DATA INTERPRETATION, STATISTICAL; DIAGNOSIS, COMPUTER-ASSISTED; HUMANS; LEARNING CURVE; MODELS, STATISTICAL; NONLINEAR DYNAMICS; PATTERN RECOGNITION, AUTOMATED; PREDICTIVE VALUE OF TESTS; PROBABILITY LEARNING; PROBLEM-BASED LEARNING; REPRODUCIBILITY OF RESULTS; SAMPLE SIZE; STOCHASTIC PROCESSES;

EID: 84857008691     PISSN: None     EISSN: 14726947     Source Type: Journal    
DOI: 10.1186/1472-6947-12-8     Document Type: Article

References (42)

1. Estimating dataset size requirements for classifying DNA microarray data. Mukherjee S, Tamayo P, Rogers S, Rifkin R, Engle A, Campbell C, Golub TR, Mesirov JP, J Comput Biol 2003 10 2 119 142 10.1089/106652703321825928 12804087 (Pubitemid 36623535)
2. How Large a Training Set is Needed to Develop a Classifier for Microarray Data? Dobbin K, Zhao Y, Simon R, Clinical Cancer Research 2008 14 1 108 114 10.1158/1078-0432.CCR-07-0443 18172259 (Pubitemid 351377984)
3. Impact of sample size on the performance of multiple-model pharmacokinetic simulations. Tam VH, Kabbara S, Yeh RF, Leary RH, Antimicrobial agents and chemotherapy 2006 50 11 3950 3952 10.1128/AAC.00337-06 16954312 (Pubitemid 44684925)
4. Effects of sample size on robustness and prediction accuracy of a prognostic gene signature. Kim S-Y, BMC bioinformatics 2009 10 1 147 10.1186/1471-2105-10-147 19445687
5. Predicting the Required Number of Training Samples. Kalayeh HM, Landgrebe DA, Pattern Analysis and Machine Intelligence, IEEE Transactions on 1983 5 6 664 667 (Pubitemid 14503894)
6. Text Classification from Labeled and Unlabeled Documents using EM. Nigam K, McCallum AK, Thrun S, Mitchell T, Mach Learn 2000 39 2-3 103 134 (Pubitemid 30594822)
7. A stopping criterion for active learning. Vlachos A, Computer Speech and Language 2008 22 3 295 312 10.1016/j.csl.2007.12.001 (Pubitemid 351329454)
8. An intrinsic stopping criterion for committee-based active learning. Olsson F, Tomanek K, Proceedings of the Thirteenth Conference on Computational Natural Language Learning Boulder, Colorado: Association for Computational Linguistics 2009 138 146
9. Confidence-based stopping criteria for active learning for data annotation. Zhu J, Wang H, Hovy E, Ma M, ACM Transactions on Speech and Language Processing (TSLP) 2010 6 3 1 24 10.1145/1753783.1753784
10. Exploring Active Learning in Medical Text Classification. Figueroa RL, Zeng-Treitler Q, Poster session presented at: AMIA 2009 Annual Symposium in Biomedical and Health Informatics San Francisco, CA, USA 2009
11. Predicting Outcome Measures in Active Learning. Kandula S, Figueroa R, Zeng-Treitler Q, Poster Session presented at: MEDINFO 2010 13th World Congress on MEdical Informatics Cape Town, South Africa 2010
12. Sample size planning for statistical power and accuracy in parameter estimation. Maxwell SE, Kelley K, Rausch JR, Annual review of psychology 2008 59 537 563 10.1146/annurev.psych.59.103006.093735 17937603
13. Sample size determination: a review. Adcock CJ, Journal of the Royal Statistical Society: Series D (The Statistician) 1997 46 2 261 283 10.1111/1467-9884.00082 (Pubitemid 127459045)
14. Some Practical Guidelines for Effective Sample Size Determination. Lenth RV, The American Statistician 2001 55 3 187 193 10.1198/000313001317098149
15. Power and Sample Size Calculations for Stochastic Cost-Effectiveness Analysis. Briggs AH, Gray AM, Medical Decision Making 1998 18 2 81 S92 10.1177/0272989X9801800210 9566469 (Pubitemid 28175945)
16. Estimating sample size in clinical studies: basic methodological principles. Carneiro AV, Rev Port Cardiol 2003 22 12 1513 1521 15008067
17. Statistical Power Analysis for the Behavioural Sciences. Cohen J, Hillsdale, NJ: Lawrence Erlbaum Associates 1988
18. CGHpower: exploring sample size calculations for chromosomal copy number experiments. Scheinin I, Ferreira JA, Knuutila S, Meijer GA, van de Wiel MA, Ylstra B, BMC bioinformatics 2010 11 331 10.1186/1471-2105-11-331 20565750
19. Sample size estimation: how many individuals should be studied? Eng J, Radiology 2003 227 2 309 313 10.1148/radiol.2272012051 12732691 (Pubitemid 36514740)
20. Sample size and power estimation for studies with health related quality of life outcomes: a comparison of four methods using the SF-36. Walters SJ, Health and quality of life outcomes 2004 2 26 10.1186/1477-7525-2-26 15161494 (Pubitemid 39112005)
21. Sample size/power calculation for case-cohort studies. Cai J, Zeng D, Biometrics 2004 60 4 1015 1024 10.1111/j.0006-341X.2004.00257.x 15606422 (Pubitemid 40019043)
22. Sample Size Requirements for Accurate Estimation of Squared Semi-Partial Correlation Coefficients. Algina J, Moulder BC, Moser BK, Multivariate Behavioral Research 2002 37 1 37 57 10.1207/S15327906MBR3701-02 (Pubitemid 36630369)
23. Sample Size Determination using ROC Analysis. Stalbovskaya V, Hamadicharef B, Ifeachor E, 3rd International Conference on Computational Intelligence in Medicine and Healthcare (CIMED2007): 2007 2007
24. Sample Size Determination for Confidence Intervals on the Population Mean and on the Difference Between Two Population Means. Beal SL, Biometrics 1989 45 3 969 977 10.2307/2531696 2790131 (Pubitemid 19249334)
25. A New Method for Choosing Sample Size for Confidence Interval-Based Inferences. Jiroutek MR, Muller KE, Kupper LL, Stewart PW, Biometrics 2003 59 3 580 590 10.1111/1541-0420.00068 14601759 (Pubitemid 37093397)
26. Effects of sample size in classifier design. Fukunaga K, Hayes R, Pattern Analysis and Machine Intelligence, IEEE Transactions on 1989 11 8 873 885 10.1109/34.31448
27. Learning Curves: Asymptotic Values and Rate of Convergence. Cortes C, Jackel LD, Solla SA, Vapnik V, Denker JS, San Francisco, CA. USA.: Morgan Kaufmann Publishers 1994 VI
28. Predicting the Relationship Between the Size of Training Sample and the Predictive Power of Classifiers. Boonyanunta N, Zeephongsekul P, Knowledge-Based Intelligent Information and Engineering Systems Springer Berlin/Heidelberg 2004 3215 529 535 10.1007/978-3-540-30134-9-71
29. Learning Curves in Classification With Microarray Data. Hess KR, Wei C, Seminars in oncology 2010 37 1 65 68 10.1053/j.seminoncol.2009.12.002 20172367
30. Predicting and Optimizing Classifier Utility with the Power Law. Last M, Proceedings of the Seventh IEEE International Conference on Data Mining Workshops IEEE Computer Society 2007 219 224
31. Efficient progressive sampling. Provost F, Jensen D, Oates T, Proceedings of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining San Diego, California, United States: ACM 1999
32. Active learning with support vector machines in the drug discovery process. Warmuth MK, Liao J, Ratsch G, Mathieson M, Putta S, Lemmen C, J Chem Inf Comput Sci 2003 43 2 667 673 10.1021/ci025620t 12653536
33. Active learning with support vector machine applied to gene expression data for cancer classification. Liu Y, J Chem Inf Comput Sci 2004 44 6 1936 1941 10.1021/ci049810a 15554662
34. Confidence-based active learning. Li M, Sethi IK, Pattern Analysis and Machine Intelligence, IEEE Transactions on 2006 28 8 1251 1261 (Pubitemid 46405023)
35. Incorporating Diversity in Active Learning with Support Vector Machines. Brinker K, Proceedings of the Twentieth International Conference on Machine Learning (ICML): 2003 2003 59 66
36. Positive Sample Enhanced Angle-Diversity Active Learning for SVM Based Image Retrieval. Yuan J, Zhou X, Zhang J, Wang M, Zhang Q, Wang W, Shi B, Proceedings of the IEEE International Conference on Multimedia and Expo (ICME 2007): 2007 2007 2202 2205
37. The Learning Curve: Historical Review and Comprehensive Survey. Yelle LE, Decision Sciences 1979 10 2 302 327 10.1111/j.1540-5915.1979.tb00026.x
38. Statistical assessment of the learning curves of health technologies. Ramsay C, Grant A, Wallace S, Garthwaite P, Monk A, Russell I, Health Technology Assessment 2001 5 12
39. Algorithm 573: NL2SOL-An Adaptive Nonlinear Least-Squares Algorithm [E4]. Dennis JE, Gay DM, Welsch RE, ACM Transactions on Mathematical Software 1981 7 3 369 383 10.1145/355958.355966
40. UCI Machine Learning Repository. http://www.ics.uci.edu/~mlearn/ MLRepository.html
41. Weka - -Machine Learning Software in Java. http://weka.wiki.sourceforge. net/
42. Support Vector Machine Active Learning with Applications to Text Classification. Tong S, Koller D, Journal of Machine Learning Research 2001 2 45 66