A Plea for Neutral Comparison Studies in Computational Sciences

PLoS ONE

Volumn 8, Issue 4, 2013, Pages

  Boulesteix, Anne Laure ^a   Lauer, Sabine ^a   Eugster, Manuel J A ^a,b  

^a UNIVERSITY OF MUNICH   (Germany)

^b AALTO UNIVERSITY   (Finland)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; BIOINFORMATICS; BIOMEDICINE; CLASSIFICATION; CLINICAL RESEARCH; COMPARATIVE STUDY; COMPUTATIONAL SCIENCE; CONTROLLED STUDY; DATA ANALYSIS; INTERMETHOD COMPARISON; INTERNET; MACHINE LEARNING; SCIENTIFIC LITERATURE; STANDARD; STATISTICAL ANALYSIS; STUDY DESIGN;

ARTIFICIAL INTELLIGENCE; COMPUTATIONAL BIOLOGY; HUMANS;

EID: 84876567454     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0061562     Document Type: Article

References (14)

1. Editorial (2008) Compare and conquer. Nat Meth 5: 275-275.
2. Wagstaff KL (2012) Machine learning that matters. In: Proceedings of the 29 th International Conference on Machine Learning, Edinburgh, Scotland, UK, 2012.
3. Hothorn T, Leisch F, (2011) Case studies in reproducibility. Briefings in Bioinformatics 12: 288-300.
4. Wolpert D (2001) The supervised learning no-free-lunch theorems. In: Proceedings of the 6th Online World Conference on Soft Computing in Industrial Applications. Citeseer, volume 6, 1-20.
5. Jelizarow M, Guillemot V, Tenenhaus A, Strimmer K, Boulesteix A, (2010) Over-optimism in bioinformatics: an illustration. Bioinformatics 26: 1990-1998.
6. Boulesteix A, (2010) Over-optimism in bioinformatics research. Bioinformatics 26: 437-439.
7. Yousefi M, Hua J, Sima C, Dougherty E, (2010) Reporting bias when using real data sets to analyze classification performance. Bioinformatics 26: 68-76.
8. Hothorn T, Leisch F, Zeileis A, Hornik K, (2005) The design and analysis of benchmark experiments. Journal of Computational and Graphical Statistics 14: 675-699.
9. Eugster MJA, Hothorn T, Leisch F, (2012) Domain-based benchmark experiments: Exploratory and inferential analysis. Austrian Journal of Statistics 41: 5-26.
10. Dougherty E, Sima C, Hua J, Hanczar B, Braga-Neto U, (2010) Performance of error estimators for classification. Current Bioinformatics 5: 53.
11. Ross J, Mulvey G, Hines E, Nissen S, Krumholz H, (2009) Trial publication after registration in clinicaltrials.gov: a cross-sectional analysis. PLoS Medicine 6: e1000144.
12. de Souza B, de Carvalho A, Soares C (2010) A comprehensive comparison of ml algorithms for gene expression data classification. In: The 2010 International Joint Conference on Neural Networks (IJCNN). IEEE, 1-8.
13. Boulesteix AL, Hable R, Lauer S, Eugster MJE (2013) A statistical framework for hypothesis testing in real data. Technical Report 136, Department of Statistics, LMU: http://epub.ub.uni-muenchen.de/14324/.
14. Keiding N, (2010) Reproducible research and the substantive context. Biostatistics 11: 376-378.