Nonparametric statistical analysis of machine learning algorithms for regression problems

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 6276 LNAI, Issue PART 1, 2010, Pages 111-120

  Graczyk, Magdalena ^a   Lasota, Tadeusz ^b   Telec, Zbigniew ^a   Trawiński, Bogdan ^a  

^a WROCLAW UNIVERSITY OF TECHNOLOGY   (Poland)

^b WROC AW UNIVERSITY OF ENVIRONMENTAL AND LIFE SCIENCES   (Poland)

Author keywords

decision trees; KEEL; machine learning; neural networks; statistical regression; statistical tests

Indexed keywords

BENCHMARK DATASETS; DATA MINING SYSTEM; KEEL; MACHINE LEARNING ALGORITHMS; MACHINE-LEARNING; MULTIPLE COMPARISON; NON-PARAMETRIC STATISTICAL ANALYSIS; REGRESSION ALGORITHMS; REGRESSION PROBLEM; STATISTICAL REGRESSION;

DATA MINING; DECISION TREES; EXPERIMENTS; KNOWLEDGE BASED SYSTEMS; LEARNING SYSTEMS; NEURAL NETWORKS; REGRESSION ANALYSIS; STATISTICAL TESTS; STATISTICS;

LEARNING ALGORITHMS;

EID: 78449246613     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-15387-7_15     Document Type: Conference Paper

References (30)

1. Alcalá-Fdez, J., et al.: KEEL: A Software Tool to Assess Evolutionary Algorithms for Data Mining Problems. Soft Computing 13(3), 307-318 (2009)
2. Asuncion, A., Newman, D.J.: UCI Machine Learning Repository. University of California, School of Information and Computer Science, Irvine (2007), http://www.ics.uci.edu/~mlearn/MLRepository.html
3. Bergmann, G., Hommel, G.: Improvements of general multiple test procedures for redundant systems of hypotheses. In: Bauer, P., Hommel, G., Sonnemann, E. (eds.) Multiple Hypotheses Testing, pp. 100-115. Springer, Berlin (1988)
4. Demšar, J.: Statistical comparisons of classifiers over multiple data sets. Journal of Machine Learning Research 7, 1-30 (2006)
5. Dunn, O.J.: Multiple comparisons among means. Journal of the American Statistical Association 56(238), 52-64 (1961)
6. Friedman, M.: The use of ranks to avoid the assumption of normality implicit in the analysis of variance. J. of the American Statistical Assoc. 32(200), 675-701 (1937)
7. García, S., Fernandez, A., Luengo, J., Herrera, F.: A Study of Statistical Techniques and Performance Measures for Genetics-Based Machine Learning: Accuracy and Interpretability. Soft Computing 13(10), 959-977 (2009)
8. García, S., Herrera, F.: An Extension on "Statistical Comparisons of Classifiers over Multiple Data Sets" for all Pairwise Comparisons. Journal of Machine Learning Research 9, 2677-2694 (2008)
9. Graczyk, M., Lasota, T., Trawiński, B.: Comparative Analysis of Premises Valuation Models Using KEEL, RapidMiner, and WEKA. In: Nguyen, N.T., Kowalczyk, R., Chen, S.-M. (eds.) ICCCI 2009. LNCS (LNAI), vol. 5796, pp. 800-812. Springer, Heidelberg (2009)
10. Güvenir, H.A., Uysal, I.: Function Approximation Repository, Bilkent University (2000), http://funapp.cs.bilkent.edu.tr
11. Hochberg, Y.: A sharper Bonferroni procedure for multiple tests of significance. Biometrika 75, 800-803 (1988)
12. Holm, S.: A simple sequentially rejective multiple test procedure. Scandinavian Journal of Statistics 6, 65-70 (1979)
13. Hommel, G., Bernhard, G.: A rapid algorithm and a computer program for multiple test procedures using procedures using logical structures of hypotheses. Computer Methods and Programs in Biomedicine 43, 213-216 (1994)
14. Iman, R.L., Davenport, J.M.: Approximations of the critical region of the Friedman statistic. Communications in Statistics 18, 571-595 (1980)
15. KEEL (Knowledge Extraction based on Evolutionary Learning), KEEL-dataset, http://www.keel.es
16. Krzystanek, M., Lasota, T., Trawiński, B.: Comparative Analysis of Evolutionary Fuzzy Models for Premises Valuation Using KEEL. In: Nguyen, N.T., Kowalczyk, R., Chen, S.-M. (eds.) ICCCI 2009. LNCS (LNAI), vol. 5796, pp. 838-849. Springer, Heidelberg (2009)
17. Lasota, T., Makos, M., Trawiński, B.: Comparative Analysis of Regression Tree Models for Premises Valuation Using Statistica Data Miner. In: Nguyen, N.T., et al. (eds.) New Challenges in Computational Collective Intelligence. SCI, vol. 244, pp. 337-348. Springer, Berlin (2009)
18. Lasota, T., Mazurkiewicz, J., Trawiński, B., Trawiński, K.: Comparison of Data Driven Models for the Validation of Residential Premises using KEEL. International Journal of Hybrid Intelligent Systems 7(1), 3-16 (2010)
19. Lasota, T., Sachnowski, P., Trawiński, B.: Comparative Analysis of Regression Tree Models for Premises Valuation Using Statistica Data Miner. In: Nguyen, N.T., Kowalczyk, R., Chen, S.-M. (eds.) ICCCI 2009. LNCS, vol. 5796, pp. 776-787. Springer, Heidelberg (2009)
20. Luengo, J., García, S., Herrera, F.: A Study on the Use of Statistical Tests for Experimentation with Neural Networks: Analysis of Parametric Test Conditions and Non-Parametric Tests. Expert Systems with Applications 36, 7798-7808 (2009)
21. Nemenyi, P.B.: Distribution-free Multiple comparisons. PhD thesis, Princeton University (1963)
22. Salzberg, S.L.: On Comparing Classifiers: Pitfalls to Avoid and a Recommended Approach. Data Mining and Knowledge Discovery 1, 317-327 (1997)
23. Shaffer, J.P.: Modified sequentially rejective multiple test procedures. Journal of the American Statistical Association 81(395), 826-831 (1986)
24. Shaffer, J.P.: Multiple hypothesis testing. Ann. Rev. of Psych. 46, 561-584 (1995)
25. Sheskin, D.J.: Handbook of Parametric and Nonparametric Statistical Procedures, 4th edn. Chapman & Hall/CRC, Boca Raton (2007)
26. Torgo, L.: University of Porto (LIACC), Regression DataSets, http://www.liaad.up.pt/~ltorgo/Regression/DataSets.html
27. Wilcoxon, F.: Individual comparisons by ranking methods. Biometrics 1, 80-83 (1945)
28. Wright, S.P.: Adjusted p-values for simultaneous inference. Biometrics 48, 1005-1013 (1992)
29. Yeh, I.-C.: Modeling of strength of high performance concrete using artificial neural networks. Cement and Concrete Research 28(12), 1797-1808 (1998)
30. Zar, J.H.: Biostatistical Analysis, 5th edn. Prentice-Hall, Englewood Cliffs (2009)