Parametric methods for comparing the performance of two classification algorithms evaluated by k-fold cross validation on multiple data sets

Pattern Recognition

Volumn 65, Issue , 2017, Pages 97-107

  Wong, Tzu Tsung ^a  

^a NATIONAL CHENG KUNG UNIVERSITY   (Taiwan)

Author keywords

Classification; k fold cross validation; Parametric method; Sampling distribution

Indexed keywords

CLASSIFICATION (OF INFORMATION); DEGREES OF FREEDOM (MECHANICS); STATISTICAL TESTS;

CLASSIFICATION ALGORITHM; CRITICAL ISSUES; K FOLD CROSS VALIDATIONS; MULTIPLE DATA SETS; NONPARAMETRIC METHODS; PARAMETRIC METHOD; SAMPLING DISTRIBUTION; TEST STATISTICS;

PARAMETER ESTIMATION;

EID: 85010685709     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2016.12.018     Document Type: Article

References (14)

1. [1] Demšar, J., Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 7 (2006), 1–30.
2. [2] García, S., Herrera, F., An extension on “statistical comparisons of classifiers over multiple data sets” for all pairwise comparisons. J. Mach. Learn. Res. 9 (2008), 2677–2694.
3. [3] García, S., Fernández, A., Luengo, J., Herrera, F., Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: experimental analysis of power. Inf. Sci. 180 (2010), 2044–2064.
4. [4] Dietterich, T.G., Approximate statistical tests for comparing supervised classification learning algorithms. Neural Comput. 10 (1998), 1895–1923.
5. [5] W.Mendenhall, R.J.Beaver, B.M.BeaverIntroduction to Probability and Statistics,14th Edition, Cengage Learning, 2013.
6. [6] Wong, T.T., Performance evaluation of classification algorithms by k-fold and leave-one-out cross validation. Pattern Recognit. 48 (2015), 2839–2846.
7. [7] Anderson, D.R., Sweeney, D.J., Williams, T.A., Camm, J.D., Cochran, J.J., Statistics for Business and Economics, 12thedition, 2012, South-Western, Tennessee.
8. [8] Casella, G., Berger, R.L., Statistical Inference, 2nd edition, 2002, Duxbury, California.
9. [9] Mitchell, T.M., Machine Learning. 1997, McGraw-Hill, New York.
10. [10] Tan, P.N., Steinbach, M., Kumar, V., Introduction to Data Mining. 2006, Addison Wesley, Massachusetts.
11. [11] Freund, R.J., Wilson, W.J., Mohr, D.L., Statistical Methods, 3rd edition, 2010, Academic Press, Massachusetts.
12. [12] Lichman, M., UCI machine learning repository. 2013, University of California, School of Information and Computer Sciences, Irvine 〈http://archive.ics.uci.edu/ml〉.
13. [13] Bowerman, B.L., O'Connell, R.T., Murphree, E.S., Business Statistics in Practice, 7th edition, 2014, McGraw-Hill, New York.
14. [14] Webb, G.I., Multiboosting: a technique for combining boosting and wagging. Mach. Learn. 40 (2000), 159–197.