Efficient sampling and handling of variance in tuning data mining models

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 7491 LNCS, Issue PART 1, 2012, Pages 195-205

  Koch, Patrick ^a   Konen, Wolfgang ^a  

^a Gummersbach Campus   (Germany)

Author keywords

Machine learning; parameter tuning; sampling; sequential parameter optimization; SVM

Indexed keywords

COMPUTATION TIME; DATA MINING MODELS; EFFICIENT SAMPLING; FITNESS FUNCTIONS; FITNESS LANDSCAPE; MODEL TRAINING; PARAMETER OPTIMIZATION; PARAMETER SPACES; PARAMETER-TUNING; REAL-WORLD APPLICATION; SURROGATE MODEL; SVM; TRAINING DATA;

ARTIFICIAL INTELLIGENCE; DATA MINING; GLOBAL OPTIMIZATION; HEALTH; LEARNING SYSTEMS; SAMPLING;

FUNCTION EVALUATION;

EID: 84866414175     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-32937-1_20     Document Type: Conference Paper

References (16)

1. Bartz-Beielstein, T., Lasarczyk, C., Preuss, M.: The SPO Toolbox. In: Bartz-Beielstein, et al. (eds.) Experimental Methods for the Analysis of Optimization Algorithms, pp. 337-360. Springer, Heidelberg (2010)
2. Bischl, B., Mersmann, O., Trautmann, H.: Resampling methods in model validation. In: Proc. WEMACS 2010, Joint to PPSN 2010, Krakow, p. 14 (2010)
3. Cochran, W.G.: Sampling techniques. Wiley-India (2007)
4. Daelemans, W., Hoste, V., De Meulder, F., Naudts, B.: Combined Optimization of Feature Selection and Algorithm Parameters in Machine Learning of Language. In: Lavrač, N., Gamberger, D., Todorovski, L., Blockeel, H. (eds.) ECML 2003. LNCS (LNAI), vol. 2837, pp. 84-95. Springer, Heidelberg (2003)
5. Efron, B.: Bootstrap methods: another look at the jackknife. The Annals of Statistics 7(1), 1-26 (1979)
6. Hansen, N., Ostermeier, A.: Completely derandomized self-adaptation in evolution strategies. Evolutionary Computation 9, 159-195 (2001)
7. Jain, A., Zongker, D.: Feature selection: Evaluation, application, and small sample performance. IEEE Transactions on PAMI 19(2), 153-158 (1997)
8. Karatzoglou, A., Smola, A., Hornik, K., Zeileis, A.: Kernlab - An S4 package for kernel methods in R. Technical report, Department of Statistics and Mathematics, WU Vienna University of Economics and Business, Vienna (2004)
9. Koch, P., Konen, W.: Stability issues in tuning very noisy functions. Submitted to PPSN 2012 Workshop on Automated Selection and Tuning of Algorithms (2012)
10. Konen, W., Koch, P., Flasch, O., Bartz-Beielstein, T., Friese, M., Naujoks, B.: Tuned data mining: A benchmark study on different tuners. In: Proc. GECCO 2011, Dublin, pp. 1995-2002. ACM (2011)
11. Lenth, R.V.: Some practical guidelines for effective sample size determination. The American Statistician 55(3), 187-193 (2001)
12. McKay, M.D., Beckman, R.J., Conover, W.J.: A comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics, 239-245 (1979)
13. Osuna, E., Freund, R., Girosi, F.: Training support vector machines: an application to face detection. In: IEEE Proc. CVPR 1997, pp. 130-136 (1997)
14. Raudys, S.J., Jain, A.K.: Small sample size effects in statistical pattern recognition. IEEE Transactions on PAMI 13(3), 252-264 (1991)
15. Schölkopf, B., Smola, A.J.: Learning with kernels: Support vector machines, regularization, optimization, and beyond. The MIT Press (2002)
16. Vapnik, V.: Statistical learning theory (1998)