Predicting relative performance of classifiers from samples

ICML 2005 - Proceedings of the 22nd International Conference on Machine Learning

Volumn , Issue , 2005, Pages 497-504

  Leite, Rui ^a   Brazdil, Pavel ^a  

^a UNIVERSITY OF PORTO   (Portugal)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; INFORMATION THEORY; METADATA; PROBLEM SOLVING;

EXPERIMENTAL EVALUATION; META-LEARNING;

LEARNING SYSTEMS;

EID: 31844442667     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1102351.1102414     Document Type: Conference Paper

References (20)

1. Bensussan, H., & Giraud-Carrier, C. (2000). Discovering task neighbourhoods through landmark learning performances. Proceedings of the Fourth European Conference on Principles and Practice of Knowledge Discovery in Databases (PKDD2000) (pp. 325-330). Springer.
2. Bensussan, H., & Kaloussis, A. (2001). Estimating the predictive accuracy of a classifier, in machine learning. Proceedings of the 12th European Conference on Machine Learning. Springer.
3. Blake, C., & Merz, C. (1998). UCI repository of machine learning databases. http://www.ics.uci.edu/~mlearn/mlrepository.html.
4. Brazdil, P., Soares, C., & Costa, J. (2003). Ranking learning algorithms: Using ibl and meta-learning on accuracy and time results. Machine Learning, 50, 251-277.
5. Breiman, L. (1996). Bias, variance, and arcing classifiers (Technical Report 460). Statistics Department, University of California.
6. Chang, C.-C., & Lin, C.-J. (2001). Libsvm: a library for support vector machines (version 2.31).
7. D. Michie, D. e. C. (1994). Machine learning; neural and statistical classification. Ellis Horwood.
8. Dimitriadou, E., Hornik, K., Leisch, F., Meyer, D., & Weingessel, A. (2004). e1071: Mise functions of the department of statistics (e1071), tu wien. R package version 1.5-1.
9. Fürnkranz, J., & Petrak, J. (2001). An evaluation of landmarking variants. Proceedings of the ECML/PKDD Workshop on Integrating Aspects of Data Mining, Decision Support and Meta-Learning (IDDM-2001) (pp. 57-68). Springer.
10. John, G., & Langley, P. (1996). Static versus dynamic sampling for data mining. Proceedings of the 2nd Int. Conf. on Knowledge Discovery and Data Mining. AAAI Press.
11. Kalousis, A., & Theoharis, T. (1999). Noemon: Design, implementation and performance results of an intelligent assistant for classifier selection. Intelligent Data Analysis, 3(50), 319-337.
12. Kolodner, J. (1993). Case-based reasoning. Morgan Kaufmann Publishers.
13. Leake, D. B. (1996). Case-based reasoning: Experiences, lessons & future directions. AAAI Press.
14. Leite, R., & Brazdil, P. (2004). Improving progressive sampling via meta-learning on learning curves. Proceedings of the 15th European Conference on Machine Learning - ECML 2004 (pp. 250-261). Springer.
15. MetaL (1999). Metal project site, http://www.metal-kdd.org/.
16. Pfahringer, B., Bensusan, H., & Giraud-Carrier, C. (2000). Meta-learning by landmarking various learning algorithms. Proceedings of the 17th International Conference on Machine Learning (ICML-2000) (pp. 743-750). Stanford, CA.
17. Provost, F., Jensen, D., & Oates, T. (1999). Efficient progressive sampling. Proceedings of Fifth Int. Conf. on Knowledge Discovery and Data Mining. AAAI Press.
18. Quinlan, R. (1998). C5.0 : 'an informal tutorial'.
19. R Development Core Team (2004). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. ISBN 3-900051-07-0.
20. Soares, C., Petrak, J., & Brazdil, P. (2001). Sampling-based relative landmarks: Systematically test-driving algorithms before choosing. Proceedings of the 10th Portuguese Conference on Artificial Intelligence (EPIA 2001) (pp. 88-94). Springer.