Active testing strategy to predict the best classification algorithm via sampling and metalearning

Frontiers in Artificial Intelligence and Applications

Volumn 215, Issue , 2010, Pages 309-314

  Leite, Rui ^a   Brazdil, Pavel ^a  

^a UNIVERSITY OF PORTO   (Portugal)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE;

CLASSIFICATION ALGORITHM; COMPUTATIONAL COSTS; CROSS VALIDATION; DATA CHARACTERISTICS; KEY FEATURE; LEARNING CURVES; METALEARNING; PAIR-WISE COMPARISON; PARTIAL ORDER; TESTING STRATEGIES;

ITERATIVE METHODS;

EID: 77956031602     PISSN: 09226389     EISSN: 18798314     Source Type: Book Series    
DOI: 10.3233/978-1-60750-606-5-309     Document Type: Conference Paper

References (16)

1. A. Asuncion and D.J. Newman. UCI machine learning repository, 2007.
2. P. Brazdil, C. Giraud-Carrier, C.Soares, and R. Vilalta, Metalearning: Applications to Data Mining, Springer, 2009.
3. P. Brazdil, C. Soares, and J. Costa, 'Ranking learning algorithms: Using IBL and meta-learning on accuracy and time results', Machine Learning, 50, 251-277, (2003).
4. W.D. Cook, M. Kress, and L.W. Seiford, 'A general framework for distance-based consensus in ordinal ranking models', European Journal of Operational Research, 96(2), 392-397, (1996).
5. Joaquim P. Costa and Carlos Soares, 'A weighted rank measure of correlation', Australian and New Zealand Journal of Statistics, 47(4), 515-529, (2005).
6. Johannes Fürnkranz and Johann Petrak, 'An evaluation of landmarking variants', in Proceedings of the ECML/PKDD Workshop on Integrating Aspects of Data Mining, Decision Support and Meta-Learning (IDDM- 2001), pp. 57-68. Springer, (2001).
7. Mark Hall, Eibe Frank, Geoffrey Holmes, Bernhard Pfahringer, Peter Reutemann, and Ian H. Witten, 'The weka data mining software: an update', SIGKDD Explorations, 11(1), 10-18, (2009).
8. Rui Leite and Pavel Brazdil, 'Predicting relative performance of classifiers from samples', in ICML '05: Proceedings of the 22nd international conference on Machine learning, pp. 497-503, New York, NY, USA, (2005). ACM Press.
9. Rui Leite and Pavel Brazdil, 'An iterative process for building learning curves and predicting relative performance of classifiers', in Progress In Artificial Intelligence, Proceedings of the 13th Portuguese Conference on Artificial Intelligence Workshops (EPIA 2007), eds., J.Neves, M.F.Santos, and J.Machado, volume 4874 of Lecture Notes in Computer Science, pp. 87-98, Guimarães, Portugal, (December 2007). Springer.
10. Rui Leite and Pavel Brazdil, 'Selecting classifiers using metalearning with sampling landmarks and data characterization', in Proceedings of the Planning to Learn Workshop (PlanLearn 2008), held at ICML/COLT/UAI 2008, eds., P.Brazdil, A.Bernstein, and L.Hunter, pp. 35-41, Helsinki, Finland, (July 2008).
11. D. Ler, I.Koprinska, and S.Chawla, 'A new landmarker generation based on correlativity', in Proceedings of the IEEE International Conference on Machine Learning and Applications, pp. 178-185. IEEE Press, Louisville, USA, (2004).
12. D. Ler, I.Koprinska, and S.Chawla, 'Utilizing regression-based landmarkers within a meta-learning framework for algorithm selection', in Proceedings of the Workshop on Meta-Learning, associated with 22nd International Conference on Machine Learning, pp. 44-51, Bonn, Germany, (2005).
13. Metal project site. http://www.metal-kdd.org/, 1999.
14. D. Michie, D.J.Spiegelhalter, and C.C.Taylor, Machine Learning, Neural and Statistical Classification, Ellis Horwood, 1994.
15. C. Soares, Learning Rankings of Learning Algorithms, Ph.D. dissertation, Department of Computer Science, Faculty of Sciences, University of Porto, 2004.
16. Carlos Soares, Johann Petrak, and Pavel Brazdil, 'Sampling-based relative landmarks: Systematically test-driving algorithms before choosing', in Proceedings of the 10th Portuguese Conference on Artificial Intelligence (EPIA 2001), pp. 88-94. Springer, (2001).