Ensembles of multi-objective decision trees

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4701 LNAI, Issue , 2007, Pages 624-631

  Kocev, Dragi ^a   Vens, Celine ^b   Struyf, Jan ^b   Džeroski, Sašo ^a  

^a JO EF STEFAN INSTITUTE   (Slovenia)

^b UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

LEARNING SYSTEMS; MATHEMATICAL MODELS;

MULTI OBJECTIVE DECISION TREES; RANDOM FORESTS;

DECISION TREES;

EID: 38049132551     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-74958-5_61     Document Type: Conference Paper

References (28)

1. Caruana, R.: Multitask learning. Machine Learning 28, 41-75 (1997)
2. Blockeel, H., De Raedt, L., Ramon, J.: Top-down induction of clustering trees. In: Proc. of the 15th ICML, pp. 55-63 (1998)
3. Suzuki, E., Gotoh, M., Choki, Y.: Bloomy decision trees for multi-objective classification. In: Siebes, A., De Raedt, L. (eds.) PKDD 2001. LNCS (LNAI), vol. 2168, Springer, Heidelberg (2001)
4. Zenko, B., Džeroski, S., Struyf, J.: Learning predictive clustering rules. In: Proc. of the Workshop on KDID at the 16th ECML (2005)
5. Dietterich, T.: Ensemble methods in machine learning. In: Kittler, J., Roli, F. (eds.) MCS 2000. LNCS, vol. 1857, pp. 1-15. Springer, Heidelberg (2000)
6. Breiman, L.: Bagging predictors. Machine Learning 24(2), 123-140 (1996)
7. Karalič, A., Bratko, I.: First order regression. Machine Learning 26, 147-176 (1997)
8. Demšar, D., Debeljak, M., Lavigne, C.: Džeroski, S.: Modelling pollen dispersal of genetically modified oilseed rape within the field. In: The Annual Meeting of the Ecological Society of America (2005)
9. Džeroski, S., Colbach, N., Messean, A.: Analysing the effect of field characteristics on gene flow between oilseed rape varieties and volunteers with regression trees. In: Proc.of the 2nd Int'l Conference on Co-existence between GM and non-GM based agricultural supply chains (2005)
10. Demšar, D., Džeroski, S., Larsen, T., Struyf, J., Axelsen, J., Pedersen, M., Krogh, P.: Using multi-objective classification to model communities of soil microarthropods. Ecological Modelling 191(1), 131-143 (2006)
11. Blocked, H., Džeroski, S., Grbovié, J.: Simultaneous prediction of multiple chemical parameters of river water quality with Tilde. In: Zytkow, J.M., Rauch, J. (eds.) Principles of Data Mining and Knowledge Discovery. LNCS (LNAI), vol. 1704, pp. 32-40. Springer, Heidelberg (1999)
12. Džeroski, S., Demšar, D., Grbovié, J.: Predicting chemical parameters of river water quality from bioindicator data. Applied Intelligence 13(1), 7-17 (2000)
13. Breiman, L.: Random forests. Machine Learning 45(1), 5-32 (2001)
14. Hansen, L., Salamon, P.: Neural network ensembles. IEEE Trans. on Pattern Anal, and Mach. Intell. 12, 993-1001 (1990)
15. Freund, Y., Schapire, R.E.: Experiments with a new boosting algorithm. In: Proc. of the 13th ICML, pp. 148-156. Morgan Kaufmann, San Francisco (1996)
16. Breiman, L.: Using adaptive bagging to debias regressions. Technical report, Statistics Department, University of California, Berkeley (1999)
17. Ho, T., Hull, J., Srihari, S.: Decision combination in multiple classifier systems. IEEE Trans. on Pattern Anal, and Mach. Intell. 16(1), 66-75 (1994)
18. Kittler, J., Hatef, M., Duin, R., Matas, J.: On combining classifiers. IEEE Trans. on Pattern Anal, and Mach. Intell. 20(3), 226-239 (1998)
19. Breiman, L., Friedman, J., Olshen, R., Stone, C.: Classification and Regression Trees. Wadsworth, Belmont (1984)
20. Blockeel, H., Schietgat, L., Struyf, J., Džeroski, S., Clare, A.: Decision trees for hierarchical multilabel classification: A case study in functional genomics. In: Fürnkranz, J., Scheffer, T., Spiliopoulou, M. (eds.) PKDD 2006. LNCS (LNAI), vol. 4213, Springer, Heidelberg (2006)
21. Clare, A., King, R.: Knowledge discovery in multi-label phenotype data. In: Siebes, A., De Raedt, L. (eds.) PKDD 2001. LNCS (LNAI), vol. 2168, Springer, Heidelberg (2001)
22. Struyf, J., Džeroski, S.: Constraint based induction of multi-objective regression trees. In: Bonchi, F., Boulicaut, J.-F. (eds.) KDID 2005. LNCS, vol. 3933, pp. 222-233. Springer, Heidelberg (2006)
23. Bauer, E., Kohavi, R.: An empirical comparison of voting classification algorithms: Bagging, boosting, and variants. Machine Learning 36, 105 (1999)
24. Hettich, S., Blake, C.L., Merz, C.J.: UCI repository of machine learning databases (1998)
25. Wilcoxon, F.: Individual comparisons by ranking methods. Biometrics 1 (1945)
26. Sain, R.S., Carmack, P.S.: Boosting multi-objective regression trees. Computing Science and Statistics 34, 232-241 (2002)
27. Banfield, R., Hall, L., Bowyer, K., Kegelmeyer, W.: A comparison of decision tree ensemble creation techniques. IEEE Trans. on Pattern Anal, and Mach. Intell. 29(1), 173-180 (2007)
28. Kocev, D., Džeroski, S., Struyf, J.: Beam search induction and similarity constraints for predictive clustering trees. In: 5th Int'l Workshop on KDID: Revised Selected and Invited Papers (to appear, 2007)