Decision forest: Combining the predictions of multiple independent decision tree models

Journal of Chemical Information and Computer Sciences

Volumn 43, Issue 2, 2003, Pages 525-531

  Tong, Weida ^a,c   Hong, Huixiao ^b   Fang, Hong ^b   Xie, Qian ^b   Perkins, Roger ^b  

^a NATIONAL CENTER FOR TOXICOLOGICAL RESEARCH   (United States)

^b NORTHROP GRUMMAN CORPORATION   (United States)

^c NCTR   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CHEMICALS; HORMONES; STATISTICAL METHODS; TREES (MATHEMATICS);

DECISION FOREST;

DECISION THEORY;

ESTROGEN RECEPTOR;

ALGORITHM; ANIMAL; ARTICLE; CHEMICAL MODEL; COMPARATIVE STUDY; DECISION TREE; FACTUAL DATABASE; FORECASTING; HUMAN; METABOLISM; PROTEIN BINDING; STRUCTURE ACTIVITY RELATION;

ALGORITHMS; ANIMALS; DATABASES, FACTUAL; DECISION TREES; FORECASTING; HUMANS; MODELS, CHEMICAL; PROTEIN BINDING; RECEPTORS, ESTROGEN; STRUCTURE-ACTIVITY RELATIONSHIP;

EID: 0037365123     PISSN: 00952338     EISSN: None     Source Type: Journal    
DOI: 10.1021/ci020058s     Document Type: Conference Paper

References (37)

1. Rusinko, A., III; Farmen, M. W.; Lambert, C. G.; Brown, P. L.; Young, S. S. Analysis of a large structure/biological activity data set using recursive partitioning. J. Chem. Inf. Comput. Sci. 1999, 39, 1017-1026.
2. Hawkins, D. M.; Young, S. S.; Rusinko, A., III Analysis of large structure-activity data set using recursive partitioning. Quant. Struct.-Act. Relat. 1997, 16, 296-302.
3. Morgan, J. N.; Sonquist, J. A. Problems in the analysis of survey data, and a proposal. J. Am. Statist Assoc. 1963, 58, 415-434.
4. Breiman, L.; Friedman, J.; Olshen, R.; Stone, C. Classification and regression trees; Chapman and Hall: 1984.
5. Breiman, L.; Friedman, J.; Olshen, R.; Stone, C.; Steinberg, D.; Colla, P. Cart: Classification and regression trees; 1995.
6. Lim, T.-S.; Loh, W.-Y. A Comparison of Prediction Accuracy, Complexity, and Training Time of Thirty-three Old and New Classification Algorithms; Cohen, W. W., Ed.; Kluwer Academic Publishers: 1999; pp 1-27.
7. (7) Shi, L. M.; Tong, W.; Fang, H.; Perkins, R.; Wu, J.; Tu, M.; Blair, R.; Branham, W.; Walker, J.; Waller, C.; Sheehan, D. An integrated "4-Phase" approach for setting endocrine disruption screening priorities - Phase I and II predictions of estrogen receptor binding affinity. SAR/QSAR Environ. Res. 2002, 13, 69-88.
8. Kass, G. V. An exploratory technique for investigating large quantities of categorical data. Appl. Stat. 1980, 29, 119-127.
9. Quinlan, J. C4.5: programs for machine learning; Morgan Kauffman: 1993.
10. Quinlan, J. R. Improved use of continuous attributes in C4.5. J. Artif. Intel. Res. 1996, 4, 77-90.
11. Clark, L. A.; Pregibon, D. Tree-based models; Chambers & Hastie: 1997; Chapter 9, pp 413-430.
12. Loh, W.-Y.; Vanichsetakul, N. Tree-structured classification via generalized discriminant analysis. J. Am. Statist. Assoc. 1988, 83, 715-728.
13. Loh, W.-Y.; Shih, Y. S. Split selection methods for classification trees. Statistica Sinica 1997, 7, 815-840.
14. Buntine, W.; Caruana, R. Introduction to IND version 2.1 and recursive partitioning; NASA Ames Research Center; 1992.
15. Murthy, S. K.; Kasif, S.; Salzberg, S. A system for induction of oblique decision trees. J. Artif. Intel. Res. 1994, 2, 1-32.
16. Brodley, C. E.; Utgoff, P. E. Multivariate decision trees. Mach. Learn. 1995, 19, 45-77.
17. Muller, W.; Wysotzki, F. Automatic construction of decision trees for classification. Ann. Oper. Res. 1994, 52, 231-247.
18. Muller, W.; Wysotzki, F. The decision-tree algorithm CAL5 based on a statistical approach to its splitting algorithm; Nakhaeizadeh, G., Taylor, C. C., Eds.; John Wiley & Sons: 1997; pp 45-65.
19. Holte, R. C. Very simple classification rules perform well on most commonly used datasets; 1993; Vol. 11, pp 63-90.
20. Blower, P.; Fligner, M.; Verducci, J.; Bjoraker, J. On combining recursive partitioning and simulated annealing to detect groups of biologically active compounds. J. Chem. Inf. Comput. Sci. 2002, 42, 393-404.
21. Izrailev, S.; Agrafiotis, D. A novel method for building regression tree models for QSAR based on artificial ant colony systems. J. Chem. Inf. Comput. Sci. 2001, 41, 176-180.
22. Bates, J. M.; Granger, C. W. J. The combination of forecasts. Oper. Res. Quart. 1969, 20, 451-468.
23. Opitz, D.; Shavlik, J. Actively searching for an effective neural-network ensemble. Connect. Sci. 1996, 8, 337-353.
24. Krogh, A.; Vedelsby, J. Neural network ensembles, cross validation and active learning; Tesauro, G., Touretzky, D., Leen, T., Eds.; MIT Press: 1995; Vol. 7, pp 231-238.
25. Maclin, R.; Shavlik, J. Combining the predictions of multiple classifiers; Using competitive learning to initialize neural networks. Proc. 14th Int. Joint Conf. Intel. 1995, 524-530.
26. Drucker, H.; Cortes, C. Boosting decision trees; MIT Press: 1996; Vol. 8, pp 479-485.
27. Quinlan, J. Bagging, boosting and c4.5. Proc. 13th Nat. Conf. Artif. Intel. 1996, 725-730.
28. Bunn, D. W. Expert use of forecasts: Bootstrapping and linear models; Wright, G., Ayton, P., Eds.; Wiley: 1987; pp 229-241.
29. Bunn, D. W. Combining forecasts. Eur. J. Operat. Res. 1988, 33, 223-229.
30. Clemen, R. T. Combining forecasts: A review and annotated bibliography. Int. J. Forecast. 1989, 5, 559-583.
31. Maclin, R.; Opitz, D. An empirical evaluation of Bagging and Boosting. Proc. 14th Nat. Conf. Artif. Intel. 1997, 546-551.
32. Breiman, L. Bagging predictors. Mach. Learn. 1996, 24, 123-140.
33. Freund, Y.; Schapire, R. Experiments with a new Boosting algorithm. Proc. 13th Int. Conf. Mach. Learn. 1996, 148-156.
34. Blair, R.; Fang, H.; Branham, W. S.; Hass, B.; Dial, S. L.; Moland, C. L.; Tong, W.; Shi, L.; Perkins, R.; Sheehan, D. M. Estrogen receptor relative binding affinities of 188 natural and xenochemicals: Structural diversity of ligands. Toxicol. Sci. 2000, 54, 138-153.
35. Branham, W. S.; Dial, S. L.; Moland, C. L.; Hass, B.; Blair, R.; Fang, H.; Shi, L.; Tong, W.; Perkins, R.; Sheehan, D. M. Binding of phytoestrogens and mycoestrogens to the rat uterine estrogen receptor. J. Nutrit. 2002, 132, 658-664.
36. Fang, H.; Tong, W.; Shi, L.; Blair, R.; Perkins, R.; Branham, W. S.; Dial, S. L.; Moland, C. L.; Sheehan, D. M. Structure activity relationship for a large diverse set of natural, synthetic and environmental chemicals. Chem. Res. Toxicol. 2001, 14, 280-294.
37. Hong, H.; Tong, W.; Fang, H.; Shi, L. M.; Xie, Q.; Wu, J.; Perkins, R.; Walker, J.; Branham, W.; Sheehan, D. Prediction of estrogen receptor binding for 58,000 chemicals using an integrated system of a tree-based model with structural alerts. Environ. Health Persp. 2002, 110, 29-36.