On the use of neural network ensembles in QSAR and QSPR

Journal of Chemical Information and Computer Sciences

Volumn 42, Issue 4, 2002, Pages 903-911

  Agrafiotis, Dimitris K ^a   Cedeño, Walter ^a   Lobanov, Victor S ^a  

^a JOHNSON AND JOHNSON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ENSEMBLE METHODS;

ERROR ANALYSIS; NEURAL NETWORKS; OPTIMIZATION; STATISTICAL METHODS;

MOLECULAR STRUCTURE;

ARTICLE; ARTIFICIAL NEURAL NETWORK; COMPUTER PROGRAM; COMPUTER SIMULATION; FACTUAL DATABASE; QUANTITATIVE STRUCTURE ACTIVITY RELATION; VALIDATION STUDY;

COMPUTER SIMULATION; DATABASES, FACTUAL; NEURAL NETWORKS (COMPUTER); QUANTITATIVE STRUCTURE-ACTIVITY RELATIONSHIP; SOFTWARE;

EID: 0036628567     PISSN: 00952338     EISSN: None     Source Type: Journal    
DOI: 10.1021/ci0203702     Document Type: Article

References (50)

1. Aoyama, T.; Suzuki, Y.; Ichikawa, H. Neural networks applied to structure-activity relationships. J. Med. Chem. 1990, 33, 905-908.
2. Andrea, T.A.; Kalayeh, H. Application of neural networks in quantitative structure-activity relationships of dihydrofolate reductase inhibitors. J. Med. Chem. 1991, 34, 2824-2836.
3. So, S.-S.; Richards, W.G. Application of neural networks: quantitative structure-activity relationships of the derivatives of 2,4-diamino-5-(substituted-benzyl) pyrimidines as DHFR inhibitors. J. Med. Chem. 1992, 35, 3201-3207.
4. Ajay, A unified framework for Using neural networks to build QSARs. J. Med. Chem. 1993, 36, 3565-3671.
5. Wikel, J.H.; Dow, E.R. The use of neural networks for variable selection in QSAR. Bioorg. Med. Chem. Lett. 1993, 3, 645-651.
6. Gasteiger, J.; Zupan, J. Neural networks in chemistry. Angew. Chem., Int. Ed. Engl. 1993, 105(4), 503-527.
7. Zupan, J.; Gasteiger, J. Neural Networks for Chemists: An Introduction; VCH: Weinheim, 1993.
8. Burns, J.A.; Whitesides, G.M. Feed-forward neural networks in chemistry: mathematical systems for classification and pattern recognition. Chem. Rev. 1993, 93, 2583.
9. Manallak, D.T.; Ellis, D.D.; Livingston, D.J. Analysis of linear and nonlinear QSAR data using neural networks. J. Med. Chem. 1994, 37, 3758-3767.
10. Neural Networks in QSAR and Drug Design; Devillers, J., Ed.; Academic Press: New York, 1996.
11. So, S.-S.; Karplus, M. Evolutionary optimization in quantitative structure-activity relationship: an application of genetic neural networks. J. Med. Chem. 1996, 39, 1521-1530.
12. Hansch, L.; Leo, C. Exploring QSAR. Fundamentals and applications in chemistry and biology; American Chemical Society: Washington, DC, 1996.
13. Dunn, W.J.; Wold, S.; Edlund, U.; Hellberg, S. Multivariate structure-activity relationships between data from a battery of biological tests and an ensemble of structure descriptors: the PLS method. QSAR 1984, 3, 131-137.
14. Selwood, D.L.; Livingstone, D.J.; Comley, J.C.W.; O'Dowd, A.B.; Hudson, A.T.; Jackson, P.; Jandu, K.S.; Rose, V.S.; Stables, J.N. J. Med. Chem. 1990, 33, 136-142.
15. Burden, F.R.; Ford, M.G.; Whitley, D.C.; Winkler, D.A. Use of automatic relevance determination in QSAR studies using Bayesian neural networks. J. Chem. Info. Comput. Sci. 2000, 40, 1423-1430.
16. Sutter, J.M.; Dixon, S.L.; Jurs, P.C. Automated descriptor selection for quantitative structure-activity relationships using generalized simulated annealing. J. Chem. Inf. Comput. Sci. 1995, 35, 77-84.
17. Luke, B.T. Evolutionary programming applied to the development of quantitative structure-activity relationships and quantitative structure-property relationships. J. Chem. Inf. Comput. Sci. 1994, 34, 1279-1287.
18. Kubinyi, H. Variable selection in QSAR studies. I. An evolutionary algorithm. QSAR 1994, 13, 285-294.
19. Rogers, D.R.; Hopfinger, A.J. Application of genetic function approximation to quantitative structure-activity relationships and quantitative structure-property relationships. J. Chem. Inf. Comput. Sci. 1994, 34, 854-866.
20. Yasri, A.; Hartsough, D. Toward an optimal procedure for variable selection and QSAR model building. J. Chem. Inf. Comput. Sci. 2001, 41, 1218-1227.
21. Hasegawa, K.; Miyashita, Y.; Funatsu, K. GA strategy for variable selection in QSAR studies: GA-based PLS analysis of calcium channel antagonists. J. Chem. Inf. Comput. Sci. 1997, 37, 306-310.
22. Izrailev, S.; Agrafiotis, D.K. A novel method for building regression tree models for QSAR based on artificial ant colony systems. J. Chem. Inf. Comput. Sci. 2001, 41, 176-180.
23. Izrailev, S.; Agrafiotis, D.K. Variable selection for QSAR by artificial ant colony systems. SAR QSAR Environ. Res. 2002, 13, 417-423.
24. Agrafiotis, D.K.; Cedeno, W. Feature selection for structure-activity correlation using binary particle swarms. J. Med. Chem. 2002, 45, 1098-1107.
25. Nilsson, N.J. Learning Machines: Foundations of Trainable Pattern-Classifying Systems, McGraw-Hill: New York, 1965.
26. Breiman, L. Bagging predictors. Machine Learning 1996, 24, 123-140.
27. Feund, Y.; Schapire, R. A decision-theoretic generalization of online learning and an application to boosting. In Proceedings of the Second European Conference on Computational Learning Theory; Springer-Verlag: 1995; pp 23-37.
28. Wolpert, D.H. Stacked generalization. Neural Networks 1996, 8, 1341-1390.
29. Breiman, L. Stacked regressions. Machine Learning 1996, 24, 49-64.
30. Carney, J.G.; Cunningham, P. The NeuralBag algorihm: optimizing generalization performance in bagged neural networks. In Proceedings of the 7th European Symposium on Neural Networks; Verleysen, M., Ed.; Brussels, Belgium, 1997; pp 35-40.
31. Heskes, T. Balancing between bagging and bumping. In Advances in Neural Information Processing Systems; Mozer, M., Jordan, M., Petsche, T., Eds.; MIT Press: 1997; Vol. 9, pp 176-182.
32. Zhang, J. Developing robust nonlinear models through bootstrap aggregated neural networks. Neurocomputing 1999, 25, 93-113.
33. Geman, S.; Bienenstock, E.; Doursat, R. Neural networks and bias/variance dilemma. Neural Computation 1992, 4, 1-58.
34. Breiman, L. Some infinity theory fr predictor ensembles; Technical Report 577; Statistics Department, University of California: Berkeley, CA, 2000.
35. Breiman, L. Bias, variance and arcing classifiers; Technical Report 460; Statistics Department, University of California: Berkeley, CA, 1996.
36. Bauer, E.; Kohavi, R. An empirical comparison of voting classification algorithms: bagging, boosting, and variants. Machine Learning 1999, 36, 105-139.
37. Maclin, R.; Opitz, D. An empirical evaluation of bagging and boosting. In Proceedings of the 14th National Conference on Artificial Intelligence; Providence, RI, 1997.
38. Carney, J.G.; Cunningham, P. Confidence and prediction intervals for neural network ensembles. In Proceedings of the International Joint Conference on Neural Networks; 1999.
39. Tikhonov, A.N.; Arsenin, V.Y. Solutions of ill-posed problems; W.H. Winston: Washington, DC, 1977.
40. Poggio, T.; Girosi, F. Networks for approximation and learning. Proc. IEEE 1990, 78, 1481-1497.
41. Burden, F.R.; Winkler, D.A. Robust QSAR models using Bayesian regularized neural networks. J. Med. Chem. 1999, 42, 3183-3187.
42. Haykin, S. Neural networks; Macmillan: New York, 1994.
43. Selwood, D.L.; Livingstone, D.J.; Comley, J.C.W.; O'Dowd, A.B.; Hudson, A.T.; Jackson, P.; Jandu, K.S.; Rose, V.S.; Stables, J.N. J. Med. Chem. 1990, 33, 136-142.
44. Maddalena, D.J.; Johnson, G.A.R. J. Med. Chem. 1995, 38, 715-724.
45. Hirst, J.D.; King, R.D.; Sternberg, M.J.E. J. Comput.-Aided Mol. Design 1994, 8, 405-420.
46. Loukas, Y.L. Adaptive neuro-fuzzy inference system: an instant and architecture-free predictor for improved QSAR studies. J. Med. Chem. 2001, 44, 2772-2783.
47. Agrafiotis, D.K.; Bone, R.F.; Salemme, F.R.; Soll, R.M. United States Patents 5, 463, 564, 1995; 5, 574, 656, 1996; 5, 684, 711, 1997; and 5, 901, 069, 1999.
48. Copyright 3-Dimensional Pharmaceuticals, Inc., 1994-2000.
49. Opitz, D.; Maclin, R. Popular ensemble methods: an empirical study. J. Artific. Intell. Res. 1999, 11, 169-198.
50. Krogh, A.; Vedelsby, J. Neural network ensembles, cross-validation and active learning. In Advances in Neural Information Processing Systems 7; Tesauro, G., Touretzky, D., Lean, T., Eds.; MIT Press: 1995; pp 231-238.