Multiclass classifier from a combination of local experts: Toward distributed computation for real-problem classifiers

International Journal of Pattern Recognition and Artificial Intelligence

Volumn 18, Issue 5, 2004, Pages 801-817

  König, Christoph ^a,c   Gini, Giuseppina ^a   Craciun, Marian ^a   Benfenati, Emilio ^b  

^a POLITECNICO DI MILANO   (Italy)

^b Lab Environ Pharmacol Toxicol   (Italy)

^c BMW GROUP   (Germany)

Author keywords

Classification from regression; Mixture of experts; QSAR

Indexed keywords

CLASSIFICATION (OF INFORMATION); DATA ACQUISITION; PROBLEM SOLVING; REGRESSION ANALYSIS; TECHNOLOGY; TOXICITY;

CLASSIFICATION FROM REGRESSION; MIXTURE OF EXPERTS; QSAR; REAL-PROBLEM CLASSIFIERS;

EXPERT SYSTEMS;

EID: 8644279686     PISSN: 02180014     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0218001404003423     Document Type: Review

References (37)

1. C. Ambroise and G. J. McLachlan, Selection bias in gene extraction on the basis of microarray gene-expression data, Proc. Natl. Acad. Sci. 99 (1999) 6562-6566.
2. A. O. Aptula, T. I. Netzeva, I. V. Vlakova, M. T. D. Cronin, T. W. Schultz, R. Kühne and G. Schürmann, Multivariate discrimination between models of toxic action of phenols, QSAR 21 (2002) 12-22.
3. E. Bauer and R. Kohavi, An empirical comparison of voting classification algorithms: bagging, boosting, and variants, Mach. Learn. 36(1-2) (1999) 105-139.
4. E. Benfenati and G. Gini, Computational predictive programs (expert systems) in toxicology, Toxicology 119 (1997) 213-225.
5. E. Benfenati, P. Mazzatorta, D. Neagu and G. Gini, Combining classifiers of pesticides toxicity through a neuro-fuzzy approach, in Multiple Classifier Systems, eds. F. Roll and J. Kittler, Lecture Notes in Computer Science, Vol. 2364 (Springer, 2002) pp. 293-303.
6. S. P. Bradbury and R. L. Lipnick, Introduction: structural properties for determining mechanisms of toxic action, Environ. Health Persp. 87 (1990) 181-182.
7. P. Chan and S. Stolfo, Learning arbiter and combiner trees from partitioned data for scaling machine learning, in Proc. 1st Int. Conf. Knowledge Discovery and Data Mining, August 1995, pp. 39-44.
8. R. D. Combes and P. Judson, The use of artificial intelligence systems for predicting toxicity, Pestic. Sci. 45 (1995) 179-194.
9. J. C. Dearden, M. D. Barratt, R. Benigni et al., The development and validation of expert systems for predicting toxicity, ATLA 25 (1997) 223-252.
10. N. R. Draper and H. Smith, Applied Regression Analysis, 2nd edn. (John Wiley, NY, 1981).
11. ECOTOX, ECOTOXicology Database System, Prepared for the US Environmental Protection Agency, by OAO Corporation, Duluth, Minnesota, February 2000.
12. G. Gini and A. Katritzky (eds.), Predictive Toxicology of Chemicals: Experiences and Impact of Artificial Intelligence Tools (AAAI Press, Menlo Park, CA, USA, 1999).
13. G. Gini et al., Predictive carcinogenicity: a model for aromatic compounds, with nitrogen-containing substituents, based on molecular descriptors using an artificial neural network, J. Chem. Inform. Comput. Sci. 39 (1999) 1076-1080.
14. M. A. Hall, Correlation-based feature selection for machine learning, Ph.D. thesis, Department of Computer Science, University of Waikato, Hamilton, New Zealand, 1999.
15. C. Hansch, D. Hoekman, A. Leo, L. Zhang and P. Li, The expanding role of quantitative structure-activity relationships (QSAR) in toxicology, Toxicol. Lett. 79 (1995) 45-53.
16. T. K. Ho, Multiple classifier combination: lessons and next steps, in Hybrid Methods in Pattern Recognition, eds. A. Kandel and H. Bunke (World Scientific, 2002).
17. R. A. Jacob, M. I. Jordan, S. J. Nowlan and G. E. Hinton, Adaptive mixtures of local experts, Neural Comput. 3 (1991) 79-87.
18. A. Jain, P. Duin and J. Mao, Statistical pattern recognition: a review, IEEE Trans. PAMI 22(1) (2000) 4-37.
19. M. I. Jordan and R. A. Jacob, Mixtures of experts and the EM algorithm, Neural Comput. 6 (1994) 181-214.
20. K. L. E. Kaiser and S. P. Niculescu, Using probabilistic neural networks to model the toxicity of chemicals to the fathead minnow (pimephales promelas): a study based on 865 compounds, Chemosphere 38 (1999) 3237-3245.
21. J. Kittler, M. Hatef, R. Duin and J. Matas, On combining classifiers, IEEE Trans. Patt. Anal. Mach. Intell. 20(3) (1998) 226-239.
22. R. Kohavi and G. H. John, Wrappers for feature subset selection, Artif. Intell., special issue on relevance 97(1-2) (1996) 273-324.
23. I. Kononenko, Estimating attributes: analysis and extension of RELIEF, European Conf. Machine Learning, Catania, Italy, April 1994, pp. 171-182.
24. A. Krogh and J. Vedelsby, Neural network ensembles, cross validation and active learning, in Advances in Neural Information Processing Systems, Vol. 7, eds. G. Tesauro, D. S. Touretzky and T. K. Leen (MIT Press, Cambridge, MA, 1995).
25. P. Mazzatorta, E. Benfenati, D. Neagu and G. Gini, The importance of scaling in data mining for toxicity prediction, J. Chem. Inform. Comput. Sci. 42 (2002) 1250-1255.
26. J. M. McKim, S. P. Bradbury and G. J. Niemi, Fish acute toxicity syndromes and their use in the QSAR approach to hazard assessment, Environ. Health Persp. 87 (1987) 171-186.
27. D. Neagu and G. Gini, Neuro-fuzzy knowledge integration applied to toxicity prediction, in Innovations in Knowledge Engineering, eds. R. Jain et al. (Advanced Knowledge International Pte Ltd., Australia, 2003).
28. M. Pintore, N. Piclin, E. Benfenati, G. Gini and J. R. Chrétien, Predicting toxicity against the fathead minnow by adaptive fuzzy partition, QSAR Comb. Sci. 22 (2003) 210-219.
29. R. Quinlan, C4.5: Programs for Machine Learning (Morgan Kaufmann Publishers, San Mateo, CA, 1993).
30. F. Roll and G. Fumera, Analysis of linear and order statistics combiners for fusion of unbalanced classifiers, in Multiple Classifier Systems, eds. F. Roll and J. Kittler, Lecture Notes in Computer Science, Vol. 2364 (Springer, 2002) pp. 252-261.
31. A. Roncaglioni, A. Colombo, U. Maran, M. Karelson and E. Benfenati, Prediction of acute aquatic toxicity to fish comparing different QSAR approaches, Toxicol. Lett. 144 (2003) 52.
32. C. L. Russom, S. P. Bradbury, D. E. Hammermeister and S. J. Drummond, Predicting modes of toxic action from chemical structure: acute toxicity in the fathead minnow (pimephales promelas), Environ. Toxicol. Chem. 16 (1997) 948-967.
33. A. J. C. Sharkey, Combining Artificial Neural Nets - Ensemble and Modular Multi-Net Systems (Springer, London, 1999).
34. WEKA 3.2.3, www.cs.waikato.ac.nz/ml/weka.
35. I. H. Witten and E. Frank, Data Mining: Practical Machine Learning Tools and Techniques with Java Implementations (Morgan Kaufmann Publishers, San Francisco, CA, 1999).
36. D. H. Wolpert, Stacked generalization, Neural Networks 5 (1992) 241-259.
37. L. Xu and W.-J. Zhang, Comparison of different methods for variable selection, Anal. Chim. Acta 446 (2001) 475-481.