Multiobjective genetic algorithm partitioning for hierarchical learning of high-dimensional pattern spaces: A learning-follows-decomposition strategy

IEEE Transactions on Neural Networks

Volumn 9, Issue 5, 1998, Pages 822-830

  Kumar, Rajeev ^a,b   Rockett, Peter ^a  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

^b BIRLA INSTITUTE OF TECHNOLOGY AND SCIENCE   (India)

Author keywords

Genetic algorithms; Neural network architecture; Pattern classification; Pattern clustering methods

Indexed keywords

ALGORITHMS; GENETIC ALGORITHMS; HIERARCHICAL SYSTEMS; NEURAL NETWORKS; OPTIMIZATION; PATTERN RECOGNITION;

HIERARCHICAL LEARNING;

LEARNING SYSTEMS;

EID: 0032162432     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/72.712155     Document Type: Article

References (34)

1. L. B. Booker, D. E. Goldberg, and J. H. Holland, "Classifier systems and genetic algorithms," Artificial Intell., vol. 40, pp. 235-282, 1989.
2. F. Z. Brill, D. E. Brown, and W. N. Martin, "Fast genetic selection of features for neural network classifiers," IEEE Trans. Neural Networks, vol. 3, no. 2, pp. 324-328, 1992.
3. E I. Chang and R. P. Lippmann, "Using genetic algorithms to improve pattern classification performance," in Advances in Neural Information Processing System, vol. 3, R. P. Lippmann, J. E. Moody, and D. S. Touretzky, Eds. San Mateo, CA: Morgan Kaufmann, 1991, pp. 797-803.
4. K. A. DeJong and W. M. Spears, "Using genetic algorithms to solve NP-complete problems," in Proc. 3rd Int. Conf. Genetic Algorithms, 1989, pp. 124-132.
5. C. M. Fonseca and P. J. Fleming, "An overview of evolutionary algorithms in multiobjective optimization," Evolutionary Computation, vol. 3, no. 1, pp. 1-16, 1995.
6. J. H. Friedman, "A recursive partitioning decision role for nonparametric classification," IEEE Trans. Computers, vol. 26, no. 4, pp. 404-408, 1977.
7. K. Fukunaga, Introduction to Statistical Pattern Recognition, 2nd ed. San Diego, CA: Academic, 1990.
8. D. E. Goldberg, Genetic Algorithms in Search, Optimization and Machine Learning. Reading, MA: Addison-Wesley, 1989.
9. H. A. Gv̈enir and I. Sirin, "A genetic algorithm for classification by feature partitioning," in Proc. 5th Int. Conf. Genetic Algorithms, 1993, pp. 543-548.
10. L. Hansen and P. Salamon, "Neural network ensembles," IEEE Trans. Pattern Anal. Machine Intell., vol. 12, no. 10, pp. 993-1001, 1990.
11. E. G. Henrichon and K. S. Fu, "A nonparametric partitioning procedure for pattern classification," IEEE Trans. Computers, vol. 18, no. 7, pp. 614-624, 1969.
12. G. E. Hinton, "Connectionist learning procedures, "Artificial Intell., vol. 40, pp. 185-234, 1989.
13. K. Hornik, "Approximation capabilities of multilayer feedforward networks," Neural Networks, vol. 4, no. 2, pp. 251-257, 1991.
14. R. A. Jacobs, M. I. Jordan, and A. G. Barto, "Task decomposition through competition in a modular connectionist architecture: the what and where vision tasks," Cognitive Sci., vol. 15, pp. 219-250, 1991.
15. M. I. Jordan and R. A. Jacobs, "Hierarchical mixtures of experts and the EM algorithm," Neural Computation, vol. 6, no. 2, pp. 181-214, 1994.
16. L. N. Kanal, "Problem-solving models and search strategies for pattern recognition," IEEE Trans. Pattern Anal. Machine Intell., vol. 1, no. 2, pp. 193-201, 1979.
17. R. Kumar, W. C. Chen, and P. I. Rockett, "Bayesian labeling of image corner features using a grey-level corner model with a bootstrapped modular neural network," in Proc. IEE 5th Int. Conf. Artificial Neural Networks (ANN 97), pp. 82-87.
18. R. Kumar and P. I. Rockett, "ANCHOR - A connectionist architecture for hierarchical nesting of multiple heterogeneous neural nets," in Working Notes AAAI Workshop Integrating Multiple Learned Models (IMLM 96), pp. 59-65.
19. _, "Improved sampling of the pareto front in multiobjective genetic optimizations by neo-stationary evolution: A Pareto converging genetic algorithm," to be published.
20. C. A. Murthy and N. Chowdhury, "In search of optimal clusters using genetic algorithms," Pattern Recog. Lett., vol. 17, no. 8, pp. 825-832, 1996.
21. S. J. Nowlan, "Maximum likelihood competitive learning," in Advances in Neural Information Processing Systems, vol. 2, D. S. Touretzky, Ed. San Mateo, CA: Morgan Kaufmann, 1990.
22. E. Oja, "Neural networks, principal components and subspaces," Int. J. Neural Syst., vol. 1, no. 1, pp. 61-68, 1989.
23. D. C. Plaut and G. E. Hinton, "Learning sets of filters using backpropagation," Computer, Speech Languages, vol. 2, pp. 35-61, 1987.
24. S. Z. Selim and M. A. Ismail, "K-means type algorithms: A generalized convergence theorem and characterization of local optimality," IEEE Trans. Pattern Anal. Machine Intell., vol. 6, no. 1, pp. 81-87, 1984.
25. I. K. Sethi and G. P. R. Sarvarayudu, "Hierarchical classifier design using mutual information," IEEE Trans. Pattern Anal. Machine Intell., vol. 4, no. 4, pp. 441-445, 1982.
26. W. Siedlecki and J. Sklansky, "Constrained genetic optimization via dynamic reward-penalty balancing and its use in pattern recognition," in Proc. 3rd Int. Conf. Genetic Algorithms, 1989, pp. 141-150.
27. A. J. C. Sharkey, "On combining artificial neural nets," Connection Sci., vol. 8, nos. 3/4, pp. 299-313, 1996.
28. N. E. Sharkey and A. J. C. Sharkey, "An analysis of catastrophic interference," Connection Sci., vol. 7, nos. 3/4, pp. 301-329, 1995.
29. D. M. Y. Sommerville, An Introduction to the Geometry of N-Dimensions. New York: Dover, 1958.
30. R. S. Sutton, "Two problems with backpropagation and other steepest-descent learning procedures for networks," in Proc. 8th Annu. Conf. Cognitive Science Soc., 1986, pp. 823-831.
31. C. C. Taylor et al., "Dataset descriptions and results," in Machine Learning, Neural and Statistical Classification, D. Michie, D. J. Spiegelhalter, and C. C. Taylor, Eds. London, U.K.: Ellis Horwood, 1994, pp. 131-174.
32. A. Waibel, H. Sawai, and K. Shikano, "Modularity and scaling in large phonemic neural networks," IEEE Trans. Acoust., Speech, Signal Processing, vol. 37, no. 12, pp. 1888-1897, 1989.
33. A. S. Weigend and D. E. Rumelhart, "The effective dimension of the space of hidden units," in Proc. IEEE Int. J. Conf. Neural Networks, 1991, pp. 2069-2074.
34. D. Wolpert, "Stacked generalization," Neural Networks, vol. 5, no. 2, pp. 241-259, 1992.