Task decomposition and module combination based on class relations: A modular neural network for pattern classification

IEEE Transactions on Neural Networks

Volumn 10, Issue 5, 1999, Pages 1244-1256

  Lu, Bao Liang ^a   Ito, Masami ^b  

^a RIKEN BRAIN SCIENCE INSTITUTE   (Japan)

^b INST OF PHYS AND CHEMICAL RESEARCH   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

LEARNING SYSTEMS; PATTERN RECOGNITION;

MIN-MAX MODULAR NEURAL NETWORK; TASK DECOMPOSITION;

NEURAL NETWORKS;

EID: 0032594843     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/72.788664     Document Type: Article

References (31)

1. R. Anand, K. G. Mehrotra, C. K. Mohan, and S. Ranka, "An improved algorithm for neural-network classification of imbalanced training sets," IEEE Trans. Neural Networks, vol. 4, pp. 962-963, 1993.
2. _, "Efficient classification for multiclass problems using modular neural networks," IEEE Trans. Neural Networks, vol. 6, pp. 117-124, 1995.
3. J. A. Anderson, An Introduction to Neural Networks. Cambridge, MA: MIT Press, 1995.
4. Y. Bennani and P. Gallinari, "Task decomposition through a modular connectionist architecture: A talker identification system," in Proc. 3rd Int. Conf. Artificial Neural Networks, I. Aleksander and J. Taylor, Eds., vol. 1. Amsterdam, The Netherlands: North-Holland, Sept. 4-7, 1992, pp. 783-786.
5. M. R. Berthold and J. Diamond, "Constructive training of probabilistic neural networks," Neurocomputing, vol. 19, pp. 167-183, 1998.
6. C. H. Chen and G. H. You, "Class-sensitive neural network," Neural Parallel Scie. Comput., vol. 1, no. 1, pp. 93-96, 1993.
7. T. H. Cormen, C. E. Leiserson, and R. L. Rivest, Introduction to Algorithms. Cambridge, MA: MIT Press, 1990.
8. R. O. Duda and P. E. Hart, Pattern Classification and Scene Analysis. New York: Wiley, 1973.
9. J. H. Friedman, "Another approach to polychotomous classification," Stanford University, Stanford, CA, Tech. Rep., 1996.
10. K. Fukunaga, Introduction to Statistical Pattern Recognition, 2nd ed. San Diego, CA: Academic, 1990.
11. P. Gallinari, "Modular neural net systems, training of," in The Handbook of Brain Theory and Neural Networks, M. A. Arbib, Ed. Cambridge, MA: MIT Press, 1995, pp. 582-585.
12. S. Ishihara and T. Nagano, "Text-independent speaker recognition utilizing neural-network techniques," Tech. Rep. IEICE, vol. NC93-121, pp. 71-77, 1994, in Japanese.
13. R. A. Jacobs, M. I. Jordan, M. I. Nowlan, and G. E. Hinton, "Adaptive mixtures of local experts," Neural Comput., vol. 3, pp. 79-87, 1991.
14. R. A. Jacobs, M. I. Jordan, and A. Barto, "Task decomposition competition in a modular connectionist architecture," Cognitive Sci., vol. 15, pp. 219-250, 1991.
15. R. Jenkins and B. Yuhas, "A simplified neural-network solution through problem decomposition: The case of the truck backer-upper," IEEE Trans. Neural Networks, vol. 4, pp. 718-722, 1993.
16. K. Lang and M. Witbrock, "Learning to tell two spirals apart," in Proc. 1988 Connectionist Models Summer School. San Mateo, CA: Morgan Kaufmann, June 17-26, 1988, pp. 52-59.
17. B. L. Lu, Y. Bai, H. Kita, and Y. Nishikawa, "An efficient multilayer quadratic perceptron for pattern classification and function approximation," in Proc. Int. Joint Conf. Neural Networks, Nagoya, Japan, Oct. 25-29, 1993, pp. 1385-1388.
18. B. L. Lu, H. Kita, and Y. Nishikawa, "A multisieving neural-network architecture that decomposes learning tasks automatically," in Proc. IEEE Conf. Neural Networks, Orlando, FL, June 28-July 2, 1994, pp. 1319-1324.
19. B. L. Lu, "Architectures, learning and inversion algorithms for multilayer neural networks," Ph.D. dissertation, Dept. Elect. Eng., Kyoto Univ., Japan, 1994.
20. B. L. Lu, K. Ito, H. Kita, and Y. Nishikawa, "A parallel and modular multisieving neural-network architecture for constructive learning," in Proc. Inst. Elect. Eng. 4th Int. Conf. Artificial Neural Networks, Cambridge, U.K., June 26-28, 1995, pp. 92-97.
21. B. L. Lu and M. Ito, "Task decomposition based on class relations: A modular neural-network architecture for pattern classification," in Biological and Artificial Computation: From Neuroscience to Technology, Lecture Notes in Computer Science, J. Mira, R. Moreno-Diaz, and J. Cabestany, Eds., vol. 1240. New York: Springer-Verlag, 1997, pp. 330-339.
22. C. J. Merz and P. M. Murphy, "UCI Repository of machine learning databases," Univ. California, Dept. Inform. Comput. Sci., Irvine, CA, 1996. Available http://www.ics.uci.edu/ mlearn/MLRepository.html
23. D. Michie, D. J. Spiegelhalter, and C. C. Taylor, Eds., Machine Learning, Neural and Statistical Classification. Chicester, U.K.: Ellis Horwood, 1994.
24. M. Minsky and S. Papert, Perceptrons: An Introduction to Computational Geometry, Expanded ed. Cambridge, MA: MIT Press, 1988.
25. J. M. J. Murre, Learning and Categorization in Modular Neural Networks. London, U.K.: Harvester Wheatsheaf, 1992.
26. N. J. Nilsson, Learning Machines: Foundations of Trainable Pattern Classifying Systems. New York: McGraw-Hill, 1965; reissued as The Mathematical Foundations of Learning Machines. San Mateo, CA: Morgan Kaufmann, 1990.
27. D. R. Rumelhart, G. E. Hinton, and R. J. Williams, "Learning internal representations by error propagation," in Parallel Distributed Processing: Explorations in the Microstructure of Cognition, D. E. Rumelhart, J. L. McClelland, and PDP Research Group, Eds. Cambridge, MA: MIT Press, 1986.
28. P. K. Simpson, "Fuzzy min-max neural networks - Part 1: classification," IEEE Trans. Neural Networks, vol. 3, pp. 776-786, 1992.
29. S. Thiria, C. Mejia, F. Badran, and M. Crepon, "Multimodular architecture for remote sensing operations," Advances in Neural Information Processing Systems 4, J. E. Moody, S. J. Hanson, and R. P. Lippmann Eds. San Mateo, CA: Morgan Kaufmann, 1992, pp. 675-682.
30. A. Waibel, H. Sawai, and K. Shkano, "Modularity and scaling in large phonemic neural networks," IEEE Trans. Acoust., Speech, Signal Processing, vol. 37, 1989.
31. X. Zhang, C. C. Hang, S. Tan, and P. Z. Wang, "The min-max function differentiation and training of fuzzy neural networks," IEEE Trans. Neural Networks, vol. 7, pp. 1139-1150, 1992.