Designing neural network architectures for pattern recognition

Knowledge Engineering Review

Volumn 15, Issue 2, 2000, Pages 151-170

  Kubat, Miroslav ^a  

^a University of Louisiana at Lafayette   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTER ARCHITECTURE; FORMAL LOGIC; GENETIC ALGORITHMS; LEARNING SYSTEMS; PATTERN RECOGNITION;

REALISTIC PATTERN RECOGNITION;

NEURAL NETWORKS;

EID: 0034205581     PISSN: 02698889     EISSN: None     Source Type: Journal    
DOI: 10.1017/S0269888900002022     Document Type: Article

References (41)

1. Atlas, L, Cole, R, Muthusamy, Y, Lippman, A, Connor, J, Park, D, El-Sharkawi, M and Marks, RJ, 1990. "A performance comparison of trained multilayer perceptrons and trained classification trees" Proceedings of the IEEE 70 1614-1619.
2. Bala, JW, Michalski, RS and Pachowicz, PW, 1994. "Progress on vision through learning at George Mason University" Proceedings of the ARPA Image Understanding Workshop pp 191-207.
3. Bioch, JC, Carsouw, R and Potharst, R, 1995. "On the use of simple classifiers for the initialization of one-hidden-layer neural nets" Proceedings of the IEEE International Conference on Neural Networks (ICNN95) 4 1739-1743.
4. Breiman, L; 1996. "Bagging predictors" Machine Learning 24 123-140.
5. Brent RP, 1991. "Fast training algorithms for multilayer neural nets" IEEE Transactions on Neural Networks 2 346-354.
6. Broomhead, DS and Lowe, D, 1988. "Multivariable functional interpolation and adaptive networks" Complex Systems 2 321-355.
7. Duda, RO and Hart, PE, 1973. Pattern Classification and Scene Analysis. John Wiley & Sons.
8. Fahlman, SE and Lebiere, C, 1900. "The cascade-correlation learning architecture" In: Touretzky, DS (ed.), Advances in Neural Information Processing Systems 2. Morgan Kaufmann, pp 524-532.
9. Fisher, DH and McKusick, KB, 1989. "An empirical comparison of ID3 and backpropagation" Proceedings of the 11th International Joint Conference on AI, IJCAI'89 Detroit, MI, pp 788-793.
10. Fisher, DH, McKusick, KB, Mooney, R, Shavlik, JW and Towell, G, 1989. "Processing issues in comparisons of symbolic and connectionist learning systems" Proceedings of the 6th International Machine-Learning Workshop Ithaca, NY, pp 169-173.
11. Frean, M, 1990. "The Upstart algorithm: A method for constructing and training feed-forward neural networks" Neural Computation 2 198-209.
12. Freund, Y, 1990. "Boosting a weak learning algorithm by majority" Proceedings of the 1990 Workshop on Computational Learning Theory. Morgan Kaufmann, pp 202-216.
13. Freund, Y, 1995. "Boosting a weak learning algorithm by majority" Information and Computation 121 (2) 256-285.
14. Freund, Y and Schapire, RE, 1996. "Experiments with a new boosting algorithm" Proceedings of the 13th International Conference on Machine Learning, ICML'96. Morgan-Kaufmann, pp 148-156.
15. Freund, Y and Schapire, RE, 1997. "A decision-theoretic generalization of on-line learning and an application to boosting" Journal of Computer and System Sciences 55 119-139.
16. Goodman, RM, Higgins, CM, Miller, JW and Smyth, P, 1992. Neural Computation 4 781-804.
17. Haykin, S, 1994. Neural Networks, A Comprehensive Foundation. Maxmillan College Publishing Co., New York.
18. Hinton, GE, 1990. "Connectionist learning procedures" In: Carbonell, J (ed.), Machine Learning: Paradigms and Methods. MIT Press, pp 185-234.
19. Ivanova, I and Kubat, M, 1995. "Initialization of neural networks by means of decision trees" Knowledge-Based Systems 8 333-344.
20. Kubat, M, 1998. "Decision trees can initialize radial-basis function networks" IEEE Transactions on Neural Networks 9 813-821.
21. Kubat, M and Cooperson, M, Jr., 1999. "Initializing RBF-networks with small subsets of training examples" Proceedings of the 16th National Conference on Artificial Intelligence, AAAI-99 Orlando.
22. Le Cun, Y, Denker JS and Solla, SA, 1990. "Optimal brain damage" In: Touretzky, DS (ed.), Advances in Neural Information Procession Systems 2 598-605. Morgan Kaufmann.
23. Lee, TC, Peterson, AM and Tsai JC, 1990. "A multi-layer feed-forward neural network with dynamically adjustable structures" IEEE International Conference on Systems, Man, and Cybernetics Los Angeles, CA, pp 367-369.
24. Mozer, MC and Smolensky, P, 1989. "Skeletonization: A technique for trimming the fat from a network via relevance assessment" In: Touretzky, DS (ed.), Advances in Neural Information Procession Systems 1 107-115. Morgan Kaufmann.
25. Nguyen, D and Widrow, B, 1990. "Improving the learning speed of two-layer neural networks by choosing initial values of the adaptive weights" International Joint Conference on Neural Networks 2 San Diego, CA, pp 21-26.
26. Park, Y, 1994. "A mapping from linear tree classifiers to neural net classifiers" Proceedings of IEEE International Conference on Neural Networks Orlando, FL, I 94-100.
27. Quinlan, JR, 1993. C4.5: Programs for Machine Learning. Morgan Kaufmann.
28. Rosenblatt, M, 1958. "The Perceptron: A probabilistic model for information storage and organization in the brain" Psychological Review 65 386-408.
29. Rumelhart, DE and McClelland, JL, 1986. Parallel Distributed Processing. MIT Bradford Press.
30. Rumelhart, DE, Hinton, GE and Williams, RJ, 1986. "Learning internal representation by error back-propagation" In: Rumelhart, DE and McClelland, JL (eds.), Parallel Distribution Processing. MIT Bradford Press.
31. Russo, AP, 1991. "Neural networks for sonar signal processing" Tutorial No. 8, IEEE Conference on Neural Networks for Ocean Engineering Washington, DC.
32. Sahami, M, 1995. "Generating neural networks through the induction of threshold logic unit trees" Proceedings of the 8th European Conference on Machine Learning pp 339-342.
33. Sarkar, D, 1995. "Methods to speed up error back-propagation learning algorithms" ACM Computing Surveys 27 519-542.
34. Schapire, RE, 1990. "The strength of weak learnability" Machine Learning 5 197-227.
35. Sethi, IK, 1990. "Entropy nets: From decision trees to neural networks" Proceedings of the IEEE 78 1605-1613.
36. Towell, GC and Shavlik, JW, 1994. "Knowledge-based artificial neural networks" Artificial Intelligence (to appear).
37. Towell, GC, Shavlik, JW and Noordewier, MO, 1990. "Refinement of approximate domain theories by knowledge-based neural networks" Proceedings of the 8th National Conference on Artificial Intelligence, AAAI'90 pp 861-866.
38. Weigend, AS, Rumelhart, DE and Huberman, BA, 1991. "Generalization by weight-elimination with application to forcasting" In: Lippmann, RP, Moody, JE and Touretzky, DS (eds.), Advances in Neural Information Procession Systems 3. Morgan Kaufmann, pp 875-882.
39. Weiss, SM and Kapouleas, I, 1989. "An empirical comparison of pattern recognition, neural nets, and machine learning classification methods" Proceedings of the 11th International Joint Conference on Artificial Intelligence, IJCAI'89 Detroit, MI, pp 781-787.
40. Whitley and Schaffer (eds.), 1992. COGANN-92: International Workshop on Combinations of Genetic Algorithms and Neural Networks. IEEE Press.
41. Widrow, B and Hoff, ME, 1960. "Adaptive switching circuits" IRE WESCON Convention Record pp 96-104.