Simultaneous optimization of neural network function and architecture algorithm

Decision Support Systems

Volumn 36, Issue 3, 2004, Pages 283-296

  Sexton, Randall S ^a   Dorsey, Robert E ^a   Sikander, Naheel A ^b  

^a MISSOURI STATE UNIVERSITY   (United States)

^b FNC Inc   (United States)

Author keywords

Artificial intelligence; Backpropagation; Genetic algorithm; Neural networks; Parsimonious

Indexed keywords

ARTIFICIAL INTELLIGENCE; BACKPROPAGATION; DECISION MAKING; DECISION SUPPORT SYSTEMS; GENETIC ALGORITHMS; MONTE CARLO METHODS; MULTILAYER NEURAL NETWORKS;

NETWORK STRUCTURE;

FEEDFORWARD NEURAL NETWORKS;

EID: 0344585403     PISSN: 01679236     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0167-9236(02)00147-1     Document Type: Article

References (26)

1. Baum E.B., Haussler D. What size net gives valid generalization? Neural Computation. 1:1989;151-160.
2. Burkitt A.N. Optimisation of the architecture of feed-forward neural nets with hidden layers by unit elimination. Complex Systems. 5:1991;371-380.
3. Chan W.S., Tong H. On tests for non-linearity in time series analysis. Journal of Forecasting. 5:1986;217-228.
4. Cottrell M., Girard B., Girard Y., Mangeas M. Time series and neural network: a statistical method for weight elimination. Verlysen M. European Symposium on Artificial Neural Networks. 1993;157-164 D. facto, Brussels.
5. Davis L. Handbook of Genetic Algorithms. 1991;Van Nostrand-Reinhold, New York.
6. Dorsey R.E., Johnson J.D. Evolution of Dynamic Reconfigurable Neural Networks: Energy Surface Optimality Using Genetic Algorithms. Levine D.S., Elsberry W.R. Optimality in Biological and Artificial Networks. 1997;185-202 Lawrence Erlbaum Associates, Hillsdale, NJ.
7. Dorsey R.E., Mayer W.J. Genetic algorithms for estimation problems with multiple optima, non-differentiability, and other irregular features. Journal of Business and Economic Statistics. 13(1):1995;53-66.
8. Dorsey R.E., Johnson J.D., Mayer W.J. A genetic algorithm for the training of feedforward neural networks. Johnson J.D., Whinston A.B. Advances in Artificial Intelligence in Economics, Finance, and Management. Vol. 1:1994;93-111 JAI Press, Greenwich, CT.
9. Dorsey R.E., Johnson J.D., Van Boening M.V. The use of artificial neural networks for estimation of decision surfaces in first price sealed bid auctions. Cooper W.W., Whinston A.B. New Direction in Computational Economics. 1994;19-40 Kluwer Academic Publishing, Netherlands.
10. Drucker H., LeCun Y. Improving generalisation performance using double backpropagation. IEEE Transactions on Neural Networks. 3:1992;991-997.
11. Fahlman S.E., Lebiere C. The cascade-correlation learning architecture. Neural Information Processing Systems. 2:1990;524-532.
12. Fogel D.B. A comparison of evolutionary programming and genetic algorithms on selected constrained optimization problems. Simulation. 64(6):1995;399-406.
13. Kamimura R. Internal representation with minimum entropy in recurrent neural networks: minimizing entropy through inhibitory connections. Network Computation in Neural Systems. 4:1993;423-440.
14. Karmin E.D. A simple procedure for pruning back-propagation trained networks. IEEE Transactions on Neural Networks. 1:1990;239-242.
15. Kruschke J.K. Distributed bottlenecks for improved generalization in back-propagation networks. International Journal of Neural Networks Research and Applications. 1:1989;187-193.
16. Lendaris G.G., Harls I.A. Improved generalization in ANN's via use of conceptual graphs: A character recognition task as an example case. Proceedings IJCNN-90. 1990;551-556 IEEE, Piscataway, NJ.
17. Michalewicz Z. Genetic Algorithms+Data Structures=Evolution Programs. 1992;Springer, Berlin.
18. Montana D.J., Davis L. Training feedforward neural networks using genetic algorithms. Proceedings of the Third International Conference on Genetic Algorithms, Morgan Kaufmann, San Mateo, CA. 1989;379-384.
19. Moody J.O., Antsaklis P.J. The dependence identification neural network construction algorithm. IEEE Transactions on Neural Networks. 7(1):1996;3-15.
20. L. Prechelt, A study of experimental evaluations of neural network learning algorithm: Current research practice, Technical Report 19/94, Fakultat fur Informatik, Universitat Karlsruhe, D-76128 Karsruhe, Germany. Anonymous FTP:/pub/papers/techreports/1994/1994-19.ps.Z on ftp.ira.uka.de, 1994.
21. Romaniuk S.G. Pruning divide and conquer networks. Network: Computation in Neural Systems. 4:1993;481-494.
22. Schuster H. Deterministic Chaos: An Introduction. 1995;VCH, Weinheim.
23. Sexton R.S., Dorsey R.E., Johnson J.D. Toward a global optimum for neural networks: a comparison of the genetic algorithm and backpropagation. Decision Support Systems. 22:1998;171-185.
24. Sexton R.S., Alidaee B., Dorsey R.E., Johnson J.D. Global optimization for artificial neural networks: a tabu search application. European Journal of Operational Research. 106:1998;570-584.
25. Sexton R.S., Dorsey R.E., Johnson J.D. Optimization of neural networks: a comparative analysis of the genetic algorithm and simulated annealing. European Journal of Operational Research. 114:1999;589-601.
26. Yao X. Evolving artificial neural networks. Proceedings of the IEEE. 87(9):1999;1423-1447.