A Methodology Using Fuzzy Logic to Optimize Feedforward Artificial Neural Network Configurations

IEEE Transactions on Systems, Man and Cybernetics

Volumn 24, Issue 5, 1994, Pages 760-768

  Sharpe, Robert N ^a   Chow, Mo yuen ^a   Briggs, Steve ^b   Windingland, Larry ^b  

^a NORTH CAROLINA STATE UNIVERSITY   (United States)

^b U S ARMY ENGINEER RESEARCH AND DEVELOPMENT CENTER   (United States)

Author keywords

Artificial neural networks; cost functions; fault detection; fuzzy logic; network configurations; robustness; sensitivity

Indexed keywords

FUZZY SETS; NEURAL NETWORKS;

COST FUNCTIONS; FAULT DETECTION; FUZZY LOGIC; NETWORK CONFIGURATIONS; OPTIMIZED FEEDFORWARD ARTIFICIAL NEURAL NETWORK;

ARTIFICIAL INTELLIGENCE;

EID: 0028423195     PISSN: 00189472     EISSN: 21682909     Source Type: Journal    
DOI: 10.1109/21.293489     Document Type: Article

References (33)

1. T. Ash, “Dynamic node creation in backpropagation networks (abstract),” in Proceedings of the International Joint Conference on Neural Networks, vol. 2, p. 623, 1989.
2. E. B. Baum and D. Haussler, “What size net gives valid generalization?,” Neural Computation, pp. 81–90, Jan. 1989.
3. R. E. Bellman and L. A. Zadeh, “Decision-making in a fuzzy environment,” Management Science, 17:4, pp. 141–164, Dec. 1970.
4. Y. Chauvin, “A back-propagation algorithm with optimal use of hidden units,” in Advances in Neural Information Processing Systems, I, D. S. Touretzky, Ed. San Mateo, CA: Morgan Kaufmann Publishers, pp. 519–526, 1989.
5. J. Y. Choi and C.-H. Choi, “Sensitivity analysis of multilayer perceptron with differentiable activation functions,” IEEE Transactions on Neural Networks, vol. 3, no. 1, pp. 101–107, Jan. 1992.
6. M. Y. Chow, P. M. Magnum and S. O. Yee, “A Neural Network Approach to Real-Time Condition Monitoring of Induction Motors,” IEEE Transactions on Industrial Electronics, vol. 2, no. 1 & 2, pp. 91–100, 1991.
7. M. Y. Chow and S. O. Yee, “Robustness test of an incipient fault detector artificial neural network,” presented at the International Joint Conference on Neural Networks, Seattle, WA, July 8–11, 1991.
8. M. Y. Chow and S. O. Yee, “Using neural networks to detect incipient faults in induction motors,” Journal of Neural Network Computing, Winter 1991.
9. G. Cybenko, “Approximation by superpositions of a sigmoidal function,” Mathematics of Control, Signals, and Systems, vol. 2, 1989.
10. D. B. Fogel, “An information criterion for optimal neural network selection,” IEEE Transactions on Neural Networks, vol. 2, no. 5, pp. 490–497, Sept. 1991.
11. Z. Guo and R. E. Uhrig, “Sensitivity analysis and applications to nuclear power plant,” in Proceedings of the International Joint Conference on Neural Networks, vol. 2, pp. 453–458, 1992.
12. M. M. Gupta, J. B. Kiszka and G. M. Trojan, “Multivariable structure of fuzzy control systems,” IEEE Transactions on Systems, Man, and Cybernetics, vol. SMC-16, pp. 638–656, 1986.
13. M. Gutierrez, J. Wang and R. Grondin, “Estimating hidden unit number for two-layer perceptrons,” in Proceedings of the International Joint Conference on Neural Networks, pp. 677–681, 1989.
14. S. J. Hanson and L. Y. Pratt, “Comparing biases for minimal network construction with back-propagation,” in Advances in Neural Information Processing Systems, I, D. S. Touretzky, Ed. San Mateo, CA: Morgan Kaufmann Publishers, pp. 177–185, 1989.
15. S.-C. Huang and Y.-F. Huang, “Bounds on the number of hidden neurons in multilayer perceptions,” IEEE Transactions on Neural Networks, vol. 2, no. 1, pp. 47–55, Jan. 1991.
16. E. D. Karnin, “A simple procedure for pruning back-propagation trained neural networks,” IEEE Transactions on Neural Networks, vol. 1, no. 2, pp. 239–242, Jun. 1990.
17. G. J. Klir and T. A. Folger, “Fuzzy Sets, Uncertainty, and Information.” New Jersey: Prentice Hall, 1988.
18. J. K. Kruschke, “Improving generalization in back—propagation networks with distributed bottlenecks,” in Proceedings of the International Joint Conference on Neural Networks, vol. 1, pp. 443–447, 1989.
19. J. K. Kruschke and J. R. Movellan, “Benefits of gain: Speeded learning and minimal hidden layers in back-propagation networks,” IEEE Transactions on Systems, Man, and Cybernetics, vol. 21, pp. 273–280, 1991.
20. S. Y. Kung and J. N. Hwang, “An algebraic projection analysis for optimal hidden units size and learning rates in back-propagation learning,” in Proceedings of the IEEE International Conference on Neural Networks, pp. 363–370, 1988.
21. C. C. Lee, “Fuzzy logic in control systems: Fuzzy logic controller, Part I,” IEEE Transactions on Systems, Man, and Cybernetics, vol. 20, no. 2, pp. 404–418, March/April 1990.
22. C. C. Lee, “Fuzzy logic in control systems: Fuzzy logic controller, Part II,” IEEE Transactions on Systems, Man, and Cybernetics, vol. 20, no. 2, pp. 419–435, March/April 1990.
23. J. Maiers and Y. S. Sherif, “Applications of fuzzy set theory,” IEEE Transactions on Systems, Man, and Cybernetics, vol. SMC-I5, pp. 175–189, 1985.
24. T. W. Miller, R. S. Sutton and P. J. Werbos, gen. ed., “Neural Networks for Control.” Massachusetts: The MIT Press, 1990.
25. M. C. Mozer, “Skeletonization: A technique for trimming the fat from a network via relevance assessment,” in Advances in Neural Information Processing Systems, I, D. S. Touretzky, Ed. San Mateo, CA: Morgan Kaufmann Publishers, 1989, pp. 107–115.
26. D. E. Rumelhart, G. E. Hinton, and R. J. Williams, “Learning internal representations by error propagation,” in D. E. Rumelhart and J. L. McClelland (Eds.), Parallel Distributed Processing: Explorations in the Microstructure of Cognition. vol. 1: Foundations. Massachusetts: The MIT Press, 1986.
27. M. A. Sartori and P. J. Antsaklis, “A simple method to derive bounds on the size and to train multilayer neural networks,” IEEE Transactions on Neural Networks, vol. 2, no. 4, pp. 467–471, Jul. 1991.
28. M. Stevenson, R. Winter and B. Widrow, “Sensitivity of feedforward neural networks to weight errors,” IEEE Transactions on Neural Networks, vol. 1, no. 1, pp. 71–80, Mar. 1990.
29. R. M. Tong and P. P. Bonissone, “A linguistic approach to decision making with fuzzy sets,” IEEE Transactions on Systems, Man, and Cybernetics, vol. SMC-10, pp. 716–723, 1980.
30. L. A. Zadeh, “Fuzzy Sets,” Information and Control, vol. 8, pp. 338–353, 1965.
31. L. A. Zadeh, “The concept of a linguistic variable and its application to approximate reasoning,” Parts 1 and 2, Information Sciences, vol. 8, PP. 199–249, 301–357, 1975.
32. L. A. Zadeh, “PRUF-A meaning representation language for natural languages,” Int. J. Man-Machine Studies, vol. 10, pp. 149–184, 1983.
33. H. J. Zimmermann, “Fuzzy Set Theory and Its Applications.” Massachusetts: Kluwer Academic Publishers, 1991.