Are artificial neural networks white boxes?

IEEE Transactions on Neural Networks

Volumn 16, Issue 4, 2005, Pages 844-852

  Kolman, Eyal ^a   Margaliot, Michael ^a  

^a TEL AVIV UNIVERSITY   (Israel)

Author keywords

Feedforward neural networks; Hybrid intelligent systems; Knowledge based networks; Rule extraction; Rule generation; Rule refinement

Indexed keywords

ARTIFICIAL INTELLIGENCE; FUZZY SETS; KNOWLEDGE BASED SYSTEMS; MATHEMATICAL MODELS;

HYBRID INTELLIGENT SYSTEMS; KNOWLEDGE BASED NETWORKS; RULE EXTRACTION; RULE GENERATION; RULE REFINEMENT;

FEEDFORWARD NEURAL NETWORKS;

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; BIOLOGICAL MODEL; COMPUTER ANALYSIS; COMPUTER SIMULATION; DECISION SUPPORT SYSTEM; EVALUATION; FUZZY LOGIC; MATHEMATICAL COMPUTING; METHODOLOGY; STATISTICAL MODEL; STATISTICS;

ALGORITHMS; COMPUTER SIMULATION; COMPUTING METHODOLOGIES; DECISION SUPPORT TECHNIQUES; FUZZY LOGIC; MODELS, BIOLOGICAL; MODELS, STATISTICAL; NEURAL NETWORKS (COMPUTER); NUMERICAL ANALYSIS, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; STOCHASTIC PROCESSES;

EID: 23044508082     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2005.849843     Document Type: Article

References (37)

1. J. V. Tu, "Advantages and disadvantages of using artificial neural networks versus logistic regression for predicting medical outcomes," J. Clin. Epidemiol., vol. 49, pp. 1225-1231, 1996.
2. D. Dubois, H. T. Nguyen, H. Prade, and M. Sugeno, "Introduction: The real contribution of fuzzy systems," in Fuzzy Systems: Modeling and Control, H. T. Nguyen and M. Sugeno, Eds. Norwell, MA: Kluwer, 1998, pp. 1-17.
3. E. Tron and M. Margaliot, "Mathematical modeling of observed natural behavior: A fuzzy logic approach," Fuzzy Sets Syst., vol. 146, pp. 437-450, 2004.
4. L. A. Zadeh, "Fuzzy logic = computing with words," IEEE Trans. Fuzzy Syst., vol. 4, no. 2, pp. 103-111, May 1996.
5. S. Mitra and Y. Hayashi, "Neuro-fuzzy rule generation: Survey in soft computing framework," IEEE Trans. Neural Netw., vol. 11, no. 3, pp. 748-768, May 2000.
6. J.-S. R. Jang, C.-T. Sun, and E. Mizutani, Neuro-Fuzzy and Soft Computing: A Computational Approach to Learning and Machine Intelligence. Englewood Cliffs, NJ: Prentice-Hall, 1997.
7. J.-S. R. Jang and C.-T Sun, "Functional equivalence between radial basis function networks and fuzzy inference systems" IEEE Trans. Neural Netw., vol. 4, no. 1, pp. 156-159, Jan. 1993.
8. H. C. Anderson, A. Lotfi, and L. C. Westphal, "Comments on "Functional equivalence between radial basis function networks and fuzzy inference systems", IEEE Trans. Neural Netw., vol. 9, no. 6, pp. 1529-1531, Nov. 1998.
9. J. M. Benitez, J. L. Castro, and I. Requena, "Are artificial neural networks black boxes?," IEEE Trans. Neural Netw., vol. 8, no. 5, pp. 1156-1164, Sep. 1997.
10. J. L. Castro, C. J. Mantas, and J. M. Benitez, "Interpretation of artificial neural networks by means of fuzzy rules," IEEE Trans. Neural Netw., vol. 13, no. 1, pp. 101-116, Jan. 2002.
11. D. Zhang, X.-L. Bai, and K.-Y. Cai, "Extended neuro-fuzzy models of multilayer perceptrons," Fuzzy Sets Syst., vol. 142, pp. 221-242, 2004.
12. M. Margaliot and G. Langholz, New Approaches to Fuzzy Modeling and Control - Design and Analysis. Singapore: World Scientific, 2000.
13. M. Margaliot and G. Langholz, "Hyperbolic optimal control and fuzzy control," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 29, no. 1, pp. 1-10, Jan. 1999.
14. S. I. Gallant, "Connectionist expert systems," in Comm. ACM, vol. 31, 1988, pp. 152-169.
15. G. Towell, J. Shavlik, and M. Noordenier, "Refinement of approximate domain theories by knowledge based neural network," in Proc. 8th Nat. Conf. Artificial Intelligence, 1990, pp. 861-866.
16. L. M. Fu, "Learning capacity and sample complexity on expert networks," IEEE Trans. Neural Netw., vol. 7, no. 6, pp. 1517-1520, Nov. 1996.
17. S. Snyders and C. W. Omlin, "What inductive bias gives good neural network training performance?," in Proc. IEEE-INNS-ENNS Int. Joint Conf. Neural Networks (IJCNN'00), Como, Italy, 2000, pp. 445-450.
18. M. Ishikawa, "Structural learning and role discovery," in Knowledge-Based Neuro-computing, I. Cloete and J. M. Zurada, Eds. Cambridge, MA: MIT Press, 2000, pp. 153-206.
19. A. Tickle, R. Andrews, M. Golea, and J. Diederich, "The truth will come to light: Directions and challenges in extracting the knowledge embedded within trained artificial neural networks," IEEE Trans. Neural Netw., vol. 9, no. 6, pp. 1057-1068, Nov. 1998.
20. R. Andrews, J. Diederich, and A. B. Tickle, "Survey and critique of techniques for extracting rules from trained artificial neural networks," Knowl.-Based Syst., vol. 8, pp. 373-389, 1995.
21. I. Cloete, Knowledge-Based Neurocomputing, J. M. Zurada, Ed. Cambridge, MA: MIT Press, 2000.
22. H. Tsukimoto, "Extracting roles from trained neural networks," IEEE Trans. Neural Netw., vol. 11, no. 2, pp. 377-389, Mar. 2000.
23. L. A. Zadeh, "The concept of a linguistic variable and its application to approximate reasoning," Inf. Sci., vol. 30, pp. 199-249, 1975.
24. P. Baranyi and Y. Yam, "Fuzzy role base reduction," in Fuzzy IF-THEN Rules in Computational Intelligence: Theory and Applications, D. Ruan and E. E. Kerre, Eds. Norwell, MA: Kluwer, 2000, pp. 135-160.
25. Y. Jin, "Fuzzy modeling of high-dimensional systems: Complexity reduction and interpretability improvement," IEEE Trans. Fuzzy Syst., vol. 8, no. 2, pp. 212-221, Apr. 2000.
26. Y. Jin, W. Von Seelen, and B. Sendhoff, "On generating FC3 fuzzy role systems from data using evolution strategies," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 29, no. 6, pp. 829-845, Dec. 1999.
27. K. Saito and R. Nakano, "Rule extraction from facts and neural networks," in Proc. Int. Neural Networks Conf. (INNC90), Paris, France, 1990, pp. 379-382.
28. R. Setiono, "Extracting rules from neural networks by pruning and hidden-unit splitting" Neural Computat., vol. 9, pp. 205-225, 1997.
29. Z.-H. Zhou, S.-F. Chen, and Z.-Q. Chen, "A statistics based approach for extracting priority rules from trained neural networks," in Proc. IEEE-INNS-ENNS Int. Joint Conf. Neural Networks (IJCNN'O0), Como, Italy, 2000, pp. 401-406.
30. G. Schmitz, C. Aldrich, and F. Gouws, "Extraction of decision trees from artificial neural networks" in Knowledge-Based Neurocomputing, I. Cloete and J. M. Zurada, Eds. Cambridge, MA: MIT Press, 2000, pp. 369-401.
31. C. M. Bishop, Neural Networks for Pattern Recognition. Oxford, U.K.: Oxford Univ. Press, 1995.
32. W. Duch, R. Adamczak, and K. Grabczewski, "Extraction of logical rules from neural network," Neural Process. Lett., vol. 7, pp. 211-219, 1998.
33. G. Towell and J. Shavlik, "The extraction of refined roles from knowledge-based neural networks," Mach. Learn., vol. 13, pp. 71-101, 1993.
34. S. Sestito and T. Dillon, "Knowledge acquisition of conjunctive rules using multilayered neural networks," Int. J. Intell. Syst., vol. 8, pp. 779-805, 1993.
35. V. Kreinovich, C. Langrand, and H. T. Nguyen, "A statistical analysis for rule base reduction," in Proc. 2nd Int. Conf. Intelligent Technologies (InTech'O1), Bangkok, Thailand, 2001, pp. 47-52.
36. K. McGarry, S. Wermter, and J. Maclntyre, "Hybrid neural systems: From simple coupling to fully integrated neural networks," Neural Comput. Surv., vol. 2, pp. 62-93, 1999.
37. W. Duch, R. Adamczak, K. Grabczewski, and G. Zal, "Hybrid neural-global minimization method of logical rule extraction," J. Adv. Computat. Intell., vol. 3, pp. 348-356, 1999.