Extracting rules from neural networks as decision diagrams

IEEE Transactions on Neural Networks

Volumn 22, Issue 12 PART 2, 2011, Pages 2435-2446

  Chorowski, Jan ^a   Zurada, Jacek M ^a  

^a University of Louisville   (United States)

Author keywords

Decision diagrams; feedforward neural networks; logic rules; rule extraction; true false unknown logic

Indexed keywords

DECISION DIAGRAM; FEED-FORWARD; LOGIC RULES; RULE EXTRACTION; TRUE FALSE UNKNOWN LOGIC;

DATA STRUCTURES; DECISION THEORY; MULTILAYER NEURAL NETWORKS; MULTILAYERS;

FEEDFORWARD NEURAL NETWORKS;

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; COMPUTER SIMULATION; DECISION SUPPORT SYSTEM; NONLINEAR SYSTEM;

ALGORITHMS; COMPUTER SIMULATION; DECISION SUPPORT TECHNIQUES; NEURAL NETWORKS (COMPUTER); NONLINEAR DYNAMICS;

EID: 83655193106     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2011.2106163     Document Type: Article

References (22)

1. R. Andrews, J. Diederich, and A. B. Tickle, "Survey and critique of techniques for extracting rules from trained artificial neural networks," Knowl.-Based Syst., vol. 8, no. 6, pp. 373-389, Dec. 1995.
2. A. B. Tickle, R. Andrews, M. Golea, and J. Diederich, "The truth will come to light: Directions and challenges in extracting the knowledge embedded within trained artificial neural networks," IEEE Trans. Neural Netw., vol. 9, no. 6, pp. 1057-1068, Nov. 1998. (Pubitemid 128742391)
3. M. W. Craven, "Extracting comprehensible models from trained neural networks," Ph.D. dissertation, Dept. Comput. Sci., Univ. Wisconsin-Madison, Madison, 1996.
4. T. A. Etchells and P. J. G. Lisboa, "Orthogonal search-based rule extraction (OSRE) for trained neural networks: A practical and efficient approach," IEEE Trans. Neural Netw., vol. 17, no. 2, pp. 374-384, Mar. 2006. (Pubitemid 43380061)
5. L. M. Fu, "Rule generation from neural networks," IEEE Trans. Syst., Man Cybern., vol. 24, no. 8, pp. 1114-1124, Aug. 1994.
6. R. Krishnan, G. Sivakumar, and P. Bhattacharya, "A search technique for rule extraction from trained neural networks," Pattern Recognit. Lett., vol. 20, no. 3, pp. 273-280, Mar. 1999.
7. R. Setiono, B. Baesens, and C. Mues, "Recursive neural network rule extraction for data with mixed attributes," IEEE Trans. Neural Netw., vol. 19, no. 2, pp. 299-307, Feb. 2008. (Pubitemid 351359294)
8. G. G. Towell, J. W. Shavlik, and M. O. Noordewier, "Refinement of approximate domain theories by knowledge-based neural networks," in Proc. 8th Nat. Conf. Artif. Intell., Boston, MA, 1990, pp. 861-866.
9. D. W. Opitz and J. W. Shavlik, "Dynamically adding symbolically meaningful nodes to knowledge-based neural networks," Knowl.-Based Syst., vol. 8, no. 6, pp. 301-311, Dec. 1995.
10. N. Barakat and J. Diederich, "Eclectic rule-extraction from support vector machines," Int. J. Comput. Intell., vol. 2, no. 1, pp. 59-62, Jan. 2005.
11. Z.-H. Zhou, "Rule extraction: Using neural networks or for neural networks?" J. Comput. Sci. Technol., vol. 19, no. 2, pp. 249-253, Mar. 2004.
12. R. E. Bryant, "Graph-based algorithms for Boolean function manipulation," IEEE Trans. Comput., vol. 35, no. 8, pp. 677-691, Aug. 1986.
13. S. B. Thrun, J. Bala, E. Bloedorn, I. Bratko, B. Cestnik, J. Cheng, K. D. Jong, S. Dzeroski, S. E. Fahlman, D. Fisher, R. Hamann, K. Kaufman, S. Keller, I. Kononenko, J. Kreuziger, R. S. Michalski, T. Mitchell, P. Pachowicz, Y. Reich, H. Vafaie, W. Van de Welde, W. Wenzel, J. Wnek, and J. Zhang, "The MONK's problems a performance comparison of different learning algorithms," School Comput. Sci., Carnegie Mellon University, Pittsburgh, PA, Tech. Rep. CMU-CS-91-197, Dec. 1991.
14. B. Baesens, R. Setiono, C. Mues, and J. Vanthienen, "Using neural network rule extraction and decision tables for credit-risk evaluation," J. Manage. Sci., vol. 49, no. 3, pp. 312-329, Mar. 2003.
15. H. R. Andersen. (1999). An Introduction to Binary Decision Diagrams. IT Univ. Copenhagen, Copenhagen, Denmark Online]. Available: http://www.itu.dk/ people/hra/notes-index.html
16. R. Kohavi and C.-H. Li, "Oblivious decision trees graphs and top down pruning," in Proc. 14th Int. Joint Conf. Artif. Intell., vol. 2. 1995, pp. 1071-1077.
17. A. L. Oliveira and A. Sangiovanni-Vincentelli, "Using the minimum description length principle to infer reduced ordered decision graphs," Mach. Learn., vol. 25, no. 1, pp. 23-50, Oct. 1996. (Pubitemid 126724388)
18. C. Mues, B. Baesens, C. M. Files, and J. Vanthienen, "Decision diagrams in machine learning: An empirical study on real-life credit-risk data," Expert Syst. Appl., vol. 27, no. 2, pp. 257-264, Aug. 2004.
19. J. M. Zurada, A. Malinowski, and S. Usui, "Perturbation method for deleting redundant inputs of perceptron networks," Neurocomputing, vol. 14, no. 2, pp. 177-193, Feb. 1997. (Pubitemid 27079664)
20. A. Frank and A. Asuncion. (2010). UCI Machine Learning Repository Online]. Available: http://archive.ics.uci.edu/ml
21. M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I. Witten, "The WEKA data mining software: An update," ACM SIGKDD Expl. Newslett., vol. 11, no. 1, pp. 10-18, Jun. 2009.
22. M. Langberg, A. Pnueli, and Y. Rodeh, "The ROBDD size of simple CNF formulas," in Correct Hardware Design and Verification Methods (Lecture Notes in Computer Science), vol. 2860. Berlin, Germany: Springer-Verlag, 2003, pp. 363-377.