Orthogonal Search-Based Rule Extraction (OSRE) for Trained Neural Networks: A Practical and Efficient Approach

IEEE Transactions on Neural Networks

Volumn 17, Issue 2, 2006, Pages 374-384

  Etchells, Terence A ^a   Lisboa, Paulo J G ^a  

^a LIVERPOOL JOHN MOORES UNIVERSITY   (United Kingdom)

Author keywords

Neura networks; Rule extraction

Indexed keywords

DECISION THEORY; FINITE DIFFERENCE METHOD; KNOWLEDGE BASED SYSTEMS; MATHEMATICAL MODELS; ONCOLOGY;

BOOLEAN RULES; BREAST CANCER; ORTHOGONAL SEARCH-BASED RULE EXTRACTION (OSRE); SMOOTH DECISION SURFACES; TRAINED NEURAL NETWORKS;

NEURAL NETWORKS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; COMPUTER SIMULATION; DECISION SUPPORT SYSTEM; EVALUATION; MATHEMATICAL COMPUTING; METHODOLOGY; THEORETICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; DECISION SUPPORT TECHNIQUES; MODELS, THEORETICAL; NEURAL NETWORKS (COMPUTER); NUMERICAL ANALYSIS, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED;

EID: 33644921465     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2005.863472     Document Type: Article

References (22)

1. P. J. G. Lisboa, "A review of evidence of health benefit from artificial neural networks in medical intervention," Neural Networks, vol. 15, no. 1, pp. 11-39, Jan. 2002.
2. E. Pop, R. Hayward, and J. Diederich, "RULENEG: Extracting rules from a trained ANN by stepwise negation," Tech. Rep., QUT NRC, 1994.
3. P. J. G. Lisboa, T. A. Etchells, and D. C. Pountney, "Minimal MLPS do not model the XOR logic," Neurocomput. Rapid Commun., vol. 48, no. 1-4, pp. 1033-1037, Oct. 2000.
4. I. Taha and J. Ghosh, "Three techniques for extracting rules from feedforward networks," Intell. Eng. Syst. Through Artif. Neural Networks, vol. 6, pp. 23-28, 1996.
5. H. Tsukimoto, "Extracting rules from trained neural networks," IEEE Trans. Neural Netw., vol. 11, no. 2, pp. 377-389, Mar. 2000.
6. G. G. Towell and J. W. Shavlik, "Extracting refined rules from knowledge-based neural networks," Mach. Learn., vol. 13, no. 1, pp. 71-101, Oct. 1993.
7. R. Setione and H. Liu, "Neurolinear: From neural networks to oblique decision rules," Neurocomput., vol. 17, no. 1, pp. 1-24, 1997.
8. A. S. Garcez d'Avila, K. Broda, and D. M. Gabbay, "Symbolic knowledge from trained neural networks: A sound approach," Artif. Intell., vol. 125, no. 1, pp. 155-207, 2001.
9. B. Apolloni et al., "A general framework for learning rules from data," IEEE Trans. Neural Netw., vol. 15, no. 6, pp. 1333-1349, Nov. 2004.
10. E. Kolman and M. Margaliot, "Are artificial neural networks white boxes?," IEEE Trans. Neural Netw., vol. 16, no. 4, pp. 844-852, Jul. 2005.
11. M. Gori and A. Petrosino, "Encoding nondeterministic fuzzy tree automa into recursive neural networks," IEEE Trans. Neural Netw., vol. 15, no. 6, pp. 1435-1449, Nov. 2004.
12. W. Pedrycz, "Heterogeneous fuzzy logic networks: Fundamentals and development studies," IEEE Trans. Neural Netw., vol. 15, no. 6, pp. 1466-1481, Nov. 2004.
13. W. Duch, "Uncertainy of data, fuzzy membership functions, and multilayer perceptrons," IEEE Trans. Neural Netw., vol. 16, no. 1, pp. 10-23, Jan. 2005.
14. D. Chakraborty and N. R. Pal, "A neuro-fuzzy scheme for simultaneous feature selection and fuzzy rule-based classification," IEEE Trans. Neural Netw., vol. 15, no. 1, pp. 110-123, Jan. 2004.
15. S. Thrun et al., "The MONK's Problems: A performance comparison of different learning algorithms," Comp. Sci. Dept., Carnegie Mellon Univ., Pittsburgh, PA, Tech. Rep. CMU-CS-91-197, 1991.
16. Wisconsin Breast Cancer Database. [Online]. Available: ftp://ftp.ics.uci. edu/pub/machine-learning-databases/
17. (2002) Derive 5.06 A Computer Algebra System. Texas Instruments, Inc., Houston, TX. [Online]. Available: http://www.derive.com
18. R. Setiono, "Generating concise and accurate classification rules for breast cancer diagnosis," Artif. Intell. Med., vol. 18, pp. 205-219, 2000.
19. R. Setiono and H. Liu, "Neurolinear: From neural networks to oblique decision rules," Neurocomput., vol. 17, no. 1, pp. 1-24, 1997.
20. S. Cross, "Private communication," unpublished.
21. AKM. Data mining analysis. [Online]. Available: http://www.auknomi.com/ webFiles/wisconsin-breast-cancer.pdf
22. A. Klose, A. Nürnberger, and D. Nauck, "Some approaches to improve the interpretability of neuro-fuzzy classifiers," in Proc. 6th Eur. Congr. Intelligent Techniques and Soft Computing (EUFIT'98), Aachen, Germany, 1998, pp. 629-633.