Inductive bias strength in knowledge-based neural networks: Application to magnetic resonance spectroscopy of breast tissues

Artificial Intelligence in Medicine

Volumn 28, Issue 2, 2003, Pages 121-140

  Omlin, Christian W ^a   Snyders, Sean ^b,c  

^a UNIVERSITY OF THE WESTERN CAPE   (South Africa)

^b STELLENBOSCH UNIVERSITY   (South Africa)

^c International University   (Germany)

Author keywords

31P magnetic resonance spectroscopy; Breast tissue; Inductive bias; Knowledge based neural networks; Learning with hints; Training and generalization performance

Indexed keywords

BIOLOGICAL ORGANS; MAGNETIC RESONANCE SPECTROSCOPY; MEDICAL APPLICATIONS; NEURAL NETWORKS; TISSUE;

INDUCTIVE BIAS STRENGTH;

KNOWLEDGE BASED SYSTEMS;

ARTICLE; ARTIFICIAL NEURAL NETWORK; BREAST; COMPUTER PROGRAM; DATA BASE; DECISION SUPPORT SYSTEM; NUCLEAR MAGNETIC RESONANCE SPECTROSCOPY; PRIORITY JOURNAL;

EID: 0042669843     PISSN: 09333657     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0933-3657(03)00062-9     Document Type: Article

References (52)

1. Abu-Mostafa Y., Learning from hints in neural networks. J. Complexity. 6:1990;192.
2. Amy B, Danel V, Ertel W, Gonzalez J, Hilario M, Malek M, et al. Modular integration of connectionist and symbolic processing in knowledge-based systems. Tech. rep. W4 D16, final report of ESPRIT project 9119 MIX, Nancy (France): CRIN-INRIA Lorraine; May 1997.
3. Barnard E., Casasent D., Invariance and neural nets. IEEE Trans. Neural Networks. 2:1991;498-508.
4. Baxt W., Application of artificial neural networks to clinical medicine. Lancet. 346:1995;1135-1138.
5. Berenji H. Refinement of approximate reasoning-based controllers by reinforcement learning. In: Birnbaum L, Collins G, editors. Proceedings of the Eighth International International Workshop on Machine Learning. San Mateo (CA): Morgan Kaufmann; 1991. p. 475-9.
6. Brodley C.E., Recursive automatic bias selection for classifier construction. Machine Learning J. 20:1995;63-94.
7. Cardie C. Using cognitive biases to guide feature set selection. In: Proceedings of the Fourteenth Annual Conference of the Cognitive Science Society. Bloomington (IN): Lawrence Erlbaum Associates; 1993. p. 469-71.
8. Cobb H. Inductive biases in a reinforcement learner. In: Proceedings of the ML92 Workshop on Biases in Inductive Learning. San Francisco: Morgan Kaufmann; 1992. p. 1-13.
9. desJardins M., Gordon D.F., Evaluation and selection of biases in machine learning. Machine Learning J. 20:1995;1-17.
10. Frasconi P., Gori M., Maggini M., Soda G., Unified integration of explicit rules and learning by example in recurrent networks. IEEE Trans. on Knowledge Data Eng. 7(2):1995;340-346.
11. Fu L, editor. Proceedings of the International Symposium on Integrating Knowledge and Neural Heuristics. Pensacola (FL): University of Florida and American Association for Artificial Intelligence; 1994.
12. Fu L., Learning capacity and sample complexity on expert networks. IEEE Trans. Neural Networks. 7(6):1996;1517-1520.
13. Fu L., Integration of neural heuristics into knowledge-based inference. Connection Sci. 1:1989;325-340.
14. Fu L., Rule generation from neural networks. IEEE Trans. Systems Man Cybernet. 24(8):1994;1114-1124.
15. Fu L.M., Fu L.C., Mapping rule-based systems into neural architecture. Knowledge-Based Syst. 3(1):1990;48-56.
16. Gallant S., Connectionist expert systems. Commun. ACM. 31(2):1988;152-169.
17. Geman S., Bienenstock E., Dourstat R., Neural networks and the bias/variance dilemma. Neural Comput. 4(1):1992;1-58.
18. Gordon D., Perlis D., Explicitly biased generalization. Comput. Intell. 5(2):1989;67-81.
19. Hayashi Y. A neural expert system with automated extraction of fuzzy if-then rules and its application to medical diagnosis. In: Lippmann R, Moody J, Touretzky D, editors. Advances in neural information processing systems, vol. 3. San Mateo (CA): Morgan Kaufmann; 1991. p. 578-84.
20. Hayashi Y., Setiono R., Yoshida K., A comparison between two neural network rule extraction techniques for the diagnosis of hepatobiliary disorders. Artif. Intell. Med. 20(3):2000;205-216.
21. Kedar-Cabelli S, McCarty T. Explanation-based generalization as resolution theorem proving. In: Proceedings of the Fourth International Workshop on Machine Learning. San Francisco: Morgan Kaufmann; 1987. p. 383-9.
22. Lacher R., Hruska S., Kuncicky D., Backpropagation learning in expert networks. IEEE Trans. Neural Networks. 3(1):1992;62-72.
23. Lavrac N., Selected methods for data mining in medicine. Artif. Intell. Med. 16(3):1999;3-23.
24. Maclin R, Shavlik J. Refining algorithms with knowledge-based neural networks: improving the Chou-Fasman algorithm for protein folding. In: Hanson S, Drastal G, Rivest R, editors. Computational learning theory and natural learning systems, vol. 1. Cambridge (MA): MIT Press; 1994.
25. Mahoney J, Moore R. Combining neural and symbolic learning to revise probabilistic rules bases. In: Hanson S, Cowans J, Giles C, editors. Advances in neural information processing systems, vol. 5. San Mateo (CA): Morgan Kaufmann; 1993.
26. McMillan C, Mozer M, Smolensky P. Rule induction through integrated symbolic and subsymbolic processing. In: Moody J, Hanson S, Lippmann R, editors. Advances in neural information processing systems, vol. 4. San Mateo (CA): Morgan Kaufmann; 1992. p. 969-76.
27. Minsky M, Papert S. Perceptrons. Cambridge (MA): MIT Press; 1969.
28. Mitchell T, Thrun S. Explanation-based neural network learning for robot control. In: Hanson JCS, Giles C, editors. Advances in neural information processing systems, vol. 5. San Francisco: Morgan Kaufmann; 1993. p. 287-94.
29. Omlin C, Giles C. Extraction and insertion of symbolic information in recurrent neural networks. In: Honavar V, Uhr L, editors. Artificial intelligence and neural networks: steps toward principled integration. San Diego (CA): Academic Press; 1994. p. 271-99.
30. Omlin C., Giles C., Extraction of rules from discrete-time recurrent neural networks. Neural Networks. 9(1):1996;41-52.
31. Omlin C., Giles C., Rule revision with recurrent neural networks. IEEE Trans. Knowledge Data Eng. 8(1):1996;183-188.
32. Opitz D., Shavlik J., Dynamically adding symbolically meaningful nodes to knowledge-based neural networks. Knowledge-Based Syst. 8:1996;301-311.
33. Pomerleau D., Gowdy J., Thorpe C., Combining artificial neural networks and symbolic processing for autonomous robot guidance. Eng. Appl. Artif. Intell. 4(4):1991;279-285.
34. Provost F.J., Buchanan B.G., Inductive policy: the pragmatics of bias selection. Machine Learning J. 20:1995;35-61.
35. Simard P, Victorri B, LeCun Y, Denker J. TangentProp - a formalism for specifying selected invariances in an adaptive network. In: Moody JE, Hanson SJ, Lippmann RP, editors. Advances in neural information processing systems, vol. 4. San Francisco: Morgan Kaufmann; 1992. p. 895-903.
36. Reggia J., Neural computation in medicine. Artif. Intell. Med. 5(2):1993;143-157.
37. Scott R., Artificial intelligence: its use in medical diagnosis. J. Nucl. Med. 34(3):1993;510-514.
38. Setiono R., Generating concise and accurate classification rules for breast cancer diagnosis. Artif. Intell. Med. 20(3):2000;205-216.
39. Shavlik J., Combining symbolic and neural learning. Machine Learning J. 14:1994;321-331.
40. Silver D, Mercer R, Hurwitz G. The functional transfer of knowledge for coronary artery disease. Tech. rep., Ont.: Department of Computer Science, Unversity of Western Ontario; 1997.
41. Snyders S, Omlin CW. What inductive bias gives good neural network training performace? In: Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks, vol. 3. New York: IEEE Computer Society Press; 2000. p. 445-50.
42. Sordo Sánchez M. A neurosymbolic approach to the classification of scarce and complex data. Ph.D. thesis, Falmer (Brighton): School of Cognitive and Computing Sciences, University of Sussex; March 1999.
43. Subramanian D., Shifting vocabulary bias in speedup learning. Machine Learning J. 20:1995;155-191.
44. Suddarth S., Holden A., Symbolic neural systems and the use of hints for developing complex systems. Int. J. Man-Machine Stud. 34:1991;291.
45. Towell G, Craven M, Shavlik J. Constructive induction using knowledge-based neural networks. In: Birnbaum L, Collins G, editors. Proceedings of the Eighth International Machine Learning Workshop. San Mateo (CA): Morgan Kaufmann; 1990. p. 213.
46. Towell G, Shavlik J. Knowledge-based artificial neural networks. Artif Intell 70, 119-65.
47. Towell G, Shavlik J, Noordewier M. Refinement of approximately correct domain theories by knowledge-based neural networks. In: Proceedings of the Eighth National Conference on Artificial Intelligence. San Mateo (CA): Morgan Kaufmann; 1990. p. 861.
48. Tresp V, Hollatz J, Ahmad S. Network structuring and training using rule-based knowledge. In: Giles C, Hanson S, Cowan J, editors. Advances in neural information processing systems, vol. 5. San Mateo (CA): Morgan Kaufmann; 1993. p. 871-8.
49. Turney P. Bias and the quantification of stability. Tech. rep., Ottawa (Ont.): Institute for Information Technology, National Research Council Canada; 1994.
50. Turney P., How to shift bias: lessons from the Baldwin effect. Evolut. Comput. 4(3):1997;271-295.
51. Ultsch A, Korus D, Kleine TO. Integration of neural networks and knowledge-based systems in medicine. In: Artificial intelligence in medicine, vol. 934 (of lecture notes on artificial intelligence). Heidelberg: Springer-Verlag; 1995. p. 425-6.
52. Valli G., Poli R., Cagnoni S., Coppini G., Neural networks and prior knowledge help the segmentation of medical images. J. Comput. Inform. Technol. 6(2):1998;117-133.