Learning by discovering concept hierarchies

Artificial Intelligence

Volumn 109, Issue 1, 1999, Pages 211-242

  Zupana, Blaž ^a,b   Bohanec, Marko ^b   Demšar, Janez ^a   Bratko, Ivan ^a,b  

^a UNIVERSITY OF LJUBLJANA   (Slovenia)

^b JO EF STEFAN INSTITUTE   (Slovenia)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; BOOLEAN FUNCTIONS; COMPUTATIONAL COMPLEXITY; COMPUTER AIDED SOFTWARE ENGINEERING; HEURISTIC METHODS; PROBLEM SOLVING;

CONCEPT HIERARCHIES; FUNCTION DECOMPOSITION; HEURISTIC ALGORITHM; HIERARCHY INDUCTION TOOL;

LEARNING SYSTEMS;

EID: 0033522717     PISSN: 00043702     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0004-3702(99)00008-9     Document Type: Article

References (55)

1. R.L. Ashenhurst, The Decomposition of Switching Functions, Technical Report, Bell Laboratories BL-1(11), 1952, pp. 541-602.
2. A.W. Biermann, J. Fairfield, T. Beres, Signature table systems and learning, IEEE Trans. Syst. Man Cybern. 12 (5) (1982) 635-648.
3. M. Bohanec, I. Bratko, V. Rajkovič, An expert system for decision making, in: H.G. Sol (Ed.), Processes and Tools for Decision Support, North-Holland, Amsterdam, 1983.
4. M. Bohanec, B. Cestnik, V. Rajkovič, A management decision support system for allocating housing loans, in: P. Humphreys, L. Bannon, A. McCosh, P. Migliarese (Eds.), Implementing System for Supporting Management Decisions, Chapman & Hall, London, 1996, pp. 34-43.
5. M. Bohanec, V. Rajkovič, Knowledge acquisition and explanation for multi-attribute decision making, in: Proceedings 8th Internat. Workshop on Expert Systems and their Applications, Avignon, France, 1988, pp. 59-78.
6. M. Bohanec, V. Rajkovič, DEX: An expert system shell for decision support, Sistemica 1 (1) (1990) 145-157.
7. I. Bratko, I. Mozetič, N. Lavrač, KARDIO: A Study in Deep and Qualitative Knowledge for Expert Systems, MIT Press, Cambridge, MA, 1989.
8. N.H. Bshouty, T.R. Hancock, L. Hellerstein, Learning boolean read-once formulas over generalized bases, J. Comput. System Sci. 50 (3) (1995) 521-542.
9. T.H. Cormen, C.E. Leiserson, R.L. Rivest, Introduction to Algorithms, MIT Press, Cambridge, MA, 1989.
10. H.A. Curtis, A New Approach to the Design of Switching Functions, Van Nostrand, Princeton, NJ, 1962.
11. J. Demšar, B. Zupan, M. Bohanec, I. Bratko, Constructing intermediate concepts by decomposition of real functions, in: M. van Someren, G. Widmer (Eds.), Proceedings European Conference on Machine Learning, ECML-97, Prague, April 1997. Springer, Berlin, 1997, pp. 93-107.
12. J. Efstathiou, V. Rajkovič, Multiattribute decisionmaking using a fuzzy heuristic approach, IEEE Trans. Syst. Man Cybern. 9 (1979) 326-333.
13. C. Files, R. Drechsler, M. Perkowski, Functional decomposition of MVL functions using multi-valued decision diagrams, in: Proceedings International Symposium on Multi-Valued Logic, May 1997.
14. J.A. Goldman, Pattern theoretic knowledge discovery, in: Proceedings 6th Internat. IEEE Conference on Tools with AI, 1994.
15. R.L. Graham, D.E. Knuth, O. Patashnik, Concrete Mathematics: A Foundation for Computer Science, Addison-Wesley, Reading, MA, 1994.
16. T.R. Hancock, M. Golea, M. Marchand, Learning nonoverlaping perceptron networks from examples and membership queries, Machine Learning 16 (3) (1994) 161-183.
17. R. Kohavi, Bottom-up induction of oblivious read-once decision graphs, in: F. Bergadano, L. De Raedt (Eds.), Proceedings European Conference on Machine Learning (ECML-94), Springer, Berlin, 1994, pp. 154-169.
18. I. Kononenko, Estimating attributes, in: F. Bergadano, L. De Raedt (Eds.), Proceedings European Conference on Machine Learning (ECML-94), Springer, Berlin, 1994, pp. 171-182.
19. I. Kononenko, E. Šimec, M. Robnik Šikonja, Overcoming the myopia of inductive learning algorithms with ReliefF, Applied Intelligence J. 7 (1) (1997) 39-56.
20. Y.-T. Lai, K.-R.R. Pan, M. Pedram, OBDD-based function decomposition: Algorithms and implementation, IEEE Trans. Computer Aided Design of Integrated Circuits and Systems 15 (8) (1996) 977-990.
21. Y.-T. Lai, M. Pedram, S. Sastry, BDD-based decomposition of logic functions with application to FPGA synthesis, in: Proceedings 30th DAC, 1993, pp. 642-647.
22. T. Luba, Decomposition of multiple-valued functions, in: Proceedings 25th Internat. Symposium on Multiple-Valued Logic, Bloomington, IN, May 1995, pp. 256-261.
23. T. Luba, H. Selvaraj, A general approach to boolean function decomposition and its application in FPGA-based synthesis, VLSI Design 3 (3-4) (1995) 289-300.
24. R.S. Michalski, A theory and methodology of inductive learning, in: R. Michalski, J. Carbonnel, T. Mitchell (Eds.), Machine Learning: An Artificial Intelligence Approach, Morgan Kaufmann, Paolo Alto, CA, 1983, pp. 83-134.
25. R.S. Michalski, Understanding the nature of learning: Issues and research directions, in: R. Michalski, J. Carbonnel, T. Mitchell (Eds.), Machine Learning: An Artificial Intelligence Approach, Morgan Kaufmann, Los Altos, CA, 1986, pp. 3-25.
26. D. Michie, Problem decomposition and the learning of skills, in: N. Lavrač, S. Wrobel (Eds.), Machine Learning: ECML-95, Lecture Notes in Artificial Intelligence Vol. 912, Springer, Berlin, 1995, pp. 17-31.
27. I. Mozetič, Learning of qualitative models, in: I. Bratko, N. Lavrač (Eds.), Progress in Machine Learning, Sigma Press, Wilmslow, England, 1987.
28. I. Mozetič, The role of abstractions in learning of qualitative models, in: Proceedings 4th Internat. Workshop on Machine Learning, Irvine, CA, Morgan Kaufmann, Los Altos, CA, 1987.
29. S. Muggleton, Structuring knowledge by asking questions, in: I. Bratko, N. Lavrač (Eds.), Progress in Machine Learning, Sigma Press, Wilmslow, England, 1987, pp. 218-229 .
30. S. Muggleton, Inductive Acquisition of Expert Knowledge, Addison-Wesley, Wokingham, England, 1990.
31. P.M. Murphy, D.W. Aha, UCI Repository of Machine Learning Databases, University of California, Department of Information and Computer Science, Irvine, CA, 1994. [http://www.ics.uci. edu/~mlearn/mlrepository.html] .
32. C.G. Nevill-Manning, I.H. Witten, Identifying hierarchical structure in sequences: A linear-time algorithm, J. Artificial Intelligence Res. 7 (1997) 67-82.
33. M. Olave, V. Rajkovič, M. Bohanec, An application for admission in public school systems, in: I.T.M. Snellen, W.B.H.J. van de Donk, J.-P. Baquiast (Eds.), Expert Systems in Public Administration, Elsevier Science (North-Holland), Amsterdam, 1989, pp. 145-160.
34. M. Perkowski, H. Uong, Automatic design of finite state machines with electronically programmable devices, in: Record of Northcon '87, Portland, OR, 1987, pp. 16/4.1-16/4.15.
35. B. Pfahringer, Controlling constructive induction in CiPF, in: F. Bergadano, L. De Raedt (Eds.), Proceedings European Conference on Machine Learning (ECML-94), Springer, Berlin, 1994, pp. 242-256.
36. J.R. Quinlan, C4.5: Programs for Machine Learning, Morgan Kaufmann, San Mateo, CA, 1993.
37. R. Quinlan, Induction of decision trees, Machine Learning 1 (1) (1986) 81-106.
38. H. Ragavan, L. Rendell, Lookahead feature construction for learning hard concepts, in: Proceedings 10th Internat. Machine Learning Conference, Morgan Kaufmann, San Mateo, CA, 1993, pp. 252-259.
39. V. Rajkovič, M. Bohanec, Decision support by knowledge explanation, in: H.G. Sol, J. Vecsenyi (Eds.), Environments for Supporting Decision Process, Elsevier Science, Amsterdam, 1991.
40. T.D. Ross, M.J. Noviskey, D.A. Gadd, J.A. Goldman, Pattern theoretic feature extraction and constructive induction, in: Proceedings ML-COLT-'94 Workshop on Constructive Induction and Change of RepresentaTion, New Brunswick, NJ, 1994.
41. S.J. Russell, Tree-structured bias, in: Proceedings AAAI-88, St. Paul, MN, Morgan Kaufmann, San Mateo, CA, 1988, pp. 641-645.
42. S.L. Salzberg, On comparing classifiers: Pitfalls to avoid and a recommended approach, Data Mining and Knowledge Discovery 1 (1997) 317-328.
43. A. Samuel, Some studies in machine learning using the game of checkers, IBM J. Res. Develop. 3 (1959) 221-229.
44. A. Samuel, Some studies in machine learning using the game of checkers II: Recent progress, IBM J. Res. Develop. 11 (1967) 601-617.
45. A.D. Shapiro, Structured Induction in Expert Systems, Turing Institute Press (in association with Addison-Wesley), 1987.
46. A.D. Shapiro, T. Niblett, Automatic induction of classification rules for a chess endgame, in: M.R.B. Clarke (Ed.), Advances in Computer Chess 3, Pergamon, Oxford, 1982, pp. 73-92.
47. I. Stahl, An overview of predicate invention techniques in ILP, in: ESPRIT BRA 6020: Inductive Logic Programming, 1991.
48. P. Tadepalli, S. Russell, Learning from examples and membership queries with structured determinations, Machine Learning, to appear.
49. S.B. Thrun Et al., A Performance Comparison of Different Learning Algorithms, Technical Report, Carnegie Mellon University CMU-CS-91-197, Pittsburgh, PA, 1991.
50. W. Wan, M.A. Perkowski, A new approach to the decomposition of incompletely specified functions based on graph-coloring and local transformations and its application to FPGA mapping, in: Proceedings IEEE EURO-DAC-'92, Hamburg, 1992, pp. 230-235.
51. D.J.A. Welsh, M.B. Powell, An upper bound on the chromatic number of a graph and its application to timetabling problems, Computer J. 10 (1967) 85-86.
52. B. Zupan, Machine Learning Based on Function Decomposition, Ph.D. Thesis, University of Ljubljana, 1997. Available at http://www-ai.ijs.si/BlazZupan/papers.html.
53. B. Zupan, M. Bohanec, I. Bratko, B. Cestnik, A dataset decomposition approach to data mining and machine discovery, in: D. Heckerman, H. Mannila, D. Pregibon, R. Uthurusamy (Eds.), Proceedings 3rd Internat. Conference on Knowledge Discovery and Data Mining (KDD-97), Irvine, CA, AAAI Press, 1997, pp. 299-303.
54. B. Zupan, M. Bohanec, I. Bratko, J. Demšar, Machine learning by function decomposition, in: D.H. Fisher Jr. (Ed.), Proceedings 14th Internat. Conference on Machine Learning (ICML-97), Morgan Kaufmann, San Mateo, CA, 1997, pp. 421-429.
55. B. Zupan, M. Bohanec, J. Demšar, I. Bratko, Feature transformation by function decomposition, IEEE Intelligent Systems and their Applications 13 (2) (1998) 38-43 .