Improving the scalability of ILP-based multi-relational concept discovery system through parallelization

Knowledge-Based Systems

Volumn 27, Issue , 2012, Pages 352-368

  Mutlu, A ^a   Senkul, P ^a   Kavurucu, Y ^b  

^a MIDDLE EAST TECHNICAL UNIVERSITY   (Turkey)

^b Turkish Naval Academy   (Turkey)

Author keywords

Concept discovery; Confidence; ILP; Multi relational data mining; Parallelization; Scalability; Support; Time efficiency

Indexed keywords

CONCEPT DISCOVERY; CONFIDENCE; ILP; MULTIRELATIONAL DATA MINING; PARALLELIZATIONS; TIME EFFICIENCIES;

ALGORITHMS; DATA MINING; SCALABILITY; SOUNDING APPARATUS; SUPPORTS;

SEARCH ENGINES;

EID: 84855917673     PISSN: 09507051     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.knosys.2011.11.001     Document Type: Article

References (75)

1. M.A. Krogel, S. Rawles, F. Zelezny, P.A. Flach, N. Lavrac, S. Wrobel, Comparative evaluation of approaches to propositionalization, in: ILP'03: Proceedings of 13th International Conference on Inductive Logic Programming 2835 of Lecture Notes in Computer Science, Springer, 2003, pp. 197-214.
2. W. Van Laer, and L. De Raedt How to upgrade propositional learners to first order logic: A case study Machine Learning and Its Applications Lecture Notes in Computer Science vol. 2049 2001 Springer Berlin/Heidelberg 102 126
3. S. Dzeroski Multi-relational data mining: an introduction SIGKDD Explorations 5 1 2003 1 16
4. J.R. Quinlan Learning logical definitions from relations Machine Learning 5 3 1990 239 266
5. S. Muggleton Inverse entailment and progol, new generation computing Special issue on Inductive Logic Programming 13 3-4 1995 245 286
6. A. Srinivasan, The Aleph Manual." , 1999.
7. L. Dehaspe, L. De Raedt, Mining association rules in multiple relations, in: ILP'97: Proceedings of the 7th International Workshop on Inductive Logic Programming, Springer-Verlag, 1997, pp. 125-132.
8. X. Yin, J. Han, J. Yang, P.S. Yu, Crossmine: efficient classification across multiple database relations, in: ICDE'04: Proceedings of the 20th International Conference on Data Engineering, IEEE Computer Society, 2004, pp. 399-411.
9. C.I. Lee, C.J. Tsai, T.Q. Wu, and W.P. Yang An approach to mining the multi-relational imbalanced database Expert Systems with Applications 34 4 2008 3021 3032
10. A. Assche, C. Vens, H. Blockeel, and S. Dzeroski First order random forests: learning relational classifiers with complex aggregates Machine Learning 64 1-3 2006 149 182
11. A.J. Knobbe, A. Siebes, B. Marseille, Involving aggregate functions in multi-relational search, in: PKDD '02: Proceedings of the 6th European Conference on Principles of Data Mining and Knowledge Discovery, Springer-Verlag, 2002, pp. 287-298.
12. C. Perlich, F. Provost, Aggregation-based feature invention and relational concept classes, in: KDD '03: Proceedings of the 9th ACM SIGKDD International Conference on Knowledge discovery and Data Mining, ACM, 2003, pp. 167-176.
13. Y.W.C. Chien, and Y.L. Chen A phenotypic genetic algorithm for inductive logic programming Expert Systems with Applications 36 3 2009 6935 6944
14. E. Lamma, P. Mello, M. Milano, and F. Riguzzi Integrating induction and abduction in logic programming Information Sciences 116 1 1999 25 54
15. Q. Wu, and Z. Liu Real formal concept analysis based on grey-rough set theory Knowledge-Based Systems 22 1 2009 38 45
16. B. Dolsak, and S. Muggleton The Application of Inductive Logic Programming to Finite Element Mesh Design Inductive Logic Programming 1992 Academic Press London
17. A. Doncescu, J. Waissman, G. Richard, and G. Roux Characterization of bio-chemical signals by inductive logic programming Knowledge-Based Systems 15 1-2 2002 129 137
18. L. Wang, and X. Liu A new model of evaluating concept similarity Knowledge-Based Systems 21 8 2008 842 846
19. S. Muggleton Inductive Logic Programming The MIT Encyclopedia of the Cognitive Sciences (MITECS) 1999 MIT Press
20. S. Muggleton, C. Feng, Efficient induction of logic programs, in: Proceedings of the 1st Conference on Algorithmic Learning Theory, Springer/Ohmsma, 1990, pp. 368-381.
21. S. Muggleton, W. Buntine, Machine invention of first order predicates by inverting resolution, in: Proceedings of the 5th International Workshop on Machine Learning, Morgan Kaufmann, 1988, pp. 339-351.
22. Y. Kavurucu, P. Senkul, and I.H. Toroslu ILP-based concept discovery in multi-relational data mining Expert Systems with Applications 36 2009 11418 11428
23. A. Srinivasan, R.D. King, S.H. Muggleton, M. Sternberg, The predictive toxicology evaluation challenge, in: IJCAI-97: Proceedings of the 15th International Joint Conference on Artificial Intelligence, Morgan-Kaufmann, 1997, pp. 1-6.
24. S. Yang, S. Ding, S. Cai, and Q. Ding An algorithm of constructing concept lattices for CAT with cognitive diagnosis Knowledge-Based Systems 21 8 2008 852 855
25. X.-D. Zhu, and Z.-Q. Huang Conceptual modeling rules extracting for data streams Knowledge-Based Systems 21 8 2008 934 940
26. L. Wei, and J.-J. Qi Relation between concept lattice reduction and rough set reduction Knowledge-Based Systems 23 8 2010 934 938
27. A. Formica Semantic web search based on rough sets and fuzzy formal concept analysis Knowledge-Based Systems 26 2012 40 47
28. U. Yun, and K.H. Ryu Approximate weighted frequent pattern mining with/without noisy environments Knowledge-Based Systems 24 1 2011 73 82
29. F. Gurbuz, L. Ozbakir, and H. Yapici Classification rule discovery for the aviation incidents resulted in fatality Knowledge-Based Systems 22 8 2009 622 632
30. S. Mitra, S. Pal, and P. Mitra Data mining in soft computing framework: a survey IEEE Transactions on Neural Networks 13 2002 3 14
31. E. Mccreath, A. Sharma, ILP with noise and fixed example size: A bayesian approach, in: IJCAI-97: Proceedings of the 15th International Joint Conference on Artificial Intelligence, Morgan-Kaufmann, 1997, pp. 1310-1315.
32. L.R. Tang, R.J. Mooney, P. Melville, Scaling up ILP to large examples: results on link discovery for counter-terrorism, in: Proceedings of the KDD-2003 Workshop on Multi-Relational Data Mining (MRDM-2003), August 2003, pp. 107-121.
33. A. Mutlu, M.A. Berk, P. Senkul, Improving the time efficiency of ilp-based multi-relational concept discovery with dynamic programming approach, in: ISCIS 2010: Proceedings of 25th International Symposium on Computer and Information Sciences, September 2010, pp. 373-376.
34. H. Blockeel, L. Dehaspe, B. Demoen, G. Janssens, and H. Vandecasteele Improving the efficiency of inductive logic programming through the use of query packs Journal of Artificial Intelligence Research 16 2002 135 166
35. H. Ohwada, H. Nishiyama, F. Mizoguchi, Concurrent execution of optimal hypothesis search for inverse entailment, in: ILP'00: Proceedings of 10th International Conference on Inductive Logic Programming 1866 of Lecture Notes in Computer Science, Springer, Berlin/Heidelberg, 2000, pp. 165-173.
36. J. Graham, C.D. Page, A. Kamal, Accelerating the drug design process through parallel inductive logic programming data mining, in: CSB'03: Proceedings of the IEEE Computer Society Conference on Bioinformatics, IEEE Computer Society, 2003, pp. 400-402.
37. S. Konstantopoulos, A data-parallel version of Aleph, CoRR abs/0708.1527, 2007.
38. Y. Kavurucu, P. Senkul, I.H. Toroslu, Confidence-based concept discovery in relational databases, in: CSIE 2009: Proceedings of 2009 World Congress on Computer Science and Information Engineering, April 2009, pp. 43-50.
39. Y. Kavurucu, P. Senkul, I.H. Toroslu, Multi-relational concept discovery with aggregation, in: ISCIS 2009: Proceedings of 24th International Symposium on Computer and Information Sciences, 2009, pp. 43-50.
40. Y. Kavurucu, P. Senkul, and I.H. Toroslu Concept discovery on relational databases: new techniques for search space pruning and rule quality improvement Knowledge-Based Systems 23 2010 743 756
41. (accessed 04.11).
42. (accessed 04.11).
43. (accessed 04.11).
44. S.D. Toprak, A new hybrid multi-relational data mining technique, Master's thesis, Middle East Technical University, Computer Engineering Department, Ankara, Turkey, May 2005.
45. G. Plotkin A further note on inductive generalization Machine Intelligence vol. 6 1971 Edinburgh University Press 101 124
46. L.D. Raedt, M. Bruynooghe, A theory of clausal discovery, in: IJCAI-93: Proceedings of the 13th International Joint Conference on Artificial Intelligence, Morgan Kaufmann, 1993, pp. 1058-1063.
47. D. Page, and A. Srinivasan ILP: a short look back and a longer look forward Journal of Machine Learning Research 4 2003 415 430
48. M.S. Chen, J. Han, and P. Yu Data mining: an overview from a database perspective IEEE Transactions on Knowledge and Data Engineering 8 1996 866 883
49. R. Agrawal, H. Mannila, R. Srikant, H. Toivonen, and A.I. Verkamo Fast discovery of association rules Advances in Knowledge Discovery and Data Mining 1996 AAAI/MIT Press 307 328
50. R. Agrawal, and J.C. Shafer Parallel mining of association rules IEEE Transactions on Knowledge and Data Engineering 8 1996 962 969
51. E.H. Han, G. Karypis, and V. Kumar Scalable parallel data mining for association rules IEEE Transactions on Knowledge and Data Engineering 12 2000 352 377
52. J.S. Park, M.-S. Chen, P.S. Yu, Efficient parallel data mining for association rules, in: CIKM '95: Proceedings of the 4th International Conference on Information and Knowledge Management, ACM, 1995, pp. 31-36.
53. R. Kufrin, Generating C4.5 production rules in parallel, in: AAAI-1997: Proceedings of the 14th National Conference on Artificial Intelligence, 1997, pp. 565-570.
54. L. Dehaspe, L.D. Raedt, Parallel inductive logic programming, in: Proceedings of the MLnet Familiarization Workshop on Statistics, Machine Learning and Knowledge Discovery in Databases, 1995, pp. 112-117.
55. T. Matsui, N. Inuzuka, H. SEKI, H. Itoh, Comparison of three parallel implementations of an induction algorithm, in 8th International Parallel Computing Workshop, Springer-Verlag, 1998, pp. 181-188.
56. N.A. Fonseca, F.M.A. Silva, V.S. Costa, R. Camacho, A pipelined data-parallel algorithm for ILP, in: CLUSTER 2005: IEEE International Conference on Cluster Computing, 2005, pp. 1-10.
57. N.A. Fonseca, O. Silva, R. Camacho, Strategies to parallelize ILP systems, in: ILP 2005: Proceedings of the 15th International Conference on Inductive Logic Programming 3625 of Lecture Notes in Computer Science, Springer, 2005, pp. 136-153.
58. Y. Kavurucu, P. Senkul, and I. Toroslu A comparative study on ILP-based concept discovery systems Expert Systems with Applications 38 9 2011 11598 11607
59. Y. Kavurucu, P. Senkul, I.H. Toroslu, Aggregation in confidence-based concept discovery for multi-relational data mining, in: Proceedings of IADIS European Conference on Data Mining (ECDM), 2008, pp. 43-50.
60. C. Goutte, E. Gaussier, A probabilistic interpretation of precision, recall and f-score, with implication for evaluation, in: ECIR 2005: 27th European Conference on IR Research, Springer, 2005, pp. 345-359.
61. D.J. Kuck, R.H. Kuhn, B. Leasure, M. Wolfe, The structure of an advanced vectorizer for pipelined processors, in: Proceedings of the 4th International Computer Software and Applications Conference, 1980.
62. E. Heymann, M.A. Senar, E. Luque, M. Livny, Adaptive scheduling for master-worker applications on the computational grid, in: GRID '00: Proceedings of the 1st IEEE/ACM International Workshop on Grid Computing, Springer-Verlag, 2000, pp. 214-227.
63. K. Aida, W. Natsume, Y. Futakata, Distributed computing with hierarchical master-worker paradigm for parallel branch and bound algorithm, in: CCGrid 2003: Proceedings of the 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid, May 2003, pp. 156-163.
64. G. Hinton, UCI Machine Learning Repository Kinship Data Set, , 1990.
65. R. Michalski, and J. Larson Inductive inference of VL decision rules SIGART Bulletin 1977 38 44
66. B. Dolsak Finite element mesh design expert system Knowledge-Based Systems 15 8 2002 315 322
67. A. Srinivasan, S. Muggleton, R. King, M. Sternberg, Theories for mutagenicity: A study of first-order and feature based induction, Technical Report, PRG-TR-8-95 Oxford University Computing Laboratory, 1995.
68. D. Eager, J. Zahorjan, and E. Lazowska Speedup versus efficiency in parallel systems IEEE Transactions on Computers 38 1989 408 423
69. D.K. Lowenthal Accurately selecting block size at runtime in pipelined parallel programs International Journal of Parallel Programming 28 2000 245 274
70. E. Alba Parallel evolutionary algorithms can achieve super-linear performance Information Processing Letters 82 1 2002 7 13
71. S. Touati, J. Worms, S. Briais, The speedup test, Technical Report, HAL-inria-0044383 Universite de Versailles-Saint Quentin en Yvelines, 2010.
72. M. Hollander, and D.A. Wolfe Nonparametric Statistical Methods second ed. 1999 Wiley-Interscience
73. W.J. Conover Practical Nonparametric Statistics 1998 John Wiley & Sons
74. S. Dudoit, J.P. Shaffer, and J.C. Boldrick Multiple hypothesis testing in microarray experiments Statistical Science 18 1 2003 71 103
75. R.A. Fisher Statistical Methods and Scientific Inference second ed. 1959 Oliver & Boyd Edinburgh