Reusable component-based architecture for decision tree algorithm design

International Journal on Artificial Intelligence Tools

Volumn 21, Issue 5, 2012, Pages

  Vukićević, Milan ^a   Jovanović, Miloš ^a   Delibašić, Boris ^a   Išljamović, Sonja ^a   Suknović, Milija ^a  

^a UNIVERSITY OF BELGRADE   (Serbia)

Author keywords

Algorithm; architecture; classification; component; decision tree; rapid miner

Indexed keywords

COMPONENT; COMPONENT BASED; COMPONENT-BASED ARCHITECTURE; DECISION-TREE ALGORITHM; FAIR TESTING; NON-EXISTENCE; OPEN SOURCE FRAMEWORKS; POTENTIAL SOLUTIONS; RESEARCH COMMUNITIES; REUSABLE COMPONENTS; SOFTWARE DEVELOPER; TECHNOLOGY ENHANCED LEARNING; TIME GAP;

ALGORITHMS; ARCHITECTURE; CLASSIFICATION (OF INFORMATION); DECISION TREES;

DATA MINING;

EID: 84862186287     PISSN: 02182130     EISSN: 17936349     Source Type: Journal    
DOI: 10.1142/S0218213012500224     Document Type: Conference Paper

References (55)

1. K. Tsiptis and A. Chorianopoulos, Data Mining Techniques in CRM: Inside Customer Segmentation (John Wiley & Sons, 2009).
2. X. Wu, V. Kumar, J. R. Quinlan, J. Ghosh, Q. Yang, H. Motoda, J. G. McLachlan et al., Top 10 algorithms in data mining, Knowledge Information Systems 14 (2008) 1-37.
3. B. Samanta, G. L. Bird, M. Kuijpers, R. Zimmerman, G. P. Jarvik, G. Wernovsky et al., Prediction of periventricular leukomalacia. Part I: Selection of hemodynamic features using logistic regression and decision tree algorithms, Artificial Intelligence in Medicine 46(3) (2009) 201-215, doi: 10.1016/j.artmed.2008.12.005.
4. A. Jovic and N. Bogunovic, Electrocardiogram analysis using a combination of statistical, geometric, and nonlinear heart rate variability features, Artificial Intelligence in Medicine (2010), doi: 10.1016/j.artmed.2010.09.005.
5. F. Emekci, O. Sahin, D. Agrawal, and A. ElAabbadi, Privacy preserving decision tree learning over multiple parties, Data & Knowledge Engineering 63(2) (2007) 348-361, doi: 10.1016/j.datak.2007.02.004. (Pubitemid 47048431)
6. J. He, H. Hu, R. Harrison, P. Tai, and Y. Pan, Transmembrane segments prediction and understanding using support vector machine and decision tree. Expert Systems with Applications 30(1) (2006) 64-72, doi: 10.1016/j.eswa.2005. 09.045. (Pubitemid 41641821)
7. R. Hadjidj, M. Debbabi, H. Lounis, F. Iqbal, A. Szporer, and D. Benredjem, Towards an integrated e-mail forensic analysis framework, Digital Investigation 5(3-4) (2009) 124-137, doi: 10.1016/j.diin.2009.01.004.
8. J. J. Jung, Contextualized mobile recommendation service based on interactive social network discovered from mobile users, Expert Systems with Applications 36 (2009) 11950-11956.
9. G. Savoiu, O. Jaško, and M. Čudanov, Diversity of specific quantitative, statistical and social methods, techniques and management models in management system, Management 14(52) (2010) 5-13.
10. J. Sun and H. Li, Data mining method for listed companies' financial distress prediction, Theory and Practice 21 (2008) 1-5, doi: 10.1016/j.knosys.2006.11.003.
11. P. C. Chang, C. Y. Fan, and J. L. Lin, Trend discovery in financial time series data using a case based fuzzy decision tree. Expert Systems with Applications 38(5) (2011) 6070-6080. doi:10.1016/j.eswa.2010.11.006.
12. O. Sedlak, V. Kocic-Vugdelija, M. Kudumovic, C. Besic, and D. Djordjevic, Management of family farms - Implementation of Fuzzy method in short-term planning, Technics Technologies Education Managemen - TTEM 5(4) (2010) 710-718.
13. A. Zeileis, T. Hothorn, and K. Hornik, Model-based Recursive Partitioning, Journal of Computational and Graphical Statistics 17(2) (2008) 492-514.
14. J. R. Quinlan, Induction of Decision Trees (Machine Learning, 1986).
15. J. R. Quinlan, C4.5 Programs for Machine Learning (Morgan Kaufmann,1993).
16. L. Breiman, J. H. Friedman, R. A. Olshen and C. J. Stone, Classification and Regression Trees (CRC Press, 1984).
17. V. G. Kass, An Exploratory Technique for Investigating Large Quantities of Categorical Data, Applied Statistics (1980) 119-127.
18. W. Y. Loh and N. Vanichsetakul, Tree-structured classification via generalized discriminant analysis (with discussion), Journal of the American Statistical Association 83 (1988) 715-728.
19. W. Y. Loh and Y. S. Shih, Split selection methods for classification trees, StatisticaSinica 7 (1997) 815-840.
20. H. Kim and W. Y. Loh, Classification trees with unbiased multiway splits, Journal of the American Statistical Association 96 (2001) 598-604.
21. W. Y. Loh, Regression trees with unbiased variable selection and interaction detection, StatisticaSinica 12 (2002) 361-386.
22. T. Hothorn, K. Hornik and A. Zeileis, Unbiased recursive partitioning: A conditional inference framework, Journal of Computational and Graphical Statistics 15(3) (2006) 651-674. (Pubitemid 44554201)
23. M. Suknovic, B. Delibasic, M. Jovanovic, M. Vukicevic, D. Becajski-Vujaklija, and Z. Obradovic, Reusable components in decision trees induction algorithms, Computational Statistics (2011), doi:10.1007/s00180-011- 0242-8.
24. B. Delibašić, M. Jovanović, M. Vukić ević, M. Suknović, and Z. Obradović, Component-based decision trees for classification. Intelligent Data Analysis 15(5) (2011) 671-673, doi: 10.3233/IDA-2011-0489.
25. S. Sonnenburg, M. L. Braun, C. S. Ong, S. Bengio, L. Bottou, G. Holmes et al., The need for open source software in machine learning, Journal of Machine Learning Research 8 2007) 2443-2466. (Pubitemid 350046193)
26. I. Mierswa, M. Wurst, R. Klinkenberg, M. Scholz, and T. Eule, YALE: Rapid prototyping for complex data mining tasks. In Proc. 12th ACM SIGKDD Int. Conf. on Knowledge Discovery and Data Mining (KDD-06) (August 2006), pp. 935-940, ISBN:1-59593-339-5. (Pubitemid 44535615)
27. I. H. Witten and E. Frank, Data Mining: Practical Machine Learning Tools and Techniques, 2nd edition (Morgan Kaufmann, San Francisco, 2005).
28. M. Vukićević, M. Jovanović, B. Delibaš ić, and M. Suknović, WhiBo-RapidMiner plug-in for component based data mining algorithm design, In Proc. of the 1st RapidMiner Community Meeting and Conference (Dortmund, Germany, 2010), www.rcomm2010.org.
29. L. Rokach and O. Maimon, Data Mining with Decision Trees - Theory and Application (World Scientific Publishing, 2008).
30. M. R. Berthold, N. Cebron, F. Dill, G. D. Fatta, T. R. Gabriel, F. Georg et al., The Konstanz Information Miner (Technical Report, 2006), http://www.knime.org.
31. RDevelopment Core Team R, A Language and Environment for Statistical Computing. R Foundation for Statistical Computing (Vienna, Austria, 2006), ISBN 3-900051-07-0, URL: http://www.R-project.org/.
32. W. Tracz, Where does reuse start? ACM SIGSOFT Software Engineering Notes 15 (1990) 42-46.
33. D. H. Wolpert, The lack of a priori distinctions between learning algorithms, Neural Computation 8 (1996) 1341-1390. (Pubitemid 126449973)
34. S. K. Murthy, Automatic construction of decision trees from data: A multidisciplinary survey, Data Mining and Knowledge Discovery 2 (1997) 345-389.
35. S. R. Safavian and D. Landgrebe, A survey of decision tree classifier methodology, IEEE Transactions on System, Man, and Cybernetics 21 (1991) 660-674. (Pubitemid 21703512)
36. J. Gehrke, R. Ramakrishnan, and V. Ganti, RainForest: A framework for fast decision tree construction of large datasets. Data Mining and Knowledge Discovery 4 (2000) 127-168.
37. N. Drossos, A. Papagelis, and D. Kallesis, Decision tree toolkit: A component-based library of decision tree algorithms. Proceedings of the 4th European Conference on Principles of Data Mining and Knowledge Discovery (September 2000), pp. 381-387.
38. D. Potts and C. Sammut, Incremental learning of linear model trees, Machine Learning 61 (2005) 5-48. (Pubitemid 43049361)
39. J. Shafer, R. Agarwal and M. Mehta, SPRINT: A scalable parallel classifier for data mining. In Proc. of 22nd International Conference on Very Large Databases, (Mumbai, India, September 1996).
40. J. Demšar, B. Zupan, G. Leban, and T. Curk, Orange: From experimental machine learning to interactive data mining, in Knowledge Discovery in Databases (PKDD, 2004), pp. 537-539. (Pubitemid 39740441)
41. J. Alcalá-Fdez, A. Fernandez, J. Luengo, J. Derrac, S. García, L. Sánchez et al., KEEL datamining software tool: Data set repository, integration of algorithms and experimental analysis framework, Journal of Multiple-Valued Logic and Soft Computing 17(2-3) (2011) 255-287.
42. B. Delibašić, K. Kirchner, J. Ruhland, M. Jovanović, and M. Vukićević, Reusable components for partitioning clustering algorithms, Artificial Intelligence Review 32(1-4) (2009) 59-75, doi: 10.1007/s10462-009-9133-6
43. M. Vukićević, B. Delibašic, M. Jovanović, M. Suknović, and Z. Obradović, Internal evaluation measures as proxies for external indices in clustering gene expression data. In Proc. of the 2011 IEEE International Conference on Bioinformatics and Biomedicine (BIBM11) (Atlanta, Georgia, USA, Nov. 12-15, 2011).
44. J. Gama, Oblique linear tree in Advances in Intelligent Data Analysis Reasoning about Data, eds. X. Liu, P. Cohen, and M. Berthold (Springer Berlin/Heidelberg); 1280 (1997) 187-198.
45. J. Gama, Discriminant trees. In Proceedings of the Sixteenth International Conference on Machine Learning (San Mateo, CA: Morgan Kaufmann, 1999), pp. 134-142.
46. S. Murthy, S. Kasif, S. Salzberg, and R. Beigel. OC1: Randomized induction of oblique decision trees. In Proceedings of the Eleventh National Conference on Artificial Intelligence (Cambridge, MA 02142, 1993, The AAAI Press/The MIT Press), pp. 322-327.
47. D. Heath, S. Kasif, and S. Salzberg, Learning oblique decision trees. In Proceedings of the 13th International Joint Conference on Articial Intelligence (Chambery, France. Morgan Kaufmann, 1993), pp. 1002-1007.
48. E. Canti-Paz amd C. Kamath, Inducing oblique decision trees with evolutionary algorithms. IEEE Transactions on Evolutionary Computation 7(1) (2003) 54-68.
49. P. E. Utgoff, Perceptron trees: A case study in hybrid concept representation. In Proceedings of the Seventh National Conference on Articial Intelligence (Morgan Kaufmann, 1998), pp. 601-606.
50. R. Kohavi, Scaling up the accuracy of naive-Bayes classifiers: A decision-tree hybrid. Proceedings of the Second International Conference on Knowledge Discovery and Data Mining (Portland, OR: AAAI Press, 1996), pp. 202-207.
51. J. Dougherty, R. Kohavi, and M. Sahami, Supervised and unsupervised discretization of continuous features. In A. Prieditis and S. Russell (eds.), Machine Learning: Proceedings of the Twelfth International Conference (Morgan Kaufmann, 1995), pp. 194-202.
52. Z.-H. Zhou and Z.-Q. Chen, Hybrid decision tree, Knowledge-Based Systems 15(8) (2002) 515-528. (Pubitemid 34732325)
53. Z.-H. Zhou, S.-F. Chen, and Z.-Q. Chen, FANNC: A fast adaptive neural network classifier, Knowledge and Information Systems 2(1) (2000) 115-129.
54. X. Xie, J. W. K. Ho, C. Murphy, G. Kaiser, B. Xu, and Y. C. Tsong, Testing and validating machine learning classifiers by metamorphic testing, The Journal of Systems and Software 84 (2011) 544-558.
55. M. Palviainen, A. Evesti, and E. Ovaska, The reliability estimation, prediction and measuring of component-based software, The Journal of Systems and Software 84(2011) 1054-1070.