Applying Ant Colony Optimization to configuring stacking ensembles for data mining

Expert Systems with Applications

Volumn 41, Issue 6, 2014, Pages 2688-2702

  Chen, Yijun ^a   Wong, Man Leung ^a   Li, Haibing ^a  

^a LINGNAN UNIVERSITY   (Hong Kong)

Author keywords

ACO; Data mining; Direct marketing; Ensemble; Metaheuristics; Stacking

Indexed keywords

ACO; DIRECT MARKETING; ENSEMBLE; META HEURISTICS; STACKING;

ANT COLONY OPTIMIZATION; DATA MINING; EXPERIMENTS; HEURISTIC ALGORITHMS;

ARTIFICIAL INTELLIGENCE;

EID: 84890061675     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2013.10.063     Document Type: Article

References (55)

1. D.W. Aha, D. Kibler, and M.K. Albert Instance-based learning algorithms Machine Learning 6 1 1991 37 66 (Pubitemid 21727227)
2. A. Al-Ani Feature subset selection using ant colony optimization International Journal of Computational Intelligence 2 2006 53 58
3. S. Bhattacharyya Direct marketing performance modeling using genetic algorithms INFORMS Journal on Computing 11 3 1999 248 257
4. L. Breiman Bagging predictors Machine Learning 24 2 1996 123 140 (Pubitemid 126724382)
5. L. Breiman Random forest Machine Learning 45 1 2001 5 32
6. L.M. Campos, J.M. Fernández-Luna, J. Gámez, and J.M. Puerta Ant colony optimization for learning bayesian networks International Journal of Approximate Reasoning 31 3 2002 291 311 (Pubitemid 35411834)
7. A. Chan, and A. Freitas A new classification-rule pruning procedure for an ant colony algorithm Artificial evolution 2006 Springer pp. 25-36
8. â̂ -: An instance-based learner using an entropic distance measure Proceedings of the 12th international conference on machine learning 1995 Morgan Kaufmann 108 114
9. G. Cui, M.L. Wong, G. Zhang, and L. Li Model selection for direct marketing: Performance criteria and validation methods Marketing Intelligence and Planning 26 3 2008 275 292
10. G. Demiröz, and A. Güvenir Classification by voting feature intervals Proceedings of the 9th european conference on machine learning Vol. 1224 1997 Springer-Verlag London, UK 85 92
11. J. Demšar Statistical comparisons of classifiers over multiple data sets Journal of Machine Learning Research 7 2006 1 30 (Pubitemid 43022939)
12. T.G. Dietterich Ensemble methods in machine learning 2000 Springer pp. 1-15
13. M. Dorigo, and T. Stützle Ant colony optimization 2004 MIT Press
14. R.O. Duda, P.E. Hart, and D.G. Stork Pattern classification 2012 John Wiley & Sons
15. S. Džeroski, and B. Z̆enko F. Roli, J. Kittler, Stacking with multi-response model trees International workshop on multiple classifier systems Vol. 2364 2002 Springer 201 211
16. Fan, W., Stolfo, S. J., Zhang, J., & Chan, P. K. (1999). AdaCost: Misclassification cost-sensitive boosting. In Proceedings of the sixteenth international conference on machine learning (pp. 97-105).
17. Fern, X. Z., & Brodley, C. E. (2003). Random projection for high dimensional data clustering: A cluster ensemble approach. In Machine learning-international workshop then conference (pp. 186-193).
18. Frank, A., & Asuncion, A. (2010). UCI machine learning repository. .
19. E. Frank, and I.H. Witten Generating accurate rule sets without global optimization Proceedings of The 15th international conference on machine learning 1998 Morgan Kaufmann 144 151
20. Freund, Y. & Schapire, R. E. (1996). Experiments with a new boosting algorithm. In Proceedings of the 13th international conference in machine learning (pp. 148-156).
21. Y. Freund, and R.E. Schapire Decision-theoretic generalization of on-line learning and an application to boosting Journal of Computer and System Science 55 1 1997 119 139 (Pubitemid 127433398)
22. M. Friedman The use of ranks to avoid the assumption of normality implicit in the analysis of variance Journal of the American Statistical Association 32 1937 675 701
23. S. García, and F. Herrera An extension on statistical comparisons of classifiers over multiple data sets for all pairwise comparisons Journal of Machine Learning Research 9 2008 2677 2694
24. S. Goss, S. Aron, J.L. Deneubourg, and J.M. Pasteels Self-organized shortcuts in the argentine ant Naturwissenschaften 76 12 1989 579 581 (Pubitemid 20073252)
25. W.J. Gutjahr Aco algorithms with guaranteed convergence to the optimal solution Information Processing Letters 82 3 2002 145 153 (Pubitemid 34181987)
26. M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I.H. Witten The WEKA data mining software: An update SIGKDD Explorations 11 1 2009 10 18
27. S. Holm A simple sequentially rejective multiple test procedure Scandinavian Journal of Statistics 6 1979 65 70
28. R.C. Holte Very simple classification rules perform well on most commonly used datasets Machine Learning 11 1993 63 90
29. W. Iba, and P. Langley Induction of one-level decision trees Proceedings of the 9th international workshop on machine learning 1992 Morgan Kaufmann Publishers Inc. San Francisco, CA, USA 233 240
30. G. John, and P. Langley Estimating continuous distributions in bayesian classifiers Proceedings of the eleventh conference on uncertainty in artificial intelligence 1995 Morgan Kaufmann 338 345
31. S. LeCessie, and J.C. VanHouwelingen Ridge estimators in logistic regression Applied Statistics 41 1 1992 191 201
32. A. Ledezma, R. Aler, and D. Borrajo Heuristic and optimization for knowledge discovery Heuristic search-based stacking of classifiers 2002 Idea Group Publishing pp. 54-67
33. B. Liu, H.A. Abbas, and B. McKay Classification rule discovery with ant colony optimization IEEE/WIC international conference on intelligent agent technology, IAT 2003 2003 IEEE 83 88
34. Z. Lu, X. Wu, X. Zhu, and J. Bongard Ensemble pruning via individual contribution ordering Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining 2010 ACM New York, NY, USA 871 880
35. C.J. Merz Using correspondence analysis to combine classifiers Machine Learning 36 1-2 1999 33 58
36. Ordóñez, F. J., Ledezma, A., & Sanchis, A. (2008). Genetic approach for optimizing ensembles of classifiers. In Proceedings of the twenty-first international FLAIRS conference (pp. 89-94).
37. R.S. Parpinelli, H.S. Lopes, and A.A. Freitas Data mining with an ant colony optimization algorithm IEEE Transactions on Evolutionary Computation 6 2002 321 332 (Pubitemid 35032734)
38. P.C. Pinto, A. Nägele, M. Dejori, T.A. Runkler, and J.M.C. Sousa Using a local discovery ant algorithm for Bayesian network structure learning IEEE Transactions on Evolutionary Computation 13 4 2009 767 779
39. R. Polikar Ensemble based systems in decision making IEEE Circuits and Systems Magazine 6 3 2006 21 45
40. J.R. Quinlan C4.5: programs for machine learning 1993 Morgan Kaufmann Publishers Inc. San Francisco, CA, USA
41. R. Ramanathan An Introduction to Data Envelopment Analysis 2003 SAGE Publications
42. R.E. Schapire The strength of weak learnability Machine Learning 5 2 1990 197 227
43. Seewald, A. K. (2002). How to make stacking better and faster while also taking care of an unknown weakness. In Proceedings of the 19th international conference on machine learning, ICML '02 (pp. 554-561).
44. R.K. Sivagaminathan, and S. Ramakrishnan A hybrid approach for feature subset selection using neural networks and ant colony optimization Expert Systems with Applications 33 2007 49 60 (Pubitemid 44959916)
45. Y. Sun, M.S. Kamel, A.K. Wong, and Y. Wang Cost-sensitive boosting for classification of imbalanced data Pattern Recognition 40 12 2007 3358 3378 (Pubitemid 47223287)
46. K.M. Ting, and I.H. Witten Issues in stacked generalization Journal of Artificial Intelligence Research 10 1 1999 271 289 (Pubitemid 30573908)
47. L. Todorovski, and S. Džeroski Combining multiple models with meta decision trees Proceedings of the 4th european conference on principles of data mining and knowledge discovery, PKDD '00 2000 Springer Berlin, Heidelberg 54 64
48. Z. Wang, and B. Feng Classification rule mining with an improved ant colony algorithm AI 2004: Advances in Artificial Intelligence 2005 Springer 357 367
49. D.H. Wolpert Stacked generalization Neural Networks 5 2 1992 241 259
50. Wong, M. L. & Cui, G. (2010). Data mining using parallel multi-objective evolutionary algorithms on graphics hardware. In Proceedings of 2010 IEEE Congress on Evolutionary Computation (pp. 1-8).
51. J. Zahavi, and N. Levin Applying neural computing to target marketing Journal of Interactive Marketing 11 1 1997 5 22
52. X. Zhang, X. Chen, and Z. He An ACO-based algorithm for parameter optimization of support vector machines Expert Systems with Applications 37 2010 6618 6628
53. Z. Zheng, and B. Padmanabhan Constructing ensembles from data envelopment analysis INFORMS Journal on Computing 19 4 2007 486 496
54. Z.H. Zhou, J.X. Wu, W. Tang, and Z.Q. Chen Combining regression estimators: Ga-based selective neural network ensemble International Journal of Computational Intelligence and Applications 1 4 2001 341 356
55. D. Zhu A hybrid approach for efficient ensembles Decision Support Systems 48 3 2010 480 487