Using ant programming guided by grammar for building rule-based classifiers

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 41, Issue 6, 2011, Pages 1585-1599

  Olmo, Juan Luis ^a   Romero, José Raúl ^a   Ventura, Sebastián ^a  

^a UNIVERSITY OF CÓRDOBA   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

AP ALGORITHM; CLASSIFICATION ALGORITHM; CLASSIFICATION RULES; CLASSIFICATION TECHNIQUE; DATA SETS; HEURISTIC FUNCTIONS; MINING CLASSIFICATION RULES; NEW MODEL; RULE-BASED CLASSIFIER; TRANSITION PROBABILITIES;

HEURISTIC ALGORITHMS;

CLASSIFICATION (OF INFORMATION);

EID: 81955161189     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2011.2157681     Document Type: Article

References (60)

1. J. Han and M. Kamber, Data Mining: Concepts and Techniques. San Mateo, CA: Morgan Kaufman, 2006.
2. S. B. Kotsiantis, I. D. Zaharakis and P. E. Pintelas, "Machine learning: A review of classification and combining techniques," Artif. Intell. Rev., vol. 26, no. 3, pp. 159-190, Nov. 2006.
3. H.-J. Huang and C.-N. Hsu, "Bayesian classification for data from the same unknown class," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 32, no. 2, pp. 137-145, Apr. 2002. (Pubitemid 34249372)
4. T.-M. Huang, V. Kecman and I. Kopriva, "Support vector machines in classification and regression-An introduction," in Kernel Based Algorithms for Mining Huge Data Sets: Supervised, Semi-supervised and Unsupervised Learning (Studies in Computational Intelligence). New York: Springer-Verlag, 2006.
5. S. Haykin, Neural Networks and Learning Machines, 3rd ed. Upper Saddle River, NJ: Pearson, 2009.
6. S. U. Guan and F. Zhu, "An incremental approach to genetic-algorithmsbased classification," IEEE Trans. Syst.,Man, Cybern. B, Cybern., vol. 35, no. 2, pp. 227-239, Apr. 2005.
7. K. C. Tan, Q. Yu, C. M. Heng and T. H. Lee. (2003, Feb.). Evolutionary computing for knowledge discovery in medical diagnosis. Artif. Intell. Med. [Online]. 27( 2), pp. 129-154. Available: http://www.sciencedirect.com/science/ article/B6T4K-47RRWS9-2/2/5c8dfaf6e49d194b0c8ed6e2fd1b5117 (Pubitemid 36294091)
8. M. Dorigo and T. Stützle, The Ant Colony Optimization Metaheuristic: Algorithms, Applications and Advances, F. Glover and G. Kochenberger, Eds. Norwell, MA: Kluwer, 2002, ser. International Series in Operations Research and Management Science.
9. M. Dorigo and T. Stützle, The ant colony optimization metaheuristic: Algorithms, applications and advances, IRIDIA, Université Libre de Bruxelles, Brussels, Belgium, Tech. Rep. TR/IRIDIA/2000-32. [Online]. Available: ftp://iridia.ulb.ac.be/pub/mdorigo/tec.reps/TR.11-MetaHandBook.pdf
10. R. Parpinelli, A. A. Freitas and H. S. Lopes, "Data mining with an ant colony optimization algorithm," IEEE Trans. Evol. Comput., vol. 6, no. 4, pp. 321-332, Aug. 2002. (Pubitemid 35032734)
11. J. R. Koza, Genetic Programming: On the Programming of Computers by Means of Natural Selection. Cambridge, MA: MIT Press, 1992.
12. O. Roux and C. Fonlupt, "Ant programming: Or how to use ants for automatic programming," in Proc. ANTS, M. Dorigo and E. Al, Eds., 2000, pp. 121-129.
13. P. Espejo, S. Ventura and F. Herrera, "A survey on the application of genetic programming to classification," IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 40, no. 2, pp. 121-144, Mar. 2010.
14. J. Fürnkranz. (1999, Jan.). Separate-and-conquer rule learning. Artif. Intell. Rev. [Online]. 13(1), pp. 3-54. Available: http://portal.acm.org/ citation.cfm?id=309283.309291
15. E. Bonabeu, T. Eric and M. Dorigo, Swarm Intelligence: From Natural to Artificial Systems. New York: Oxford Univ. Press, 1999.
16. M. Dorigo, V. Maniezzo and A. Colorni, "The ant system: Optimization by a colony of cooperating agents," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 26, no. 1, pp. 29-41, Feb. 1996. (Pubitemid 126780573)
17. D. Martens, B. Baesens and T. Fawcett. (2011, Jan.). Editorial survey: Swarm intelligence for data mining. Mach. Learn. [Online]. 82(1), pp. 1-42. Available: http://dx.doi.org/10.1007/s10994-010-5216-5
18. B. Liu, H. A. Abbass and B. McKay, "Density-based heuristic for rule discovery with ant-miner," in Proc. 6th Australasia-Japan Joint Workshop Intell. Evol. Syst., 2002, pp. 180-184.
19. B. Liu, H. A. Abbass and B. McKay, "Classification rule discovery with ant colony optimization," in Proc. IEEE/WIC Int. Conf. IAT, 2003, pp. 83-88.
20. Z. Wang and B. Feng, "Classification rule mining with an improved ant colony algorithm," in Proc. Aust. Conf. Artif. Intell., vol. 3339, LNAI, 2004, pp. 357-367. (Pubitemid 41050367)
21. C. Chen, Y. Chen and J. He, "Neural network ensemble based ant colony classification rule mining," in Proc. Int. Conf. Innovative Comput., Inf. Control, 2006, vol. 3, pp. 427-430.
22. A. Chan and A. Freitas, "A new classification-rule pruning procedure for an ant colony algorithm," in Proc. Artif. Evol., 2006, pp. 25-36. (Pubitemid 44011437)
23. A. Chan and A. A. Freitas, "A new ant colony algorithm for multilabel classification with applications in bioinformatics," in Proc. GECCO, Jul. 2006, pp. 27-34. (Pubitemid 44611291)
24. J. Smaldon and A. A. Freitas, "A new version of the ant-miner algorithm discovering unordered rule sets," in Proc. GECCO, 2006, pp. 43-50. (Pubitemid 44611293)
25. P. Jin, Y. Zhu, K. Hu and S. Li, Classification Rule Mining Based on Ant Colony Optimization Algorithm, New York: Springer-Verlag, 2006, vol. 344, pp. 654-663. [Online]. Available: http://dx.doi.org/10.1007/978- 3-540-37256-1-82
26. M. Galea and Q. Shen, "Simultaneous ant colony optimization algorithms for learning linguistic fuzzy rules," in Swarm Intelligence in Data Mining. Berlin, Germany: Springer-Verlag, 2006, pp. 75-99.
27. S. Swaminathan, "Rule induction using ant colony optimization for mixed variable attributes," M.S. thesis, Texas Tech Univ., Lubbock, TX, 2006.
28. D. Martens, M. De Backer, J. Vanthienen, M. Snoeck and B. Baesens, "Classification with ant colony optimization," IEEE Trans. Evol. Comput., vol. 11, no. 5, pp. 651-665, Oct. 2007. (Pubitemid 47527996)
29. F. Otero, A. A. Freitas and C. Johnson, "cant-miner: An ant colony classification algorithm to cope with continuous attributes," in Proc. ANTS Conf., vol. 5217, LNCS, 2008, pp. 48-59.
30. C. Nalini and P. Balasubramanie, "Discovering unordered rule sets for mixed variables using an ant-miner algorithm," Data Sci. J., vol. 7, pp. 76- 87, May 2008.
31. F. E. Otero, A. A. Freitas and C. G. Johnson, "A hierarchical classification ant colony algorithm for predicting gene ontology terms," in Proc. 7th Eur. Conf. EvoBIO, 2009, pp. 68-79.
32. K. M. Salama and A. M. Abdelbar, "Extensions to the ant-miner classification rule discovery algorithm," in Proc. 7th Int. Conf. Swarm Intell.- ANTS, vol. 6234, LNCS, 2010, pp. 167-178.
33. T. Stützle and H. H. Hoos, "Max-min ant system," Future Gener. Comput. Syst., vol. 16, no. 8, pp. 889-914, Jun. 2000.
34. N. Holden and A. A. Freitas. (2008, Jan.). A hybrid PSO/ACO algorithm for discovering classification rules in data mining. J. Artif. Evol. Appl. [Online]. 2008, pp. 2:1-2:11. Available: http://dx.doi.org/10.1155/2008/316145
35. Y. Chen, B. Yang and J. Dong, "Evolving flexible neural networks using ant programming and PSO algorithm," in Proc. ISNN (1), 2004, pp. 211-216.
36. M. Boryczka and Z. J. Czech, "Solving approximation problems by ant colony programming," in Proc. GECCO Late Breaking Papers, 2002, pp. 39-46.
37. M. Boryczka, Z. J. Czech and W. Wieczorek, "Ant colony programming for approximation problems," in Proc. GECCO, 2003, pp. 142-143.
38. J. Green, J. Whalley and C. Johnson, "Automatic programming with ant colony optimization," in Proc. UK Workshop Comput. Intell., 2004, pp. 70-77.
39. M. Boryczka, "Eliminating introns in ant colony programming," Fundam. Inf., vol. 68, no. 1/2, pp. 1-19, Apr. 2005.
40. M. Boryczka, "Ant colony programming with the candidate list," in Proc. KES-AMSTA, vol. 4953, LNAI, 2008, pp. 302-311.
41. H. A. Abbass, X. Hoai and R. I. Mckay, "AntTAG: A new method to compose computer programs using colonies of ants," in Proc. IEEE Congr. Evol. Comput., 2002, pp. 1654-1659.
42. P. Whigham, "Grammatically biased genetic programming," in Proc. Workshop Genetic Program.: From Theory Real-World Appl., 1995, pp. 33-41.
43. N. Hoai and R. McKay, "A framework for tree adjunct grammar guided genetic programming," in Proc. PACCS, 2001, pp. 93-99.
44. C. Keber and M. G. Schuster, "Option valuation with generalized ant programming," in Proc. GECCO, W. B. Langdon, E. Cantú-Paz, K. Mathias, R. Roy, D. Davis, R. Poli, K. Balakrishnan, V. Honavar, G. Rudolph, J. Wegener, L. Bull, M. A. Potter, A. C. Schultz, J. F. Miller, E. Burke, N. Jonoska et al., Eds., Jul. 9-13, 2002, pp. 74-81. [Online]. Avaialble: http://www.cs.bham.ac.uk/~wbl/biblio/gecco2002/aaaa075.ps
45. A. Salehi-Abari and T. White, "Enhanced generalized ant programming (EGAP)," in Proc. 10th GECCO, 2008, pp. 111-118.
46. A. Salehi-Abari and T. White, "The uphill battle of ant programming vs. genetic programming," in Proc. IJCCI, 2009, pp. 171-176.
47. S. Shirakawa, S. Ogino and T. Nagao. (2008, Sep.). Dynamic ant programming for automatic construction of programs. IEEJ Trans. Elect. Electron. Eng. (TEEE). [Online]. 3(5), pp. 540-548. Available: http://dx.doi.org/doi:10. 1002/tee.20311
48. F. Neumann, D. Sudholt and C. Witt, "Computational complexity of ant colony optimization and its hybridization with local search," Innovations in Swarm Intelligence, vol. 248, pp. 91-120, Berlin, Germany: Springer- Verlag, 2009. [Online]. Available: http://dx.doi.org/10.1007/978-3-642-04225-6-6
49. R. J. Mullen, D. Monekosso, S. Barman and P. Remagnino, "A review of ant algorithms," Expert Syst. Appl., vol. 36, no. 6, pp. 9608-9617, Aug. 2009.
50. A. Geyer-Schulz, Fuzzy Rule-Based Expert Systems and Genetic Machine Learning, vol. 3. Heidelberg, Germany: Physica-Verlag, 1995, ser. Studies in Fuzziness.
51. P. Clark and R. Boswell, "Rule induction with CN2: Some recent improvements," in Proc. EWSL, 1991, pp. 151-163.
52. J. Ávila, E. Gibaja, A. Zafra and S. Ventura, "A niching algorithm to learn discriminant functions with multi-label patterns," in Proc. IDEAL, 2009, pp. 570-577.
53. A. Frank and A. Asuncion, UCI Machine Learning Repository, 2010. [Online]. Available: http://archive.ics.uci.edu/ml
54. U. M. Fayyad and K. B. Irani, "Multi-interval discretization of continuous-valued attributes for classification learning," in Proc. 13th IJCAI, 1993, pp. 1022-1029.
55. C. C. Bojarczuk, H. S. Lopes, A. A. Freitas and E. L. Michalkiewicz, "A constrained-syntax genetic programming system for discovering classification rules: Application to medical data sets," Artif. Intell. Med., vol. 30, no. 1, pp. 27-48, Jan. 2004. (Pubitemid 37543646)
56. S. Ventura, C. Romero, A. Zafra, J. A. Delgado and C. Hervás, "JCLEC: A java framework for evolutionary computation," Soft Comput., vol. 12, no. 4, pp. 381-392, Oct. 2007.
57. D. H. Wolpert, "The lack of a priori distinctions between learning algorithms," Neural Comput., vol. 8, no. 7, pp. 1341-1390, Oct. 1996. (Pubitemid 126449973)
58. D. H. Wolpert and W. G. Macready. (1997, Apr.). No free lunch theorems for optimization. IEEE Trans. Evol. Comput. [Online]. 1(1), pp. 67-82. Available: http://dx.doi.org/10.1109/4235.585893 (Pubitemid 127771019)
59. J. Demşar, "Statistical comparisons of classifiers over multiple data sets," J. Mach. Learn. Res., vol. 7, pp. 1-30, 2006. (Pubitemid 43022939)
60. D. J. Sheskin, Handbook of Parametric and Nonparametric Statistical Procedures. Boca Raton, FL: Chapman & Hall/CRC, 2007.