Neural-based learning classifier systems

IEEE Transactions on Knowledge and Data Engineering

Volumn 20, Issue 1, 2008, Pages 26-39

  Dam, Hai H ^b   Abbass, Hussein A ^a,b   Lokan, Chris ^b   Yao, Xin ^a,c  

^a IEEE

^b UNIVERSITY OF NEW SOUTH WALES   (Australia)

^c UNIVERSITY OF BIRMINGHAM   (United Kingdom)

Author keywords

Classification; Data mining; Evolutionary computing and genetic algorithms; Neural nets; Representations; Rule based processing

Indexed keywords

CLASSIFICATION (OF INFORMATION); DATA MINING; EVOLUTIONARY ALGORITHMS; NEURAL NETWORKS;

RULE-BASED PROCESSING; UNIVARIATE CLASSIFICATION RULE;

SUPERVISED LEARNING;

EID: 36649012798     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2007.190671     Document Type: Article

References (38)

1. H. A. Abbass, M. Towsey, and G. D. Finn. C-Net: A method for generating non-deterministic and dynamic multivariate decision trees. Knowledge and Information Systems, 3(2): 184-197, 2001.
2. E. Bernadó-Mansilla and J. M. Garrell-Guiu. Accuracy-based learning classifier systems: models, analysis and applications to classification tasks. Evolutionary Computation, 11(3):209-238, 2003.
3. E. Bernado-Mansilla, X. Llorà, and J. M. Garrell-Guiu. XCS and GALE: a comparative study of two learning classifier systems with six other learning algorithms on classification tasks. In Proceedings of the 4th International Workshop on Learning Classifier Systems (IWLCS2001), pages 337-341, 200.1. Short version published in Genetic and Evolutionary Compution Conference (GECCO2001).
4. G. Brown. Diversity in Neural Network Ensembles. PhD thesis, School of Computer Science, The University of Birmingham, 2004.
5. G. Brown, J. Wyatt, R. Harris, and X. Yao. Diversity creation methods: a survey and categorisation. Information Fusion, 6(1):5-20, 2005.
6. L. Bull. On using constructivism in neural classifier systems. In Parallel Problem Solving from Nature - PPSN VII, pages 558-567, 2002.
7. L. Bull and T. O'Hara. Accuracy-based neuro and neuro-fuzzy classifier systems. In GECCO '02: Proceedings of the Genetic and Evolutionary Computation Conference, pages 905-911, San Francisco, CA, USA, 2002. Morgan Kaufmann Publishers Inc.
8. M. V. Butz. Rule-based Evolutionary Online. Learning Systems: Learning Bounds, Classification, and Prediction. PhD thesis, University of Illinois at Urbana-Champaign, 2004.
9. M. V. Butz. Kernel-based, ellipsoidal conditions in the real-valued XCS classifier system. In GECCO '05: Proceedings of the 2005 conference on Genetic and evolutionary computation, pages 1835-1842, New York, NY, USA, 2005. ACM Press.
10. H. H. Dam, H. A. Abbass, and C. Lokan. Be real! XCS with continuous valued inputs. In Proceedings of the Eighth International Workshop on Learning Classifier Systems (IWLCS-2005), Washington D.C., USA, 2005.
11. P. Duell, I. Fermin, and X. Yao. Speciation techniques in evolved ensembles with negative correlation learning. In IEEE Congress on Evolutionary Computation, pages 16-21, Vancouver, Canada, 2006.
12. D. E. Goldberg. Genetic Algorithms in Search, Optimization, and Machine Learning. Addision-Wesley Publishing Company, INC., 1989.
13. S. Haykin. Neural networks, a comprehensive foundation. Prentice-Hall, Inc., second edition, 1999.
14. J. H. Holland. Adaptation in Natural and Artificial Systems. University of Michigan Press, Ann Arbor, 1975. Republished by the MIT press, 1992.
15. J. H. Holland. Properties of the bucket brigade. In Proceedings of the 1st International Conference on Genetic Algorithms, pages 1-7, Mahwah, NJ, USA, 1985. Lawrence Erlbaum Associates, Inc.
16. J. H. Holland. Escaping Brittleness: The Possibilities of GeneralPurpose Learning Algorithms Applied to Parallel Rule-Based Systems. In Mitchell, Michalski, and Carbonell, editors, Machine Learning, an Artificial Intelligence Approach. Volume II, chapter 20, pages 593-623. Morgan Kaufmann, 1986.
17. K. Hornik, M. Stinchcombe, and H. White. Multilayer feedforward networks are universal approximators. Neural Network, 2(5):359-366, 1989.
18. J. Hurst and L. Bull. A self-adaptive neural learning classifier system, with constructivism for mobile robot control. In Parallel Problem Solving from Nature - PPSN VIII, pages 942-951. Springer, 2004.
19. M. M. Islam, X. Yao, and K. Murase. A. constructive algorithm, for training cooperative neural network ensembles. IEEE Transactions on Neural Networks, 14(4):820-834, 2003.
20. T. Kovacs. What should a classifier system learn and how should we measure it? Journal of Soft Computing, 6(3-4):171-182, June 2002.
21. P. L. Lanzi and A. Perrucci. Extending the representation of classifier conditions part I: From, messy coding to S-expressions. In W. Banzhaf, J. Daida, A. E. Eiben, M. H. Garzon, V. Honavar, M. Jakiela, and R. E. Smith, editors, Proceedings of the Genetic and Evolutionary Computation Conference, volume 1, pages 337-344. Morgan Kaufmann, 1999.
22. P. L. Lanzi and A. Perrucci. Extending the representation of classifier conditions part II: From messy coding to S-expressions. In W. Banzhaf, J. Daida, A. E. Eiben, M. H. Garzon, V. Honavar, M. Jakiela, andR. E. Smith, editors, Proceedings of the Genetic and Evolutionary Computation Conference, volume 1, pages 345-352. Morgan Kaufmann, 1999.
23. W. P. Lincoln and J. Skrzypek. Synergy of clustering multiple back propagation networks. Advances in neural information processing systems 2, pages 650-659, 1990.
24. Y. Liu. Negative Correlation Learning and Evolutionary Design of Neural Network Ensembles. PhD thesis, University College, The University of New South Wales, Australian Defence Force Academy, Canberra, Australia, 1999.
25. Y. Liu and X. Yao. Negatively correlated neural networks can produce best ensembles. Australian journal of intelligent information processing systems, 4(3/4): 176-185, 1997.
26. Y. Liu, X. Yao, and T. Higuchi. Evolutionary ensembles with negative con-elation learning. IEEE Transactions on Evolutionary Computation, 4(4):380-387, 2000.
27. R. McKay and H. Abbass. Anti-correlation: A diversity promoting mechanism in ensemble learning. The Australian Journal of Intelligence Information Processing Systems, 7(3/4): 139-149, 2001.
28. D. Newman, S. Hettich, C. Blake, and C. Merz. UCI repository of machine learning databases, 1998.
29. N. J. Nilsson. Learning Machines: Foundations of Trainable PatternClassifying Systems. McGraw-Hill, 1965.
30. S. Quartz and T. Sejnowski. The neural basis of cognitive development: A. constructivist manifesto. Brain and Behavioral Sciences, 20(4):537-596, 1997.
31. K. Shafi, H. Abbass, and W. Zhu. The role of early stopping and population size in xcs for intrusion detection. In 6th International Conference on Simulated Evolution and Learning (SEAL'06), pages 50-57, Hefei, China, 2006.
32. A. Sharkey. On combining artificial neural nets. Connection Science, 8:299-313, 1996.
33. M. Skurichina, L. Kuncheva, and R. Duin. Bagging and boosting for the nearest mean classifier: Effects of sample size on diversity and accuracy. In International Workshop on Multiple Classifier Systems, pages 62-7.1. Springer, 2002.
34. S. F. Smith. A Learning System Based on Genetic Adaptive Algorithms. PhD thesis, University of Pittsburgh, 1980.
35. S. W. Wilson. Classifier fitness based on accuracy. Evolutionary Computation, 3(2):149-175, 1995.
36. S. W. Wilson. Generalization in the XCS classifier system. In J. R. Koza, W. Banzhaf, K. Chellapilla, K. Deb, M. Dorigo, D. B. Fogel, M. H. Garzon, D. E. Goldberg, H. Iba, and R. Riolo, editors, Genetic Programming 1998: Proceedings of the Third Annual Conference, pages 665-674, University of Wisconsin, Madison, Wisconsin, USA, 1998. Morgan Kaufmann.
37. S. W. Wilson. Get real! XCS with continuous-valued inputs. In P. Lanzi, W. Stolzmann, and S. Wilson, editors, Learning Classifier Systems, From Foundations to Applications, LNAI-1813, pages 209-219, Berlin, 2000. Springer-Verlag.
38. S. W. Wilson. Mining oblique data with. XCS. In P. L. Lanzi, W. Stolzmann, and S. W. Wilson, editors, Proceedings of the Third International Workshop (IWLCS-2000), Lecture Notes in Artificial Intelligence, pages 158-174, 2001.