NOW G-net: Learning classification programs on networks of workstations

IEEE Transactions on Evolutionary Computation

Volumn 6, Issue 5, 2002, Pages 463-480

  Anglano, Cosimo ^a   Botta, Marco ^b  

^a UNIVERSITY OF EASTERN PIEDMONT   (Italy)

^b UNIVERSITY OF TURIN   (Italy)

Author keywords

Classification; Evolutionary computation; Machine learning; Networks of workstations; Parallel computing

Indexed keywords

COMPUTER SIMULATION; COMPUTER WORKSTATIONS; DATA MINING; HEURISTIC METHODS; KNOWLEDGE REPRESENTATION; LEARNING SYSTEMS; LOCAL AREA NETWORKS; LOGIC PROGRAMMING; NEURAL NETWORKS; PARALLEL PROCESSING SYSTEMS; PATTERN RECOGNITION; RANDOM PROCESSES;

DISTRIBUTED EVOLUTIONARY ALGORITHM; DYNAMIC LOAD DISTRIBUTION TECHNIQUES; GENETIC NETWORKS; LEARNING CLASSIFICATION PROGRAMS; NETWORKS OF WORKSTATIONS; PARALLEL STOCHASTIC SEARCH; STRUCTURED REPRESENTATION LANGUAGES;

GENETIC ALGORITHMS;

EID: 0036808967     PISSN: 1089778X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TEVC.2002.800882     Document Type: Article

References (85)

1. H. Ade, L. D. Readt, and M. Bruynooghe, "Declarative bias for specific-to-general ILP systems," Mach. Learn., vol. 20, pp. 119-154, 1995.
2. P. Angeline, "Adaptive and self-adaptive evolutionary computations," in Computational Intelligence: A Dynamic Systems Perspective, M. Palaniswami, Y. Attikiouzel, R. Marks, D. Fogel, and T. Fukuda, Eds. Piscataway, NJ: IEEE Press, 1995, pp. 152-163.
3. C. Anglano, A. Giordano, and G. Lo Bello, "High performance knowledge extraction from data on PC-based networks of workstations," in Proc. 2nd Int. Workshop on Personal Computer Based Networks of Workstations (PC-NOW'99), vol. 1586, Apr. 1999, pp. 1130-1144.
4. C. Anglano, A. Giordana, G. Lo Bello, and L. Saitta, "A network genetic algorithm for concept learning," in Proc. 7th Int. Conf. Genetic Algorithms, July 1997, pp. 434-441.
5. ____, "An experimental evaluation of coevolutive concept learning," in Proc. 15th Int. Conf. Machine Learning, July 1998, pp. 19-27.
6. ____, "Coevolutionary, distributed search for inducing concept descriptions," in Eur. Conf. Machine Learning, vol. 1398, 1998, pp. 322-333.
7. S. Augier, G. Venturini, and Y. Kodratoff, "Learning first order rules with a genetic algorithm," in Proc. 1st Int. Conf. Knowledge Discovery and Data Mining, 1995, pp. 21-26.
8. S. Baluja, "The evolution of genetic algorithms: Toward massive parallelism," in Proc. 10th Int. Conf. Machine Learning, 1993, pp. 1-8.
9. N. Boden, R. Felderman, A. Kulawik, C. Seitz, and W.-K. Su, "Myrinet: A gigabit-per-second local-area-network," IEEE Micro., vol. 15, pp. 29-36, Feb. 1995.
10. M. Botta and A. Giordana, "Smart+: A multi-strategy learning tool," in Proc. 13th Int. Joint Conf. Artificial Intelligence (IJCAI-93), Chambery, France, 1993, pp. 937-943.
11. M. Botta and R. Piola, "Refining numerical constants in first order logic theories," Mach. Learn., vol. 38, pp. 109-131, Feb. 2000.
12. L. Breiman, J. Friedman, R. Ohlsen, and C. Stone, Classification and Regression Trees. Pacific Grove, CA: Wadsworth & Brooks, 1984.
13. D. E. Brown, C. L. Huntley, and A. R. Spillane, "A parallel genetic heuristic for the quadratic assignment problem," in Proc. 3rd Int. Conf. Genetic Algorithms, 1989, pp. 406-415.
14. G. Chiola and G. Ciaccio, "Implementing a low cost, low latency parallel platform," Parallel Comput., vol. 22, no. 13, pp. 1703-1717, Feb. 1997.
15. ____, "Gamma and MPI/GAMMA on gigabit ethernet," in Proc. 7th Eur. PVM/MPI Users Group Meeting, vol. 1908, Sept. 2000, pp. 129-136.
16. A. P. Danyluk and F. J. Provost, "Small disjuncts in action: Learning to diagnose errors in the local loop of the telephone network," in Proc. 10th Int. Conf. Machine Learning, 1993, pp. 81-88.
17. L. De Raedt and S. Džeroski, "First-order jk-clausal theories are PAC-learnable," Artific. Intell., vol. 70, pp. 375-392, 1994.
18. K. Deb and D. E. Goldberg, "An investigation of niches and species formation in genetic function optimization," in Proc. 3rd Int. Conf. Genetic Algorithms, 1989, pp. 42-50.
19. L. Dehaspe, H. Toivonen, and R. D. King, "Finding frequent substructures in chemical compounds," in Proc. 4th Int. Conf. Knowledge Discovery and Data Mining, 1998, pp. 30-36.
20. K. De Jong, "Analysis of the behavior of a class of genetic adaptive systems," Ph.D. dissertation, Univ. Michigan, Ann Arbor, 1975.
21. K. A. De Jong, W. M. Spears, and F. D. Gordon, "Using genetic algorithms for concept learning," Mach. Learn., vol. 13, pp. 161-188, 1993.
22. J. B. Dennis, "Dataflow supercomputers," IEEE Computer, vol. 13, pp. 48-56, Nov. 1980.
23. T. G. Dietterich and R. S. Michalski, "A comparative review of selected methods for learning from examples," in Machine Learning: An Artificial Intelligence Approach, R. S. Michalski, J. G. Carbonell, and T. M. Mitchell, Eds. San Mateo, CA: Morgan Kaufmann, 1983, vol. I, pp. 41-81.
24. L. Fogel, A. Owens, and M. Walsh, Artificial Intelligence Through Simulated Evolution. New York: Wiley, 1966.
25. N. Friedman, D. Geiger, and M. Goldszmit, "Bayesian network classifiers," Mach. Learn., vol. 29, pp. 131-164, 1997.
26. A. Giordana and F. Neri, "Search-intensive concept induction," Evolut. Computat., vol. 3, pp. 375-416, 1996.
27. A. Giordana, F. Neri, L. Saitta, and M. Botta, "Integrating multiple learning strategies in first order logics," Mach. Learn., vol. 27, pp. 209-240, 1997.
28. A. Giordana and L. Saitta, "Learning disjunctive concepts by means of genetic algorithms," in Proc. 11th Int. Conf. Machine Learning, 1994, pp. 96-104.
29. D. Goldberg, Genetic Algorithms in Search, Optimization and Machine Learning. Reading, MA: Addison-Wesley, 1989.
30. D. E. Goldberg and J. Richardson, "Genetic algorithms with sharing for multimodal function optimization," in Proc. 2nd Int. Conf. Genetic Algorithms, 1987, pp. 41-49.
31. D. Greene and S. Smith, "Competition-based induction of decision models from examples," Mach. Learn., vol. 13, pp. 229-258, 1993.
32. J. J. Grefenstette, "Robot learning with parallel genetic algorithms on networked computers," in Proc. Summer Computer Simulation Conf., 1995, pp. 352-357.
33. F. Gruau and D. Whitley, "Adding learning to cellular development of neural networks: Evolution and Baldwin effect," Evolut. Computat., vol. 1, no. 3, pp. 213-233, 1993.
34. R. Hagmann, "Process servers: Sharing processing power in a workstation environment," Proc. 6th IEEE Int. Conf. Distributed Computing Systems, pp. 260-267, May 1986.
35. G. Harik, "Finding multimodal solutions using restricted tournament selection," in Int. Conf. Genetic Algorithms, 1995, pp. 24-31.
36. D. Haussler, "Learning conjunctive concepts in structural domains," Mach. Learn., vol. 4, pp. 70-40, 1989.
37. J. Hekanaho, "Symbiosis in multimodal concept learning," in Proc. 12th Int. Conf. Machine Learning, 1995, pp. 278-285.
38. C. Hewitt, P. Bishop, and R. Steiger, "A universal modular actor formalism for artificial intelligence," in Proc. Int. Joint Conf. Artificial Intelligence, 1973, pp. 235-245.
39. W. D. Hillis et al., "Co-evolving parasites improve simulated evolution as an optimization procedure," in Artificial Life, C. Langton et al., Eds. Reading, MA: Addison-Wesley, 1992, vol. II, pp. 313-324.
40. J. Holland, Adaptation in natural and artificial systems. Ann Arbor: Univ. Michigan Press, 1975.
41. J. H. Holland, "Escaping brittleness: The possibilities of general-purpose learning algorithms applied to parallel rule-based systems," in Machine Learning: An Artificial Intelligence Approach, J. G. C. R. S. Michalski, and T. M. Mitchell, Eds. San Mateo, CA: Morgan Kaufmann, 1986, vol. 2, pp. 593-623.
42. R. Holte, L. Acker, and B. Porter, "Concept learning and the problem of small disjuncts," in Proc. 11th Int. Joint Conf. Artificial Intelligence, Detroit, MI, 1989, pp. 813-818.
43. C. Hui and S. Chanson, "Improved strategies for dynamic load balancing," IEEE Concurrency, vol. 7, pp. 58-67, July-Sept. 1999.
44. P. Husbands and F. Mill, "Co-evolving parasites improve simulated evolution as an optimization procedure," in Proc. 4th Int. Conf. Genetic Algorithms, 1991, pp. 264-270.
45. C. Janikow, "A knowledge intensive genetic algorithm for supervised learning," Mach. Learn., vol. 13, pp. 198-228, 1993.
46. M. Kendall and A. Stuart, The Advanced Theory of Statistics, London, U.K.: Griffin, 1977.
47. R. D. King, A. Srinivasan, and M. J. E. Stenberg, "Relating chemical activity to structure: An examination of ILP successes," New Gener. Comput., vol. 13, no. 3-4, pp. 411-433, 1995.
48. P. Lanzi, W. Stolzmann, and S. Wilson, Learning Classifier Systems: From Foundations to Applications. New York: Springer-Verlag, 2000.
49. M. Litzkow, M. Livny, and M. Mutka, "Condor-A hunter of idle workstations," Proc. 8th IEEE Int. Conf. Distributed Computing Systems, pp. 260-267, May 1986.
50. B. Manderik and P. Spiessens, "Fine-grained parallel genetic algorithms," in Proc. 3rd Int. Conf. Genetic Algorithms, 1989, pp. 428-433.
51. T. Maruyama, T. Hirose, and A. Kongaya, "A fine-grained parallel genetic algorithm for distributed parallel systems," in Proc. 5th Int. Conf. Genetic Algorithms, 1993, pp. 184-190.
52. C. Merz, P. Murphy, and D. Aha, Repository of Machine Learning Databases. Irvine: Univ. California, 1991.
53. R. Michalski, "Pattern recognition as a rule-guided inductive inference," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-2, pp. 349-361, 1980.
54. ____, "A theory and methodology of inductive learning," in Machine Learning: An Artificial Intelligence Approach, J. C. R. Michalski and T. Mitchell, Eds. Los Altos, CA: Morgan Kaufmann, 1983, pp. 83-134.
55. K. Morik, "Balanced cooperative modeling," in Proc. 1st Multistrategy Learning Workshop, 1991, pp. 65-80.
56. S. Muggleton, "Inverse entailment and Progol," New Gener. Comput., vol. 13, pp. 245-286, 1995.
57. F. Neri and L. Saitta, "Genetic algorithms for pattern recognition," IEEE Trans. Pattern Anal. Machine Intell., vol. 18, pp. 1135-1142, 1996.
58. A. L. Oliveira and A. S. Vincentelli, "Using the minimum description length principle to infer reduced ordered decision graphs," Mach. Learn., vol. 25, no. 1, pp. 23-50, 1996.
59. M. J. Pazzani and D. Kibler, "The utility of knowledge in inductive learning," Mach. Learn., vol. 9, pp. 57-94, 1992.
60. C. C. Pettey and M. R. Leuze, "A theoretical investigation of a parallel genetic algorithm," in Proc. 3rd Int. Conf. Genetic Algorithms, 1989, pp. 398-405.
61. M. Potter, "The design and analysis of a computational model of cooperative coevolution," Ph.D. dissertation, George Mason Univ., Fairfax, VA, 1997.
62. M. Potter and K. De Jong, "Cooperative coevolution: An architecture for evolving coadapted subcomponents," Evolut. Computat., vol. 8, no. 1, pp. 1-30, 2000.
63. M. A. Potter, K. A. De Jong, and J. J. Grefenstette, "A coevolutionary approach to learning sequential decision rules," in Proc. 6th Inf. Conf. Genetic Algorithms, 1995, pp. 366-372.
64. L. Prylli and B. Tourancheau, "BIP: A new protocol designed for high performance networking on myrinet," in Proc. 1st Int. Workshop PC-Based Networks of Workstations (PC-NOW'98), vol. 1388. Orlando, FL, 1998, pp. 472-485.
65. J. R. Quinlan, "Improved estimates for the accuracy of small disjuncts," Mach. Learn., vol. 6, pp. 93-98, 1990.
66. ____, C4.5-Programs for Machine Learning. San Mateo, CA: Morgan Kaufmann, 1993.
67. R. Quinlan, "Induction of decision trees," Mach. Learn., vol. 1, pp. 81-106, 1986.
68. ____, "Learning logical definitions from relations," Mach. Learn., vol. 5, pp. 239-266, 1990.
69. V. Rayward-Smith, I. Osman, C. Reeves, and G. Smith, Modern Heuristic Search Methods. New York: Wiley, 1989.
70. J. Rissanen, "Modeling by shortest data description," Automatica, vol. 14, pp. 465-471, 1978.
71. D. E. Rumelhart and J. L. McClelland, Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Cambridge, MA: MIT Press, 1986, pt. I & II.
72. M. Sebag and C. Rouveirol, "Tractable induction and classification in first order logic via stochastic matching," in Proc. 15th Int. Joint Conf. Artificial Intelligence, Aug. 1997, pp. 888-893.
73. R. Shapire, "The strength of weak learnability," Mach. Learn., vol. 5, pp. 197-227, 1990.
74. W. Spears, "Simple subpopulation schemes," in Proc. Conf. Evolutionary Programming, 1994, pp. 296-307.
75. V. S. Sunderam, G. A. Geist, J. Dongarra, and R. Manchek, "The PVM concurrent-computing system: Evolution, experiences, and trends," Parallel Comput., vol. 20, no. 4, pp. 531-545, Apr. 1994.
76. G. Syswerda, "Uniform crossover in genetic algorithms," in Proc. 3rd Int. Conf. Genetic Algorithms, 1989, pp. 2-9.
77. E.-G. Talbi, J.-M. Geib, Z. Hafidi, and D. Kebbal, "Mars: An adaptive parallel programming environment," in High Performance Cluster Computing, vol. 1: Architectures and Systems, R. Buyya, Ed. Englewood Cliffs, NJ: Prentice-Hall, 1999, pp. 722-739.
78. R. Tanese, "Distributed genetic algorithms," in Proc. 3rd Int. Conf. Genetic Algorithms, 1989, pp. 434-439.
79. T. T. Team, The Top 500Supercomputer Sites. [Online]. Available: http://www.top500.org
80. G. Towell and J. Shavlik, "Knowledge based artificial neural networks," Artif. Intell., vol. 70, no. 4, pp. 119-166, 1994.
81. R. Weber, "On the optimal assignment of customers to parallel servers," J. Appl. Prob., vol. 15, pp. 406-413, 1978.
82. G. M. Weiss and H. Hirsh, "The problem with noise and small disjuncts," in Proc. 15th Int. Conf. Machine Learning, July 1998, pp. 574-578.
83. S. Wilson, "Classifier fitness based on accuracy," Evolut. Comput., vol. 3, no. 2, pp. 149-175, 1995.
84. M. Zaki, W. Li, and S. Parthasarathy, "Customized dynamic load balancing for a network of workstations," in Proc. 5th Int. Symp. High Performance Distributed Computing (HPDC6), Syracuse, NY, Aug. 1996, pp. 282-291.
85. M. Zaki, S. Parthasarathy, and W. Li, "Customized dynamic load balancing," in High Performance Cluster Computing, vol. 1: Architectures and Systems, R. Buyya, Ed. Englewood Cliffs, NJ: Prentice-Hall, 1999, pp. 579-604.