Prototype selection algorithms for distributed learning

Pattern Recognition

Volumn 43, Issue 6, 2010, Pages 2292-2300

  Czarnowski, Ireneusz ^a  

^a GDYNIA MARITIME UNIVERSITY   (Poland)

Author keywords

Data reduction; Distributed data mining; Distributed learning; Instance selection

Indexed keywords

AGENT BASED; AGENT COLLABORATION; BASIC PROPERTIES; COMPUTATIONAL EXPERIMENT; COMPUTATIONAL PROBLEM; DATA CLUSTERS; DISTRIBUTED DATA; DISTRIBUTED DATA MINING; DISTRIBUTED DATABASE; DISTRIBUTED LEARNING; DISTRIBUTED SITES; GLOBAL KNOWLEDGE; GLOBAL MODELS; INSTANCE SELECTION; LOCAL PATTERNS; POPULATION LEARNING ALGORITHMS; PROTOTYPE SELECTION;

DATA REDUCTION; POPULATION STATISTICS;

LEARNING ALGORITHMS;

EID: 76749097995     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2010.01.006     Document Type: Article

References (53)

1. Aha D.W., Kibler D., and Albert M.K. Instance-based learning algorithms. Machine Learning 6 (1999) 37-66
2. M. Allen, S. Zilberstein, Agent influence as a predictor of difficulty for decentralized problem-solving, in: Proceedings of the 22nd International Conference on Artificial Intelligence, AAAI Press, Menlo Park, CA, 2007, pp. 688-693.
3. A. Asuncion, D.J. Newman, UCI machine learning repository 〈http://www.ics.uci.edu/mlearn/MLRepository.html〉. University of California, School of Information and Computer Science, Irvine, CA, 2007.
4. S. Bailey, R. Grossman, H. Sivakumar, A. Turinsky, Papyrus: a system for data mining over local and wide area clusters and super-clusters, in: Proceedings of the ACM/IEEE SC Conference (SC '99), 1999, p. 63.
5. Barbucha D., Czarnowski I., Jedrzejowicz P., Ratajczak-Ropel E., and Wierzbowska I. An implementation of the JADE-base A-team environment. International Transactions on Systems Science and Applications 3 4 (2008) 319-328
6. Bezdek J.C., and Kuncheva L.I. Nearest prototype classifier design: an experimental study. International Journal of Intelligence Systems 16 2 (2000) 1445-1473
7. M. Borth, Learning from multiple Beyesian networks for revision and refinement of expert systems, in: M. Jarke, J. Koehler, G. Lekemeyer (Eds.), Proceedings of the 25th Annual German Conference on AI, Aachen, 2002, pp. 82-96.
8. P.S. Bradley, U.M. Fayyad, Refining initial points for K-means clustering, in: Proceedings of the Fifteenth International Conference on Machine Learning, 1998, pp. 91-99.
9. Cano J.R., Herrera F., and Lozano M. On the combination of evolutionary algorithms and stratified strategies for training set selection in data mining. Applied Soft Computing 6 (2004) 323-332
10. Caragea D., Silvescu A., and Honavar V. A framework for learning from distributed data using sufficient statistics and its application to learning decision trees. International Journal of Hybrid Intelligent Systems 1 1-2 (2003) 80-89
11. N. Chawla, S. Eschrich, L.O. Hall, Creating ensembles of classifiers, in: Proceedings of the ICDM 2001, USA, 2001, pp. 580-581.
12. Czarnowski I., and Jedrzejowicz P. An approach to instance reduction in supervised learning. In: Coenen F., Preece A., and Macintosh A. (Eds). Research and Development in Intelligent Systems, vol. XX (2004), Springer, London 267-282
13. Czarnowski I., Jedrzejowicz P., and Wierzbowska I. An A-team approach to learning classifiers from distributed data sources. International Journal of Intelligence Information and Database Systems 3 4 (2009)
14. Dash M., and Liu H. Feature selection for classification. Intelligence Data Analysis 1 3 (1997) 131-156
15. P. Edward, W. Davies, A heterogeneous multi-agent learning system, in: S.M. Deen (Ed.), Proceedings of the Special Internet Group on Cooperating Knowledge Based Systems, 1993, pp. 163-184.
16. Frawley W.J., Piatetsky-Shapiro G., and Matheus C. Knowledge discovery in databases-an overview. In: Piatetsky-Shapiro G., and Matheus C. (Eds). Knowledge Discovery in Databases (1991), AAAI/MIT Press
17. Glover F. Tabu search. Parts I and II. ORSA Journal of Computing 1 3 (1990)
18. Glover F. Tabu search. Part I and II. ORSA Journal of Computing 2 1 (1990)
19. Y. Guo, J.P. Muller, Multiagent collaborative learning for distributed business systems, in: Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems AAMAS'04, New York, 2004.
20. Y. Hamo, S. Markovitch, The COMPSET algorithm for subset selection, in: Proceedings of the Nineteenth International Joint Conference for Artificial Intelligence, Edinburgh, Scotland, 2005, pp. 728-733.
21. Han J., and Kamber M. Data Mining. Concepts and Techniques (2001), Academic Press, San Diego
22. J. Huang, A.R. Pearce, Distributed interactive learning in multi-agent systems, in: Proceedings of the Twenty-First National Conference on Artificial Intelligence, AAAI Press, 2006, pp. 666-671.
23. Jedrzejowicz P. Social learning algorithm as a tool for solving some difficult scheduling problems. Foundation of Computing and Decision Sciences 24 (1999) 51-66
24. M. Klusch, S. Lodi, G-L Moro, Agent-based distributed data mining: the KDEC scheme, in: M. Klusch, S. Bergamaschi, P. Edwards, P. Petta (Eds.) Intelligent Information Agents: The AgentLink Perspective, Lecture Notes in Artificial Intelligence, vol. 2586, Springer, 2003, pp. 104-122.
25. S. Krishnaswamy, A. Zaslavsky, S.W. Loke, Techniques for estimating the computation and communication costs of distributed data mining, in: P.M.A. Sloot, et al. (Eds.), ICCS 2002, Lecture Notes in Computer Science, vol. 2329, 2002, pp. 603-612.
26. Kuri-Morales A.F., and Rodriguez-Erazo F. A search space reduction methodology for data mining in large databases. Engineering Applications of Artificial Intelligence 22 1 (2009) 57-65
27. H. Liu, H. Lu, J. Yao, Identifying relevant databases for multidatabase mining, in: Proceedings of the Pacific-Asia Conference on Knowledge Discovery and Data Mining, 1998, pp. 210-221.
28. Manning C.D., Raghavan P., and Schütze H. Introduction to Information Retrieval (2008), Cambridge University Press
29. In: Liu H., and Motoda H. (Eds). Instance Selection and Construction for Data Mining (2001), Kluwer Academic Publisher
30. Lu X., and Xueguang S. Methods of Chemometrics (2004), Science Press, Beijing
31. J. B. MacQueen, Some methods for classification and analysis of multivariate observations, in: Proceedings of the 5th Berkeley Symposium on Mathematical Statistics and Probability, vol. 1, University of California Press, Berkeley, 1967, pp. 281-297.
32. Meiri R., and Zahavi J. Using simulated annealing to optimize the feature selection problem in marketing applications. European Journal of Operational Research 17 3 (2006) 842-858
33. Michalewicz Z. Genetic Algorithms+Data Structures=Evolution Programs (1996), Springer, Berlin
34. Morgan J., Daugherty R., Hilchie A., and Carey B. Sample size and modeling accuracy of decision tree based data mining tools. Academy of Information and Management Science Journal 6 2 (2003) 71-99
35. Prodromidis A., Chan P.K., and Stolfos S.J. Meta-learning in distributed data mining systems: issues and approaches. In: Kargupta H., and Chan P. (Eds). Advances in Distributed and Parallel Knowledge Discovery vol. 3 (2000), AAAI/MIT Press
36. Quinlan J.R. C4.5: Programs for Machine Learning, (1993), Morgan Kaufmann Publishers, SanMateo
37. Sian S. Extending learning to multiple agents: issues and a model for multi-agent machine learning (ma-ml). In: Kodratoff Y. (Ed). Machine Learning-EWSL-91 (1991), Springer-Verlag 440-456
38. da Silva J., Giannella C., Bhargava R., Kargupta H., and Klusch M. Distributed data mining and agents. Engineering Applications of Artificial Intelligence Journal 18 (2005) 791-807
39. S. Stolfo, A.L. Prodromidis, S. Tselepis, W. Lee, D.W. Fan, JAM: Java Agents for Meta-learning over distributed databases, in: Proceedings of the 3rd International Conference on Knowledge Discovery and Data Mining, Newport Beach, CA, AAAI Press, 1997, pp. 74-81.
40. D.B. Skalak, Prototype and feature selection by sampling and random mutation hill climbing algorithm, in: Proceedings of the International Conference on Machine Learning, 1994, pp. 293-301.
41. Talukdar S.N., Pyo S.S., and Giras T. Asynchronous procedures for parallel processing. IEEE Transactions on PAS PAS-102 11 (1983) 3652-3659
42. The European Network of Excellence on Intelligence Technologies for Smart Adaptive Systems (EUNITE)-EUNITE World Competition in domain of Intelligent Technologies-〈http://neuron.tuke.sk/competition2〉, 2002.
43. Tomek I. An experiment with the edited nearest-neighbour rule. IEEE Transactions on Systems, Man, and Cybernetics 6 6 (1976) 448-452
44. Tozicka J., Rovatsos M., Pechoucek M., and Urban U. MALEF: framework for distributed machine learning and data mining. International Journal of Intelligent Information and Database Systems 2 1 (2008) 6-24
45. Tsoumakas G., Angelis L., and Vlahavas I. Clustering classifiers for knowledge discovery from physical distributed database. Data and Knowledge Engineering 49 3 (2004)
46. A.L. Turinsky, R.L. Grossman, A framework for finding distributed data mining strategies that are intermediate between centralised strategies and in-place strategies, in: Proceedings of the KDD Workshop on Distributed Data Mining, 2000.
47. Wilson D.R., and Martinez T.R. Reduction Techniques for Instance-based Learning Algorithm, Machine Learning vol. 33(3) (2000), Kluwer Academic Publishers, Boston pp. 257-286
48. Winton D., and Pete E. Using instance selection to combine multiple models learned from disjoint subsets. In: Liu H., and Motoda H. (Eds). Instance Selection and Construction for Data Mining (2001), Kluwer Scientific Publisher
49. Wolpert D. Stacked generalisation. Neural Networks 5 (1992) 241-259
50. Zhang X.F., Lam C.M., and Cheung W.K. Mining local data sources for learning global cluster model via local model exchange. IEEE Intelligence Informatics Bulletin 4 2 (2004) 748-751
51. D. Zhang, Zhi-Hua Zhou, Songcan Chen, Semi-supervised dimensionality reduction, in: Proceedings of the International Conference Data Mining, 2007, pp. 629-634.
52. Zhang S., Wu X., and Zhang C. Multi-database mining. IEEE Computational Intelligence Bulletin 2 1 (2003) 5-13
53. X. Zhu, X. Wu, Scalable representative instance selection and ranking, in: IEEE Proceedings of the International Conference on Pattern Recognition, 2006, pp. 352-355.