Prototype classifier design with pruning

International Journal on Artificial Intelligence Tools

Volumn 14, Issue 1-2, 2005, Pages 261-280

  Li, Jiang ^a   Manry, Michael T ^a   Yu, Changhua ^a   Wilson, D Randall ^b  

^a The University of Texas at Arlington   (United States)

^b 3361 TMCB   (United States)

Author keywords

Condensing; instancebased learning; Editing; Nearest neighbor classifier; Prototype selection; Pruning technology

Indexed keywords

EID: 33746242351     PISSN: 02182130     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0218213005002090     Document Type: Conference Paper

References (40)

1. T. M. Cover and P. E. Hart, "Nearest neighbor pattern classification," IEEE Trans. Info. Theory, vol. 13, no. 1, pp. 21-27, 1967.
2. Sproull and F. Robert, "Refinements to nearest neighbor searching in k-dimen. trees," Algorithmica, vol. 6, pp. 579-589, 1991.
3. Papadimitriou, H. Christos, and J. L. Bentley, "A worst-case analysis of nearest neighbor searching by projection," Lecture Notes in Computer Science, vol. 85, pp. 470-482, 1980, Automata Languages and Programming.
4. D. W. Aha, K. Dennis, and K. A. Marc, "Instance-based learning algorithms," Machine Learning, vol. 6, pp. 37-66, 1991.
5. D. W. Aha, "Tolerating noisy, irrelevant and novel attributes in instance-based learning algorithms.," International Journal of Man-Machine Studies, vol. 36, pp. 267-287, 1992.
6. G. W. Gates, "The reduced nearest neighbor rule," IEEE Transactions on Information Theory, vol. IT-18, no. 3, pp. 431-433, 1972.
7. C. Penrod and T. Wagner, "Another look at the edited nearest nearest neighbor rule," IEEE Trans. Syst., Man, Cyber., vol. 7, pp. 92-94, 1977.
8. I. Tomek, "Two modifications of cnn," IEEE Trans. on Syst., Man., and Cybern., no. SMC-6:, pp. 769-772, 1976.
9. D. R. Wilson and T. T. Martinez, "Instance pruning techniques," Proceeding of the Fourteenth International Conference on Machine Learning, pp. 404-411, 1997.
10. D. R. Wilson and T. R. Martinez, "Reduction techniques for instance-based learning algorithms," Machine Learning, vol. 38, no. 3, pp. 257-286, 2000.
11. D. L. Wilson, "Asymptotic properties of nearest neighbor rules using edited data," IEEE Transactions on Systems, Man, and Cybernetics, vol. 2, no. 3, pp. 408- 421, 1972.
12. S. Geva and J. Sitte, "Adaptive nearest neighbor pattern class.," IEEE Trans. Neur. Net., vol. 2, no. 2, pp. 318-322, 1992.
13. I. Tomek, "An experiment with the edited nearest-neighbor rule," IEEE Trans, on Syst., Man., and Cybern., vol. 6, no. 6, pp. 448-452, 1976.
14. Cin-Liang Chang, "Finding prototypes for nearest neighbor classifiers," IEEE Transactions on Computers, vol. 23, no. 11, pp. 1179-1184, Nov. 1974.
15. T. Kohonen, Self-Organizing Maps, Springer-verlag, Mass., 1995.
16. R. Nock and M. Sebban, "Advances in adaptive prototype weighting and selection," International Journal on Artificial Intelligence Tools, vol. 10, no. 1-2, pp. 137-156, 2001.
17. M. Sebban, R. Nock, and S. Lallich, "Stopping criterion for boosting-based data reduction techniques: from binary to multiclass problems," Journal of Machine Learning Research, vol. 3, pp. 863-885, Nov. 2002.
18. M. Kubat and M. Cooperson, "Voting nearest-neighbor subclassifiers," Proceedings of the Seventeenth International Conference on Machine Learning, pp. 503-510, Jun. 2000.
19. M. SEbban, R. Nock, and S. Lallich, "Boosting neighborhood-based classifiers," in Proceedings of the Eighteenth International Conference on Machine Learning. 2001, pp. 505-512, Morgan Kaufmann.
20. A. Rozsypal and M. Kubat, "Using the genetic algorithm to reduce the size of a nearest-neighbor classifier and to select relevant attributes," in Proceedings of the 18th International Conference on Machine Learning, Williamstown, MA, June 28-July 1 2001. pp. 449-457.
21. V. B. Zubek and T. G. Dietterich, "Pruning improves heuristic search for cost-sensitive learning," in Proceedings of the International Conference on Machine Learning, San Francisco, 2002, pp. 27-34.
22. Q. Yang and J. Zhu, "A case-addition policy for case-base maintenance," Computationa Intelligence, vol. 17, no. 2, pp. 250-262, 2001.
23. L. Portinale and P. Torasso, "Case-base maintenance in a multimodal reasoning system," Computationa Intelligence, vol. 17, no. 2, pp. 263-279, 2001.
24. T. Kohonen, "Improved versions of learning vector quantization," IJCNN International Joint Conference on Neural Networks, pp. 545-550, 1990.
25. R. M. Cameron-Jones, "Instance selection by encoding length heuristic with random mutation hill climbing," Proceedings of the Eighth Australian Joint Conference on Artificial Intelligence, pp. 99-106, 1995.
26. B. G. Batchelor, Pattern Recognition: Ideas in Practice, Plenum Press, New York, 1978.
27. Y. Biberman, "A context similarity measure," Proceedings of the European Conference on Machine Learning, pp. 49-63, 1994.
28. R. D. Short and K. Fukunaga, "The optimal distance measure for nearest neighbor classification," IEEE Trans. on Information Theory, vol. IT-27, no. 5, pp. 622-627, Sep. 1981.
29. C. Stanfill and D. Waltz, "Toward memory-based reasoning," Communications of the ACM, vol. 29, pp. 1213-1228, 1986.
30. R. Yager and S. P. Filev, "Approximate clustering via the mountain method," IEEE Transactions on Systems, Man and Cybernetics, vol. 24, no. 8, pp. 1279- 1284, 1994.
31. L. C. Stephen, "Fuzzy model identification based on cluster estimation," Journal of Intelligent and Fuzzy Systems, vol. 2, pp. 267-278, 1994.
32. G. F. Hughes, "On the mean accuracy of statistical pattern recognizers," IEEE Transactions on Information Theory, vol. 14, pp. 55-63, 1968.
33. V. N. Vapnik, The Nature of Statistical Learning Theory, Springer-Verlag, New York, 1995.
34. Jiang Li, Michael T. Manry, and Changhua Yu, "Prototype based classifier design with pruning," Proceedings of the Seventeenth International Conference of the Florida AI Research Society, pp. 706-711, May 2004.
35. A.Gersho, "On the structure of vector quantizers," IEEE Trans. Inform. Theory, vol. IT-28, pp. 157-166, Mar. 1982.
36. E. A. Wan, "Neural network classification: A bayesian interpretation," IEEE trans. on Neural Network, vol. 1, no. 4, pp. 303-305, 1990.
37. D. E. Rumelhart, G. E. Hinton, and R. J. Williams, Parallel Distributed Processing, vol. 1, chapter Learning internal representations by error propagation, MIT Press, Cambridge, MA, 1986.
38. M. H. Hassoun, Fundamentals of Artificial Neural Networks, Cambridge, MA: MIT Press, 1995.
39. W. Gong, H. C. Yau, and M. T. Manry, "Non-gaussian feature analyses using a neural network," Progress in Neural Networks, vol. 2, pp. 253-269, 1994.
40. C. J. Merz and P. M. Murphy, UCI Repository of Machine Learning Databases, Irvine, CA: University of California Irvine, Department of Information and Computer Science. Internet: http://www.ics.uci.edu/~mlearn/ MLRepository.html, 1996.