Fuzzy ARTMAP with input relevances

IEEE Transactions on Neural Networks

Volumn 17, Issue 4, 2006, Pages 929-941

  Andonie, Rǎzvan ^a   Sasu, Lucian ^b  

^a CENTRAL WASHINGTON UNIVERSITY   (United States)

^b TRANSILVANIA UNIVERSITY OF BRASOV   (Romania)

Author keywords

Fuzzy ARTMAP (FAM); Incremental learning; Noisy function mapping; Probability estimation; Relevance factor

Indexed keywords

APPROXIMATION THEORY; ESTIMATION; FUZZY SETS; LEARNING SYSTEMS; PROBABILITY;

INCREMENTAL LEARNING; NOISY FUNCTION MAPPING; PROBABILITY ESTIMATION; RELEVANCE FACTOR;

NEURAL NETWORKS;

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; FUZZY LOGIC; LEARNING;

ALGORITHMS; FUZZY LOGIC; LEARNING; NEURAL NETWORKS (COMPUTER);

EID: 33746896164     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2006.875988     Document Type: Article

References (51)

1. L. Bottou and Y. L. Cun,, S. Thrun, L. Saul, and B. Schölkopf, Eds., "Large scale online learning," in Advances in Neural Information Processing Systems 16. Cambridge, MA: MIT Press, 2004.
2. G. Carpenter, S. Grossberg, N. Markuzon, J. Reynolds, and D. Rosen, "Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimensional maps," IEEE Trans. Neural Netw., vol. 3, no. 5, pp. 698-713, Sep. 1992.
3. C. Diehl and G. Cauwenberghs, "SVM incremental learning, adaptation and optimization," in Proc. Int. Joint Conf. Neural Networks (IJCNN 2003), Portland, OR, Jul. 20-24, 2003, pp. 2685-2690.
4. G. Cauwenberghs and T. Poggio, T. G. D. Todd, K. Leen, and V. Tresp, Eds., "Incremental and decremental support vector machine learning," in Advances in Neural Information Processing Systems 13(NIPS 2000). Cambridge, MA: MIT Press, 2000, pp. 409-415.
5. A. Shilton and M. Palaniswami, "Incremental training of support vector machines," IEEE Trans. Neural Netw., vol. 16, no. 1, pp. 114-131, Jan. 2005.
6. K. Fukushima, "Neocognitron capable of incremental learning," Neural Netw., vol. 17, no. 1, pp. 37-46, Jan. 2004.
7. R. Polikar, L. Udpa, S. S. Udpa, and V. Honovar, "Learn++: An incremental learning algorithm for supervised neural networks," IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 31, no. 4, pp. 497-508, Nov. 2001.
8. G. Carpenter and S. Grossberg, "The ART of adaptive pattern recognition by a self-organizing neural network," IEEE Computer, vol. 21, no. 3, pp. 77-88, Mar. 1988.
9. O. Parsons and G. A. Carpenter, "ARTMAP neural networks for information fusion and data mining: Map production and target recognition methodologies," Neural Netw., vol. 16, no. 7, pp. 1075-1089, Sep. 2003.
10. G. Carpenter and W. Ross, "ART-EMAP: A neural network architecture for learning and prediction by evidence accumulation," IEEE Trans. Neural Netw., vol. 6, no. 4, pp. 805-818, Sep. 1995.
11. G. Carpenter, B. Milenova, and B. Noeske, "Distributed ARTMAP: A neural network for fast distributed supervised learning," Neural Netw., vol. 11, no. 4, pp. 793-813, 1998.
12. S. Verzi, G. Heileman, M. Georgiopoulos, and M. Healy, "Boosted ARTMAP," in Proc. IEEE World Congr. Computational Intelligence WCCI''98, Anchorage, AK, 1998, pp. 396-400.
13. I. Dagher, M. Georgiopoulos, G. Heileman, and G. Bebis, "Fuzzy ARTVar: an improved fuzzy ARTMAP algorithm," in Proc. IEEE World Congress Computational Intelligence WCCI''98, Anchorage, AK, 1998, pp. 1688-1693.
14. J. Williamson, "Gaussian ARTMAP: A neural network for fast incremental learning of noisy multidimensional maps," Neural Netw., vol. 9, no. 5, pp. 881-897, 1996.
15. S. Marriott and R. F. Harrison, "A modified fuzzy ARTMAP architecture for the approximation of noisy mappings," Neural Netw., vol. 8, no. 4, pp. 619-641, 1995.
16. C. P. Lim and R. F. Harrison, "An incremental adaptive network for on-line supervized learning and probability estimation," Neural Netw., vol. 10, no. 5, pp. 925-939, 1997.
17. E. Gomez-Sanchez, Y. Dimitriadis, J. Cano-Izquierdo, and J. Lopez-Coronado, " μARTMAP: Use of mutual information for category reduction in fuzzy ARTMAP," IEEE Trans. Neural Netw., vol. 13, no. 1, pp. 58-69, Jan. 2002.
18. V. Vapnik, "An overview of statistical learning theor," IEEE Trans. Neural Netw., vol. 10, no. 5, pp. 988-999, Sep. 1999.
19. J. Arribas and J. Cid-Sueiro, "A model selection algorithm for a posteriori probability estimation with neural networks," IEEE Trans. Neural Netw., vol. 16, no. 4, pp. 799-809, Jul. 2005.
20. G. A. Carpenter, S. Grossberg, and J. Reynolds, "A fuzzy ARTMAP nonparametric probability estimator for nonstationary pattern recognition problems," IEEE Trans. Neural Netw., vol. 6, no. 6, pp. 1330-1336, Nov. 1995.
21. C. P. Lim and R. F. Harrison, L. C. Jain, B. Lazzerini, and U. Halici, Eds., "ART-based autonomous learning systems: Part I - Architectures and algorithms," in Innovations in ART Neural Networks. New York: Springer-Verlag, 2000.
22. S. Verzi, G. Heileman, M. Georgiopoulos, and G. Anagnostopoulos, "Universal approximation with fuzzy art and fuzzy artmap," in Proc. IEEE Int. Joint Conf. Neural Networks (IJCNN'03), Portland, OR, Jul. 20-24, 2003, vol. 3, pp. 1987-1992.
23. R. Jones, R. Ghani, T. Mitchell, and E. Riloff, "Active learning for information extraction with multiple view feature sets," in Proc. ECML-03 Workshop Adaptive Text Extraction and Mining, Cavtat-Dubrobnik, Croatia, 2003, pp. 26-33.
24. M. Kukar and I. Kononenko, H. Prade, Ed., "Cost-sensitive learning with neural networks," in Proc. 13th Eur. Conf. Artificial Intelligence (ECAI 98), 1998, pp. 445-449.
25. X. Yang, Q. Song, and A. Cao, "Weighted support vector machine for data classification," in Proc. Int. Joint Conf. Neural Networks (IJCNN 2005), Montreal, QC, Canada, Jul. 31-Aug. 4 2005, pp. 859-864.
26. Q. Tao, G. Wu, F. Wang, and W. J. "Posterior probability support vector machines for unbalanced data," IEEE Trans. Neural Netw., vol. 16, no. 6, pp. 1561-1573, Nov. 2005.
27. V. Cho, "Knowledge discovery from distributed and textual data," Ph.D. dissertation, Dept. Comp. Sci., Hong Kong Univ. Sci. Tech., Hong Kong, 1999.
28. B. Wuthrich, V. Cho, J. Pun, and J. Zhang, "Data quality in distributed environments," in Advances in Distributed and Parallel Knowledge Discovery, H. Kargupta and P. Chan, Eds. Cambridge, MA: AAAI Press/MIT Press, 2000, pp. 295-316.
29. M. Taghi, V. Baghmisheh, and P. Nikola, "A fast simplified fuzzy ARTMAP network," Neural Process. Lett., vol. 17, no. 3, pp. 273-316, 2003.
30. V. Kaburlasos and V. Petridis, "Fuzzy lattice neurocomputing (FNL) models," Neural Netw., vol. 13, no. 10, pp. 1145-1169, Dec. 2000.
31. B. Moore, "ART1 and pattern clustering," in Proc. 1988 Connectionist Model Summer School, San Mateo, CA, 1988, Morgan Kaufmann, pp. 174-185.
32. G. Carpenter, S. Grossberg, and J. Reynolds, "Fuzzy ART: Fast stable learning and categorization of analog patterns by an adaptive resonance system," Neural Netw., vol. 4, no. 6, pp. 759-771, 1991.
33. D. Specht, "Probabilistic neural networks," Neural Netw., vol. 3, no. 1, pp. 109-118, 1990.
34. R. Andonie, "A converse H-theorem for inductive processes," Comp. Artif. Intell., vol. 9, no. 2, pp. 159-167, 1990.
35. M. Wasan, Stochastic Approximation. Cambridge, U.K.: Cambridge Univ. Press, 1969.
36. R.M. Golden, Mathematical Methods for Neural Network Analysis and Design. Cambridge, MA: MIT Press, 1996.
37. W. Feller, An Introduction to Probability Theory and Its Applications. New York: Wiley, 1970, vol. 1.
38. P. Hall and C. C. Heyde, Martingale Limit Theory and Its Applications. New York: Academic Press, 1980.
39. M. Nicolescu, N. Dinculeanu, and S. Marcus, Mathematical Analysis (in Romanian). Bucharest, Romania: Editura Didacticǎ şsi Pedagogicǎ, 1966, vol. 1.
40. G. Anagnostopoulos and M. Georgiopoulos, "Putting the utility of match tracking in fuzzy ARTMAP training to the test," in Proc. 7th Int. Conf. Knowledge-Based Intelligent Information and Engineering Systems (KES '03), U.K., 2003, vol. II, pp. 1-6.
41. T. Poggio and F. Girosi, "Networks for approximation and learning," Proc. IEEE, vol. 78, no. 9, pp. 1481-1497, Sep. 1990.
42. T. Chen and H. Chen, "Universal approximation to nonlinear operators by neural networks with arbitrary activation functions and its application to dynamic systems," IEEE Trans. Neural Netw., vol. 6, no. 4, pp. 911-917, Jul. 1995.
43. F. Girosi and T. Poggio, "Networks and the best approximation property," Biol. Cybern., vol. 63, no. 9, pp. 169-176, Sep. 1990.
44. R. Andonie, "The psychological limits of neural computation," in Dealing With Complexity: A Neural Network Approach, M. Karny, K. Warwick, and V. Kurkova, Eds. London, U.K.: Springer-Verlag, 1997, pp. 252-263.
45. R. Andonie, L. Sasu, and V. Beiu, O. Castillo, Ed., "A modified fuzzy ARTMAP architecture for incremental learning function approximation," in Proc. IASTED Int. Conf. Neural Networks and Computational Intelligence (NCI 2003), Cancun, Mexico, May 19-21, 2003, pp. 124-129.
46. J. Franke and E. Mandler, "A comparison of two approaches for combining the votes of cooperating classifiers," in Proc. 11th Int. Conf. Pattern Recognition, 1992, vol. 2, pp. 611-614.
47. Y. S. Huang and C. Y. Suen, "A method of combining multiple experts for the recognition of unconstrained handwritten numerals," IEEE Trans. Pattern Anal. Mach. Intell., vol. 17, no. 1, pp. 90-94, Jan. 1995.
48. G. Wilensky, "Analysis of neural network issues: Scaling, enhanced nodal processing, comparison with standard classification," DARPA Neural Netw. Program Rev., pp. 1-9, Oct. 29-30, 1991.
49. V. Ciesielski, "Boundary points do not improve the accuracy of neural net classifiers," in Proc. 8th Australian Joint Conf. Artificial Intelligence, Canberra, Australia, 1995, pp. 163-170.
50. E. Lander and R. Lesser, "Sharing meta-information to guide cooperative search among heterogeneous reusable agents," IEEE Trans. Knowl. Data Eng., vol. 9, no. 2, pp. 193-208, Mar.-Apr. 1997.
51. Y. Freund and R. Schapire, "A decision-theoretic generalization of on-line learning and an application to boosting," J. Comput. Syst. Sci., vol. 55, no. 1, pp. 119-139, 1997.