An on-line ICA-mixture-model-based self-constructing fuzzy neural network

IEEE Transactions on Circuits and Systems I: Regular Papers

Volumn 52, Issue 1, 2005, Pages 207-221

  Lin, Chin Teng ^a,b   Cheng, Wen Chang ^a   Liang, Sheng Fu ^a,b  

^a NATIONAL CHIAO TUNG UNIVERSITY   (Taiwan)

^b University System of Taiwan   (Taiwan)

Author keywords

Backpropagation rule; Gaussian mixture model; Non Gaussian mixture model; Principal component analysis; Takagi Sugeno Kang (TSK) fuzzy rules

Indexed keywords

BACKPROPAGATION; FUZZY SETS; IDENTIFICATION (CONTROL SYSTEMS); INDEPENDENT COMPONENT ANALYSIS; KNOWLEDGE BASED SYSTEMS; LEARNING SYSTEMS; MATHEMATICAL MODELS; PRINCIPAL COMPONENT ANALYSIS;

GAUSSIAN MIXTURE MODEL; NON-GAUSSIAN MIXTURE MODEL; TAKAGI-SUGENO-KANG FUZZY RULES;

NEURAL NETWORKS;

EID: 12944295084     PISSN: 10577122     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSI.2004.840110     Document Type: Article

References (42)

1. B. Kosko, Neural Networks and Fuzzy Systems. Englewood Cliffs, NJ: Prentice-Hall, 1992.
2. C. T. Lin, Neural Fuzzy Control Systems with Structure and Parameter Learning. New York: World Scientific, 1994.
3. C. T. Lin and C. S. G. Lee, Neural Fuzzy Systems: A Neural-Fuzzy Synergism to Intelligent Systems. Englewood Cliffs, NJ: Prentice-Hell, 1996.
4. R. Jang, C. T. Sun, and E. Mizutani, Neuro-Fuzzy and Soft Computing: A Computational Approach to Learning and Machine Intelligence. Englewood Cliffs, NJ: Prentice-Hall, 1997.
5. D. Nauck, F. Klawonn, and R. Kruse, Foundations of Neuro-Fuzzy Systems. New York: Wiley, 1997.
6. S. Horikawa, T. Furuhashi, and Y. Uchikawa, "On fuzzy modeling using fuzzy neural networks with the backpropagation algorithm," IEEE Trans. Neural Netw., vol. 3, pp. 801-806, Sep. 1992.
7. K. Tanaka, M. Sano, and H. Watanabe, "Modeling and control of carbon monoxide concentration using a neuro-fuzzy technique," IEEE Trans. Fuzzy Syst., vol. 3, pp. 271-279, Aug. 1995.
8. Y. Lin and G. A. Cunningham, "A new approach to fuzzy-neural system modeling," IEEE Trans. Fuzzy Syst., vol. 3, pp. 190-197, May 1995.
9. M. Sugeno and T. Yasukawa, "A fuzzy-logic-based approach to qualitative modeling," IEEE Trans. Fuzzy Syst., vol. 1, pp. 7-31, Feb. 1993.
10. L. Wang and R. Langari, "Building sugeno-type models using fuzzy discretization and orthogonal parameter estimation techniques," IEEE Trans. Fuzzy Syst., vol. 3, pp. 454-458, Nov. 1995.
11. E. H. Ruspini, "Recent development in fuzzy clustering," Fuzzy Set and Possibility Theory, pp. 113-147, 1982.
12. T. W. Lee, M. S. Lewicki, and T. J. Sejnowski, "Unsupervised classification with nongaussian mixture models using ICA," Adv. Neural Inf. Process. Syst., vol. 11, pp. 508-514, 1999.
13. C. F. Juang and C. T. Lin, "An on-line self constructing neural fuzzy inference network and its applications," IEEE Trans. Fuzzy Syst., vol. 6, no. 1, pp. 12-32, Feb. 1998.
14. T. W. Lee, M. Girolami, and T. J. Sejnowski, "Independent component analysis using an extended infomax algorithm for mixed sub-gaussian and super-gaussian sources," Neural Comput., vol. 11, no. 2, pp. 417-441, 1999.
15. J. C. Bezdek, J. Keller, R. Krisnapuram, and N. R. Pal, Fuzzy Models and Algorithms for Pattern Recognition and Image Processing. Boston, MA: Kluwer, 1999.
16. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification, 2nd ed. New York: Wiley, 2001.
17. F. Höppner, F. Klawonn, R. Kruse, and T. Runkler, Fuzzy Cluster Analysis. New York: Wiley, 1999.
18. G. J. McLachlan and T. Krishnan, The EM Algorithms and Extensions. New York: Wiley, 1997.
19. T.-W. Lee and M. S. Lewicki, "Image processing methods using ICA mixture models," in Independent Component Analysis: Principles and Practice, S. Roberts and R. Everson, Eds. New York: Cambridge Univ. Press, 2001.
20. R. Duda and P. Hart, Pattern Classification and Scene Analysis. New York: Wiley, 1973.
21. M. E. Tipping and C. M. Bishop, "Mixtures of probabilistic principal component analyzers," Neural Computation, vol. 11, no. 2, pp. 443-482, 1999.
22. M. S. Lewicki and T. J. Sejnowski, "Learning overcomplete representations," Neural Computation, vol. 12, no. 2, pp. 337-365, 2000.
23. D. MacKay, Maximum Likelihood and Covariant Algorithms for Independent Component Analysis, Draft 3.7, 1996.
24. U.-M. Bae and T.-W. Lee, "Blind signal separation in teleconferencing using the ICA mixture model," Electron. Lett., vol. 36, no. 7, pp. 680-382, 2000.
25. J. F. Cardoso, "High-order contrasts for independent component analysis," Neural Comput., vol. 11, pp. 157-192, 1999.
26. R. O. Duda and P. E. Hart, Pattern Classification and Scene Analysis New York: Wiley, 1973.
27. T. W. Lee, M. S. Lewicki, and T. J. Sejnowski, "ICA mixture models for unsupervised classification of non-Gaussian classes and automatic context switching in blind signal separation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 10, Oct. 2000.
28. T. W. Lee, M. S. Lewicki, and T. J. Sejnowski, "ICA mixture models for unsupervised and automatic context switching," in Proc. Int. Workshop ICA, 1999, pp. 209-214.
29. Md. M. Islam, X. Yao, and K. Murase, "A constructive algorithm for training cooperative neural network ensembles," IEEE Trans. Neural Netw., vol. 14, no. 4, Jul. 2003.
30. C. L. Blake and C. J. Merz. (1998) UCI Repository of Machine Learning Databases [Online]. Available: http://www.ics.uci.edu/~mlearn/ ML-Repository.html
31. P. K. Simpson, "Fuzzy min-max neural networks - Part I: Classification," IEEE Trans. Neural Netw., vol. 3, pp. 776-786, Sep. 1992.
32. H. M. Lee, "A neural network classifier with disjunctive fuzzy information," Neural Netw., vol. 11, no. 6, pp. 1113-1125, 1998.
33. H. M. Lee, C. M. Chen, J. M. Chen, and Y. L. Jou, "An efficient fuzzy classifier with feature selection based on fuzzy entropy," IEEE Trans. Syst., Man, Cybern. B, vol. 31, pp. 426-432, Jun. 2001.
34. T. P. Wu and S. M. Chen, "A new method for constructing membership functions and fuzzy roles from training examples," IEEE Trans. on Syst. Man, Cybern. B, Cybern., vol. 29, pp. 25-40, Feb. 1999.
35. J. S. Wang and C. S. George Lee, "Self-adaptive neuro-fuzzy inference systems for classification applications," IEEE Trans. Fuzzy Syst. vol. 10, no. 6, Dec. 2002.
36. B. C. Lovel and A. P. Bradley, "The multiscale classifier," IEEE Trans. Pattern Anal. Mach. Intell., vol. 18, no. 2, pp. 124-137, Feb. 1996.
37. D. Nauck and R. Kruse, "A neuro-fuzzy method to learn fuzzy classification rules from data," Fuzzy Sets Syst., vol. 89, no. 3, pp. 277-288, 1997.
38. R. Setiono and H. Liu, "Neural-network feature selector," IEEE Trans. Neural Netw., vol. 8, no. 3, pp. 654-662, Jun. 1997.
39. M. Setnes and H. Roubos, "GA-fuzzy modeling and classification: Complexity and performance," IEEE Trans. Fuzzy Syst., vol. 8, no. 5, pp. 509-522, Oct. 2000.
40. H. Ishibuchi, T. Nakashima, and T. Murata, "Performance evaluation of fuzzy classifier systems for multidimensional pattern classification problems," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 29, pp. 601-618, Oct. 1999.
41. A. L. Corcoran and S. Sen, "Using real-valued genetic algorithms to evolve role sets for classification," in Proc. 1st IEEE Conf. Evolutionary Computation, Orlando, FL, Jun. 1994, pp. 120-124.
42. P. Brazdil and J. Gama, LIACC, Univ. of Porto Rua Campo Alegre 823 4150 Porto, Portugal.