ANCFIS: A neurofuzzy architecture employing complex fuzzy sets

IEEE Transactions on Fuzzy Systems

Volumn 19, Issue 2, 2011, Pages 305-322

  Chen, Zhifei ^a   Aghakhani, Sara ^b   Man, James ^c   Dick, Scott ^d  

^a TTS Sense   (Canada)

^b UNIVERSITY OF CALGARY   (Canada)

^c HEC PARIS   (France)

^d UNIVERSITY OF ALBERTA   (Canada)

Author keywords

complex fuzzy logic; Complex fuzzy sets (CFSs); machine learning; neurofuzzy systems; time series forecasting

Indexed keywords

COMPLEX FUZZY LOGIC; COMPLEX FUZZY SETS; MACHINE-LEARNING; NEUROFUZZY SYSTEMS; TIME-SERIES FORECASTING;

FORECASTING; FUZZY SETS; LEARNING SYSTEMS;

FUZZY LOGIC;

EID: 79953666016     PISSN: 10636706     EISSN: None     Source Type: Journal    
DOI: 10.1109/TFUZZ.2010.2096469     Document Type: Article

References (83)

1. S. Aghakhani and S. Dick, "An on-line learning algorithm for complex fuzzy logic," presented at the WCCI, Barcelona, Spain, 2010.
2. R. Bakker, J. C. Schouten, C. L. Giles, F. Takens, and C. M. Van Den Bleek, "Learning chaotic attractors by neural networks," Neural Comput., vol. 12, pp. 2355-2383, 2000.
3. G. Bontempi, M. Birattari, and H. Bersini, "Local learning for iterated time-series prediction," in Proc. ICML, Bled, Slovenia, 1999, pp. 32-38.
4. J. J. Buckley, "Fuzzy complex numbers," Fuzzy Sets Syst., vol. 33, pp. 333-345, 1989. (Pubitemid 20660145)
5. J. J. Buckley, "Fuzzy complex analysis II: Integration," Fuzzy Sets Syst., vol. 49, pp. 171-179, 1992.
6. J. J. Buckley and Y. Qu, "Solving linear and quadratic fuzzy equations," Fuzzy Sets Syst., vol. 38, pp. 43-59, 1990.
7. J. J. Buckley and Y. Qu, "Fuzzy complex analysis I: Differentiation," Fuzzy Sets Syst., vol. 41, pp. 269-284, 1991.
8. J. J. Buckley and Y. Qu, "Solving fuzzy equations: A new solution concept," Fuzzy Sets Syst., vol. 39, pp. 291-301, 1991.
9. L. J. Cao, "Support vector machines experts for time series forecasting," Neurocomputing, vol. 51, pp. 321-339, 2003.
10. L. Chen and K. Aihara, "Chaotic simulated annealing by a neural network model with transient chaos," Neural Netw., vol. 8, pp. 915-930, 1995.
11. Z. Chen, H. Shi, Y. An, and C. Sun, "Globally convergent approach based on chaotic theory for underwater robot motor optimization," in Proc. IEEE Int. Conf. Rob, Int. Syst. Sig., Changsha, China, 2003, pp. 996-1001.
12. T. J. Cholewo and J. M. Zurada, "Sequential network construction for time series prediction," in Proc. IEEE ICNN, Houston, TX, 1997, pp. 2034-2038.
13. R. S. Crowder, "Predicting the Mackey-Glass time series with cascadecorrelation learning," in Proc. 1990 Summer School Connectionist Models, D. S. Touretzky, J. L. Elman, T. J. Sejnowski, and G. E. Hinton, Eds. San Francisco, CA: Morgan Kaufmann, 1991, pp. 117-123.
14. G. Dangelmayr, S. Gadaleta, D. Hundley, and M. Kirby, "Time series prediction by estimating Markov probabilities through topology preserving maps," Proc. SPIE, vol. 3812, pp. 86-93, 1999. (Pubitemid 30554101)
15. Y.-F. Deng, X. Jin, and Y.-X. Zhong, "Ensemble SVR for prediction of time series," in Proc. Int. Conf. Mach. Learning Cybern., Guangzhou, China, 2005, pp. 3528-3534. (Pubitemid 41734529)
16. A. Y. Deshmukh, A. B. Bavaskar, P. R. Bajaj, and A. G. Keskar, "Implementation of complex fuzzy logic modules with VLSI approach," Int. J. Comput. Sci. Netw. Security, vol. 8, pp. 172-178, 2008.
17. S. Dick, "Towards complex fuzzy logic," IEEE Trans. Fuzzy Syst., vol. 13, no. 3, pp. 405-414, Jun. 2005.
18. M. Dorigo and L. M. Gambardella, "Ant colony system: A cooperative learning approach to the travelling salesman problem," IEEE Trans. Evol. Comp., vol. 1, no. 1, pp. 53-66, Apr. 1997. (Pubitemid 127771018)
19. M. Dorigo, V. Maniezzo, and A. Colorni, "Ant system: Optimization by a colony of cooperating agents," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 26, no. 1, pp. 29-41, Feb. 1996. (Pubitemid 126780573)
20. C. H. Edwards and D. E. Penney, Calculus and Analytic Geometry, 3rd ed. Englewood Cliffs, NJ: Prentice-Hall, 1990.
21. G. M. Georgiou andC.Kutsougeras, "Complex domain backpropagation," IEEE Trans. Circuits Syst. II, Exp. Briefs, vol. 39, no. 5, pp. 330-334, May 1992.
22. F. A. Gers, D. Eck, and J. Schmidhuber, "Applying LSTM to time series predictable through time-window approaches," in Proc. Int. Conf. Artif. Neural Netw., Vienna, Austria, 2001, pp. 669-676. (Pubitemid 33317026)
23. D. Graves andW. Pedrycz, "Fuzzy prediction architecture using recurrent neural networks," Neurocomput., vol. 72, pp. 1668-1678, 2009.
24. M. Gruber, Regression Estimators a Comparative Study. Burlington, MA: Academic Press, 1990.
25. S. Haykin, Neural Networks: A Comprehensive Foundation. Upper Saddle River, NJ: Prentice-Hall, 1999.
26. D. Himmelblau, Applied Nonlinear Programming. New York: McGraw-Hill, 1992.
27. A. Hirose, Complex-Valued Neural Networks. Berlin, Germany: Spinger-Verlag, 2006.
28. A. Hirose, Y. Asano, and T. Hamano, "Developmental learning based on coherent neural networks with behavioral mode tuning by carrierfrequency modulation," in Proc. IJCNN, Vancouver, BC, Canada, 2006, pp. 8874-8881.
29. A. Hirose, T. Higo, and K. Tanizawa, "Holographic three-dimensional movie generation with frame interpolation using coherent neural networks," presented at IJCNN, Vancouver, BC, Canada, 2006.
30. X. Hong and C. J. Harris, "Experimental design and model construction algorithms for radial basis function networks," Int. J. Syst. Sci., vol. 34, pp. 733-745, 2003.
31. T. C. Hsia, System Identification: Least-Squares Methods. Lexington, MA: D. C. Heath, 1977.
32. U. Huebner, N. B. Abraham, and C. O.Weiss, "Dimensions and entropies of chaotic intensity pulsations in a single-mode far-infrared NH3 laser," Phys. Rev. A, vol. 40, pp. 6354-65, 1989.
33. U. Huebner, W. Klische, N. B. Abraham, and C. O. Weiss, "Comparison of Lorenz-like laser behavior with the Lorenz model," Coherence and Quantum Optics VI, J. Eberly, Ed., New York: Plenum, 1989, p. 517.
34. U. Huebner,W. Klische, N. B. Abraham, and C. O.Weiss, "On problems encountered with dimension calculations," in Measures of Complexity and Chaos, N. B. Abraham, A. M. Albano, A. Passamante, and P. E. Rapp, Eds. New York: Plenum, 1989, pp. 133-136.
35. R. J. Hyndman. (2008). Time Series Data Library. Department of Econometrics and Business Statistics, Monash Univ. [Online]. Available: http://www-personal.buseco.monash.edu.au/hyndman/TSDL/
36. R. J. Hyndman and A. B. Koehler, "Another look at measures of forecast accuracy," Int. J. Forecasting, vol. 22, pp. 679-688, 2006. (Pubitemid 44524717)
37. J.-S. R. Jang, "ANFIS: Adaptive-network-based fuzzy inference system," IEEE Trans. Syst., Man, Cybern., vol. 23, no. 3, pp. 665-685, May/Jun. 1993.
38. J.-S. R. Jang and C.-T. Sun, "Neuro-fuzzy modeling and control," Proc. IEEE, vol. 83, pp. 378-406, 1995.
39. H. Kantz and T. Schreiber, Nonlinear Time Series Analysis. NewYork: Cambridge Univ. Press, 1997.
40. A. Kaufman and M. M. Gupta, Introduction to Fuzzy Arithmetic. New York: Van Nostrand Reinhold, 1985.
41. M. S. Kim and C. C. Guest, "Modification of backpropagation for complex-valued signal processing in frequency domain," in Proc. Int. J. C. Neural Net., vol. 3, San Diego, CA, 1990, pp. 27-31.
42. G. J. Klir and B. Yuan, Fuzzy Sets and Fuzzy Logic: Theory and Applications. Upper Saddle River, NJ: Prentice-Hall, 1995.
43. R. Konnur, "Additive chaotic forcing scheme for determination of the global minimum of functions," Commun. Nonlinear Sci. Numer. Simul., vol. 9, pp. 499-513, 2004. (Pubitemid 38653488)
44. T. Koskela, M. Varsta, J. Heikkonen, and K. Kaski, "Recurrent SOM with local linear models in time series prediction," in Proc. Eur. Symp. ANN, Bruges, Belgium, 1998, pp. 167-172.
45. Y. Kuroe and Y. Taniguchi, "Models of self-correlation type complexvalued associative memories and their performance comparison," in Proc. Int. Joint Conf. Neural Netw., Vancouver, BC, Canada, 2006, pp. 605-609.
46. A. Lendasse, F. Corona, J. Hao, N. Reyhani, and M. Verleysen, "Determination of the Mahalanobis matrix using nonparametric noise estimation," in Proc. Eur. Symp. ANN, Bruges, Belgium, 2006, pp. 227-232.
47. F. H. F. Leung, H. K. Lam, S. H. Ling, and P. K. S. Tam, "Tuning of the structure and parameters of a neural network using an improved genetic algorithm," IEEE Trans. Neural Netw., vol. 14, no. 1, pp. 79-88, Jan. 2003.
48. H. Leung and S. Haykin, "The complex back propagation algorithm," IEEE Trans. Signal Process, vol. 39, no. 9, pp. 2101-2104, Sep. 1991.
49. M. Li, K. Mehrotra, C. Mohan, and S. Ranka, "Sunspot numbers forecasting using neural networks," in Proc. 5th IEEE Int. Symp. Int. Control, Philadelphia, PA, 1990, pp. 524-529.
50. Y. Li and Y. T. Jang, "Complex adaptive fuzzy inference systems," in Proc. Asian Fuzzy Syst. Symp., Kenting, Taiwan, 1996, pp. 551-556.
51. S. Q. Ma, D. J. Peng, and D. Y. Li, "Fuzzy complex value measure and fuzzy complex value measurable function," in Fuzzy Information and Engineering,B.-Y. Cao, C.Y. Zhang, and T. F. Li, Eds. Berlin,Germany: Springer, 2008, pp. 187-192.
52. A. Malekzadeh-A. and M.-R. Akbarzadeh-T., "Complex-valued adaptive neuro fuzzy inference system-CANFIS," in Proc. World Aut. Congr., Seville, Spain, 2004, pp. 477-482. (Pubitemid 43252329)
53. J. Man, Z. Chen, and S. Dick, "Towards inductive learning of complex fuzzy inference systems," in Proc. NAFIPS, San Diego, CA, 2007, pp. 415-420. (Pubitemid 47533998)
54. Z. Michalewicz, "Genetic algorithms, numerical optimization and constraints," in Proc. Int. Conf. Gen. Algo., Pittsburgh, PA, 1995, pp. 151-158.
55. H. E. Michel, A. A. S. Awwal, and D. Rancour, "Artificial neural networks using complex numbers and phase encoded weights-electronic and optical implementations," in Proc. IJCNN, Vancouver, BC, Canada, 2006, pp. 1213-1218.
56. J. Mingjun and T. Huanwen, "Application of chaos in simulated annealing," Chaos, Solitons Fractals, vol. 21, pp. 933-941, 2004.
57. D. Moses, O. Degani, H.-N. Teodorescu, M. Friedman, and A. Kandel, "Linguistic coordinate transformations for complex fuzzy sets," in Proc. IEEE Int. Conf. Fuzzy Syst., Seoul, Korea, 1999, pp. 1340-1345.
58. H.T. Nguyen, A. Kandel, andV.Kreinovich, "Complex fuzzy sets: towards new foundations," in Proc. IEEE Int. Conf. Fuzzy Systems,, San Antonio, TX, 2000, pp. 1045-1048.
59. T. T. Nguyen, C. P. Willis, D. J. Paddon, and H. S. Nguyen, "A hybrid system for learning sunspot recognition and classification," in Proc. Int. Conf. Hybrid IT, Bath, U.K., 2006, pp. 257-264. (Pubitemid 46604199)
60. I. Nishikawa, T. Iritani, and K. Sakakibara, "Improvements of the traffic signal control by complex-valued Hopfield networks," in Proc. IJCNN, Vancouver, BC, Canada, 2006, pp. 1186-1191.
61. T. Nitta, "An extension of the back-propagation algorithm to quaternions," in Proc. ICONIP, Hong Kong, 1996, pp. 247-250.
62. T. Nobuhiko and H. van Dijk, "Combined forecasts from linear and nonlinear time series models," Int. J. Forecasting, vol. 18, pp. 421-438, 2002.
63. A. J. Noest, "Discrete-state phasor neural nets," Phys. Rev. A, vol. 38, pp. 2196-2199, 1988.
64. R. Rajamani, D. Levinson, P. Michalopoulos, J. Wang, K. Santhanakrishnan, and X. Zou, "Adaptive cruise control system design and its impact on traffic flow," Tech. Rep. CTS 05-01, Intell. Transp. Syst. Inst., Univ. Minnesota, Minneapolis, MN, 2005.
65. D. Ramot, M. Friedman, G. Langholz, and A. Kandel, "Complex fuzzy logic," IEEE Trans. Fuzzy Syst., vol. 11, no. 4, pp. 450-461, Aug. 2003.
66. D. Ramot, R. Milo, M. Friedman, and A. Kandel, "Complex fuzzy sets," IEEE Trans. Fuzzy Syst., vol. 10, no. 2, pp. 171-186, Apr. 2002. (Pubitemid 34554862)
67. G. Rigatos, "Energy spectrum of quantum associative memories," in Proc. IJCNN, Vancouver, BC, Canada, 2006, pp. 599-604.
68. H. H. Sargent, "A prediction for the next sunspot cycle," in Proc. 28th IEEE Vehic. Technol. Conf., Boulder, CO, 1978, pp. 490-496.
69. T. Sauer, "Time series prediction using delay coordinate embedding," in Time Series Prediction: Forecasting the Future and Understanding the Past, A. Weigend and N. Gershenfeld, Eds. Reading, MA: Addison Wesley, 1994, pp. 175-193.
70. H. Shi, Z. Chen, and C. Sun, "Application of improved chaotic optimization algorithms to problems with motion planning for mobile robots," in Proc. IEEE Int. Conf. Rob., Int. Syst. Signal Process, Changsha, China, 2003, pp. 611-615.
71. J. Tome and J. Carvalho, "One step ahead prediction using Fuzzy Boolean Neural Networks," in Proc. EUSFLAT-LFA, Barcelona, Spain, 2005, pp. 500-505.
72. H. Tong and K. S. Lim, "Threshold autoregression, limit cycles and cyclical data," J. R. Stat. Soc. B, vol. 42, pp. 245-292, 1980.
73. J.-T. Tsai, J.-H. Chou, and T.-K. Liu, "Tuning the structure and parameters of a neural network by using hybrid Taguchi-genetic algorithm," IEEE Trans. Neural Netw., vol. 17, no. 1, pp. 69-80, Jan. 2006. (Pubitemid 43263941)
74. E. A. Wan, "Time series prediction by using a connectionist network with internal time delays," in Time Series Prediction: Forecasting the Future and Understanding the Past, A.Weigend and N. Gershenfeld, Eds. Reading, MA: Addison Wesley, 1994, pp. 195-217.
75. A. Weigend. (2008). The Santa Fe time series competition data. [Online]. Available at: http://www-psych.stanford.edu/~andreas/Time-Series/SantaFe.html
76. A. S. Weigend and N. A. Gershenfeld, "Results for time series prediction competition at the Santa Fe Institute," in Proc. IEEE Int. Conf. Neural Netw., San Francisco, CA, 1993, pp. 1786-1793.
77. A. S. Weigend, B. A. Huberman, and D. E. Rumelhart, "Predicting the future:Aconnectionist approach," Int. J. Neural Syst., vol. 1, pp. 193-209, 1990.
78. A. S.Weigend and D. A. Nix, "Predictions with confidence intervals (local error bars)," Univ. Berlin, Berlin, Humboldt, Germany, 1994.
79. H. White, "Economic prediction using neural networks: The case of IBM daily stock returns," in Proc. IEEE ICNN, San Diego, CA, 1988, pp. 451-458.
80. C. Wu and J. Qiu, "Some remarks for fuzzy complex analysis," Fuzzy Sets Syst., vol. 106, pp. 231-238, 1999. (Pubitemid 129524620)
81. J.Wu andM. Liu, "Improving generalization performance of artificial neural networks with genetic algorithms," in Proc. IEEE Int. Conf. Granular Comput., Guangxi, China, 2005, pp. 288-291.
82. G.-Q. Zhang, "Fuzzy limit theory of fuzzy complex numbers," Fuzzy Sets Syst., vol. 46, pp. 227-235, 1992.
83. G. Zhang, T. S. Dillon, K.-Y. Cai, J. Ma, and J. Lu, "Operation properties and delta-equalities of complex fuzzy sets," Int. J. Approx. Reason., vol. 50, pp. 1227-1249, 2009.