Generalized type-2 fuzzy weight adjustment for backpropagation neural networks in time series prediction

Information Sciences

Volumn 325, Issue , 2015, Pages 159-174

  Gaxiola, Fernando ^a   Melin, Patricia ^a   Valdez, Fevrier ^a   Castillo, Oscar ^a  

^a TIJUANA INSTITUTE OF TECHNOLOGY   (Mexico)

Author keywords

Backpropagation algorithm; Generalized type 2 fuzzy system; Generalized type 2 fuzzy weight; Neural network

Indexed keywords

BACKPROPAGATION; FUZZY INFERENCE; FUZZY NEURAL NETWORKS; FUZZY SYSTEMS; GAUSSIAN NOISE (ELECTRONIC); GLASS; MEMBERSHIP FUNCTIONS; NEURAL NETWORKS; TIME SERIES;

BACK PROPAGATION NEURAL NETWORKS; FOOTPRINT OF UNCERTAINTIES; INTERVAL TYPE-2 FUZZY; MACKEY-GLASS TIME SERIES; NEURAL NETWORK (NN); TIME SERIES PREDICTION; TYPE-2 FUZZY SYSTEMS; TYPE-2 FUZZY WEIGHTS;

FUZZY LOGIC;

EID: 84941567707     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2015.07.020     Document Type: Article

References (61)

1. Abiyev R. A type-2 fuzzy wavelet neural network for time series prediction Lecture Notes in Computer Science 6098 2010 518 527
2. Aliev R.A., Pedrycz W., Guirimov B., Aliev R.R., Ilhan U., Babagil M., Mammadli S. Type-2 fuzzy neural networks with fuzzy clustering and differential evolution optimization Inf. Sci. 181 9 2011 1591 1608
3. Barbounis T.G., Theocharis J.B. Locally recurrent neural networks for wind speed prediction using spatial correlation Inf. Sci. 177 24 2007 5775 5797
4. Beale E.M.L. A derivation of conjugate gradients Numerical Methods for Nonlinear Optimization FA Lootsma ed. 1972 Academic Press London 39 43
5. Bel A., Wagner C., Hagras H. Multiobjective optimization and comparison of nonsingleton type-1 and singleton interval type-2 fuzzy logic systems IEEE Trans. Fuzzy Syst. 21 3 2013 459 476
6. Casasent D., Natarajan S. A classifier neural net with complex-valued weights and square-law nonlinearities Neural Netw. 8 6 1995 989 998
7. Castillo O., Melin P. A review on the design and optimization of interval type-2 fuzzy controllers Appl. Soft Comput. 12 4 2012 1267 1278
8. Castillo O., Melin P. Soft-Computing for Control of Non-Linear Dynamical Systems 221 2001 Springer-Verlag
9. Castillo O., Melin P. Type-2 Fuzzy Logic Theory and Applications 2008 Springer-Verlag 29 43
10. Castro J., Castillo O., Melin P. An interval type-2 fuzzy logic toolbox for control applications Proceedings of IEEE Fuzzy Systems Conference 2007 1 6
11. Castro J., Castillo O., Melin P., Mendoza O., Rodríguez-Díaz A. An interval type-2 fuzzy neural network for chaotic time series prediction with cross-validation and akaike test Soft Computing for Intelligent Control and Mobile Robotics 2011 Springer-Verlag Heidelberg, Germany 269 285
12. Castro J., Castillo O., Melin P., Rodríguez-Díaz A. A hybrid learning algorithm for a class of interval type-2 fuzzy neural networks Inf. Sci. 179 13 2009 2175 2193
13. Castro J., Castillo O., Melin P., Rodríguez-Díaz A. Building fuzzy inference systems with a new interval type-2 fuzzy logic toolbox Trans. Comput. Sci. 1 2008 104 114
14. Cazorla M., Escolano F. Two bayesian methods for junction detection IEEE Trans. Image Process. 12 3 2003 317 327
15. De Wilde O. The magnitude of the diagonal elements in neural networks Neural Netw. 10 3 1997 499 504
16. Doostparast Torshizi A., Fazel Zarandi M.H., Zakeri H. On type-reduction of type-2 fuzzy sets: a review Appl. Soft Comput. 25 2015 614 627
17. Draghici S. On the capabilities of neural networks using limited precision weights Neural Netw. 15 3 2002 395 414
18. Fazel Zarandi M.H., Doostparast Torshizi A., Turksen I.B., Rezaee B. A new indirect approach to the type-2 fuzzy systems modeling and design Inf. Sci. 232 20 2013 346 365
19. Feuring T. Learning in fuzzy neural networks Proceedings of IEEE International Conference on Neural Networks 2 1996 1061 1066
20. Fletcher R., Reeves C.M. Function minimization by conjugate gradients Comput. J. 7 1964 149 154
21. Gaxiola F., Melin P., Valdez F., Castillo O. Interval type-2 fuzzy weight adjustment for backpropagation neural networks with application in time series prediction Inf. Sci. 260 2014 1 14
22. Gaxiola F., Melin P., Valdez F. Neural network with fuzzy weights using type-1 and type-2 fuzzy learning with Gaussian membership functions Recent Advances on Hybrid Approaches for Designing Intelligent Systems Studies in Computational Intelligence 547 2014 Springer-Verlag Heidelberg, Germany 51 65
23. Gedeon T. Additive neural networks and periodic patterns Neural Netw. 12 4-5 1999 617 626
24. Greenfield S., Chiclana F. Defuzzification of the discretised generalised type-2 fuzzy set: experimental evaluation Inf. Sci. 244 2013 1 25
25. Hagan M.T., Demuth H.B., Beale M.H. Neural Network Design 736 1996 PWS Publishing Boston
26. Hagras H. Type-2 fuzzy logic controllers: a way forward for fuzzy systems in real world environments Proceedings of IEEE World Congress on Computational Intelligence 2008 181 200 R
27. Hidalgo D., Melin P., Castillo O. An optimization method for designing type-2 fuzzy inference systems based on the footprint of uncertainty using genetic algorithms Expert Syst. Appl. 39 2012 4590 4598
28. Ishibuchi H., Morioka K., Tanaka H. A fuzzy neural network with trapezoid fuzzy weights, fuzzy systems Proceedings of IEEE World Congress on Computational Intelligence 1 1994 228 233
29. Ishibuchi H., Tanaka H., Okada H. Fuzzy neural networks with fuzzy weights and fuzzy biases Proceedings of IEEE International Conference on Neural Networks 3 1993 1650 1655
30. Jang J.S.R., Sun C.T., Mizutani E. Neuro-Fuzzy and Soft Computing: a Computational Approach to Learning and Machine Intelligence 1997 Prentice Hall 614
31. Kamarthi S., Pittner S. Accelerating neural network training using weight extrapolations Neural Netw. 12 9 1999 1285 1299
32. Karnik N., Mendel J. Applications of type-2 fuzzy logic systems to forecasting of time-series Inf. Sci. 120 1-4 1999 89 111
33. Karnik N., Mendel J., Liang Q. Type-2 fuzzy logic systems IEEE Trans. Fuzzy Syst. 7 6 1999 643 658
34. Liu F. An efficient centroid type-reduction strategy for general type-2 fuzzy logic system Inf. Sci. 178 9 2008 2224 2236
35. Liu F., Mendel J., Wu D. Study on enhanced Karnik-Mendel algorithms: initialization explanations and computation improvements Inf. Sci. 184 2012 75 91
36. Lucas L., Centeno T., Delgado M. General type-2 fuzzy inference systems: analysis, design and computational aspects Proceedings of IEEE International Conference on Fuzzy Systems 2007 1107 1112
37. Martinez G., Melin P., Bravo D., Gonzalez F., Gonzalez M. Modular neural networks and fuzzy sugeno integral for face and fingerprint recognition Advances in Soft Computing 34 2006 Springer-Verlag Heidelberg, Germany 603 618
38. Melin P. Modular Neural Networks and Type-2 Fuzzy Systems for Pattern Recognition 2012 Springer 1 204
39. Meltser M., Shoham M., Manevitz L. Approximating functions by neural networks: a constructive solution in the uniform norm Neural Netw. 9 6 1996 965 978
40. Mendel J. Comments on alpha-plane representation for type-2 fuzzy sets: theory and applications IEEE Trans. Fuzzy Syst. 18 1 2010 229 230
41. Mendel J. On KM algorithms for solving type-2 fuzzy set problems IEEE Trans. Fuzzy Syst. 21 3 2013 426 446
42. Mendel J. Uncertain, Rule-Based Fuzzy Logic Systems: Introduction and New Directions 2001 Prentice-Hall
43. Mendel J., John R. Type-2 fuzzy sets made simple IEEE Trans. Fuzzy Syst. 10 2 2002 117 127
44. Mendel J., Liu F., Zhai D. α -plane representation for type-2 fuzzy sets: theory and applications IEEE Trans. Fuzzy Syst. 17 5 2009 1189 1207
45. Mo H., Wang F.Y., Zhou M., Li R., Xiao Z. Footprint of uncertainty for type-2 fuzzy sets Inf. Sci. 272 2014 96 110
46. Moller M.F. A scaled conjugate gradient algorithm for fast supervised learning Neural Netw. 6 1993 525 533
47. Monirul Islam M.D., Murase K. A new algorithm to design compact two-hidden-layer artificial neural networks Neural Netw. 14 9 2001 1265 1278
48. Neville R.S., Eldridge S. Transformations of Sigma-Pi nets: obtaining reflected functions by reflecting weight matrices Neural Netw. 15 3 2002 375 393
49. W. Pedrycz Granular Computing: Analysis and Design of Intelligent Systems 2013 CRC Press/Francis Taylor Boca Raton
50. Phansalkar V.V., Sastry P.S. Analysis of the back-propagation algorithm with momentum IEEE Trans. Neural Netw. 5 3 1994 505 506
51. Powell M.J.D. Restart procedures for the conjugate gradient method Math. Program. 12 1977 241 254
52. Pulido M., Melin P., Castillo O. Genetic optimization of ensemble neural networks for complex time series predicition Proceedings of International Joint Conference on Neural Networks 2011 202 206
53. Salazar P.A., Melin P., Castillo O. A new biometric recognition technique based on hand geometry and voice using neural networks and fuzzy logic Soft Computing for Hybrid Intelligent Systems 2008 Springer-Verlag Heidelberg, Germany 171 186
54. Sepúlveda R., Castillo O., Melin P., Montiel O. An efficient computational method to implement type-2 fuzzy logic in control applications Analysis and Design of Intelligent Systems using Soft Computing Techniques 2007 Springer-Verlag Heidelberg, Germany 45 52
55. Tung S.W., Quek C., Guan C. eT2FIS: an evolving type-2 neural fuzzy inference system Inf. Sci. 220 2013 124 148
56. Wagner C., Hagras H. Toward general type-2 fuzzy logic systems based on zslices IEEE Trans. Fuzzy Syst. 18 4 2010 637 660
57. Wu D. Approaches for reducing the computational cost of interval type-2 fuzzy logic systems: overview and comparisons IEEE Trans. Fuzzy Syst. 21 1 2013 80 99
58. Yam J., Chow T. Weight initialization method for improving training speed in feedforward neural network Neurocomputing 30 1-4 2000 219 232
59. Yeung D., Chan P., Ng W. radial basis function network learning using localized generalization error bound Inf. Sci. 179 19 2009 3199 3217
60. Zhai D., Mendel J. Centroid of a general type-2 fuzzy set computed by means of the centroid-flow algorithm Proceedings of IEEE Fuzzy Systems Conference 2010 1 8
61. Zhai D., Mendel J. Uncertainty measures for general type-2 fuzzy sets Inf. Sci. 181 3 2011 503 518