On-line assurance of interpretability criteria in evolving fuzzy systems - Achievements, new concepts and open issues

Information Sciences

Volumn 251, Issue , 2013, Pages 22-46

  Lughofer, Edwin ^a  

^a JOHANNES KEPLER UNIVERSITY LINZ   (Austria)

Author keywords

Evolving fuzzy system Complexity reduction Interpretability criteria Knowledge expansion On line assurance

Indexed keywords

COMPLEXITY REDUCTION; DISTINGUISHABILITY; EVOLVING FUZZY SYSTEMS; INTERPRETABILITY CRITERION; KNOWLEDGE EXPANSION; ON-LINE ASSURANCES; ON-LINE COMPLEXITY; PRECISE MODELING;

ARTIFICIAL INTELLIGENCE; SOFTWARE ENGINEERING;

FUZZY SYSTEMS;

EID: 84883213469     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2013.07.002     Document Type: Article

References (116)

1. W.C. Abraham, and A. Robins Memory retention - the synaptic stability versus plasticity dilemma Trends in Neurosciences 28 2 2005 73 78
2. R. Akerkar, and P. Sajja Knowledge-Based Systems 2009 Jones & Bartlett Learning Sudbury, MA
3. J.M. Alonso, and L. Magdalena Special issue on interpretable fuzzy systems Information Sciences 181 2011 4331 4339
4. P. Angelov, D. Filev, SimpleTS: a simplified method for learning evolving Takagi-Sugeno fuzzy models, in: Proceedings of FUZZ-IEEE 2005, Reno, Nevada, USA, 2005, pp. 1068-1073.
5. P. Angelov, D. Filev, and N. Kasabov Evolving Intelligent Systems - Methodology and Applications 2010 John Wiley & Sons New York
6. P. Angelov, and A. Kordon Evolving inferential sensors in the chemical process industry P. Angelov, D. Filev, N. Kasabov, Evolving Intelligent Systems: Methodology and Applications 2010 John Wiley & Sons New York 313 336
7. P. Angelov, and X. Zhou Evolving fuzzy-rule-based classifiers from data streams IEEE Transactions on Fuzzy Systems 16 6 2008 1462 1475
8. P.P. Angelov Evolving Rule-Based Models: A Tool for Design of Flexible Adaptive Systems 2002 Springer Verlag Berlin Germany
9. P.P. Angelov An approach for fuzzy rule-base adaptation using on-line clustering International Journal on Approximate Reasoning 35 3 2004 275 289
10. P.P. Angelov Evolving Takagi-Sugeno fuzzy systems from streaming data, eTS+ P. Angelov, D. Filev, N. Kasabov, Evolving Intelligent Systems: Methodology and Applications 2010 John Wiley & Sons New York 21 50
11. P.P. Angelov, and D. Filev An approach to online identification of Takagi-Sugeno fuzzy models IEEE Transactions on Systems, Man and Cybernetics, Part B: Cybernetics 34 1 2004 484 498
12. P.P. Angelov, E. Lughofer, and X. Zhou Evolving fuzzy classifiers using different model architectures Fuzzy Sets and Systems 159 23 2008 3160 3182
13. M. Bikdash A highly interpretable form of Sugeno inference systems IEEE Transactions on Fuzzy Systems 7 6 1999 686 696
14. A. Bouchachia, Incremental induction of classification fuzzy rules, in: IEEE Workshop on Evolving and Self-Developing Intelligent Systems (ESDIS) 2009, Nashville, USA, 2009, pp. 32-39.
15. J. Casillas, O. Cordon, F. Herrera, and L. Magdalena Interpretability Issues in Fuzzy Modeling 2003 Springer Verlag Berlin Heidelberg
16. J. Casillas, O. Cordon, M.J. Del Jesus, and F. Herrera Genetic feature selection in a fuzzy rule-based classification system learning process for high-dimensional problems Information Sciences 136 1-4 2001 135 157
17. G. Castellano, A.M. Fanelli, and C. Mencar A neuro-fuzzy network to generate human-understandable knowledge from data Cognitive Systems Research 3 2002 125 144
18. C. Cernuda, Experimental Analysis on Assessing Interpretability of Fuzzy Rule-Based Systems, PhD Thesis, Universidad de Oviedo, Spain, 2010.
19. K.-S. Chin, A. Chan, and J.-B. Yang Development of a fuzzy FMEA based product design system The International Journal of Advanced Manufacturing Technology 36 7-8 2008 633 649
20. J.S. Cho, and D.J. Park Novel fuzzy logic control based on weighting of partially inconsistent rules using neural network Journal of Intelligent and Fuzzy Systems 8 2 2000 99 110
21. M.-Y. Chow, S. Altug, and H.J. Trussell Heuristic constraints enforcement for training of and knowledge extraction from a fuzzy/neural architecture Part ii: Implementation and application IEEE Transactions on Fuzzy Systems 7 2 1999 151 159
22. V.V. Cross, and T.A. Sudkamp Similarity and Compatibility in Fuzzy Set Theory: Assessment and Applications 2010 Springer Physica Heidelberg New York
23. D. Dovzan, V. Logar, I. Skrjanc, Solving the sales prediction problem with fuzzy evolving methods, in: WCCI 2012 IEEE World Congress on Computational Intelligence, Brisbane, Australia, 2012.
24. D. Dovzan, and I. Skrjanc Recursive clustering based on a Gustafson-Kessel algorithm Evolving Systems 2 1 2011 15 24
25. J.G. Dy, and C.E. Brodley Feature selection for unsupervised learning Journal of Machine Learning Research 5 2004 845 889
26. C. Eitzinger, W. Heidl, E. Lughofer, S. Raiser, J.E. Smith, M.A. Tahir, D. Sannen, and H. van Brussel Assessment of the influence of adaptive components in trainable surface inspection systems Machine Vision and Applications 21 5 2010 613 626
27. J. Feng An intelligent decision support system based on machine learning and dynamic track of psychological evaluation criterion J. Kacpzryk, Intelligent Decision and Policy Making Support Systems 2008 Springer Heidelberg Berlin
28. A. Fiordaliso A constrained Takagi-Sugeno fuzzy system that allows for better interpretation and analysis Fuzzy Sets and Systems 118 2 2001 281 296
29. G.F. Franklin, J.D. Powell, and A. Emami-Naeini Feedback Control of Dynamic Systems 2009 Pearson Higher Education Upper Saddle River New Jersey
30. M.J. Gacto, R. Alcala, and F. Herrera Interpretability of linguistic fuzzy rule-based systems: an overview of interpretability measures Information Sciences 181 20 2011 4340 4360
31. J. Gama Knowledge Discovery from Data Streams 2010 Chapman & Hall/CRC Boca Raton, Florida
32. J. Gama, P. Medas, G. Castillo, and P. Rodrigues Learning with drift detection Lecture Notes in Computer Science vol. 3171 2004 Springer Berlin Heidelberg 286 295
33. J.J. Govindhasamy, S.F. McLoone, and G.W. Irwin Second-order training of adaptive critics for online process control IEEE Transactions on Systems, Man and Cybernetics, Part B: Cybernetics 35 2 2006 381 385
34. C. Hametner, and S. Jakubek Local model network identification for online engine modelling Information Sciences 220 2013 210 225
35. F.H. Hamker RBF learning in a non-stationary environment: the stability-plasticity dilemma R.J. Howlett, L.C. Jain, Radial Basis Function Networks 1: Recent Developments in Theory and Applications 2001 Physica Verlag Heidelberg, New York 219 251
36. F.E. Harrel Regression Modeling Strategies 2001 Springer New York, USA
37. T. Hastie, R. Tibshirani, and J. Friedman The Elements of Statistical Learn-ing: Data Mining, Inference and Prediction second ed. 2009 Springer New York Berlin Heidelberg
38. H.A. Hefny Comments on distinguishability quantification of fuzzy sets Information Sciences 177 2007 4832 4839
39. L.J. Herrera, H. Pomares, I. Rojas, O. Valenzuela, and A. Prieto TaSe, a Taylor series-based fuzzy system model that combines interpretability and accuracy Fuzzy Sets and Systems 153 3 2005 403 427
40. M. Hisada, S. Ozawa, K. Zhang, and N. Kasabov Incremental linear discriminant analysis for evolving feature spaces in multitask pattern recognition problems Evolving Systems 1 1 2010 17 27
41. L.O. Jimenez, and D.A. Landgrebe Supervised classification in high-dimensional space: geometrical, statistical, and asymptotical properties of multivariate data IEEE Transactions on Systems, Man and Cybernetics, part C: Reviews and Applications 28 1 1998 39 54
42. Y. Jin Fuzzy modelling of high dimensional systems: complexity reduction and interpretability improvement IEEE Transactions on Fuzzy Systems 8 2 2000 212 221
43. C.F. Juang, and C.T. Lin An on-line self-constructing neural fuzzy inference network and its applications IEEE Transactions on Fuzzy Systems 6 1 1998 12 32
44. A. Kalhor, B.N. Araabi, and C. Lucas An online predictor model as adaptive habitually linear and transiently nonlinear model Evolving Systems 1 1 2010 29 41
45. N.K. Kasabov, and Q. Song DENFIS: dynamic evolving neural-fuzzy inference system and its application for time-series prediction IEEE Transactions on Fuzzy Systems 10 2 2002 144 154
46. E.P. Klement, R. Mesiar, and E. Pap Triangular Norms 2000 Kluwer Academic Publishers Dordrecht Norwell New York London
47. R. Klinkenberg Learning drifting concepts: example selection vs. example weighting Intelligent Data Analysis 8 3 2004 281 300
48. M. Komijani, C. Lucas, B.N. Araabi, and A. Kalhor Introducing evolving Takagi-Sugeno method based on local least squares support vector machine models Evolving Systems 3 2 2012 81 93
49. J. Korbicz, J.M. Koscielny, Z. Kowalczuk, and W. Cholewa Fault Diagnosis - Models. Artificial Intelligence and Applications 2004 Springer Verlag Berlin Heidelberg
50. S. Kullback, and R.A. Leibler On information and sufficiency Annals of Mathematical Statistics 22 1 1951 79 86
51. L. Kuncheva Fuzzy Classifier Design 2000 Physica-Verlag Heidelberg
52. D. Leite, R. Ballini, P. Costa, and F. Gomide Evolving fuzzy granular modeling from nonstationary fuzzy data streams Evolving Systems 3 2 2012 65 79
53. D. Leite, P. Costa, and F. Gomide Interval approach for evolving granular system modeling M. Sayed-Mouchaweh, E. Lughofer, Learning in Non-Stationary Environments: Methods and Applications 2012 Springer New York 271 300
54. A. Lemos, W. Caminhas, and F. Gomide Adaptive fault detection and diagnosis using an evolving fuzzy classifier Information Sciences 220 2013 64 85
55. A. Lemos, W. Caminhasund, and F. Gomide Fuzzy evolving linear regression trees Evolving Systems 2 1 2011 1 14
56. G. Leng A hybrid learning algorithm with a similarity-based pruning strategy for self-adaptive neuro-fuzzy systems Applied Soft Computing 9 4 2009 1354 1366
57. G. Leng, T.M. McGinnity, and G. Prasad An approach for on-line extraction of fuzzy rules using a self-organising fuzzy neural network Fuzzy Sets and Systems 150 2 2005 211 243
58. G. Leng, X.-J. Zeng, and J.A. Keane An improved approach of self-organising fuzzy neural network based on similarity measures Evolving Systems 3 1 2012 19 30
59. C.S. Leung, K.W. Wong, P.F. Sum, and L.W. Chan A pruning method for the recursive least squares algorithm Neural Networks 14 2 2001 147 174
60. E. Lima, M. Hell, R. Ballini, and F. Gomide Evolving fuzzy modeling using participatory learning P. Angelov, D. Filev, N. Kasabov, Evolving Intelligent Systems: Methodology and Applications 2010 John Wiley & Sons New York 67 86
61. Y.Y. Lin, J.-Y. Chang, and C.-T. Lin Identification and prediction of dynamic systems using an interactively recurrent self-evolving fuzzy neural network IEEE Transactions on Neural Networks and Learning Systems 24 2 2013 310 321
62. L. Ljung System Identification: Theory for the User 1999 Prentice Hall PTR, Prentic Hall Inc. Upper Saddle River, New Jersey
63. E. Lughofer Evolving Fuzzy Systems - Methodologies. Advanced Concepts and Applications 2011 Springer Berlin Heidelberg
64. E. Lughofer Human-inspired evolving machines - the next generation of evolving intelligent systems? SMC Newsletter 36 2011
65. E. Lughofer On-line incremental feature weighting in evolving fuzzy classifiers Fuzzy Sets and Systems 163 1 2011 1 23
66. E. Lughofer Flexible evolving fuzzy inference systems from data streams (FLEXFIS++) M. Sayed-Mouchaweh, E. Lughofer, Learning in Non-Stationary Environments: Methods and Applications 2012 Springer New York 205 246
67. E. Lughofer Single-pass active learning with conflict and ignorance Evolving Systems 3 4 2012 251 271
68. E. Lughofer, and P. Angelov Handling drifts and shifts in on-line data streams with evolving fuzzy systems Applied Soft Computing 11 2 2011 2057 2068
69. E. Lughofer, J.-L. Bouchot, and A. Shaker On-line elimination of local redundancies in evolving fuzzy systems Evolving Systems 2 3 2011 165 187
70. E. Lughofer, and O. Buchtala Reliable all-pairs evolving fuzzy classifiers IEEE Transactions on Fuzzy Systems 21 3 2013 10.1109/TFUZZ.2012. 2226892
71. E. Lughofer, C. Eitzinger, and C. Guardiola On-line quality control with flexible evolving fuzzy systems M. Sayed-Mouchaweh, E. Lughofer, Learning in Non-Stationary Environments: Methods and Applications 2012 Springer New York 375 406
72. E. Lughofer, and E. Hüllermeier On-line redundancy elimination in evolving fuzzy regression models using a fuzzy inclusion measure Proceedings of the EUSFLAT 2011 Conference 2011 Elsevier Aix-Les-Bains, France 380 387
73. E. Lughofer, E. Hüllermeier, E.P. Klement, Improving the interpretability of data-driven evolving fuzzy systems, in: Proceedings of EUSFLAT 2005, Barcelona, Spain, 2005, pp. 28-33.
74. E. Lughofer, J.E. Smith, P. Caleb-Solly, M.A. Tahir, C. Eitzinger, D. Sannen, and M. Nuttin Human-machine interaction issues in quality control based on on-line image classification IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans 39 5 2009 960 971
75. E. Lughofer, B. Trawinski, K. Trawinski, O. Kempa, and T. Lasota On employing fuzzy modeling algorithms for the valuation of residential premises Information Sciences 181 23 2011 5123 5142
76. J. Macias-Hernandez, and P. Angelov Applications of evolving intelligent systems to the oil and gas industry P. Angelov, D. Filev, N. Kasabov, Evolving Intelligent Systems: Methodology and Applications 2010 John Wiley & Sons New York 401 421
77. L. Maciel, A. Lemos, F. Gomide, and R. Ballini Evolving fuzzy systems for pricing fixed income options Evolving Systems 3 1 2012 5 18
78. E.H. Mamdani Application of fuzzy logic to approximate reasoning using linguistic systems Fuzzy Sets and Systems 26 12 1977 1182 1191
79. D. Marquardt An algorithm for least-squares estimation of nonlinear parameters SIAM Journal on Applied Mathematics 11 2 1963 431 441
80. C. Mencar, G. Castellano, and A.M. Fanelli Distinguishability quantification of fuzzy sets Information Sciences 177 2007 130 149
81. F.L. Minku, A. White, and X. Yao The impact of diversity on on-line ensemble learning in the presence of concept drift IEEE Transactions on Knowledge and Data Engineering 22 2010 730 742
82. D. Nauck Adaptive rule weights in neuro-fuzzy systems Neural Computing and Applications 9 2000 60 70
83. D. Nauck, R. Kruse, How the learning of rule weights affects the interpretability of fuzzy systems, in: Proceedings of Fuzz-IEEE '98, Anchorage, Alaska, 1998, pp. 1235-1240.
84. O. Nelles Nonlinear System Identification 2001 Springer Berlin
85. L.S.H. Ngia, and J. Sjöberg Efficient training of neural nets for nonlinear adaptive filtering using a recursive Levenberg-Marquardt algorithm IEEE Transactions on Signal Processing 48 7 2000 1915 1926
86. J. Valente De Oliveira Towards neuro-linguistic modeling: constraints for optimization of membership functions Fuzzy Sets and Systems 106 1999 357 380
87. N.R. Pal, and K. Pal Handling of inconsistent rules with an extended model of fuzzy reasoning Journal of Intelligent and Fuzzy Systems 7 1999 55 73
88. W. Pedrycz, J. Berezowski, and I. Jamal A granular description of data: a study in evolvable systems M. Sayed-Mouchaweh, E. Lughofer, Learning in Non-Stationary Environments: Methods and Applications 2012 Springer New York 57 76
89. W. Pedrycz, and F. Gomide Fuzzy Systems Engineering: Toward Human-Centric Computing 2007 John Wiley & Sons Hoboken, New Jersey
90. M. Pratama, S.G. Anavatti, E. Lughofer, GENFIS: towards and effective localist network, IEEE Transactions on Fuzzy Systems, 2013 (in press). < http://dx.doi.org/10.1109/TFUZZ.2013.2264938 >.
91. M. Pratama, M.J. Er, X. Li, R.J. Oentaryo, E. Lughofer, and I. Arifin Data driven modeling based on dynamic parsimonious fuzzy neural network Neurocomputing 110 2013 18 28
92. J.V. Ramos, C. Pereira, and A. Dourado The building of interpretable systems in real-time P. Angelov, D. Filev, N. Kasabov, Evolving Intelligent Systems: Methodology and Applications 2010 John Wiley & Sons New York 127 150
93. A. Riid, and E. Rüstern Identification of transparent, compact, accurate and reliable linguistic fuzzy models Information Sciences 181 20 2011 4378 4393
94. H.-J. Rong Sequential adaptive fuzzy inference system for function approximation problems M. Sayed-Mouchaweh, E. Lughofer, Learning in Non-Stationary Environments: Methods and Applications 2012 Springer New York
95. H.-J. Rong, N. Sundararajan, G.-B. Huang, and P. Saratchandran Sequential adaptive fuzzy inference system (SAFIS) for nonlinear system identification and prediction Fuzzy Sets and Systems 157 9 2006 1260 1275
96. H.-J. Rong, N. Sundararajan, G.-B. Huang, and G.-S. Zhao Extended sequential adaptive fuzzy inference system for classification problems Evolving Systems 2 2 2011 71 82
97. N. Rosemann, W. Brockmann, B. Neumann, Enforcing local properties in online learning first order TS-fuzzy systems by incremental regularization, in: Proceedings of IFSA-EUSFLAT 2009, Lisbon, Portugal, 2009, pp. 466-471.
98. J.J. Rubio Stability analysis for an on-line evolving neuro-fuzzy recurrent network P. Angelov, D. Filev, N. Kasabov, Evolving Intelligent Systems: Methodology and Applications 2010 John Wiley & Sons New York 173 199
99. E.H. Ruspini A new approach to clustering Information and Control 15 1 1969 22 32
100. S. Saminger-Platz, R. Mesiar, and D. Dubois Aggregation operators and commuting IEEE Transactions on Fuzzy Systems 15 6 2007 1032 1045
101. M. Sayed-Mouchaweh, and E. Lughofer Learning in Non-Stationary Environments: Methods and Applications 2012 Springer New York
102. M. Setnes Simplification and reduction of fuzzy rules J. Casillas, O. Cordón, F. Herrera, L. Magdalena, Interpretability Issues in Fuzzy Modeling 2003 Springer Berlin 278 302
103. M. Setnes, R. Babuska, U. Kaymak, and H.R.v.N. Lemke Similarity measures in fuzzy rule base simplification IEEE Transactions on Systems, Man and Cybernetics, Part B: Cybernetics 28 3 1998 376 386
104. A. Shaker, R. Senge, and E. Hüllermeier Evolving fuzzy patterns trees for binary classification on data streams Information Sciences 220 2012 34 45
105. H. Soleimani, K. Lucas, and B.N. Araabi Recursive Gath-Geva clustering as a basis for evolving neuro-fuzzy modeling Evolving Systems 1 1 2010 59 71
106. B. Sridevi, and R. Nadarajan Fuzzy similarity measure for generalized fuzzy numbers International Journal for Open Problems in Computation and Mathematics 2 2 2009 240 253
107. T. Takagi, and M. Sugeno Fuzzy identification of systems and its applications to modeling and control IEEE Transactions on Systems, Man and Cybernetics 15 1 1985 116 132
108. S. Thrun Explanation-Based Neural Network Learning: A Lifelong Learning Approach 1996 Kluwer Academic Publishers Boston, MA
109. S.W. Tung, C. Quek, and C. Guan et2fis: An evolving type-2 neural fuzzy inference system Information Sciences 220 2013 124 148
110. E. Turban, J.E. Aronson, and T.-P. Liang Decision Support Systems and Intelligent Systems seventh ed. 2004 Prentice Hall Upper Saddle River, New Jersey
111. W. Wang, and J. Vrbanek An evolving fuzzy predictor for industrial applications IEEE Transactions on Fuzzy Systems 16 6 2008 1439 1449
112. B.L. Welch The generalization of 'students' problem when several different population variances are involved Biometrika 34 1-2 1947 28 35
113. T. Wetter Medical decision support systems Lecture Notes in Computer Science Medical Data Analysis 2000 Springer Berlin/Heidelberg 458 466
114. R.R. Yager A model of participatory learning IEEE Transactions on Systems, Man and Cybernetics 20 5 1990 1229 1234
115. J. Yen, L. Wang, and C.W. Gillespie Improving the interpretability of TSK fuzzy models by combining global learning and local learning IEEE Transactions on Fuzzy Systems 6 4 1998 530 537
116. S.M. Zhou, and J.Q. Gan Low-level interpretability and high-level interpretability: a unified view of data-driven interpretable fuzzy systems modelling Fuzzy Sets and Systems 159 23 2008 3091 3131